2024-02-21T23:31:12.224 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-21T23:31:12.224 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191 --owner scheduled_yuriw@teuthology --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi -- /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191/orig.config.yaml 2024-02-21T23:31:12.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T23:31:12.372 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191 branch: wip-yuri10-testing-2024-02-21-1249-reef description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: yweinste@redhat.com first_in_suite: false job_id: '7570191' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific ' name: yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri10-testing-2024-02-21-1249-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: c1dc18f444603397768fcb7c34a8488b10284df6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c1dc18f444603397768fcb7c34a8488b10284df6 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2024-02-21-1249-reef sha1: c1dc18f444603397768fcb7c34a8488b10284df6 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 1691 sha1: c1dc18f444603397768fcb7c34a8488b10284df6 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri10-testing-2024-02-21-1249-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: c1dc18f444603397768fcb7c34a8488b10284df6 targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwlVrfVY0BiEVsdD9CfI+t0GU1XLPzOdSEmbhV6StIwczciyhpJv4W25CfFjSCjjiSUjcBcdPhNsnhmn3rbKLo= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5kR6KISUPHuUFM9/bYxOFY67OipMkuKQLuOJpm70mJDkLbVP0YT/++hnFGfLi41YpixpwzyfM6jfZ3mK9Ww5I= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: pacific exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: pacific cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:pacific roleless: true - print: '**** done end installing pacific cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-21_23:06:32 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-21T23:31:12.372 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa; will attempt to use it 2024-02-21T23:31:12.373 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks 2024-02-21T23:31:12.373 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-21T23:31:12.374 INFO:teuthology.task.internal:Checking packages... 2024-02-21T23:31:12.397 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c1dc18f444603397768fcb7c34a8488b10284df6' 2024-02-21T23:31:12.398 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-21T23:31:12.398 INFO:teuthology.packaging:ref: None 2024-02-21T23:31:12.398 INFO:teuthology.packaging:tag: None 2024-02-21T23:31:12.398 INFO:teuthology.packaging:branch: wip-yuri10-testing-2024-02-21-1249-reef 2024-02-21T23:31:12.398 INFO:teuthology.packaging:sha1: c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-21T23:31:12.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2024-02-21-1249-reef 2024-02-21T23:31:12.617 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-638.gc1dc18f4 2024-02-21T23:31:12.618 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-21T23:31:12.625 INFO:teuthology.task.internal:no buildpackages task found 2024-02-21T23:31:12.625 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-21T23:31:12.644 INFO:teuthology.task.internal:Saving configuration 2024-02-21T23:31:12.664 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-21T23:31:12.671 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T23:31:12.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 23:24:57.977013', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwlVrfVY0BiEVsdD9CfI+t0GU1XLPzOdSEmbhV6StIwczciyhpJv4W25CfFjSCjjiSUjcBcdPhNsnhmn3rbKLo='} 2024-02-21T23:31:12.711 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 23:24:57.975270', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5kR6KISUPHuUFM9/bYxOFY67OipMkuKQLuOJpm70mJDkLbVP0YT/++hnFGfLi41YpixpwzyfM6jfZ3mK9Ww5I='} 2024-02-21T23:31:12.711 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-21T23:31:12.717 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-21T23:31:12.717 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-21T23:31:12.717 INFO:teuthology.run_tasks:Running task console_log... 2024-02-21T23:31:12.792 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0b40fef160>, signals=[15]) 2024-02-21T23:31:12.792 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-21T23:31:12.798 INFO:teuthology.task.internal:Opening connections... 2024-02-21T23:31:12.799 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-02-21T23:31:12.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:31:12.874 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-02-21T23:31:12.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:31:12.946 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-21T23:31:12.953 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-02-21T23:31:12.976 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-02-21T23:31:12.976 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-02-21T23:31:13.037 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-02-21T23:31:13.037 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2024-02-21T23:31:13.037 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-02-21T23:31:13.037 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-02-21T23:31:13.037 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2024-02-21T23:31:13.038 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2024-02-21T23:31:13.038 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-21T23:31:13.038 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-02-21T23:31:13.038 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-21T23:31:13.038 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-02-21T23:31:13.038 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T23:31:13.038 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-21T23:31:13.038 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T23:31:13.039 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-02-21T23:31:13.063 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-02-21T23:31:13.085 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-02-21T23:31:13.086 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-02-21T23:31:13.146 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-02-21T23:31:13.146 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-02-21T23:31:13.146 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-02-21T23:31:13.146 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-02-21T23:31:13.146 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-02-21T23:31:13.146 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-02-21T23:31:13.146 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-21T23:31:13.147 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-02-21T23:31:13.147 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-21T23:31:13.147 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-02-21T23:31:13.147 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T23:31:13.147 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-21T23:31:13.147 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T23:31:13.147 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-02-21T23:31:13.171 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-21T23:31:13.180 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-21T23:31:13.186 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-21T23:31:13.187 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-02-21T23:31:13.189 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-02-21T23:31:13.210 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-21T23:31:13.216 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-21T23:31:13.217 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-02-21T23:31:13.251 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-02-21T23:31:13.284 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-21T23:31:13.336 INFO:teuthology.run_tasks:Running task kernel... 2024-02-21T23:31:13.353 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-21T23:31:13.353 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-21T23:31:13.354 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T23:31:13.354 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T23:31:13.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:31:13.374 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-02-21T23:31:13.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:31:13.375 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-02-21T23:31:13.436 INFO:teuthology.orchestra.run.smithi161.stdout:4.18.0-489.el8.x86_64 2024-02-21T23:31:13.436 INFO:teuthology.task.kernel:Running kernel on smithi161: 4.18.0-489.el8.x86_64 2024-02-21T23:31:13.436 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2024-02-21T23:31:13.437 INFO:teuthology.orchestra.run.smithi049.stdout:4.18.0-489.el8.x86_64 2024-02-21T23:31:13.437 INFO:teuthology.task.kernel:Running kernel on smithi049: 4.18.0-489.el8.x86_64 2024-02-21T23:31:13.438 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2024-02-21T23:31:16.973 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - AppStream 30 MB/s | 27 MB 00:00 2024-02-21T23:31:17.163 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - AppStream 26 MB/s | 27 MB 00:01 2024-02-21T23:33:28.424 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - BaseOS 83 kB/s | 10 MB 02:06 2024-02-21T23:33:30.516 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2024-02-21T23:33:31.067 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2024-02-21T23:33:31.360 INFO:teuthology.orchestra.run.smithi049.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2024-02-21T23:33:33.730 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 16 MB 00:02 2024-02-21T23:33:37.693 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 541 kB/s | 24 kB 00:00 2024-02-21T23:33:40.827 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-21T23:33:40.827 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-21T23:33:40.939 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-21T23:33:40.939 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 4.18.0-540.el8 baseos 10 M 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core x86_64 4.18.0-540.el8 baseos 44 M 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules x86_64 4.18.0-540.el8 baseos 36 M 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout:Install 3 Packages 2024-02-21T23:33:40.940 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-21T23:33:40.941 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 90 M 2024-02-21T23:33:40.941 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 97 M 2024-02-21T23:33:40.941 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-21T23:33:43.036 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - BaseOS 75 kB/s | 10 MB 02:21 2024-02-21T23:33:44.952 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2024-02-21T23:33:45.454 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2024-02-21T23:33:45.680 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-02-21T23:33:46.781 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2024-02-21T23:33:50.664 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 336 kB/s | 24 kB 00:00 2024-02-21T23:33:53.703 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-21T23:33:53.703 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-21T23:33:53.824 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout: kernel x86_64 4.18.0-540.el8 baseos 10 M 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-core x86_64 4.18.0-540.el8 baseos 44 M 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules x86_64 4.18.0-540.el8 baseos 36 M 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-21T23:33:53.825 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-21T23:33:53.826 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-21T23:33:53.826 INFO:teuthology.orchestra.run.smithi161.stdout:Install 3 Packages 2024-02-21T23:33:53.826 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-21T23:33:53.826 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 90 M 2024-02-21T23:33:53.826 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 97 M 2024-02-21T23:33:53.826 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-21T23:37:57.342 INFO:teuthology.orchestra.run.smithi049.stdout:(1/3): kernel-4.18.0-540.el8.x86_64.rpm 41 kB/s | 10 MB 04:16 2024-02-21T23:38:30.769 INFO:teuthology.orchestra.run.smithi161.stdout:(1/3): kernel-4.18.0-540.el8.x86_64.rpm 38 kB/s | 10 MB 04:36 2024-02-21T23:50:04.135 INFO:teuthology.orchestra.run.smithi049.stdout:(2/3): kernel-modules-4.18.0-540.el8.x86_64.rpm 38 kB/s | 36 MB 16:22 2024-02-21T23:50:48.994 INFO:teuthology.orchestra.run.smithi161.stdout:(2/3): kernel-modules-4.18.0-540.el8.x86_64.rpm 37 kB/s | 36 MB 16:54 2024-02-21T23:53:40.623 INFO:teuthology.orchestra.run.smithi161.stdout:(3/3): kernel-core-4.18.0-540.el8.x86_64.rpm 38 kB/s | 44 MB 19:46 2024-02-21T23:53:40.624 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-21T23:53:40.624 INFO:teuthology.orchestra.run.smithi161.stdout:Total 78 kB/s | 90 MB 19:46 2024-02-21T23:53:41.299 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-21T23:53:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-21T23:53:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-21T23:53:42.987 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-21T23:53:43.028 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-21T23:53:45.864 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-21T23:53:46.320 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-core-4.18.0-540.el8.x86_64 1/3 2024-02-21T23:53:49.935 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-4.18.0-540.el8.x86_64 1/3 2024-02-21T23:53:50.352 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-modules-4.18.0-540.el8.x86_64 2/3 2024-02-21T23:53:53.790 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-4.18.0-540.el8.x86_64 2/3 2024-02-21T23:53:54.127 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:16.184 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:16.208 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:16.557 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:16.558 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-4.18.0-540.el8.x86_64 1/3 2024-02-21T23:54:16.558 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-core-4.18.0-540.el8.x86_64 2/3 2024-02-21T23:54:16.686 INFO:teuthology.orchestra.run.smithi049.stdout:(3/3): kernel-core-4.18.0-540.el8.x86_64.rpm 36 kB/s | 44 MB 20:35 2024-02-21T23:54:16.686 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-21T23:54:16.686 INFO:teuthology.orchestra.run.smithi049.stdout:Total 75 kB/s | 90 MB 20:35 2024-02-21T23:54:17.071 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-modules-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:17.071 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-21T23:54:17.071 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-21T23:54:17.071 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-4.18.0-540.el8.x86_64 kernel-core-4.18.0-540.el8.x86_64 2024-02-21T23:54:17.071 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-4.18.0-540.el8.x86_64 2024-02-21T23:54:17.071 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-21T23:54:17.071 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-21T23:54:17.263 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-02-21T23:54:17.398 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-21T23:54:17.484 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-4.18.0-540.el8.x86_64 2024-02-21T23:54:17.484 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-540.el8.x86_64 2024-02-21T23:54:17.485 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-540.el8.x86_64 2024-02-21T23:54:17.485 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-21T23:54:17.485 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-21T23:54:17.485 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-21T23:54:17.485 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2024-02-21T23:54:17.485 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-02-21T23:54:17.695 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-4.18.0-540.el8.x86_64 2024-02-21T23:54:17.696 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-540.el8.x86_64 2024-02-21T23:54:17.696 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2024-02-21T23:54:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2024-02-21T23:54:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2024-02-21T23:54:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.02 2024-02-21T23:54:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 129.el8 2024-02-21T23:54:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2024-02-21T23:54:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-21T23:54:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:Group : System Environment/Base 2024-02-21T23:54:17.730 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 9265586 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Relocations : (not relocatable) 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : CentOS BuildSystem 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-21T23:54:17.731 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-21T23:54:17.732 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-21T23:54:17.732 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2024-02-21T23:54:17.732 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-21T23:54:17.732 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2024-02-21T23:54:17.733 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-21T23:54:17.733 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 4.18.0-540.el8.x86_64 2024-02-21T23:54:17.733 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-21T23:54:17.860 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-21T23:54:17.860 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-21T23:54:19.168 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-21T23:54:19.202 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-21T23:54:19.326 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-02-21T23:54:21.961 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-02-21T23:54:21.962 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-02-21T23:54:21.991 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.1ptbK8Je7Y 2024-02-21T23:54:21.991 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.1ptbK8Je7Y 2024-02-21T23:54:22.064 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.1ptbK8Je7Y 2024-02-21T23:54:22.221 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-21T23:54:22.221 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.1ptbK8Je7Y is 6KB 2024-02-21T23:54:22.270 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.1ptbK8Je7Y 2024-02-21T23:54:22.287 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2024-02-21T23:54:22.380 INFO:teuthology.orchestra.run.smithi161.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-21T23:54:22.380 INFO:teuthology.orchestra.run.smithi161.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-21T23:54:22.380 INFO:teuthology.orchestra.run.smithi161.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-21T23:54:22.380 INFO:teuthology.orchestra.run.smithi161.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-540.el8.x86_64.conf 2024-02-21T23:54:22.381 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-540.el8.x86_64 2024-02-21T23:54:22.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-02-21T23:54:22.768 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-core-4.18.0-540.el8.x86_64 1/3 2024-02-21T23:54:26.598 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-4.18.0-540.el8.x86_64 1/3 2024-02-21T23:54:27.016 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-4.18.0-540.el8.x86_64 2/3 2024-02-21T23:54:30.699 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-4.18.0-540.el8.x86_64 2/3 2024-02-21T23:54:31.018 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:52.504 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-21T23:54:52.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-21T23:54:52.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:54:54.389 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:54.413 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:54.814 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:54.814 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-4.18.0-540.el8.x86_64 1/3 2024-02-21T23:54:54.814 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-core-4.18.0-540.el8.x86_64 2/3 2024-02-21T23:54:55.294 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-4.18.0-540.el8.x86_64 3/3 2024-02-21T23:54:55.294 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-21T23:54:55.294 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-21T23:54:55.294 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-4.18.0-540.el8.x86_64 kernel-core-4.18.0-540.el8.x86_64 2024-02-21T23:54:55.294 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-4.18.0-540.el8.x86_64 2024-02-21T23:54:55.294 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-21T23:54:55.294 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-21T23:54:55.467 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-02-21T23:54:55.697 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-4.18.0-540.el8.x86_64 2024-02-21T23:54:55.697 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-540.el8.x86_64 2024-02-21T23:54:55.697 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-540.el8.x86_64 2024-02-21T23:54:55.697 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-21T23:54:55.697 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-21T23:54:55.697 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-21T23:54:55.697 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2024-02-21T23:54:55.697 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-02-21T23:54:55.916 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-4.18.0-540.el8.x86_64 2024-02-21T23:54:55.917 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-540.el8.x86_64 2024-02-21T23:54:55.917 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.02 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 129.el8 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:Group : System Environment/Base 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 9265586 2024-02-21T23:54:55.951 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Relocations : (not relocatable) 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : CentOS BuildSystem 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-21T23:54:55.952 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-21T23:54:55.953 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2024-02-21T23:54:55.953 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-21T23:54:55.953 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2024-02-21T23:54:55.954 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-21T23:54:55.954 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 4.18.0-540.el8.x86_64 2024-02-21T23:54:55.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-21T23:54:57.634 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-02-21T23:54:59.817 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-02-21T23:54:59.819 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-02-21T23:54:59.854 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.NW7ZyOKfJv 2024-02-21T23:54:59.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NW7ZyOKfJv 2024-02-21T23:54:59.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.NW7ZyOKfJv 2024-02-21T23:55:00.069 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.NW7ZyOKfJv is 6KB 2024-02-21T23:55:00.156 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.NW7ZyOKfJv 2024-02-21T23:55:00.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2024-02-21T23:55:00.258 INFO:teuthology.orchestra.run.smithi049.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-21T23:55:00.258 INFO:teuthology.orchestra.run.smithi049.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-21T23:55:00.258 INFO:teuthology.orchestra.run.smithi049.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-21T23:55:00.258 INFO:teuthology.orchestra.run.smithi049.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-540.el8.x86_64.conf 2024-02-21T23:55:00.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-540.el8.x86_64 2024-02-21T23:55:00.416 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2024-02-21T23:55:11.036 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-21T23:55:20.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-21T23:55:20.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:55:23.100 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-21T23:55:30.424 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-21T23:55:30.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-21T23:55:30.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:55:35.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-21T23:55:35.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:55:48.924 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-02-21T23:55:53.532 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-02-21T23:55:57.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-21T23:55:57.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:56:00.988 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-02-21T23:56:08.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-21T23:56:08.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:56:08.897 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-02-21T23:56:09.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-21T23:56:09.205 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-540.el8.x86_64"... 2024-02-21T23:56:09.205 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-02-21T23:56:09.222 INFO:teuthology.orchestra.run.smithi161.stdout:4.18.0-540.el8.x86_64 2024-02-21T23:56:09.222 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-540.el8.x86_64 vs 4.18.0-540.el8.x86_64 2024-02-21T23:56:09.222 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-21T23:56:09.222 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-21T23:56:10.223 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-21T23:56:10.223 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-21T23:56:10.286 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2024-02-21T23:56:10.300 DEBUG:teuthology.parallel:result is None 2024-02-21T23:56:12.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-21T23:56:12.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:56:16.060 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-02-21T23:56:31.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-21T23:56:31.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:56:34.140 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-02-21T23:56:52.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-21T23:56:52.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:57:10.588 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-02-21T23:57:31.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-21T23:57:31.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T23:57:31.956 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-02-21T23:57:32.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-21T23:57:32.245 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-540.el8.x86_64"... 2024-02-21T23:57:32.245 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-02-21T23:57:32.264 INFO:teuthology.orchestra.run.smithi049.stdout:4.18.0-540.el8.x86_64 2024-02-21T23:57:32.264 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-540.el8.x86_64 vs 4.18.0-540.el8.x86_64 2024-02-21T23:57:32.264 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-21T23:57:32.264 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-21T23:57:33.265 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-21T23:57:33.265 DEBUG:teuthology.orchestra.run.smithi049:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-21T23:57:33.323 INFO:teuthology.orchestra.run.smithi049.stdout:ttyS1 2024-02-21T23:57:33.337 DEBUG:teuthology.parallel:result is None 2024-02-21T23:57:33.337 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-21T23:57:33.345 INFO:teuthology.task.internal:Creating test directory... 2024-02-21T23:57:33.345 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T23:57:33.348 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T23:57:33.372 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-21T23:57:33.379 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-21T23:57:33.389 INFO:teuthology.task.internal:Creating archive directory... 2024-02-21T23:57:33.389 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T23:57:33.409 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T23:57:33.643 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-21T23:57:33.650 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-21T23:57:33.650 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T23:57:33.653 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T23:57:33.690 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T23:57:33.702 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T23:57:33.702 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T23:57:33.714 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T23:57:33.715 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-21T23:57:33.723 INFO:teuthology.task.internal:Configuring sudo... 2024-02-21T23:57:33.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T23:57:33.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T23:57:33.773 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-21T23:57:33.782 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-21T23:57:33.783 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T23:57:33.797 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T23:57:33.832 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T23:57:33.900 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T23:57:33.966 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T23:57:34.012 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T23:57:34.055 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-21T23:57:34.055 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T23:57:34.123 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T23:57:34.171 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T23:57:34.234 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T23:57:34.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T23:57:34.325 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-21T23:57:34.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T23:57:34.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-02-21T23:57:34.396 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-02-21T23:57:34.462 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T23:57:34.497 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T23:57:34.687 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-21T23:57:34.694 INFO:teuthology.task.internal:Starting timer... 2024-02-21T23:57:34.694 INFO:teuthology.run_tasks:Running task pcp... 2024-02-21T23:57:34.704 INFO:teuthology.run_tasks:Running task selinux... 2024-02-21T23:57:34.711 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-21T23:57:34.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2024-02-21T23:57:34.821 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2024-02-21T23:57:34.823 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2024-02-21T23:57:34.892 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2024-02-21T23:57:34.894 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-21T23:57:34.894 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2024-02-21T23:57:34.916 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2024-02-21T23:57:34.917 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2024-02-21T23:57:34.955 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2024-02-21T23:57:34.955 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2024-02-21T23:57:34.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T23:57:34.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:57:34.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T23:57:35.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:57:35.023 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-21T23:57:35.023 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2024-02-21T23:57:35.055 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2024-02-21T23:57:35.089 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-21T23:57:35.099 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-21T23:57:35.119 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-21T23:57:35.120 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-22T00:13:14.012 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2024-02-22T00:13:14.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-22T00:13:14.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T00:13:14.093 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-02-22T00:13:14.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-02-22T00:13:14.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-22T00:13:14.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T00:13:14.238 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-02-22T00:13:14.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-02-22T00:13:14.263 INFO:teuthology.run_tasks:Running task clock... 2024-02-22T00:13:14.274 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-22T00:13:14.274 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-22T00:13:14.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T00:13:14.277 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-22T00:13:14.277 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T00:13:14.311 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-22T00:13:14.326 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-22T00:13:14.335 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-22T00:13:14.348 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-22T00:13:14.390 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2024-02-22T00:13:14.403 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2024-02-22T00:13:14.416 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-22T00:13:14.430 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-22T00:13:14.463 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2024-02-22T00:13:14.473 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2024-02-22T00:13:14.488 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-22T00:13:14.498 INFO:teuthology.orchestra.run.smithi049.stderr:bash: ntpq: command not found 2024-02-22T00:13:14.501 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-22T00:13:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-22T00:13:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-02-22T00:13:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T00:13:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T00:13:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T00:13:14.502 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T00:13:14.563 INFO:teuthology.orchestra.run.smithi161.stderr:bash: ntpq: command not found 2024-02-22T00:13:14.567 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-22T00:13:14.567 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-02-22T00:13:14.567 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T00:13:14.567 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T00:13:14.567 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T00:13:14.567 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T00:13:14.569 INFO:teuthology.run_tasks:Running task pexec... 2024-02-22T00:13:14.579 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-22T00:13:14.579 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:13:14.579 DEBUG:teuthology.orchestra.run.smithi049:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-22T00:13:14.580 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi161.front.sepia.ceph.com 2024-02-22T00:13:14.580 DEBUG:teuthology.orchestra.run.smithi161:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-22T00:13:15.396 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:30 ago on Thu 22 Feb 2024 12:11:45 AM UTC. 2024-02-22T00:13:15.400 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:03:00 ago on Thu 22 Feb 2024 12:10:15 AM UTC. 2024-02-22T00:13:17.444 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout:Resetting modules: 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:13:17.445 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:13:17.601 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout:Resetting modules: 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout: container-tools 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:13:17.602 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:13:17.698 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:13:17.870 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:13:18.550 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:03:03 ago on Thu 22 Feb 2024 12:10:15 AM UTC. 2024-02-22T00:13:18.821 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:33 ago on Thu 22 Feb 2024 12:11:45 AM UTC. 2024-02-22T00:13:20.619 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:13:20.655 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:13:20.655 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:13:20.655 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout:Installing group/module packages: 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: crun x86_64 1.14.1-1.module_el8+951+32019cde appstream 257 k 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-22T00:13:20.656 INFO:teuthology.orchestra.run.smithi161.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:Installing module profiles: 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools/common 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:Enabling module streams: 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout: container-tools rhel8 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:Install 13 Packages 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 27 M 2024-02-22T00:13:20.657 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 91 M 2024-02-22T00:13:20.658 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:13:20.920 INFO:teuthology.orchestra.run.smithi161.stdout:(1/13): cockpit-podman-83-1.module_el8+847+7863 3.1 MB/s | 688 kB 00:00 2024-02-22T00:13:20.959 INFO:teuthology.orchestra.run.smithi161.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 3.9 MB/s | 1.0 MB 00:00 2024-02-22T00:13:20.985 INFO:teuthology.orchestra.run.smithi161.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 590 kB/s | 38 kB 00:00 2024-02-22T00:13:21.010 INFO:teuthology.orchestra.run.smithi161.stdout:(4/13): crun-1.14.1-1.module_el8+951+32019cde.x 5.0 MB/s | 257 kB 00:00 2024-02-22T00:13:21.030 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:13:21.044 INFO:teuthology.orchestra.run.smithi161.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 5.3 MB/s | 180 kB 00:00 2024-02-22T00:13:21.069 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:13:21.069 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout:Installing group/module packages: 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: crun x86_64 1.14.1-1.module_el8+951+32019cde appstream 257 k 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-22T00:13:21.070 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:Installing weak dependencies: 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:Installing module profiles: 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: container-tools/common 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling module streams: 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: container-tools rhel8 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout:Install 13 Packages 2024-02-22T00:13:21.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:13:21.072 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 27 M 2024-02-22T00:13:21.072 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 91 M 2024-02-22T00:13:21.072 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:13:21.085 INFO:teuthology.orchestra.run.smithi161.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 597 kB/s | 25 kB 00:00 2024-02-22T00:13:21.153 INFO:teuthology.orchestra.run.smithi161.stdout:(7/13): netavark-1.10.3-1.module_el8+951+32019c 25 MB/s | 4.1 MB 00:00 2024-02-22T00:13:21.178 INFO:teuthology.orchestra.run.smithi161.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.0 MB/s | 94 kB 00:00 2024-02-22T00:13:21.395 INFO:teuthology.orchestra.run.smithi161.stdout:(9/13): toolbox-0.0.99.5-1.module_el8+847+7863d 12 MB/s | 2.5 MB 00:00 2024-02-22T00:13:21.483 INFO:teuthology.orchestra.run.smithi049.stdout:(1/13): cockpit-podman-83-1.module_el8+847+7863 3.6 MB/s | 688 kB 00:00 2024-02-22T00:13:21.495 INFO:teuthology.orchestra.run.smithi161.stdout:(10/13): skopeo-1.14.3-0.1.module_el8+885+7da14 26 MB/s | 8.8 MB 00:00 2024-02-22T00:13:21.512 INFO:teuthology.orchestra.run.smithi161.stdout:(11/13): udica-0.2.6-20.module_el8+804+f131391c 450 kB/s | 53 kB 00:00 2024-02-22T00:13:21.517 INFO:teuthology.orchestra.run.smithi049.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 4.6 MB/s | 1.0 MB 00:00 2024-02-22T00:13:21.529 INFO:teuthology.orchestra.run.smithi161.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 1.2 MB/s | 41 kB 00:00 2024-02-22T00:13:21.584 INFO:teuthology.orchestra.run.smithi049.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 377 kB/s | 38 kB 00:00 2024-02-22T00:13:21.609 INFO:teuthology.orchestra.run.smithi049.stdout:(4/13): crun-1.14.1-1.module_el8+951+32019cde.x 2.7 MB/s | 257 kB 00:00 2024-02-22T00:13:21.629 INFO:teuthology.orchestra.run.smithi161.stdout:(13/13): buildah-1.33.5-1.module_el8+885+7da147 10 MB/s | 9.7 MB 00:00 2024-02-22T00:13:21.629 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:13:21.629 INFO:teuthology.orchestra.run.smithi161.stdout:Total 28 MB/s | 27 MB 00:00 2024-02-22T00:13:21.651 INFO:teuthology.orchestra.run.smithi049.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 4.2 MB/s | 180 kB 00:00 2024-02-22T00:13:21.701 INFO:teuthology.orchestra.run.smithi049.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 497 kB/s | 25 kB 00:00 2024-02-22T00:13:21.769 INFO:teuthology.orchestra.run.smithi049.stdout:(7/13): netavark-1.10.3-1.module_el8+951+32019c 22 MB/s | 4.1 MB 00:00 2024-02-22T00:13:21.794 INFO:teuthology.orchestra.run.smithi049.stdout:(8/13): python3-pyxdg-0.25-16.el8.noarch.rpm 1.0 MB/s | 94 kB 00:00 2024-02-22T00:13:21.899 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:13:21.911 INFO:teuthology.orchestra.run.smithi049.stdout:(9/13): buildah-1.33.5-1.module_el8+885+7da147f 16 MB/s | 9.7 MB 00:00 2024-02-22T00:13:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:13:21.920 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:13:21.944 INFO:teuthology.orchestra.run.smithi049.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 1.6 MB/s | 53 kB 00:00 2024-02-22T00:13:22.061 INFO:teuthology.orchestra.run.smithi049.stdout:(11/13): toolbox-0.0.99.5-1.module_el8+847+7863 9.5 MB/s | 2.5 MB 00:00 2024-02-22T00:13:22.087 INFO:teuthology.orchestra.run.smithi049.stdout:(12/13): yajl-2.1.0-12.el8.x86_64.rpm 288 kB/s | 41 kB 00:00 2024-02-22T00:13:22.152 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:13:22.155 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:13:22.187 INFO:teuthology.orchestra.run.smithi049.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 21 MB/s | 8.8 MB 00:00 2024-02-22T00:13:22.187 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:13:22.187 INFO:teuthology.orchestra.run.smithi049.stdout:Total 25 MB/s | 27 MB 00:01 2024-02-22T00:13:22.465 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:13:22.487 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:13:22.487 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:13:22.732 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:13:22.735 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:13:22.879 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:13:23.491 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:13:23.814 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-22T00:13:23.998 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-02-22T00:13:24.202 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-02-22T00:13:24.400 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-02-22T00:13:24.495 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-02-22T00:13:24.621 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-02-22T00:13:24.674 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-02-22T00:13:24.877 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-02-22T00:13:25.071 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-02-22T00:13:25.179 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-02-22T00:13:25.343 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-02-22T00:13:25.930 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-02-22T00:13:26.137 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-02-22T00:13:26.346 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 8/13 2024-02-22T00:13:26.566 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : crun-1.14.1-1.module_el8+951+32019cde.x86_64 9/13 2024-02-22T00:13:27.003 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-02-22T00:13:27.017 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-02-22T00:13:27.212 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-22T00:13:27.243 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 8/13 2024-02-22T00:13:27.449 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-22T00:13:27.481 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : crun-1.14.1-1.module_el8+951+32019cde.x86_64 9/13 2024-02-22T00:13:27.634 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-22T00:13:27.946 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : crun-1.14.1-1.module_el8+951+32019cde.x86_64 5/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-02-22T00:13:28.046 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-22T00:13:28.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-22T00:13:28.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-02-22T00:13:28.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-22T00:13:28.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-22T00:13:28.143 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-22T00:13:28.419 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: crun-1.14.1-1.module_el8+951+32019cde.x86_64 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-02-22T00:13:28.662 INFO:teuthology.orchestra.run.smithi161.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-22T00:13:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-22T00:13:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-22T00:13:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-22T00:13:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-22T00:13:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-22T00:13:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-22T00:13:28.663 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:13:28.663 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:13:28.668 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-22T00:13:28.942 DEBUG:teuthology.parallel:result is None 2024-02-22T00:13:29.120 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 13/13 2024-02-22T00:13:29.120 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-02-22T00:13:29.120 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/13 2024-02-22T00:13:29.120 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : crun-1.14.1-1.module_el8+951+32019cde.x86_64 5/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/13 2024-02-22T00:13:29.121 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-02-22T00:13:29.643 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: crun-1.14.1-1.module_el8+951+32019cde.x86_64 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-22T00:13:29.644 INFO:teuthology.orchestra.run.smithi049.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-22T00:13:29.645 INFO:teuthology.orchestra.run.smithi049.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-22T00:13:29.645 INFO:teuthology.orchestra.run.smithi049.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-22T00:13:29.645 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:13:29.645 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:13:29.982 DEBUG:teuthology.parallel:result is None 2024-02-22T00:13:29.983 INFO:teuthology.run_tasks:Running task install... 2024-02-22T00:13:29.994 DEBUG:teuthology.task.install:project ceph 2024-02-22T00:13:29.994 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c1dc18f444603397768fcb7c34a8488b10284df6'}} 2024-02-22T00:13:29.994 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'c1dc18f444603397768fcb7c34a8488b10284df6'} 2024-02-22T00:13:29.994 INFO:teuthology.task.install:Using flavor: default 2024-02-22T00:13:30.003 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-22T00:13:30.003 INFO:teuthology.task.install:extra packages: [] 2024-02-22T00:13:30.003 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c1dc18f444603397768fcb7c34a8488b10284df6', 'tag': None, 'wait_for_package': False} 2024-02-22T00:13:30.004 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-22T00:13:30.004 INFO:teuthology.packaging:ref: None 2024-02-22T00:13:30.004 INFO:teuthology.packaging:tag: None 2024-02-22T00:13:30.004 INFO:teuthology.packaging:branch: pacific 2024-02-22T00:13:30.004 INFO:teuthology.packaging:sha1: c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:13:30.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-02-22T00:13:30.007 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c1dc18f444603397768fcb7c34a8488b10284df6', 'tag': None, 'wait_for_package': False} 2024-02-22T00:13:30.007 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-22T00:13:30.007 INFO:teuthology.packaging:ref: None 2024-02-22T00:13:30.007 INFO:teuthology.packaging:tag: None 2024-02-22T00:13:30.007 INFO:teuthology.packaging:branch: pacific 2024-02-22T00:13:30.007 INFO:teuthology.packaging:sha1: c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:13:30.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-02-22T00:13:30.237 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/pacific/eb66ed921e744301e6863be6353618d63967ea59/centos/8/flavors/default/ 2024-02-22T00:13:30.238 INFO:teuthology.task.install.rpm:Package version is 16.2.14-550.geb66ed92 2024-02-22T00:13:30.249 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/pacific/eb66ed921e744301e6863be6353618d63967ea59/centos/8/flavors/default/ 2024-02-22T00:13:30.249 INFO:teuthology.task.install.rpm:Package version is 16.2.14-550.geb66ed92 2024-02-22T00:13:30.355 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/pacific/eb66ed921e744301e6863be6353618d63967ea59/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/pacific/eb66ed921e744301e6863be6353618d63967ea59/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/pacific/eb66ed921e744301e6863be6353618d63967ea59/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-22T00:13:30.356 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:13:30.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-22T00:13:30.385 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-22T00:13:30.385 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-22T00:13:30.385 INFO:teuthology.packaging:ref: None 2024-02-22T00:13:30.385 INFO:teuthology.packaging:tag: None 2024-02-22T00:13:30.385 INFO:teuthology.packaging:branch: pacific 2024-02-22T00:13:30.385 INFO:teuthology.packaging:sha1: c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:13:30.385 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-22T00:13:30.429 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/pacific/eb66ed921e744301e6863be6353618d63967ea59/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/pacific/eb66ed921e744301e6863be6353618d63967ea59/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/pacific/eb66ed921e744301e6863be6353618d63967ea59/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-22T00:13:30.430 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:13:30.430 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-22T00:13:30.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-22T00:13:30.464 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-22T00:13:30.464 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-22T00:13:30.464 INFO:teuthology.packaging:ref: None 2024-02-22T00:13:30.464 INFO:teuthology.packaging:tag: None 2024-02-22T00:13:30.464 INFO:teuthology.packaging:branch: pacific 2024-02-22T00:13:30.464 INFO:teuthology.packaging:sha1: c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:13:30.465 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-22T00:13:30.533 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-22T00:13:30.535 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-22T00:13:30.600 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2024-02-22T00:13:30.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2024-02-22T00:13:30.617 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-22T00:13:30.687 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2024-02-22T00:13:30.688 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2024-02-22T00:13:30.874 INFO:teuthology.orchestra.run.smithi049.stdout:76 files removed 2024-02-22T00:13:30.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw 2024-02-22T00:13:30.952 INFO:teuthology.orchestra.run.smithi161.stdout:76 files removed 2024-02-22T00:13:30.980 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw 2024-02-22T00:13:31.678 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 219 kB/s | 76 kB 00:00 2024-02-22T00:13:31.695 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 249 kB/s | 76 kB 00:00 2024-02-22T00:13:32.012 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 52 kB/s | 15 kB 00:00 2024-02-22T00:13:32.137 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 38 kB/s | 15 kB 00:00 2024-02-22T00:13:32.588 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 3.4 kB/s | 1.4 kB 00:00 2024-02-22T00:13:32.621 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 2.5 kB/s | 1.4 kB 00:00 2024-02-22T00:13:33.880 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - AppStream 22 MB/s | 27 MB 00:01 2024-02-22T00:13:34.022 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - AppStream 20 MB/s | 27 MB 00:01 2024-02-22T00:17:12.248 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - BaseOS 49 kB/s | 10 MB 03:33 2024-02-22T00:17:14.163 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - Extras 55 kB/s | 18 kB 00:00 2024-02-22T00:17:14.805 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2024-02-22T00:17:15.548 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 8 - PowerTools 7.4 MB/s | 4.9 MB 00:00 2024-02-22T00:17:16.616 INFO:teuthology.orchestra.run.smithi161.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-02-22T00:17:18.608 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2024-02-22T00:17:22.433 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 380 kB/s | 24 kB 00:00 2024-02-22T00:17:25.982 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:17:25.984 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:17:25.984 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:17:25.985 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:17:25.985 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:17:25.985 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:16.2.14-550.geb66ed92.el8 ceph 12 M 2024-02-22T00:17:25.985 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2024-02-22T00:17:25.985 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 3.7 M 2024-02-22T00:17:25.985 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 4.2 M 2024-02-22T00:17:25.985 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:17:25.985 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:16.2.14-550.geb66ed92.el8 ceph 6.1 M 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:16.2.14-550.geb66ed92.el8 ceph 24 M 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:16.2.14-550.geb66ed92.el8 ceph 26 k 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 825 k 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 494 k 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-22T00:17:25.986 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 3.8 M 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:16.2.14-550.geb66ed92.el8 ceph 45 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:16.2.14-550.geb66ed92.el8 ceph 99 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:16.2.14-550.geb66ed92.el8 ceph 215 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:16.2.14-550.geb66ed92.el8 ceph 389 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:16.2.14-550.geb66ed92.el8 ceph 369 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:16.2.14-550.geb66ed92.el8 ceph 114 k 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:17:25.987 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:17:25.988 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:17:25.988 INFO:teuthology.orchestra.run.smithi161.stdout:Install 21 Packages 2024-02-22T00:17:25.988 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 2 Packages 2024-02-22T00:17:25.988 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:17:25.988 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 58 M 2024-02-22T00:17:25.989 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:17:26.943 INFO:teuthology.orchestra.run.smithi161.stdout:(1/23): ceph-base-16.2.14-550.geb66ed92.el8.x86 7.2 MB/s | 6.1 MB 00:00 2024-02-22T00:17:27.010 INFO:teuthology.orchestra.run.smithi161.stdout:(2/23): ceph-selinux-16.2.14-550.geb66ed92.el8. 386 kB/s | 26 kB 00:00 2024-02-22T00:17:27.160 INFO:teuthology.orchestra.run.smithi161.stdout:(3/23): libcephfs2-16.2.14-550.geb66ed92.el8.x8 5.4 MB/s | 825 kB 00:00 2024-02-22T00:17:27.260 INFO:teuthology.orchestra.run.smithi161.stdout:(4/23): libradosstriper1-16.2.14-550.geb66ed92. 4.8 MB/s | 494 kB 00:00 2024-02-22T00:17:27.469 INFO:teuthology.orchestra.run.smithi161.stdout:(5/23): ceph-radosgw-16.2.14-550.geb66ed92.el8. 8.4 MB/s | 12 MB 00:01 2024-02-22T00:17:27.552 INFO:teuthology.orchestra.run.smithi161.stdout:(6/23): python3-ceph-argparse-16.2.14-550.geb66 540 kB/s | 45 kB 00:00 2024-02-22T00:17:27.645 INFO:teuthology.orchestra.run.smithi161.stdout:(7/23): python3-ceph-common-16.2.14-550.geb66ed 1.1 MB/s | 99 kB 00:00 2024-02-22T00:17:27.703 INFO:teuthology.orchestra.run.smithi161.stdout:(8/23): librgw2-16.2.14-550.geb66ed92.el8.x86_6 8.6 MB/s | 3.8 MB 00:00 2024-02-22T00:17:27.728 INFO:teuthology.orchestra.run.smithi161.stdout:(9/23): python3-cephfs-16.2.14-550.geb66ed92.el 2.5 MB/s | 215 kB 00:00 2024-02-22T00:17:27.787 INFO:teuthology.orchestra.run.smithi161.stdout:(10/23): python3-rados-16.2.14-550.geb66ed92.el 4.6 MB/s | 389 kB 00:00 2024-02-22T00:17:27.821 INFO:teuthology.orchestra.run.smithi161.stdout:(11/23): python3-rbd-16.2.14-550.geb66ed92.el8. 3.9 MB/s | 369 kB 00:00 2024-02-22T00:17:27.913 INFO:teuthology.orchestra.run.smithi161.stdout:(12/23): python3-rgw-16.2.14-550.geb66ed92.el8. 914 kB/s | 114 kB 00:00 2024-02-22T00:17:28.149 INFO:teuthology.orchestra.run.smithi161.stdout:(13/23): ceph-common-16.2.14-550.geb66ed92.el8. 12 MB/s | 24 MB 00:02 2024-02-22T00:17:28.215 INFO:teuthology.orchestra.run.smithi161.stdout:(14/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.7 MB/s | 677 kB 00:00 2024-02-22T00:17:28.232 INFO:teuthology.orchestra.run.smithi161.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 528 kB/s | 44 kB 00:00 2024-02-22T00:17:28.266 INFO:teuthology.orchestra.run.smithi161.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 735 kB/s | 259 kB 00:00 2024-02-22T00:17:28.433 INFO:teuthology.orchestra.run.smithi161.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 1.1 MB/s | 181 kB 00:00 2024-02-22T00:17:28.458 INFO:teuthology.orchestra.run.smithi161.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2024-02-22T00:17:28.475 INFO:teuthology.orchestra.run.smithi161.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2024-02-22T00:17:28.500 INFO:teuthology.orchestra.run.smithi161.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.7 MB/s | 75 kB 00:00 2024-02-22T00:17:28.809 INFO:teuthology.orchestra.run.smithi161.stdout:(21/23): librados2-16.2.14-550.geb66ed92.el8.x8 11 MB/s | 3.7 MB 00:00 2024-02-22T00:17:28.884 INFO:teuthology.orchestra.run.smithi161.stdout:(22/23): librbd1-16.2.14-550.geb66ed92.el8.x86_ 11 MB/s | 4.2 MB 00:00 2024-02-22T00:17:32.747 INFO:teuthology.orchestra.run.smithi161.stdout:(23/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 10 kB/s | 47 kB 00:04 2024-02-22T00:17:32.751 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:17:32.751 INFO:teuthology.orchestra.run.smithi161.stdout:Total 8.6 MB/s | 58 MB 00:06 2024-02-22T00:17:32.795 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:17:32.844 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:17:32.844 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:17:33.170 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:17:33.173 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:17:34.151 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:17:34.334 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-02-22T00:17:34.530 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-22T00:17:34.927 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-22T00:17:35.130 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:16.2.14-550.geb66ed92.el8.x86_64 3/25 2024-02-22T00:17:35.207 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:16.2.14-550.geb66ed92.el8.x86_64 3/25 2024-02-22T00:17:35.445 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:16.2.14-550.geb66ed92.el8.x86_64 4/25 2024-02-22T00:17:35.630 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 5/25 2024-02-22T00:17:36.042 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 5/25 2024-02-22T00:17:36.238 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 6/25 2024-02-22T00:17:36.305 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 6/25 2024-02-22T00:17:36.498 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-02-22T00:17:36.980 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-02-22T00:17:37.147 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:16.2.14-550.geb66ed92.el8.x86_64 9/25 2024-02-22T00:17:37.225 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:16.2.14-550.geb66ed92.el8.x86_64 9/25 2024-02-22T00:17:37.386 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-02-22T00:17:37.586 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:16.2.14-550.geb66ed92.el8. 11/25 2024-02-22T00:17:37.767 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:16.2.14-550.geb66ed92.el8.x86_64 12/25 2024-02-22T00:17:37.990 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:16.2.14-550.geb66ed92.el8.x86_64 13/25 2024-02-22T00:17:38.213 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:16.2.14-550.geb66ed92.el8.x86_64 14/25 2024-02-22T00:17:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:16.2.14-550.geb66ed92.el8.x86_6 15/25 2024-02-22T00:17:38.432 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:16.2.14-550.geb66ed92.el8.x86_6 15/25 2024-02-22T00:17:38.657 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-02-22T00:17:38.838 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-02-22T00:17:39.017 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-02-22T00:17:39.267 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:16.2.14-550.geb66ed92.el8.x8 19/25 2024-02-22T00:17:41.715 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 20/25 2024-02-22T00:17:41.955 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 20/25 2024-02-22T00:17:42.665 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 20/25 2024-02-22T00:17:42.945 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 21/25 2024-02-22T00:17:43.030 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 21/25 2024-02-22T00:17:43.162 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:16.2.14-550.geb66ed92.el8.x86_64 22/25 2024-02-22T00:17:49.598 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - BaseOS 42 kB/s | 10 MB 04:10 2024-02-22T00:17:51.648 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2024-02-22T00:17:52.307 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2024-02-22T00:17:53.008 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 8 - PowerTools 8.1 MB/s | 4.9 MB 00:00 2024-02-22T00:17:54.109 INFO:teuthology.orchestra.run.smithi049.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2024-02-22T00:17:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2024-02-22T00:17:59.010 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 430 kB/s | 24 kB 00:00 2024-02-22T00:18:02.265 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:16.2.14-550.geb66ed92.el8.x86_64 22/25 2024-02-22T00:18:02.265 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2024-02-22T00:18:02.265 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2024-02-22T00:18:02.265 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2024-02-22T00:18:02.266 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /run 2024-02-22T00:18:02.266 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2024-02-22T00:18:02.266 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2024-02-22T00:18:02.266 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2024-02-22T00:18:02.266 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2024-02-22T00:18:02.266 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /dev 2024-02-22T00:18:02.266 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:02.785 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:18:02.789 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:02.789 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:18:02.789 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:02.789 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:18:02.789 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:16.2.14-550.geb66ed92.el8 ceph 12 M 2024-02-22T00:18:02.789 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2024-02-22T00:18:02.789 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 3.7 M 2024-02-22T00:18:02.789 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 4.2 M 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:16.2.14-550.geb66ed92.el8 ceph 6.1 M 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:16.2.14-550.geb66ed92.el8 ceph 24 M 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:16.2.14-550.geb66ed92.el8 ceph 26 k 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 825 k 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 494 k 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-02-22T00:18:02.790 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:16.2.14-550.geb66ed92.el8 ceph 3.8 M 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:16.2.14-550.geb66ed92.el8 ceph 45 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:16.2.14-550.geb66ed92.el8 ceph 99 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:16.2.14-550.geb66ed92.el8 ceph 215 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:16.2.14-550.geb66ed92.el8 ceph 389 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:16.2.14-550.geb66ed92.el8 ceph 369 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:16.2.14-550.geb66ed92.el8 ceph 114 k 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout:Install 21 Packages 2024-02-22T00:18:02.791 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 2 Packages 2024-02-22T00:18:02.792 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:02.792 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 58 M 2024-02-22T00:18:02.792 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:18:03.459 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:16.2.14-550.geb66ed92.el8.x86_64 23/25 2024-02-22T00:18:03.522 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-550.geb66ed92.el8.x86_64 23/25 2024-02-22T00:18:03.522 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-22T00:18:03.753 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-22T00:18:03.753 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-22T00:18:03.970 INFO:teuthology.orchestra.run.smithi049.stdout:(1/23): ceph-radosgw-16.2.14-550.geb66ed92.el8. 14 MB/s | 12 MB 00:00 2024-02-22T00:18:04.003 INFO:teuthology.orchestra.run.smithi049.stdout:(2/23): ceph-selinux-16.2.14-550.geb66ed92.el8. 771 kB/s | 26 kB 00:00 2024-02-22T00:18:04.095 INFO:teuthology.orchestra.run.smithi049.stdout:(3/23): libcephfs2-16.2.14-550.geb66ed92.el8.x8 8.8 MB/s | 825 kB 00:00 2024-02-22T00:18:04.146 INFO:teuthology.orchestra.run.smithi049.stdout:(4/23): libradosstriper1-16.2.14-550.geb66ed92. 9.7 MB/s | 494 kB 00:00 2024-02-22T00:18:04.413 INFO:teuthology.orchestra.run.smithi049.stdout:(5/23): librgw2-16.2.14-550.geb66ed92.el8.x86_6 14 MB/s | 3.8 MB 00:00 2024-02-22T00:18:04.441 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-22T00:18:04.441 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 1/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 2/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:16.2.14-550.geb66ed92.el8.x86_64 3/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:16.2.14-550.geb66ed92.el8.x86_64 4/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 5/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:16.2.14-550.geb66ed92.el8.x86_6 6/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:16.2.14-550.geb66ed92.el8.x86_64 7/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:16.2.14-550.geb66ed92.el8. 8/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:16.2.14-550.geb66ed92.el8.x8 9/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:16.2.14-550.geb66ed92.el8.x86_64 10/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:16.2.14-550.geb66ed92.el8.x86_64 11/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:16.2.14-550.geb66ed92.el8.x86_64 12/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:16.2.14-550.geb66ed92.el8.x86_64 13/25 2024-02-22T00:18:04.442 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:16.2.14-550.geb66ed92.el8.x86_64 22/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-02-22T00:18:04.443 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 24/25 2024-02-22T00:18:04.463 INFO:teuthology.orchestra.run.smithi049.stdout:(6/23): python3-ceph-argparse-16.2.14-550.geb66 901 kB/s | 45 kB 00:00 2024-02-22T00:18:04.539 INFO:teuthology.orchestra.run.smithi049.stdout:(7/23): ceph-base-16.2.14-550.geb66ed92.el8.x86 4.4 MB/s | 6.1 MB 00:01 2024-02-22T00:18:04.564 INFO:teuthology.orchestra.run.smithi049.stdout:(8/23): python3-ceph-common-16.2.14-550.geb66ed 985 kB/s | 99 kB 00:00 2024-02-22T00:18:04.605 INFO:teuthology.orchestra.run.smithi049.stdout:(9/23): python3-cephfs-16.2.14-550.geb66ed92.el 3.2 MB/s | 215 kB 00:00 2024-02-22T00:18:04.631 INFO:teuthology.orchestra.run.smithi049.stdout:(10/23): python3-rados-16.2.14-550.geb66ed92.el 5.7 MB/s | 389 kB 00:00 2024-02-22T00:18:04.673 INFO:teuthology.orchestra.run.smithi049.stdout:(11/23): python3-rbd-16.2.14-550.geb66ed92.el8. 5.4 MB/s | 369 kB 00:00 2024-02-22T00:18:04.698 INFO:teuthology.orchestra.run.smithi049.stdout:(12/23): python3-rgw-16.2.14-550.geb66ed92.el8. 1.7 MB/s | 114 kB 00:00 2024-02-22T00:18:04.790 INFO:teuthology.orchestra.run.smithi049.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2024-02-22T00:18:04.816 INFO:teuthology.orchestra.run.smithi049.stdout:(14/23): librdkafka-1.6.1-1.el8.x86_64.rpm 4.6 MB/s | 677 kB 00:00 2024-02-22T00:18:04.841 INFO:teuthology.orchestra.run.smithi049.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 876 kB/s | 44 kB 00:00 2024-02-22T00:18:05.016 INFO:teuthology.orchestra.run.smithi049.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.7 MB/s | 306 kB 00:00 2024-02-22T00:18:05.083 INFO:teuthology.orchestra.run.smithi049.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 2.7 MB/s | 181 kB 00:00 2024-02-22T00:18:05.125 INFO:teuthology.orchestra.run.smithi049.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2024-02-22T00:18:05.175 INFO:teuthology.orchestra.run.smithi049.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-02-22T00:18:05.385 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: leveldb-1.22-1.el8.x86_64 2024-02-22T00:18:05.386 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-22T00:18:05.387 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.388 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.388 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:05.388 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:05.388 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:18:05.705 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-test 2024-02-22T00:18:05.734 INFO:teuthology.orchestra.run.smithi049.stdout:(20/23): ceph-common-16.2.14-550.geb66ed92.el8. 9.3 MB/s | 24 MB 00:02 2024-02-22T00:18:05.801 INFO:teuthology.orchestra.run.smithi049.stdout:(21/23): librados2-16.2.14-550.geb66ed92.el8.x8 6.0 MB/s | 3.7 MB 00:00 2024-02-22T00:18:05.826 INFO:teuthology.orchestra.run.smithi049.stdout:(22/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 47 kB/s | 47 kB 00:01 2024-02-22T00:18:06.002 INFO:teuthology.orchestra.run.smithi049.stdout:(23/23): librbd1-16.2.14-550.geb66ed92.el8.x86_ 16 MB/s | 4.2 MB 00:00 2024-02-22T00:18:06.004 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:18:06.004 INFO:teuthology.orchestra.run.smithi049.stdout:Total 18 MB/s | 58 MB 00:03 2024-02-22T00:18:06.048 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:18:06.099 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:18:06.099 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:18:06.434 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:18:06.438 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:18:06.463 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:44 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:18:07.431 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:18:07.642 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-02-22T00:18:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-22T00:18:08.003 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:18:08.004 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:18:08.004 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:18:08.004 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:18:08.004 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:18:08.005 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:16.2.14-550.geb66ed92.el8 ceph 52 M 2024-02-22T00:18:08.005 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:18:08.005 INFO:teuthology.orchestra.run.smithi161.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-22T00:18:08.005 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:16.2.14-550.geb66ed92.el8 ceph 174 k 2024-02-22T00:18:08.005 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-22T00:18:08.005 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-22T00:18:08.005 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-22T00:18:08.005 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:08.006 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:18:08.006 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:18:08.006 INFO:teuthology.orchestra.run.smithi161.stdout:Install 6 Packages 2024-02-22T00:18:08.006 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:08.007 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 53 M 2024-02-22T00:18:08.007 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 197 M 2024-02-22T00:18:08.007 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:18:08.129 INFO:teuthology.orchestra.run.smithi161.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 2.4 MB/s | 203 kB 00:00 2024-02-22T00:18:08.171 INFO:teuthology.orchestra.run.smithi161.stdout:(2/6): oniguruma-6.8.2-3.el8.x86_64.rpm 4.5 MB/s | 188 kB 00:00 2024-02-22T00:18:08.199 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-02-22T00:18:08.213 INFO:teuthology.orchestra.run.smithi161.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2024-02-22T00:18:08.247 INFO:teuthology.orchestra.run.smithi161.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2024-02-22T00:18:08.347 INFO:teuthology.orchestra.run.smithi161.stdout:(5/6): libcephsqlite-16.2.14-550.geb66ed92.el8. 579 kB/s | 174 kB 00:00 2024-02-22T00:18:08.381 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:16.2.14-550.geb66ed92.el8.x86_64 3/25 2024-02-22T00:18:08.586 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.14-550.geb66ed92.el8.x86_64 3/25 2024-02-22T00:18:08.816 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:16.2.14-550.geb66ed92.el8.x86_64 4/25 2024-02-22T00:18:08.980 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 5/25 2024-02-22T00:18:09.401 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 5/25 2024-02-22T00:18:09.572 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 6/25 2024-02-22T00:18:09.623 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 6/25 2024-02-22T00:18:09.826 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-02-22T00:18:10.354 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-02-22T00:18:10.505 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:16.2.14-550.geb66ed92.el8.x86_64 9/25 2024-02-22T00:18:10.514 INFO:teuthology.orchestra.run.smithi161.stdout:(6/6): ceph-test-16.2.14-550.geb66ed92.el8.x86_ 21 MB/s | 52 MB 00:02 2024-02-22T00:18:10.516 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:18:10.516 INFO:teuthology.orchestra.run.smithi161.stdout:Total 21 MB/s | 53 MB 00:02 2024-02-22T00:18:10.558 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:18:10.579 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:18:10.579 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:18:10.580 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:16.2.14-550.geb66ed92.el8.x86_64 9/25 2024-02-22T00:18:10.753 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-02-22T00:18:10.873 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:18:10.877 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:18:10.903 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:16.2.14-550.geb66ed92.el8. 11/25 2024-02-22T00:18:11.076 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:16.2.14-550.geb66ed92.el8.x86_64 12/25 2024-02-22T00:18:11.267 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:16.2.14-550.geb66ed92.el8.x86_64 13/25 2024-02-22T00:18:11.351 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:18:11.466 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:16.2.14-550.geb66ed92.el8.x86_64 14/25 2024-02-22T00:18:11.601 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-22T00:18:11.605 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:16.2.14-550.geb66ed92.el8.x86_6 15/25 2024-02-22T00:18:11.676 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:16.2.14-550.geb66ed92.el8.x86_6 15/25 2024-02-22T00:18:11.777 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-22T00:18:11.892 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-02-22T00:18:11.916 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-22T00:18:11.984 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-22T00:18:12.063 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-02-22T00:18:12.172 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-22T00:18:12.235 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-02-22T00:18:12.324 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:16.2.14-550.geb66ed92.el8.x86_64 5/6 2024-02-22T00:18:12.426 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:16.2.14-550.geb66ed92.el8.x8 19/25 2024-02-22T00:18:15.004 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 20/25 2024-02-22T00:18:15.205 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 20/25 2024-02-22T00:18:15.958 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 20/25 2024-02-22T00:18:16.257 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 21/25 2024-02-22T00:18:16.359 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 21/25 2024-02-22T00:18:16.496 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:16.2.14-550.geb66ed92.el8.x86_64 22/25 2024-02-22T00:18:16.978 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:16.2.14-550.geb66ed92.el8.x86_64 5/6 2024-02-22T00:18:17.256 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:16.2.14-550.geb66ed92.el8.x86_64 6/6 2024-02-22T00:18:17.529 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-test-2:16.2.14-550.geb66ed92.el8.x86_64 6/6 2024-02-22T00:18:17.529 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:16.2.14-550.geb66ed92.el8.x86_64 1/6 2024-02-22T00:18:17.530 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:16.2.14-550.geb66ed92.el8.x86_64 2/6 2024-02-22T00:18:17.530 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-22T00:18:17.530 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-22T00:18:17.530 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: jq-1.6-8.el8.x86_64 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-1.el8.x86_64 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:18.009 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:18:18.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph 2024-02-22T00:18:19.051 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:57 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:18:20.624 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:18:20.627 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:18:20.627 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:16.2.14-550.geb66ed92.el8 ceph 6.4 k 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:16.2.14-550.geb66ed92.el8 ceph 2.4 M 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:16.2.14-550.geb66ed92.el8 ceph 1.6 M 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 245 k 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:16.2.14-550.geb66ed92.el8 ceph 5.2 M 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:16.2.14-550.geb66ed92.el8 ceph 19 M 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-22T00:18:20.628 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-22T00:18:20.629 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-22T00:18:20.630 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:20.631 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:18:20.631 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:18:20.631 INFO:teuthology.orchestra.run.smithi161.stdout:Install 32 Packages 2024-02-22T00:18:20.631 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:20.631 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 32 M 2024-02-22T00:18:20.631 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 104 M 2024-02-22T00:18:20.632 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:18:21.107 INFO:teuthology.orchestra.run.smithi161.stdout:(1/32): ceph-16.2.14-550.geb66ed92.el8.x86_64.r 34 kB/s | 6.4 kB 00:00 2024-02-22T00:18:21.308 INFO:teuthology.orchestra.run.smithi161.stdout:(2/32): ceph-mds-16.2.14-550.geb66ed92.el8.x86_ 6.3 MB/s | 2.4 MB 00:00 2024-02-22T00:18:21.341 INFO:teuthology.orchestra.run.smithi161.stdout:(3/32): ceph-mgr-16.2.14-550.geb66ed92.el8.x86_ 3.9 MB/s | 1.6 MB 00:00 2024-02-22T00:18:21.425 INFO:teuthology.orchestra.run.smithi161.stdout:(4/32): ceph-mgr-modules-core-16.2.14-550.geb66 2.9 MB/s | 245 kB 00:00 2024-02-22T00:18:21.509 INFO:teuthology.orchestra.run.smithi161.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.8 MB/s | 157 kB 00:00 2024-02-22T00:18:21.542 INFO:teuthology.orchestra.run.smithi161.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.1 MB/s | 39 kB 00:00 2024-02-22T00:18:21.576 INFO:teuthology.orchestra.run.smithi161.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 3.0 MB/s | 103 kB 00:00 2024-02-22T00:18:21.610 INFO:teuthology.orchestra.run.smithi161.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.7 MB/s | 57 kB 00:00 2024-02-22T00:18:21.660 INFO:teuthology.orchestra.run.smithi161.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 9.0 MB/s | 457 kB 00:00 2024-02-22T00:18:22.169 INFO:teuthology.orchestra.run.smithi161.stdout:(10/32): ceph-mon-16.2.14-550.geb66ed92.el8.x86 4.9 MB/s | 5.2 MB 00:01 2024-02-22T00:18:22.394 INFO:teuthology.orchestra.run.smithi161.stdout:(11/32): ceph-osd-16.2.14-550.geb66ed92.el8.x86 17 MB/s | 19 MB 00:01 2024-02-22T00:18:30.635 INFO:teuthology.orchestra.run.smithi161.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 28 kB/s | 249 kB 00:08 2024-02-22T00:18:31.335 INFO:teuthology.orchestra.run.smithi161.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 62 kB/s | 44 kB 00:00 2024-02-22T00:18:31.452 INFO:teuthology.orchestra.run.smithi161.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.6 MB/s | 185 kB 00:00 2024-02-22T00:18:31.511 INFO:teuthology.orchestra.run.smithi161.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.9 MB/s | 173 kB 00:00 2024-02-22T00:18:31.602 INFO:teuthology.orchestra.run.smithi161.stdout:(16/32): python3-cherrypy-18.4.0-1.el8.noarch.r 4.1 MB/s | 384 kB 00:00 2024-02-22T00:18:31.653 INFO:teuthology.orchestra.run.smithi161.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2024-02-22T00:18:31.711 INFO:teuthology.orchestra.run.smithi161.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 301 kB/s | 18 kB 00:00 2024-02-22T00:18:31.770 INFO:teuthology.orchestra.run.smithi161.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 836 kB/s | 49 kB 00:00 2024-02-22T00:18:31.828 INFO:teuthology.orchestra.run.smithi161.stdout:(20/32): python3-more-itertools-7.2.0-3.el8.noa 1.0 MB/s | 59 kB 00:00 2024-02-22T00:18:31.887 INFO:teuthology.orchestra.run.smithi161.stdout:(21/32): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2024-02-22T00:18:31.979 INFO:teuthology.orchestra.run.smithi161.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2024-02-22T00:18:32.029 INFO:teuthology.orchestra.run.smithi161.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 374 kB/s | 19 kB 00:00 2024-02-22T00:18:32.088 INFO:teuthology.orchestra.run.smithi161.stdout:(24/32): python3-singledispatch-3.4.0.3-18.el8. 410 kB/s | 24 kB 00:00 2024-02-22T00:18:32.138 INFO:teuthology.orchestra.run.smithi161.stdout:(25/32): python3-tempora-1.14.1-5.el8.noarch.rp 584 kB/s | 29 kB 00:00 2024-02-22T00:18:32.188 INFO:teuthology.orchestra.run.smithi161.stdout:(26/32): python3-trustme-0.6.0-4.el8.noarch.rpm 553 kB/s | 27 kB 00:00 2024-02-22T00:18:32.247 INFO:teuthology.orchestra.run.smithi161.stdout:(27/32): python3-waitress-1.4.3-1.el8.noarch.rp 4.3 MB/s | 255 kB 00:00 2024-02-22T00:18:32.306 INFO:teuthology.orchestra.run.smithi161.stdout:(28/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.2 MB/s | 251 kB 00:00 2024-02-22T00:18:32.364 INFO:teuthology.orchestra.run.smithi161.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2024-02-22T00:18:32.414 INFO:teuthology.orchestra.run.smithi161.stdout:(30/32): python3-zc-lockfile-2.0-2.el8.noarch.r 460 kB/s | 23 kB 00:00 2024-02-22T00:18:32.531 INFO:teuthology.orchestra.run.smithi161.stdout:(31/32): python3-pycparser-2.14-14.el8.noarch.r 11 kB/s | 109 kB 00:10 2024-02-22T00:18:36.210 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:16.2.14-550.geb66ed92.el8.x86_64 22/25 2024-02-22T00:18:36.210 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /dev 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /run 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /dev 2024-02-22T00:18:36.211 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:37.462 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:16.2.14-550.geb66ed92.el8.x86_64 23/25 2024-02-22T00:18:37.542 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-550.geb66ed92.el8.x86_64 23/25 2024-02-22T00:18:37.542 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-22T00:18:37.770 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-02-22T00:18:37.770 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-22T00:18:38.470 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-02-22T00:18:38.470 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 1/25 2024-02-22T00:18:38.470 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 2/25 2024-02-22T00:18:38.470 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:16.2.14-550.geb66ed92.el8.x86_64 3/25 2024-02-22T00:18:38.470 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:16.2.14-550.geb66ed92.el8.x86_64 4/25 2024-02-22T00:18:38.470 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 5/25 2024-02-22T00:18:38.470 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:16.2.14-550.geb66ed92.el8.x86_6 6/25 2024-02-22T00:18:38.470 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:16.2.14-550.geb66ed92.el8.x86_64 7/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:16.2.14-550.geb66ed92.el8. 8/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:16.2.14-550.geb66ed92.el8.x8 9/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:16.2.14-550.geb66ed92.el8.x86_64 10/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:16.2.14-550.geb66ed92.el8.x86_64 11/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:16.2.14-550.geb66ed92.el8.x86_64 12/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:16.2.14-550.geb66ed92.el8.x86_64 13/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-02-22T00:18:38.471 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.14-550.geb66ed92.el8.x86_64 22/25 2024-02-22T00:18:38.472 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-02-22T00:18:38.472 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 24/25 2024-02-22T00:18:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-02-22T00:18:39.311 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:39.311 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: leveldb-1.22-1.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.2-3.el8.x86_64 2024-02-22T00:18:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.3.1-3.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:39.313 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:18:39.639 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-test 2024-02-22T00:18:40.423 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:42 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:18:42.112 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:16.2.14-550.geb66ed92.el8 ceph 52 M 2024-02-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi049.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-02-22T00:18:42.113 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:16.2.14-550.geb66ed92.el8 ceph 174 k 2024-02-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-02-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-02-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-02-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi049.stdout:Install 6 Packages 2024-02-22T00:18:42.114 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 53 M 2024-02-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 197 M 2024-02-22T00:18:42.115 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:18:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.4 MB/s | 203 kB 00:00 2024-02-22T00:18:42.409 INFO:teuthology.orchestra.run.smithi049.stdout:(2/6): oniguruma-6.8.2-3.el8.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-02-22T00:18:42.467 INFO:teuthology.orchestra.run.smithi049.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-02-22T00:18:42.501 INFO:teuthology.orchestra.run.smithi049.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2024-02-22T00:18:42.559 INFO:teuthology.orchestra.run.smithi049.stdout:(5/6): libcephsqlite-16.2.14-550.geb66ed92.el8. 514 kB/s | 174 kB 00:00 2024-02-22T00:18:45.276 INFO:teuthology.orchestra.run.smithi049.stdout:(6/6): ceph-test-16.2.14-550.geb66ed92.el8.x86_ 17 MB/s | 52 MB 00:03 2024-02-22T00:18:45.278 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:18:45.278 INFO:teuthology.orchestra.run.smithi049.stdout:Total 17 MB/s | 53 MB 00:03 2024-02-22T00:18:45.321 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:18:45.343 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:18:45.343 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:18:45.497 INFO:teuthology.orchestra.run.smithi161.stdout:(32/32): python3-cryptography-3.2.1-7.el8.x86_6 27 kB/s | 641 kB 00:23 2024-02-22T00:18:45.500 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:18:45.501 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.3 MB/s | 32 MB 00:24 2024-02-22T00:18:45.579 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:18:45.617 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:18:45.617 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:18:45.655 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:18:45.658 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:18:45.846 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:18:45.849 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:18:46.156 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:18:46.372 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-02-22T00:18:46.561 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-02-22T00:18:46.674 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-22T00:18:46.756 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-02-22T00:18:46.948 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-02-22T00:18:46.976 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:18:47.115 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:16.2.14-550.geb66ed92.el8.x86_64 5/6 2024-02-22T00:18:47.182 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-22T00:18:47.376 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-22T00:18:47.635 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-22T00:18:47.859 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-22T00:18:48.115 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-22T00:18:48.311 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-22T00:18:49.281 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-22T00:18:50.108 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-22T00:18:50.317 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-22T00:18:50.546 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-22T00:18:50.759 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-22T00:18:51.007 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-22T00:18:51.419 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-22T00:18:51.646 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-22T00:18:51.834 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-22T00:18:52.024 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:16.2.14-550.geb66ed92.el8.x86_64 5/6 2024-02-22T00:18:52.108 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-22T00:18:52.256 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:16.2.14-550.geb66ed92.el8.x86_64 6/6 2024-02-22T00:18:52.302 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-22T00:18:52.536 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-test-2:16.2.14-550.geb66ed92.el8.x86_64 6/6 2024-02-22T00:18:52.536 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:16.2.14-550.geb66ed92.el8.x86_64 1/6 2024-02-22T00:18:52.537 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:16.2.14-550.geb66ed92.el8.x86_64 2/6 2024-02-22T00:18:52.537 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-02-22T00:18:52.537 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-02-22T00:18:52.537 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-02-22T00:18:52.609 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-22T00:18:52.874 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: jq-1.6-8.el8.x86_64 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-1.el8.x86_64 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:52.989 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:18:53.037 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-22T00:18:53.207 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-22T00:18:53.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph 2024-02-22T00:18:53.423 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-22T00:18:53.622 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-22T00:18:53.836 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-22T00:18:54.039 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:00:56 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:18:54.141 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-22T00:18:54.463 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-22T00:18:54.811 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-550.geb66ed92.el8. 27/32 2024-02-22T00:18:55.009 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 28/32 2024-02-22T00:18:55.739 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:18:55.743 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:55.743 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:18:55.743 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:55.743 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:18:55.743 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:16.2.14-550.geb66ed92.el8 ceph 6.4 k 2024-02-22T00:18:55.743 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:18:55.743 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:16.2.14-550.geb66ed92.el8 ceph 2.4 M 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:16.2.14-550.geb66ed92.el8 ceph 1.6 M 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 245 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:16.2.14-550.geb66ed92.el8 ceph 5.2 M 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:16.2.14-550.geb66ed92.el8 ceph 19 M 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-02-22T00:18:55.744 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-02-22T00:18:55.745 INFO:teuthology.orchestra.run.smithi049.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout:Install 32 Packages 2024-02-22T00:18:55.746 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:18:55.747 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 32 M 2024-02-22T00:18:55.747 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 104 M 2024-02-22T00:18:55.747 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:18:56.437 INFO:teuthology.orchestra.run.smithi049.stdout:(1/32): ceph-16.2.14-550.geb66ed92.el8.x86_64.r 34 kB/s | 6.4 kB 00:00 2024-02-22T00:18:56.525 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 28/32 2024-02-22T00:18:56.595 INFO:teuthology.orchestra.run.smithi049.stdout:(2/32): ceph-mds-16.2.14-550.geb66ed92.el8.x86_ 7.0 MB/s | 2.4 MB 00:00 2024-02-22T00:18:56.701 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:16.2.14-550.geb66ed92.el8.x86_64 29/32 2024-02-22T00:18:56.820 INFO:teuthology.orchestra.run.smithi049.stdout:(3/32): ceph-mgr-16.2.14-550.geb66ed92.el8.x86_ 2.8 MB/s | 1.6 MB 00:00 2024-02-22T00:18:56.929 INFO:teuthology.orchestra.run.smithi049.stdout:(4/32): ceph-mgr-modules-core-16.2.14-550.geb66 2.2 MB/s | 245 kB 00:00 2024-02-22T00:18:57.021 INFO:teuthology.orchestra.run.smithi049.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2024-02-22T00:18:57.055 INFO:teuthology.orchestra.run.smithi049.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.1 MB/s | 39 kB 00:00 2024-02-22T00:18:57.144 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:16.2.14-550.geb66ed92.el8.x86_64 29/32 2024-02-22T00:18:57.155 INFO:teuthology.orchestra.run.smithi049.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.0 MB/s | 103 kB 00:00 2024-02-22T00:18:57.189 INFO:teuthology.orchestra.run.smithi049.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 1.7 MB/s | 57 kB 00:00 2024-02-22T00:18:57.239 INFO:teuthology.orchestra.run.smithi049.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 9.0 MB/s | 457 kB 00:00 2024-02-22T00:18:57.326 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:16.2.14-550.geb66ed92.el8.x86_64 30/32 2024-02-22T00:18:57.557 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:16.2.14-550.geb66ed92.el8.x86_64 30/32 2024-02-22T00:18:57.623 INFO:teuthology.orchestra.run.smithi049.stdout:(10/32): ceph-osd-16.2.14-550.geb66ed92.el8.x86 18 MB/s | 19 MB 00:01 2024-02-22T00:18:57.698 INFO:teuthology.orchestra.run.smithi049.stdout:(11/32): ceph-mon-16.2.14-550.geb66ed92.el8.x86 4.1 MB/s | 5.2 MB 00:01 2024-02-22T00:18:57.734 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:16.2.14-550.geb66ed92.el8.x86_64 31/32 2024-02-22T00:18:57.751 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:16.2.14-550.geb66ed92.el8.x86_64 31/32 2024-02-22T00:18:57.892 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:16.2.14-550.geb66ed92.el8.x86_64 32/32 2024-02-22T00:18:58.310 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-2:16.2.14-550.geb66ed92.el8.x86_64 32/32 2024-02-22T00:18:58.310 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:16.2.14-550.geb66ed92.el8.x86_64 1/32 2024-02-22T00:18:58.310 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:16.2.14-550.geb66ed92.el8.x86_64 2/32 2024-02-22T00:18:58.310 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 3/32 2024-02-22T00:18:58.310 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:16.2.14-550.geb66ed92.el8.x86_64 4/32 2024-02-22T00:18:58.310 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:16.2.14-550.geb66ed92.el8.x86_64 5/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-550.geb66ed92.el8. 6/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-22T00:18:58.311 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-22T00:18:58.312 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-22T00:18:58.312 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-22T00:18:58.312 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-22T00:18:58.312 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-22T00:18:58.312 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-22T00:18:58.312 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-22T00:18:58.313 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-22T00:18:58.313 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-22T00:18:58.313 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-22T00:18:58.313 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-22T00:18:58.313 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-22T00:18:58.313 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-22T00:18:59.150 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-22T00:18:59.150 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:59.150 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:18:59.150 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:59.150 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:59.150 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:59.150 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-22T00:18:59.151 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-2.6-1.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-22T00:18:59.152 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-22T00:18:59.153 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:18:59.153 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:18:59.396 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-base 2024-02-22T00:19:00.161 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:38 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:19:01.664 INFO:teuthology.orchestra.run.smithi161.stdout:Package ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:19:01.710 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:19:01.711 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:19:01.712 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:19:01.828 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install cephadm 2024-02-22T00:19:02.582 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:40 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:19:04.156 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 85 k 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-02-22T00:19:04.157 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:04.158 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 85 k 2024-02-22T00:19:04.158 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 352 k 2024-02-22T00:19:04.158 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:19:04.445 INFO:teuthology.orchestra.run.smithi161.stdout:cephadm-16.2.14-550.geb66ed92.el8.noarch.rpm 297 kB/s | 85 kB 00:00 2024-02-22T00:19:04.446 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:19:04.446 INFO:teuthology.orchestra.run.smithi161.stdout:Total 296 kB/s | 85 kB 00:00 2024-02-22T00:19:04.446 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:19:04.453 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:19:04.453 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:19:04.455 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:19:04.458 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:19:04.503 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:19:04.983 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/1 2024-02-22T00:19:05.136 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/1 2024-02-22T00:19:05.369 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/1 2024-02-22T00:19:05.737 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/1 2024-02-22T00:19:05.737 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:05.737 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:19:05.737 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:19:05.738 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:05.738 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:19:05.979 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-immutable-object-cache 2024-02-22T00:19:06.735 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:44 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:19:08.304 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-550.geb66ed92.el8 ceph 161 k 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-02-22T00:19:08.305 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:08.306 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 161 k 2024-02-22T00:19:08.306 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 470 k 2024-02-22T00:19:08.306 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:19:08.608 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-immutable-object-cache-16.2.14-550.geb66ed 534 kB/s | 161 kB 00:00 2024-02-22T00:19:08.609 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:19:08.609 INFO:teuthology.orchestra.run.smithi161.stdout:Total 532 kB/s | 161 kB 00:00 2024-02-22T00:19:08.609 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:19:08.620 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:19:08.620 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:19:08.666 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:19:08.669 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:19:08.774 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:19:08.897 INFO:teuthology.orchestra.run.smithi049.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 9.7 kB/s | 109 kB 00:11 2024-02-22T00:19:08.966 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-550.geb66ed92. 1/1 2024-02-22T00:19:09.386 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-550.geb66ed92. 1/1 2024-02-22T00:19:09.456 INFO:teuthology.orchestra.run.smithi049.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 78 kB/s | 44 kB 00:00 2024-02-22T00:19:09.714 INFO:teuthology.orchestra.run.smithi049.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 717 kB/s | 185 kB 00:00 2024-02-22T00:19:09.759 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-550.geb66ed92. 1/1 2024-02-22T00:19:09.759 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:09.759 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:19:09.759 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:19:09.759 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:09.759 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:19:09.864 INFO:teuthology.orchestra.run.smithi049.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB 00:00 2024-02-22T00:19:09.997 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr 2024-02-22T00:19:10.048 INFO:teuthology.orchestra.run.smithi049.stdout:(16/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.0 MB/s | 384 kB 00:00 2024-02-22T00:19:10.157 INFO:teuthology.orchestra.run.smithi049.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-02-22T00:19:10.257 INFO:teuthology.orchestra.run.smithi049.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 176 kB/s | 18 kB 00:00 2024-02-22T00:19:10.365 INFO:teuthology.orchestra.run.smithi049.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 450 kB/s | 49 kB 00:00 2024-02-22T00:19:10.482 INFO:teuthology.orchestra.run.smithi049.stdout:(20/32): python3-more-itertools-7.2.0-3.el8.noa 504 kB/s | 59 kB 00:00 2024-02-22T00:19:10.608 INFO:teuthology.orchestra.run.smithi049.stdout:(21/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2024-02-22T00:19:10.708 INFO:teuthology.orchestra.run.smithi049.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2024-02-22T00:19:10.764 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:48 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:19:10.833 INFO:teuthology.orchestra.run.smithi049.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 150 kB/s | 19 kB 00:00 2024-02-22T00:19:10.958 INFO:teuthology.orchestra.run.smithi049.stdout:(24/32): python3-singledispatch-3.4.0.3-18.el8. 191 kB/s | 24 kB 00:00 2024-02-22T00:19:11.286 INFO:teuthology.orchestra.run.smithi049.stdout:(25/32): python3-tempora-1.14.1-5.el8.noarch.rp 89 kB/s | 29 kB 00:00 2024-02-22T00:19:11.393 INFO:teuthology.orchestra.run.smithi049.stdout:(26/32): python3-trustme-0.6.0-4.el8.noarch.rpm 258 kB/s | 27 kB 00:00 2024-02-22T00:19:11.535 INFO:teuthology.orchestra.run.smithi049.stdout:(27/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.8 MB/s | 255 kB 00:00 2024-02-22T00:19:11.693 INFO:teuthology.orchestra.run.smithi049.stdout:(28/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.5 MB/s | 251 kB 00:00 2024-02-22T00:19:11.827 INFO:teuthology.orchestra.run.smithi049.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 640 kB/s | 85 kB 00:00 2024-02-22T00:19:11.961 INFO:teuthology.orchestra.run.smithi049.stdout:(30/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 17 kB/s | 249 kB 00:14 2024-02-22T00:19:11.977 INFO:teuthology.orchestra.run.smithi049.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 153 kB/s | 23 kB 00:00 2024-02-22T00:19:12.285 INFO:teuthology.orchestra.run.smithi161.stdout:Package ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:19:12.330 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:19:12.332 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:19:12.332 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:19:12.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-dashboard 2024-02-22T00:19:13.196 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:51 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:19:14.760 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 3.1 M 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 24 k 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 15 k 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-22T00:19:14.761 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-22T00:19:14.762 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:14.762 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:19:14.762 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:19:14.762 INFO:teuthology.orchestra.run.smithi161.stdout:Install 6 Packages 2024-02-22T00:19:14.762 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:14.762 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 3.4 M 2024-02-22T00:19:14.762 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 22 M 2024-02-22T00:19:14.763 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:19:15.211 INFO:teuthology.orchestra.run.smithi161.stdout:(1/6): ceph-prometheus-alerts-16.2.14-550.geb66 99 kB/s | 15 kB 00:00 2024-02-22T00:19:15.236 INFO:teuthology.orchestra.run.smithi161.stdout:(2/6): ceph-grafana-dashboards-16.2.14-550.geb6 139 kB/s | 24 kB 00:00 2024-02-22T00:19:15.336 INFO:teuthology.orchestra.run.smithi161.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 336 kB/s | 34 kB 00:00 2024-02-22T00:19:15.403 INFO:teuthology.orchestra.run.smithi161.stdout:(4/6): ceph-mgr-dashboard-16.2.14-550.geb66ed92 9.1 MB/s | 3.1 MB 00:00 2024-02-22T00:19:15.437 INFO:teuthology.orchestra.run.smithi161.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.9 MB/s | 196 kB 00:00 2024-02-22T00:19:17.029 INFO:teuthology.orchestra.run.smithi161.stdout:(6/6): python3-jwt-1.6.1-2.el8.noarch.rpm 23 kB/s | 43 kB 00:01 2024-02-22T00:19:17.031 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:19:17.031 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.5 MB/s | 3.4 MB 00:02 2024-02-22T00:19:17.043 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:19:17.054 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:19:17.054 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:19:17.143 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:19:17.146 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:19:17.413 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:19:17.612 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-22T00:19:17.891 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-22T00:19:18.092 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-22T00:19:18.204 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-550.geb66ed92.el8.n 4/6 2024-02-22T00:19:19.311 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-550.geb66ed92.el8. 5/6 2024-02-22T00:19:19.571 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-550.geb66ed92.el8.noarc 6/6 2024-02-22T00:19:19.837 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-550.geb66ed92.el8.noarc 6/6 2024-02-22T00:19:19.837 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-550.geb66ed92.el8. 1/6 2024-02-22T00:19:19.837 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-550.geb66ed92.el8.noarc 2/6 2024-02-22T00:19:19.837 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-550.geb66ed92.el8.n 3/6 2024-02-22T00:19:19.837 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-22T00:19:19.837 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-22T00:19:20.227 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:20.228 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:19:20.381 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-22T00:19:21.137 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:59 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:19:22.691 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:19:22.692 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2024-02-22T00:19:22.692 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:19:22.692 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2024-02-22T00:19:22.692 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 8.6 M 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2024-02-22T00:19:22.693 INFO:teuthology.orchestra.run.smithi161.stdout:Install 8 Packages 2024-02-22T00:19:22.694 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:19:22.694 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 37 M 2024-02-22T00:19:22.694 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 210 M 2024-02-22T00:19:22.694 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:19:23.300 INFO:teuthology.orchestra.run.smithi161.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2024-02-22T00:19:23.367 INFO:teuthology.orchestra.run.smithi161.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.9 MB 00:00 2024-02-22T00:19:23.409 INFO:teuthology.orchestra.run.smithi161.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 5.3 MB/s | 225 kB 00:00 2024-02-22T00:19:23.534 INFO:teuthology.orchestra.run.smithi161.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 16 MB/s | 3.7 MB 00:00 2024-02-22T00:19:23.635 INFO:teuthology.orchestra.run.smithi161.stdout:(5/8): ceph-mgr-diskprediction-local-16.2.14-55 12 MB/s | 8.6 MB 00:00 2024-02-22T00:19:24.010 INFO:teuthology.orchestra.run.smithi161.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 24 MB/s | 14 MB 00:00 2024-02-22T00:19:36.786 INFO:teuthology.orchestra.run.smithi161.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 13 kB/s | 172 kB 00:13 2024-02-22T00:19:42.216 INFO:teuthology.orchestra.run.smithi049.stdout:(32/32): python3-cryptography-3.2.1-7.el8.x86_6 14 kB/s | 641 kB 00:44 2024-02-22T00:19:42.218 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:19:42.218 INFO:teuthology.orchestra.run.smithi049.stdout:Total 701 kB/s | 32 MB 00:46 2024-02-22T00:19:42.298 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:19:42.340 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:19:42.340 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:19:42.587 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:19:42.588 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:19:43.692 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:19:43.916 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-02-22T00:19:44.122 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-02-22T00:19:44.386 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-02-22T00:19:44.596 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-02-22T00:19:44.895 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-02-22T00:19:45.069 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-02-22T00:19:45.226 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-02-22T00:19:45.396 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-02-22T00:19:45.599 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-02-22T00:19:45.811 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-02-22T00:19:46.057 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-02-22T00:19:46.290 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-02-22T00:19:46.683 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-02-22T00:19:46.910 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-02-22T00:19:47.064 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-02-22T00:19:47.301 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-02-22T00:19:47.524 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-22T00:19:47.815 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-02-22T00:19:48.122 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-02-22T00:19:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-02-22T00:19:48.470 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-02-22T00:19:48.691 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-02-22T00:19:48.903 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-02-22T00:19:49.135 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-02-22T00:19:49.442 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-02-22T00:19:49.741 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-02-22T00:19:50.137 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-550.geb66ed92.el8. 27/32 2024-02-22T00:19:50.325 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 28/32 2024-02-22T00:19:51.938 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 28/32 2024-02-22T00:19:52.122 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:16.2.14-550.geb66ed92.el8.x86_64 29/32 2024-02-22T00:19:52.592 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:16.2.14-550.geb66ed92.el8.x86_64 29/32 2024-02-22T00:19:52.780 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:16.2.14-550.geb66ed92.el8.x86_64 30/32 2024-02-22T00:19:53.012 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:16.2.14-550.geb66ed92.el8.x86_64 30/32 2024-02-22T00:19:53.196 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:16.2.14-550.geb66ed92.el8.x86_64 31/32 2024-02-22T00:19:53.214 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:16.2.14-550.geb66ed92.el8.x86_64 31/32 2024-02-22T00:19:53.330 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:16.2.14-550.geb66ed92.el8.x86_64 32/32 2024-02-22T00:19:53.762 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-2:16.2.14-550.geb66ed92.el8.x86_64 32/32 2024-02-22T00:19:53.762 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:16.2.14-550.geb66ed92.el8.x86_64 1/32 2024-02-22T00:19:53.762 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:16.2.14-550.geb66ed92.el8.x86_64 2/32 2024-02-22T00:19:53.762 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 3/32 2024-02-22T00:19:53.762 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:16.2.14-550.geb66ed92.el8.x86_64 4/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:16.2.14-550.geb66ed92.el8.x86_64 5/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-550.geb66ed92.el8. 6/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-02-22T00:19:53.763 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-02-22T00:19:53.764 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-02-22T00:19:53.765 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-02-22T00:19:53.765 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-02-22T00:19:53.765 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-02-22T00:19:53.765 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-02-22T00:19:54.667 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-02-22T00:19:54.668 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-6.2-6.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.0.6-14.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-2.6-1.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.14-14.el8.noarch 2024-02-22T00:19:54.669 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2017.2-11.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:19:54.670 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:19:54.929 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-base 2024-02-22T00:19:55.724 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:01:57 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:19:55.848 INFO:teuthology.orchestra.run.smithi161.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 20 kB/s | 645 kB 00:32 2024-02-22T00:19:55.848 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:19:55.848 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.1 MB/s | 37 MB 00:33 2024-02-22T00:19:56.077 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:19:56.095 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:19:56.096 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:19:56.405 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:19:56.408 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:19:56.970 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:19:57.109 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-22T00:19:57.252 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-22T00:19:57.361 INFO:teuthology.orchestra.run.smithi049.stdout:Package ceph-base-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:19:57.383 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-22T00:19:57.413 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:19:57.415 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:19:57.415 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:19:57.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install cephadm 2024-02-22T00:19:57.982 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-22T00:19:58.125 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-22T00:19:58.322 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:00 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:19:58.741 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-22T00:19:58.883 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-22T00:19:59.578 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-22T00:19:59.879 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-22T00:19:59.995 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:19:59.995 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:19:59.995 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:19:59.995 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:19:59.995 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:19:59.996 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 85 k 2024-02-22T00:19:59.996 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:19:59.996 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:19:59.996 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:19:59.996 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-02-22T00:19:59.996 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:19:59.997 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 85 k 2024-02-22T00:19:59.997 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 352 k 2024-02-22T00:19:59.997 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:20:00.124 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-22T00:20:00.289 INFO:teuthology.orchestra.run.smithi049.stdout:cephadm-16.2.14-550.geb66ed92.el8.noarch.rpm 292 kB/s | 85 kB 00:00 2024-02-22T00:20:00.290 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:20:00.290 INFO:teuthology.orchestra.run.smithi049.stdout:Total 290 kB/s | 85 kB 00:00 2024-02-22T00:20:00.290 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:20:00.297 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:20:00.297 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:20:00.300 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:20:00.303 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:20:00.347 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:20:00.826 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/1 2024-02-22T00:20:00.995 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/1 2024-02-22T00:20:01.232 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/1 2024-02-22T00:20:01.615 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/1 2024-02-22T00:20:01.615 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:01.615 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:20:01.615 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:20:01.615 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:01.615 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:20:01.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-immutable-object-cache 2024-02-22T00:20:01.949 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-22T00:20:02.664 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:04 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:20:03.234 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-22T00:20:03.416 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-550.geb66ed9 8/8 2024-02-22T00:20:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-550.geb66ed9 8/8 2024-02-22T00:20:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-550.geb66ed9 1/8 2024-02-22T00:20:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-22T00:20:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-22T00:20:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-22T00:20:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-22T00:20:03.723 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-22T00:20:03.724 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-22T00:20:04.338 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-22T00:20:04.338 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:20:04.338 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:20:04.338 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:20:04.338 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-22T00:20:04.338 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-22T00:20:04.338 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-22T00:20:04.339 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-22T00:20:04.339 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-22T00:20:04.339 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-22T00:20:04.339 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-22T00:20:04.339 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:20:04.339 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:20:04.365 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:20:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:20:04.366 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2024-02-22T00:20:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:20:04.366 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:20:04.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-550.geb66ed92.el8 ceph 161 k 2024-02-22T00:20:04.366 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:20:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:20:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-02-22T00:20:04.367 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 161 k 2024-02-22T00:20:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 470 k 2024-02-22T00:20:04.367 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:20:04.482 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-rook 2024-02-22T00:20:04.661 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-immutable-object-cache-16.2.14-550.geb66ed 550 kB/s | 161 kB 00:00 2024-02-22T00:20:04.662 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:20:04.662 INFO:teuthology.orchestra.run.smithi049.stdout:Total 548 kB/s | 161 kB 00:00 2024-02-22T00:20:04.662 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:20:04.674 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:20:04.674 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:20:04.725 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:20:04.728 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:20:04.838 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:20:05.012 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-550.geb66ed92. 1/1 2024-02-22T00:20:05.236 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:02:43 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:20:05.440 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-550.geb66ed92. 1/1 2024-02-22T00:20:05.800 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-550.geb66ed92. 1/1 2024-02-22T00:20:05.800 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:05.800 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:20:05.800 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:20:05.800 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:05.801 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:20:05.997 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr 2024-02-22T00:20:06.789 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:08 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:20:06.815 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:20:06.817 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:20:06.817 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:20:06.817 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:20:06.817 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:20:06.817 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 27 k 2024-02-22T00:20:06.817 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:20:06.817 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-22T00:20:06.818 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:20:06.819 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:20:06.819 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:20:06.819 INFO:teuthology.orchestra.run.smithi161.stdout:Install 13 Packages 2024-02-22T00:20:06.819 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:20:06.819 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 1.9 M 2024-02-22T00:20:06.819 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 24 M 2024-02-22T00:20:06.820 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:20:08.430 INFO:teuthology.orchestra.run.smithi049.stdout:Package ceph-mgr-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:20:08.480 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:20:08.481 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:20:08.481 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:20:08.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-dashboard 2024-02-22T00:20:08.882 INFO:teuthology.orchestra.run.smithi161.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 270 kB/s | 20 kB 00:00 2024-02-22T00:20:08.908 INFO:teuthology.orchestra.run.smithi161.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 268 kB/s | 27 kB 00:00 2024-02-22T00:20:08.941 INFO:teuthology.orchestra.run.smithi161.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2024-02-22T00:20:08.966 INFO:teuthology.orchestra.run.smithi161.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.8 MB/s | 110 kB 00:00 2024-02-22T00:20:08.992 INFO:teuthology.orchestra.run.smithi161.stdout:(5/13): ceph-mgr-rook-16.2.14-550.geb66ed92.el8 149 kB/s | 27 kB 00:00 2024-02-22T00:20:09.397 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:11 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:20:10.892 INFO:teuthology.orchestra.run.smithi161.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 22 kB/s | 43 kB 00:01 2024-02-22T00:20:11.076 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 3.1 M 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 24 k 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 15 k 2024-02-22T00:20:11.077 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-02-22T00:20:11.078 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-02-22T00:20:11.078 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-02-22T00:20:11.078 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:11.078 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:20:11.078 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:20:11.078 INFO:teuthology.orchestra.run.smithi049.stdout:Install 6 Packages 2024-02-22T00:20:11.078 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:11.079 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 3.4 M 2024-02-22T00:20:11.079 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 22 M 2024-02-22T00:20:11.079 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:20:11.339 INFO:teuthology.orchestra.run.smithi049.stdout:(1/6): ceph-grafana-dashboards-16.2.14-550.geb6 150 kB/s | 24 kB 00:00 2024-02-22T00:20:11.431 INFO:teuthology.orchestra.run.smithi049.stdout:(2/6): ceph-prometheus-alerts-16.2.14-550.geb66 58 kB/s | 15 kB 00:00 2024-02-22T00:20:11.657 INFO:teuthology.orchestra.run.smithi049.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 149 kB/s | 34 kB 00:00 2024-02-22T00:20:11.723 INFO:teuthology.orchestra.run.smithi049.stdout:(4/6): ceph-mgr-dashboard-16.2.14-550.geb66ed92 5.7 MB/s | 3.1 MB 00:00 2024-02-22T00:20:11.898 INFO:teuthology.orchestra.run.smithi049.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 813 kB/s | 196 kB 00:00 2024-02-22T00:20:12.115 INFO:teuthology.orchestra.run.smithi049.stdout:(6/6): python3-jwt-1.6.1-2.el8.noarch.rpm 55 kB/s | 43 kB 00:00 2024-02-22T00:20:12.118 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:20:12.118 INFO:teuthology.orchestra.run.smithi049.stdout:Total 3.3 MB/s | 3.4 MB 00:01 2024-02-22T00:20:12.131 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:20:12.143 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:20:12.143 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:20:12.236 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:20:12.239 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:20:12.512 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:20:12.694 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-02-22T00:20:12.912 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-02-22T00:20:13.096 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-02-22T00:20:13.200 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-550.geb66ed92.el8.n 4/6 2024-02-22T00:20:14.309 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-550.geb66ed92.el8. 5/6 2024-02-22T00:20:14.663 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-550.geb66ed92.el8.noarc 6/6 2024-02-22T00:20:14.962 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-550.geb66ed92.el8.noarc 6/6 2024-02-22T00:20:14.962 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-550.geb66ed92.el8. 1/6 2024-02-22T00:20:14.962 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-550.geb66ed92.el8.noarc 2/6 2024-02-22T00:20:14.962 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-550.geb66ed92.el8.n 3/6 2024-02-22T00:20:14.962 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-02-22T00:20:14.962 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-02-22T00:20:15.366 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-02-22T00:20:15.366 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:15.366 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:20:15.366 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:20:15.367 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:20:15.367 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:20:15.367 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-02-22T00:20:15.367 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-02-22T00:20:15.367 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.4.1-12.el8.noarch 2024-02-22T00:20:15.367 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:15.367 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:20:15.513 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-22T00:20:16.305 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:02:18 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:20:17.983 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:20:17.984 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2024-02-22T00:20:17.984 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:20:17.984 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2024-02-22T00:20:17.984 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:20:17.984 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 8.6 M 2024-02-22T00:20:17.984 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:20:17.984 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-02-22T00:20:17.984 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout:============================================================================================ 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout:Install 8 Packages 2024-02-22T00:20:17.985 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:20:17.986 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 37 M 2024-02-22T00:20:17.986 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 210 M 2024-02-22T00:20:17.986 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:20:18.320 INFO:teuthology.orchestra.run.smithi049.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 19 MB/s | 4.9 MB 00:00 2024-02-22T00:20:18.387 INFO:teuthology.orchestra.run.smithi049.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2024-02-22T00:20:18.429 INFO:teuthology.orchestra.run.smithi049.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 5.3 MB/s | 225 kB 00:00 2024-02-22T00:20:18.496 INFO:teuthology.orchestra.run.smithi049.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 21 MB/s | 3.7 MB 00:00 2024-02-22T00:20:18.755 INFO:teuthology.orchestra.run.smithi049.stdout:(5/8): ceph-mgr-diskprediction-local-16.2.14-55 13 MB/s | 8.6 MB 00:00 2024-02-22T00:20:18.913 INFO:teuthology.orchestra.run.smithi049.stdout:(6/8): python3-scipy-1.0.0-21.module_el8+762+77 29 MB/s | 14 MB 00:00 2024-02-22T00:20:20.633 INFO:teuthology.orchestra.run.smithi161.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 13 kB/s | 155 kB 00:11 2024-02-22T00:20:23.956 INFO:teuthology.orchestra.run.smithi161.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 24 kB/s | 81 kB 00:03 2024-02-22T00:20:24.141 INFO:teuthology.orchestra.run.smithi161.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 6.3 MB/s | 1.2 MB 00:00 2024-02-22T00:20:24.329 INFO:teuthology.orchestra.run.smithi161.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 342 kB/s | 64 kB 00:00 2024-02-22T00:20:24.564 INFO:teuthology.orchestra.run.smithi161.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 261 kB/s | 61 kB 00:00 2024-02-22T00:20:31.798 INFO:teuthology.orchestra.run.smithi049.stdout:(7/8): libquadmath-8.5.0-21.el8.x86_64.rpm 13 kB/s | 172 kB 00:13 2024-02-22T00:20:43.177 INFO:teuthology.orchestra.run.smithi161.stdout:(12/13): python3-certifi-2018.10.15-7.el8.noarc 516 B/s | 16 kB 00:32 2024-02-22T00:20:59.489 INFO:teuthology.orchestra.run.smithi049.stdout:(8/8): libgfortran-8.5.0-21.el8.x86_64.rpm 16 kB/s | 645 kB 00:40 2024-02-22T00:20:59.489 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:20:59.489 INFO:teuthology.orchestra.run.smithi049.stdout:Total 915 kB/s | 37 MB 00:41 2024-02-22T00:20:59.727 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:20:59.746 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:20:59.746 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:21:00.075 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:21:00.078 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:21:00.649 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:21:00.802 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-22T00:21:00.920 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-02-22T00:21:01.085 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-22T00:21:01.721 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-02-22T00:21:01.876 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-02-22T00:21:02.542 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-02-22T00:21:02.677 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-22T00:21:03.403 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-02-22T00:21:03.860 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-02-22T00:21:04.083 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-22T00:21:05.963 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-02-22T00:21:07.565 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-02-22T00:21:07.742 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-550.geb66ed9 8/8 2024-02-22T00:21:08.068 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-550.geb66ed9 8/8 2024-02-22T00:21:08.068 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-550.geb66ed9 1/8 2024-02-22T00:21:08.069 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-02-22T00:21:08.069 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-02-22T00:21:08.069 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-02-22T00:21:08.069 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-02-22T00:21:08.069 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-02-22T00:21:08.069 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-02-22T00:21:08.475 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.15-4.el8.x86_64 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-02-22T00:21:08.476 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:08.477 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:08.623 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-rook 2024-02-22T00:21:09.411 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:11 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:11.086 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:11.088 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:11.088 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:21:11.088 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:11.088 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:21:11.088 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 27 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-02-22T00:21:11.089 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:11.090 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:21:11.090 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:11.090 INFO:teuthology.orchestra.run.smithi049.stdout:Install 13 Packages 2024-02-22T00:21:11.090 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:11.090 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 1.9 M 2024-02-22T00:21:11.090 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 24 M 2024-02-22T00:21:11.091 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:21:11.868 INFO:teuthology.orchestra.run.smithi049.stdout:(1/13): python3-jsonpointer-1.10-11.el8.noarch. 291 kB/s | 20 kB 00:00 2024-02-22T00:21:11.893 INFO:teuthology.orchestra.run.smithi049.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 284 kB/s | 27 kB 00:00 2024-02-22T00:21:11.926 INFO:teuthology.orchestra.run.smithi049.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.3 MB/s | 126 kB 00:00 2024-02-22T00:21:11.952 INFO:teuthology.orchestra.run.smithi049.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 1.8 MB/s | 110 kB 00:00 2024-02-22T00:21:12.060 INFO:teuthology.orchestra.run.smithi049.stdout:(5/13): ceph-mgr-rook-16.2.14-550.geb66ed92.el8 105 kB/s | 27 kB 00:00 2024-02-22T00:21:12.152 INFO:teuthology.orchestra.run.smithi049.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 360 kB/s | 33 kB 00:00 2024-02-22T00:21:12.203 INFO:teuthology.orchestra.run.smithi049.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 325 kB/s | 16 kB 00:00 2024-02-22T00:21:12.278 INFO:teuthology.orchestra.run.smithi049.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 1.1 MB/s | 81 kB 00:00 2024-02-22T00:21:12.445 INFO:teuthology.orchestra.run.smithi049.stdout:(9/13): python3-kubernetes-11.0.0-6.el8.noarch. 7.0 MB/s | 1.2 MB 00:00 2024-02-22T00:21:12.495 INFO:teuthology.orchestra.run.smithi049.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2024-02-22T00:21:12.537 INFO:teuthology.orchestra.run.smithi049.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.4 MB/s | 61 kB 00:00 2024-02-22T00:21:12.787 INFO:teuthology.orchestra.run.smithi049.stdout:(12/13): python3-requests-oauthlib-1.0.0-1.el8. 51 kB/s | 43 kB 00:00 2024-02-22T00:21:17.071 INFO:teuthology.orchestra.run.smithi049.stdout:(13/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 30 kB/s | 155 kB 00:05 2024-02-22T00:21:17.071 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:21:17.072 INFO:teuthology.orchestra.run.smithi049.stdout:Total 327 kB/s | 1.9 MB 00:05 2024-02-22T00:21:17.130 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:21:17.147 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:21:17.147 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:21:17.241 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:21:17.245 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:21:17.831 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:21:18.205 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-22T00:21:18.427 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-22T00:21:18.638 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-22T00:21:18.840 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-22T00:21:19.049 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-22T00:21:19.283 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-22T00:21:19.563 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-22T00:21:19.798 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-22T00:21:20.884 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-22T00:21:21.155 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-22T00:21:21.355 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-22T00:21:21.531 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-22T00:21:21.701 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:16.2.14-550.geb66ed92.el8.noarch 13/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-550.geb66ed92.el8.noarch 13/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:16.2.14-550.geb66ed92.el8.noarch 1/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-22T00:21:21.992 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-22T00:21:21.993 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-22T00:21:21.993 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-22T00:21:21.993 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-22T00:21:21.993 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-22T00:21:22.565 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-22T00:21:22.565 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:22.565 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:21:22.565 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:21:22.565 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-22T00:21:22.565 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-22T00:21:22.565 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:22.566 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:22.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-mgr-cephadm 2024-02-22T00:21:23.492 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:25 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:25.180 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:25.181 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:21:25.181 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:25.181 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:21:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 116 k 2024-02-22T00:21:25.181 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:21:25.181 INFO:teuthology.orchestra.run.smithi049.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout:Install 6 Packages 2024-02-22T00:21:25.182 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:25.183 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 5.9 M 2024-02-22T00:21:25.183 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 24 M 2024-02-22T00:21:25.183 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:21:25.469 INFO:teuthology.orchestra.run.smithi049.stdout:(1/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 4.6 MB/s | 578 kB 00:00 2024-02-22T00:21:25.528 INFO:teuthology.orchestra.run.smithi049.stdout:(2/6): ceph-mgr-cephadm-16.2.14-550.geb66ed92.e 636 kB/s | 116 kB 00:00 2024-02-22T00:21:25.620 INFO:teuthology.orchestra.run.smithi049.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2024-02-22T00:21:25.637 INFO:teuthology.orchestra.run.smithi049.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 126 kB/s | 21 kB 00:00 2024-02-22T00:21:25.787 INFO:teuthology.orchestra.run.smithi049.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 293 kB/s | 49 kB 00:00 2024-02-22T00:21:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.1 MB/s | 355 kB 00:00 2024-02-22T00:21:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:21:25.856 INFO:teuthology.orchestra.run.smithi049.stdout:Total 8.7 MB/s | 5.9 MB 00:00 2024-02-22T00:21:25.907 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:21:25.917 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:21:25.917 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:21:26.016 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:21:26.019 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:21:26.300 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:21:26.552 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-22T00:21:26.827 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-22T00:21:27.796 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-22T00:21:28.125 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-22T00:21:28.356 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-22T00:21:28.530 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-550.geb66ed92.el8.noarch 6/6 2024-02-22T00:21:28.825 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-550.geb66ed92.el8.noarch 6/6 2024-02-22T00:21:28.825 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/6 2024-02-22T00:21:28.825 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-22T00:21:28.825 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-22T00:21:28.825 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-22T00:21:28.825 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: python3-apipkg-1.5-6.el8.noarch 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.5.1-7.el8.noarch 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-02-22T00:21:29.224 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:29.225 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:29.372 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-fuse 2024-02-22T00:21:30.158 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:32 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:31.838 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:31.839 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:31.839 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-02-22T00:21:31.839 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:31.839 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:21:31.839 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:16.2.14-550.geb66ed92.el8 ceph 911 k 2024-02-22T00:21:31.839 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-02-22T00:21:31.839 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-22T00:21:31.840 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:31.840 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:21:31.840 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:31.840 INFO:teuthology.orchestra.run.smithi049.stdout:Install 2 Packages 2024-02-22T00:21:31.840 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:31.840 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 994 k 2024-02-22T00:21:31.841 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 2.8 M 2024-02-22T00:21:31.841 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:21:32.348 INFO:teuthology.orchestra.run.smithi049.stdout:(1/2): ceph-fuse-16.2.14-550.geb66ed92.el8.x86_ 2.8 MB/s | 911 kB 00:00 2024-02-22T00:21:36.796 INFO:teuthology.orchestra.run.smithi049.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 17 kB/s | 83 kB 00:04 2024-02-22T00:21:36.797 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:21:36.797 INFO:teuthology.orchestra.run.smithi049.stdout:Total 201 kB/s | 994 kB 00:04 2024-02-22T00:21:36.809 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:21:36.833 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:21:36.833 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:21:36.933 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:21:36.936 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:21:37.112 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:21:37.374 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-22T00:21:37.621 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 2/2 2024-02-22T00:21:38.034 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 2/2 2024-02-22T00:21:38.034 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 1/2 2024-02-22T00:21:38.459 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-22T00:21:38.459 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:38.460 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:21:38.460 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-22T00:21:38.460 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:38.460 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:39.751 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librados-devel 2024-02-22T00:21:40.549 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:42 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:42.222 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:42.222 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:16.2.14-550.geb66ed92.el8 ceph 131 k 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-02-22T00:21:42.223 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:42.224 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 131 k 2024-02-22T00:21:42.224 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 432 k 2024-02-22T00:21:42.224 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:21:42.520 INFO:teuthology.orchestra.run.smithi049.stdout:librados-devel-16.2.14-550.geb66ed92.el8.x86_64 443 kB/s | 131 kB 00:00 2024-02-22T00:21:42.520 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:21:42.521 INFO:teuthology.orchestra.run.smithi049.stdout:Total 441 kB/s | 131 kB 00:00 2024-02-22T00:21:42.521 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:21:42.527 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:21:42.527 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:21:42.581 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:21:42.584 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:21:42.701 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:21:42.927 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:21:43.229 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:21:43.653 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:21:43.653 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:43.653 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:21:43.653 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:21:43.653 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:43.653 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:43.873 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install libcephfs2 2024-02-22T00:21:44.673 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:46 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:46.312 INFO:teuthology.orchestra.run.smithi049.stdout:Package libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:21:46.362 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:46.364 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:21:46.364 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:46.482 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install libcephfs-devel 2024-02-22T00:21:47.277 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:49 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:48.960 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2024-02-22T00:21:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:48.960 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:21:48.961 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:16.2.14-550.geb66ed92.el8 ceph 25 k 2024-02-22T00:21:48.961 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:21:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:21:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-02-22T00:21:48.961 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:48.961 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 25 k 2024-02-22T00:21:48.962 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 107 k 2024-02-22T00:21:48.962 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:21:49.181 INFO:teuthology.orchestra.run.smithi049.stdout:libcephfs-devel-16.2.14-550.geb66ed92.el8.x86_6 116 kB/s | 25 kB 00:00 2024-02-22T00:21:49.181 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:21:49.181 INFO:teuthology.orchestra.run.smithi049.stdout:Total 116 kB/s | 25 kB 00:00 2024-02-22T00:21:49.181 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:21:49.185 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:21:49.185 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:21:49.187 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:21:49.191 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:21:49.239 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:21:49.440 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:21:49.703 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:21:50.066 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:21:50.066 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:50.066 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:21:50.066 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:21:50.066 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:21:50.066 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:50.204 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librados2 2024-02-22T00:21:50.994 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:52 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:52.621 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:21:52.673 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:52.674 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:21:52.675 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:52.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install librbd1 2024-02-22T00:21:53.585 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:55 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:55.208 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:21:55.258 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:55.259 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:21:55.259 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:55.374 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rados 2024-02-22T00:21:56.165 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:03:58 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:21:57.806 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rados-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:21:57.857 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:21:57.858 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:21:57.858 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:21:57.979 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rgw 2024-02-22T00:21:58.770 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:04:00 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:22:00.424 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rgw-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:22:00.477 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:22:00.478 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:22:00.478 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:22:00.611 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-cephfs 2024-02-22T00:22:01.405 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:04:03 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:22:03.040 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-cephfs-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:22:03.092 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:22:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:22:03.094 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:22:03.221 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install python3-rbd 2024-02-22T00:22:04.013 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:04:06 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:22:05.666 INFO:teuthology.orchestra.run.smithi049.stdout:Package python3-rbd-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:22:05.716 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:22:05.717 INFO:teuthology.orchestra.run.smithi049.stdout:Nothing to do. 2024-02-22T00:22:05.718 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:22:05.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-fuse 2024-02-22T00:22:06.630 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:04:08 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:22:08.335 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:22:08.335 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:08.335 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-02-22T00:22:08.335 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:08.335 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:22:08.336 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:16.2.14-550.geb66ed92.el8 ceph 88 k 2024-02-22T00:22:08.336 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:08.336 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:22:08.336 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:08.336 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-02-22T00:22:08.336 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:08.336 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 88 k 2024-02-22T00:22:08.337 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 240 k 2024-02-22T00:22:08.337 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:22:08.595 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-fuse-16.2.14-550.geb66ed92.el8.x86_64.rpm 343 kB/s | 88 kB 00:00 2024-02-22T00:22:08.595 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:22:08.595 INFO:teuthology.orchestra.run.smithi049.stdout:Total 341 kB/s | 88 kB 00:00 2024-02-22T00:22:08.595 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:22:08.606 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:22:08.606 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:22:08.661 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:22:08.664 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:22:08.775 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:22:08.972 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:09.271 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:09.692 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:09.692 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:09.692 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:22:09.692 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:22:09.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:09.695 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:22:09.891 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-mirror 2024-02-22T00:22:10.686 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:04:12 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:22:12.366 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:22:12.367 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:12.367 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repo Size 2024-02-22T00:22:12.367 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:12.367 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:22:12.367 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:16.2.14-550.geb66ed92.el8 ceph 3.7 M 2024-02-22T00:22:12.367 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:12.368 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:22:12.368 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:12.368 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-02-22T00:22:12.368 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:12.368 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 3.7 M 2024-02-22T00:22:12.368 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 15 M 2024-02-22T00:22:12.368 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:22:12.890 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-mirror-16.2.14-550.geb66ed92.el8.x86_64.rpm 7.0 MB/s | 3.7 MB 00:00 2024-02-22T00:22:12.890 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:22:12.891 INFO:teuthology.orchestra.run.smithi049.stdout:Total 7.0 MB/s | 3.7 MB 00:00 2024-02-22T00:22:12.891 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:22:12.904 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:22:12.904 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:22:12.972 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:22:12.974 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:22:13.442 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:22:13.639 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:14.058 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:14.478 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:14.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:14.478 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:22:14.478 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:22:14.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:14.478 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:22:14.688 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install rbd-nbd 2024-02-22T00:22:15.478 INFO:teuthology.orchestra.run.smithi049.stdout:Last metadata expiration check: 0:04:17 ago on Thu 22 Feb 2024 12:17:58 AM UTC. 2024-02-22T00:22:17.161 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:16.2.14-550.geb66ed92.el8 ceph 175 k 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout:Install 1 Package 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:17.162 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 175 k 2024-02-22T00:22:17.163 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 523 k 2024-02-22T00:22:17.163 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-02-22T00:22:17.461 INFO:teuthology.orchestra.run.smithi049.stdout:rbd-nbd-16.2.14-550.geb66ed92.el8.x86_64.rpm 587 kB/s | 175 kB 00:00 2024-02-22T00:22:17.462 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:22:17.462 INFO:teuthology.orchestra.run.smithi049.stdout:Total 585 kB/s | 175 kB 00:00 2024-02-22T00:22:17.462 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-02-22T00:22:17.473 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-02-22T00:22:17.474 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-02-22T00:22:17.526 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-02-22T00:22:17.530 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-02-22T00:22:17.658 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-02-22T00:22:17.895 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:18.196 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-nbd-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:18.586 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:18.586 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:18.586 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-02-22T00:22:18.586 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:22:18.586 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:22:18.586 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-02-22T00:22:18.845 DEBUG:teuthology.parallel:result is None 2024-02-22T00:22:18.852 INFO:teuthology.orchestra.run.smithi161.stdout:[MIRROR] python3-cachetools-3.1.1-4.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://epel.stl.us.ssimn.org/8/Everything/x86_64/Packages/p/python3-cachetools-3.1.1-4.el8.noarch.rpm [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out] 2024-02-22T00:22:26.119 INFO:teuthology.orchestra.run.smithi161.stdout:(13/13): python3-cachetools-3.1.1-4.el8.noarch. 246 B/s | 33 kB 02:17 2024-02-22T00:22:26.120 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:22:26.120 INFO:teuthology.orchestra.run.smithi161.stdout:Total 14 kB/s | 1.9 MB 02:19 2024-02-22T00:22:26.172 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:22:26.188 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:22:26.188 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:22:26.276 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:22:26.279 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:22:26.843 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:22:27.070 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-02-22T00:22:27.250 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-02-22T00:22:27.489 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-02-22T00:22:27.724 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-02-22T00:22:27.939 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-02-22T00:22:28.162 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-02-22T00:22:28.453 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-02-22T00:22:28.687 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-02-22T00:22:29.711 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-02-22T00:22:29.973 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-02-22T00:22:30.223 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-02-22T00:22:30.416 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-02-22T00:22:30.607 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:16.2.14-550.geb66ed92.el8.noarch 13/13 2024-02-22T00:22:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-550.geb66ed92.el8.noarch 13/13 2024-02-22T00:22:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:16.2.14-550.geb66ed92.el8.noarch 1/13 2024-02-22T00:22:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-02-22T00:22:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-02-22T00:22:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-02-22T00:22:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-02-22T00:22:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-02-22T00:22:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-02-22T00:22:30.929 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-02-22T00:22:30.929 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-02-22T00:22:30.929 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-02-22T00:22:30.929 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-02-22T00:22:30.929 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-02-22T00:22:31.390 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-02-22T00:22:31.390 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:31.390 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:22:31.390 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:22:31.390 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-02-22T00:22:31.390 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-02-22T00:22:31.390 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-02-22T00:22:31.390 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:31.391 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:22:31.505 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-cephadm 2024-02-22T00:22:32.274 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:10 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:22:33.852 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:16.2.14-550.geb66ed92.el8 ceph-noarch 116 k 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-02-22T00:22:33.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-02-22T00:22:33.854 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:22:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:Install 6 Packages 2024-02-22T00:22:33.854 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 5.9 M 2024-02-22T00:22:33.854 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 24 M 2024-02-22T00:22:33.855 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:22:34.076 INFO:teuthology.orchestra.run.smithi161.stdout:(1/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 4.7 MB/s | 578 kB 00:00 2024-02-22T00:22:34.134 INFO:teuthology.orchestra.run.smithi161.stdout:(2/6): ceph-mgr-cephadm-16.2.14-550.geb66ed92.e 648 kB/s | 116 kB 00:00 2024-02-22T00:22:34.209 INFO:teuthology.orchestra.run.smithi161.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2024-02-22T00:22:34.243 INFO:teuthology.orchestra.run.smithi161.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 127 kB/s | 21 kB 00:00 2024-02-22T00:22:34.369 INFO:teuthology.orchestra.run.smithi161.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 317 kB/s | 49 kB 00:00 2024-02-22T00:22:34.435 INFO:teuthology.orchestra.run.smithi161.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.2 MB/s | 355 kB 00:00 2024-02-22T00:22:34.438 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:22:34.438 INFO:teuthology.orchestra.run.smithi161.stdout:Total 10 MB/s | 5.9 MB 00:00 2024-02-22T00:22:34.489 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:22:34.499 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:22:34.499 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:22:34.592 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:22:34.595 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:22:34.872 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:22:35.140 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-02-22T00:22:35.452 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-02-22T00:22:36.390 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-02-22T00:22:36.745 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-02-22T00:22:36.982 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-02-22T00:22:37.215 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-550.geb66ed92.el8.noarch 6/6 2024-02-22T00:22:37.489 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-550.geb66ed92.el8.noarch 6/6 2024-02-22T00:22:37.489 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-550.geb66ed92.el8.noarch 1/6 2024-02-22T00:22:37.489 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-02-22T00:22:37.489 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-02-22T00:22:37.489 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-02-22T00:22:37.490 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-02-22T00:22:37.887 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-02-22T00:22:37.887 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:37.887 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:22:37.887 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:16.2.14-550.geb66ed92.el8.noarch 2024-02-22T00:22:37.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-apipkg-1.5-6.el8.noarch 2024-02-22T00:22:37.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.5.1-7.el8.noarch 2024-02-22T00:22:37.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-02-22T00:22:37.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-02-22T00:22:37.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-02-22T00:22:37.888 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:37.888 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:22:38.012 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-fuse 2024-02-22T00:22:38.763 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:16 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:22:40.342 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:22:40.343 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:40.343 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-02-22T00:22:40.343 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:40.343 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:22:40.343 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:16.2.14-550.geb66ed92.el8 ceph 911 k 2024-02-22T00:22:40.343 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-02-22T00:22:40.343 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2024-02-22T00:22:40.344 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:40.344 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:22:40.344 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:40.344 INFO:teuthology.orchestra.run.smithi161.stdout:Install 2 Packages 2024-02-22T00:22:40.344 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:40.344 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 994 k 2024-02-22T00:22:40.344 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 2.8 M 2024-02-22T00:22:40.345 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:22:40.644 INFO:teuthology.orchestra.run.smithi161.stdout:(1/2): ceph-fuse-16.2.14-550.geb66ed92.el8.x86_ 3.4 MB/s | 911 kB 00:00 2024-02-22T00:22:46.635 INFO:teuthology.orchestra.run.smithi161.stdout:(2/2): fuse-2.9.7-17.el8.x86_64.rpm 13 kB/s | 83 kB 00:06 2024-02-22T00:22:46.636 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:22:46.636 INFO:teuthology.orchestra.run.smithi161.stdout:Total 158 kB/s | 994 kB 00:06 2024-02-22T00:22:46.647 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:22:46.669 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:22:46.669 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:22:46.761 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:22:46.764 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:22:46.934 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:22:47.204 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2024-02-22T00:22:47.422 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 2/2 2024-02-22T00:22:47.815 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 2/2 2024-02-22T00:22:47.815 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 1/2 2024-02-22T00:22:48.244 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2024-02-22T00:22:48.244 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:48.244 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:22:48.244 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2024-02-22T00:22:48.244 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:48.245 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:22:48.521 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librados-devel 2024-02-22T00:22:49.290 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:27 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:22:50.871 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:16.2.14-550.geb66ed92.el8 ceph 131 k 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-02-22T00:22:50.872 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:50.873 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 131 k 2024-02-22T00:22:50.873 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 432 k 2024-02-22T00:22:50.873 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:22:51.174 INFO:teuthology.orchestra.run.smithi161.stdout:librados-devel-16.2.14-550.geb66ed92.el8.x86_64 435 kB/s | 131 kB 00:00 2024-02-22T00:22:51.175 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:22:51.175 INFO:teuthology.orchestra.run.smithi161.stdout:Total 433 kB/s | 131 kB 00:00 2024-02-22T00:22:51.175 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:22:51.180 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:22:51.181 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:22:51.230 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:22:51.233 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:22:51.352 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:22:51.587 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:51.891 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:52.286 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:52.286 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:52.286 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:22:52.286 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:22:52.286 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:52.286 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:22:52.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install libcephfs2 2024-02-22T00:22:53.279 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:31 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:22:54.781 INFO:teuthology.orchestra.run.smithi161.stdout:Package libcephfs2-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:22:54.829 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:22:54.830 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:22:54.830 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:22:54.942 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install libcephfs-devel 2024-02-22T00:22:55.701 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:33 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:22:57.274 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:22:57.274 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:16.2.14-550.geb66ed92.el8 ceph 25 k 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-02-22T00:22:57.275 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:57.276 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 25 k 2024-02-22T00:22:57.276 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 107 k 2024-02-22T00:22:57.276 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:22:57.509 INFO:teuthology.orchestra.run.smithi161.stdout:libcephfs-devel-16.2.14-550.geb66ed92.el8.x86_6 109 kB/s | 25 kB 00:00 2024-02-22T00:22:57.510 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:22:57.510 INFO:teuthology.orchestra.run.smithi161.stdout:Total 109 kB/s | 25 kB 00:00 2024-02-22T00:22:57.510 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:22:57.513 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:22:57.513 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:22:57.516 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:22:57.519 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:22:57.570 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:22:57.776 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:58.072 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:22:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:58.434 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:22:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:22:58.434 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:22:58.434 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:22:58.562 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librados2 2024-02-22T00:22:59.317 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:37 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:00.829 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:23:00.879 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:00.880 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:23:00.880 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:00.984 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librbd1 2024-02-22T00:23:01.742 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:39 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:03.270 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:23:03.317 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:03.319 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:23:03.319 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:03.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rados 2024-02-22T00:23:04.190 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:42 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:05.675 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rados-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:23:05.723 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:05.724 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:23:05.724 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:05.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rgw 2024-02-22T00:23:06.604 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:44 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:08.141 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rgw-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:23:08.189 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:08.190 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:23:08.190 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:08.307 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-cephfs 2024-02-22T00:23:09.075 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:47 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:10.638 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-cephfs-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:23:10.686 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:10.687 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:23:10.688 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:10.806 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rbd 2024-02-22T00:23:11.570 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:49 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:13.085 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rbd-2:16.2.14-550.geb66ed92.el8.x86_64 is already installed. 2024-02-22T00:23:13.132 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:13.133 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-02-22T00:23:13.133 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:13.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-fuse 2024-02-22T00:23:14.008 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:52 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:15.574 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:15.575 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:15.575 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-02-22T00:23:15.575 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:15.575 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:23:15.575 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:16.2.14-550.geb66ed92.el8 ceph 88 k 2024-02-22T00:23:15.575 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:15.576 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:23:15.576 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:15.576 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-02-22T00:23:15.576 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:15.576 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 88 k 2024-02-22T00:23:15.576 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 240 k 2024-02-22T00:23:15.576 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:23:15.882 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-fuse-16.2.14-550.geb66ed92.el8.x86_64.rpm 289 kB/s | 88 kB 00:00 2024-02-22T00:23:15.883 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:23:15.883 INFO:teuthology.orchestra.run.smithi161.stdout:Total 288 kB/s | 88 kB 00:00 2024-02-22T00:23:15.883 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:23:15.892 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:23:15.893 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:23:15.942 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:23:15.945 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:23:16.057 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:23:16.275 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:16.554 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:16.939 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:16.939 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:16.939 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:23:16.939 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:23:16.940 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:16.940 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:17.203 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-mirror 2024-02-22T00:23:17.967 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:05:55 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:19.531 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:19.531 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:19.531 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:16.2.14-550.geb66ed92.el8 ceph 3.7 M 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 3.7 M 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 15 M 2024-02-22T00:23:19.532 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:23:20.326 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-mirror-16.2.14-550.geb66ed92.el8.x86_64.rpm 4.6 MB/s | 3.7 MB 00:00 2024-02-22T00:23:20.327 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:23:20.327 INFO:teuthology.orchestra.run.smithi161.stdout:Total 4.6 MB/s | 3.7 MB 00:00 2024-02-22T00:23:20.327 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:23:20.339 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:23:20.339 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:23:20.402 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:23:20.405 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:23:20.848 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:23:21.042 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:21.462 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:21.848 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:21.848 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:21.848 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:23:21.848 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:23:21.848 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:21.848 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:22.106 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-nbd 2024-02-22T00:23:22.870 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:06:00 ago on Thu 22 Feb 2024 12:17:22 AM UTC. 2024-02-22T00:23:24.429 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-02-22T00:23:24.430 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:24.430 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-02-22T00:23:24.430 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:24.430 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-02-22T00:23:24.430 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:16.2.14-550.geb66ed92.el8 ceph 175 k 2024-02-22T00:23:24.430 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:24.431 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-02-22T00:23:24.431 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-02-22T00:23:24.431 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-02-22T00:23:24.431 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:24.431 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 175 k 2024-02-22T00:23:24.431 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 523 k 2024-02-22T00:23:24.431 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-02-22T00:23:24.620 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-nbd-16.2.14-550.geb66ed92.el8.x86_64.rpm 927 kB/s | 175 kB 00:00 2024-02-22T00:23:24.621 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-02-22T00:23:24.621 INFO:teuthology.orchestra.run.smithi161.stdout:Total 920 kB/s | 175 kB 00:00 2024-02-22T00:23:24.621 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-02-22T00:23:24.631 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-02-22T00:23:24.632 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-02-22T00:23:24.681 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-02-22T00:23:24.684 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-02-22T00:23:24.817 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-02-22T00:23:25.028 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:25.349 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-nbd-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:25.730 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:16.2.14-550.geb66ed92.el8.x86_64 1/1 2024-02-22T00:23:25.730 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:25.731 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-02-22T00:23:25.731 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:16.2.14-550.geb66ed92.el8.x86_64 2024-02-22T00:23:25.731 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:23:25.731 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-02-22T00:23:25.952 DEBUG:teuthology.parallel:result is None 2024-02-22T00:23:25.953 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-22T00:23:25.953 INFO:teuthology.packaging:ref: None 2024-02-22T00:23:25.953 INFO:teuthology.packaging:tag: None 2024-02-22T00:23:25.953 INFO:teuthology.packaging:branch: pacific 2024-02-22T00:23:25.953 INFO:teuthology.packaging:sha1: c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:23:25.954 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-02-22T00:23:26.208 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-22T00:23:26.237 INFO:teuthology.orchestra.run.smithi049.stdout:16.2.14-550.geb66ed92.el8 2024-02-22T00:23:26.237 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-550.geb66ed92.el8 2024-02-22T00:23:26.237 INFO:teuthology.task.install:The correct ceph version 16.2.14-550.geb66ed92 is installed. 2024-02-22T00:23:26.239 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-22T00:23:26.239 INFO:teuthology.packaging:ref: None 2024-02-22T00:23:26.239 INFO:teuthology.packaging:tag: None 2024-02-22T00:23:26.239 INFO:teuthology.packaging:branch: pacific 2024-02-22T00:23:26.240 INFO:teuthology.packaging:sha1: c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:23:26.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-02-22T00:23:26.585 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-22T00:23:26.609 INFO:teuthology.orchestra.run.smithi161.stdout:16.2.14-550.geb66ed92.el8 2024-02-22T00:23:26.609 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-550.geb66ed92.el8 2024-02-22T00:23:26.610 INFO:teuthology.task.install:The correct ceph version 16.2.14-550.geb66ed92 is installed. 2024-02-22T00:23:26.611 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-22T00:23:26.612 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:23:26.612 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-22T00:23:26.648 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:23:26.648 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-22T00:23:26.678 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-22T00:23:26.679 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:23:26.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-02-22T00:23:26.719 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-22T00:23:26.790 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:23:26.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-02-22T00:23:26.817 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-22T00:23:26.885 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-22T00:23:26.885 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:23:26.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-22T00:23:26.915 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-22T00:23:26.986 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:23:26.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-22T00:23:27.014 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-22T00:23:27.081 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-22T00:23:27.081 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:23:27.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-02-22T00:23:27.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-22T00:23:27.180 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:23:27.180 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-02-22T00:23:27.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-22T00:23:27.274 INFO:teuthology.run_tasks:Running task print... 2024-02-22T00:23:27.287 INFO:teuthology.task.print:**** done install task... 2024-02-22T00:23:27.287 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-22T00:23:27.373 INFO:tasks.cephadm:Config: {'cephadm_branch': 'pacific', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:pacific', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'c1dc18f444603397768fcb7c34a8488b10284df6'} 2024-02-22T00:23:27.373 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:pacific 2024-02-22T00:23:27.373 INFO:tasks.cephadm:Cluster fsid is 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:23:27.374 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-22T00:23:27.374 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-22T00:23:27.374 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi049': '172.21.15.49', 'mon.smithi161': '172.21.15.161'} 2024-02-22T00:23:27.374 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-22T00:23:27.374 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname $(hostname -s) 2024-02-22T00:23:27.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname $(hostname -s) 2024-02-22T00:23:27.433 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref pacific)... 2024-02-22T00:23:27.433 DEBUG:teuthology.orchestra.run.smithi049:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-22T00:23:27.671 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Feb 22 00:23 /home/ubuntu/cephtest/cephadm 2024-02-22T00:23:27.671 DEBUG:teuthology.orchestra.run.smithi161:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-22T00:23:27.811 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Feb 22 00:23 /home/ubuntu/cephtest/cephadm 2024-02-22T00:23:27.811 DEBUG:teuthology.orchestra.run.smithi049:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-22T00:23:27.835 DEBUG:teuthology.orchestra.run.smithi161:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-22T00:23:27.888 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:pacific on all hosts... 2024-02-22T00:23:27.888 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull 2024-02-22T00:23:27.891 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull 2024-02-22T00:23:28.787 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-02-22T00:23:29.172 INFO:teuthology.orchestra.run.smithi161.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-02-22T00:23:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:23:57.062 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)", 2024-02-22T00:23:57.062 INFO:teuthology.orchestra.run.smithi049.stdout: "image_id": "7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550", 2024-02-22T00:23:57.062 INFO:teuthology.orchestra.run.smithi049.stdout: "repo_digests": [ 2024-02-22T00:23:57.062 INFO:teuthology.orchestra.run.smithi049.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010" 2024-02-22T00:23:57.062 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-02-22T00:23:57.062 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:23:57.653 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-22T00:23:57.653 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)", 2024-02-22T00:23:57.653 INFO:teuthology.orchestra.run.smithi161.stdout: "image_id": "7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550", 2024-02-22T00:23:57.653 INFO:teuthology.orchestra.run.smithi161.stdout: "repo_digests": [ 2024-02-22T00:23:57.653 INFO:teuthology.orchestra.run.smithi161.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010" 2024-02-22T00:23:57.654 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-02-22T00:23:57.654 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-22T00:23:57.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph 2024-02-22T00:23:57.712 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph 2024-02-22T00:23:57.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /etc/ceph 2024-02-22T00:23:57.784 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /etc/ceph 2024-02-22T00:23:57.814 INFO:tasks.cephadm:Writing seed config... 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-22T00:23:57.816 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-22T00:23:57.817 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-22T00:23:57.818 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-22T00:23:57.819 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:23:57.819 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-22T00:23:57.845 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9923b37e-d118-11ee-95bd-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-22T00:23:57.845 DEBUG:teuthology.orchestra.run.smithi049:mon.smithi049> sudo journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi049.service 2024-02-22T00:23:57.887 INFO:tasks.cephadm:Bootstrapping... 2024-02-22T00:23:57.887 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific -v bootstrap --fsid 9923b37e-d118-11ee-95bd-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.49 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-22T00:23:57.918 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:-- Logs begin at Wed 2024-02-21 23:57:02 UTC. -- 2024-02-22T00:23:58.107 INFO:teuthology.orchestra.run.smithi049.stderr:-------------------------------------------------------------------------------- 2024-02-22T00:23:58.108 INFO:teuthology.orchestra.run.smithi049.stderr:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:pacific', '-v', 'bootstrap', '--fsid', '9923b37e-d118-11ee-95bd-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.49', '--skip-admin-label'] 2024-02-22T00:23:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: 4.9.3-dev 2024-02-22T00:23:58.143 INFO:teuthology.orchestra.run.smithi049.stderr:Verifying podman|docker is present... 2024-02-22T00:23:58.164 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: 4.9.3-dev 2024-02-22T00:23:58.179 INFO:teuthology.orchestra.run.smithi049.stderr:Verifying lvm2 is present... 2024-02-22T00:23:58.179 INFO:teuthology.orchestra.run.smithi049.stderr:Verifying time synchronization is in place... 2024-02-22T00:23:58.186 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-22T00:23:58.192 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: inactive 2024-02-22T00:23:58.198 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: enabled 2024-02-22T00:23:58.203 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: active 2024-02-22T00:23:58.204 INFO:teuthology.orchestra.run.smithi049.stderr:Unit chronyd.service is enabled and running 2024-02-22T00:23:58.204 INFO:teuthology.orchestra.run.smithi049.stderr:Repeating the final host check... 2024-02-22T00:23:58.224 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: 4.9.3-dev 2024-02-22T00:23:58.237 INFO:teuthology.orchestra.run.smithi049.stderr:podman (/bin/podman) version 4.9.3 is present 2024-02-22T00:23:58.237 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl is present 2024-02-22T00:23:58.238 INFO:teuthology.orchestra.run.smithi049.stderr:lvcreate is present 2024-02-22T00:23:58.243 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-02-22T00:23:58.248 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: inactive 2024-02-22T00:23:58.254 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: enabled 2024-02-22T00:23:58.260 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: active 2024-02-22T00:23:58.261 INFO:teuthology.orchestra.run.smithi049.stderr:Unit chronyd.service is enabled and running 2024-02-22T00:23:58.261 INFO:teuthology.orchestra.run.smithi049.stderr:Host looks OK 2024-02-22T00:23:58.261 INFO:teuthology.orchestra.run.smithi049.stderr:Cluster fsid: 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:23:58.261 INFO:teuthology.orchestra.run.smithi049.stderr:Acquiring lock 139653369014760 on /run/cephadm/9923b37e-d118-11ee-95bd-87774f69a715.lock 2024-02-22T00:23:58.261 INFO:teuthology.orchestra.run.smithi049.stderr:Lock 139653369014760 acquired on /run/cephadm/9923b37e-d118-11ee-95bd-87774f69a715.lock 2024-02-22T00:23:58.261 INFO:teuthology.orchestra.run.smithi049.stderr:Verifying IP 172.21.15.49 port 3300 ... 2024-02-22T00:23:58.262 INFO:teuthology.orchestra.run.smithi049.stderr:Verifying IP 172.21.15.49 port 6789 ... 2024-02-22T00:23:58.262 INFO:teuthology.orchestra.run.smithi049.stderr:Base mon IP(s) is [172.21.15.49:3300, 172.21.15.49:6789], mon addrv is [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-02-22T00:23:58.265 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.49 metric 100 2024-02-22T00:23:58.266 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.49 metric 100 2024-02-22T00:23:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-02-22T00:23:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-02-22T00:23:58.269 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-02-22T00:23:58.271 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-22T00:23:58.271 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-02-22T00:23:58.271 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-22T00:23:58.271 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2024-02-22T00:23:58.271 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-02-22T00:23:58.272 INFO:teuthology.orchestra.run.smithi049.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-02-22T00:23:58.272 INFO:teuthology.orchestra.run.smithi049.stderr:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-02-22T00:23:58.272 INFO:teuthology.orchestra.run.smithi049.stderr:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-02-22T00:23:58.272 INFO:teuthology.orchestra.run.smithi049.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-22T00:23:58.273 INFO:teuthology.orchestra.run.smithi049.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-22T00:23:58.274 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-02-22T00:23:58.352 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: Trying to pull quay.ceph.io/ceph-ci/ceph:pacific... 2024-02-22T00:23:58.492 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: Getting image source signatures 2024-02-22T00:23:58.493 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: Copying blob sha256:6a725db67f9d8a3d1854323a2987a594424da05f10d8a333e41377f3b137fc12 2024-02-22T00:23:58.493 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: Copying blob sha256:0f642e61a11afb42c0ccb5b05f5809250ad643ed143780d6ff49a5a4c492fc38 2024-02-22T00:23:58.493 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: Copying config sha256:7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550 2024-02-22T00:23:58.661 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: Writing manifest to image destination 2024-02-22T00:23:58.746 INFO:teuthology.orchestra.run.smithi049.stderr:/bin/podman: 7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550 2024-02-22T00:23:59.229 INFO:teuthology.orchestra.run.smithi049.stderr:ceph: ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable) 2024-02-22T00:23:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:Ceph version: ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable) 2024-02-22T00:23:59.826 INFO:teuthology.orchestra.run.smithi049.stderr:Extracting ceph user uid/gid from container image... 2024-02-22T00:24:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:stat: 167 167 2024-02-22T00:24:00.822 INFO:teuthology.orchestra.run.smithi049.stderr:Creating initial keys... 2024-02-22T00:24:01.750 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-authtool: AQAhlNZlMzcSEBAA9R89jG1QqDFd2Gnl3I5l8A== 2024-02-22T00:24:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-authtool: AQAilNZlbVMvKxAAM6KwQQmWFjJNlhc524Hp0Q== 2024-02-22T00:24:03.855 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-authtool: AQAjlNZlv5OTLRAArix+ATmJd44vKmLfZizDSQ== 2024-02-22T00:24:04.354 INFO:teuthology.orchestra.run.smithi049.stderr:Creating initial monmap... 2024-02-22T00:24:04.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-22T00:24:04.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:04.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-22T00:24:05.370 INFO:teuthology.orchestra.run.smithi049.stderr:monmaptool for smithi049 [v2:172.21.15.49:3300,v1:172.21.15.49:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-22T00:24:05.371 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/monmaptool: set fsid to 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:05.371 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-22T00:24:05.371 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:24:05.371 INFO:teuthology.orchestra.run.smithi049.stderr:Creating mon... 2024-02-22T00:24:05.857 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.781+0000 7f33aca7b880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T00:24:05.857 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.781+0000 7f33aca7b880 1 imported monmap: 2024-02-22T00:24:05.857 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: epoch 0 2024-02-22T00:24:05.857 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:05.857 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: last_changed 2024-02-22T00:24:04.747718+0000 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: created 2024-02-22T00:24:04.747718+0000 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.smithi049 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.781+0000 7f33aca7b880 0 /usr/bin/ceph-mon: set fsid to 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: RocksDB version: 6.8.1 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Compile date Feb 20 2024 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: DB SUMMARY 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi049/store.db dir, Total Num: 0, files: 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.858 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi049/store.db: 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.error_if_exists: 0 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.create_if_missing: 1 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.env: 0x55905cbf5080 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.fs: Posix File System 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.info_log: 0x55905efb7300 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.statistics: (nil) 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.use_fsync: 0 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T00:24:05.859 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.db_log_dir: 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi049/store.db 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T00:24:05.860 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.write_buffer_manager: 0x55905efbd950 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T00:24:05.861 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.unordered_write: 0 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.row_cache: None 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.wal_filter: None 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T00:24:05.862 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.two_write_queues: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.atomic_flush: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.log_readahead_size: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T00:24:05.863 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.max_open_files: -1 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Compression algorithms supported: 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: kZSTD supported: 0 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: kXpressCompression supported: 0 2024-02-22T00:24:05.864 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: kZlibCompression supported: 1 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.782+0000 7f33aca7b880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000001 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.merge_operator: 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_filter: None 2024-02-22T00:24:05.865 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55905eecdd18) 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: index_type: 0 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: checksum: 1 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-02-22T00:24:05.866 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: block_cache: 0x55905ef02d10 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-02-22T00:24:05.867 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: format_version: 2 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: block_align: 0 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compression: NoCompression 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T00:24:05.868 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.num_levels: 7 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T00:24:05.869 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T00:24:05.870 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T00:24:05.871 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T00:24:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T00:24:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.table_properties_collectors: 2024-02-22T00:24:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T00:24:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T00:24:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T00:24:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T00:24:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T00:24:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.bloom_locality: 0 2024-02-22T00:24:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.ttl: 2592000 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.783+0000 7f33aca7b880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.784+0000 7f33aca7b880 4 rocksdb: DB pointer 0x55905efcb800 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.784+0000 7f33958ee700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.784+0000 7f33958ee700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-22T00:24:05.874 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T00:24:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:24:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T00:24:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.786+0000 7f33aca7b880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.786+0000 7f33aca7b880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-02-22T00:24:05.878 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph-mon: debug 2024-02-22T00:24:05.786+0000 7f33aca7b880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi049 for mon.smithi049 2024-02-22T00:24:06.402 INFO:teuthology.orchestra.run.smithi049.stderr:create mon.smithi049 on 2024-02-22T00:24:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-02-22T00:24:06.514 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-22T00:24:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9923b37e-d118-11ee-95bd-87774f69a715.target → /etc/systemd/system/ceph-9923b37e-d118-11ee-95bd-87774f69a715.target. 2024-02-22T00:24:06.610 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-9923b37e-d118-11ee-95bd-87774f69a715.target → /etc/systemd/system/ceph-9923b37e-d118-11ee-95bd-87774f69a715.target. 2024-02-22T00:24:06.820 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Failed to reset failed state of unit ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi049.service: Unit ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi049.service not loaded. 2024-02-22T00:24:06.826 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Created symlink /etc/systemd/system/ceph-9923b37e-d118-11ee-95bd-87774f69a715.target.wants/ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi049.service → /etc/systemd/system/ceph-9923b37e-d118-11ee-95bd-87774f69a715@.service. 2024-02-22T00:24:07.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:06 smithi049 systemd[1]: Starting Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:24:07.538 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: disabled 2024-02-22T00:24:07.545 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: inactive 2024-02-22T00:24:07.546 INFO:teuthology.orchestra.run.smithi049.stderr:firewalld.service is not enabled 2024-02-22T00:24:07.547 INFO:teuthology.orchestra.run.smithi049.stderr:Not possible to enable service . firewalld.service is not available 2024-02-22T00:24:07.547 INFO:teuthology.orchestra.run.smithi049.stderr:Waiting for mon to start... 2024-02-22T00:24:07.547 INFO:teuthology.orchestra.run.smithi049.stderr:Waiting for mon... 2024-02-22T00:24:07.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: cluster 2024-02-22T00:24:07.498421+0000 mon.smithi049 (mon.0) 0 : [INF] mkfs 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:07.770 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: cluster 2024-02-22T00:24:07.482910+0000 mon.smithi049 (mon.0) 1 : cluster [INF] mon.smithi049 is new leader, mons smithi049 in quorum (ranks 0) 2024-02-22T00:24:07.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:07 smithi049 bash[66801]: b3bd17fc6041a836dfd97efc80ddaaa6b3cf1a67dc13682b8beda96deb86aff6 2024-02-22T00:24:07.771 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:07 smithi049 systemd[1]: Started Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.059+0000 7ff493228700 1 Processor -- start 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.059+0000 7ff493228700 1 -- start start 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.059+0000 7ff493228700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.060+0000 7ff493228700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c071fc0 con 0x7ff48c071ba0 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.060+0000 7ff490fc4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.060+0000 7ff490fc4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54638/0 (socket says 172.21.15.49:54638) 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.060+0000 7ff490fc4700 1 -- 172.21.15.49:0/2049500201 learned_addr learned my addr 172.21.15.49:0/2049500201 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.060+0000 7ff490fc4700 1 -- 172.21.15.49:0/2049500201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c1001e0 con 0x7ff48c071ba0 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff490fc4700 1 --2- 172.21.15.49:0/2049500201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0ffcf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff480009730 tx=0x7ff4800090f0).ready entity=mon.0 client_cookie=6fdae087562bf8a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:08.066 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff48b7fe700 1 -- 172.21.15.49:0/2049500201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff48000b6e0 con 0x7ff48c071ba0 2024-02-22T00:24:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff48b7fe700 1 -- 172.21.15.49:0/2049500201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48000b840 con 0x7ff48c071ba0 2024-02-22T00:24:08.067 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff48b7fe700 1 -- 172.21.15.49:0/2049500201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff48000bb10 con 0x7ff48c071ba0 2024-02-22T00:24:08.069 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff493228700 1 -- 172.21.15.49:0/2049500201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 msgr2=0x7ff48c0ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:08.069 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff493228700 1 --2- 172.21.15.49:0/2049500201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0ffcf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff480009730 tx=0x7ff4800090f0).stop 2024-02-22T00:24:08.069 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff493228700 1 -- 172.21.15.49:0/2049500201 shutdown_connections 2024-02-22T00:24:08.069 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff493228700 1 --2- 172.21.15.49:0/2049500201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0ffcf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:08.069 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.061+0000 7ff493228700 1 -- 172.21.15.49:0/2049500201 >> 172.21.15.49:0/2049500201 conn(0x7ff48c0f76f0 msgr2=0x7ff48c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:08.069 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.062+0000 7ff493228700 1 -- 172.21.15.49:0/2049500201 shutdown_connections 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.062+0000 7ff493228700 1 -- 172.21.15.49:0/2049500201 wait complete. 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.062+0000 7ff493228700 1 Processor -- start 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.062+0000 7ff493228700 1 -- start start 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.062+0000 7ff493228700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.062+0000 7ff493228700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0fbbf0 con 0x7ff48c071ba0 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff490fc4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff490fc4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54644/0 (socket says 172.21.15.49:54644) 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff490fc4700 1 -- 172.21.15.49:0/1916674624 learned_addr learned my addr 172.21.15.49:0/1916674624 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff490fc4700 1 -- 172.21.15.49:0/1916674624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009370 con 0x7ff48c071ba0 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff490fc4700 1 --2- 172.21.15.49:0/1916674624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0fd770 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff480000c00 tx=0x7ff480017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff489ffb700 1 -- 172.21.15.49:0/1916674624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff480011cc0 con 0x7ff48c071ba0 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff489ffb700 1 -- 172.21.15.49:0/1916674624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480011e20 con 0x7ff48c071ba0 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48c0fbd90 con 0x7ff48c071ba0 2024-02-22T00:24:08.070 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff489ffb700 1 -- 172.21.15.49:0/1916674624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff48001d590 con 0x7ff48c071ba0 2024-02-22T00:24:08.071 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.063+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c0fc1a0 con 0x7ff48c071ba0 2024-02-22T00:24:08.071 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.064+0000 7ff489ffb700 1 -- 172.21.15.49:0/1916674624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff48001da20 con 0x7ff48c071ba0 2024-02-22T00:24:08.071 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.064+0000 7ff489ffb700 1 -- 172.21.15.49:0/1916674624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff480026b10 con 0x7ff48c071ba0 2024-02-22T00:24:08.072 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.064+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c046ce0 con 0x7ff48c071ba0 2024-02-22T00:24:08.072 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.067+0000 7ff489ffb700 1 -- 172.21.15.49:0/1916674624 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7ff480021030 con 0x7ff48c071ba0 2024-02-22T00:24:08.144 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.136+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff48c105160 con 0x7ff48c071ba0 2024-02-22T00:24:08.144 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.136+0000 7ff489ffb700 1 -- 172.21.15.49:0/1916674624 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7ff48002f430 con 0x7ff48c071ba0 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: cluster: 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: id: 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: services: 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi049 (age 0.640168s) 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mgr: no daemons active 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: data: 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-02-22T00:24:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: pgs: 2024-02-22T00:24:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.137+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 msgr2=0x7ff48c0fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.137+0000 7ff493228700 1 --2- 172.21.15.49:0/1916674624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0fd770 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff480000c00 tx=0x7ff480017000).stop 2024-02-22T00:24:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.137+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 shutdown_connections 2024-02-22T00:24:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.137+0000 7ff493228700 1 --2- 172.21.15.49:0/1916674624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff48c071ba0 0x7ff48c0fd770 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.137+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 >> 172.21.15.49:0/1916674624 conn(0x7ff48c0f76f0 msgr2=0x7ff48c0f93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.137+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 shutdown_connections 2024-02-22T00:24:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:08.137+0000 7ff493228700 1 -- 172.21.15.49:0/1916674624 wait complete. 2024-02-22T00:24:08.676 INFO:teuthology.orchestra.run.smithi049.stderr:mon is available 2024-02-22T00:24:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:Assimilating anything we can from ceph.conf... 2024-02-22T00:24:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: cluster 2024-02-22T00:24:07.497647+0000 mon.smithi049 (mon.0) 2 : cluster [INF] mon.smithi049 is new leader, mons smithi049 in quorum (ranks 0) 2024-02-22T00:24:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: cluster 2024-02-22T00:24:07.497766+0000 mon.smithi049 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0]} removed_ranks: {} 2024-02-22T00:24:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: cluster 2024-02-22T00:24:07.499561+0000 mon.smithi049 (mon.0) 4 : cluster [DBG] fsmap 2024-02-22T00:24:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: cluster 2024-02-22T00:24:07.501190+0000 mon.smithi049 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-22T00:24:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: cluster 2024-02-22T00:24:07.501637+0000 mon.smithi049 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-22T00:24:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: audit 2024-02-22T00:24:08.137764+0000 mon.smithi049 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.49:0/1916674624' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T00:24:09.169 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.161+0000 7f9d2e3e6700 1 Processor -- start 2024-02-22T00:24:09.169 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.161+0000 7f9d2e3e6700 1 -- start start 2024-02-22T00:24:09.169 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d2e3e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d280ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:09.169 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d2e3e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d28100120 con 0x7f9d28071c60 2024-02-22T00:24:09.169 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d27fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d280ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:09.169 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d27fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d280ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54650/0 (socket says 172.21.15.49:54650) 2024-02-22T00:24:09.169 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d27fff700 1 -- 172.21.15.49:0/3690573861 learned_addr learned my addr 172.21.15.49:0/3690573861 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d27fff700 1 -- 172.21.15.49:0/3690573861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d28100260 con 0x7f9d28071c60 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d27fff700 1 --2- 172.21.15.49:0/3690573861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d280ffc30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f9d18009730 tx=0x7f9d180090f0).ready entity=mon.0 client_cookie=ab3b89897699db14 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d26ffd700 1 -- 172.21.15.49:0/3690573861 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d1800b6e0 con 0x7f9d28071c60 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d26ffd700 1 -- 172.21.15.49:0/3690573861 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800b840 con 0x7f9d28071c60 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.162+0000 7f9d26ffd700 1 -- 172.21.15.49:0/3690573861 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d1800bb10 con 0x7f9d28071c60 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.163+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/3690573861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 msgr2=0x7f9d280ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.163+0000 7f9d2e3e6700 1 --2- 172.21.15.49:0/3690573861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d280ffc30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f9d18009730 tx=0x7f9d180090f0).stop 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.163+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/3690573861 shutdown_connections 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.163+0000 7f9d2e3e6700 1 --2- 172.21.15.49:0/3690573861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d280ffc30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.163+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/3690573861 >> 172.21.15.49:0/3690573861 conn(0x7f9d280f76f0 msgr2=0x7f9d280f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.163+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/3690573861 shutdown_connections 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.163+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/3690573861 wait complete. 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.164+0000 7f9d2e3e6700 1 Processor -- start 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.164+0000 7f9d2e3e6700 1 -- start start 2024-02-22T00:24:09.170 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.164+0000 7f9d2e3e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d2810b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.164+0000 7f9d2e3e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2810bab0 con 0x7f9d28071c60 2024-02-22T00:24:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.164+0000 7f9d27fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d2810b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.164+0000 7f9d27fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d2810b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54656/0 (socket says 172.21.15.49:54656) 2024-02-22T00:24:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.164+0000 7f9d27fff700 1 -- 172.21.15.49:0/2798281755 learned_addr learned my addr 172.21.15.49:0/2798281755 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.164+0000 7f9d27fff700 1 -- 172.21.15.49:0/2798281755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18009370 con 0x7f9d28071c60 2024-02-22T00:24:09.171 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.165+0000 7f9d27fff700 1 --2- 172.21.15.49:0/2798281755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d2810b5c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f9d18000c00 tx=0x7f9d18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.165+0000 7f9d257fa700 1 -- 172.21.15.49:0/2798281755 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d18011cc0 con 0x7f9d28071c60 2024-02-22T00:24:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.165+0000 7f9d257fa700 1 -- 172.21.15.49:0/2798281755 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18011e20 con 0x7f9d28071c60 2024-02-22T00:24:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.165+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2810bcb0 con 0x7f9d28071c60 2024-02-22T00:24:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.165+0000 7f9d257fa700 1 -- 172.21.15.49:0/2798281755 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9d1801d590 con 0x7f9d28071c60 2024-02-22T00:24:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.165+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2810c0c0 con 0x7f9d28071c60 2024-02-22T00:24:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.165+0000 7f9d257fa700 1 -- 172.21.15.49:0/2798281755 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f9d1801da20 con 0x7f9d28071c60 2024-02-22T00:24:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.165+0000 7f9d257fa700 1 -- 172.21.15.49:0/2798281755 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9d18026b10 con 0x7f9d28071c60 2024-02-22T00:24:09.172 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.166+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d28046ce0 con 0x7f9d28071c60 2024-02-22T00:24:09.173 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.168+0000 7f9d257fa700 1 -- 172.21.15.49:0/2798281755 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f9d18021030 con 0x7f9d28071c60 2024-02-22T00:24:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.236+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9d28100510 con 0x7f9d28071c60 2024-02-22T00:24:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.239+0000 7f9d257fa700 1 -- 172.21.15.49:0/2798281755 <== mon.0 v2:172.21.15.49:3300/0 7 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f9d1802f880 con 0x7f9d28071c60 2024-02-22T00:24:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.239+0000 7f9d257fa700 1 -- 172.21.15.49:0/2798281755 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+454 (secure 0 0 0) 0x7f9d18019570 con 0x7f9d28071c60 2024-02-22T00:24:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: [global] 2024-02-22T00:24:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: fsid = 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-22T00:24:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-02-22T00:24:09.247 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: [mgr] 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: [osd] 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-22T00:24:09.248 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.240+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 msgr2=0x7f9d2810b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.240+0000 7f9d2e3e6700 1 --2- 172.21.15.49:0/2798281755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d2810b5c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f9d18000c00 tx=0x7f9d18017000).stop 2024-02-22T00:24:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.240+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 shutdown_connections 2024-02-22T00:24:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.240+0000 7f9d2e3e6700 1 --2- 172.21.15.49:0/2798281755 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d28071c60 0x7f9d2810b5c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.240+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 >> 172.21.15.49:0/2798281755 conn(0x7f9d280f76f0 msgr2=0x7f9d280f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.240+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 shutdown_connections 2024-02-22T00:24:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:09.240+0000 7f9d2e3e6700 1 -- 172.21.15.49:0/2798281755 wait complete. 2024-02-22T00:24:09.579 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: audit 2024-02-22T00:24:09.237406+0000 mon.smithi049 (mon.0) 8 : audit [INF] from='client.? 172.21.15.49:0/2798281755' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-22T00:24:09.579 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: audit 2024-02-22T00:24:09.240673+0000 mon.smithi049 (mon.0) 9 : audit [INF] from='client.? 172.21.15.49:0/2798281755' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-22T00:24:09.815 INFO:teuthology.orchestra.run.smithi049.stderr:Generating new minimal ceph.conf... 2024-02-22T00:24:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.333+0000 7fc60d6db700 1 Processor -- start 2024-02-22T00:24:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.333+0000 7fc60d6db700 1 -- start start 2024-02-22T00:24:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.333+0000 7fc60d6db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc6080ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.333+0000 7fc60d6db700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6081001e0 con 0x7fc608071be0 2024-02-22T00:24:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.333+0000 7fc606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc6080ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.333+0000 7fc606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc6080ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54658/0 (socket says 172.21.15.49:54658) 2024-02-22T00:24:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.333+0000 7fc606ffd700 1 -- 172.21.15.49:0/2711955333 learned_addr learned my addr 172.21.15.49:0/2711955333 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:10.344 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.334+0000 7fc606ffd700 1 -- 172.21.15.49:0/2711955333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608100320 con 0x7fc608071be0 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.334+0000 7fc606ffd700 1 --2- 172.21.15.49:0/2711955333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc6080ffcf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc5fc009730 tx=0x7fc5fc0090f0).ready entity=mon.0 client_cookie=2ea9b0a9527480a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.334+0000 7fc605ffb700 1 -- 172.21.15.49:0/2711955333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5fc00b6e0 con 0x7fc608071be0 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.334+0000 7fc605ffb700 1 -- 172.21.15.49:0/2711955333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fc5fc00bc90 con 0x7fc608071be0 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.334+0000 7fc605ffb700 1 -- 172.21.15.49:0/2711955333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5fc011c70 con 0x7fc608071be0 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 -- 172.21.15.49:0/2711955333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 msgr2=0x7fc6080ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 --2- 172.21.15.49:0/2711955333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc6080ffcf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc5fc009730 tx=0x7fc5fc0090f0).stop 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 -- 172.21.15.49:0/2711955333 shutdown_connections 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 --2- 172.21.15.49:0/2711955333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc6080ffcf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 -- 172.21.15.49:0/2711955333 >> 172.21.15.49:0/2711955333 conn(0x7fc6080f7750 msgr2=0x7fc6080f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 -- 172.21.15.49:0/2711955333 shutdown_connections 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 -- 172.21.15.49:0/2711955333 wait complete. 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 Processor -- start 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.335+0000 7fc60d6db700 1 -- start start 2024-02-22T00:24:10.345 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc60d6db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc60810bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc60d6db700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60810c290 con 0x7fc608071be0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc60810bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc60810bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54660/0 (socket says 172.21.15.49:54660) 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc606ffd700 1 -- 172.21.15.49:0/3942616336 learned_addr learned my addr 172.21.15.49:0/3942616336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc606ffd700 1 -- 172.21.15.49:0/3942616336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5fc009370 con 0x7fc608071be0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc606ffd700 1 --2- 172.21.15.49:0/3942616336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc60810bda0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc5fc0115c0 tx=0x7fc5fc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc5effff700 1 -- 172.21.15.49:0/3942616336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5fc011a90 con 0x7fc608071be0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc5effff700 1 -- 172.21.15.49:0/3942616336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fc5fc011bf0 con 0x7fc608071be0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc5effff700 1 -- 172.21.15.49:0/3942616336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5fc01ac30 con 0x7fc608071be0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60810c490 con 0x7fc608071be0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.336+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60810c8a0 con 0x7fc608071be0 2024-02-22T00:24:10.346 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.337+0000 7fc5effff700 1 -- 172.21.15.49:0/3942616336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fc5fc023660 con 0x7fc608071be0 2024-02-22T00:24:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.337+0000 7fc5effff700 1 -- 172.21.15.49:0/3942616336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc5fc0223b0 con 0x7fc608071be0 2024-02-22T00:24:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.338+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc608046ce0 con 0x7fc608071be0 2024-02-22T00:24:10.347 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.340+0000 7fc5effff700 1 -- 172.21.15.49:0/3942616336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fc5fc01e020 con 0x7fc608071be0 2024-02-22T00:24:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.407+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc608105c40 con 0x7fc608071be0 2024-02-22T00:24:10.412 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.408+0000 7fc5effff700 1 -- 172.21.15.49:0/3942616336 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fc5fc011e60 con 0x7fc608071be0 2024-02-22T00:24:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.408+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 msgr2=0x7fc60810bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.408+0000 7fc60d6db700 1 --2- 172.21.15.49:0/3942616336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc60810bda0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc5fc0115c0 tx=0x7fc5fc0090f0).stop 2024-02-22T00:24:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.408+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 shutdown_connections 2024-02-22T00:24:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.408+0000 7fc60d6db700 1 --2- 172.21.15.49:0/3942616336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc608071be0 0x7fc60810bda0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:10.415 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.408+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 >> 172.21.15.49:0/3942616336 conn(0x7fc6080f7750 msgr2=0x7fc6080f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:10.415 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.409+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 shutdown_connections 2024-02-22T00:24:10.415 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:10.409+0000 7fc60d6db700 1 -- 172.21.15.49:0/3942616336 wait complete. 2024-02-22T00:24:10.761 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: audit 2024-02-22T00:24:10.409126+0000 mon.smithi049 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.49:0/3942616336' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:24:11.014 INFO:teuthology.orchestra.run.smithi049.stderr:Restarting the monitor... 2024-02-22T00:24:11.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:11 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:24:11.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:11 smithi049 bash[67140]: Error: no container with name or ID "ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon.smithi049" found: no such container 2024-02-22T00:24:11.271 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: debug 2024-02-22T00:24:11.265+0000 7ff1ef2b3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-22T00:24:11.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[66816]: debug 2024-02-22T00:24:11.265+0000 7ff1ef2b3700 -1 mon.smithi049@0(leader) e1 *** Got Signal Terminated *** 2024-02-22T00:24:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:11 smithi049 bash[67179]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049 2024-02-22T00:24:12.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:12 smithi049 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi049.service: Succeeded. 2024-02-22T00:24:12.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:12 smithi049 systemd[1]: Stopped Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:24:12.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:12 smithi049 systemd[1]: Starting Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:24:14.270 INFO:teuthology.orchestra.run.smithi049.stderr:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.212+0000 7f5c32425880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.212+0000 7f5c32425880 0 ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable), process ceph-mon, pid 7 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.212+0000 7f5c32425880 0 pidfile_write: ignore empty --pid-file 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.217+0000 7f5c32425880 0 load: jerasure load: lrc load: isa 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: RocksDB version: 6.8.1 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Compile date Feb 20 2024 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: DB SUMMARY 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.471 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: CURRENT file: CURRENT 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi049/store.db dir, Total Num: 1, files: 000004.sst 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi049/store.db: 000006.log size: 100014 ; 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.error_if_exists: 0 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.create_if_missing: 0 2024-02-22T00:24:14.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.env: 0x5567c9734080 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.fs: Posix File System 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.info_log: 0x5567cb5aa560 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.statistics: (nil) 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.use_fsync: 0 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T00:24:14.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.db_log_dir: 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi049/store.db 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-22T00:24:14.474 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.write_buffer_manager: 0x5567cc21a450 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T00:24:14.475 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.unordered_write: 0 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.row_cache: None 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.wal_filter: None 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.two_write_queues: 0 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.atomic_flush: 0 2024-02-22T00:24:14.476 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.log_readahead_size: 0 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T00:24:14.477 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.max_open_files: -1 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Compression algorithms supported: 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: kZSTD supported: 0 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: kXpressCompression supported: 0 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: kZlibCompression supported: 1 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T00:24:14.478 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000005 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.merge_operator: 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.compaction_filter: None 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.218+0000 7f5c32425880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5567cb54fd10) 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cache_index_and_filter_blocks: 1 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T00:24:14.479 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: pin_top_level_index_and_filter: 1 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: index_type: 0 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: data_block_index_type: 0 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: index_shortening: 1 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: hash_index_allow_collision: 1 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: checksum: 1 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: no_block_cache: 0 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: block_cache: 0x5567cb584f10 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: block_cache_name: BinnedLRUCache 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: block_cache_options: 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: capacity : 536870912 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: num_shard_bits : 4 2024-02-22T00:24:14.480 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: strict_capacity_limit : 0 2024-02-22T00:24:14.481 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: high_pri_pool_ratio: 0.000 2024-02-22T00:24:14.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: block_cache_compressed: (nil) 2024-02-22T00:24:14.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: persistent_cache: (nil) 2024-02-22T00:24:14.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: block_size: 4096 2024-02-22T00:24:14.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: block_size_deviation: 10 2024-02-22T00:24:14.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: block_restart_interval: 16 2024-02-22T00:24:14.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: index_block_restart_interval: 1 2024-02-22T00:24:14.482 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: metadata_block_size: 4096 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: partition_filters: 0 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: use_delta_encoding: 1 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: whole_key_filtering: 1 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: verify_compression: 0 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: read_amp_bytes_per_bit: 0 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: format_version: 2 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: enable_index_compression: 1 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: block_align: 0 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compression: NoCompression 2024-02-22T00:24:14.483 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.num_levels: 7 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T00:24:14.484 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T00:24:14.485 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T00:24:14.486 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.table_properties_collectors: 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T00:24:14.487 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.bloom_locality: 0 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.ttl: 2592000 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708561454220043, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.219+0000 7f5c32425880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-02-22T00:24:14.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.220+0000 7f5c32425880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.221+0000 7f5c32425880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708561454221166, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 95393, "table_properties": {"data_size": 93488, "index_size": 382, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12918, "raw_average_key_size": 49, "raw_value_size": 86382, "raw_average_value_size": 332, "num_data_blocks": 12, "num_entries": 260, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708561454, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.221+0000 7f5c32425880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.221+0000 7f5c32425880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708561454221668, "job": 1, "event": "recovery_finished"} 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.222+0000 7f5c32425880 4 rocksdb: DB pointer 0x5567cb64d800 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.222+0000 7f5c19217700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.222+0000 7f5c19217700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ** DB Stats ** 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T00:24:14.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ** Compaction Stats [default] ** 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: L0 2/0 94.85 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.3 0.00 0.00 1 0.001 0 0 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Sum 2/0 94.85 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.3 0.00 0.00 1 0.001 0 0 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.3 0.00 0.00 1 0.001 0 0 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ** Compaction Stats [default] ** 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 125.3 0.00 0.00 1 0.001 0 0 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:24:14.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Cumulative compaction: 0.00 GB write, 25.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Interval compaction: 0.00 GB write, 25.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ** Compaction Stats [default] ** 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: L0 2/0 94.85 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.3 0.00 0.00 1 0.001 0 0 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Sum 2/0 94.85 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 125.3 0.00 0.00 1 0.001 0 0 2024-02-22T00:24:14.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ** Compaction Stats [default] ** 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 125.3 0.00 0.00 1 0.001 0 0 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Cumulative compaction: 0.00 GB write, 25.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:24:14.492 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.223+0000 7f5c32425880 0 starting mon.smithi049 rank 0 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi049 fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.224+0000 7f5c32425880 1 mon.smithi049@-1(???) e1 preinit fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.224+0000 7f5c32425880 0 mon.smithi049@-1(???).mds e1 new map 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.224+0000 7f5c32425880 0 mon.smithi049@-1(???).mds e1 print_map 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: e1 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: legacy client fscid: -1 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: No filesystems configured 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: 2024-02-22T00:24:14.493 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.224+0000 7f5c32425880 0 mon.smithi049@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.224+0000 7f5c32425880 0 mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.224+0000 7f5c32425880 0 mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.224+0000 7f5c32425880 0 mon.smithi049@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:10.409126+0000 mon.smithi049 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.49:0/3942616336' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:24:14.224+0000 7f5c32425880 1 mon.smithi049@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 bash[67309]: 74dfb5559ec59d36980fbe115b69227b66ff8daf851a4d3bedfdc880dc9e78bb 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 systemd[1]: Started Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:14.240768+0000 mon.smithi049 (mon.0) 1 : cluster [INF] mon.smithi049 is new leader, mons smithi049 in quorum (ranks 0) 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:14.240814+0000 mon.smithi049 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0]} removed_ranks: {} 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:14.241247+0000 mon.smithi049 (mon.0) 3 : cluster [DBG] fsmap 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:14.241281+0000 mon.smithi049 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-22T00:24:14.494 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:14.241658+0000 mon.smithi049 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-22T00:24:14.774 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.769+0000 7f1fd761a700 1 Processor -- start 2024-02-22T00:24:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.770+0000 7f1fd761a700 1 -- start start 2024-02-22T00:24:14.776 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.770+0000 7f1fd761a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd00ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.770+0000 7f1fd761a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd0100180 con 0x7f1fd0071c00 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.770+0000 7f1fd53b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd00ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.770+0000 7f1fd53b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd00ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40026/0 (socket says 172.21.15.49:40026) 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.770+0000 7f1fd53b6700 1 -- 172.21.15.49:0/1186169828 learned_addr learned my addr 172.21.15.49:0/1186169828 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.771+0000 7f1fd53b6700 1 -- 172.21.15.49:0/1186169828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd01002c0 con 0x7f1fd0071c00 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.771+0000 7f1fd53b6700 1 --2- 172.21.15.49:0/1186169828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd00ffc90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f1fcc009730 tx=0x7f1fcc0090f0).ready entity=mon.0 client_cookie=d3502d459c5b0fd5 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.771+0000 7f1fc7fff700 1 -- 172.21.15.49:0/1186169828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fcc00b6e0 con 0x7f1fd0071c00 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.771+0000 7f1fc7fff700 1 -- 172.21.15.49:0/1186169828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1fcc00bc90 con 0x7f1fd0071c00 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.771+0000 7f1fc7fff700 1 -- 172.21.15.49:0/1186169828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fcc011c70 con 0x7f1fd0071c00 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.771+0000 7f1fd761a700 1 -- 172.21.15.49:0/1186169828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 msgr2=0x7f1fd00ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.771+0000 7f1fd761a700 1 --2- 172.21.15.49:0/1186169828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd00ffc90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f1fcc009730 tx=0x7f1fcc0090f0).stop 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.772+0000 7f1fd761a700 1 -- 172.21.15.49:0/1186169828 shutdown_connections 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.772+0000 7f1fd761a700 1 --2- 172.21.15.49:0/1186169828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd00ffc90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.772+0000 7f1fd761a700 1 -- 172.21.15.49:0/1186169828 >> 172.21.15.49:0/1186169828 conn(0x7f1fd00f76f0 msgr2=0x7f1fd00f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:14.777 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.772+0000 7f1fd761a700 1 -- 172.21.15.49:0/1186169828 shutdown_connections 2024-02-22T00:24:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.772+0000 7f1fd761a700 1 -- 172.21.15.49:0/1186169828 wait complete. 2024-02-22T00:24:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.772+0000 7f1fd761a700 1 Processor -- start 2024-02-22T00:24:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.772+0000 7f1fd761a700 1 -- start start 2024-02-22T00:24:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.772+0000 7f1fd761a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd010be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fd761a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd010c340 con 0x7f1fd0071c00 2024-02-22T00:24:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fd53b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd010be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:14.778 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fd53b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd010be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40034/0 (socket says 172.21.15.49:40034) 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fd53b6700 1 -- 172.21.15.49:0/2235949937 learned_addr learned my addr 172.21.15.49:0/2235949937 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fd53b6700 1 -- 172.21.15.49:0/2235949937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc009370 con 0x7f1fd0071c00 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fd53b6700 1 --2- 172.21.15.49:0/2235949937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd010be50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f1fcc011870 tx=0x7f1fcc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fc67fc700 1 -- 172.21.15.49:0/2235949937 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fcc011400 con 0x7f1fd0071c00 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fc67fc700 1 -- 172.21.15.49:0/2235949937 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1fcc011a90 con 0x7f1fd0071c00 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd010c540 con 0x7f1fd0071c00 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fc67fc700 1 -- 172.21.15.49:0/2235949937 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1fcc01a9f0 con 0x7f1fd0071c00 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.773+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd010c950 con 0x7f1fd0071c00 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.774+0000 7f1fc67fc700 1 -- 172.21.15.49:0/2235949937 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1fcc023450 con 0x7f1fd0071c00 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.774+0000 7f1fc67fc700 1 -- 172.21.15.49:0/2235949937 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1fcc0223b0 con 0x7f1fd0071c00 2024-02-22T00:24:14.779 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.774+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd0046ce0 con 0x7f1fd0071c00 2024-02-22T00:24:14.780 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.777+0000 7f1fc67fc700 1 -- 172.21.15.49:0/2235949937 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f1fcc028060 con 0x7f1fd0071c00 2024-02-22T00:24:14.847 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.843+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f1fd0100f80 con 0x7f1fd0071c00 2024-02-22T00:24:14.849 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.845+0000 7f1fc67fc700 1 -- 172.21.15.49:0/2235949937 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1fd0100f80 con 0x7f1fd0071c00 2024-02-22T00:24:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.846+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 msgr2=0x7f1fd010be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.846+0000 7f1fd761a700 1 --2- 172.21.15.49:0/2235949937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd010be50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f1fcc011870 tx=0x7f1fcc0090f0).stop 2024-02-22T00:24:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.846+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 shutdown_connections 2024-02-22T00:24:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.846+0000 7f1fd761a700 1 --2- 172.21.15.49:0/2235949937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fd0071c00 0x7f1fd010be50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.846+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 >> 172.21.15.49:0/2235949937 conn(0x7f1fd00f76f0 msgr2=0x7f1fd00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.846+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 shutdown_connections 2024-02-22T00:24:14.851 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:14.846+0000 7f1fd761a700 1 -- 172.21.15.49:0/2235949937 wait complete. 2024-02-22T00:24:15.432 INFO:teuthology.orchestra.run.smithi049.stderr:Wrote config to /etc/ceph/ceph.conf 2024-02-22T00:24:15.432 INFO:teuthology.orchestra.run.smithi049.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-22T00:24:15.432 INFO:teuthology.orchestra.run.smithi049.stderr:Creating mgr... 2024-02-22T00:24:15.432 INFO:teuthology.orchestra.run.smithi049.stderr:Verifying port 9283 ... 2024-02-22T00:24:15.566 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Failed to reset failed state of unit ceph-9923b37e-d118-11ee-95bd-87774f69a715@mgr.smithi049.rjblpr.service: Unit ceph-9923b37e-d118-11ee-95bd-87774f69a715@mgr.smithi049.rjblpr.service not loaded. 2024-02-22T00:24:15.572 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: Created symlink /etc/systemd/system/ceph-9923b37e-d118-11ee-95bd-87774f69a715.target.wants/ceph-9923b37e-d118-11ee-95bd-87774f69a715@mgr.smithi049.rjblpr.service → /etc/systemd/system/ceph-9923b37e-d118-11ee-95bd-87774f69a715@.service. 2024-02-22T00:24:16.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:14.845947+0000 mon.smithi049 (mon.0) 6 : audit [INF] from='client.? 172.21.15.49:0/2235949937' entity='client.admin' 2024-02-22T00:24:16.296 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: disabled 2024-02-22T00:24:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: inactive 2024-02-22T00:24:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:firewalld.service is not enabled 2024-02-22T00:24:16.304 INFO:teuthology.orchestra.run.smithi049.stderr:Not possible to enable service . firewalld.service is not available 2024-02-22T00:24:16.312 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: disabled 2024-02-22T00:24:16.320 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: inactive 2024-02-22T00:24:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:firewalld.service is not enabled 2024-02-22T00:24:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-22T00:24:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:Waiting for mgr to start... 2024-02-22T00:24:16.321 INFO:teuthology.orchestra.run.smithi049.stderr:Waiting for mgr... 2024-02-22T00:24:16.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.819+0000 7f928137b700 1 Processor -- start 2024-02-22T00:24:16.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.820+0000 7f928137b700 1 -- start start 2024-02-22T00:24:16.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.820+0000 7f928137b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c1020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:16.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.820+0000 7f928137b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c0fdaa0 con 0x7f927c071be0 2024-02-22T00:24:16.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.820+0000 7f927affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c1020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:16.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.820+0000 7f927affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c1020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40054/0 (socket says 172.21.15.49:40054) 2024-02-22T00:24:16.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.820+0000 7f927affd700 1 -- 172.21.15.49:0/2382085526 learned_addr learned my addr 172.21.15.49:0/2382085526 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.820+0000 7f927affd700 1 -- 172.21.15.49:0/2382085526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c1025a0 con 0x7f927c071be0 2024-02-22T00:24:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f927affd700 1 --2- 172.21.15.49:0/2382085526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c1020b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f926c009730 tx=0x7f926c0090f0).ready entity=mon.0 client_cookie=726167d8684d8ba7 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f9279ffb700 1 -- 172.21.15.49:0/2382085526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f926c00b6e0 con 0x7f927c071be0 2024-02-22T00:24:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f9279ffb700 1 -- 172.21.15.49:0/2382085526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f926c00bc90 con 0x7f927c071be0 2024-02-22T00:24:16.830 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f9279ffb700 1 -- 172.21.15.49:0/2382085526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f926c011c70 con 0x7f927c071be0 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f928137b700 1 -- 172.21.15.49:0/2382085526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 msgr2=0x7f927c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f928137b700 1 --2- 172.21.15.49:0/2382085526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c1020b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f926c009730 tx=0x7f926c0090f0).stop 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f928137b700 1 -- 172.21.15.49:0/2382085526 shutdown_connections 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f928137b700 1 --2- 172.21.15.49:0/2382085526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c1020b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f928137b700 1 -- 172.21.15.49:0/2382085526 >> 172.21.15.49:0/2382085526 conn(0x7f927c0f76f0 msgr2=0x7f927c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f928137b700 1 -- 172.21.15.49:0/2382085526 shutdown_connections 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.821+0000 7f928137b700 1 -- 172.21.15.49:0/2382085526 wait complete. 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.822+0000 7f928137b700 1 Processor -- start 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.822+0000 7f928137b700 1 -- start start 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.822+0000 7f928137b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.822+0000 7f928137b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c10e4b0 con 0x7f927c071be0 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.822+0000 7f927affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f927affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c10dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40066/0 (socket says 172.21.15.49:40066) 2024-02-22T00:24:16.831 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f927affd700 1 -- 172.21.15.49:0/1698403356 learned_addr learned my addr 172.21.15.49:0/1698403356 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f927affd700 1 -- 172.21.15.49:0/1698403356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c009370 con 0x7f927c071be0 2024-02-22T00:24:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f927affd700 1 --2- 172.21.15.49:0/1698403356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c10dfc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f926c000c00 tx=0x7f926c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f9263fff700 1 -- 172.21.15.49:0/1698403356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f926c01a610 con 0x7f927c071be0 2024-02-22T00:24:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c10e6b0 con 0x7f927c071be0 2024-02-22T00:24:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f9263fff700 1 -- 172.21.15.49:0/1698403356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f926c01abc0 con 0x7f927c071be0 2024-02-22T00:24:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f9263fff700 1 -- 172.21.15.49:0/1698403356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f926c022a20 con 0x7f927c071be0 2024-02-22T00:24:16.832 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c10eac0 con 0x7f927c071be0 2024-02-22T00:24:16.833 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f9263fff700 1 -- 172.21.15.49:0/1698403356 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f926c023450 con 0x7f927c071be0 2024-02-22T00:24:16.833 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.823+0000 7f9263fff700 1 -- 172.21.15.49:0/1698403356 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f926c019390 con 0x7f927c071be0 2024-02-22T00:24:16.833 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.824+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c046ce0 con 0x7f927c071be0 2024-02-22T00:24:16.833 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.827+0000 7f9263fff700 1 -- 172.21.15.49:0/1698403356 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f926c028060 con 0x7f927c071be0 2024-02-22T00:24:16.903 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.897+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f927c1032f0 con 0x7f927c071be0 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.897+0000 7f9263fff700 1 -- 172.21.15.49:0/1698403356 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f926c01e070 con 0x7f927c071be0 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: { 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "fsid": "9923b37e-d118-11ee-95bd-87774f69a715", 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "health": { 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "checks": {}, 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "mutes": [] 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-22T00:24:16.904 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum": [ 2024-02-22T00:24:16.905 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 0 2024-02-22T00:24:16.905 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:16.905 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-22T00:24:16.905 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "smithi049" 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "monmap": { 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osdmap": { 2024-02-22T00:24:16.911 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "pgmap": { 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-22T00:24:16.912 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "fsmap": { 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "available": false, 2024-02-22T00:24:16.913 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "modules": [ 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "iostat", 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "nfs", 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "restful" 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "services": {} 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "servicemap": { 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "modified": "2024-02-22T00:24:07.498784+0000", 2024-02-22T00:24:16.914 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "services": {} 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: } 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.898+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 msgr2=0x7f927c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.898+0000 7f928137b700 1 --2- 172.21.15.49:0/1698403356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c10dfc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f926c000c00 tx=0x7f926c0090f0).stop 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.898+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 shutdown_connections 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.898+0000 7f928137b700 1 --2- 172.21.15.49:0/1698403356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f927c071be0 0x7f927c10dfc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.898+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 >> 172.21.15.49:0/1698403356 conn(0x7f927c0f76f0 msgr2=0x7f927c0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.898+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 shutdown_connections 2024-02-22T00:24:16.915 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:16.898+0000 7f928137b700 1 -- 172.21.15.49:0/1698403356 wait complete. 2024-02-22T00:24:17.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:16.898537+0000 mon.smithi049 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.49:0/1698403356' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T00:24:17.560 INFO:teuthology.orchestra.run.smithi049.stderr:mgr not available, waiting (1/15)... 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.232+0000 7f3c9ba98700 1 Processor -- start 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.232+0000 7f3c9ba98700 1 -- start start 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.232+0000 7f3c9ba98700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.232+0000 7f3c9ba98700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c94100120 con 0x7f3c94071c60 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.232+0000 7f3c99834700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.233+0000 7f3c99834700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40078/0 (socket says 172.21.15.49:40078) 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.233+0000 7f3c99834700 1 -- 172.21.15.49:0/4001246336 learned_addr learned my addr 172.21.15.49:0/4001246336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.233+0000 7f3c99834700 1 -- 172.21.15.49:0/4001246336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94100260 con 0x7f3c94071c60 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.233+0000 7f3c99834700 1 --2- 172.21.15.49:0/4001246336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940ffc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3c90009730 tx=0x7f3c900090f0).ready entity=mon.0 client_cookie=4bb78507cc209eee server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:20.241 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.233+0000 7f3c98832700 1 -- 172.21.15.49:0/4001246336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c9000b6e0 con 0x7f3c94071c60 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.233+0000 7f3c98832700 1 -- 172.21.15.49:0/4001246336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3c9000bc90 con 0x7f3c94071c60 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.233+0000 7f3c98832700 1 -- 172.21.15.49:0/4001246336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c90011c70 con 0x7f3c94071c60 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.234+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4001246336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 msgr2=0x7f3c940ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.234+0000 7f3c9ba98700 1 --2- 172.21.15.49:0/4001246336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940ffc30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3c90009730 tx=0x7f3c900090f0).stop 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.234+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4001246336 shutdown_connections 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.234+0000 7f3c9ba98700 1 --2- 172.21.15.49:0/4001246336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940ffc30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.234+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4001246336 >> 172.21.15.49:0/4001246336 conn(0x7f3c940f76f0 msgr2=0x7f3c940f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.234+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4001246336 shutdown_connections 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.234+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4001246336 wait complete. 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c9ba98700 1 Processor -- start 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c9ba98700 1 -- start start 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c9ba98700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c9ba98700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940fbb30 con 0x7f3c94071c60 2024-02-22T00:24:20.242 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c99834700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c99834700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940fd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40082/0 (socket says 172.21.15.49:40082) 2024-02-22T00:24:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c99834700 1 -- 172.21.15.49:0/4021281013 learned_addr learned my addr 172.21.15.49:0/4021281013 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c99834700 1 -- 172.21.15.49:0/4021281013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c90009370 con 0x7f3c94071c60 2024-02-22T00:24:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.235+0000 7f3c99834700 1 --2- 172.21.15.49:0/4021281013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940fd6b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3c90000c00 tx=0x7f3c900090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.236+0000 7f3c8af78700 1 -- 172.21.15.49:0/4021281013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c9001a610 con 0x7f3c94071c60 2024-02-22T00:24:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.236+0000 7f3c8af78700 1 -- 172.21.15.49:0/4021281013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3c9001abc0 con 0x7f3c94071c60 2024-02-22T00:24:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.236+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c940fbcd0 con 0x7f3c94071c60 2024-02-22T00:24:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.236+0000 7f3c8af78700 1 -- 172.21.15.49:0/4021281013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c90022a20 con 0x7f3c94071c60 2024-02-22T00:24:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.236+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c940fc0e0 con 0x7f3c94071c60 2024-02-22T00:24:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.236+0000 7f3c8af78700 1 -- 172.21.15.49:0/4021281013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3c90023450 con 0x7f3c94071c60 2024-02-22T00:24:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.236+0000 7f3c8af78700 1 -- 172.21.15.49:0/4021281013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3c90019390 con 0x7f3c94071c60 2024-02-22T00:24:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.237+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c94046ce0 con 0x7f3c94071c60 2024-02-22T00:24:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.239+0000 7f3c8af78700 1 -- 172.21.15.49:0/4021281013 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f3c90028060 con 0x7f3c94071c60 2024-02-22T00:24:20.325 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.310+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3c94100f20 con 0x7f3c94071c60 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.310+0000 7f3c8af78700 1 -- 172.21.15.49:0/4021281013 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f3c9001e070 con 0x7f3c94071c60 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: { 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "fsid": "9923b37e-d118-11ee-95bd-87774f69a715", 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "health": { 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "checks": {}, 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "mutes": [] 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum": [ 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 0 2024-02-22T00:24:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "smithi049" 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum_age": 6, 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "monmap": { 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osdmap": { 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-22T00:24:20.327 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "pgmap": { 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-22T00:24:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "fsmap": { 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "available": false, 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "modules": [ 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "iostat", 2024-02-22T00:24:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "nfs", 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "restful" 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "services": {} 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "servicemap": { 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "modified": "2024-02-22T00:24:07.498784+0000", 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "services": {} 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: } 2024-02-22T00:24:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.311+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 msgr2=0x7f3c940fd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.311+0000 7f3c9ba98700 1 --2- 172.21.15.49:0/4021281013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940fd6b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3c90000c00 tx=0x7f3c900090f0).stop 2024-02-22T00:24:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.311+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 shutdown_connections 2024-02-22T00:24:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.311+0000 7f3c9ba98700 1 --2- 172.21.15.49:0/4021281013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c94071c60 0x7f3c940fd6b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.311+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 >> 172.21.15.49:0/4021281013 conn(0x7f3c940f76f0 msgr2=0x7f3c940f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.311+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 shutdown_connections 2024-02-22T00:24:20.331 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:20.311+0000 7f3c9ba98700 1 -- 172.21.15.49:0/4021281013 wait complete. 2024-02-22T00:24:20.628 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:20.311753+0000 mon.smithi049 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.49:0/4021281013' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T00:24:20.974 INFO:teuthology.orchestra.run.smithi049.stderr:mgr not available, waiting (2/15)... 2024-02-22T00:24:22.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:21.749042+0000 mon.smithi049 (mon.0) 9 : cluster [INF] Activating manager daemon smithi049.rjblpr 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:21.751795+0000 mon.smithi049 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi049.rjblpr(active, starting, since 0.00284736s) 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.752873+0000 mon.smithi049 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.753105+0000 mon.smithi049 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.753310+0000 mon.smithi049 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.753492+0000 mon.smithi049 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.753702+0000 mon.smithi049 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:21.767495+0000 mon.smithi049 (mon.0) 16 : cluster [INF] Manager daemon smithi049.rjblpr is now available 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.776060+0000 mon.smithi049 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.782416+0000 mon.smithi049 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.785620+0000 mon.smithi049 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.787900+0000 mon.smithi049 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:22.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:21.790155+0000 mon.smithi049 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.49:0/3649566777' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.551+0000 7fad9e710700 1 Processor -- start 2024-02-22T00:24:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.552+0000 7fad9e710700 1 -- start start 2024-02-22T00:24:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.552+0000 7fad9e710700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad980ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.552+0000 7fad9e710700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad981001a0 con 0x7fad98071be0 2024-02-22T00:24:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.552+0000 7fad97fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad980ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.552+0000 7fad97fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad980ffcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48244/0 (socket says 172.21.15.49:48244) 2024-02-22T00:24:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.552+0000 7fad97fff700 1 -- 172.21.15.49:0/1859588722 learned_addr learned my addr 172.21.15.49:0/1859588722 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.552+0000 7fad97fff700 1 -- 172.21.15.49:0/1859588722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad981002e0 con 0x7fad98071be0 2024-02-22T00:24:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.552+0000 7fad97fff700 1 --2- 172.21.15.49:0/1859588722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad980ffcb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fad88009730 tx=0x7fad880090f0).ready entity=mon.0 client_cookie=f9218a3fad74882f server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad96ffd700 1 -- 172.21.15.49:0/1859588722 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad8800b6e0 con 0x7fad98071be0 2024-02-22T00:24:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad96ffd700 1 -- 172.21.15.49:0/1859588722 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fad8800bc90 con 0x7fad98071be0 2024-02-22T00:24:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad96ffd700 1 -- 172.21.15.49:0/1859588722 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad88011c70 con 0x7fad98071be0 2024-02-22T00:24:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad9e710700 1 -- 172.21.15.49:0/1859588722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 msgr2=0x7fad980ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad9e710700 1 --2- 172.21.15.49:0/1859588722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad980ffcb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fad88009730 tx=0x7fad880090f0).stop 2024-02-22T00:24:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad9e710700 1 -- 172.21.15.49:0/1859588722 shutdown_connections 2024-02-22T00:24:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad9e710700 1 --2- 172.21.15.49:0/1859588722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad980ffcb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad9e710700 1 -- 172.21.15.49:0/1859588722 >> 172.21.15.49:0/1859588722 conn(0x7fad980f76f0 msgr2=0x7fad980f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad9e710700 1 -- 172.21.15.49:0/1859588722 shutdown_connections 2024-02-22T00:24:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.553+0000 7fad9e710700 1 -- 172.21.15.49:0/1859588722 wait complete. 2024-02-22T00:24:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.554+0000 7fad9e710700 1 Processor -- start 2024-02-22T00:24:23.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.554+0000 7fad9e710700 1 -- start start 2024-02-22T00:24:23.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad9e710700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad9810be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:23.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad9e710700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9810c310 con 0x7fad98071be0 2024-02-22T00:24:23.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad97fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad9810be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:23.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad97fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad9810be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48254/0 (socket says 172.21.15.49:48254) 2024-02-22T00:24:23.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad97fff700 1 -- 172.21.15.49:0/365596442 learned_addr learned my addr 172.21.15.49:0/365596442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:23.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad97fff700 1 -- 172.21.15.49:0/365596442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88009370 con 0x7fad98071be0 2024-02-22T00:24:23.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad97fff700 1 --2- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad9810be20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fad8800c010 tx=0x7fad880090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:23.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad957fa700 1 -- 172.21.15.49:0/365596442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad8801a610 con 0x7fad98071be0 2024-02-22T00:24:23.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad957fa700 1 -- 172.21.15.49:0/365596442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fad8801abc0 con 0x7fad98071be0 2024-02-22T00:24:23.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad957fa700 1 -- 172.21.15.49:0/365596442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fad88022a20 con 0x7fad98071be0 2024-02-22T00:24:23.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9810c510 con 0x7fad98071be0 2024-02-22T00:24:23.570 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.555+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9810c920 con 0x7fad98071be0 2024-02-22T00:24:23.570 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.556+0000 7fad957fa700 1 -- 172.21.15.49:0/365596442 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 3) v1 ==== 38515+0+0 (secure 0 0 0) 0x7fad88022c90 con 0x7fad98071be0 2024-02-22T00:24:23.570 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.556+0000 7fad957fa700 1 --2- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fad800324e0 0x7fad800349a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:23.570 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.556+0000 7fad957fa700 1 -- 172.21.15.49:0/365596442 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fad88044590 con 0x7fad98071be0 2024-02-22T00:24:23.570 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.556+0000 7fad977fe700 1 --2- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fad800324e0 0x7fad800349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:23.570 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.557+0000 7fad977fe700 1 --2- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fad800324e0 0x7fad800349a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fad8c009780 tx=0x7fad8c006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:23.570 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.557+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad98046ce0 con 0x7fad98071be0 2024-02-22T00:24:23.571 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.562+0000 7fad957fa700 1 -- 172.21.15.49:0/365596442 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fad88018d60 con 0x7fad98071be0 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.801+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fad98105b60 con 0x7fad98071be0 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.801+0000 7fad957fa700 1 -- 172.21.15.49:0/365596442 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fad88018320 con 0x7fad98071be0 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: { 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "fsid": "9923b37e-d118-11ee-95bd-87774f69a715", 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "health": { 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "checks": {}, 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "mutes": [] 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-02-22T00:24:23.809 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum": [ 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 0 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum_names": [ 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "smithi049" 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "quorum_age": 9, 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "monmap": { 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_mons": 1 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osdmap": { 2024-02-22T00:24:23.810 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:23.811 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_osds": 0, 2024-02-22T00:24:23.811 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-02-22T00:24:23.811 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-02-22T00:24:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-02-22T00:24:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-02-22T00:24:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-02-22T00:24:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "pgmap": { 2024-02-22T00:24:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-02-22T00:24:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-02-22T00:24:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_pools": 0, 2024-02-22T00:24:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_objects": 0, 2024-02-22T00:24:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-02-22T00:24:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-02-22T00:24:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-02-22T00:24:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "bytes_total": 0 2024-02-22T00:24:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "fsmap": { 2024-02-22T00:24:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "by_rank": [], 2024-02-22T00:24:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "up:standby": 0 2024-02-22T00:24:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "mgrmap": { 2024-02-22T00:24:23.822 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "available": true, 2024-02-22T00:24:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-02-22T00:24:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "modules": [ 2024-02-22T00:24:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "iostat", 2024-02-22T00:24:23.823 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "nfs", 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "restful" 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ], 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "services": {} 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "servicemap": { 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 1, 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "modified": "2024-02-22T00:24:07.498784+0000", 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "services": {} 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: }, 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "progress_events": {} 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: } 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fad800324e0 msgr2=0x7fad800349a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 --2- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fad800324e0 0x7fad800349a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fad8c009780 tx=0x7fad8c006cc0).stop 2024-02-22T00:24:23.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 msgr2=0x7fad9810be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:23.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 --2- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad9810be20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fad8800c010 tx=0x7fad880090f0).stop 2024-02-22T00:24:23.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 shutdown_connections 2024-02-22T00:24:23.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 --2- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fad800324e0 0x7fad800349a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:23.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 --2- 172.21.15.49:0/365596442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad98071be0 0x7fad9810be20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:23.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 >> 172.21.15.49:0/365596442 conn(0x7fad980f76f0 msgr2=0x7fad980f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:23.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 shutdown_connections 2024-02-22T00:24:23.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:23.805+0000 7fad9e710700 1 -- 172.21.15.49:0/365596442 wait complete. 2024-02-22T00:24:24.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:22.755073+0000 mon.smithi049 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi049.rjblpr(active, since 1.00612s) 2024-02-22T00:24:25.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:23.802771+0000 mon.smithi049 (mon.0) 23 : audit [DBG] from='client.? 172.21.15.49:0/365596442' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T00:24:25.506 INFO:teuthology.orchestra.run.smithi049.stderr:mgr is available 2024-02-22T00:24:26.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:24.756782+0000 mon.smithi049 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi049.rjblpr(active, since 3s) 2024-02-22T00:24:28.681 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:28.282431+0000 mon.smithi049 (mon.0) 25 : audit [INF] from='client.? 172.21.15.49:0/1223979891' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-22T00:24:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.102+0000 7f23fff47700 1 Processor -- start 2024-02-22T00:24:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.102+0000 7f23fff47700 1 -- start start 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.102+0000 7f23fff47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.102+0000 7f23fff47700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80fc7e0 con 0x7f23f80fbed0 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.102+0000 7f23fdce3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.102+0000 7f23fdce3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48260/0 (socket says 172.21.15.49:48260) 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.102+0000 7f23fdce3700 1 -- 172.21.15.49:0/469479904 learned_addr learned my addr 172.21.15.49:0/469479904 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.103+0000 7f23fdce3700 1 -- 172.21.15.49:0/469479904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80fc920 con 0x7f23f80fbed0 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.103+0000 7f23fdce3700 1 --2- 172.21.15.49:0/469479904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f80fc2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f23f4009730 tx=0x7f23f40090f0).ready entity=mon.0 client_cookie=2c670f7a92b6d9c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.103+0000 7f23fcce1700 1 -- 172.21.15.49:0/469479904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23f400b6e0 con 0x7f23f80fbed0 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.103+0000 7f23fcce1700 1 -- 172.21.15.49:0/469479904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f23f400bc90 con 0x7f23f80fbed0 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.103+0000 7f23fcce1700 1 -- 172.21.15.49:0/469479904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23f4011c70 con 0x7f23f80fbed0 2024-02-22T00:24:29.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.103+0000 7f23fff47700 1 -- 172.21.15.49:0/469479904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 msgr2=0x7f23f80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.103+0000 7f23fff47700 1 --2- 172.21.15.49:0/469479904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f80fc2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f23f4009730 tx=0x7f23f40090f0).stop 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 -- 172.21.15.49:0/469479904 shutdown_connections 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 --2- 172.21.15.49:0/469479904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f80fc2f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 -- 172.21.15.49:0/469479904 >> 172.21.15.49:0/469479904 conn(0x7f23f80f76f0 msgr2=0x7f23f80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 -- 172.21.15.49:0/469479904 shutdown_connections 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 -- 172.21.15.49:0/469479904 wait complete. 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 Processor -- start 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 -- start start 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f8109ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fff47700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f810a090 con 0x7f23f80fbed0 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fdce3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f8109ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fdce3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f8109ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48262/0 (socket says 172.21.15.49:48262) 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.104+0000 7f23fdce3700 1 -- 172.21.15.49:0/1223979891 learned_addr learned my addr 172.21.15.49:0/1223979891 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.105+0000 7f23fdce3700 1 -- 172.21.15.49:0/1223979891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f4009370 con 0x7f23f80fbed0 2024-02-22T00:24:29.085 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.105+0000 7f23fdce3700 1 --2- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f8109ba0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f23f4011870 tx=0x7f23f40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.105+0000 7f23eeffd700 1 -- 172.21.15.49:0/1223979891 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23f401a610 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.105+0000 7f23eeffd700 1 -- 172.21.15.49:0/1223979891 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f23f401abc0 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.105+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f810a290 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.105+0000 7f23eeffd700 1 -- 172.21.15.49:0/1223979891 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23f4022a30 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.105+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f810a6a0 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.106+0000 7f23eeffd700 1 -- 172.21.15.49:0/1223979891 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7f23f4022ca0 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.106+0000 7f23eeffd700 1 --2- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f23e4034860 0x7f23e4036d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.106+0000 7f23eeffd700 1 -- 172.21.15.49:0/1223979891 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f23f4044750 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.106+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f8046ce0 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.106+0000 7f23fd4e2700 1 --2- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f23e4034860 0x7f23e4036d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.106+0000 7f23fd4e2700 1 --2- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f23e4034860 0x7f23e4036d20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f23e8009780 tx=0x7f23e8006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.111+0000 7f23eeffd700 1 -- 172.21.15.49:0/1223979891 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f23f401e020 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.281+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f23f80fdc20 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.282+0000 7f23eeffd700 1 -- 172.21.15.49:0/1223979891 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+398 (secure 0 0 0) 0x7f23f4018ba0 con 0x7f23f80fbed0 2024-02-22T00:24:29.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f23e4034860 msgr2=0x7f23e4036d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 --2- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f23e4034860 0x7f23e4036d20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f23e8009780 tx=0x7f23e8006cc0).stop 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 msgr2=0x7f23f8109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 --2- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f8109ba0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f23f4011870 tx=0x7f23f40090f0).stop 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 shutdown_connections 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 --2- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f23e4034860 0x7f23e4036d20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 --2- 172.21.15.49:0/1223979891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f23f80fbed0 0x7f23f8109ba0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 >> 172.21.15.49:0/1223979891 conn(0x7f23f80f76f0 msgr2=0x7f23f8100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 shutdown_connections 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:28.283+0000 7f23fff47700 1 -- 172.21.15.49:0/1223979891 wait complete. 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: [global] 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: fsid = 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: log_to_journald = false 2024-02-22T00:24:29.087 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: [mgr] 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: [osd] 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-02-22T00:24:29.088 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-02-22T00:24:33.690 INFO:teuthology.orchestra.run.smithi049.stderr:Enabling cephadm module... 2024-02-22T00:24:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.244+0000 7f3ea7295700 1 Processor -- start 2024-02-22T00:24:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.244+0000 7f3ea7295700 1 -- start start 2024-02-22T00:24:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.244+0000 7f3ea7295700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea00fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.244+0000 7f3ea7295700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00fc7e0 con 0x7f3ea00fbed0 2024-02-22T00:24:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.245+0000 7f3ea5031700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea00fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.245+0000 7f3ea5031700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea00fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57562/0 (socket says 172.21.15.49:57562) 2024-02-22T00:24:34.251 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.245+0000 7f3ea5031700 1 -- 172.21.15.49:0/1886079413 learned_addr learned my addr 172.21.15.49:0/1886079413 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.245+0000 7f3ea5031700 1 -- 172.21.15.49:0/1886079413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00fc920 con 0x7f3ea00fbed0 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.245+0000 7f3ea5031700 1 --2- 172.21.15.49:0/1886079413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea00fc2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f3e90009730 tx=0x7f3e900090f0).ready entity=mon.0 client_cookie=bc256aaf086b31c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.245+0000 7f3e97fff700 1 -- 172.21.15.49:0/1886079413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e9000b6e0 con 0x7f3ea00fbed0 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.245+0000 7f3e97fff700 1 -- 172.21.15.49:0/1886079413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3e9000bc90 con 0x7f3ea00fbed0 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.245+0000 7f3e97fff700 1 -- 172.21.15.49:0/1886079413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e90011c70 con 0x7f3ea00fbed0 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.246+0000 7f3ea7295700 1 -- 172.21.15.49:0/1886079413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 msgr2=0x7f3ea00fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.246+0000 7f3ea7295700 1 --2- 172.21.15.49:0/1886079413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea00fc2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f3e90009730 tx=0x7f3e900090f0).stop 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.246+0000 7f3ea7295700 1 -- 172.21.15.49:0/1886079413 shutdown_connections 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.246+0000 7f3ea7295700 1 --2- 172.21.15.49:0/1886079413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea00fc2f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.246+0000 7f3ea7295700 1 -- 172.21.15.49:0/1886079413 >> 172.21.15.49:0/1886079413 conn(0x7f3ea00f76f0 msgr2=0x7f3ea00f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.246+0000 7f3ea7295700 1 -- 172.21.15.49:0/1886079413 shutdown_connections 2024-02-22T00:24:34.252 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.246+0000 7f3ea7295700 1 -- 172.21.15.49:0/1886079413 wait complete. 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea7295700 1 Processor -- start 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea7295700 1 -- start start 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea7295700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea010be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea7295700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea010c2f0 con 0x7f3ea00fbed0 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea5031700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea010be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea5031700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea010be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57570/0 (socket says 172.21.15.49:57570) 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea5031700 1 -- 172.21.15.49:0/73172290 learned_addr learned my addr 172.21.15.49:0/73172290 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea5031700 1 -- 172.21.15.49:0/73172290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009370 con 0x7f3ea00fbed0 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.247+0000 7f3ea5031700 1 --2- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea010be00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3e90011870 tx=0x7f3e900090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.248+0000 7f3e96777700 1 -- 172.21.15.49:0/73172290 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e9001a610 con 0x7f3ea00fbed0 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.248+0000 7f3e96777700 1 -- 172.21.15.49:0/73172290 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3e9001abc0 con 0x7f3ea00fbed0 2024-02-22T00:24:34.255 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.248+0000 7f3e96777700 1 -- 172.21.15.49:0/73172290 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e90022a30 con 0x7f3ea00fbed0 2024-02-22T00:24:34.256 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.248+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea010c4f0 con 0x7f3ea00fbed0 2024-02-22T00:24:34.256 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.248+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea010c900 con 0x7f3ea00fbed0 2024-02-22T00:24:34.256 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.249+0000 7f3e96777700 1 -- 172.21.15.49:0/73172290 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7f3e90022ca0 con 0x7f3ea00fbed0 2024-02-22T00:24:34.256 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.249+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea0046ce0 con 0x7f3ea00fbed0 2024-02-22T00:24:34.256 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.249+0000 7f3e96777700 1 --2- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f3e8c032610 0x7f3e8c034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:34.256 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.249+0000 7f3e96777700 1 -- 172.21.15.49:0/73172290 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3e90044770 con 0x7f3ea00fbed0 2024-02-22T00:24:34.256 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.249+0000 7f3ea4830700 1 --2- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f3e8c032610 0x7f3e8c034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:34.256 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.249+0000 7f3ea4830700 1 --2- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f3e8c032610 0x7f3e8c034ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3e9c009780 tx=0x7f3e9c006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:34.258 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.253+0000 7f3e96777700 1 -- 172.21.15.49:0/73172290 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3e900223b0 con 0x7f3ea00fbed0 2024-02-22T00:24:34.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.466+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f3ea00fdc20 con 0x7f3ea00fbed0 2024-02-22T00:24:34.524 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.519+0000 7f3e96777700 1 -- 172.21.15.49:0/73172290 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f3e9002b350 con 0x7f3ea00fbed0 2024-02-22T00:24:34.524 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.520+0000 7f3e96777700 1 -- 172.21.15.49:0/73172290 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f3e90021580 con 0x7f3ea00fbed0 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f3e8c032610 msgr2=0x7f3e8c034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 --2- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f3e8c032610 0x7f3e8c034ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3e9c009780 tx=0x7f3e9c006cc0).stop 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 msgr2=0x7f3ea010be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 --2- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea010be00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3e90011870 tx=0x7f3e900090f0).stop 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 shutdown_connections 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 --2- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7f3e8c032610 0x7f3e8c034ad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 --2- 172.21.15.49:0/73172290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea00fbed0 0x7f3ea010be00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 >> 172.21.15.49:0/73172290 conn(0x7f3ea00f76f0 msgr2=0x7f3ea0071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 shutdown_connections 2024-02-22T00:24:34.528 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:34.522+0000 7f3ea7295700 1 -- 172.21.15.49:0/73172290 wait complete. 2024-02-22T00:24:34.834 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:34.468271+0000 mon.smithi049 (mon.0) 26 : audit [INF] from='client.? 172.21.15.49:0/73172290' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.577+0000 7fbe90037700 1 Processor -- start 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.578+0000 7fbe90037700 1 -- start start 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.578+0000 7fbe90037700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe88102090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.578+0000 7fbe90037700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880fda80 con 0x7fbe88071c00 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.578+0000 7fbe8ddd3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe88102090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.578+0000 7fbe8ddd3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe88102090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57590/0 (socket says 172.21.15.49:57590) 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.578+0000 7fbe8ddd3700 1 -- 172.21.15.49:0/3718354888 learned_addr learned my addr 172.21.15.49:0/3718354888 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.578+0000 7fbe8ddd3700 1 -- 172.21.15.49:0/3718354888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88102580 con 0x7fbe88071c00 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.578+0000 7fbe8ddd3700 1 --2- 172.21.15.49:0/3718354888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe88102090 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fbe84009730 tx=0x7fbe840090f0).ready entity=mon.0 client_cookie=684fb3c47009378b server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:35.584 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe8cdd1700 1 -- 172.21.15.49:0/3718354888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe8400b6e0 con 0x7fbe88071c00 2024-02-22T00:24:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe8cdd1700 1 -- 172.21.15.49:0/3718354888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbe8400bc90 con 0x7fbe88071c00 2024-02-22T00:24:35.585 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe8cdd1700 1 -- 172.21.15.49:0/3718354888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe84011c70 con 0x7fbe88071c00 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe90037700 1 -- 172.21.15.49:0/3718354888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 msgr2=0x7fbe88102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe90037700 1 --2- 172.21.15.49:0/3718354888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe88102090 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fbe84009730 tx=0x7fbe840090f0).stop 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe90037700 1 -- 172.21.15.49:0/3718354888 shutdown_connections 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe90037700 1 --2- 172.21.15.49:0/3718354888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe88102090 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe90037700 1 -- 172.21.15.49:0/3718354888 >> 172.21.15.49:0/3718354888 conn(0x7fbe880f76f0 msgr2=0x7fbe880f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe90037700 1 -- 172.21.15.49:0/3718354888 shutdown_connections 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.579+0000 7fbe90037700 1 -- 172.21.15.49:0/3718354888 wait complete. 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.580+0000 7fbe90037700 1 Processor -- start 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.580+0000 7fbe90037700 1 -- start start 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe90037700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe8810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe90037700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8810e4d0 con 0x7fbe88071c00 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe8ddd3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe8810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe8ddd3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe8810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57606/0 (socket says 172.21.15.49:57606) 2024-02-22T00:24:35.586 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe8ddd3700 1 -- 172.21.15.49:0/2491715409 learned_addr learned my addr 172.21.15.49:0/2491715409 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe8ddd3700 1 -- 172.21.15.49:0/2491715409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe84009370 con 0x7fbe88071c00 2024-02-22T00:24:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe8ddd3700 1 --2- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe8810dfe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbe84009330 tx=0x7fbe840090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe7effd700 1 -- 172.21.15.49:0/2491715409 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe8401a610 con 0x7fbe88071c00 2024-02-22T00:24:35.588 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe7effd700 1 -- 172.21.15.49:0/2491715409 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbe8401abc0 con 0x7fbe88071c00 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8810e6d0 con 0x7fbe88071c00 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.581+0000 7fbe7effd700 1 -- 172.21.15.49:0/2491715409 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbe84022a30 con 0x7fbe88071c00 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.582+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8810eae0 con 0x7fbe88071c00 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.583+0000 7fbe7effd700 1 -- 172.21.15.49:0/2491715409 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fbe84022cb0 con 0x7fbe88071c00 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.583+0000 7fbe7effd700 1 --2- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fbe740325e0 0x7fbe74034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.583+0000 7fbe7effd700 1 -- 172.21.15.49:0/2491715409 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbe84043fa0 con 0x7fbe88071c00 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.583+0000 7fbe8d5d2700 1 -- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fbe740325e0 msgr2=0x7fbe74034aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/48931101 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.583+0000 7fbe8d5d2700 1 --2- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fbe740325e0 0x7fbe74034aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-22T00:24:35.589 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.583+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe88046ce0 con 0x7fbe88071c00 2024-02-22T00:24:35.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.588+0000 7fbe7effd700 1 -- 172.21.15.49:0/2491715409 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbe8401e070 con 0x7fbe88071c00 2024-02-22T00:24:35.789 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.784+0000 7fbe8d5d2700 1 -- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fbe740325e0 msgr2=0x7fbe74034aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/48931101 2024-02-22T00:24:35.789 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.784+0000 7fbe8d5d2700 1 --2- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fbe740325e0 0x7fbe74034aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-22T00:24:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.806+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fbe88107e30 con 0x7fbe88071c00 2024-02-22T00:24:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.807+0000 7fbe7effd700 1 -- 172.21.15.49:0/2491715409 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fbe8401ad30 con 0x7fbe88071c00 2024-02-22T00:24:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: { 2024-02-22T00:24:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 5, 2024-02-22T00:24:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "available": true, 2024-02-22T00:24:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "active_name": "smithi049.rjblpr", 2024-02-22T00:24:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-22T00:24:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: } 2024-02-22T00:24:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fbe740325e0 msgr2=0x7fbe74034aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-22T00:24:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 --2- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fbe740325e0 0x7fbe74034aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:24:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 msgr2=0x7fbe8810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 --2- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe8810dfe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbe84009330 tx=0x7fbe840090f0).stop 2024-02-22T00:24:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 shutdown_connections 2024-02-22T00:24:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 --2- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7fbe740325e0 0x7fbe74034aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:24:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 --2- 172.21.15.49:0/2491715409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbe88071c00 0x7fbe8810dfe0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 >> 172.21.15.49:0/2491715409 conn(0x7fbe880f76f0 msgr2=0x7fbe880f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 shutdown_connections 2024-02-22T00:24:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:35.809+0000 7fbe90037700 1 -- 172.21.15.49:0/2491715409 wait complete. 2024-02-22T00:24:35.835 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:34.521347+0000 mon.smithi049 (mon.0) 27 : audit [INF] from='client.? 172.21.15.49:0/73172290' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-22T00:24:35.835 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:34.521393+0000 mon.smithi049 (mon.0) 28 : cluster [DBG] mgrmap e5: smithi049.rjblpr(active, since 12s) 2024-02-22T00:24:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:Waiting for the mgr to restart... 2024-02-22T00:24:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:Waiting for mgr epoch 5... 2024-02-22T00:24:36.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:35.808274+0000 mon.smithi049 (mon.0) 29 : audit [DBG] from='client.? 172.21.15.49:0/2491715409' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-22T00:24:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.918+0000 7efd759df700 1 Processor -- start 2024-02-22T00:24:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.918+0000 7efd759df700 1 -- start start 2024-02-22T00:24:36.924 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.918+0000 7efd759df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd700ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.918+0000 7efd759df700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd70100120 con 0x7efd70071c60 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.918+0000 7efd6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd700ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.918+0000 7efd6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd700ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57608/0 (socket says 172.21.15.49:57608) 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.918+0000 7efd6effd700 1 -- 172.21.15.49:0/2312131201 learned_addr learned my addr 172.21.15.49:0/2312131201 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.919+0000 7efd6effd700 1 -- 172.21.15.49:0/2312131201 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70100260 con 0x7efd70071c60 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.919+0000 7efd6effd700 1 --2- 172.21.15.49:0/2312131201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd700ffc30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efd60009730 tx=0x7efd600090f0).ready entity=mon.0 client_cookie=2483538ec1b8bb71 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.919+0000 7efd6dffb700 1 -- 172.21.15.49:0/2312131201 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd6000b6e0 con 0x7efd70071c60 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.919+0000 7efd6dffb700 1 -- 172.21.15.49:0/2312131201 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7efd6000bc90 con 0x7efd70071c60 2024-02-22T00:24:36.925 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.919+0000 7efd6dffb700 1 -- 172.21.15.49:0/2312131201 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd60011c70 con 0x7efd70071c60 2024-02-22T00:24:36.928 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.920+0000 7efd759df700 1 -- 172.21.15.49:0/2312131201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 msgr2=0x7efd700ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:36.928 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.920+0000 7efd759df700 1 --2- 172.21.15.49:0/2312131201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd700ffc30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efd60009730 tx=0x7efd600090f0).stop 2024-02-22T00:24:36.928 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.920+0000 7efd759df700 1 -- 172.21.15.49:0/2312131201 shutdown_connections 2024-02-22T00:24:36.928 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.920+0000 7efd759df700 1 --2- 172.21.15.49:0/2312131201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd700ffc30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.920+0000 7efd759df700 1 -- 172.21.15.49:0/2312131201 >> 172.21.15.49:0/2312131201 conn(0x7efd700f76f0 msgr2=0x7efd700f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.920+0000 7efd759df700 1 -- 172.21.15.49:0/2312131201 shutdown_connections 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.920+0000 7efd759df700 1 -- 172.21.15.49:0/2312131201 wait complete. 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.921+0000 7efd759df700 1 Processor -- start 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.921+0000 7efd759df700 1 -- start start 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.921+0000 7efd759df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd7010be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.921+0000 7efd759df700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7010c2f0 con 0x7efd70071c60 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.921+0000 7efd6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd7010be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.921+0000 7efd6effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd7010be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57610/0 (socket says 172.21.15.49:57610) 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.921+0000 7efd6effd700 1 -- 172.21.15.49:0/3243386698 learned_addr learned my addr 172.21.15.49:0/3243386698 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.922+0000 7efd6effd700 1 -- 172.21.15.49:0/3243386698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd60009370 con 0x7efd70071c60 2024-02-22T00:24:36.929 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.922+0000 7efd6effd700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd7010be00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efd6000c010 tx=0x7efd600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.922+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd6001a610 con 0x7efd70071c60 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.922+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7efd6001abc0 con 0x7efd70071c60 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.922+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7010c4f0 con 0x7efd70071c60 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.922+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd60022a20 con 0x7efd70071c60 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.922+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7010c900 con 0x7efd70071c60 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.923+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7efd60022c90 con 0x7efd70071c60 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.923+0000 7efd57fff700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 0x7efd58034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.923+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 --> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd580351e0 con 0x7efd58032660 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.923+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7efd60045550 con 0x7efd70071c60 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.923+0000 7efd6e7fc700 1 -- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 msgr2=0x7efd58034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/48931101 2024-02-22T00:24:36.930 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:36.923+0000 7efd6e7fc700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 0x7efd58034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-22T00:24:37.129 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:37.124+0000 7efd6e7fc700 1 -- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 msgr2=0x7efd58034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/48931101 2024-02-22T00:24:37.129 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:37.124+0000 7efd6e7fc700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 0x7efd58034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-22T00:24:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:37.525+0000 7efd6e7fc700 1 -- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 msgr2=0x7efd58034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/48931101 2024-02-22T00:24:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:37.525+0000 7efd6e7fc700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 0x7efd58034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-22T00:24:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:38.326+0000 7efd6e7fc700 1 -- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 msgr2=0x7efd58034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/48931101 2024-02-22T00:24:38.331 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:38.326+0000 7efd6e7fc700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 0x7efd58034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-22T00:24:39.932 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:39.927+0000 7efd6e7fc700 1 -- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 msgr2=0x7efd58034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/48931101 2024-02-22T00:24:39.933 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:39.927+0000 7efd6e7fc700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 0x7efd58034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-02-22T00:24:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:40.045+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mgrmap(e 6) v1 ==== 38456+0+0 (secure 0 0 0) 0x7efd600198b0 con 0x7efd70071c60 2024-02-22T00:24:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:40.046+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 msgr2=0x7efd58034b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-22T00:24:40.051 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:40.046+0000 7efd57fff700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 0x7efd58034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:24:40.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:40.044860+0000 mon.smithi049 (mon.0) 30 : cluster [INF] Active manager daemon smithi049.rjblpr restarted 2024-02-22T00:24:40.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:40.045114+0000 mon.smithi049 (mon.0) 31 : cluster [INF] Activating manager daemon smithi049.rjblpr 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:40.048013+0000 mon.smithi049 (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:40.048128+0000 mon.smithi049 (mon.0) 33 : cluster [DBG] mgrmap e6: smithi049.rjblpr(active, starting, since 0.0031013s) 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.048936+0000 mon.smithi049 (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.049505+0000 mon.smithi049 (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.050171+0000 mon.smithi049 (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.050358+0000 mon.smithi049 (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.050498+0000 mon.smithi049 (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:40.052623+0000 mon.smithi049 (mon.0) 39 : cluster [INF] Manager daemon smithi049.rjblpr is now available 2024-02-22T00:24:40.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.065879+0000 mon.smithi049 (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:41.052 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.047+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 7) v1 ==== 38526+0+0 (secure 0 0 0) 0x7efd60019390 con 0x7efd70071c60 2024-02-22T00:24:41.053 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.047+0000 7efd57fff700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7efd58035fd0 0x7efd580383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:41.053 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.047+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd580351e0 con 0x7efd58035fd0 2024-02-22T00:24:41.053 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.048+0000 7efd6e7fc700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7efd58035fd0 0x7efd580383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:41.053 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.048+0000 7efd6e7fc700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7efd58035fd0 0x7efd580383c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7efd64003850 tx=0x7efd64009350).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:41.053 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.049+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7efd580351e0 con 0x7efd58035fd0 2024-02-22T00:24:41.060 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7efd7005a310 con 0x7efd58035fd0 2024-02-22T00:24:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd57fff700 1 -- 172.21.15.49:0/3243386698 <== mgr.14116 v2:172.21.15.49:6800/2503465771 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7efd7005a310 con 0x7efd58035fd0 2024-02-22T00:24:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: { 2024-02-22T00:24:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-02-22T00:24:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "initialized": true 2024-02-22T00:24:41.061 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: } 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7efd58035fd0 msgr2=0x7efd580383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7efd58035fd0 0x7efd580383c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7efd64003850 tx=0x7efd64009350).stop 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 msgr2=0x7efd7010be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd7010be00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efd6000c010 tx=0x7efd600090f0).stop 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 shutdown_connections 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7efd58035fd0 0x7efd580383c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd70071c60 0x7efd7010be00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 --2- 172.21.15.49:0/3243386698 >> [v2:172.21.15.49:6800/48931101,v1:172.21.15.49:6801/48931101] conn(0x7efd58032660 0x7efd58034b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.056+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 >> 172.21.15.49:0/3243386698 conn(0x7efd700f76f0 msgr2=0x7efd700f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.057+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 shutdown_connections 2024-02-22T00:24:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:41.057+0000 7efd759df700 1 -- 172.21.15.49:0/3243386698 wait complete. 2024-02-22T00:24:41.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:40.063310+0000 mgr.smithi049.rjblpr (mgr.14116) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-22T00:24:41.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.155049+0000 mon.smithi049 (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:41.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.156047+0000 mon.smithi049 (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:24:41.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.157311+0000 mon.smithi049 (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:24:41.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.159548+0000 mon.smithi049 (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:24:41.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.173720+0000 mon.smithi049 (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:24:41.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:40.176494+0000 mon.smithi049 (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:24:41.423 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:41.050951+0000 mon.smithi049 (mon.0) 47 : cluster [DBG] mgrmap e7: smithi049.rjblpr(active, since 1.00592s) 2024-02-22T00:24:41.676 INFO:teuthology.orchestra.run.smithi049.stderr:mgr epoch 5 is available 2024-02-22T00:24:41.676 INFO:teuthology.orchestra.run.smithi049.stderr:Setting orchestrator backend to cephadm... 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.265+0000 7fc65fcde700 1 Processor -- start 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.265+0000 7fc65fcde700 1 -- start start 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.265+0000 7fc65fcde700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc6580ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.265+0000 7fc65fcde700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658100160 con 0x7fc658071c20 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.265+0000 7fc65da7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc6580ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.265+0000 7fc65da7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc6580ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32998/0 (socket says 172.21.15.49:32998) 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.265+0000 7fc65da7a700 1 -- 172.21.15.49:0/995294934 learned_addr learned my addr 172.21.15.49:0/995294934 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65da7a700 1 -- 172.21.15.49:0/995294934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6581002a0 con 0x7fc658071c20 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65da7a700 1 --2- 172.21.15.49:0/995294934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc6580ffc70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc654009730 tx=0x7fc6540090f0).ready entity=mon.0 client_cookie=baaf25ac96eb37b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65ca78700 1 -- 172.21.15.49:0/995294934 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc65400b770 con 0x7fc658071c20 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65ca78700 1 -- 172.21.15.49:0/995294934 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fc65400bd20 con 0x7fc658071c20 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65ca78700 1 -- 172.21.15.49:0/995294934 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc654011cc0 con 0x7fc658071c20 2024-02-22T00:24:42.272 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65fcde700 1 -- 172.21.15.49:0/995294934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 msgr2=0x7fc6580ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65fcde700 1 --2- 172.21.15.49:0/995294934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc6580ffc70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc654009730 tx=0x7fc6540090f0).stop 2024-02-22T00:24:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65fcde700 1 -- 172.21.15.49:0/995294934 shutdown_connections 2024-02-22T00:24:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65fcde700 1 --2- 172.21.15.49:0/995294934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc6580ffc70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.266+0000 7fc65fcde700 1 -- 172.21.15.49:0/995294934 >> 172.21.15.49:0/995294934 conn(0x7fc6580f76f0 msgr2=0x7fc6580f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.267+0000 7fc65fcde700 1 -- 172.21.15.49:0/995294934 shutdown_connections 2024-02-22T00:24:42.273 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.267+0000 7fc65fcde700 1 -- 172.21.15.49:0/995294934 wait complete. 2024-02-22T00:24:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.267+0000 7fc65fcde700 1 Processor -- start 2024-02-22T00:24:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.267+0000 7fc65fcde700 1 -- start start 2024-02-22T00:24:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.267+0000 7fc65fcde700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc65810be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.267+0000 7fc65fcde700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65810c300 con 0x7fc658071c20 2024-02-22T00:24:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc65da7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc65810be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:42.275 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc65da7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc65810be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33010/0 (socket says 172.21.15.49:33010) 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc65da7a700 1 -- 172.21.15.49:0/1515435889 learned_addr learned my addr 172.21.15.49:0/1515435889 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc65da7a700 1 -- 172.21.15.49:0/1515435889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654009370 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc65da7a700 1 --2- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc65810be10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc654011630 tx=0x7fc6540090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc64effd700 1 -- 172.21.15.49:0/1515435889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc654011ae0 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65810c500 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc64effd700 1 -- 172.21.15.49:0/1515435889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fc65400be90 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc64effd700 1 -- 172.21.15.49:0/1515435889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc65401aaf0 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.268+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65810c910 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.269+0000 7fc64effd700 1 -- 172.21.15.49:0/1515435889 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fc654010af0 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.269+0000 7fc64effd700 1 --2- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc644032610 0x7fc644034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.269+0000 7fc64effd700 1 -- 172.21.15.49:0/1515435889 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fc654044f80 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.269+0000 7fc65d279700 1 --2- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc644032610 0x7fc644034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.269+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc658046ce0 con 0x7fc658071c20 2024-02-22T00:24:42.276 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.270+0000 7fc65d279700 1 --2- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc644032610 0x7fc644034ad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc648009780 tx=0x7fc648006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:42.279 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.274+0000 7fc64effd700 1 -- 172.21.15.49:0/1515435889 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc654018970 con 0x7fc658071c20 2024-02-22T00:24:42.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:41.050194+0000 mgr.smithi049.rjblpr (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-22T00:24:42.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:41.057311+0000 mgr.smithi049.rjblpr (mgr.14116) 3 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-22T00:24:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.458+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fc65810de30 con 0x7fc644032610 2024-02-22T00:24:42.468 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.463+0000 7fc64effd700 1 -- 172.21.15.49:0/1515435889 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc65810de30 con 0x7fc644032610 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc644032610 msgr2=0x7fc644034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 --2- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc644032610 0x7fc644034ad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc648009780 tx=0x7fc648006cc0).stop 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 msgr2=0x7fc65810be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 --2- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc65810be10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc654011630 tx=0x7fc6540090f0).stop 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 shutdown_connections 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 --2- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc644032610 0x7fc644034ad0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 --2- 172.21.15.49:0/1515435889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc658071c20 0x7fc65810be10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 >> 172.21.15.49:0/1515435889 conn(0x7fc6580f76f0 msgr2=0x7fc6580f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 shutdown_connections 2024-02-22T00:24:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:42.465+0000 7fc65fcde700 1 -- 172.21.15.49:0/1515435889 wait complete. 2024-02-22T00:24:43.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:24:42.157778+0000 mon.smithi049 (mon.0) 48 : cluster [DBG] mgrmap e8: smithi049.rjblpr(active, since 2s) 2024-02-22T00:24:43.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:42.460224+0000 mgr.smithi049.rjblpr (mgr.14116) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:43.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:42.464278+0000 mon.smithi049 (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:43.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:42.485620+0000 mon.smithi049 (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:24:43.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.555+0000 7fa4a21c7700 1 Processor -- start 2024-02-22T00:24:43.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.555+0000 7fa4a21c7700 1 -- start start 2024-02-22T00:24:43.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.555+0000 7fa4a21c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c072280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:43.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.555+0000 7fa4a21c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c074100 con 0x7fa49c073ce0 2024-02-22T00:24:43.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.555+0000 7fa49b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:43.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.555+0000 7fa49b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c072280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33022/0 (socket says 172.21.15.49:33022) 2024-02-22T00:24:43.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.555+0000 7fa49b7fe700 1 -- 172.21.15.49:0/827926236 learned_addr learned my addr 172.21.15.49:0/827926236 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:43.565 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.556+0000 7fa49b7fe700 1 -- 172.21.15.49:0/827926236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c072770 con 0x7fa49c073ce0 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.556+0000 7fa49b7fe700 1 --2- 172.21.15.49:0/827926236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c072280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa490009730 tx=0x7fa4900090f0).ready entity=mon.0 client_cookie=de1761d629d67fce server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.556+0000 7fa49a7fc700 1 -- 172.21.15.49:0/827926236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49000b6e0 con 0x7fa49c073ce0 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.556+0000 7fa49a7fc700 1 -- 172.21.15.49:0/827926236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fa49000bc90 con 0x7fa49c073ce0 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.556+0000 7fa49a7fc700 1 -- 172.21.15.49:0/827926236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa490011c70 con 0x7fa49c073ce0 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.556+0000 7fa4a21c7700 1 -- 172.21.15.49:0/827926236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 msgr2=0x7fa49c072280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.557+0000 7fa4a21c7700 1 --2- 172.21.15.49:0/827926236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c072280 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa490009730 tx=0x7fa4900090f0).stop 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.557+0000 7fa4a21c7700 1 -- 172.21.15.49:0/827926236 shutdown_connections 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.557+0000 7fa4a21c7700 1 --2- 172.21.15.49:0/827926236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c072280 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.557+0000 7fa4a21c7700 1 -- 172.21.15.49:0/827926236 >> 172.21.15.49:0/827926236 conn(0x7fa49c0f8810 msgr2=0x7fa49c0fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.557+0000 7fa4a21c7700 1 -- 172.21.15.49:0/827926236 shutdown_connections 2024-02-22T00:24:43.566 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.557+0000 7fa4a21c7700 1 -- 172.21.15.49:0/827926236 wait complete. 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.557+0000 7fa4a21c7700 1 Processor -- start 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.558+0000 7fa4a21c7700 1 -- start start 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.558+0000 7fa4a21c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c10df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.558+0000 7fa4a21c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c10e450 con 0x7fa49c073ce0 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.558+0000 7fa49b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c10df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.558+0000 7fa49b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c10df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33034/0 (socket says 172.21.15.49:33034) 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.558+0000 7fa49b7fe700 1 -- 172.21.15.49:0/1611574589 learned_addr learned my addr 172.21.15.49:0/1611574589 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.558+0000 7fa49b7fe700 1 -- 172.21.15.49:0/1611574589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa490009370 con 0x7fa49c073ce0 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.558+0000 7fa49b7fe700 1 --2- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c10df60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa490009330 tx=0x7fa4900090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.559+0000 7fa498ff9700 1 -- 172.21.15.49:0/1611574589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49001a610 con 0x7fa49c073ce0 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.559+0000 7fa498ff9700 1 -- 172.21.15.49:0/1611574589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fa49001abc0 con 0x7fa49c073ce0 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.559+0000 7fa498ff9700 1 -- 172.21.15.49:0/1611574589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa490022ac0 con 0x7fa49c073ce0 2024-02-22T00:24:43.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.559+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c10e650 con 0x7fa49c073ce0 2024-02-22T00:24:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.559+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c10ea60 con 0x7fa49c073ce0 2024-02-22T00:24:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.559+0000 7fa498ff9700 1 -- 172.21.15.49:0/1611574589 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fa490022cf0 con 0x7fa49c073ce0 2024-02-22T00:24:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.560+0000 7fa498ff9700 1 --2- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa484032630 0x7fa484034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.560+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c046ce0 con 0x7fa49c073ce0 2024-02-22T00:24:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.560+0000 7fa498ff9700 1 -- 172.21.15.49:0/1611574589 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fa490044bf0 con 0x7fa49c073ce0 2024-02-22T00:24:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.560+0000 7fa49affd700 1 --2- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa484032630 0x7fa484034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:43.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.560+0000 7fa49affd700 1 --2- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa484032630 0x7fa484034af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa48c009780 tx=0x7fa48c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:43.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.564+0000 7fa498ff9700 1 -- 172.21.15.49:0/1611574589 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa49001e020 con 0x7fa49c073ce0 2024-02-22T00:24:43.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.737+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fa49c10f340 con 0x7fa484032630 2024-02-22T00:24:43.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.737+0000 7fa498ff9700 1 -- 172.21.15.49:0/1611574589 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fa49c10f340 con 0x7fa484032630 2024-02-22T00:24:43.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: value unchanged 2024-02-22T00:24:43.744 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.739+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa484032630 msgr2=0x7fa484034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:43.744 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.739+0000 7fa4a21c7700 1 --2- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa484032630 0x7fa484034af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa48c009780 tx=0x7fa48c006cc0).stop 2024-02-22T00:24:43.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.739+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 msgr2=0x7fa49c10df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:43.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.739+0000 7fa4a21c7700 1 --2- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c10df60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa490009330 tx=0x7fa4900090f0).stop 2024-02-22T00:24:43.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.739+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 shutdown_connections 2024-02-22T00:24:43.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.739+0000 7fa4a21c7700 1 --2- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa484032630 0x7fa484034af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:43.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.739+0000 7fa4a21c7700 1 --2- 172.21.15.49:0/1611574589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa49c073ce0 0x7fa49c10df60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:43.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.739+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 >> 172.21.15.49:0/1611574589 conn(0x7fa49c0f8810 msgr2=0x7fa49c0fa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:43.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.740+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 shutdown_connections 2024-02-22T00:24:43.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:43.740+0000 7fa4a21c7700 1 -- 172.21.15.49:0/1611574589 wait complete. 2024-02-22T00:24:44.490 INFO:teuthology.orchestra.run.smithi049.stderr:Generating ssh key... 2024-02-22T00:24:44.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:43.738595+0000 mgr.smithi049.rjblpr (mgr.14116) 5 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.039+0000 7f8c82133700 1 Processor -- start 2024-02-22T00:24:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.039+0000 7f8c82133700 1 -- start start 2024-02-22T00:24:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.039+0000 7f8c82133700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c0ffcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.039+0000 7f8c82133700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c1001c0 con 0x7f8c7c071c00 2024-02-22T00:24:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.039+0000 7f8c7b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c0ffcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.039+0000 7f8c7b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c0ffcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33038/0 (socket says 172.21.15.49:33038) 2024-02-22T00:24:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.039+0000 7f8c7b7fe700 1 -- 172.21.15.49:0/2235041911 learned_addr learned my addr 172.21.15.49:0/2235041911 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.040+0000 7f8c7b7fe700 1 -- 172.21.15.49:0/2235041911 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c100300 con 0x7f8c7c071c00 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.040+0000 7f8c7b7fe700 1 --2- 172.21.15.49:0/2235041911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c0ffcd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8c6c009730 tx=0x7f8c6c0090f0).ready entity=mon.0 client_cookie=9338a2f209c35282 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.040+0000 7f8c7a7fc700 1 -- 172.21.15.49:0/2235041911 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c6c00b6e0 con 0x7f8c7c071c00 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.040+0000 7f8c7a7fc700 1 -- 172.21.15.49:0/2235041911 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8c6c00bc90 con 0x7f8c7c071c00 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.040+0000 7f8c7a7fc700 1 -- 172.21.15.49:0/2235041911 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c6c011c70 con 0x7f8c7c071c00 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.041+0000 7f8c82133700 1 -- 172.21.15.49:0/2235041911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 msgr2=0x7f8c7c0ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.041+0000 7f8c82133700 1 --2- 172.21.15.49:0/2235041911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c0ffcd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8c6c009730 tx=0x7f8c6c0090f0).stop 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.041+0000 7f8c82133700 1 -- 172.21.15.49:0/2235041911 shutdown_connections 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.041+0000 7f8c82133700 1 --2- 172.21.15.49:0/2235041911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c0ffcd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.041+0000 7f8c82133700 1 -- 172.21.15.49:0/2235041911 >> 172.21.15.49:0/2235041911 conn(0x7f8c7c0f7750 msgr2=0x7f8c7c0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.041+0000 7f8c82133700 1 -- 172.21.15.49:0/2235041911 shutdown_connections 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.041+0000 7f8c82133700 1 -- 172.21.15.49:0/2235041911 wait complete. 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.041+0000 7f8c82133700 1 Processor -- start 2024-02-22T00:24:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c82133700 1 -- start start 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c82133700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c10be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c82133700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c10c300 con 0x7f8c7c071c00 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c7b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c10be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c7b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c10be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33042/0 (socket says 172.21.15.49:33042) 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c7b7fe700 1 -- 172.21.15.49:0/2032545918 learned_addr learned my addr 172.21.15.49:0/2032545918 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c7b7fe700 1 -- 172.21.15.49:0/2032545918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c009370 con 0x7f8c7c071c00 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c7b7fe700 1 --2- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c10be10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8c6c000c00 tx=0x7f8c6c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c78ff9700 1 -- 172.21.15.49:0/2032545918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c6c011c30 con 0x7f8c7c071c00 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c10c500 con 0x7f8c7c071c00 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.042+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c10c910 con 0x7f8c7c071c00 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.043+0000 7f8c78ff9700 1 -- 172.21.15.49:0/2032545918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8c6c011400 con 0x7f8c7c071c00 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.043+0000 7f8c78ff9700 1 -- 172.21.15.49:0/2032545918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c6c01ab70 con 0x7f8c7c071c00 2024-02-22T00:24:45.050 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.043+0000 7f8c78ff9700 1 -- 172.21.15.49:0/2032545918 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f8c6c0223b0 con 0x7f8c7c071c00 2024-02-22T00:24:45.051 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.043+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c005120 con 0x7f8c7c071c00 2024-02-22T00:24:45.051 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.044+0000 7f8c78ff9700 1 --2- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8c68032610 0x7f8c68034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:45.051 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.044+0000 7f8c78ff9700 1 -- 172.21.15.49:0/2032545918 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f8c6c044b50 con 0x7f8c7c071c00 2024-02-22T00:24:45.051 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.044+0000 7f8c7affd700 1 --2- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8c68032610 0x7f8c68034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:45.051 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.044+0000 7f8c7affd700 1 --2- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8c68032610 0x7f8c68034ad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8c64009780 tx=0x7f8c64006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:45.053 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.048+0000 7f8c78ff9700 1 -- 172.21.15.49:0/2032545918 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8c6c011e60 con 0x7f8c7c071c00 2024-02-22T00:24:45.226 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.221+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c5c002a40 con 0x7f8c68032610 2024-02-22T00:24:45.432 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.427+0000 7f8c78ff9700 1 -- 172.21.15.49:0/2032545918 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8c5c002a40 con 0x7f8c68032610 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8c68032610 msgr2=0x7f8c68034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 --2- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8c68032610 0x7f8c68034ad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8c64009780 tx=0x7f8c64006cc0).stop 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 msgr2=0x7f8c7c10be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 --2- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c10be10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8c6c000c00 tx=0x7f8c6c0090f0).stop 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 shutdown_connections 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 --2- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8c68032610 0x7f8c68034ad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 --2- 172.21.15.49:0/2032545918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c7c071c00 0x7f8c7c10be10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 >> 172.21.15.49:0/2032545918 conn(0x7f8c7c0f7750 msgr2=0x7f8c7c0f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 shutdown_connections 2024-02-22T00:24:45.435 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:45.429+0000 7f8c82133700 1 -- 172.21.15.49:0/2032545918 wait complete. 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.474+0000 7f8dc8fd6700 1 Processor -- start 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.474+0000 7f8dc8fd6700 1 -- start start 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.474+0000 7f8dc8fd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40feae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.474+0000 7f8dc8fd6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40fefd0 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.474+0000 7f8dc259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40feae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.474+0000 7f8dc259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40feae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33056/0 (socket says 172.21.15.49:33056) 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.474+0000 7f8dc259c700 1 -- 172.21.15.49:0/4015006496 learned_addr learned my addr 172.21.15.49:0/4015006496 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.475+0000 7f8dc259c700 1 -- 172.21.15.49:0/4015006496 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40ff110 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.475+0000 7f8dc259c700 1 --2- 172.21.15.49:0/4015006496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40feae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8db4009730 tx=0x7f8db40090f0).ready entity=mon.0 client_cookie=23a7cf992dc108f server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:46.480 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.475+0000 7f8dc159a700 1 -- 172.21.15.49:0/4015006496 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8db400b6e0 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.475+0000 7f8dc159a700 1 -- 172.21.15.49:0/4015006496 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8db400bc90 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.481 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.475+0000 7f8dc159a700 1 -- 172.21.15.49:0/4015006496 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8db4011c70 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.476+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/4015006496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 msgr2=0x7f8dc40feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.476+0000 7f8dc8fd6700 1 --2- 172.21.15.49:0/4015006496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40feae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8db4009730 tx=0x7f8db40090f0).stop 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.476+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/4015006496 shutdown_connections 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.476+0000 7f8dc8fd6700 1 --2- 172.21.15.49:0/4015006496 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40feae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.476+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/4015006496 >> 172.21.15.49:0/4015006496 conn(0x7f8dc40f6e60 msgr2=0x7f8dc40f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.476+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/4015006496 shutdown_connections 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.476+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/4015006496 wait complete. 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc8fd6700 1 Processor -- start 2024-02-22T00:24:46.483 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc8fd6700 1 -- start start 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc8fd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40fdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc8fd6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40fc410 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40fdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40fdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33058/0 (socket says 172.21.15.49:33058) 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc259c700 1 -- 172.21.15.49:0/1004017197 learned_addr learned my addr 172.21.15.49:0/1004017197 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc259c700 1 -- 172.21.15.49:0/1004017197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4009370 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc259c700 1 --2- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40fdf90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8db4011870 tx=0x7f8db40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8db37fe700 1 -- 172.21.15.49:0/1004017197 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8db401a610 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8db37fe700 1 -- 172.21.15.49:0/1004017197 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8db401abc0 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.477+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc40fc5b0 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.478+0000 7f8db37fe700 1 -- 172.21.15.49:0/1004017197 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8db4022a30 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.478+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc40fc9c0 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.484 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.478+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc4046ce0 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.479+0000 7f8db37fe700 1 -- 172.21.15.49:0/1004017197 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f8db4022ca0 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.479+0000 7f8db37fe700 1 --2- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8dac032660 0x7f8dac034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.479+0000 7f8db37fe700 1 -- 172.21.15.49:0/1004017197 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f8db4045010 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.479+0000 7f8dc1d9b700 1 --2- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8dac032660 0x7f8dac034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:46.485 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.480+0000 7f8dc1d9b700 1 --2- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8dac032660 0x7f8dac034b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8db8009780 tx=0x7f8db8006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:46.488 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.483+0000 7f8db37fe700 1 -- 172.21.15.49:0/1004017197 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8db40223b0 con 0x7f8dc40fe6c0 2024-02-22T00:24:46.658 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.653+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dc41058d0 con 0x7f8dac032660 2024-02-22T00:24:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.654+0000 7f8db37fe700 1 -- 172.21.15.49:0/1004017197 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f8dc41058d0 con 0x7f8dac032660 2024-02-22T00:24:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqe9fRYT5tNm1RTjpUJ9/qmZnovHHMvHMjHg7u0dHDviCgciRPNq/Ki5gBfchImJqx7PcXVK4oRVF6478SuXFm27eOHd6/iRYFfFBU8QtpaJRMvNRQRr4ffsOkQjln5gpVxbPO55UbwI87t9ZLINya0gDULkHSBPSxzT5D4uVyZWuxGMhMr1MVIwQlmfJNvTmialkfx6q3VslBzXH2i7oTa8Q9Iuw1r6QjMgmS9piBVf81d00xiJGB/rZMP24okOx+8LjvK7zJDNy0rnFMbJ4cM/W8k9F3/OTTy24k8Te5Wm1YuBZ6X12uSk/e12CLcMG2LFtnf84HeybwEc7vlYzRG6j+1R7J8vs4vbRrY9G8Fw32lZ4CEcF1Dq0O4ZmzjKCkcWtUZ9+VpYty3gSDaiWxFCL8arbH3MFDvb+FvxgXGRU2BbnXRFGJKmmB1ahFyqMuUzdvhWwinoWPWle5vpbDK6M97MuDubDBVbYf46ci/Oq3Jj03Oj3mTSlEo4Xlh40= ceph-9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:24:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8dac032660 msgr2=0x7f8dac034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 --2- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8dac032660 0x7f8dac034b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f8db8009780 tx=0x7f8db8006cc0).stop 2024-02-22T00:24:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 msgr2=0x7f8dc40fdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 --2- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40fdf90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8db4011870 tx=0x7f8db40090f0).stop 2024-02-22T00:24:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 shutdown_connections 2024-02-22T00:24:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 --2- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8dac032660 0x7f8dac034b20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 --2- 172.21.15.49:0/1004017197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8dc40fe6c0 0x7f8dc40fdf90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 >> 172.21.15.49:0/1004017197 conn(0x7f8dc40f6e60 msgr2=0x7f8dc41004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 shutdown_connections 2024-02-22T00:24:46.662 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:46.656+0000 7f8dc8fd6700 1 -- 172.21.15.49:0/1004017197 wait complete. 2024-02-22T00:24:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:45.222980+0000 mgr.smithi049.rjblpr (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:45.223180+0000 mgr.smithi049.rjblpr (mgr.14116) 7 : cephadm [INF] Generating ssh key... 2024-02-22T00:24:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:45.426065+0000 mon.smithi049 (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:45.427766+0000 mon.smithi049 (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:47.296 INFO:teuthology.orchestra.run.smithi049.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-22T00:24:47.296 INFO:teuthology.orchestra.run.smithi049.stderr:Adding key to root@localhost authorized_keys... 2024-02-22T00:24:47.296 INFO:teuthology.orchestra.run.smithi049.stderr:Adding host smithi049... 2024-02-22T00:24:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.818+0000 7f92578a8700 1 Processor -- start 2024-02-22T00:24:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.818+0000 7f92578a8700 1 -- start start 2024-02-22T00:24:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.818+0000 7f92578a8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f9250072280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.818+0000 7f92578a8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9250074100 con 0x7f9250073ce0 2024-02-22T00:24:47.825 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.819+0000 7f9255644700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f9250072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.819+0000 7f9255644700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f9250072280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33064/0 (socket says 172.21.15.49:33064) 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.819+0000 7f9255644700 1 -- 172.21.15.49:0/1595621119 learned_addr learned my addr 172.21.15.49:0/1595621119 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.819+0000 7f9255644700 1 -- 172.21.15.49:0/1595621119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250072770 con 0x7f9250073ce0 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.819+0000 7f9255644700 1 --2- 172.21.15.49:0/1595621119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f9250072280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9244009730 tx=0x7f92440090f0).ready entity=mon.0 client_cookie=d2c749d1e8653566 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.819+0000 7f9243fff700 1 -- 172.21.15.49:0/1595621119 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f924400b6e0 con 0x7f9250073ce0 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.819+0000 7f9243fff700 1 -- 172.21.15.49:0/1595621119 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f924400bc90 con 0x7f9250073ce0 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.819+0000 7f9243fff700 1 -- 172.21.15.49:0/1595621119 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9244011c70 con 0x7f9250073ce0 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.820+0000 7f92578a8700 1 -- 172.21.15.49:0/1595621119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 msgr2=0x7f9250072280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.820+0000 7f92578a8700 1 --2- 172.21.15.49:0/1595621119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f9250072280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9244009730 tx=0x7f92440090f0).stop 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.820+0000 7f92578a8700 1 -- 172.21.15.49:0/1595621119 shutdown_connections 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.820+0000 7f92578a8700 1 --2- 172.21.15.49:0/1595621119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f9250072280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.820+0000 7f92578a8700 1 -- 172.21.15.49:0/1595621119 >> 172.21.15.49:0/1595621119 conn(0x7f92500f8810 msgr2=0x7f92500fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.820+0000 7f92578a8700 1 -- 172.21.15.49:0/1595621119 shutdown_connections 2024-02-22T00:24:47.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.820+0000 7f92578a8700 1 -- 172.21.15.49:0/1595621119 wait complete. 2024-02-22T00:24:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f92578a8700 1 Processor -- start 2024-02-22T00:24:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f92578a8700 1 -- start start 2024-02-22T00:24:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f92578a8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f925010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f92578a8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925010e4d0 con 0x7f9250073ce0 2024-02-22T00:24:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f9255644700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f925010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:47.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f9255644700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f925010dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33070/0 (socket says 172.21.15.49:33070) 2024-02-22T00:24:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f9255644700 1 -- 172.21.15.49:0/3136635334 learned_addr learned my addr 172.21.15.49:0/3136635334 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f9255644700 1 -- 172.21.15.49:0/3136635334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244009370 con 0x7f9250073ce0 2024-02-22T00:24:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f9255644700 1 --2- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f925010dfe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9244000c00 tx=0x7f92440090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f92427fc700 1 -- 172.21.15.49:0/3136635334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f924401a610 con 0x7f9250073ce0 2024-02-22T00:24:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.821+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925010e6d0 con 0x7f9250073ce0 2024-02-22T00:24:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.822+0000 7f92427fc700 1 -- 172.21.15.49:0/3136635334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f924401abc0 con 0x7f9250073ce0 2024-02-22T00:24:47.828 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.822+0000 7f92427fc700 1 -- 172.21.15.49:0/3136635334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9244022a20 con 0x7f9250073ce0 2024-02-22T00:24:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.822+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925010eae0 con 0x7f9250073ce0 2024-02-22T00:24:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.822+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9250046ce0 con 0x7f9250073ce0 2024-02-22T00:24:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.823+0000 7f92427fc700 1 -- 172.21.15.49:0/3136635334 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f9244022ce0 con 0x7f9250073ce0 2024-02-22T00:24:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.823+0000 7f92427fc700 1 --2- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f923c032610 0x7f923c034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.823+0000 7f92427fc700 1 -- 172.21.15.49:0/3136635334 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f9244044fe0 con 0x7f9250073ce0 2024-02-22T00:24:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.823+0000 7f9254e43700 1 --2- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f923c032610 0x7f923c034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:47.829 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.824+0000 7f9254e43700 1 --2- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f923c032610 0x7f923c034ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f924c009780 tx=0x7f924c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:47.830 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:47.827+0000 7f92427fc700 1 -- 172.21.15.49:0/3136635334 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f92440223b0 con 0x7f9250073ce0 2024-02-22T00:24:47.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:46.655512+0000 mgr.smithi049.rjblpr (mgr.14116) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:48.010 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.006+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}) v1 -- 0x7f9250107f00 con 0x7f923c032610 2024-02-22T00:24:48.647 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Added host 'smithi049' with addr '172.21.15.49' 2024-02-22T00:24:48.647 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.642+0000 7f92427fc700 1 -- 172.21.15.49:0/3136635334 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f9250107f00 con 0x7f923c032610 2024-02-22T00:24:48.648 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.644+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f923c032610 msgr2=0x7f923c034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:48.648 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.644+0000 7f92578a8700 1 --2- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f923c032610 0x7f923c034ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f924c009780 tx=0x7f924c006cc0).stop 2024-02-22T00:24:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.644+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 msgr2=0x7f925010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.644+0000 7f92578a8700 1 --2- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f925010dfe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9244000c00 tx=0x7f92440090f0).stop 2024-02-22T00:24:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.644+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 shutdown_connections 2024-02-22T00:24:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.644+0000 7f92578a8700 1 --2- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f923c032610 0x7f923c034ad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.644+0000 7f92578a8700 1 --2- 172.21.15.49:0/3136635334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9250073ce0 0x7f925010dfe0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.644+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 >> 172.21.15.49:0/3136635334 conn(0x7f92500f8810 msgr2=0x7f92500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:48.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.645+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 shutdown_connections 2024-02-22T00:24:48.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:48.645+0000 7f92578a8700 1 -- 172.21.15.49:0/3136635334 wait complete. 2024-02-22T00:24:48.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:48.007155+0000 mgr.smithi049.rjblpr (mgr.14116) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:49.268 INFO:teuthology.orchestra.run.smithi049.stderr:Deploying mon service with default placement... 2024-02-22T00:24:49.802 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.794+0000 7f8d1ae3f700 1 Processor -- start 2024-02-22T00:24:49.802 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.794+0000 7f8d1ae3f700 1 -- start start 2024-02-22T00:24:49.802 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.794+0000 7f8d1ae3f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d140fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:49.802 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.794+0000 7f8d1ae3f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140fc7e0 con 0x7f8d140fbed0 2024-02-22T00:24:49.802 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.795+0000 7f8d18bdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d140fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:49.802 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.795+0000 7f8d18bdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d140fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33078/0 (socket says 172.21.15.49:33078) 2024-02-22T00:24:49.802 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.795+0000 7f8d18bdb700 1 -- 172.21.15.49:0/2920848966 learned_addr learned my addr 172.21.15.49:0/2920848966 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:49.802 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.795+0000 7f8d18bdb700 1 -- 172.21.15.49:0/2920848966 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d140fc920 con 0x7f8d140fbed0 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.795+0000 7f8d18bdb700 1 --2- 172.21.15.49:0/2920848966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d140fc2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8d08009730 tx=0x7f8d080090f0).ready entity=mon.0 client_cookie=3ff0a2441e98ba30 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.795+0000 7f8d137fe700 1 -- 172.21.15.49:0/2920848966 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d0800b6e0 con 0x7f8d140fbed0 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.795+0000 7f8d137fe700 1 -- 172.21.15.49:0/2920848966 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8d0800bc90 con 0x7f8d140fbed0 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.795+0000 7f8d137fe700 1 -- 172.21.15.49:0/2920848966 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d08011c70 con 0x7f8d140fbed0 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.796+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/2920848966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 msgr2=0x7f8d140fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.796+0000 7f8d1ae3f700 1 --2- 172.21.15.49:0/2920848966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d140fc2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8d08009730 tx=0x7f8d080090f0).stop 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.796+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/2920848966 shutdown_connections 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.796+0000 7f8d1ae3f700 1 --2- 172.21.15.49:0/2920848966 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d140fc2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.796+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/2920848966 >> 172.21.15.49:0/2920848966 conn(0x7f8d140f76f0 msgr2=0x7f8d140f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.796+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/2920848966 shutdown_connections 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.796+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/2920848966 wait complete. 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.797+0000 7f8d1ae3f700 1 Processor -- start 2024-02-22T00:24:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.797+0000 7f8d1ae3f700 1 -- start start 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.797+0000 7f8d1ae3f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d1410ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.797+0000 7f8d1ae3f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14071c80 con 0x7f8d140fbed0 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.797+0000 7f8d18bdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d1410ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.797+0000 7f8d18bdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d1410ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33092/0 (socket says 172.21.15.49:33092) 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.797+0000 7f8d18bdb700 1 -- 172.21.15.49:0/3657980312 learned_addr learned my addr 172.21.15.49:0/3657980312 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.797+0000 7f8d18bdb700 1 -- 172.21.15.49:0/3657980312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08009370 con 0x7f8d140fbed0 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.798+0000 7f8d18bdb700 1 --2- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d1410ead0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8d08011870 tx=0x7f8d080090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.798+0000 7f8d11ffb700 1 -- 172.21.15.49:0/3657980312 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d0801a610 con 0x7f8d140fbed0 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.798+0000 7f8d11ffb700 1 -- 172.21.15.49:0/3657980312 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f8d0801abc0 con 0x7f8d140fbed0 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.798+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d14071e80 con 0x7f8d140fbed0 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.798+0000 7f8d11ffb700 1 -- 172.21.15.49:0/3657980312 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d08022a30 con 0x7f8d140fbed0 2024-02-22T00:24:49.804 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.798+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1410f180 con 0x7f8d140fbed0 2024-02-22T00:24:49.805 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.799+0000 7f8d11ffb700 1 -- 172.21.15.49:0/3657980312 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f8d08022ca0 con 0x7f8d140fbed0 2024-02-22T00:24:49.805 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.799+0000 7f8d11ffb700 1 --2- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8d04032660 0x7f8d04034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:49.805 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.799+0000 7f8d11ffb700 1 -- 172.21.15.49:0/3657980312 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f8d08044bd0 con 0x7f8d140fbed0 2024-02-22T00:24:49.806 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.799+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d14046ce0 con 0x7f8d140fbed0 2024-02-22T00:24:49.806 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.799+0000 7f8d13fff700 1 --2- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8d04032660 0x7f8d04034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:49.806 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.800+0000 7f8d13fff700 1 --2- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8d04032660 0x7f8d04034b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8d00009780 tx=0x7f8d00006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:49.807 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.804+0000 7f8d11ffb700 1 -- 172.21.15.49:0/3657980312 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8d0801e080 con 0x7f8d140fbed0 2024-02-22T00:24:49.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:48.641587+0000 mon.smithi049 (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:49.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:48.641885+0000 mgr.smithi049.rjblpr (mgr.14116) 10 : cephadm [INF] Added host smithi049 2024-02-22T00:24:49.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:48.666822+0000 mon.smithi049 (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:24:49.991 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.986+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d14059120 con 0x7f8d04032660 2024-02-22T00:24:49.994 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.991+0000 7f8d11ffb700 1 -- 172.21.15.49:0/3657980312 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8d14059120 con 0x7f8d04032660 2024-02-22T00:24:49.994 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Scheduled mon update... 2024-02-22T00:24:49.997 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8d04032660 msgr2=0x7f8d04034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:49.997 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 --2- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8d04032660 0x7f8d04034b20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8d00009780 tx=0x7f8d00006cc0).stop 2024-02-22T00:24:49.997 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 msgr2=0x7f8d1410ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:49.997 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 --2- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d1410ead0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8d08011870 tx=0x7f8d080090f0).stop 2024-02-22T00:24:49.997 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 shutdown_connections 2024-02-22T00:24:49.997 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 --2- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f8d04032660 0x7f8d04034b20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:49.998 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 --2- 172.21.15.49:0/3657980312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d140fbed0 0x7f8d1410ead0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:49.998 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 >> 172.21.15.49:0/3657980312 conn(0x7f8d140f76f0 msgr2=0x7f8d140f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:49.998 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 shutdown_connections 2024-02-22T00:24:49.998 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:49.993+0000 7f8d1ae3f700 1 -- 172.21.15.49:0/3657980312 wait complete. 2024-02-22T00:24:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:Deploying mgr service with default placement... 2024-02-22T00:24:51.154 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.141+0000 7f376e926700 1 Processor -- start 2024-02-22T00:24:51.154 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.141+0000 7f376e926700 1 -- start start 2024-02-22T00:24:51.154 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.141+0000 7f376e926700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f37680fd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:51.154 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.141+0000 7f376e926700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37680fdd20 con 0x7f37680fd410 2024-02-22T00:24:51.154 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.142+0000 7f3767fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f37680fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.142+0000 7f3767fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f37680fd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33098/0 (socket says 172.21.15.49:33098) 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.142+0000 7f3767fff700 1 -- 172.21.15.49:0/4217981521 learned_addr learned my addr 172.21.15.49:0/4217981521 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.142+0000 7f3767fff700 1 -- 172.21.15.49:0/4217981521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680fde60 con 0x7f37680fd410 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.142+0000 7f3767fff700 1 --2- 172.21.15.49:0/4217981521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f37680fd830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3758009730 tx=0x7f37580090f0).ready entity=mon.0 client_cookie=5c12aa94aab0f31d server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.142+0000 7f3766ffd700 1 -- 172.21.15.49:0/4217981521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f375800b6e0 con 0x7f37680fd410 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.142+0000 7f3766ffd700 1 -- 172.21.15.49:0/4217981521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f375800bc90 con 0x7f37680fd410 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.142+0000 7f3766ffd700 1 -- 172.21.15.49:0/4217981521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3758011c70 con 0x7f37680fd410 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 -- 172.21.15.49:0/4217981521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 msgr2=0x7f37680fd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 --2- 172.21.15.49:0/4217981521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f37680fd830 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3758009730 tx=0x7f37580090f0).stop 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 -- 172.21.15.49:0/4217981521 shutdown_connections 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 --2- 172.21.15.49:0/4217981521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f37680fd830 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 -- 172.21.15.49:0/4217981521 >> 172.21.15.49:0/4217981521 conn(0x7f37680f6e20 msgr2=0x7f37680f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 -- 172.21.15.49:0/4217981521 shutdown_connections 2024-02-22T00:24:51.155 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 -- 172.21.15.49:0/4217981521 wait complete. 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 Processor -- start 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.143+0000 7f376e926700 1 -- start start 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f376e926700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f376810bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f376e926700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376810c280 con 0x7f37680fd410 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f3767fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f376810bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f3767fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f376810bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33112/0 (socket says 172.21.15.49:33112) 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f3767fff700 1 -- 172.21.15.49:0/355365642 learned_addr learned my addr 172.21.15.49:0/355365642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f3767fff700 1 -- 172.21.15.49:0/355365642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758009370 con 0x7f37680fd410 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f3767fff700 1 --2- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f376810bd90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f37580115c0 tx=0x7f37580090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f37657fa700 1 -- 172.21.15.49:0/355365642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3758011a90 con 0x7f37680fd410 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f37657fa700 1 -- 172.21.15.49:0/355365642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f3758011bf0 con 0x7f37680fd410 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376810c480 con 0x7f37680fd410 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f37657fa700 1 -- 172.21.15.49:0/355365642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f375801ac30 con 0x7f37680fd410 2024-02-22T00:24:51.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.144+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376810c890 con 0x7f37680fd410 2024-02-22T00:24:51.157 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.145+0000 7f37657fa700 1 -- 172.21.15.49:0/355365642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f3758023400 con 0x7f37680fd410 2024-02-22T00:24:51.157 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.145+0000 7f37657fa700 1 --2- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f37500325e0 0x7f3750034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:51.157 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.145+0000 7f37657fa700 1 -- 172.21.15.49:0/355365642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f3758044f50 con 0x7f37680fd410 2024-02-22T00:24:51.157 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.145+0000 7f37677fe700 1 --2- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f37500325e0 0x7f3750034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:51.157 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.145+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3768046ce0 con 0x7f37680fd410 2024-02-22T00:24:51.157 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.146+0000 7f37677fe700 1 --2- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f37500325e0 0x7f3750034aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f375c009780 tx=0x7f375c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:51.157 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.150+0000 7f37657fa700 1 -- 172.21.15.49:0/355365642 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f375801e080 con 0x7f37680fd410 2024-02-22T00:24:51.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:49.987488+0000 mgr.smithi049.rjblpr (mgr.14116) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:51.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:49.988692+0000 mgr.smithi049.rjblpr (mgr.14116) 12 : cephadm [INF] Saving service mon spec with placement count:5 2024-02-22T00:24:51.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:49.990941+0000 mon.smithi049 (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:51.352 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.347+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f3768105e00 con 0x7f37500325e0 2024-02-22T00:24:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.351+0000 7f37657fa700 1 -- 172.21.15.49:0/355365642 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3768105e00 con 0x7f37500325e0 2024-02-22T00:24:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-02-22T00:24:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f37500325e0 msgr2=0x7f3750034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 --2- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f37500325e0 0x7f3750034aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f375c009780 tx=0x7f375c006cc0).stop 2024-02-22T00:24:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 msgr2=0x7f376810bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 --2- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f376810bd90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f37580115c0 tx=0x7f37580090f0).stop 2024-02-22T00:24:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 shutdown_connections 2024-02-22T00:24:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 --2- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f37500325e0 0x7f3750034aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:51.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 --2- 172.21.15.49:0/355365642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37680fd410 0x7f376810bd90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:51.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 >> 172.21.15.49:0/355365642 conn(0x7f37680f6e20 msgr2=0x7f37680fb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:51.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 shutdown_connections 2024-02-22T00:24:51.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:51.353+0000 7f376e926700 1 -- 172.21.15.49:0/355365642 wait complete. 2024-02-22T00:24:51.967 INFO:teuthology.orchestra.run.smithi049.stderr:Deploying crash service with default placement... 2024-02-22T00:24:52.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:51.349042+0000 mgr.smithi049.rjblpr (mgr.14116) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:52.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:51.349906+0000 mgr.smithi049.rjblpr (mgr.14116) 14 : cephadm [INF] Saving service mgr spec with placement count:2 2024-02-22T00:24:52.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:51.352103+0000 mon.smithi049 (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:52.695 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.688+0000 7fd167e47700 1 Processor -- start 2024-02-22T00:24:52.695 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.689+0000 7fd167e47700 1 -- start start 2024-02-22T00:24:52.695 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.689+0000 7fd167e47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd1600fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:52.695 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.689+0000 7fd167e47700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1600fc7e0 con 0x7fd1600fbed0 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.689+0000 7fd165be3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd1600fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.689+0000 7fd165be3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd1600fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54572/0 (socket says 172.21.15.49:54572) 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.689+0000 7fd165be3700 1 -- 172.21.15.49:0/2848825413 learned_addr learned my addr 172.21.15.49:0/2848825413 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.689+0000 7fd165be3700 1 -- 172.21.15.49:0/2848825413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1600fc920 con 0x7fd1600fbed0 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.689+0000 7fd165be3700 1 --2- 172.21.15.49:0/2848825413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd1600fc2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd15c009730 tx=0x7fd15c0090f0).ready entity=mon.0 client_cookie=417f7f34acf3ec75 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd164be1700 1 -- 172.21.15.49:0/2848825413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd15c00b6e0 con 0x7fd1600fbed0 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd164be1700 1 -- 172.21.15.49:0/2848825413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fd15c00bc90 con 0x7fd1600fbed0 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd164be1700 1 -- 172.21.15.49:0/2848825413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd15c011c70 con 0x7fd1600fbed0 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd167e47700 1 -- 172.21.15.49:0/2848825413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 msgr2=0x7fd1600fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd167e47700 1 --2- 172.21.15.49:0/2848825413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd1600fc2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd15c009730 tx=0x7fd15c0090f0).stop 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd167e47700 1 -- 172.21.15.49:0/2848825413 shutdown_connections 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd167e47700 1 --2- 172.21.15.49:0/2848825413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd1600fc2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd167e47700 1 -- 172.21.15.49:0/2848825413 >> 172.21.15.49:0/2848825413 conn(0x7fd1600f76f0 msgr2=0x7fd1600f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:52.696 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.690+0000 7fd167e47700 1 -- 172.21.15.49:0/2848825413 shutdown_connections 2024-02-22T00:24:52.697 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.691+0000 7fd167e47700 1 -- 172.21.15.49:0/2848825413 wait complete. 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.691+0000 7fd167e47700 1 Processor -- start 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.691+0000 7fd167e47700 1 -- start start 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd167e47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd16010eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd167e47700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd160071ca0 con 0x7fd1600fbed0 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd165be3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd16010eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd165be3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd16010eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54574/0 (socket says 172.21.15.49:54574) 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd165be3700 1 -- 172.21.15.49:0/3818282506 learned_addr learned my addr 172.21.15.49:0/3818282506 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd165be3700 1 -- 172.21.15.49:0/3818282506 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c009370 con 0x7fd1600fbed0 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd165be3700 1 --2- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd16010eab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd15c011870 tx=0x7fd15c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd152ffd700 1 -- 172.21.15.49:0/3818282506 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd15c01a610 con 0x7fd1600fbed0 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd152ffd700 1 -- 172.21.15.49:0/3818282506 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fd15c01abc0 con 0x7fd1600fbed0 2024-02-22T00:24:52.699 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd160071ea0 con 0x7fd1600fbed0 2024-02-22T00:24:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd152ffd700 1 -- 172.21.15.49:0/3818282506 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd15c022a30 con 0x7fd1600fbed0 2024-02-22T00:24:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.692+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16010f160 con 0x7fd1600fbed0 2024-02-22T00:24:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.693+0000 7fd152ffd700 1 -- 172.21.15.49:0/3818282506 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fd15c022cf0 con 0x7fd1600fbed0 2024-02-22T00:24:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.693+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd160046ce0 con 0x7fd1600fbed0 2024-02-22T00:24:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.693+0000 7fd152ffd700 1 --2- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fd14c032610 0x7fd14c034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.693+0000 7fd152ffd700 1 -- 172.21.15.49:0/3818282506 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fd15c044c80 con 0x7fd1600fbed0 2024-02-22T00:24:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.693+0000 7fd1653e2700 1 --2- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fd14c032610 0x7fd14c034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:52.700 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.694+0000 7fd1653e2700 1 --2- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fd14c032610 0x7fd14c034ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd154009780 tx=0x7fd154006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:52.702 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.698+0000 7fd152ffd700 1 -- 172.21.15.49:0/3818282506 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd15c01ad30 con 0x7fd1600fbed0 2024-02-22T00:24:52.886 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.882+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fd160059120 con 0x7fd14c032610 2024-02-22T00:24:52.890 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.886+0000 7fd152ffd700 1 -- 172.21.15.49:0/3818282506 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fd160059120 con 0x7fd14c032610 2024-02-22T00:24:52.890 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Scheduled crash update... 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fd14c032610 msgr2=0x7fd14c034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 --2- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fd14c032610 0x7fd14c034ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd154009780 tx=0x7fd154006cc0).stop 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 msgr2=0x7fd16010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 --2- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd16010eab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd15c011870 tx=0x7fd15c0090f0).stop 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 shutdown_connections 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 --2- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fd14c032610 0x7fd14c034ad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 --2- 172.21.15.49:0/3818282506 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1600fbed0 0x7fd16010eab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 >> 172.21.15.49:0/3818282506 conn(0x7fd1600f76f0 msgr2=0x7fd1600f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 shutdown_connections 2024-02-22T00:24:52.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:52.888+0000 7fd167e47700 1 -- 172.21.15.49:0/3818282506 wait complete. 2024-02-22T00:24:53.762 INFO:teuthology.orchestra.run.smithi049.stderr:Deploying prometheus service with default placement... 2024-02-22T00:24:54.027 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:52.883828+0000 mgr.smithi049.rjblpr (mgr.14116) 15 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:54.027 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:52.884729+0000 mgr.smithi049.rjblpr (mgr.14116) 16 : cephadm [INF] Saving service crash spec with placement * 2024-02-22T00:24:54.027 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:52.886823+0000 mon.smithi049 (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:54.028 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:53.178700+0000 mon.smithi049 (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:54.028 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:53.421765+0000 mon.smithi049 (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:54.306 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.294+0000 7f3a9a331700 1 Processor -- start 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.294+0000 7f3a9a331700 1 -- start start 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.294+0000 7f3a9a331700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a940fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.294+0000 7f3a9a331700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940feeb0 con 0x7f3a940fe5a0 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.294+0000 7f3a93fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a940fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.294+0000 7f3a93fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a940fe9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54576/0 (socket says 172.21.15.49:54576) 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.294+0000 7f3a93fff700 1 -- 172.21.15.49:0/3422613610 learned_addr learned my addr 172.21.15.49:0/3422613610 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.295+0000 7f3a93fff700 1 -- 172.21.15.49:0/3422613610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940feff0 con 0x7f3a940fe5a0 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.295+0000 7f3a93fff700 1 --2- 172.21.15.49:0/3422613610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a940fe9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3a84009730 tx=0x7f3a840090f0).ready entity=mon.0 client_cookie=35b30b37247f1d47 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.295+0000 7f3a92ffd700 1 -- 172.21.15.49:0/3422613610 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a8400b6e0 con 0x7f3a940fe5a0 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.295+0000 7f3a92ffd700 1 -- 172.21.15.49:0/3422613610 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3a8400bcd0 con 0x7f3a940fe5a0 2024-02-22T00:24:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.295+0000 7f3a92ffd700 1 -- 172.21.15.49:0/3422613610 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a84011cb0 con 0x7f3a940fe5a0 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.295+0000 7f3a9a331700 1 -- 172.21.15.49:0/3422613610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 msgr2=0x7f3a940fe9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.295+0000 7f3a9a331700 1 --2- 172.21.15.49:0/3422613610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a940fe9c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3a84009730 tx=0x7f3a840090f0).stop 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.296+0000 7f3a9a331700 1 -- 172.21.15.49:0/3422613610 shutdown_connections 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.296+0000 7f3a9a331700 1 --2- 172.21.15.49:0/3422613610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a940fe9c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.296+0000 7f3a9a331700 1 -- 172.21.15.49:0/3422613610 >> 172.21.15.49:0/3422613610 conn(0x7f3a940f6e20 msgr2=0x7f3a940f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.296+0000 7f3a9a331700 1 -- 172.21.15.49:0/3422613610 shutdown_connections 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.296+0000 7f3a9a331700 1 -- 172.21.15.49:0/3422613610 wait complete. 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.297+0000 7f3a9a331700 1 Processor -- start 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.297+0000 7f3a9a331700 1 -- start start 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.297+0000 7f3a9a331700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a9410be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.297+0000 7f3a9a331700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9410c2f0 con 0x7f3a940fe5a0 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.297+0000 7f3a93fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a9410be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:54.308 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.297+0000 7f3a93fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a9410be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54590/0 (socket says 172.21.15.49:54590) 2024-02-22T00:24:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.297+0000 7f3a93fff700 1 -- 172.21.15.49:0/571960437 learned_addr learned my addr 172.21.15.49:0/571960437 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.298+0000 7f3a93fff700 1 -- 172.21.15.49:0/571960437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84009370 con 0x7f3a940fe5a0 2024-02-22T00:24:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.298+0000 7f3a93fff700 1 --2- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a9410be00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3a84006ba0 tx=0x7f3a840090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.298+0000 7f3a917fa700 1 -- 172.21.15.49:0/571960437 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a8401a640 con 0x7f3a940fe5a0 2024-02-22T00:24:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.298+0000 7f3a917fa700 1 -- 172.21.15.49:0/571960437 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3a8401ac30 con 0x7f3a940fe5a0 2024-02-22T00:24:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.298+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9410c4f0 con 0x7f3a940fe5a0 2024-02-22T00:24:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.298+0000 7f3a917fa700 1 -- 172.21.15.49:0/571960437 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a84022b60 con 0x7f3a940fe5a0 2024-02-22T00:24:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.298+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9410c900 con 0x7f3a940fe5a0 2024-02-22T00:24:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.299+0000 7f3a917fa700 1 -- 172.21.15.49:0/571960437 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f3a84019390 con 0x7f3a940fe5a0 2024-02-22T00:24:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.299+0000 7f3a917fa700 1 --2- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f3a7c032610 0x7f3a7c034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.299+0000 7f3a917fa700 1 -- 172.21.15.49:0/571960437 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f3a84045a80 con 0x7f3a940fe5a0 2024-02-22T00:24:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.299+0000 7f3a937fe700 1 --2- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f3a7c032610 0x7f3a7c034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.299+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a94046ce0 con 0x7f3a940fe5a0 2024-02-22T00:24:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.300+0000 7f3a937fe700 1 --2- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f3a7c032610 0x7f3a7c034ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3a88009780 tx=0x7f3a88006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:54.311 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.306+0000 7f3a917fa700 1 -- 172.21.15.49:0/571960437 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3a84019690 con 0x7f3a940fe5a0 2024-02-22T00:24:54.515 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.510+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a94105dc0 con 0x7f3a7c032610 2024-02-22T00:24:54.519 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.515+0000 7f3a917fa700 1 -- 172.21.15.49:0/571960437 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f3a94105dc0 con 0x7f3a7c032610 2024-02-22T00:24:54.519 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Scheduled prometheus update... 2024-02-22T00:24:54.521 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.516+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f3a7c032610 msgr2=0x7f3a7c034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.516+0000 7f3a9a331700 1 --2- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f3a7c032610 0x7f3a7c034ad0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3a88009780 tx=0x7f3a88006cc0).stop 2024-02-22T00:24:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.516+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 msgr2=0x7f3a9410be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.516+0000 7f3a9a331700 1 --2- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a9410be00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3a84006ba0 tx=0x7f3a840090f0).stop 2024-02-22T00:24:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.517+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 shutdown_connections 2024-02-22T00:24:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.517+0000 7f3a9a331700 1 --2- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f3a7c032610 0x7f3a7c034ad0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.517+0000 7f3a9a331700 1 --2- 172.21.15.49:0/571960437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a940fe5a0 0x7f3a9410be00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.517+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 >> 172.21.15.49:0/571960437 conn(0x7f3a940f6e20 msgr2=0x7f3a940f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.517+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 shutdown_connections 2024-02-22T00:24:54.523 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:54.517+0000 7f3a9a331700 1 -- 172.21.15.49:0/571960437 wait complete. 2024-02-22T00:24:55.253 INFO:teuthology.orchestra.run.smithi049.stderr:Deploying grafana service with default placement... 2024-02-22T00:24:55.892 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.883+0000 7f7560688700 1 Processor -- start 2024-02-22T00:24:55.892 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.883+0000 7f7560688700 1 -- start start 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.883+0000 7f7560688700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f75580ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.883+0000 7f7560688700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7558100120 con 0x7f7558071c60 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.883+0000 7f755e424700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f75580ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.884+0000 7f755e424700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f75580ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54592/0 (socket says 172.21.15.49:54592) 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.884+0000 7f755e424700 1 -- 172.21.15.49:0/1462803855 learned_addr learned my addr 172.21.15.49:0/1462803855 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.884+0000 7f755e424700 1 -- 172.21.15.49:0/1462803855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558100260 con 0x7f7558071c60 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.884+0000 7f755e424700 1 --2- 172.21.15.49:0/1462803855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f75580ffc30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7554009730 tx=0x7f75540090f0).ready entity=mon.0 client_cookie=2e72096347c55434 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.884+0000 7f755d422700 1 -- 172.21.15.49:0/1462803855 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f755400b6e0 con 0x7f7558071c60 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.884+0000 7f755d422700 1 -- 172.21.15.49:0/1462803855 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f755400bcd0 con 0x7f7558071c60 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.884+0000 7f755d422700 1 -- 172.21.15.49:0/1462803855 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7554011cb0 con 0x7f7558071c60 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.885+0000 7f7560688700 1 -- 172.21.15.49:0/1462803855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 msgr2=0x7f75580ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.885+0000 7f7560688700 1 --2- 172.21.15.49:0/1462803855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f75580ffc30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f7554009730 tx=0x7f75540090f0).stop 2024-02-22T00:24:55.893 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.885+0000 7f7560688700 1 -- 172.21.15.49:0/1462803855 shutdown_connections 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.885+0000 7f7560688700 1 --2- 172.21.15.49:0/1462803855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f75580ffc30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.885+0000 7f7560688700 1 -- 172.21.15.49:0/1462803855 >> 172.21.15.49:0/1462803855 conn(0x7f75580f76f0 msgr2=0x7f75580f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.885+0000 7f7560688700 1 -- 172.21.15.49:0/1462803855 shutdown_connections 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.885+0000 7f7560688700 1 -- 172.21.15.49:0/1462803855 wait complete. 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f7560688700 1 Processor -- start 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f7560688700 1 -- start start 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f7560688700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f755810bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f7560688700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755810c390 con 0x7f7558071c60 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f755e424700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f755810bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:55.894 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f755e424700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f755810bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54600/0 (socket says 172.21.15.49:54600) 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f755e424700 1 -- 172.21.15.49:0/1833420871 learned_addr learned my addr 172.21.15.49:0/1833420871 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f755e424700 1 -- 172.21.15.49:0/1833420871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554009370 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.886+0000 7f755e424700 1 --2- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f755810bea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f75540118b0 tx=0x7f75540090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.887+0000 7f754f7fe700 1 -- 172.21.15.49:0/1833420871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f755400bad0 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.887+0000 7f754f7fe700 1 -- 172.21.15.49:0/1833420871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7554011ad0 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.887+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755810c590 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.887+0000 7f754f7fe700 1 -- 172.21.15.49:0/1833420871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f755401aa50 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.887+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755810c9a0 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.888+0000 7f754f7fe700 1 -- 172.21.15.49:0/1833420871 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f755401acc0 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.888+0000 7f754f7fe700 1 --2- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f7544032660 0x7f7544034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.888+0000 7f754f7fe700 1 -- 172.21.15.49:0/1833420871 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f7554044a50 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.888+0000 7f755dc23700 1 --2- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f7544032660 0x7f7544034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.888+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7558046ce0 con 0x7f7558071c60 2024-02-22T00:24:55.895 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.888+0000 7f755dc23700 1 --2- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f7544032660 0x7f7544034b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7548009780 tx=0x7f7548006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:55.897 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:55.893+0000 7f754f7fe700 1 -- 172.21.15.49:0/1833420871 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f755401e020 con 0x7f7558071c60 2024-02-22T00:24:55.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:54.512735+0000 mgr.smithi049.rjblpr (mgr.14116) 17 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:55.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:54.513593+0000 mgr.smithi049.rjblpr (mgr.14116) 18 : cephadm [INF] Saving service prometheus spec with placement count:1 2024-02-22T00:24:55.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:54.515841+0000 mon.smithi049 (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:56.089 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.085+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f755810de60 con 0x7f7544032660 2024-02-22T00:24:56.095 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.090+0000 7f754f7fe700 1 -- 172.21.15.49:0/1833420871 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f755810de60 con 0x7f7544032660 2024-02-22T00:24:56.095 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Scheduled grafana update... 2024-02-22T00:24:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f7544032660 msgr2=0x7f7544034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 --2- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f7544032660 0x7f7544034b20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7548009780 tx=0x7f7548006cc0).stop 2024-02-22T00:24:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 msgr2=0x7f755810bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 --2- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f755810bea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f75540118b0 tx=0x7f75540090f0).stop 2024-02-22T00:24:56.099 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 shutdown_connections 2024-02-22T00:24:56.100 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 --2- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f7544032660 0x7f7544034b20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:56.100 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 --2- 172.21.15.49:0/1833420871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7558071c60 0x7f755810bea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:56.100 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 >> 172.21.15.49:0/1833420871 conn(0x7f75580f76f0 msgr2=0x7f75580f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:56.100 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 shutdown_connections 2024-02-22T00:24:56.100 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:56.092+0000 7f7560688700 1 -- 172.21.15.49:0/1833420871 wait complete. 2024-02-22T00:24:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:55.816451+0000 mon.smithi049 (mon.0) 61 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:56.087255+0000 mgr.smithi049.rjblpr (mgr.14116) 19 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:56.088085+0000 mgr.smithi049.rjblpr (mgr.14116) 20 : cephadm [INF] Saving service grafana spec with placement count:1 2024-02-22T00:24:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:56.090626+0000 mon.smithi049 (mon.0) 62 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:57.576 INFO:teuthology.orchestra.run.smithi049.stderr:Deploying node-exporter service with default placement... 2024-02-22T00:24:58.147 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.133+0000 7f352ffff700 1 Processor -- start 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.133+0000 7f352ffff700 1 -- start start 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.133+0000 7f352ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f35300fe930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.133+0000 7f352ffff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300fee20 con 0x7f35300fe510 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.133+0000 7f352effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f35300fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.133+0000 7f352effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f35300fe930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54612/0 (socket says 172.21.15.49:54612) 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.133+0000 7f352effd700 1 -- 172.21.15.49:0/3336295055 learned_addr learned my addr 172.21.15.49:0/3336295055 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.134+0000 7f352effd700 1 -- 172.21.15.49:0/3336295055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300fef60 con 0x7f35300fe510 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.134+0000 7f352effd700 1 --2- 172.21.15.49:0/3336295055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f35300fe930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3518009730 tx=0x7f35180090f0).ready entity=mon.0 client_cookie=81b04fcc35cec58a server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.134+0000 7f352dffb700 1 -- 172.21.15.49:0/3336295055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f351800b6e0 con 0x7f35300fe510 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.134+0000 7f352dffb700 1 -- 172.21.15.49:0/3336295055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f351800bcd0 con 0x7f35300fe510 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.134+0000 7f352dffb700 1 -- 172.21.15.49:0/3336295055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3518011cb0 con 0x7f35300fe510 2024-02-22T00:24:58.148 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.134+0000 7f352ffff700 1 -- 172.21.15.49:0/3336295055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 msgr2=0x7f35300fe930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.134+0000 7f352ffff700 1 --2- 172.21.15.49:0/3336295055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f35300fe930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3518009730 tx=0x7f35180090f0).stop 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.135+0000 7f352ffff700 1 -- 172.21.15.49:0/3336295055 shutdown_connections 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.135+0000 7f352ffff700 1 --2- 172.21.15.49:0/3336295055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f35300fe930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.135+0000 7f352ffff700 1 -- 172.21.15.49:0/3336295055 >> 172.21.15.49:0/3336295055 conn(0x7f35300f6cb0 msgr2=0x7f35300f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.135+0000 7f352ffff700 1 -- 172.21.15.49:0/3336295055 shutdown_connections 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.135+0000 7f352ffff700 1 -- 172.21.15.49:0/3336295055 wait complete. 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.135+0000 7f352ffff700 1 Processor -- start 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.135+0000 7f352ffff700 1 -- start start 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f353010bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352ffff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353010c0b0 con 0x7f35300fe510 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f353010bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f353010bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54616/0 (socket says 172.21.15.49:54616) 2024-02-22T00:24:58.149 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352effd700 1 -- 172.21.15.49:0/1464012296 learned_addr learned my addr 172.21.15.49:0/1464012296 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352effd700 1 -- 172.21.15.49:0/1464012296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518009370 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352effd700 1 --2- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f353010bbc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3518006ba0 tx=0x7f35180090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f3527fff700 1 -- 172.21.15.49:0/1464012296 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f351801a640 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f3527fff700 1 -- 172.21.15.49:0/1464012296 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f351801ac30 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353010c2b0 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f3527fff700 1 -- 172.21.15.49:0/1464012296 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3518022b60 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.136+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353010c6c0 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.137+0000 7f3527fff700 1 -- 172.21.15.49:0/1464012296 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f35180223b0 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.137+0000 7f3527fff700 1 --2- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f351c032660 0x7f351c034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.137+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3530046ce0 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.137+0000 7f3527fff700 1 -- 172.21.15.49:0/1464012296 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f3518044b80 con 0x7f35300fe510 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.137+0000 7f352e7fc700 1 --2- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f351c032660 0x7f351c034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.138+0000 7f352e7fc700 1 --2- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f351c032660 0x7f351c034b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3520009780 tx=0x7f3520006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:58.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.142+0000 7f3527fff700 1 -- 172.21.15.49:0/1464012296 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f351801ada0 con 0x7f35300fe510 2024-02-22T00:24:58.332 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.328+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f353010cfa0 con 0x7f351c032660 2024-02-22T00:24:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.332+0000 7f3527fff700 1 -- 172.21.15.49:0/1464012296 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f353010cfa0 con 0x7f351c032660 2024-02-22T00:24:58.336 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2024-02-22T00:24:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.334+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f351c032660 msgr2=0x7f351c034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.334+0000 7f352ffff700 1 --2- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f351c032660 0x7f351c034b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3520009780 tx=0x7f3520006cc0).stop 2024-02-22T00:24:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.334+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 msgr2=0x7f353010bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.334+0000 7f352ffff700 1 --2- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f353010bbc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f3518006ba0 tx=0x7f35180090f0).stop 2024-02-22T00:24:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.334+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 shutdown_connections 2024-02-22T00:24:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.334+0000 7f352ffff700 1 --2- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f351c032660 0x7f351c034b20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.334+0000 7f352ffff700 1 --2- 172.21.15.49:0/1464012296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35300fe510 0x7f353010bbc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.334+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 >> 172.21.15.49:0/1464012296 conn(0x7f35300f6cb0 msgr2=0x7f3530100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.335+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 shutdown_connections 2024-02-22T00:24:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:58.335+0000 7f352ffff700 1 -- 172.21.15.49:0/1464012296 wait complete. 2024-02-22T00:24:58.916 INFO:teuthology.orchestra.run.smithi049.stderr:Deploying alertmanager service with default placement... 2024-02-22T00:24:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.588+0000 7faff0070700 1 Processor -- start 2024-02-22T00:24:59.599 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.588+0000 7faff0070700 1 -- start start 2024-02-22T00:24:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.588+0000 7faff0070700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe81020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.588+0000 7faff0070700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80fdaa0 con 0x7fafe8071be0 2024-02-22T00:24:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.589+0000 7fafede0c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe81020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.589+0000 7fafede0c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe81020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54632/0 (socket says 172.21.15.49:54632) 2024-02-22T00:24:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.589+0000 7fafede0c700 1 -- 172.21.15.49:0/3683322983 learned_addr learned my addr 172.21.15.49:0/3683322983 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:59.600 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.589+0000 7fafede0c700 1 -- 172.21.15.49:0/3683322983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe81025a0 con 0x7fafe8071be0 2024-02-22T00:24:59.601 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.589+0000 7fafede0c700 1 --2- 172.21.15.49:0/3683322983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe81020b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fafd8009730 tx=0x7fafd80090f0).ready entity=mon.0 client_cookie=99ac412e91280c1d server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:59.601 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.589+0000 7fafece0a700 1 -- 172.21.15.49:0/3683322983 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafd800b6e0 con 0x7fafe8071be0 2024-02-22T00:24:59.601 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.589+0000 7fafece0a700 1 -- 172.21.15.49:0/3683322983 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fafd800bcd0 con 0x7fafe8071be0 2024-02-22T00:24:59.601 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.589+0000 7fafece0a700 1 -- 172.21.15.49:0/3683322983 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafd8011cb0 con 0x7fafe8071be0 2024-02-22T00:24:59.601 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.590+0000 7faff0070700 1 -- 172.21.15.49:0/3683322983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 msgr2=0x7fafe81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.590+0000 7faff0070700 1 --2- 172.21.15.49:0/3683322983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe81020b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fafd8009730 tx=0x7fafd80090f0).stop 2024-02-22T00:24:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.590+0000 7faff0070700 1 -- 172.21.15.49:0/3683322983 shutdown_connections 2024-02-22T00:24:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.590+0000 7faff0070700 1 --2- 172.21.15.49:0/3683322983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe81020b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.590+0000 7faff0070700 1 -- 172.21.15.49:0/3683322983 >> 172.21.15.49:0/3683322983 conn(0x7fafe80f76f0 msgr2=0x7fafe80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.590+0000 7faff0070700 1 -- 172.21.15.49:0/3683322983 shutdown_connections 2024-02-22T00:24:59.602 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.590+0000 7faff0070700 1 -- 172.21.15.49:0/3683322983 wait complete. 2024-02-22T00:24:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7faff0070700 1 Processor -- start 2024-02-22T00:24:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7faff0070700 1 -- start start 2024-02-22T00:24:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7faff0070700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe810dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7faff0070700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe810e4c0 con 0x7fafe8071be0 2024-02-22T00:24:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7fafede0c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe810dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:59.603 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7fafede0c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe810dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54642/0 (socket says 172.21.15.49:54642) 2024-02-22T00:24:59.604 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7fafede0c700 1 -- 172.21.15.49:0/2686119856 learned_addr learned my addr 172.21.15.49:0/2686119856 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:24:59.604 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7fafede0c700 1 -- 172.21.15.49:0/2686119856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009370 con 0x7fafe8071be0 2024-02-22T00:24:59.604 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7fafede0c700 1 --2- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe810dfd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fafd80118b0 tx=0x7fafd80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:59.604 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.591+0000 7fafdeffd700 1 -- 172.21.15.49:0/2686119856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafd800be40 con 0x7fafe8071be0 2024-02-22T00:24:59.605 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.592+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe810e6c0 con 0x7fafe8071be0 2024-02-22T00:24:59.605 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.592+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe810ead0 con 0x7fafe8071be0 2024-02-22T00:24:59.605 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.592+0000 7fafdeffd700 1 -- 172.21.15.49:0/2686119856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fafd801aad0 con 0x7fafe8071be0 2024-02-22T00:24:59.605 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.592+0000 7fafdeffd700 1 -- 172.21.15.49:0/2686119856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fafd8023a80 con 0x7fafe8071be0 2024-02-22T00:24:59.606 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.592+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc005120 con 0x7fafe8071be0 2024-02-22T00:24:59.606 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.593+0000 7fafdeffd700 1 -- 172.21.15.49:0/2686119856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fafd801ac40 con 0x7fafe8071be0 2024-02-22T00:24:59.606 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.593+0000 7fafdeffd700 1 --2- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fafd4032660 0x7fafd4034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:24:59.606 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.593+0000 7fafdeffd700 1 -- 172.21.15.49:0/2686119856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fafd8044c50 con 0x7fafe8071be0 2024-02-22T00:24:59.606 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.593+0000 7fafed60b700 1 --2- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fafd4032660 0x7fafd4034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:24:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.594+0000 7fafed60b700 1 --2- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fafd4032660 0x7fafd4034b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fafe4009780 tx=0x7fafe4006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:24:59.607 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.597+0000 7fafdeffd700 1 -- 172.21.15.49:0/2686119856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fafd8044e60 con 0x7fafe8071be0 2024-02-22T00:24:59.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:58.329803+0000 mgr.smithi049.rjblpr (mgr.14116) 21 : audit [DBG] from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:24:59.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:58.330667+0000 mgr.smithi049.rjblpr (mgr.14116) 22 : cephadm [INF] Saving service node-exporter spec with placement * 2024-02-22T00:24:59.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:24:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:58.332957+0000 mon.smithi049 (mon.0) 63 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:24:59.784 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.780+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fafcc000bc0 con 0x7fafd4032660 2024-02-22T00:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.783+0000 7fafdeffd700 1 -- 172.21.15.49:0/2686119856 <== mgr.14116 v2:172.21.15.49:6800/2503465771 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fafcc000bc0 con 0x7fafd4032660 2024-02-22T00:24:59.788 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2024-02-22T00:24:59.790 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fafd4032660 msgr2=0x7fafd4034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 --2- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fafd4032660 0x7fafd4034b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fafe4009780 tx=0x7fafe4006cc0).stop 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 msgr2=0x7fafe810dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 --2- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe810dfd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fafd80118b0 tx=0x7fafd80090f0).stop 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 shutdown_connections 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 --2- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fafd4032660 0x7fafd4034b20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 --2- 172.21.15.49:0/2686119856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafe8071be0 0x7fafe810dfd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 >> 172.21.15.49:0/2686119856 conn(0x7fafe80f76f0 msgr2=0x7fafe80f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 shutdown_connections 2024-02-22T00:24:59.791 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:24:59.785+0000 7faff0070700 1 -- 172.21.15.49:0/2686119856 wait complete. 2024-02-22T00:25:00.978 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.971+0000 7fc9848f2700 1 Processor -- start 2024-02-22T00:25:00.978 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.971+0000 7fc9848f2700 1 -- start start 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.972+0000 7fc9848f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc9800fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.972+0000 7fc9848f2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9800fc7e0 con 0x7fc9800fbed0 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.972+0000 7fc97e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc9800fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.972+0000 7fc97e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc9800fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54652/0 (socket says 172.21.15.49:54652) 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.972+0000 7fc97e59c700 1 -- 172.21.15.49:0/1076255673 learned_addr learned my addr 172.21.15.49:0/1076255673 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.972+0000 7fc97e59c700 1 -- 172.21.15.49:0/1076255673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9800fc920 con 0x7fc9800fbed0 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.972+0000 7fc97e59c700 1 --2- 172.21.15.49:0/1076255673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc9800fc2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc97400b9d0 tx=0x7fc97400b3b0).ready entity=mon.0 client_cookie=ea90f5ae7ba312af server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc97d59a700 1 -- 172.21.15.49:0/1076255673 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc97400dbd0 con 0x7fc9800fbed0 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc97d59a700 1 -- 172.21.15.49:0/1076255673 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc97400dd30 con 0x7fc9800fbed0 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc97d59a700 1 -- 172.21.15.49:0/1076255673 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc97400f6d0 con 0x7fc9800fbed0 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc9848f2700 1 -- 172.21.15.49:0/1076255673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 msgr2=0x7fc9800fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc9848f2700 1 --2- 172.21.15.49:0/1076255673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc9800fc2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fc97400b9d0 tx=0x7fc97400b3b0).stop 2024-02-22T00:25:00.979 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc9848f2700 1 -- 172.21.15.49:0/1076255673 shutdown_connections 2024-02-22T00:25:00.980 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc9848f2700 1 --2- 172.21.15.49:0/1076255673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc9800fc2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:00.980 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc9848f2700 1 -- 172.21.15.49:0/1076255673 >> 172.21.15.49:0/1076255673 conn(0x7fc9800f76f0 msgr2=0x7fc9800f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:00.980 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc9848f2700 1 -- 172.21.15.49:0/1076255673 shutdown_connections 2024-02-22T00:25:00.980 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.973+0000 7fc9848f2700 1 -- 172.21.15.49:0/1076255673 wait complete. 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.974+0000 7fc9848f2700 1 Processor -- start 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.974+0000 7fc9848f2700 1 -- start start 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc9848f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc980109b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc9848f2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98010a040 con 0x7fc9800fbed0 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc97e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc980109b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc97e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc980109b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54654/0 (socket says 172.21.15.49:54654) 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc97e59c700 1 -- 172.21.15.49:0/3781610096 learned_addr learned my addr 172.21.15.49:0/3781610096 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc97e59c700 1 -- 172.21.15.49:0/3781610096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97400b610 con 0x7fc9800fbed0 2024-02-22T00:25:00.983 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc97e59c700 1 --2- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc980109b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc974007010 tx=0x7fc97400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc96f7fe700 1 -- 172.21.15.49:0/3781610096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc974010680 con 0x7fc9800fbed0 2024-02-22T00:25:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc96f7fe700 1 -- 172.21.15.49:0/3781610096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc9740107e0 con 0x7fc9800fbed0 2024-02-22T00:25:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc9848f2700 1 -- 172.21.15.49:0/3781610096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98010a240 con 0x7fc9800fbed0 2024-02-22T00:25:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc96f7fe700 1 -- 172.21.15.49:0/3781610096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc974024420 con 0x7fc9800fbed0 2024-02-22T00:25:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.975+0000 7fc9848f2700 1 -- 172.21.15.49:0/3781610096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98010a650 con 0x7fc9800fbed0 2024-02-22T00:25:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.976+0000 7fc96f7fe700 1 -- 172.21.15.49:0/3781610096 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fc974024760 con 0x7fc9800fbed0 2024-02-22T00:25:00.984 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.976+0000 7fc96f7fe700 1 --2- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc9680325e0 0x7fc968034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:00.985 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.976+0000 7fc96f7fe700 1 -- 172.21.15.49:0/3781610096 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fc974047990 con 0x7fc9800fbed0 2024-02-22T00:25:00.985 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.976+0000 7fc97dd9b700 1 --2- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc9680325e0 0x7fc968034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:00.985 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.977+0000 7fc96d7fa700 1 -- 172.21.15.49:0/3781610096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc964005120 con 0x7fc9800fbed0 2024-02-22T00:25:00.985 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.977+0000 7fc97dd9b700 1 --2- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc9680325e0 0x7fc968034aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc970009780 tx=0x7fc970006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:00.987 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:00.981+0000 7fc96f7fe700 1 -- 172.21.15.49:0/3781610096 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc974014070 con 0x7fc9800fbed0 2024-02-22T00:25:01.156 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.151+0000 7fc96d7fa700 1 -- 172.21.15.49:0/3781610096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fc9640057f0 con 0x7fc9800fbed0 2024-02-22T00:25:01.159 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.154+0000 7fc96f7fe700 1 -- 172.21.15.49:0/3781610096 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc97402e440 con 0x7fc9800fbed0 2024-02-22T00:25:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 -- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc9680325e0 msgr2=0x7fc968034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 --2- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc9680325e0 0x7fc968034aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc970009780 tx=0x7fc970006cc0).stop 2024-02-22T00:25:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 -- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 msgr2=0x7fc980109b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 --2- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc980109b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc974007010 tx=0x7fc97400b3b0).stop 2024-02-22T00:25:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 -- 172.21.15.49:0/3781610096 shutdown_connections 2024-02-22T00:25:01.163 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 --2- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc9680325e0 0x7fc968034aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:01.164 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 --2- 172.21.15.49:0/3781610096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc9800fbed0 0x7fc980109b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:01.164 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 -- 172.21.15.49:0/3781610096 >> 172.21.15.49:0/3781610096 conn(0x7fc9800f76f0 msgr2=0x7fc980100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:01.164 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 -- 172.21.15.49:0/3781610096 shutdown_connections 2024-02-22T00:25:01.164 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:01.156+0000 7fc96d7fa700 1 -- 172.21.15.49:0/3781610096 wait complete. 2024-02-22T00:25:01.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:59.781776+0000 mgr.smithi049.rjblpr (mgr.14116) 23 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:25:01.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:24:59.782583+0000 mgr.smithi049.rjblpr (mgr.14116) 24 : cephadm [INF] Saving service alertmanager spec with placement count:1 2024-02-22T00:25:01.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:24:59.784673+0000 mon.smithi049 (mon.0) 64 : audit [INF] from='mgr.14116 172.21.15.49:0/841016773' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:01.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:00.051615+0000 mgr.smithi049.rjblpr (mgr.14116) 25 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.355+0000 7fc2d1144700 1 Processor -- start 2024-02-22T00:25:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.355+0000 7fc2d1144700 1 -- start start 2024-02-22T00:25:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.356+0000 7fc2d1144700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc0fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:02.362 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.356+0000 7fc2d1144700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0fc7e0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.356+0000 7fc2cad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc0fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.356+0000 7fc2cad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc0fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54938/0 (socket says 172.21.15.49:54938) 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.356+0000 7fc2cad9d700 1 -- 172.21.15.49:0/4170594898 learned_addr learned my addr 172.21.15.49:0/4170594898 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.356+0000 7fc2cad9d700 1 -- 172.21.15.49:0/4170594898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0fc920 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.356+0000 7fc2cad9d700 1 --2- 172.21.15.49:0/4170594898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc0fc2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc2bc009730 tx=0x7fc2bc0090f0).ready entity=mon.0 client_cookie=4ea2eb3a19780406 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.356+0000 7fc2c9d9b700 1 -- 172.21.15.49:0/4170594898 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2bc00b6e0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2c9d9b700 1 -- 172.21.15.49:0/4170594898 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc2bc00bcd0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2c9d9b700 1 -- 172.21.15.49:0/4170594898 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2bc011cb0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2d1144700 1 -- 172.21.15.49:0/4170594898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 msgr2=0x7fc2cc0fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2d1144700 1 --2- 172.21.15.49:0/4170594898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc0fc2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc2bc009730 tx=0x7fc2bc0090f0).stop 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2d1144700 1 -- 172.21.15.49:0/4170594898 shutdown_connections 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2d1144700 1 --2- 172.21.15.49:0/4170594898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc0fc2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2d1144700 1 -- 172.21.15.49:0/4170594898 >> 172.21.15.49:0/4170594898 conn(0x7fc2cc0f76f0 msgr2=0x7fc2cc0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:02.363 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2d1144700 1 -- 172.21.15.49:0/4170594898 shutdown_connections 2024-02-22T00:25:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.357+0000 7fc2d1144700 1 -- 172.21.15.49:0/4170594898 wait complete. 2024-02-22T00:25:02.364 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.358+0000 7fc2d1144700 1 Processor -- start 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.358+0000 7fc2d1144700 1 -- start start 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.358+0000 7fc2d1144700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.358+0000 7fc2d1144700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc10a0f0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.358+0000 7fc2cad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2cad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54952/0 (socket says 172.21.15.49:54952) 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2cad9d700 1 -- 172.21.15.49:0/2918461386 learned_addr learned my addr 172.21.15.49:0/2918461386 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2cad9d700 1 -- 172.21.15.49:0/2918461386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc009370 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2cad9d700 1 --2- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc109c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc2bc0118b0 tx=0x7fc2bc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2c3fff700 1 -- 172.21.15.49:0/2918461386 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2bc00be40 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc10a2f0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2c3fff700 1 -- 172.21.15.49:0/2918461386 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc2bc00bad0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2c3fff700 1 -- 172.21.15.49:0/2918461386 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc2bc01aaa0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.359+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc10a700 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.360+0000 7fc2c3fff700 1 -- 172.21.15.49:0/2918461386 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fc2bc01ad20 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.360+0000 7fc2c3fff700 1 --2- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc2b8034860 0x7fc2b8036d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.360+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc046ce0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.360+0000 7fc2c3fff700 1 -- 172.21.15.49:0/2918461386 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fc2bc044a50 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.360+0000 7fc2ca59c700 1 --2- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc2b8034860 0x7fc2b8036d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:02.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.361+0000 7fc2ca59c700 1 --2- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc2b8034860 0x7fc2b8036d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc2b4009780 tx=0x7fc2b4006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:02.369 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.365+0000 7fc2c3fff700 1 -- 172.21.15.49:0/2918461386 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc2bc01e070 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:01.155656+0000 mon.smithi049 (mon.0) 65 : audit [INF] from='client.? 172.21.15.49:0/3781610096' entity='client.admin' 2024-02-22T00:25:02.540 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.535+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fc2cc0fdc20 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.543 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.539+0000 7fc2c3fff700 1 -- 172.21.15.49:0/2918461386 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc2bc023cb0 con 0x7fc2cc0fbed0 2024-02-22T00:25:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc2b8034860 msgr2=0x7fc2b8036d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 --2- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc2b8034860 0x7fc2b8036d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc2b4009780 tx=0x7fc2b4006cc0).stop 2024-02-22T00:25:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 msgr2=0x7fc2cc109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:02.546 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 --2- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc109c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc2bc0118b0 tx=0x7fc2bc0090f0).stop 2024-02-22T00:25:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 shutdown_connections 2024-02-22T00:25:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 --2- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fc2b8034860 0x7fc2b8036d20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 --2- 172.21.15.49:0/2918461386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2cc0fbed0 0x7fc2cc109c00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 >> 172.21.15.49:0/2918461386 conn(0x7fc2cc0f76f0 msgr2=0x7fc2cc100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 shutdown_connections 2024-02-22T00:25:02.547 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:02.541+0000 7fc2d1144700 1 -- 172.21.15.49:0/2918461386 wait complete. 2024-02-22T00:25:03.189 INFO:teuthology.orchestra.run.smithi049.stderr:Enabling the dashboard module... 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.734+0000 7fa31745e700 1 Processor -- start 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.734+0000 7fa31745e700 1 -- start start 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.734+0000 7fa31745e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa3100fd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.734+0000 7fa31745e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100fd8f0 con 0x7fa3100fcfe0 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.734+0000 7fa3151fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa3100fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.734+0000 7fa3151fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa3100fd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54954/0 (socket says 172.21.15.49:54954) 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.734+0000 7fa3151fa700 1 -- 172.21.15.49:0/579964335 learned_addr learned my addr 172.21.15.49:0/579964335 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.735+0000 7fa3151fa700 1 -- 172.21.15.49:0/579964335 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3100fda30 con 0x7fa3100fcfe0 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.735+0000 7fa3151fa700 1 --2- 172.21.15.49:0/579964335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa3100fd400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa30c009730 tx=0x7fa30c0090f0).ready entity=mon.0 client_cookie=44e4887f5be9bef9 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.735+0000 7fa307fff700 1 -- 172.21.15.49:0/579964335 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa30c00b6e0 con 0x7fa3100fcfe0 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.735+0000 7fa307fff700 1 -- 172.21.15.49:0/579964335 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa30c00bcd0 con 0x7fa3100fcfe0 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.735+0000 7fa307fff700 1 -- 172.21.15.49:0/579964335 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa30c011cb0 con 0x7fa3100fcfe0 2024-02-22T00:25:03.741 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.735+0000 7fa31745e700 1 -- 172.21.15.49:0/579964335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 msgr2=0x7fa3100fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.735+0000 7fa31745e700 1 --2- 172.21.15.49:0/579964335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa3100fd400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa30c009730 tx=0x7fa30c0090f0).stop 2024-02-22T00:25:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.735+0000 7fa31745e700 1 -- 172.21.15.49:0/579964335 shutdown_connections 2024-02-22T00:25:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.736+0000 7fa31745e700 1 --2- 172.21.15.49:0/579964335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa3100fd400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.736+0000 7fa31745e700 1 -- 172.21.15.49:0/579964335 >> 172.21.15.49:0/579964335 conn(0x7fa3100f8820 msgr2=0x7fa3100fac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.736+0000 7fa31745e700 1 -- 172.21.15.49:0/579964335 shutdown_connections 2024-02-22T00:25:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.736+0000 7fa31745e700 1 -- 172.21.15.49:0/579964335 wait complete. 2024-02-22T00:25:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.736+0000 7fa31745e700 1 Processor -- start 2024-02-22T00:25:03.742 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.736+0000 7fa31745e700 1 -- start start 2024-02-22T00:25:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa31745e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa310072c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa31745e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa310071110 con 0x7fa3100fcfe0 2024-02-22T00:25:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa3151fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa310072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa3151fa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa310072c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54966/0 (socket says 172.21.15.49:54966) 2024-02-22T00:25:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa3151fa700 1 -- 172.21.15.49:0/3502177918 learned_addr learned my addr 172.21.15.49:0/3502177918 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:03.744 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa3151fa700 1 -- 172.21.15.49:0/3502177918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c009370 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa3151fa700 1 --2- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa310072c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa30c006b00 tx=0x7fa30c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa3067fc700 1 -- 172.21.15.49:0/3502177918 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa30c01a640 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa3067fc700 1 -- 172.21.15.49:0/3502177918 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa30c01ac30 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa3067fc700 1 -- 172.21.15.49:0/3502177918 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa30c023cb0 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa31745e700 1 -- 172.21.15.49:0/3502177918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3100712b0 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.737+0000 7fa31745e700 1 -- 172.21.15.49:0/3502177918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3100716c0 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.738+0000 7fa3067fc700 1 -- 172.21.15.49:0/3502177918 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fa30c023510 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.738+0000 7fa2fbfff700 1 -- 172.21.15.49:0/3502177918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f0005120 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.739+0000 7fa3067fc700 1 --2- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa2fc032660 0x7fa2fc034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.739+0000 7fa3067fc700 1 -- 172.21.15.49:0/3502177918 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fa30c0449c0 con 0x7fa3100fcfe0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.739+0000 7fa3149f9700 1 --2- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa2fc032660 0x7fa2fc034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:03.745 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.739+0000 7fa3149f9700 1 --2- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa2fc032660 0x7fa2fc034b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa300009780 tx=0x7fa300006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:03.747 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.743+0000 7fa3067fc700 1 -- 172.21.15.49:0/3502177918 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa30c019570 con 0x7fa3100fcfe0 2024-02-22T00:25:03.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:02.051963+0000 mgr.smithi049.rjblpr (mgr.14116) 26 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:03.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:02.539998+0000 mon.smithi049 (mon.0) 66 : audit [INF] from='client.? 172.21.15.49:0/2918461386' entity='client.admin' 2024-02-22T00:25:03.962 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:03.957+0000 7fa2fbfff700 1 -- 172.21.15.49:0/3502177918 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fa2f00057f0 con 0x7fa3100fcfe0 2024-02-22T00:25:04.546 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.541+0000 7fa3067fc700 1 -- 172.21.15.49:0/3502177918 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7fa30c02c440 con 0x7fa3100fcfe0 2024-02-22T00:25:04.547 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.543+0000 7fa3067fc700 1 -- 172.21.15.49:0/3502177918 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fa30c022700 con 0x7fa3100fcfe0 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.545+0000 7fa2fbfff700 1 -- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa2fc032660 msgr2=0x7fa2fc034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.545+0000 7fa2fbfff700 1 --2- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa2fc032660 0x7fa2fc034b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa300009780 tx=0x7fa300006cc0).stop 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.545+0000 7fa2fbfff700 1 -- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 msgr2=0x7fa310072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.545+0000 7fa2fbfff700 1 --2- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa310072c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa30c006b00 tx=0x7fa30c0090f0).stop 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.545+0000 7fa2fbfff700 1 -- 172.21.15.49:0/3502177918 shutdown_connections 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.545+0000 7fa2fbfff700 1 --2- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fa2fc032660 0x7fa2fc034b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.545+0000 7fa2fbfff700 1 --2- 172.21.15.49:0/3502177918 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3100fcfe0 0x7fa310072c90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.545+0000 7fa2fbfff700 1 -- 172.21.15.49:0/3502177918 >> 172.21.15.49:0/3502177918 conn(0x7fa3100f8820 msgr2=0x7fa3100fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:04.551 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.546+0000 7fa2fbfff700 1 -- 172.21.15.49:0/3502177918 shutdown_connections 2024-02-22T00:25:04.552 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:04.546+0000 7fa2fbfff700 1 -- 172.21.15.49:0/3502177918 wait complete. 2024-02-22T00:25:04.800 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:03.959053+0000 mon.smithi049 (mon.0) 67 : audit [INF] from='client.? 172.21.15.49:0/3502177918' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-22T00:25:05.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:04.544397+0000 mon.smithi049 (mon.0) 68 : audit [INF] from='client.? 172.21.15.49:0/3502177918' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-22T00:25:05.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:04.544468+0000 mon.smithi049 (mon.0) 69 : cluster [DBG] mgrmap e9: smithi049.rjblpr(active, since 24s) 2024-02-22T00:25:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.932+0000 7fb2f21ad700 1 Processor -- start 2024-02-22T00:25:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.932+0000 7fb2f21ad700 1 -- start start 2024-02-22T00:25:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.933+0000 7fb2f21ad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec0fba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.933+0000 7fb2f21ad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0fbf70 con 0x7fb2ec0fb660 2024-02-22T00:25:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.933+0000 7fb2eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec0fba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.933+0000 7fb2eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec0fba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54998/0 (socket says 172.21.15.49:54998) 2024-02-22T00:25:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.933+0000 7fb2eb7fe700 1 -- 172.21.15.49:0/4096735784 learned_addr learned my addr 172.21.15.49:0/4096735784 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.934+0000 7fb2eb7fe700 1 -- 172.21.15.49:0/4096735784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0fc0b0 con 0x7fb2ec0fb660 2024-02-22T00:25:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.934+0000 7fb2eb7fe700 1 --2- 172.21.15.49:0/4096735784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec0fba80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb2e0009730 tx=0x7fb2e00090f0).ready entity=mon.0 client_cookie=a2738b4b15b05881 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.935+0000 7fb2ea7fc700 1 -- 172.21.15.49:0/4096735784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e000c7f0 con 0x7fb2ec0fb660 2024-02-22T00:25:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.935+0000 7fb2ea7fc700 1 -- 172.21.15.49:0/4096735784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb2e000cde0 con 0x7fb2ec0fb660 2024-02-22T00:25:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.935+0000 7fb2ea7fc700 1 -- 172.21.15.49:0/4096735784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e0010e10 con 0x7fb2ec0fb660 2024-02-22T00:25:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.936+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4096735784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 msgr2=0x7fb2ec0fba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.936+0000 7fb2f21ad700 1 --2- 172.21.15.49:0/4096735784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec0fba80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb2e0009730 tx=0x7fb2e00090f0).stop 2024-02-22T00:25:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.936+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4096735784 shutdown_connections 2024-02-22T00:25:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.936+0000 7fb2f21ad700 1 --2- 172.21.15.49:0/4096735784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec0fba80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.936+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4096735784 >> 172.21.15.49:0/4096735784 conn(0x7fb2ec0f6e60 msgr2=0x7fb2ec0f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.936+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4096735784 shutdown_connections 2024-02-22T00:25:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.937+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4096735784 wait complete. 2024-02-22T00:25:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.938+0000 7fb2f21ad700 1 Processor -- start 2024-02-22T00:25:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.938+0000 7fb2f21ad700 1 -- start start 2024-02-22T00:25:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.938+0000 7fb2f21ad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec10b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:05.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.938+0000 7fb2f21ad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec109860 con 0x7fb2ec0fb660 2024-02-22T00:25:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.939+0000 7fb2eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec10b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.939+0000 7fb2eb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec10b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55010/0 (socket says 172.21.15.49:55010) 2024-02-22T00:25:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.939+0000 7fb2eb7fe700 1 -- 172.21.15.49:0/4187546267 learned_addr learned my addr 172.21.15.49:0/4187546267 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.939+0000 7fb2eb7fe700 1 -- 172.21.15.49:0/4187546267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0009370 con 0x7fb2ec0fb660 2024-02-22T00:25:05.944 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.939+0000 7fb2eb7fe700 1 --2- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec10b3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb2e0000c00 tx=0x7fb2e00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:05.945 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.940+0000 7fb2e8ff9700 1 -- 172.21.15.49:0/4187546267 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e0019630 con 0x7fb2ec0fb660 2024-02-22T00:25:05.945 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.940+0000 7fb2e8ff9700 1 -- 172.21.15.49:0/4187546267 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb2e001d070 con 0x7fb2ec0fb660 2024-02-22T00:25:05.945 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.940+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec109a00 con 0x7fb2ec0fb660 2024-02-22T00:25:05.945 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.940+0000 7fb2e8ff9700 1 -- 172.21.15.49:0/4187546267 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2e0018930 con 0x7fb2ec0fb660 2024-02-22T00:25:05.947 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.940+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec109e10 con 0x7fb2ec0fb660 2024-02-22T00:25:05.947 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.942+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d8005150 con 0x7fb2ec0fb660 2024-02-22T00:25:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.944+0000 7fb2e8ff9700 1 -- 172.21.15.49:0/4187546267 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7fb2e0018a90 con 0x7fb2ec0fb660 2024-02-22T00:25:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.944+0000 7fb2e8ff9700 1 --2- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fb2d40326b0 0x7fb2d4034b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.944+0000 7fb2e8ff9700 1 -- 172.21.15.49:0/4187546267 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fb2e00447e0 con 0x7fb2ec0fb660 2024-02-22T00:25:05.949 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.944+0000 7fb2eaffd700 1 -- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fb2d40326b0 msgr2=0x7fb2d4034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/2503465771 2024-02-22T00:25:05.950 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.944+0000 7fb2eaffd700 1 --2- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fb2d40326b0 0x7fb2d4034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-22T00:25:05.959 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:05.954+0000 7fb2e8ff9700 1 -- 172.21.15.49:0/4187546267 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb2e0019790 con 0x7fb2ec0fb660 2024-02-22T00:25:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.145+0000 7fb2eaffd700 1 -- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fb2d40326b0 msgr2=0x7fb2d4034b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/2503465771 2024-02-22T00:25:06.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.145+0000 7fb2eaffd700 1 --2- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fb2d40326b0 0x7fb2d4034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-22T00:25:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.192+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb2d8006030 con 0x7fb2ec0fb660 2024-02-22T00:25:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.192+0000 7fb2e8ff9700 1 -- 172.21.15.49:0/4187546267 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fb2e0014070 con 0x7fb2ec0fb660 2024-02-22T00:25:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: { 2024-02-22T00:25:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "epoch": 9, 2024-02-22T00:25:06.197 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "available": true, 2024-02-22T00:25:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "active_name": "smithi049.rjblpr", 2024-02-22T00:25:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "num_standby": 0 2024-02-22T00:25:06.198 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: } 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.194+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fb2d40326b0 msgr2=0x7fb2d4034b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.194+0000 7fb2f21ad700 1 --2- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fb2d40326b0 0x7fb2d4034b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.194+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 msgr2=0x7fb2ec10b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.194+0000 7fb2f21ad700 1 --2- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec10b3e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb2e0000c00 tx=0x7fb2e00090f0).stop 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.194+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 shutdown_connections 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.194+0000 7fb2f21ad700 1 --2- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7fb2d40326b0 0x7fb2d4034b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.194+0000 7fb2f21ad700 1 --2- 172.21.15.49:0/4187546267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2ec0fb660 0x7fb2ec10b3e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.194+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 >> 172.21.15.49:0/4187546267 conn(0x7fb2ec0f6e60 msgr2=0x7fb2ec0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.195+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 shutdown_connections 2024-02-22T00:25:06.200 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:06.195+0000 7fb2f21ad700 1 -- 172.21.15.49:0/4187546267 wait complete. 2024-02-22T00:25:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:06.193582+0000 mon.smithi049 (mon.0) 70 : audit [DBG] from='client.? 172.21.15.49:0/4187546267' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-22T00:25:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:Waiting for the mgr to restart... 2024-02-22T00:25:06.794 INFO:teuthology.orchestra.run.smithi049.stderr:Waiting for mgr epoch 9... 2024-02-22T00:25:07.356 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.348+0000 7f95fee63700 1 Processor -- start 2024-02-22T00:25:07.356 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.348+0000 7f95fee63700 1 -- start start 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.348+0000 7f95fee63700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.348+0000 7f95fee63700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80fc7e0 con 0x7f95f80fbed0 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.348+0000 7f95fcbff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.348+0000 7f95fcbff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55024/0 (socket says 172.21.15.49:55024) 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.348+0000 7f95fcbff700 1 -- 172.21.15.49:0/230945776 learned_addr learned my addr 172.21.15.49:0/230945776 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.348+0000 7f95fcbff700 1 -- 172.21.15.49:0/230945776 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80fc920 con 0x7f95f80fbed0 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.349+0000 7f95fcbff700 1 --2- 172.21.15.49:0/230945776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f80fc2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f95ec009730 tx=0x7f95ec0090f0).ready entity=mon.0 client_cookie=27d000b2727c373c server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.349+0000 7f95f77fe700 1 -- 172.21.15.49:0/230945776 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95ec00b6e0 con 0x7f95f80fbed0 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.349+0000 7f95f77fe700 1 -- 172.21.15.49:0/230945776 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f95ec00bcd0 con 0x7f95f80fbed0 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.349+0000 7f95f77fe700 1 -- 172.21.15.49:0/230945776 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95ec011cb0 con 0x7f95f80fbed0 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 -- 172.21.15.49:0/230945776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 msgr2=0x7f95f80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 --2- 172.21.15.49:0/230945776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f80fc2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f95ec009730 tx=0x7f95ec0090f0).stop 2024-02-22T00:25:07.357 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 -- 172.21.15.49:0/230945776 shutdown_connections 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 --2- 172.21.15.49:0/230945776 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f80fc2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 -- 172.21.15.49:0/230945776 >> 172.21.15.49:0/230945776 conn(0x7f95f80f76f0 msgr2=0x7f95f80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 -- 172.21.15.49:0/230945776 shutdown_connections 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 -- 172.21.15.49:0/230945776 wait complete. 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 Processor -- start 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.350+0000 7f95fee63700 1 -- start start 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95fee63700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f810ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95fee63700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f8071ce0 con 0x7f95f80fbed0 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95fcbff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f810ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95fcbff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f810ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55034/0 (socket says 172.21.15.49:55034) 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95fcbff700 1 -- 172.21.15.49:0/4236665972 learned_addr learned my addr 172.21.15.49:0/4236665972 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95fcbff700 1 -- 172.21.15.49:0/4236665972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009370 con 0x7f95f80fbed0 2024-02-22T00:25:07.358 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95fcbff700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f810ead0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f95ec002f40 tx=0x7f95ec0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:07.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95ec01a590 con 0x7f95f80fbed0 2024-02-22T00:25:07.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f8071ee0 con 0x7f95f80fbed0 2024-02-22T00:25:07.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f95ec01ab80 con 0x7f95f80fbed0 2024-02-22T00:25:07.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.351+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95ec022aa0 con 0x7f95f80fbed0 2024-02-22T00:25:07.359 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.352+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f810f180 con 0x7f95f80fbed0 2024-02-22T00:25:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.352+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f95ec019390 con 0x7f95f80fbed0 2024-02-22T00:25:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.353+0000 7f95f5ffb700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 0x7f95e8034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.353+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 --> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95f805a310 con 0x7f95e8032660 2024-02-22T00:25:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.353+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f95ec045ad0 con 0x7f95f80fbed0 2024-02-22T00:25:07.360 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.353+0000 7f95f7fff700 1 -- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 msgr2=0x7f95e8034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/2503465771 2024-02-22T00:25:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.353+0000 7f95f7fff700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 0x7f95e8034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-22T00:25:07.559 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.554+0000 7f95f7fff700 1 -- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 msgr2=0x7f95e8034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/2503465771 2024-02-22T00:25:07.559 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.554+0000 7f95f7fff700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 0x7f95e8034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-22T00:25:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.955+0000 7f95f7fff700 1 -- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 msgr2=0x7f95e8034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/2503465771 2024-02-22T00:25:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:07.955+0000 7f95f7fff700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 0x7f95e8034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-02-22T00:25:08.760 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:08.756+0000 7f95f7fff700 1 -- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 msgr2=0x7f95e8034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/2503465771 2024-02-22T00:25:08.761 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:08.756+0000 7f95f7fff700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 0x7f95e8034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-02-22T00:25:10.141 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:10.135+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mgrmap(e 10) v1 ==== 38469+0+0 (secure 0 0 0) 0x7f95ec019a60 con 0x7f95f80fbed0 2024-02-22T00:25:10.141 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:10.136+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 msgr2=0x7f95e8034b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-22T00:25:10.141 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:10.136+0000 7f95f5ffb700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 0x7f95e8034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:10.134984+0000 mon.smithi049 (mon.0) 71 : cluster [INF] Active manager daemon smithi049.rjblpr restarted 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:10.135213+0000 mon.smithi049 (mon.0) 72 : cluster [INF] Activating manager daemon smithi049.rjblpr 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:10.138078+0000 mon.smithi049 (mon.0) 73 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:10.138197+0000 mon.smithi049 (mon.0) 74 : cluster [DBG] mgrmap e10: smithi049.rjblpr(active, starting, since 0.00307316s) 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.139205+0000 mon.smithi049 (mon.0) 75 : audit [DBG] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.139813+0000 mon.smithi049 (mon.0) 76 : audit [DBG] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.140555+0000 mon.smithi049 (mon.0) 77 : audit [DBG] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.140792+0000 mon.smithi049 (mon.0) 78 : audit [DBG] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.141010+0000 mon.smithi049 (mon.0) 79 : audit [DBG] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:25:10.377 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:10.154810+0000 mon.smithi049 (mon.0) 80 : cluster [INF] Manager daemon smithi049.rjblpr is now available 2024-02-22T00:25:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.137+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 11) v1 ==== 38539+0+0 (secure 0 0 0) 0x7f95ec0151c0 con 0x7f95f80fbed0 2024-02-22T00:25:11.142 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.137+0000 7f95f5ffb700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f95e8035fb0 0x7f95e80383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:11.142 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.137+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 --> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95f805a310 con 0x7f95e8035fb0 2024-02-22T00:25:11.142 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.137+0000 7f95f7fff700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f95e8035fb0 0x7f95e80383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:11.143 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.139+0000 7f95f7fff700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f95e8035fb0 0x7f95e80383a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f95e4003850 tx=0x7f95e4006e60).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:11.143 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.139+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mgr.14156 v2:172.21.15.49:6800/3269480929 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f95f805a310 con 0x7f95e8035fb0 2024-02-22T00:25:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.145+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 --> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f95f8046ce0 con 0x7f95e8035fb0 2024-02-22T00:25:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.145+0000 7f95f5ffb700 1 -- 172.21.15.49:0/4236665972 <== mgr.14156 v2:172.21.15.49:6800/3269480929 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f95f8046ce0 con 0x7f95e8035fb0 2024-02-22T00:25:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: { 2024-02-22T00:25:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-02-22T00:25:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: "initialized": true 2024-02-22T00:25:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: } 2024-02-22T00:25:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.146+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f95e8035fb0 msgr2=0x7f95e80383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.146+0000 7f95fee63700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f95e8035fb0 0x7f95e80383a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f95e4003850 tx=0x7f95e4006e60).stop 2024-02-22T00:25:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.146+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 msgr2=0x7f95f810ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:11.151 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.146+0000 7f95fee63700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f810ead0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f95ec002f40 tx=0x7f95ec0090f0).stop 2024-02-22T00:25:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.147+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 shutdown_connections 2024-02-22T00:25:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.147+0000 7f95fee63700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f80fbed0 0x7f95f810ead0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.147+0000 7f95fee63700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f95e8035fb0 0x7f95e80383a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.147+0000 7f95fee63700 1 --2- 172.21.15.49:0/4236665972 >> [v2:172.21.15.49:6800/2503465771,v1:172.21.15.49:6801/2503465771] conn(0x7f95e8032660 0x7f95e8034b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:25:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.147+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 >> 172.21.15.49:0/4236665972 conn(0x7f95f80f76f0 msgr2=0x7f95f80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.147+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 shutdown_connections 2024-02-22T00:25:11.152 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:11.147+0000 7f95fee63700 1 -- 172.21.15.49:0/4236665972 wait complete. 2024-02-22T00:25:11.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.253813+0000 mon.smithi049 (mon.0) 81 : audit [DBG] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:25:11.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.255023+0000 mon.smithi049 (mon.0) 82 : audit [DBG] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:25:11.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.280950+0000 mon.smithi049 (mon.0) 83 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:25:11.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:10.285246+0000 mon.smithi049 (mon.0) 84 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:25:11.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:11.140451+0000 mon.smithi049 (mon.0) 85 : cluster [DBG] mgrmap e11: smithi049.rjblpr(active, since 1.00533s) 2024-02-22T00:25:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:mgr epoch 9 is available 2024-02-22T00:25:12.063 INFO:teuthology.orchestra.run.smithi049.stderr:Generating a dashboard self-signed certificate... 2024-02-22T00:25:12.592 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.586+0000 7fa8df0b1700 1 Processor -- start 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.586+0000 7fa8df0b1700 1 -- start start 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.586+0000 7fa8df0b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d8102090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.586+0000 7fa8df0b1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80fda80 con 0x7fa8d8071c00 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.586+0000 7fa8dce4d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d8102090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.586+0000 7fa8dce4d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d8102090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45038/0 (socket says 172.21.15.49:45038) 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.586+0000 7fa8dce4d700 1 -- 172.21.15.49:0/3039243344 learned_addr learned my addr 172.21.15.49:0/3039243344 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.587+0000 7fa8dce4d700 1 -- 172.21.15.49:0/3039243344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8102580 con 0x7fa8d8071c00 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.587+0000 7fa8dce4d700 1 --2- 172.21.15.49:0/3039243344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d8102090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa8cc009730 tx=0x7fa8cc0090f0).ready entity=mon.0 client_cookie=3f1ce4de0778c7db server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.587+0000 7fa8d77fe700 1 -- 172.21.15.49:0/3039243344 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8cc00b6e0 con 0x7fa8d8071c00 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.587+0000 7fa8d77fe700 1 -- 172.21.15.49:0/3039243344 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa8cc00bcd0 con 0x7fa8d8071c00 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.587+0000 7fa8d77fe700 1 -- 172.21.15.49:0/3039243344 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8cc011cb0 con 0x7fa8d8071c00 2024-02-22T00:25:12.593 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.588+0000 7fa8df0b1700 1 -- 172.21.15.49:0/3039243344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 msgr2=0x7fa8d8102090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:12.594 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.588+0000 7fa8df0b1700 1 --2- 172.21.15.49:0/3039243344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d8102090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa8cc009730 tx=0x7fa8cc0090f0).stop 2024-02-22T00:25:12.594 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.588+0000 7fa8df0b1700 1 -- 172.21.15.49:0/3039243344 shutdown_connections 2024-02-22T00:25:12.594 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.588+0000 7fa8df0b1700 1 --2- 172.21.15.49:0/3039243344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d8102090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:12.594 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.588+0000 7fa8df0b1700 1 -- 172.21.15.49:0/3039243344 >> 172.21.15.49:0/3039243344 conn(0x7fa8d80f76f0 msgr2=0x7fa8d80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:12.594 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.588+0000 7fa8df0b1700 1 -- 172.21.15.49:0/3039243344 shutdown_connections 2024-02-22T00:25:12.594 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.588+0000 7fa8df0b1700 1 -- 172.21.15.49:0/3039243344 wait complete. 2024-02-22T00:25:12.595 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.588+0000 7fa8df0b1700 1 Processor -- start 2024-02-22T00:25:12.595 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8df0b1700 1 -- start start 2024-02-22T00:25:12.595 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8df0b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d810e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:12.595 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8df0b1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d810e540 con 0x7fa8d8071c00 2024-02-22T00:25:12.595 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8dce4d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d810e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:12.595 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8dce4d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d810e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45050/0 (socket says 172.21.15.49:45050) 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8dce4d700 1 -- 172.21.15.49:0/742521422 learned_addr learned my addr 172.21.15.49:0/742521422 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8dce4d700 1 -- 172.21.15.49:0/742521422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc009370 con 0x7fa8d8071c00 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8dce4d700 1 --2- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d810e050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa8cc0118b0 tx=0x7fa8cc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.589+0000 7fa8d5ffb700 1 -- 172.21.15.49:0/742521422 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8cc00be40 con 0x7fa8d8071c00 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.590+0000 7fa8df0b1700 1 -- 172.21.15.49:0/742521422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d810e740 con 0x7fa8d8071c00 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.590+0000 7fa8d5ffb700 1 -- 172.21.15.49:0/742521422 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa8cc01aad0 con 0x7fa8d8071c00 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.590+0000 7fa8d5ffb700 1 -- 172.21.15.49:0/742521422 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa8cc0239e0 con 0x7fa8d8071c00 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.590+0000 7fa8df0b1700 1 -- 172.21.15.49:0/742521422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d810eb50 con 0x7fa8d8071c00 2024-02-22T00:25:12.596 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.591+0000 7fa8c37fe700 1 -- 172.21.15.49:0/742521422 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b8005120 con 0x7fa8d8071c00 2024-02-22T00:25:12.597 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.591+0000 7fa8d5ffb700 1 -- 172.21.15.49:0/742521422 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 11) v1 ==== 38539+0+0 (secure 0 0 0) 0x7fa8cc023ca0 con 0x7fa8d8071c00 2024-02-22T00:25:12.597 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.591+0000 7fa8d5ffb700 1 --2- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa8c8032520 0x7fa8c80349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:12.597 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.591+0000 7fa8d5ffb700 1 -- 172.21.15.49:0/742521422 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fa8cc044ac0 con 0x7fa8d8071c00 2024-02-22T00:25:12.597 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.592+0000 7fa8d7fff700 1 --2- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa8c8032520 0x7fa8c80349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:12.597 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.592+0000 7fa8d7fff700 1 --2- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa8c8032520 0x7fa8c80349e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa8c4009780 tx=0x7fa8c4006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:12.601 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.597+0000 7fa8d5ffb700 1 -- 172.21.15.49:0/742521422 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa8cc0292a0 con 0x7fa8d8071c00 2024-02-22T00:25:12.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:11.140274+0000 mgr.smithi049.rjblpr (mgr.14156) 1 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-22T00:25:12.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:11.146678+0000 mgr.smithi049.rjblpr (mgr.14156) 2 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-22T00:25:12.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:11.709324+0000 mon.smithi049 (mon.0) 86 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:12.715 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.708+0000 7fa8d5ffb700 1 -- 172.21.15.49:0/742521422 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 12) v1 ==== 38645+0+0 (secure 0 0 0) 0x7fa8cc01ac40 con 0x7fa8d8071c00 2024-02-22T00:25:12.787 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.782+0000 7fa8c37fe700 1 -- 172.21.15.49:0/742521422 --> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8b8000bc0 con 0x7fa8c8032520 2024-02-22T00:25:12.958 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.953+0000 7fa8d5ffb700 1 -- 172.21.15.49:0/742521422 <== mgr.14156 v2:172.21.15.49:6800/3269480929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fa8b8000bc0 con 0x7fa8c8032520 2024-02-22T00:25:12.958 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: Self-signed certificate created 2024-02-22T00:25:12.960 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 -- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa8c8032520 msgr2=0x7fa8c80349e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:12.960 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa8c8032520 0x7fa8c80349e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa8c4009780 tx=0x7fa8c4006cc0).stop 2024-02-22T00:25:12.960 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 -- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 msgr2=0x7fa8d810e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:12.961 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d810e050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa8cc0118b0 tx=0x7fa8cc0090f0).stop 2024-02-22T00:25:12.961 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 -- 172.21.15.49:0/742521422 shutdown_connections 2024-02-22T00:25:12.961 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa8c8032520 0x7fa8c80349e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:12.961 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 --2- 172.21.15.49:0/742521422 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa8d8071c00 0x7fa8d810e050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:12.961 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 -- 172.21.15.49:0/742521422 >> 172.21.15.49:0/742521422 conn(0x7fa8d80f76f0 msgr2=0x7fa8d80f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:12.961 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 -- 172.21.15.49:0/742521422 shutdown_connections 2024-02-22T00:25:12.961 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:12.955+0000 7fa8c37fe700 1 -- 172.21.15.49:0/742521422 wait complete. 2024-02-22T00:25:14.016 INFO:teuthology.orchestra.run.smithi049.stderr:Creating initial admin user... 2024-02-22T00:25:14.019 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:12.710871+0000 mon.smithi049 (mon.0) 87 : cluster [DBG] mgrmap e12: smithi049.rjblpr(active, since 2s) 2024-02-22T00:25:14.019 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:12.784036+0000 mgr.smithi049.rjblpr (mgr.14156) 3 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:25:14.019 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:12.952582+0000 mon.smithi049 (mon.0) 88 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:14.019 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:12.954291+0000 mon.smithi049 (mon.0) 89 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:14.940 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.901+0000 7f8bb9827700 1 Processor -- start 2024-02-22T00:25:14.940 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.901+0000 7f8bb9827700 1 -- start start 2024-02-22T00:25:14.940 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.901+0000 7f8bb9827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.901+0000 7f8bb9827700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40fef10 con 0x7f8bb40fe600 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.901+0000 7f8bb2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.901+0000 7f8bb2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45062/0 (socket says 172.21.15.49:45062) 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.901+0000 7f8bb2ffd700 1 -- 172.21.15.49:0/3358175301 learned_addr learned my addr 172.21.15.49:0/3358175301 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb2ffd700 1 -- 172.21.15.49:0/3358175301 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb40ff050 con 0x7f8bb40fe600 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb2ffd700 1 --2- 172.21.15.49:0/3358175301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fea20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f8ba4009730 tx=0x7f8ba40090f0).ready entity=mon.0 client_cookie=4b723f8cc58c9819 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb1ffb700 1 -- 172.21.15.49:0/3358175301 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ba400b6e0 con 0x7f8bb40fe600 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb1ffb700 1 -- 172.21.15.49:0/3358175301 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8ba400bcd0 con 0x7f8bb40fe600 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb1ffb700 1 -- 172.21.15.49:0/3358175301 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ba4011cb0 con 0x7f8bb40fe600 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb9827700 1 -- 172.21.15.49:0/3358175301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 msgr2=0x7f8bb40fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb9827700 1 --2- 172.21.15.49:0/3358175301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fea20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f8ba4009730 tx=0x7f8ba40090f0).stop 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb9827700 1 -- 172.21.15.49:0/3358175301 shutdown_connections 2024-02-22T00:25:14.941 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb9827700 1 --2- 172.21.15.49:0/3358175301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fea20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb9827700 1 -- 172.21.15.49:0/3358175301 >> 172.21.15.49:0/3358175301 conn(0x7f8bb40f6e20 msgr2=0x7f8bb40f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb9827700 1 -- 172.21.15.49:0/3358175301 shutdown_connections 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.902+0000 7f8bb9827700 1 -- 172.21.15.49:0/3358175301 wait complete. 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.903+0000 7f8bb9827700 1 Processor -- start 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.903+0000 7f8bb9827700 1 -- start start 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb9827700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb9827700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40fc350 con 0x7f8bb40fe600 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45066/0 (socket says 172.21.15.49:45066) 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb2ffd700 1 -- 172.21.15.49:0/1644705663 learned_addr learned my addr 172.21.15.49:0/1644705663 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb2ffd700 1 -- 172.21.15.49:0/1644705663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba4009370 con 0x7f8bb40fe600 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb2ffd700 1 --2- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fded0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f8ba4006b00 tx=0x7f8ba40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8b9bfff700 1 -- 172.21.15.49:0/1644705663 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ba401a640 con 0x7f8bb40fe600 2024-02-22T00:25:14.942 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8b9bfff700 1 -- 172.21.15.49:0/1644705663 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8ba401ac30 con 0x7f8bb40fe600 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb40fc4f0 con 0x7f8bb40fe600 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8b9bfff700 1 -- 172.21.15.49:0/1644705663 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ba4023cb0 con 0x7f8bb40fe600 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.904+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb40fc900 con 0x7f8bb40fe600 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.905+0000 7f8b9bfff700 1 -- 172.21.15.49:0/1644705663 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 12) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f8ba402c3f0 con 0x7f8bb40fe600 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.905+0000 7f8b9bfff700 1 --2- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f8b9c032660 0x7f8b9c034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.905+0000 7f8b9bfff700 1 -- 172.21.15.49:0/1644705663 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f8ba40450b0 con 0x7f8bb40fe600 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.905+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb4046ce0 con 0x7f8bb40fe600 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.906+0000 7f8bb27fc700 1 --2- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f8b9c032660 0x7f8b9c034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.906+0000 7f8bb27fc700 1 --2- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f8b9c032660 0x7f8b9c034b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8ba8009780 tx=0x7f8ba8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:14.943 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:14.910+0000 7f8b9bfff700 1 -- 172.21.15.49:0/1644705663 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8ba401a7a0 con 0x7f8bb40fe600 2024-02-22T00:25:15.103 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.098+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 --> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8bb405a130 con 0x7f8b9c032660 2024-02-22T00:25:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.359+0000 7f8b9bfff700 1 -- 172.21.15.49:0/1644705663 <== mgr.14156 v2:172.21.15.49:6800/3269480929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f8bb405a130 con 0x7f8b9c032660 2024-02-22T00:25:15.364 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$tPWChLm1VxyIDoxkLD6pD.c7LGJZqx2bYxvfKhPMLouLb.kwrENlu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708561515, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-22T00:25:15.366 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.361+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f8b9c032660 msgr2=0x7f8b9c034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.361+0000 7f8bb9827700 1 --2- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f8b9c032660 0x7f8b9c034b20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8ba8009780 tx=0x7f8ba8006cc0).stop 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.361+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 msgr2=0x7f8bb40fded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.361+0000 7f8bb9827700 1 --2- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fded0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f8ba4006b00 tx=0x7f8ba40090f0).stop 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.361+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 shutdown_connections 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.361+0000 7f8bb9827700 1 --2- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f8b9c032660 0x7f8b9c034b20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.361+0000 7f8bb9827700 1 --2- 172.21.15.49:0/1644705663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8bb40fe600 0x7f8bb40fded0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.361+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 >> 172.21.15.49:0/1644705663 conn(0x7f8bb40f6e20 msgr2=0x7f8bb40f8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.362+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 shutdown_connections 2024-02-22T00:25:15.367 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:15.362+0000 7f8bb9827700 1 -- 172.21.15.49:0/1644705663 wait complete. 2024-02-22T00:25:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:Fetching dashboard port number... 2024-02-22T00:25:16.648 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.639+0000 7f54ad24b700 1 Processor -- start 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.639+0000 7f54ad24b700 1 -- start start 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.639+0000 7f54ad24b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a80ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.639+0000 7f54ad24b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a8100120 con 0x7f54a8071c60 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.639+0000 7f54a6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a80ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.639+0000 7f54a6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a80ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45074/0 (socket says 172.21.15.49:45074) 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.639+0000 7f54a6d9d700 1 -- 172.21.15.49:0/2335515477 learned_addr learned my addr 172.21.15.49:0/2335515477 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54a6d9d700 1 -- 172.21.15.49:0/2335515477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8100260 con 0x7f54a8071c60 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54a6d9d700 1 --2- 172.21.15.49:0/2335515477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a80ffc30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5498009730 tx=0x7f54980090f0).ready entity=mon.0 client_cookie=e51f1d6ca710c405 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54a5d9b700 1 -- 172.21.15.49:0/2335515477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549800b6e0 con 0x7f54a8071c60 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54a5d9b700 1 -- 172.21.15.49:0/2335515477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f549800bcd0 con 0x7f54a8071c60 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54a5d9b700 1 -- 172.21.15.49:0/2335515477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5498011cb0 con 0x7f54a8071c60 2024-02-22T00:25:16.649 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54ad24b700 1 -- 172.21.15.49:0/2335515477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 msgr2=0x7f54a80ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54ad24b700 1 --2- 172.21.15.49:0/2335515477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a80ffc30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5498009730 tx=0x7f54980090f0).stop 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54ad24b700 1 -- 172.21.15.49:0/2335515477 shutdown_connections 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54ad24b700 1 --2- 172.21.15.49:0/2335515477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a80ffc30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54ad24b700 1 -- 172.21.15.49:0/2335515477 >> 172.21.15.49:0/2335515477 conn(0x7f54a80f76f0 msgr2=0x7f54a80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54ad24b700 1 -- 172.21.15.49:0/2335515477 shutdown_connections 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.640+0000 7f54ad24b700 1 -- 172.21.15.49:0/2335515477 wait complete. 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.641+0000 7f54ad24b700 1 Processor -- start 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.641+0000 7f54ad24b700 1 -- start start 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54ad24b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a810e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54ad24b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a810e500 con 0x7f54a8071c60 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54a6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a810e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54a6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a810e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45078/0 (socket says 172.21.15.49:45078) 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54a6d9d700 1 -- 172.21.15.49:0/4249571795 learned_addr learned my addr 172.21.15.49:0/4249571795 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:16.650 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54a6d9d700 1 -- 172.21.15.49:0/4249571795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498009370 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54a6d9d700 1 --2- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a810e010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f54980118b0 tx=0x7f54980090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f548ffff700 1 -- 172.21.15.49:0/4249571795 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f549800be40 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f548ffff700 1 -- 172.21.15.49:0/4249571795 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f549801aad0 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a810e700 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f548ffff700 1 -- 172.21.15.49:0/4249571795 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5498023a80 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.642+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a810eb10 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.643+0000 7f548ffff700 1 -- 172.21.15.49:0/4249571795 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f5498023c70 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.644+0000 7f548ffff700 1 --2- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f5490032750 0x7f5490034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.644+0000 7f548ffff700 1 -- 172.21.15.49:0/4249571795 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f5498044c10 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.644+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a8046ce0 con 0x7f54a8071c60 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.644+0000 7f54a659c700 1 --2- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f5490032750 0x7f5490034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:16.651 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.644+0000 7f54a659c700 1 --2- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f5490032750 0x7f5490034c10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f549c009780 tx=0x7f549c006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:16.652 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.648+0000 7f548ffff700 1 -- 172.21.15.49:0/4249571795 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f549801e080 con 0x7f54a8071c60 2024-02-22T00:25:16.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:15.100642+0000 mgr.smithi049.rjblpr (mgr.14156) 4 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:25:16.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:15.355107+0000 mon.smithi049 (mon.0) 90 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.819+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f54a8100f20 con 0x7f54a8071c60 2024-02-22T00:25:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.819+0000 7f548ffff700 1 -- 172.21.15.49:0/4249571795 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f5498021320 con 0x7f54a8071c60 2024-02-22T00:25:16.824 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 8443 2024-02-22T00:25:16.826 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f5490032750 msgr2=0x7f5490034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 --2- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f5490032750 0x7f5490034c10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f549c009780 tx=0x7f549c006cc0).stop 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 msgr2=0x7f54a810e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 --2- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a810e010 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f54980118b0 tx=0x7f54980090f0).stop 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 shutdown_connections 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 --2- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f5490032750 0x7f5490034c10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 --2- 172.21.15.49:0/4249571795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54a8071c60 0x7f54a810e010 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 >> 172.21.15.49:0/4249571795 conn(0x7f54a80f76f0 msgr2=0x7f54a80f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 shutdown_connections 2024-02-22T00:25:16.827 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:16.821+0000 7f54ad24b700 1 -- 172.21.15.49:0/4249571795 wait complete. 2024-02-22T00:25:17.521 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:16.358801+0000 mon.smithi049 (mon.0) 91 : cluster [DBG] mgrmap e13: smithi049.rjblpr(active, since 6s) 2024-02-22T00:25:17.521 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:16.820857+0000 mon.smithi049 (mon.0) 92 : audit [DBG] from='client.? 172.21.15.49:0/4249571795' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-22T00:25:17.527 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: disabled 2024-02-22T00:25:17.536 INFO:teuthology.orchestra.run.smithi049.stderr:systemctl: inactive 2024-02-22T00:25:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:firewalld.service is not enabled 2024-02-22T00:25:17.537 INFO:teuthology.orchestra.run.smithi049.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-22T00:25:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:Ceph Dashboard is now available at: 2024-02-22T00:25:17.540 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:17.540 INFO:teuthology.orchestra.run.smithi049.stderr: URL: https://smithi049.front.sepia.ceph.com:8443/ 2024-02-22T00:25:17.540 INFO:teuthology.orchestra.run.smithi049.stderr: User: admin 2024-02-22T00:25:17.540 INFO:teuthology.orchestra.run.smithi049.stderr: Password: 94kqf539za 2024-02-22T00:25:17.540 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:17.540 INFO:teuthology.orchestra.run.smithi049.stderr:Enabling autotune for osd_memory_target 2024-02-22T00:25:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.072+0000 7f748c6f9700 1 Processor -- start 2024-02-22T00:25:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.073+0000 7f748c6f9700 1 -- start start 2024-02-22T00:25:18.078 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.073+0000 7f748c6f9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.073+0000 7f748c6f9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7484100160 con 0x7f7484071c20 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.073+0000 7f748a495700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.073+0000 7f748a495700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45088/0 (socket says 172.21.15.49:45088) 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.073+0000 7f748a495700 1 -- 172.21.15.49:0/113790828 learned_addr learned my addr 172.21.15.49:0/113790828 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.073+0000 7f748a495700 1 -- 172.21.15.49:0/113790828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74841002a0 con 0x7f7484071c20 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f748a495700 1 --2- 172.21.15.49:0/113790828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840ffc70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7480009730 tx=0x7f74800090f0).ready entity=mon.0 client_cookie=396dc22444138a42 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f7489493700 1 -- 172.21.15.49:0/113790828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f748000b770 con 0x7f7484071c20 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f7489493700 1 -- 172.21.15.49:0/113790828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f748000bd60 con 0x7f7484071c20 2024-02-22T00:25:18.079 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f7489493700 1 -- 172.21.15.49:0/113790828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7480011d90 con 0x7f7484071c20 2024-02-22T00:25:18.082 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f748c6f9700 1 -- 172.21.15.49:0/113790828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 msgr2=0x7f74840ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:18.082 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f748c6f9700 1 --2- 172.21.15.49:0/113790828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840ffc70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7480009730 tx=0x7f74800090f0).stop 2024-02-22T00:25:18.082 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f748c6f9700 1 -- 172.21.15.49:0/113790828 shutdown_connections 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f748c6f9700 1 --2- 172.21.15.49:0/113790828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840ffc70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f748c6f9700 1 -- 172.21.15.49:0/113790828 >> 172.21.15.49:0/113790828 conn(0x7f74840f76f0 msgr2=0x7f74840f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f748c6f9700 1 -- 172.21.15.49:0/113790828 shutdown_connections 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.074+0000 7f748c6f9700 1 -- 172.21.15.49:0/113790828 wait complete. 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.075+0000 7f748c6f9700 1 Processor -- start 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.075+0000 7f748c6f9700 1 -- start start 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.075+0000 7f748c6f9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.075+0000 7f748c6f9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74840fbb70 con 0x7f7484071c20 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.075+0000 7f748a495700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.075+0000 7f748a495700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45090/0 (socket says 172.21.15.49:45090) 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.075+0000 7f748a495700 1 -- 172.21.15.49:0/3217304784 learned_addr learned my addr 172.21.15.49:0/3217304784 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.076+0000 7f748a495700 1 -- 172.21.15.49:0/3217304784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7480009370 con 0x7f7484071c20 2024-02-22T00:25:18.083 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.076+0000 7f748a495700 1 --2- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840fd6f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7480000c00 tx=0x7f74800090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.076+0000 7f74777fe700 1 -- 172.21.15.49:0/3217304784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f748001a7a0 con 0x7f7484071c20 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.076+0000 7f74777fe700 1 -- 172.21.15.49:0/3217304784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f748001ad90 con 0x7f7484071c20 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.076+0000 7f74777fe700 1 -- 172.21.15.49:0/3217304784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7480022cc0 con 0x7f7484071c20 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.076+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74840fbd10 con 0x7f7484071c20 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.076+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74840fc120 con 0x7f7484071c20 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.077+0000 7f74777fe700 1 -- 172.21.15.49:0/3217304784 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f7480022520 con 0x7f7484071c20 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.077+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7484046ce0 con 0x7f7484071c20 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.077+0000 7f74777fe700 1 --2- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f7470032750 0x7f7470034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.077+0000 7f74777fe700 1 -- 172.21.15.49:0/3217304784 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f7480044f10 con 0x7f7484071c20 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.077+0000 7f7489c94700 1 --2- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f7470032750 0x7f7470034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:18.084 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.078+0000 7f7489c94700 1 --2- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f7470032750 0x7f7470034c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f7478009780 tx=0x7f7478006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:18.086 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.082+0000 7f74777fe700 1 -- 172.21.15.49:0/3217304784 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7480018500 con 0x7f7484071c20 2024-02-22T00:25:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.253+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f7484100f60 con 0x7f7484071c20 2024-02-22T00:25:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.254+0000 7f74777fe700 1 -- 172.21.15.49:0/3217304784 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f7480018320 con 0x7f7484071c20 2024-02-22T00:25:18.261 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.255+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f7470032750 msgr2=0x7f7470034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:18.261 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.255+0000 7f748c6f9700 1 --2- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f7470032750 0x7f7470034c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f7478009780 tx=0x7f7478006cc0).stop 2024-02-22T00:25:18.261 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.255+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 msgr2=0x7f74840fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:18.261 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.255+0000 7f748c6f9700 1 --2- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840fd6f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f7480000c00 tx=0x7f74800090f0).stop 2024-02-22T00:25:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.256+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 shutdown_connections 2024-02-22T00:25:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.256+0000 7f748c6f9700 1 --2- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f7470032750 0x7f7470034c10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.256+0000 7f748c6f9700 1 --2- 172.21.15.49:0/3217304784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7484071c20 0x7f74840fd6f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.256+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 >> 172.21.15.49:0/3217304784 conn(0x7f74840f76f0 msgr2=0x7f74840f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.256+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 shutdown_connections 2024-02-22T00:25:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:18.256+0000 7f748c6f9700 1 -- 172.21.15.49:0/3217304784 wait complete. 2024-02-22T00:25:19.567 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffff11700 1 Processor -- start 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffff11700 1 -- start start 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffff11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff80fea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffff11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff80fef50 con 0x7feff80fe640 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffdcad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff80fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffdcad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff80fea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45096/0 (socket says 172.21.15.49:45096) 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffdcad700 1 -- 172.21.15.49:0/3633099706 learned_addr learned my addr 172.21.15.49:0/3633099706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffdcad700 1 -- 172.21.15.49:0/3633099706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80ff090 con 0x7feff80fe640 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.561+0000 7feffdcad700 1 --2- 172.21.15.49:0/3633099706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff80fea60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7feff4009730 tx=0x7feff40090f0).ready entity=mon.0 client_cookie=3421b61051e9cb0b server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffccab700 1 -- 172.21.15.49:0/3633099706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feff400b6e0 con 0x7feff80fe640 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffccab700 1 -- 172.21.15.49:0/3633099706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7feff400bcd0 con 0x7feff80fe640 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffccab700 1 -- 172.21.15.49:0/3633099706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feff4011cb0 con 0x7feff80fe640 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffff11700 1 -- 172.21.15.49:0/3633099706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 msgr2=0x7feff80fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:19.568 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffff11700 1 --2- 172.21.15.49:0/3633099706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff80fea60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7feff4009730 tx=0x7feff40090f0).stop 2024-02-22T00:25:19.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffff11700 1 -- 172.21.15.49:0/3633099706 shutdown_connections 2024-02-22T00:25:19.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffff11700 1 --2- 172.21.15.49:0/3633099706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff80fea60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:19.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffff11700 1 -- 172.21.15.49:0/3633099706 >> 172.21.15.49:0/3633099706 conn(0x7feff80f6e20 msgr2=0x7feff80f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:19.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffff11700 1 -- 172.21.15.49:0/3633099706 shutdown_connections 2024-02-22T00:25:19.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.562+0000 7feffff11700 1 -- 172.21.15.49:0/3633099706 wait complete. 2024-02-22T00:25:19.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.563+0000 7feffff11700 1 Processor -- start 2024-02-22T00:25:19.569 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.563+0000 7feffff11700 1 -- start start 2024-02-22T00:25:19.571 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.563+0000 7feffff11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff810be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:19.571 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.563+0000 7feffff11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff810c300 con 0x7feff80fe640 2024-02-22T00:25:19.571 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7feffdcad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff810be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:19.571 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7feffdcad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff810be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45098/0 (socket says 172.21.15.49:45098) 2024-02-22T00:25:19.571 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7feffdcad700 1 -- 172.21.15.49:0/1876831807 learned_addr learned my addr 172.21.15.49:0/1876831807 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:19.571 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7feffdcad700 1 -- 172.21.15.49:0/1876831807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff4009370 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7feffdcad700 1 --2- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff810be10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7feff4006b00 tx=0x7feff40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7fefeeffd700 1 -- 172.21.15.49:0/1876831807 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feff401a640 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7fefeeffd700 1 -- 172.21.15.49:0/1876831807 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7feff401ac30 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7fefeeffd700 1 -- 172.21.15.49:0/1876831807 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feff4023cb0 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff810c500 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.564+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff810c910 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.565+0000 7fefeeffd700 1 -- 172.21.15.49:0/1876831807 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7feff4023510 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.565+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff8046ce0 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.565+0000 7fefeeffd700 1 --2- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fefe4032700 0x7fefe4034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.565+0000 7fefeeffd700 1 -- 172.21.15.49:0/1876831807 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7feff4044fd0 con 0x7feff80fe640 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.566+0000 7feffd4ac700 1 --2- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fefe4032700 0x7fefe4034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:19.572 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.566+0000 7feffd4ac700 1 --2- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fefe4032700 0x7fefe4034bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fefe8009780 tx=0x7fefe8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:19.574 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.570+0000 7fefeeffd700 1 -- 172.21.15.49:0/1876831807 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7feff4019570 con 0x7feff80fe640 2024-02-22T00:25:19.840 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.835+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7feff80fb9f0 con 0x7feff80fe640 2024-02-22T00:25:19.842 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.838+0000 7fefeeffd700 1 -- 172.21.15.49:0/1876831807 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v29)=0 set mgr/dashboard/cluster/status v29) v1 ==== 153+0+0 (secure 0 0 0) 0x7feff401e020 con 0x7feff80fe640 2024-02-22T00:25:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fefe4032700 msgr2=0x7fefe4034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 --2- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fefe4032700 0x7fefe4034bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fefe8009780 tx=0x7fefe8006cc0).stop 2024-02-22T00:25:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 msgr2=0x7feff810be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 --2- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff810be10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7feff4006b00 tx=0x7feff40090f0).stop 2024-02-22T00:25:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 shutdown_connections 2024-02-22T00:25:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 --2- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fefe4032700 0x7fefe4034bc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 --2- 172.21.15.49:0/1876831807 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feff80fe640 0x7feff810be10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 >> 172.21.15.49:0/1876831807 conn(0x7feff80f6e20 msgr2=0x7feff81004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 shutdown_connections 2024-02-22T00:25:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: 2024-02-22T00:25:19.840+0000 7feffff11700 1 -- 172.21.15.49:0/1876831807 wait complete. 2024-02-22T00:25:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-02-22T00:25:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-22T00:25:20.567 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:20.567 INFO:teuthology.orchestra.run.smithi049.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-22T00:25:20.567 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:20.567 INFO:teuthology.orchestra.run.smithi049.stderr:Or, if you are only running a single cluster on this host: 2024-02-22T00:25:20.567 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:Please consider enabling telemetry to help improve Ceph: 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr: ceph telemetry on 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:For more information see: 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-02-22T00:25:20.568 INFO:teuthology.orchestra.run.smithi049.stderr:Bootstrap complete. 2024-02-22T00:25:20.611 INFO:tasks.cephadm:Fetching config... 2024-02-22T00:25:20.612 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:25:20.612 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-22T00:25:20.671 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-22T00:25:20.672 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:25:20.672 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-22T00:25:20.730 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-22T00:25:20.730 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:25:20.731 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/keyring of=/dev/stdout 2024-02-22T00:25:20.799 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-22T00:25:20.799 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:25:20.799 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-22T00:25:20.859 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-22T00:25:20.859 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqe9fRYT5tNm1RTjpUJ9/qmZnovHHMvHMjHg7u0dHDviCgciRPNq/Ki5gBfchImJqx7PcXVK4oRVF6478SuXFm27eOHd6/iRYFfFBU8QtpaJRMvNRQRr4ffsOkQjln5gpVxbPO55UbwI87t9ZLINya0gDULkHSBPSxzT5D4uVyZWuxGMhMr1MVIwQlmfJNvTmialkfx6q3VslBzXH2i7oTa8Q9Iuw1r6QjMgmS9piBVf81d00xiJGB/rZMP24okOx+8LjvK7zJDNy0rnFMbJ4cM/W8k9F3/OTTy24k8Te5Wm1YuBZ6X12uSk/e12CLcMG2LFtnf84HeybwEc7vlYzRG6j+1R7J8vs4vbRrY9G8Fw32lZ4CEcF1Dq0O4ZmzjKCkcWtUZ9+VpYty3gSDaiWxFCL8arbH3MFDvb+FvxgXGRU2BbnXRFGJKmmB1ahFyqMuUzdvhWwinoWPWle5vpbDK6M97MuDubDBVbYf46ci/Oq3Jj03Oj3mTSlEo4Xlh40= ceph-9923b37e-d118-11ee-95bd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-22T00:25:20.938 INFO:teuthology.orchestra.run.smithi049.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqe9fRYT5tNm1RTjpUJ9/qmZnovHHMvHMjHg7u0dHDviCgciRPNq/Ki5gBfchImJqx7PcXVK4oRVF6478SuXFm27eOHd6/iRYFfFBU8QtpaJRMvNRQRr4ffsOkQjln5gpVxbPO55UbwI87t9ZLINya0gDULkHSBPSxzT5D4uVyZWuxGMhMr1MVIwQlmfJNvTmialkfx6q3VslBzXH2i7oTa8Q9Iuw1r6QjMgmS9piBVf81d00xiJGB/rZMP24okOx+8LjvK7zJDNy0rnFMbJ4cM/W8k9F3/OTTy24k8Te5Wm1YuBZ6X12uSk/e12CLcMG2LFtnf84HeybwEc7vlYzRG6j+1R7J8vs4vbRrY9G8Fw32lZ4CEcF1Dq0O4ZmzjKCkcWtUZ9+VpYty3gSDaiWxFCL8arbH3MFDvb+FvxgXGRU2BbnXRFGJKmmB1ahFyqMuUzdvhWwinoWPWle5vpbDK6M97MuDubDBVbYf46ci/Oq3Jj03Oj3mTSlEo4Xlh40= ceph-9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:25:20.949 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqe9fRYT5tNm1RTjpUJ9/qmZnovHHMvHMjHg7u0dHDviCgciRPNq/Ki5gBfchImJqx7PcXVK4oRVF6478SuXFm27eOHd6/iRYFfFBU8QtpaJRMvNRQRr4ffsOkQjln5gpVxbPO55UbwI87t9ZLINya0gDULkHSBPSxzT5D4uVyZWuxGMhMr1MVIwQlmfJNvTmialkfx6q3VslBzXH2i7oTa8Q9Iuw1r6QjMgmS9piBVf81d00xiJGB/rZMP24okOx+8LjvK7zJDNy0rnFMbJ4cM/W8k9F3/OTTy24k8Te5Wm1YuBZ6X12uSk/e12CLcMG2LFtnf84HeybwEc7vlYzRG6j+1R7J8vs4vbRrY9G8Fw32lZ4CEcF1Dq0O4ZmzjKCkcWtUZ9+VpYty3gSDaiWxFCL8arbH3MFDvb+FvxgXGRU2BbnXRFGJKmmB1ahFyqMuUzdvhWwinoWPWle5vpbDK6M97MuDubDBVbYf46ci/Oq3Jj03Oj3mTSlEo4Xlh40= ceph-9923b37e-d118-11ee-95bd-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-22T00:25:20.995 INFO:teuthology.orchestra.run.smithi161.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqe9fRYT5tNm1RTjpUJ9/qmZnovHHMvHMjHg7u0dHDviCgciRPNq/Ki5gBfchImJqx7PcXVK4oRVF6478SuXFm27eOHd6/iRYFfFBU8QtpaJRMvNRQRr4ffsOkQjln5gpVxbPO55UbwI87t9ZLINya0gDULkHSBPSxzT5D4uVyZWuxGMhMr1MVIwQlmfJNvTmialkfx6q3VslBzXH2i7oTa8Q9Iuw1r6QjMgmS9piBVf81d00xiJGB/rZMP24okOx+8LjvK7zJDNy0rnFMbJ4cM/W8k9F3/OTTy24k8Te5Wm1YuBZ6X12uSk/e12CLcMG2LFtnf84HeybwEc7vlYzRG6j+1R7J8vs4vbRrY9G8Fw32lZ4CEcF1Dq0O4ZmzjKCkcWtUZ9+VpYty3gSDaiWxFCL8arbH3MFDvb+FvxgXGRU2BbnXRFGJKmmB1ahFyqMuUzdvhWwinoWPWle5vpbDK6M97MuDubDBVbYf46ci/Oq3Jj03Oj3mTSlEo4Xlh40= ceph-9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:25:21.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-22T00:25:21.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:19.839243+0000 mon.smithi049 (mon.0) 93 : audit [INF] from='client.? 172.21.15.49:0/1876831807' entity='client.admin' 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.735+0000 7f18298de700 1 -- 172.21.15.49:0/4007337640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 msgr2=0x7f18240fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.735+0000 7f18298de700 1 --2- 172.21.15.49:0/4007337640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 0x7f18240fa190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f1814004770 tx=0x7f1814009cb0).stop 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.735+0000 7f18298de700 1 -- 172.21.15.49:0/4007337640 shutdown_connections 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.735+0000 7f18298de700 1 --2- 172.21.15.49:0/4007337640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 0x7f18240fa190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.735+0000 7f18298de700 1 -- 172.21.15.49:0/4007337640 >> 172.21.15.49:0/4007337640 conn(0x7f18240f1c10 msgr2=0x7f18240f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.735+0000 7f18298de700 1 -- 172.21.15.49:0/4007337640 shutdown_connections 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.735+0000 7f18298de700 1 -- 172.21.15.49:0/4007337640 wait complete. 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.736+0000 7f18298de700 1 Processor -- start 2024-02-22T00:25:23.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.736+0000 7f18298de700 1 -- start start 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f18298de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 0x7f18241077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f18298de700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1824107cc0 con 0x7f18240611f0 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f1822ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 0x7f18241077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f1822ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 0x7f18241077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47778/0 (socket says 172.21.15.49:47778) 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f1822ffd700 1 -- 172.21.15.49:0/702757194 learned_addr learned my addr 172.21.15.49:0/702757194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f1822ffd700 1 -- 172.21.15.49:0/702757194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814005040 con 0x7f18240611f0 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f1822ffd700 1 --2- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 0x7f18241077d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1814004740 tx=0x7f1814009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f180bfff700 1 -- 172.21.15.49:0/702757194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1814018070 con 0x7f18240611f0 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f180bfff700 1 -- 172.21.15.49:0/702757194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1814013e30 con 0x7f18240611f0 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1824107ec0 con 0x7f18240611f0 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f180bfff700 1 -- 172.21.15.49:0/702757194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f181401d600 con 0x7f18240611f0 2024-02-22T00:25:23.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.737+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1824108350 con 0x7f18240611f0 2024-02-22T00:25:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.738+0000 7f180bfff700 1 -- 172.21.15.49:0/702757194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f181401d830 con 0x7f18240611f0 2024-02-22T00:25:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.739+0000 7f180bfff700 1 --2- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f180c032700 0x7f180c034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.739+0000 7f180bfff700 1 -- 172.21.15.49:0/702757194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f1814044690 con 0x7f18240611f0 2024-02-22T00:25:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.739+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1824046ce0 con 0x7f18240611f0 2024-02-22T00:25:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.739+0000 7f18227fc700 1 --2- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f180c032700 0x7f180c034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.739+0000 7f18227fc700 1 --2- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f180c032700 0x7f180c034bc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f1818009780 tx=0x7f1818006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:23.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.743+0000 7f180bfff700 1 -- 172.21.15.49:0/702757194 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f181401bb60 con 0x7f18240611f0 2024-02-22T00:25:23.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.918+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f18240fd090 con 0x7f18240611f0 2024-02-22T00:25:23.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.922+0000 7f180bfff700 1 -- 172.21.15.49:0/702757194 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f181401bb60 con 0x7f18240611f0 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f180c032700 msgr2=0x7f180c034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 --2- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f180c032700 0x7f180c034bc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f1818009780 tx=0x7f1818006cc0).stop 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 msgr2=0x7f18241077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 --2- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 0x7f18241077d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f1814004740 tx=0x7f1814009cb0).stop 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 shutdown_connections 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 --2- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f180c032700 0x7f180c034bc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 --2- 172.21.15.49:0/702757194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18240611f0 0x7f18241077d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 >> 172.21.15.49:0/702757194 conn(0x7f18240f1c10 msgr2=0x7f18240f25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 shutdown_connections 2024-02-22T00:25:23.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:23.925+0000 7f18298de700 1 -- 172.21.15.49:0/702757194 wait complete. 2024-02-22T00:25:24.639 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-22T00:25:24.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-22T00:25:24.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:23.759959+0000 mon.smithi049 (mon.0) 94 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:24.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:23.922016+0000 mon.smithi049 (mon.0) 95 : audit [INF] from='client.? 172.21.15.49:0/702757194' entity='client.admin' 2024-02-22T00:25:24.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:24.099819+0000 mon.smithi049 (mon.0) 96 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:25:24.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:24.103240+0000 mon.smithi049 (mon.0) 97 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:24.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:25:24.111792+0000 mgr.smithi049.rjblpr (mgr.14156) 5 : cephadm [INF] Deploying daemon alertmanager.smithi049 on smithi049 2024-02-22T00:25:26.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.785+0000 7f540e618700 1 -- 172.21.15.49:0/1975873314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 msgr2=0x7f54080fa1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:26.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.785+0000 7f540e618700 1 --2- 172.21.15.49:0/1975873314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 0x7f54080fa1c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f53f8004770 tx=0x7f53f8009cb0).stop 2024-02-22T00:25:26.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.785+0000 7f540e618700 1 -- 172.21.15.49:0/1975873314 shutdown_connections 2024-02-22T00:25:26.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.785+0000 7f540e618700 1 --2- 172.21.15.49:0/1975873314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 0x7f54080fa1c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:26.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.785+0000 7f540e618700 1 -- 172.21.15.49:0/1975873314 >> 172.21.15.49:0/1975873314 conn(0x7f54080f1c40 msgr2=0x7f54080f4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:26.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.786+0000 7f540e618700 1 -- 172.21.15.49:0/1975873314 shutdown_connections 2024-02-22T00:25:26.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.786+0000 7f540e618700 1 -- 172.21.15.49:0/1975873314 wait complete. 2024-02-22T00:25:26.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.786+0000 7f540e618700 1 Processor -- start 2024-02-22T00:25:26.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.786+0000 7f540e618700 1 -- start start 2024-02-22T00:25:26.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.786+0000 7f540e618700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 0x7f54081077e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:26.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.786+0000 7f540e618700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5408107cd0 con 0x7f54080612e0 2024-02-22T00:25:26.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.787+0000 7f5407fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 0x7f54081077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:26.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.787+0000 7f5407fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 0x7f54081077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47798/0 (socket says 172.21.15.49:47798) 2024-02-22T00:25:26.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.787+0000 7f5407fff700 1 -- 172.21.15.49:0/3811186679 learned_addr learned my addr 172.21.15.49:0/3811186679 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:26.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.787+0000 7f5407fff700 1 -- 172.21.15.49:0/3811186679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f8005040 con 0x7f54080612e0 2024-02-22T00:25:26.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.788+0000 7f5407fff700 1 --2- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 0x7f54081077e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f53f80099b0 tx=0x7f53f8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:26.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.788+0000 7f54057fa700 1 -- 172.21.15.49:0/3811186679 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53f8018070 con 0x7f54080612e0 2024-02-22T00:25:26.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.788+0000 7f54057fa700 1 -- 172.21.15.49:0/3811186679 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f53f8013730 con 0x7f54080612e0 2024-02-22T00:25:26.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.788+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5408107ed0 con 0x7f54080612e0 2024-02-22T00:25:26.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.788+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5408108360 con 0x7f54080612e0 2024-02-22T00:25:26.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.788+0000 7f54057fa700 1 -- 172.21.15.49:0/3811186679 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f53f801d440 con 0x7f54080612e0 2024-02-22T00:25:26.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.789+0000 7f54057fa700 1 -- 172.21.15.49:0/3811186679 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f53f801d5a0 con 0x7f54080612e0 2024-02-22T00:25:26.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.789+0000 7f54057fa700 1 --2- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f53f0032750 0x7f53f0034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:26.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.789+0000 7f54057fa700 1 -- 172.21.15.49:0/3811186679 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f53f8044710 con 0x7f54080612e0 2024-02-22T00:25:26.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.789+0000 7f54077fe700 1 --2- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f53f0032750 0x7f53f0034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:26.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.789+0000 7f54077fe700 1 --2- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f53f0032750 0x7f53f0034c10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f53fc009780 tx=0x7f53fc006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:26.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.791+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f4005120 con 0x7f54080612e0 2024-02-22T00:25:26.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.795+0000 7f54057fa700 1 -- 172.21.15.49:0/3811186679 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f53f801d990 con 0x7f54080612e0 2024-02-22T00:25:26.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.977+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 --> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f53f4002a80 con 0x7f53f0032750 2024-02-22T00:25:26.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.980+0000 7f54057fa700 1 -- 172.21.15.49:0/3811186679 <== mgr.14156 v2:172.21.15.49:6800/3269480929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f53f4002a80 con 0x7f53f0032750 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f53f0032750 msgr2=0x7f53f0034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 --2- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f53f0032750 0x7f53f0034c10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f53fc009780 tx=0x7f53fc006cc0).stop 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 msgr2=0x7f54081077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 --2- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 0x7f54081077e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f53f80099b0 tx=0x7f53f8009cb0).stop 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 shutdown_connections 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 --2- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f53f0032750 0x7f53f0034c10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 --2- 172.21.15.49:0/3811186679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54080612e0 0x7f54081077e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 >> 172.21.15.49:0/3811186679 conn(0x7f54080f1c40 msgr2=0x7f54080f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 shutdown_connections 2024-02-22T00:25:26.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:26.982+0000 7f540e618700 1 -- 172.21.15.49:0/3811186679 wait complete. 2024-02-22T00:25:27.475 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi161 2024-02-22T00:25:27.475 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:25:27.475 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.conf 2024-02-22T00:25:27.497 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:25:27.497 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:25:27.558 INFO:tasks.cephadm:Adding host smithi161 to orchestrator... 2024-02-22T00:25:27.558 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch host add smithi161 2024-02-22T00:25:28.252 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:26.977896+0000 mgr.smithi049.rjblpr (mgr.14156) 6 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:25:28.252 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:26.980266+0000 mon.smithi049 (mon.0) 98 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:30.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.682+0000 7f72efad8700 1 -- 172.21.15.49:0/52777266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 msgr2=0x7f72e80f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:30.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.682+0000 7f72efad8700 1 --2- 172.21.15.49:0/52777266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 0x7f72e80f79e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f72dc004770 tx=0x7f72dc009cb0).stop 2024-02-22T00:25:30.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.682+0000 7f72efad8700 1 -- 172.21.15.49:0/52777266 shutdown_connections 2024-02-22T00:25:30.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.682+0000 7f72efad8700 1 --2- 172.21.15.49:0/52777266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 0x7f72e80f79e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:30.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.682+0000 7f72efad8700 1 -- 172.21.15.49:0/52777266 >> 172.21.15.49:0/52777266 conn(0x7f72e80f2d40 msgr2=0x7f72e80f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.682+0000 7f72efad8700 1 -- 172.21.15.49:0/52777266 shutdown_connections 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.682+0000 7f72efad8700 1 -- 172.21.15.49:0/52777266 wait complete. 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.683+0000 7f72efad8700 1 Processor -- start 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.683+0000 7f72efad8700 1 -- start start 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.683+0000 7f72efad8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 0x7f72e8107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.683+0000 7f72efad8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8107d30 con 0x7f72e80f75c0 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.683+0000 7f72ed874700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 0x7f72e8107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.683+0000 7f72ed874700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 0x7f72e8107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47818/0 (socket says 172.21.15.49:47818) 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.683+0000 7f72ed874700 1 -- 172.21.15.49:0/3321880269 learned_addr learned my addr 172.21.15.49:0/3321880269 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.684+0000 7f72ed874700 1 -- 172.21.15.49:0/3321880269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc005040 con 0x7f72e80f75c0 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.684+0000 7f72ed874700 1 --2- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 0x7f72e8107840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f72dc0099b0 tx=0x7f72dc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.684+0000 7f72daf78700 1 -- 172.21.15.49:0/3321880269 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72dc018070 con 0x7f72e80f75c0 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.684+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e8107f30 con 0x7f72e80f75c0 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.684+0000 7f72daf78700 1 -- 172.21.15.49:0/3321880269 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f72dc013730 con 0x7f72e80f75c0 2024-02-22T00:25:30.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.684+0000 7f72daf78700 1 -- 172.21.15.49:0/3321880269 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72dc01d460 con 0x7f72e80f75c0 2024-02-22T00:25:30.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.684+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e81083c0 con 0x7f72e80f75c0 2024-02-22T00:25:30.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.685+0000 7f72daf78700 1 -- 172.21.15.49:0/3321880269 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f72dc0125d0 con 0x7f72e80f75c0 2024-02-22T00:25:30.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.685+0000 7f72daf78700 1 --2- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f72d40326d0 0x7f72d4034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:30.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.685+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e8046ce0 con 0x7f72e80f75c0 2024-02-22T00:25:30.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.685+0000 7f72daf78700 1 -- 172.21.15.49:0/3321880269 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f72dc043fc0 con 0x7f72e80f75c0 2024-02-22T00:25:30.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.685+0000 7f72ed073700 1 --2- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f72d40326d0 0x7f72d4034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:30.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.685+0000 7f72ed073700 1 --2- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f72d40326d0 0x7f72d4034b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f72e4009780 tx=0x7f72e4006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:30.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.689+0000 7f72daf78700 1 -- 172.21.15.49:0/3321880269 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f72dc0128d0 con 0x7f72e80f75c0 2024-02-22T00:25:30.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:30.868+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 --> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}) v1 -- 0x7f72e8109470 con 0x7f72d40326d0 2024-02-22T00:25:31.452 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:30.141842+0000 mgr.smithi049.rjblpr (mgr.14156) 7 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:31.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.530+0000 7f72daf78700 1 -- 172.21.15.49:0/3321880269 <== mgr.14156 v2:172.21.15.49:6800/3269480929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f72e8109470 con 0x7f72d40326d0 2024-02-22T00:25:31.535 INFO:teuthology.orchestra.run.smithi049.stdout:Added host 'smithi161' with addr '172.21.15.161' 2024-02-22T00:25:31.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f72d40326d0 msgr2=0x7f72d4034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 --2- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f72d40326d0 0x7f72d4034b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f72e4009780 tx=0x7f72e4006cc0).stop 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 msgr2=0x7f72e8107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 --2- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 0x7f72e8107840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f72dc0099b0 tx=0x7f72dc009cb0).stop 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 shutdown_connections 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 --2- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f72d40326d0 0x7f72d4034b90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 --2- 172.21.15.49:0/3321880269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f72e80f75c0 0x7f72e8107840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 >> 172.21.15.49:0/3321880269 conn(0x7f72e80f2d40 msgr2=0x7f72e80f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 shutdown_connections 2024-02-22T00:25:31.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:31.532+0000 7f72efad8700 1 -- 172.21.15.49:0/3321880269 wait complete. 2024-02-22T00:25:32.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:30.870394+0000 mgr.smithi049.rjblpr (mgr.14156) 8 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:25:32.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:31.531081+0000 mon.smithi049 (mon.0) 99 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:32.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:25:31.531395+0000 mgr.smithi049.rjblpr (mgr.14156) 9 : cephadm [INF] Added host smithi161 2024-02-22T00:25:33.337 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch host ls --format=json 2024-02-22T00:25:33.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:32.142148+0000 mgr.smithi049.rjblpr (mgr.14156) 10 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:35.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:34.142582+0000 mgr.smithi049.rjblpr (mgr.14156) 11 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.701+0000 7f935610d700 1 -- 172.21.15.49:0/3340774163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 msgr2=0x7f93500fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.701+0000 7f935610d700 1 --2- 172.21.15.49:0/3340774163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 0x7f93500fa190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9340004770 tx=0x7f9340009cb0).stop 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.701+0000 7f935610d700 1 -- 172.21.15.49:0/3340774163 shutdown_connections 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.701+0000 7f935610d700 1 --2- 172.21.15.49:0/3340774163 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 0x7f93500fa190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.701+0000 7f935610d700 1 -- 172.21.15.49:0/3340774163 >> 172.21.15.49:0/3340774163 conn(0x7f93500f1c10 msgr2=0x7f93500f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.701+0000 7f935610d700 1 -- 172.21.15.49:0/3340774163 shutdown_connections 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.701+0000 7f935610d700 1 -- 172.21.15.49:0/3340774163 wait complete. 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.701+0000 7f935610d700 1 Processor -- start 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f935610d700 1 -- start start 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f935610d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 0x7f93501077a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f935610d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350107c90 con 0x7f93500611f0 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 0x7f93501077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 0x7f93501077a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33308/0 (socket says 172.21.15.49:33308) 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f934f7fe700 1 -- 172.21.15.49:0/3752069670 learned_addr learned my addr 172.21.15.49:0/3752069670 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f934f7fe700 1 -- 172.21.15.49:0/3752069670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340005040 con 0x7f93500611f0 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f934f7fe700 1 --2- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 0x7f93501077a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f9340004740 tx=0x7f9340009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f934cff9700 1 -- 172.21.15.49:0/3752069670 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9340018070 con 0x7f93500611f0 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f934cff9700 1 -- 172.21.15.49:0/3752069670 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9340013e30 con 0x7f93500611f0 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9350107e90 con 0x7f93500611f0 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.702+0000 7f934cff9700 1 -- 172.21.15.49:0/3752069670 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f934001d600 con 0x7f93500611f0 2024-02-22T00:25:36.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.703+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9350108320 con 0x7f93500611f0 2024-02-22T00:25:36.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.703+0000 7f934cff9700 1 -- 172.21.15.49:0/3752069670 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f93400125d0 con 0x7f93500611f0 2024-02-22T00:25:36.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.703+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9350046ce0 con 0x7f93500611f0 2024-02-22T00:25:36.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.704+0000 7f934cff9700 1 --2- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9338032700 0x7f9338034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:36.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.704+0000 7f934cff9700 1 -- 172.21.15.49:0/3752069670 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f9340044600 con 0x7f93500611f0 2024-02-22T00:25:36.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.704+0000 7f934effd700 1 --2- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9338032700 0x7f9338034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:36.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.704+0000 7f934effd700 1 --2- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9338032700 0x7f9338034bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9344009780 tx=0x7f9344006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:36.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.708+0000 7f934cff9700 1 -- 172.21.15.49:0/3752069670 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9340024300 con 0x7f93500611f0 2024-02-22T00:25:36.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.902+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 --> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93500f2ce0 con 0x7f9338032700 2024-02-22T00:25:36.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.904+0000 7f934cff9700 1 -- 172.21.15.49:0/3752069670 <== mgr.14156 v2:172.21.15.49:6800/3269480929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f93500f2ce0 con 0x7f9338032700 2024-02-22T00:25:36.908 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:25:36.908 INFO:teuthology.orchestra.run.smithi049.stdout:[{"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.161", "hostname": "smithi161", "labels": [], "status": ""}] 2024-02-22T00:25:36.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.905+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9338032700 msgr2=0x7f9338034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:36.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.905+0000 7f935610d700 1 --2- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9338032700 0x7f9338034bc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9344009780 tx=0x7f9344006cc0).stop 2024-02-22T00:25:36.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.906+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 msgr2=0x7f93501077a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:36.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.906+0000 7f935610d700 1 --2- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 0x7f93501077a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f9340004740 tx=0x7f9340009cb0).stop 2024-02-22T00:25:36.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.906+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 shutdown_connections 2024-02-22T00:25:36.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.906+0000 7f935610d700 1 --2- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9338032700 0x7f9338034bc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:36.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.906+0000 7f935610d700 1 --2- 172.21.15.49:0/3752069670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93500611f0 0x7f93501077a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:36.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.906+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 >> 172.21.15.49:0/3752069670 conn(0x7f93500f1c10 msgr2=0x7f93500f25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:36.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.906+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 shutdown_connections 2024-02-22T00:25:36.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:36.906+0000 7f935610d700 1 -- 172.21.15.49:0/3752069670 wait complete. 2024-02-22T00:25:37.627 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-22T00:25:37.628 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd crush tunables default 2024-02-22T00:25:37.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:36.143083+0000 mgr.smithi049.rjblpr (mgr.14156) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:37.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:36.539042+0000 mon.smithi049 (mon.0) 100 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:37.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:36.540835+0000 mon.smithi049 (mon.0) 101 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:25:37.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:36.542378+0000 mon.smithi049 (mon.0) 102 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-22T00:25:37.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:36.542966+0000 mon.smithi049 (mon.0) 103 : audit [DBG] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:25:37.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:25:36.543493+0000 mgr.smithi049.rjblpr (mgr.14156) 13 : cephadm [INF] Deploying daemon crash.smithi049 on smithi049 2024-02-22T00:25:38.596 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:36.904734+0000 mgr.smithi049.rjblpr (mgr.14156) 14 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T00:25:39.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:38.143444+0000 mgr.smithi049.rjblpr (mgr.14156) 15 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:39.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:39.425993+0000 mon.smithi049 (mon.0) 104 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:40.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.285+0000 7f054e658700 1 -- 172.21.15.49:0/2368783623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 msgr2=0x7f05480f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:40.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.285+0000 7f054e658700 1 --2- 172.21.15.49:0/2368783623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 0x7f05480f68d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0538004770 tx=0x7f0538009cb0).stop 2024-02-22T00:25:40.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.285+0000 7f054e658700 1 -- 172.21.15.49:0/2368783623 shutdown_connections 2024-02-22T00:25:40.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.285+0000 7f054e658700 1 --2- 172.21.15.49:0/2368783623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 0x7f05480f68d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:40.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.285+0000 7f054e658700 1 -- 172.21.15.49:0/2368783623 >> 172.21.15.49:0/2368783623 conn(0x7f05480f1c10 msgr2=0x7f05480f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:40.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.285+0000 7f054e658700 1 -- 172.21.15.49:0/2368783623 shutdown_connections 2024-02-22T00:25:40.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.285+0000 7f054e658700 1 -- 172.21.15.49:0/2368783623 wait complete. 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.286+0000 7f054e658700 1 Processor -- start 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.286+0000 7f054e658700 1 -- start start 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f054e658700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 0x7f0548106720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f054e658700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548106c10 con 0x7f05480f64b0 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f0547fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 0x7f0548106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f0547fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 0x7f0548106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33328/0 (socket says 172.21.15.49:33328) 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f0547fff700 1 -- 172.21.15.49:0/1336573515 learned_addr learned my addr 172.21.15.49:0/1336573515 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f0547fff700 1 -- 172.21.15.49:0/1336573515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538005040 con 0x7f05480f64b0 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f0547fff700 1 --2- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 0x7f0548106720 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f05380099b0 tx=0x7f0538009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f05457fa700 1 -- 172.21.15.49:0/1336573515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0538018070 con 0x7f05480f64b0 2024-02-22T00:25:40.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f05457fa700 1 -- 172.21.15.49:0/1336573515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0538013730 con 0x7f05480f64b0 2024-02-22T00:25:40.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0548106e10 con 0x7f05480f64b0 2024-02-22T00:25:40.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f05457fa700 1 -- 172.21.15.49:0/1336573515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f053801d460 con 0x7f05480f64b0 2024-02-22T00:25:40.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.287+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05481072a0 con 0x7f05480f64b0 2024-02-22T00:25:40.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.288+0000 7f05457fa700 1 -- 172.21.15.49:0/1336573515 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f053801d690 con 0x7f05480f64b0 2024-02-22T00:25:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.288+0000 7f05457fa700 1 --2- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f0534032730 0x7f0534034bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.288+0000 7f05457fa700 1 -- 172.21.15.49:0/1336573515 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f05380441f0 con 0x7f05480f64b0 2024-02-22T00:25:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.288+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0548046ce0 con 0x7f05480f64b0 2024-02-22T00:25:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.289+0000 7f05477fe700 1 --2- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f0534032730 0x7f0534034bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:40.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.289+0000 7f05477fe700 1 --2- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f0534032730 0x7f0534034bf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0530009780 tx=0x7f0530006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.293+0000 7f05457fa700 1 -- 172.21.15.49:0/1336573515 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f053801ab40 con 0x7f05480f64b0 2024-02-22T00:25:40.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:40.483+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f05481080a0 con 0x7f05480f64b0 2024-02-22T00:25:40.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:39.566857+0000 mon.smithi049 (mon.0) 105 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:40.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:39.568669+0000 mon.smithi049 (mon.0) 106 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:40.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:39.570081+0000 mon.smithi049 (mon.0) 107 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-22T00:25:40.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:39.570432+0000 mgr.smithi049.rjblpr (mgr.14156) 16 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-22T00:25:40.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:39.573050+0000 mon.smithi049 (mon.0) 108 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:40.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:25:39.580983+0000 mgr.smithi049.rjblpr (mgr.14156) 17 : cephadm [INF] Deploying daemon grafana.smithi049 on smithi049 2024-02-22T00:25:40.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:40.281706+0000 mon.smithi049 (mon.0) 109 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:40.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:40.484987+0000 mon.smithi049 (mon.0) 110 : audit [INF] from='client.? 172.21.15.49:0/1336573515' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-22T00:25:41.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.282+0000 7f05457fa700 1 -- 172.21.15.49:0/1336573515 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f053801be60 con 0x7f05480f64b0 2024-02-22T00:25:41.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f0534032730 msgr2=0x7f0534034bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:41.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 --2- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f0534032730 0x7f0534034bf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0530009780 tx=0x7f0530006cc0).stop 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 msgr2=0x7f0548106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 --2- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 0x7f0548106720 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f05380099b0 tx=0x7f0538009cb0).stop 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 shutdown_connections 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 --2- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f0534032730 0x7f0534034bf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 --2- 172.21.15.49:0/1336573515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05480f64b0 0x7f0548106720 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 >> 172.21.15.49:0/1336573515 conn(0x7f05480f1c10 msgr2=0x7f05480f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 shutdown_connections 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:25:41.284+0000 7f054e658700 1 -- 172.21.15.49:0/1336573515 wait complete. 2024-02-22T00:25:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-02-22T00:25:41.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:40.143777+0000 mgr.smithi049.rjblpr (mgr.14156) 18 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:41.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:41.283093+0000 mon.smithi049 (mon.0) 111 : audit [INF] from='client.? 172.21.15.49:0/1336573515' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-22T00:25:41.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:41.283164+0000 mon.smithi049 (mon.0) 112 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-22T00:25:42.085 INFO:tasks.cephadm:Adding mon.smithi049 on smithi049 2024-02-22T00:25:42.085 INFO:tasks.cephadm:Adding mon.smithi161 on smithi161 2024-02-22T00:25:42.085 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch apply mon '2;smithi049:172.21.15.49=smithi049;smithi161:172.21.15.161=smithi161' 2024-02-22T00:25:43.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.816+0000 7f985409a700 1 -- 172.21.15.161:0/3060999196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 msgr2=0x7f984c0f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.816+0000 7f985409a700 1 --2- 172.21.15.161:0/3060999196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 0x7f984c0f79e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f983c004770 tx=0x7f983c009cb0).stop 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.816+0000 7f985409a700 1 -- 172.21.15.161:0/3060999196 shutdown_connections 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.816+0000 7f985409a700 1 --2- 172.21.15.161:0/3060999196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 0x7f984c0f79e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.816+0000 7f985409a700 1 -- 172.21.15.161:0/3060999196 >> 172.21.15.161:0/3060999196 conn(0x7f984c0f2d40 msgr2=0x7f984c0f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.816+0000 7f985409a700 1 -- 172.21.15.161:0/3060999196 shutdown_connections 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.816+0000 7f985409a700 1 -- 172.21.15.161:0/3060999196 wait complete. 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.817+0000 7f985409a700 1 Processor -- start 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.817+0000 7f985409a700 1 -- start start 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.817+0000 7f985409a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 0x7f984c107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.817+0000 7f985409a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c107d30 con 0x7f984c0f75c0 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.817+0000 7f9851e36700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 0x7f984c107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.817+0000 7f9851e36700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 0x7f984c107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:59026/0 (socket says 172.21.15.161:59026) 2024-02-22T00:25:43.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.817+0000 7f9851e36700 1 -- 172.21.15.161:0/951507934 learned_addr learned my addr 172.21.15.161:0/951507934 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:25:43.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.818+0000 7f9851e36700 1 -- 172.21.15.161:0/951507934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c005040 con 0x7f984c0f75c0 2024-02-22T00:25:43.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.818+0000 7f9851e36700 1 --2- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 0x7f984c107840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f983c009300 tx=0x7f983c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:43.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.818+0000 7f9842ffd700 1 -- 172.21.15.161:0/951507934 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f983c018070 con 0x7f984c0f75c0 2024-02-22T00:25:43.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.818+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c107f30 con 0x7f984c0f75c0 2024-02-22T00:25:43.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.818+0000 7f9842ffd700 1 -- 172.21.15.161:0/951507934 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f983c009890 con 0x7f984c0f75c0 2024-02-22T00:25:43.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.818+0000 7f9842ffd700 1 -- 172.21.15.161:0/951507934 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f983c01c400 con 0x7f984c0f75c0 2024-02-22T00:25:43.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.818+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c1083c0 con 0x7f984c0f75c0 2024-02-22T00:25:43.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.819+0000 7f9842ffd700 1 -- 172.21.15.161:0/951507934 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f983c01d420 con 0x7f984c0f75c0 2024-02-22T00:25:43.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.819+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c046ce0 con 0x7f984c0f75c0 2024-02-22T00:25:43.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.819+0000 7f9842ffd700 1 --2- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9838032700 0x7f9838034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:43.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.819+0000 7f9842ffd700 1 -- 172.21.15.161:0/951507934 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f983c044630 con 0x7f984c0f75c0 2024-02-22T00:25:43.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.819+0000 7f9851635700 1 --2- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9838032700 0x7f9838034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:43.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.820+0000 7f9851635700 1 --2- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9838032700 0x7f9838034bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9848009780 tx=0x7f9848006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:43.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.824+0000 7f9842ffd700 1 -- 172.21.15.161:0/951507934 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f983c025b80 con 0x7f984c0f75c0 2024-02-22T00:25:43.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:42.144021+0000 mgr.smithi049.rjblpr (mgr.14156) 19 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:43.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:43.994+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 --> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi049:172.21.15.49=smithi049;smithi161:172.21.15.161=smithi161", "target": ["mon-mgr", ""]}) v1 -- 0x7f984c0f3f50 con 0x7f9838032700 2024-02-22T00:25:44.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.000+0000 7f9842ffd700 1 -- 172.21.15.161:0/951507934 <== mgr.14156 v2:172.21.15.49:6800/3269480929 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f984c0f3f50 con 0x7f9838032700 2024-02-22T00:25:44.004 INFO:teuthology.orchestra.run.smithi161.stdout:Scheduled mon update... 2024-02-22T00:25:44.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9838032700 msgr2=0x7f9838034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:44.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 --2- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9838032700 0x7f9838034bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f9848009780 tx=0x7f9848006cc0).stop 2024-02-22T00:25:44.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 msgr2=0x7f984c107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:44.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 --2- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 0x7f984c107840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f983c009300 tx=0x7f983c009cb0).stop 2024-02-22T00:25:44.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 shutdown_connections 2024-02-22T00:25:44.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 --2- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f9838032700 0x7f9838034bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:44.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 --2- 172.21.15.161:0/951507934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f984c0f75c0 0x7f984c107840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:44.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 >> 172.21.15.161:0/951507934 conn(0x7f984c0f2d40 msgr2=0x7f984c0f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:44.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 shutdown_connections 2024-02-22T00:25:44.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:44.001+0000 7f985409a700 1 -- 172.21.15.161:0/951507934 wait complete. 2024-02-22T00:25:44.571 DEBUG:teuthology.orchestra.run.smithi161:mon.smithi161> sudo journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi161.service 2024-02-22T00:25:44.573 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:25:44.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:25:44.602 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:-- Logs begin at Wed 2024-02-21 23:55:52 UTC. -- 2024-02-22T00:25:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:43.996366+0000 mgr.smithi049.rjblpr (mgr.14156) 20 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi049:172.21.15.49=smithi049;smithi161:172.21.15.161=smithi161", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:25:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:25:43.998174+0000 mgr.smithi049.rjblpr (mgr.14156) 21 : cephadm [INF] Saving service mon spec with placement smithi049:172.21.15.49=smithi049;smithi161:172.21.15.161=smithi161;count:2 2024-02-22T00:25:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:44.000487+0000 mon.smithi049 (mon.0) 113 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:44.144278+0000 mgr.smithi049.rjblpr (mgr.14156) 22 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:46.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.228+0000 7f00efd15700 1 -- 172.21.15.161:0/1085859077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 msgr2=0x7f00e80f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:46.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.228+0000 7f00efd15700 1 --2- 172.21.15.161:0/1085859077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 0x7f00e80f79e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f00d8004770 tx=0x7f00d8009cb0).stop 2024-02-22T00:25:46.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.228+0000 7f00efd15700 1 -- 172.21.15.161:0/1085859077 shutdown_connections 2024-02-22T00:25:46.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.228+0000 7f00efd15700 1 --2- 172.21.15.161:0/1085859077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 0x7f00e80f79e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:46.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.228+0000 7f00efd15700 1 -- 172.21.15.161:0/1085859077 >> 172.21.15.161:0/1085859077 conn(0x7f00e80f2d40 msgr2=0x7f00e80f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:46.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.228+0000 7f00efd15700 1 -- 172.21.15.161:0/1085859077 shutdown_connections 2024-02-22T00:25:46.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.228+0000 7f00efd15700 1 -- 172.21.15.161:0/1085859077 wait complete. 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.229+0000 7f00efd15700 1 Processor -- start 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.229+0000 7f00efd15700 1 -- start start 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.229+0000 7f00efd15700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 0x7f00e8107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.229+0000 7f00efd15700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8107d30 con 0x7f00e80f75c0 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.229+0000 7f00edab1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 0x7f00e8107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.229+0000 7f00edab1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 0x7f00e8107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:59036/0 (socket says 172.21.15.161:59036) 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.229+0000 7f00edab1700 1 -- 172.21.15.161:0/2887389620 learned_addr learned my addr 172.21.15.161:0/2887389620 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.229+0000 7f00edab1700 1 -- 172.21.15.161:0/2887389620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d8005040 con 0x7f00e80f75c0 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.230+0000 7f00edab1700 1 --2- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 0x7f00e8107840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f00d8009300 tx=0x7f00d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.230+0000 7f00deffd700 1 -- 172.21.15.161:0/2887389620 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00d8018070 con 0x7f00e80f75c0 2024-02-22T00:25:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.230+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e8107f30 con 0x7f00e80f75c0 2024-02-22T00:25:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.230+0000 7f00deffd700 1 -- 172.21.15.161:0/2887389620 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f00d8009890 con 0x7f00e80f75c0 2024-02-22T00:25:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.230+0000 7f00deffd700 1 -- 172.21.15.161:0/2887389620 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f00d801c400 con 0x7f00e80f75c0 2024-02-22T00:25:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.230+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e81083c0 con 0x7f00e80f75c0 2024-02-22T00:25:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.231+0000 7f00deffd700 1 -- 172.21.15.161:0/2887389620 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f00d801d420 con 0x7f00e80f75c0 2024-02-22T00:25:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.231+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e8046ce0 con 0x7f00e80f75c0 2024-02-22T00:25:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.231+0000 7f00deffd700 1 --2- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f00d4032700 0x7f00d4034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.231+0000 7f00deffd700 1 -- 172.21.15.161:0/2887389620 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f00d8044570 con 0x7f00e80f75c0 2024-02-22T00:25:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.231+0000 7f00ed2b0700 1 --2- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f00d4032700 0x7f00d4034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.231+0000 7f00ed2b0700 1 --2- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f00d4032700 0x7f00d4034bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f00e4009780 tx=0x7f00e4006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:46.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.236+0000 7f00deffd700 1 -- 172.21.15.161:0/2887389620 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f00d8025b80 con 0x7f00e80f75c0 2024-02-22T00:25:46.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.461+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f00e8109210 con 0x7f00e80f75c0 2024-02-22T00:25:46.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.462+0000 7f00deffd700 1 -- 172.21.15.161:0/2887389620 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f00d8025b80 con 0x7f00e80f75c0 2024-02-22T00:25:46.466 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:25:46.466 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:25:46.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f00d4032700 msgr2=0x7f00d4034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:46.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 --2- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f00d4032700 0x7f00d4034bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f00e4009780 tx=0x7f00e4006cc0).stop 2024-02-22T00:25:46.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 msgr2=0x7f00e8107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:46.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 --2- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 0x7f00e8107840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f00d8009300 tx=0x7f00d8009cb0).stop 2024-02-22T00:25:46.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 shutdown_connections 2024-02-22T00:25:46.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 --2- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f00d4032700 0x7f00d4034bc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:46.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 --2- 172.21.15.161:0/2887389620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00e80f75c0 0x7f00e8107840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:46.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 >> 172.21.15.161:0/2887389620 conn(0x7f00e80f2d40 msgr2=0x7f00e80f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:46.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 shutdown_connections 2024-02-22T00:25:46.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:46.463+0000 7f00efd15700 1 -- 172.21.15.161:0/2887389620 wait complete. 2024-02-22T00:25:46.469 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:25:47.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:46.144490+0000 mgr.smithi049.rjblpr (mgr.14156) 23 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:47.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:46.462882+0000 mon.smithi049 (mon.0) 114 : audit [DBG] from='client.? 172.21.15.161:0/2887389620' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:25:48.049 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:25:48.049 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:25:49.631 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:48.144761+0000 mgr.smithi049.rjblpr (mgr.14156) 24 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:49.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.788+0000 7f595d49a700 1 -- 172.21.15.161:0/2664306949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 msgr2=0x7f59580f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:49.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.788+0000 7f595d49a700 1 --2- 172.21.15.161:0/2664306949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 0x7f59580f68f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5948004770 tx=0x7f5948009cb0).stop 2024-02-22T00:25:49.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.788+0000 7f595d49a700 1 -- 172.21.15.161:0/2664306949 shutdown_connections 2024-02-22T00:25:49.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.788+0000 7f595d49a700 1 --2- 172.21.15.161:0/2664306949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 0x7f59580f68f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.788+0000 7f595d49a700 1 -- 172.21.15.161:0/2664306949 >> 172.21.15.161:0/2664306949 conn(0x7f59580f1c30 msgr2=0x7f59580f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.788+0000 7f595d49a700 1 -- 172.21.15.161:0/2664306949 shutdown_connections 2024-02-22T00:25:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.788+0000 7f595d49a700 1 -- 172.21.15.161:0/2664306949 wait complete. 2024-02-22T00:25:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.789+0000 7f595d49a700 1 Processor -- start 2024-02-22T00:25:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.789+0000 7f595d49a700 1 -- start start 2024-02-22T00:25:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.789+0000 7f595d49a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 0x7f595810a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:49.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.789+0000 7f595d49a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59580612c0 con 0x7f59580f64d0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f5956ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 0x7f595810a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f5956ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 0x7f595810a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:59060/0 (socket says 172.21.15.161:59060) 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f5956ffd700 1 -- 172.21.15.161:0/2773541983 learned_addr learned my addr 172.21.15.161:0/2773541983 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f5956ffd700 1 -- 172.21.15.161:0/2773541983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948005040 con 0x7f59580f64d0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f5956ffd700 1 --2- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 0x7f595810a520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f59480099b0 tx=0x7f5948009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f593ffff700 1 -- 172.21.15.161:0/2773541983 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5948018070 con 0x7f59580f64d0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f593ffff700 1 -- 172.21.15.161:0/2773541983 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5948013730 con 0x7f59580f64d0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59580614c0 con 0x7f59580f64d0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f593ffff700 1 -- 172.21.15.161:0/2773541983 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f594801d460 con 0x7f59580f64d0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.790+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595810abd0 con 0x7f59580f64d0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.791+0000 7f593ffff700 1 -- 172.21.15.161:0/2773541983 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f59480125d0 con 0x7f59580f64d0 2024-02-22T00:25:49.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.791+0000 7f593ffff700 1 --2- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f59400326d0 0x7f5940034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:49.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.791+0000 7f593ffff700 1 -- 172.21.15.161:0/2773541983 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f59480440a0 con 0x7f59580f64d0 2024-02-22T00:25:49.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.791+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5958046ce0 con 0x7f59580f64d0 2024-02-22T00:25:49.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.791+0000 7f59567fc700 1 --2- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f59400326d0 0x7f5940034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:49.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.792+0000 7f59567fc700 1 --2- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f59400326d0 0x7f5940034b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f594c009780 tx=0x7f594c006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:49.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:49.796+0000 7f593ffff700 1 -- 172.21.15.161:0/2773541983 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f59480128d0 con 0x7f59580f64d0 2024-02-22T00:25:50.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.018+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f59580fbfc0 con 0x7f59580f64d0 2024-02-22T00:25:50.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.019+0000 7f593ffff700 1 -- 172.21.15.161:0/2773541983 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f59580fbfc0 con 0x7f59580f64d0 2024-02-22T00:25:50.024 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:25:50.024 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:25:50.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f59400326d0 msgr2=0x7f5940034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:50.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 --2- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f59400326d0 0x7f5940034b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f594c009780 tx=0x7f594c006cc0).stop 2024-02-22T00:25:50.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 msgr2=0x7f595810a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:50.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 --2- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 0x7f595810a520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f59480099b0 tx=0x7f5948009cb0).stop 2024-02-22T00:25:50.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 shutdown_connections 2024-02-22T00:25:50.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 --2- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f59400326d0 0x7f5940034b90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:50.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 --2- 172.21.15.161:0/2773541983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f59580f64d0 0x7f595810a520 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:50.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 >> 172.21.15.161:0/2773541983 conn(0x7f59580f1c30 msgr2=0x7f59580f2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:50.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 shutdown_connections 2024-02-22T00:25:50.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:50.021+0000 7f595d49a700 1 -- 172.21.15.161:0/2773541983 wait complete. 2024-02-22T00:25:50.027 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:25:50.499 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:50.020339+0000 mon.smithi049 (mon.0) 115 : audit [DBG] from='client.? 172.21.15.161:0/2773541983' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:25:51.572 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:50.144981+0000 mgr.smithi049.rjblpr (mgr.14156) 25 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:51.574 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:25:51.575 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:25:53.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.263+0000 7f4ace67e700 1 -- 172.21.15.161:0/1336625010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 msgr2=0x7f4ac80f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:53.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.263+0000 7f4ace67e700 1 --2- 172.21.15.161:0/1336625010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 0x7f4ac80f79e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4ab8004770 tx=0x7f4ab8009cb0).stop 2024-02-22T00:25:53.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.263+0000 7f4ace67e700 1 -- 172.21.15.161:0/1336625010 shutdown_connections 2024-02-22T00:25:53.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.263+0000 7f4ace67e700 1 --2- 172.21.15.161:0/1336625010 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 0x7f4ac80f79e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:53.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.263+0000 7f4ace67e700 1 -- 172.21.15.161:0/1336625010 >> 172.21.15.161:0/1336625010 conn(0x7f4ac80f2d40 msgr2=0x7f4ac80f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:53.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.263+0000 7f4ace67e700 1 -- 172.21.15.161:0/1336625010 shutdown_connections 2024-02-22T00:25:53.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.263+0000 7f4ace67e700 1 -- 172.21.15.161:0/1336625010 wait complete. 2024-02-22T00:25:53.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.264+0000 7f4ace67e700 1 Processor -- start 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.264+0000 7f4ace67e700 1 -- start start 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ace67e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 0x7f4ac8107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ace67e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8107d30 con 0x7f4ac80f75c0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ac7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 0x7f4ac8107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ac7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 0x7f4ac8107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:45876/0 (socket says 172.21.15.161:45876) 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ac7fff700 1 -- 172.21.15.161:0/1234742399 learned_addr learned my addr 172.21.15.161:0/1234742399 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ac7fff700 1 -- 172.21.15.161:0/1234742399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8005040 con 0x7f4ac80f75c0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ac7fff700 1 --2- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 0x7f4ac8107840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4ab8009300 tx=0x7f4ab8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ac57fa700 1 -- 172.21.15.161:0/1234742399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ab8018070 con 0x7f4ac80f75c0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ac57fa700 1 -- 172.21.15.161:0/1234742399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4ab8009890 con 0x7f4ac80f75c0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac8107f30 con 0x7f4ac80f75c0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ac57fa700 1 -- 172.21.15.161:0/1234742399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4ab801c400 con 0x7f4ac80f75c0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.265+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac81083c0 con 0x7f4ac80f75c0 2024-02-22T00:25:53.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.266+0000 7f4ac57fa700 1 -- 172.21.15.161:0/1234742399 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 13) v1 ==== 38688+0+0 (secure 0 0 0) 0x7f4ab801c670 con 0x7f4ac80f75c0 2024-02-22T00:25:53.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.266+0000 7f4ac57fa700 1 --2- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f4ab0032750 0x7f4ab0034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:53.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.266+0000 7f4ac57fa700 1 -- 172.21.15.161:0/1234742399 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f4ab80447f0 con 0x7f4ac80f75c0 2024-02-22T00:25:53.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.266+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac8046ce0 con 0x7f4ac80f75c0 2024-02-22T00:25:53.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.267+0000 7f4ac77fe700 1 --2- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f4ab0032750 0x7f4ab0034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:53.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.267+0000 7f4ac77fe700 1 --2- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f4ab0032750 0x7f4ab0034c10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4abc009780 tx=0x7f4abc006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:53.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.271+0000 7f4ac57fa700 1 -- 172.21.15.161:0/1234742399 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4ab801ca10 con 0x7f4ac80f75c0 2024-02-22T00:25:53.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.494+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4ac80fd1a0 con 0x7f4ac80f75c0 2024-02-22T00:25:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.495+0000 7f4ac57fa700 1 -- 172.21.15.161:0/1234742399 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f4ab801bb20 con 0x7f4ac80f75c0 2024-02-22T00:25:53.499 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:25:53.499 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.496+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f4ab0032750 msgr2=0x7f4ab0034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.496+0000 7f4ace67e700 1 --2- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f4ab0032750 0x7f4ab0034c10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4abc009780 tx=0x7f4abc006cc0).stop 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.496+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 msgr2=0x7f4ac8107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.496+0000 7f4ace67e700 1 --2- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 0x7f4ac8107840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f4ab8009300 tx=0x7f4ab8009cb0).stop 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.496+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 shutdown_connections 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.497+0000 7f4ace67e700 1 --2- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f4ab0032750 0x7f4ab0034c10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.497+0000 7f4ace67e700 1 --2- 172.21.15.161:0/1234742399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ac80f75c0 0x7f4ac8107840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.497+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 >> 172.21.15.161:0/1234742399 conn(0x7f4ac80f2d40 msgr2=0x7f4ac80f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.497+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 shutdown_connections 2024-02-22T00:25:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:53.497+0000 7f4ace67e700 1 -- 172.21.15.161:0/1234742399 wait complete. 2024-02-22T00:25:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:25:53.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:52.145219+0000 mgr.smithi049.rjblpr (mgr.14156) 26 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:53.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:52.482249+0000 mon.smithi049 (mon.0) 116 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:53.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:25:52.485595+0000 mgr.smithi049.rjblpr (mgr.14156) 27 : cephadm [INF] Deploying daemon node-exporter.smithi049 on smithi049 2024-02-22T00:25:54.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:53.495930+0000 mon.smithi049 (mon.0) 117 : audit [DBG] from='client.? 172.21.15.161:0/1234742399' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:25:55.184 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:25:55.184 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:25:55.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:54.145628+0000 mgr.smithi049.rjblpr (mgr.14156) 28 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:25:55.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:55.201415+0000 mon.smithi049 (mon.0) 118 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:55.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:55.203662+0000 mon.smithi049 (mon.0) 119 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-22T00:25:55.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:55.286717+0000 mon.smithi049 (mon.0) 120 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:25:56.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.972+0000 7f4458ce0700 1 -- 172.21.15.161:0/3211145182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 msgr2=0x7f44540f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.972+0000 7f4458ce0700 1 --2- 172.21.15.161:0/3211145182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 0x7f44540f68d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4444004770 tx=0x7f4444009cb0).stop 2024-02-22T00:25:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.972+0000 7f4458ce0700 1 -- 172.21.15.161:0/3211145182 shutdown_connections 2024-02-22T00:25:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.972+0000 7f4458ce0700 1 --2- 172.21.15.161:0/3211145182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 0x7f44540f68d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.972+0000 7f4458ce0700 1 -- 172.21.15.161:0/3211145182 >> 172.21.15.161:0/3211145182 conn(0x7f44540f1c10 msgr2=0x7f44540f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.972+0000 7f4458ce0700 1 -- 172.21.15.161:0/3211145182 shutdown_connections 2024-02-22T00:25:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.972+0000 7f4458ce0700 1 -- 172.21.15.161:0/3211145182 wait complete. 2024-02-22T00:25:56.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f4458ce0700 1 Processor -- start 2024-02-22T00:25:56.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f4458ce0700 1 -- start start 2024-02-22T00:25:56.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f4458ce0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 0x7f44540fe490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:56.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f4458ce0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540fc910 con 0x7f44540f64b0 2024-02-22T00:25:56.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f445259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 0x7f44540fe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:25:56.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f445259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 0x7f44540fe490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:45904/0 (socket says 172.21.15.161:45904) 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f445259c700 1 -- 172.21.15.161:0/1129702628 learned_addr learned my addr 172.21.15.161:0/1129702628 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f445259c700 1 -- 172.21.15.161:0/1129702628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4444005040 con 0x7f44540f64b0 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.973+0000 7f445259c700 1 --2- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 0x7f44540fe490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4444009300 tx=0x7f4444009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.974+0000 7f44437fe700 1 -- 172.21.15.161:0/1129702628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4444018070 con 0x7f44540f64b0 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.974+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44540fcab0 con 0x7f44540f64b0 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.974+0000 7f44437fe700 1 -- 172.21.15.161:0/1129702628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4444009890 con 0x7f44540f64b0 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.974+0000 7f44437fe700 1 -- 172.21.15.161:0/1129702628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f444401c400 con 0x7f44540f64b0 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.974+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44540fcf40 con 0x7f44540f64b0 2024-02-22T00:25:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.974+0000 7f44437fe700 1 -- 172.21.15.161:0/1129702628 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 38702+0+0 (secure 0 0 0) 0x7f444401c6c0 con 0x7f44540f64b0 2024-02-22T00:25:56.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.975+0000 7f44437fe700 1 --2- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f443c032750 0x7f443c034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:25:56.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.975+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445405a310 con 0x7f44540f64b0 2024-02-22T00:25:56.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.975+0000 7f44437fe700 1 -- 172.21.15.161:0/1129702628 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f4444044a00 con 0x7f44540f64b0 2024-02-22T00:25:56.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.975+0000 7f4451d9b700 1 -- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f443c032750 msgr2=0x7f443c034c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3269480929 2024-02-22T00:25:56.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.975+0000 7f4451d9b700 1 --2- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f443c032750 0x7f443c034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-22T00:25:56.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:56.980+0000 7f44437fe700 1 -- 172.21.15.161:0/1129702628 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f444401b550 con 0x7f44540f64b0 2024-02-22T00:25:57.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.176+0000 7f4451d9b700 1 -- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f443c032750 msgr2=0x7f443c034c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3269480929 2024-02-22T00:25:57.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.176+0000 7f4451d9b700 1 --2- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f443c032750 0x7f443c034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-22T00:25:57.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.203+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f44540fbfa0 con 0x7f44540f64b0 2024-02-22T00:25:57.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.204+0000 7f44437fe700 1 -- 172.21.15.161:0/1129702628 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f444401b370 con 0x7f44540f64b0 2024-02-22T00:25:57.208 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:25:57.208 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:25:57.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f443c032750 msgr2=0x7f443c034c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-22T00:25:57.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 --2- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f443c032750 0x7f443c034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:25:57.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 msgr2=0x7f44540fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:25:57.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 --2- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 0x7f44540fe490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4444009300 tx=0x7f4444009cb0).stop 2024-02-22T00:25:57.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 shutdown_connections 2024-02-22T00:25:57.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 --2- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7f443c032750 0x7f443c034c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:25:57.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 --2- 172.21.15.161:0/1129702628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f44540f64b0 0x7f44540fe490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:25:57.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 >> 172.21.15.161:0/1129702628 conn(0x7f44540f1c10 msgr2=0x7f4454060dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:25:57.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 shutdown_connections 2024-02-22T00:25:57.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:25:57.206+0000 7f4458ce0700 1 -- 172.21.15.161:0/1129702628 wait complete. 2024-02-22T00:25:57.211 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:25:57.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:56.203891+0000 mon.smithi049 (mon.0) 121 : audit [INF] from='mgr.14156 172.21.15.49:0/563212449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-22T00:25:57.622 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:25:56.203957+0000 mon.smithi049 (mon.0) 122 : cluster [DBG] mgrmap e14: smithi049.rjblpr(active, since 46s) 2024-02-22T00:25:58.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:25:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:25:57.205278+0000 mon.smithi049 (mon.0) 123 : audit [DBG] from='client.? 172.21.15.161:0/1129702628' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:25:58.793 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:25:58.793 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:26:00.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.619+0000 7fa2e673f700 1 -- 172.21.15.161:0/2313488370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 msgr2=0x7fa2e00f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:00.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.619+0000 7fa2e673f700 1 --2- 172.21.15.161:0/2313488370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 0x7fa2e00f68d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa2d0004770 tx=0x7fa2d0009cb0).stop 2024-02-22T00:26:00.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.619+0000 7fa2e673f700 1 -- 172.21.15.161:0/2313488370 shutdown_connections 2024-02-22T00:26:00.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.619+0000 7fa2e673f700 1 --2- 172.21.15.161:0/2313488370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 0x7fa2e00f68d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:00.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.619+0000 7fa2e673f700 1 -- 172.21.15.161:0/2313488370 >> 172.21.15.161:0/2313488370 conn(0x7fa2e00f1c10 msgr2=0x7fa2e00f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:00.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.620+0000 7fa2e673f700 1 -- 172.21.15.161:0/2313488370 shutdown_connections 2024-02-22T00:26:00.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.620+0000 7fa2e673f700 1 -- 172.21.15.161:0/2313488370 wait complete. 2024-02-22T00:26:00.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.620+0000 7fa2e673f700 1 Processor -- start 2024-02-22T00:26:00.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.620+0000 7fa2e673f700 1 -- start start 2024-02-22T00:26:00.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.620+0000 7fa2e673f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 0x7fa2e0106720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:00.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.620+0000 7fa2e673f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e0106c10 con 0x7fa2e00f64b0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 0x7fa2e0106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 0x7fa2e0106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:45916/0 (socket says 172.21.15.161:45916) 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2dffff700 1 -- 172.21.15.161:0/4169331516 learned_addr learned my addr 172.21.15.161:0/4169331516 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2dffff700 1 -- 172.21.15.161:0/4169331516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d0005040 con 0x7fa2e00f64b0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2dffff700 1 --2- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 0x7fa2e0106720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa2d00099b0 tx=0x7fa2d0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2dd7fa700 1 -- 172.21.15.161:0/4169331516 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2d0018070 con 0x7fa2e00f64b0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2dd7fa700 1 -- 172.21.15.161:0/4169331516 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa2d0013730 con 0x7fa2e00f64b0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e0106e10 con 0x7fa2e00f64b0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2dd7fa700 1 -- 172.21.15.161:0/4169331516 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa2d001d460 con 0x7fa2e00f64b0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.621+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e01072a0 con 0x7fa2e00f64b0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.622+0000 7fa2dd7fa700 1 -- 172.21.15.161:0/4169331516 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 14) v1 ==== 38702+0+0 (secure 0 0 0) 0x7fa2d001d6b0 con 0x7fa2e00f64b0 2024-02-22T00:26:00.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.622+0000 7fa2dd7fa700 1 --2- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa2c8032780 0x7fa2c8034c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:00.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.622+0000 7fa2dd7fa700 1 -- 172.21.15.161:0/4169331516 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fa2d00440d0 con 0x7fa2e00f64b0 2024-02-22T00:26:00.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.622+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e0046ce0 con 0x7fa2e00f64b0 2024-02-22T00:26:00.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.622+0000 7fa2df7fe700 1 -- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa2c8032780 msgr2=0x7fa2c8034c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3269480929 2024-02-22T00:26:00.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.622+0000 7fa2df7fe700 1 --2- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa2c8032780 0x7fa2c8034c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-02-22T00:26:00.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.627+0000 7fa2dd7fa700 1 -- 172.21.15.161:0/4169331516 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa2d001a900 con 0x7fa2e00f64b0 2024-02-22T00:26:00.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.823+0000 7fa2df7fe700 1 -- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa2c8032780 msgr2=0x7fa2c8034c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.49:6800/3269480929 2024-02-22T00:26:00.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.823+0000 7fa2df7fe700 1 --2- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa2c8032780 0x7fa2c8034c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-02-22T00:26:00.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.852+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa2e00fbfa0 con 0x7fa2e00f64b0 2024-02-22T00:26:00.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.852+0000 7fa2dd7fa700 1 -- 172.21.15.161:0/4169331516 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7fa2d001a310 con 0x7fa2e00f64b0 2024-02-22T00:26:00.856 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:26:00.857 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:26:00.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa2c8032780 msgr2=0x7fa2c8034c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-22T00:26:00.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 --2- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa2c8032780 0x7fa2c8034c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:26:00.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 msgr2=0x7fa2e0106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:00.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 --2- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 0x7fa2e0106720 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa2d00099b0 tx=0x7fa2d0009cb0).stop 2024-02-22T00:26:00.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 shutdown_connections 2024-02-22T00:26:00.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 --2- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:6800/3269480929,v1:172.21.15.49:6801/3269480929] conn(0x7fa2c8032780 0x7fa2c8034c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:26:00.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 --2- 172.21.15.161:0/4169331516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2e00f64b0 0x7fa2e0106720 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:00.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 >> 172.21.15.161:0/4169331516 conn(0x7fa2e00f1c10 msgr2=0x7fa2e00f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:00.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 shutdown_connections 2024-02-22T00:26:00.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:00.854+0000 7fa2e673f700 1 -- 172.21.15.161:0/4169331516 wait complete. 2024-02-22T00:26:00.859 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:26:01.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:00.853465+0000 mon.smithi049 (mon.0) 124 : audit [DBG] from='client.? 172.21.15.161:0/4169331516' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:26:01.994 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:01.748019+0000 mon.smithi049 (mon.0) 125 : cluster [INF] Active manager daemon smithi049.rjblpr restarted 2024-02-22T00:26:01.994 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:01.748248+0000 mon.smithi049 (mon.0) 126 : cluster [INF] Activating manager daemon smithi049.rjblpr 2024-02-22T00:26:01.994 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:01.750780+0000 mon.smithi049 (mon.0) 127 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-22T00:26:01.994 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:01.750878+0000 mon.smithi049 (mon.0) 128 : cluster [DBG] mgrmap e15: smithi049.rjblpr(active, starting, since 0.00271931s) 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.751899+0000 mon.smithi049 (mon.0) 129 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.752608+0000 mon.smithi049 (mon.0) 130 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.753223+0000 mon.smithi049 (mon.0) 131 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.753376+0000 mon.smithi049 (mon.0) 132 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.753511+0000 mon.smithi049 (mon.0) 133 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:01.767752+0000 mon.smithi049 (mon.0) 134 : cluster [INF] Manager daemon smithi049.rjblpr is now available 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.868868+0000 mon.smithi049 (mon.0) 135 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.870512+0000 mon.smithi049 (mon.0) 136 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:26:01.995 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.899564+0000 mon.smithi049 (mon.0) 137 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:02.470 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:26:02.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:26:03.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.913972+0000 mon.smithi049 (mon.0) 138 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:26:03.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:01.918185+0000 mon.smithi049 (mon.0) 139 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:26:03.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:02.354440+0000 mon.smithi049 (mon.0) 140 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:03.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:02.636550+0000 mon.smithi049 (mon.0) 141 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:03.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:02.752670+0000 mon.smithi049 (mon.0) 142 : cluster [DBG] mgrmap e16: smithi049.rjblpr(active, since 1.00451s) 2024-02-22T00:26:04.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.291+0000 7f2659010700 1 -- 172.21.15.161:0/3778802660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 msgr2=0x7f26540f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:04.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.291+0000 7f2659010700 1 --2- 172.21.15.161:0/3778802660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 0x7f26540f68d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f2648004770 tx=0x7f2648009cb0).stop 2024-02-22T00:26:04.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.291+0000 7f2659010700 1 -- 172.21.15.161:0/3778802660 shutdown_connections 2024-02-22T00:26:04.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.291+0000 7f2659010700 1 --2- 172.21.15.161:0/3778802660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 0x7f26540f68d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:04.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.291+0000 7f2659010700 1 -- 172.21.15.161:0/3778802660 >> 172.21.15.161:0/3778802660 conn(0x7f26540f1c10 msgr2=0x7f26540f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:04.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.291+0000 7f2659010700 1 -- 172.21.15.161:0/3778802660 shutdown_connections 2024-02-22T00:26:04.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.292+0000 7f2659010700 1 -- 172.21.15.161:0/3778802660 wait complete. 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.292+0000 7f2659010700 1 Processor -- start 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.293+0000 7f2659010700 1 -- start start 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.293+0000 7f2659010700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 0x7f265410a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.293+0000 7f2659010700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2654061190 con 0x7f26540f64b0 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.293+0000 7f2652d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 0x7f265410a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.293+0000 7f2652d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 0x7f265410a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:44108/0 (socket says 172.21.15.161:44108) 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.293+0000 7f2652d9d700 1 -- 172.21.15.161:0/855401389 learned_addr learned my addr 172.21.15.161:0/855401389 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.293+0000 7f2652d9d700 1 -- 172.21.15.161:0/855401389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2648005040 con 0x7f26540f64b0 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.294+0000 7f2652d9d700 1 --2- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 0x7f265410a540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f2648009300 tx=0x7f2648009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.294+0000 7f263bfff700 1 -- 172.21.15.161:0/855401389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2648018070 con 0x7f26540f64b0 2024-02-22T00:26:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.294+0000 7f263bfff700 1 -- 172.21.15.161:0/855401389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2648009890 con 0x7f26540f64b0 2024-02-22T00:26:04.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.294+0000 7f263bfff700 1 -- 172.21.15.161:0/855401389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f264801c400 con 0x7f26540f64b0 2024-02-22T00:26:04.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.294+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2654061390 con 0x7f26540f64b0 2024-02-22T00:26:04.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.294+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265410abf0 con 0x7f26540f64b0 2024-02-22T00:26:04.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.295+0000 7f263bfff700 1 -- 172.21.15.161:0/855401389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 38745+0+0 (secure 0 0 0) 0x7f264801c670 con 0x7f26540f64b0 2024-02-22T00:26:04.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.295+0000 7f263bfff700 1 --2- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f263c032830 0x7f263c034cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:04.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.295+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265405a310 con 0x7f26540f64b0 2024-02-22T00:26:04.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.295+0000 7f263bfff700 1 -- 172.21.15.161:0/855401389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f2648044850 con 0x7f26540f64b0 2024-02-22T00:26:04.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.295+0000 7f265259c700 1 --2- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f263c032830 0x7f263c034cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:04.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.296+0000 7f265259c700 1 --2- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f263c032830 0x7f263c034cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f2644009780 tx=0x7f2644006cc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:04.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.300+0000 7f263bfff700 1 -- 172.21.15.161:0/855401389 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2648024300 con 0x7f26540f64b0 2024-02-22T00:26:04.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.526+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f26540fbfa0 con 0x7f26540f64b0 2024-02-22T00:26:04.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.527+0000 7f263bfff700 1 -- 172.21.15.161:0/855401389 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f264801bb60 con 0x7f26540f64b0 2024-02-22T00:26:04.531 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:26:04.531 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:26:04.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f263c032830 msgr2=0x7f263c034cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:04.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 --2- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f263c032830 0x7f263c034cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f2644009780 tx=0x7f2644006cc0).stop 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 msgr2=0x7f265410a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 --2- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 0x7f265410a540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f2648009300 tx=0x7f2648009cb0).stop 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 shutdown_connections 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 --2- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f263c032830 0x7f263c034cf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 --2- 172.21.15.161:0/855401389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26540f64b0 0x7f265410a540 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 >> 172.21.15.161:0/855401389 conn(0x7f26540f1c10 msgr2=0x7f26540f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 shutdown_connections 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:04.529+0000 7f2659010700 1 -- 172.21.15.161:0/855401389 wait complete. 2024-02-22T00:26:04.534 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:26:05.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:03.908639+0000 mon.smithi049 (mon.0) 143 : cluster [DBG] mgrmap e17: smithi049.rjblpr(active, since 2s) 2024-02-22T00:26:05.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:04.528022+0000 mon.smithi049 (mon.0) 144 : audit [DBG] from='client.? 172.21.15.161:0/855401389' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:26:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:05.302982+0000 mon.smithi049 (mon.0) 145 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:05.595229+0000 mon.smithi049 (mon.0) 146 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:26:06.819 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:26:06.819 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:26:08.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.909+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/2932824084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 msgr2=0x7f2dcc0fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:08.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.909+0000 7f2dd0f6a700 1 --2- 172.21.15.161:0/2932824084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 0x7f2dcc0fda00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2dc0004770 tx=0x7f2dc0009cb0).stop 2024-02-22T00:26:08.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.909+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/2932824084 shutdown_connections 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.909+0000 7f2dd0f6a700 1 --2- 172.21.15.161:0/2932824084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 0x7f2dcc0fda00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.909+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/2932824084 >> 172.21.15.161:0/2932824084 conn(0x7f2dcc0f3220 msgr2=0x7f2dcc0f5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.909+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/2932824084 shutdown_connections 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.909+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/2932824084 wait complete. 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.910+0000 7f2dd0f6a700 1 Processor -- start 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.910+0000 7f2dd0f6a700 1 -- start start 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.910+0000 7f2dd0f6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 0x7f2dcc10d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.910+0000 7f2dd0f6a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc10de40 con 0x7f2dcc0fd620 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.910+0000 7f2dca59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 0x7f2dcc10d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dca59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 0x7f2dcc10d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:44112/0 (socket says 172.21.15.161:44112) 2024-02-22T00:26:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dca59c700 1 -- 172.21.15.161:0/1284395718 learned_addr learned my addr 172.21.15.161:0/1284395718 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dca59c700 1 -- 172.21.15.161:0/1284395718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0005040 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dca59c700 1 --2- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 0x7f2dcc10d950 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2dc0004740 tx=0x7f2dc0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dbb7fe700 1 -- 172.21.15.161:0/1284395718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc0018070 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dbb7fe700 1 -- 172.21.15.161:0/1284395718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2dc0009860 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc10e040 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dbb7fe700 1 -- 172.21.15.161:0/1284395718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2dc001c5b0 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.911+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc10e450 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.912+0000 7f2dbb7fe700 1 -- 172.21.15.161:0/1284395718 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 38745+0+0 (secure 0 0 0) 0x7f2dc001d470 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.912+0000 7f2dbb7fe700 1 --2- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2db4032820 0x7f2db4034ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.912+0000 7f2dbb7fe700 1 -- 172.21.15.161:0/1284395718 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f2dc00440c0 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.912+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc05f150 con 0x7f2dcc0fd620 2024-02-22T00:26:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.913+0000 7f2dc9d9b700 1 --2- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2db4032820 0x7f2db4034ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:08.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.913+0000 7f2dc9d9b700 1 --2- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2db4032820 0x7f2db4034ce0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f2dbc009780 tx=0x7f2dbc006cc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:08.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:08.917+0000 7f2dbb7fe700 1 -- 172.21.15.161:0/1284395718 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2dc001d7c0 con 0x7f2dcc0fd620 2024-02-22T00:26:08.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:07.602602+0000 mon.smithi049 (mon.0) 147 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:08.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.139834+0000 mon.smithi049 (mon.0) 148 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:08.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.140571+0000 mon.smithi049 (mon.0) 149 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:26:08.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.141563+0000 mon.smithi049 (mon.0) 150 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:08.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.142407+0000 mon.smithi049 (mon.0) 151 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:08.143820+0000 mgr.smithi049.rjblpr (mgr.14194) 1 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:08.144220+0000 mgr.smithi049.rjblpr (mgr.14194) 2 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:08.159904+0000 mgr.smithi049.rjblpr (mgr.14194) 3 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:08.183122+0000 mgr.smithi049.rjblpr (mgr.14194) 4 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.188346+0000 mon.smithi049 (mon.0) 152 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.243828+0000 mon.smithi049 (mon.0) 153 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.246415+0000 mon.smithi049 (mon.0) 154 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.248281+0000 mon.smithi049 (mon.0) 155 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.250343+0000 mon.smithi049 (mon.0) 156 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-22T00:26:08.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:08.251120+0000 mon.smithi049 (mon.0) 157 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:09.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.151+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2dcc05a310 con 0x7f2dcc0fd620 2024-02-22T00:26:09.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.151+0000 7f2dbb7fe700 1 -- 172.21.15.161:0/1284395718 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f2dc00242f0 con 0x7f2dcc0fd620 2024-02-22T00:26:09.156 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:26:09.156 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2db4032820 msgr2=0x7f2db4034ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 --2- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2db4032820 0x7f2db4034ce0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f2dbc009780 tx=0x7f2dbc006cc0).stop 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 msgr2=0x7f2dcc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 --2- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 0x7f2dcc10d950 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2dc0004740 tx=0x7f2dc0009cb0).stop 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 shutdown_connections 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 --2- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2db4032820 0x7f2db4034ce0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 --2- 172.21.15.161:0/1284395718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2dcc0fd620 0x7f2dcc10d950 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 >> 172.21.15.161:0/1284395718 conn(0x7f2dcc0f3220 msgr2=0x7f2dcc0f3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 shutdown_connections 2024-02-22T00:26:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:09.154+0000 7f2dd0f6a700 1 -- 172.21.15.161:0/1284395718 wait complete. 2024-02-22T00:26:09.159 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:26:09.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:08.251785+0000 mgr.smithi049.rjblpr (mgr.14194) 5 : cephadm [INF] Deploying daemon crash.smithi161 on smithi161 2024-02-22T00:26:09.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:09.152709+0000 mon.smithi049 (mon.0) 158 : audit [DBG] from='client.? 172.21.15.161:0/1284395718' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:26:10.835 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:26:10.835 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.929+0000 7f98a72bf700 1 -- 172.21.15.161:0/832759619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 msgr2=0x7f98a00f6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.929+0000 7f98a72bf700 1 --2- 172.21.15.161:0/832759619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 0x7f98a00f6860 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f989c004770 tx=0x7f989c009cb0).stop 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.929+0000 7f98a72bf700 1 -- 172.21.15.161:0/832759619 shutdown_connections 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.929+0000 7f98a72bf700 1 --2- 172.21.15.161:0/832759619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 0x7f98a00f6860 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.929+0000 7f98a72bf700 1 -- 172.21.15.161:0/832759619 >> 172.21.15.161:0/832759619 conn(0x7f98a006c440 msgr2=0x7f98a006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.929+0000 7f98a72bf700 1 -- 172.21.15.161:0/832759619 shutdown_connections 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.929+0000 7f98a72bf700 1 -- 172.21.15.161:0/832759619 wait complete. 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.930+0000 7f98a72bf700 1 Processor -- start 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.930+0000 7f98a72bf700 1 -- start start 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.930+0000 7f98a72bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 0x7f98a010fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.930+0000 7f98a72bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a010ff80 con 0x7f98a00f6480 2024-02-22T00:26:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.930+0000 7f98a505b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 0x7f98a010fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.930+0000 7f98a505b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 0x7f98a010fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:45884/0 (socket says 172.21.15.161:45884) 2024-02-22T00:26:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.930+0000 7f98a505b700 1 -- 172.21.15.161:0/1437643442 learned_addr learned my addr 172.21.15.161:0/1437643442 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:26:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.930+0000 7f98a505b700 1 -- 172.21.15.161:0/1437643442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c005040 con 0x7f98a00f6480 2024-02-22T00:26:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.931+0000 7f98a505b700 1 --2- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 0x7f98a010fa90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f989c004740 tx=0x7f989c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.931+0000 7f9896777700 1 -- 172.21.15.161:0/1437643442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f989c018070 con 0x7f98a00f6480 2024-02-22T00:26:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.931+0000 7f9896777700 1 -- 172.21.15.161:0/1437643442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f989c009860 con 0x7f98a00f6480 2024-02-22T00:26:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.931+0000 7f9896777700 1 -- 172.21.15.161:0/1437643442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f989c01c5b0 con 0x7f98a00f6480 2024-02-22T00:26:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.931+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a0110180 con 0x7f98a00f6480 2024-02-22T00:26:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.931+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a0110610 con 0x7f98a00f6480 2024-02-22T00:26:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.932+0000 7f9896777700 1 -- 172.21.15.161:0/1437643442 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 38745+0+0 (secure 0 0 0) 0x7f989c01c710 con 0x7f98a00f6480 2024-02-22T00:26:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.932+0000 7f9896777700 1 --2- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c032820 0x7f988c034ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.932+0000 7f9896777700 1 -- 172.21.15.161:0/1437643442 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f989c0440a0 con 0x7f98a00f6480 2024-02-22T00:26:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.932+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a005f1f0 con 0x7f98a00f6480 2024-02-22T00:26:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.932+0000 7f98a485a700 1 --2- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c032820 0x7f988c034ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.933+0000 7f98a485a700 1 --2- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c032820 0x7f988c034ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9890009780 tx=0x7f9890006cc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:12.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:12.937+0000 7f9896777700 1 -- 172.21.15.161:0/1437643442 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f989c026910 con 0x7f98a00f6480 2024-02-22T00:26:13.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.193+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f98a0046ce0 con 0x7f98a00f6480 2024-02-22T00:26:13.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.193+0000 7f9896777700 1 -- 172.21.15.161:0/1437643442 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7f989c0242f0 con 0x7f98a00f6480 2024-02-22T00:26:13.197 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:26:13.197 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:26:13.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c032820 msgr2=0x7f988c034ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:13.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 --2- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c032820 0x7f988c034ce0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9890009780 tx=0x7f9890006cc0).stop 2024-02-22T00:26:13.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 msgr2=0x7f98a010fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:13.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 --2- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 0x7f98a010fa90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f989c004740 tx=0x7f989c009cb0).stop 2024-02-22T00:26:13.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 shutdown_connections 2024-02-22T00:26:13.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 --2- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c032820 0x7f988c034ce0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:13.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 --2- 172.21.15.161:0/1437643442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00f6480 0x7f98a010fa90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:13.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 >> 172.21.15.161:0/1437643442 conn(0x7f98a006c440 msgr2=0x7f98a00f4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:13.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 shutdown_connections 2024-02-22T00:26:13.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:13.195+0000 7f98a72bf700 1 -- 172.21.15.161:0/1437643442 wait complete. 2024-02-22T00:26:13.199 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:26:14.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:12.753240+0000 mon.smithi049 (mon.0) 159 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:14.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:12.755551+0000 mon.smithi049 (mon.0) 160 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:26:14.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:12.757555+0000 mon.smithi049 (mon.0) 161 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-22T00:26:14.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:12.758311+0000 mon.smithi049 (mon.0) 162 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:26:14.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:12.759161+0000 mon.smithi049 (mon.0) 163 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:14.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:12.759833+0000 mgr.smithi049.rjblpr (mgr.14194) 6 : cephadm [INF] Deploying daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:26:14.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:13.193497+0000 mon.smithi049 (mon.0) 164 : audit [DBG] from='client.? 172.21.15.161:0/1437643442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:26:15.603 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:26:15.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:26:16.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:15.316627+0000 mon.smithi049 (mon.0) 165 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:16.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:15.318732+0000 mon.smithi049 (mon.0) 166 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:26:16.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:15.319540+0000 mon.smithi049 (mon.0) 167 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:16.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:15.320217+0000 mgr.smithi049.rjblpr (mgr.14194) 7 : cephadm [INF] Deploying daemon mon.smithi161 on smithi161 2024-02-22T00:26:18.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:16.905258+0000 mon.smithi049 (mon.0) 168 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:18.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.437+0000 7fb433280700 1 -- 172.21.15.161:0/3333726655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 msgr2=0x7fb42c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:18.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.437+0000 7fb433280700 1 --2- 172.21.15.161:0/3333726655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 0x7fb42c0fc930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb428004770 tx=0x7fb428009cb0).stop 2024-02-22T00:26:18.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.437+0000 7fb433280700 1 -- 172.21.15.161:0/3333726655 shutdown_connections 2024-02-22T00:26:18.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.437+0000 7fb433280700 1 --2- 172.21.15.161:0/3333726655 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 0x7fb42c0fc930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:18.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.437+0000 7fb433280700 1 -- 172.21.15.161:0/3333726655 >> 172.21.15.161:0/3333726655 conn(0x7fb42c06c440 msgr2=0x7fb42c06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:18.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.437+0000 7fb433280700 1 -- 172.21.15.161:0/3333726655 shutdown_connections 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.437+0000 7fb433280700 1 -- 172.21.15.161:0/3333726655 wait complete. 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.438+0000 7fb433280700 1 Processor -- start 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.438+0000 7fb433280700 1 -- start start 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.438+0000 7fb433280700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 0x7fb42c108a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.438+0000 7fb433280700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c108f20 con 0x7fb42c0fc550 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.438+0000 7fb43101c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 0x7fb42c108a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.438+0000 7fb43101c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 0x7fb42c108a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:45910/0 (socket says 172.21.15.161:45910) 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.438+0000 7fb43101c700 1 -- 172.21.15.161:0/465150981 learned_addr learned my addr 172.21.15.161:0/465150981 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.439+0000 7fb43101c700 1 -- 172.21.15.161:0/465150981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb428005040 con 0x7fb42c0fc550 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.439+0000 7fb43101c700 1 --2- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 0x7fb42c108a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb428009300 tx=0x7fb428009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.439+0000 7fb422777700 1 -- 172.21.15.161:0/465150981 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb428018070 con 0x7fb42c0fc550 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.439+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c109120 con 0x7fb42c0fc550 2024-02-22T00:26:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.439+0000 7fb422777700 1 -- 172.21.15.161:0/465150981 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb428013410 con 0x7fb42c0fc550 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.439+0000 7fb422777700 1 -- 172.21.15.161:0/465150981 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb42801c3c0 con 0x7fb42c0fc550 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.439+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c109530 con 0x7fb42c0fc550 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.440+0000 7fb422777700 1 -- 172.21.15.161:0/465150981 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) v1 ==== 38745+0+0 (secure 0 0 0) 0x7fb42801d420 con 0x7fb42c0fc550 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.440+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c05f1f0 con 0x7fb42c0fc550 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.440+0000 7fb422777700 1 --2- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb418032830 0x7fb418034cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.440+0000 7fb422777700 1 -- 172.21.15.161:0/465150981 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb4280446f0 con 0x7fb42c0fc550 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.440+0000 7fb43081b700 1 --2- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb418032830 0x7fb418034cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.441+0000 7fb43081b700 1 --2- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb418032830 0x7fb418034cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb41c009780 tx=0x7fb41c006cc0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.445+0000 7fb422777700 1 -- 172.21.15.161:0/465150981 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb42801b370 con 0x7fb42c0fc550 2024-02-22T00:26:18.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.696+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb42c05a310 con 0x7fb42c0fc550 2024-02-22T00:26:18.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.697+0000 7fb422777700 1 -- 172.21.15.161:0/465150981 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+731 (secure 0 0 0) 0x7fb42801b370 con 0x7fb42c0fc550 2024-02-22T00:26:18.701 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:26:18.701 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":1,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:24:04.747718Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.698+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb418032830 msgr2=0x7fb418034cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.698+0000 7fb433280700 1 --2- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb418032830 0x7fb418034cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb41c009780 tx=0x7fb41c006cc0).stop 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.698+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 msgr2=0x7fb42c108a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.698+0000 7fb433280700 1 --2- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 0x7fb42c108a30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb428009300 tx=0x7fb428009cb0).stop 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.699+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 shutdown_connections 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.699+0000 7fb433280700 1 --2- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb418032830 0x7fb418034cf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.699+0000 7fb433280700 1 --2- 172.21.15.161:0/465150981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb42c0fc550 0x7fb42c108a30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.699+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 >> 172.21.15.161:0/465150981 conn(0x7fb42c06c440 msgr2=0x7fb42c0f4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.699+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 shutdown_connections 2024-02-22T00:26:18.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:18.699+0000 7fb433280700 1 -- 172.21.15.161:0/465150981 wait complete. 2024-02-22T00:26:18.704 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 1 2024-02-22T00:26:19.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:18.697916+0000 mon.smithi049 (mon.0) 169 : audit [DBG] from='client.? 172.21.15.161:0/465150981' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:26:20.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:19 smithi161 systemd[1]: Starting Ceph mon.smithi161 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:26:20.380 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T00:26:20.381 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mon dump -f json 2024-02-22T00:26:20.649 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.451+0000 7f3ec59dd880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T00:26:20.649 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.451+0000 7f3ec59dd880 0 ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable), process ceph-mon, pid 7 2024-02-22T00:26:20.649 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.451+0000 7f3ec59dd880 0 pidfile_write: ignore empty --pid-file 2024-02-22T00:26:20.649 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.457+0000 7f3ec59dd880 0 load: jerasure load: lrc load: isa 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: RocksDB version: 6.8.1 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Compile date Feb 20 2024 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: DB SUMMARY 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: CURRENT file: CURRENT 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-22T00:26:20.650 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi161/store.db dir, Total Num: 0, files: 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi161/store.db: 000003.log size: 511 ; 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.error_if_exists: 0 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.create_if_missing: 0 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.env: 0x556b2d44c080 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.fs: Posix File System 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.info_log: 0x556b2e064560 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.statistics: (nil) 2024-02-22T00:26:20.651 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.use_fsync: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.db_log_dir: 2024-02-22T00:26:20.652 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi161/store.db 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.write_buffer_manager: 0x556b2ecd4450 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T00:26:20.653 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T00:26:20.654 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T00:26:20.654 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T00:26:20.654 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T00:26:20.654 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T00:26:20.654 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T00:26:20.654 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T00:26:20.654 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.unordered_write: 0 2024-02-22T00:26:20.654 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T00:26:20.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T00:26:20.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T00:26:20.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T00:26:20.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.row_cache: None 2024-02-22T00:26:20.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.wal_filter: None 2024-02-22T00:26:20.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T00:26:20.656 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.two_write_queues: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.atomic_flush: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.log_readahead_size: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T00:26:20.657 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_open_files: -1 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Compression algorithms supported: 2024-02-22T00:26:20.658 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: kZSTD supported: 0 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: kXpressCompression supported: 0 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: kZlibCompression supported: 1 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000001 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.merge_operator: 2024-02-22T00:26:20.659 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_filter: None 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556b2e009d10) 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cache_index_and_filter_blocks: 1 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: pin_top_level_index_and_filter: 1 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: index_type: 0 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: data_block_index_type: 0 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: index_shortening: 1 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T00:26:20.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: hash_index_allow_collision: 1 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: checksum: 1 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: no_block_cache: 0 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: block_cache: 0x556b2e03ef10 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: block_cache_name: BinnedLRUCache 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: block_cache_options: 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: capacity : 536870912 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: num_shard_bits : 4 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: strict_capacity_limit : 0 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: high_pri_pool_ratio: 0.000 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: block_cache_compressed: (nil) 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: persistent_cache: (nil) 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: block_size: 4096 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: block_size_deviation: 10 2024-02-22T00:26:20.661 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: block_restart_interval: 16 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: index_block_restart_interval: 1 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: metadata_block_size: 4096 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: partition_filters: 0 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: use_delta_encoding: 1 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: whole_key_filtering: 1 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: verify_compression: 0 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: read_amp_bytes_per_bit: 0 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: format_version: 2 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: enable_index_compression: 1 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: block_align: 0 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T00:26:20.662 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compression: NoCompression 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.num_levels: 7 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:26:20.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T00:26:20.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T00:26:20.665 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.table_properties_collectors: 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T00:26:20.666 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.bloom_locality: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.ttl: 2592000 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.459+0000 7f3ec59dd880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.460+0000 7f3ec59dd880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.667 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.460+0000 7f3ec59dd880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.460+0000 7f3ec59dd880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708561580461198, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.460+0000 7f3ec59dd880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.460+0000 7f3ec59dd880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.460+0000 7f3ec59dd880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708561580461828, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708561580, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.460+0000 7f3ec59dd880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.461+0000 7f3ec59dd880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708561580462349, "job": 1, "event": "recovery_finished"} 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.462+0000 7f3ec59dd880 4 rocksdb: DB pointer 0x556b2e107800 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.462+0000 7f3eac7cf700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.462+0000 7f3eac7cf700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ** DB Stats ** 2024-02-22T00:26:20.668 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ** Compaction Stats [default] ** 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-22T00:26:20.669 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ** Compaction Stats [default] ** 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:26:20.670 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ** Compaction Stats [default] ** 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.671 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ** Compaction Stats [default] ** 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.4 0.00 0.00 1 0.001 0 0 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Cumulative compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T00:26:20.672 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.462+0000 7f3ec59dd880 0 mon.smithi161 does not exist in monmap, will attempt to join an existing cluster 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.462+0000 7f3ec59dd880 0 using public_addr v2:172.21.15.161:0/0 -> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.463+0000 7f3ec59dd880 0 starting mon.smithi161 rank -1 at public addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] at bind addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi161 fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.465+0000 7f3ec59dd880 1 mon.smithi161@-1(???) e0 preinit fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 0 mon.smithi161@-1(synchronizing).mds e1 new map 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 0 mon.smithi161@-1(synchronizing).mds e1 print_map 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: e1 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: legacy client fscid: -1 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.673 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: No filesystems configured 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 1 mon.smithi161@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 1 mon.smithi161@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 1 mon.smithi161@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 1 mon.smithi161@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 1 mon.smithi161@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 1 mon.smithi161@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.493+0000 7f3eaefd4700 1 mon.smithi161@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.494+0000 7f3eaefd4700 0 mon.smithi161@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.494+0000 7f3eaefd4700 0 mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.494+0000 7f3eaefd4700 0 mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.494+0000 7f3eaefd4700 0 mon.smithi161@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T00:26:20.674 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:18.697916+0000 mon.smithi049 (mon.0) 169 : audit [DBG] from='client.? 172.21.15.161:0/465150981' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:26:20.675 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:26:20.494+0000 7f3eaefd4700 1 mon.smithi161@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-02-22T00:26:20.675 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 bash[70359]: f78a00eee4563cb63c2b53aa66d30d83e940048d015490cdbd5bf36cf4610978 2024-02-22T00:26:20.675 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:20 smithi161 systemd[1]: Started Ceph mon.smithi161 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.894+0000 7f7be1f83700 1 -- 172.21.15.161:0/3066814125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 msgr2=0x7f7bc8005870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.894+0000 7f7be1f83700 1 --2- 172.21.15.161:0/3066814125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 0x7f7bc8005870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f7bdc061670 tx=0x7f7bcc00b040).stop 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.894+0000 7f7be1f83700 1 -- 172.21.15.161:0/3066814125 shutdown_connections 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.894+0000 7f7be1f83700 1 --2- 172.21.15.161:0/3066814125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 0x7f7bc8005870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.894+0000 7f7be1f83700 1 -- 172.21.15.161:0/3066814125 >> 172.21.15.161:0/3066814125 conn(0x7f7bdc0f3200 msgr2=0x7f7bdc0f5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.894+0000 7f7be1f83700 1 -- 172.21.15.161:0/3066814125 shutdown_connections 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.894+0000 7f7be1f83700 1 -- 172.21.15.161:0/3066814125 wait complete. 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.895+0000 7f7be1f83700 1 Processor -- start 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.895+0000 7f7be1f83700 1 -- start start 2024-02-22T00:26:25.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.895+0000 7f7be1f83700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 0x7f7bdc06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.895+0000 7f7be1f83700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 0x7f7bdc06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.895+0000 7f7be1f83700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc113af0 con 0x7f7bc8003400 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.895+0000 7f7be1f83700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc113c30 con 0x7f7bdc06b5c0 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 0x7f7bdc06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 0x7f7bdc06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdaffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 0x7f7bdc06ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40382/0 (socket says 172.21.15.161:40382) 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdaffd700 1 -- 172.21.15.161:0/933226181 learned_addr learned my addr 172.21.15.161:0/933226181 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdaffd700 1 -- 172.21.15.161:0/933226181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 msgr2=0x7f7bdc06ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdaffd700 1 -- 172.21.15.161:0/933226181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 msgr2=0x7f7bdc06ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdaffd700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 0x7f7bdc06ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdaffd700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 0x7f7bdc06ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdb7fe700 1 -- 172.21.15.161:0/933226181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 msgr2=0x7f7bdc06ba40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdb7fe700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 0x7f7bdc06ba40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:25.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdb7fe700 1 -- 172.21.15.161:0/933226181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc005040 con 0x7f7bc8003400 2024-02-22T00:26:25.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bdb7fe700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 0x7f7bdc06b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7bdc061670 tx=0x7f7bcc002040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:25.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bd8ff9700 1 -- 172.21.15.161:0/933226181 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bcc004630 con 0x7f7bc8003400 2024-02-22T00:26:25.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bd8ff9700 1 -- 172.21.15.161:0/933226181 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7bcc004c20 con 0x7f7bc8003400 2024-02-22T00:26:25.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7bd8ff9700 1 -- 172.21.15.161:0/933226181 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bcc021d90 con 0x7f7bc8003400 2024-02-22T00:26:25.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc113e30 con 0x7f7bc8003400 2024-02-22T00:26:25.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.896+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc114310 con 0x7f7bc8003400 2024-02-22T00:26:25.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.897+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc05f060 con 0x7f7bc8003400 2024-02-22T00:26:25.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.898+0000 7f7bd8ff9700 1 -- 172.21.15.161:0/933226181 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f7bcc0215b0 con 0x7f7bc8003400 2024-02-22T00:26:25.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.898+0000 7f7bd8ff9700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7bbc0612e0 0x7f7bbc0637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:25.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.899+0000 7f7bd8ff9700 1 -- 172.21.15.161:0/933226181 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f7bcc07dff0 con 0x7f7bc8003400 2024-02-22T00:26:25.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.899+0000 7f7bdaffd700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7bbc0612e0 0x7f7bbc0637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:25.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.899+0000 7f7bdaffd700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7bbc0612e0 0x7f7bbc0637a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7bc4006fd0 tx=0x7f7bc4008040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:25.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:25.903+0000 7f7bd8ff9700 1 -- 172.21.15.161:0/933226181 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7bcc04f570 con 0x7f7bc8003400 2024-02-22T00:26:25.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:20.503902+0000 mon.smithi049 (mon.0) 171 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:26:25.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:20.504153+0000 mon.smithi049 (mon.0) 172 : cluster [INF] mon.smithi049 calling monitor election 2024-02-22T00:26:25.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:20.517196+0000 mon.smithi049 (mon.0) 173 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:20.736251+0000 mon.smithi049 (mon.0) 174 : audit [DBG] from='mgr.? 172.21.15.161:0/1981037617' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:26:25.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:21.500045+0000 mon.smithi049 (mon.0) 175 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:21.754729+0000 mgr.smithi049.rjblpr (mgr.14194) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:22.500211+0000 mon.smithi049 (mon.0) 176 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:22.502038+0000 mon.smithi161 (mon.1) 1 : cluster [INF] mon.smithi161 calling monitor election 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:23.500635+0000 mon.smithi049 (mon.0) 177 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:23.755077+0000 mgr.smithi049.rjblpr (mgr.14194) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:24.500491+0000 mon.smithi049 (mon.0) 178 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:25.500335+0000 mon.smithi049 (mon.0) 179 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.531251+0000 mon.smithi049 (mon.0) 180 : cluster [INF] mon.smithi049 is new leader, mons smithi049,smithi161 in quorum (ranks 0,1) 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.534194+0000 mon.smithi049 (mon.0) 181 : cluster [DBG] monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.546817+0000 mon.smithi049 (mon.0) 182 : cluster [DBG] fsmap 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.546852+0000 mon.smithi049 (mon.0) 183 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.547085+0000 mon.smithi049 (mon.0) 184 : cluster [DBG] mgrmap e17: smithi049.rjblpr(active, since 23s) 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.547245+0000 mon.smithi049 (mon.0) 185 : cluster [INF] overall HEALTH_OK 2024-02-22T00:26:25.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.547751+0000 mon.smithi049 (mon.0) 186 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:26:25.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:25.549134+0000 mon.smithi049 (mon.0) 187 : audit [DBG] from='mgr.? 172.21.15.161:0/1981037617' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:26:25.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:25.550956+0000 mon.smithi049 (mon.0) 188 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:25.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:25.551242+0000 mon.smithi049 (mon.0) 189 : audit [DBG] from='mgr.? 172.21.15.161:0/1981037617' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:26:25.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:25.551715+0000 mon.smithi049 (mon.0) 190 : audit [DBG] from='mgr.? 172.21.15.161:0/1981037617' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:26:25.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:20.503902+0000 mon.smithi049 (mon.0) 171 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:26:25.962 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:20.504153+0000 mon.smithi049 (mon.0) 172 : cluster [INF] mon.smithi049 calling monitor election 2024-02-22T00:26:25.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:20.517196+0000 mon.smithi049 (mon.0) 173 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:20.736251+0000 mon.smithi049 (mon.0) 174 : audit [DBG] from='mgr.? 172.21.15.161:0/1981037617' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:26:25.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:21.500045+0000 mon.smithi049 (mon.0) 175 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:21.754729+0000 mgr.smithi049.rjblpr (mgr.14194) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:25.963 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:22.500211+0000 mon.smithi049 (mon.0) 176 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:22.502038+0000 mon.smithi161 (mon.1) 1 : cluster [INF] mon.smithi161 calling monitor election 2024-02-22T00:26:25.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:23.500635+0000 mon.smithi049 (mon.0) 177 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:23.755077+0000 mgr.smithi049.rjblpr (mgr.14194) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:25.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:24.500491+0000 mon.smithi049 (mon.0) 178 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:25.500335+0000 mon.smithi049 (mon.0) 179 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:25.964 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.531251+0000 mon.smithi049 (mon.0) 180 : cluster [INF] mon.smithi049 is new leader, mons smithi049,smithi161 in quorum (ranks 0,1) 2024-02-22T00:26:25.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.534194+0000 mon.smithi049 (mon.0) 181 : cluster [DBG] monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} 2024-02-22T00:26:25.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.546817+0000 mon.smithi049 (mon.0) 182 : cluster [DBG] fsmap 2024-02-22T00:26:25.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.546852+0000 mon.smithi049 (mon.0) 183 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-22T00:26:25.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.547085+0000 mon.smithi049 (mon.0) 184 : cluster [DBG] mgrmap e17: smithi049.rjblpr(active, since 23s) 2024-02-22T00:26:25.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.547245+0000 mon.smithi049 (mon.0) 185 : cluster [INF] overall HEALTH_OK 2024-02-22T00:26:25.965 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.547751+0000 mon.smithi049 (mon.0) 186 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:26:25.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:25.549134+0000 mon.smithi049 (mon.0) 187 : audit [DBG] from='mgr.? 172.21.15.161:0/1981037617' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:26:25.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:25.550956+0000 mon.smithi049 (mon.0) 188 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:25.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:25.551242+0000 mon.smithi049 (mon.0) 189 : audit [DBG] from='mgr.? 172.21.15.161:0/1981037617' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:26:25.966 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:25.551715+0000 mon.smithi049 (mon.0) 190 : audit [DBG] from='mgr.? 172.21.15.161:0/1981037617' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:26:26.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.157+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7bdc06c7c0 con 0x7f7bc8003400 2024-02-22T00:26:26.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.158+0000 7f7bd8ff9700 1 -- 172.21.15.161:0/933226181 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1009 (secure 0 0 0) 0x7f7bcc025020 con 0x7f7bc8003400 2024-02-22T00:26:26.163 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-02-22T00:26:26.163 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","modified":"2024-02-22T00:26:20.501237Z","created":"2024-02-22T00:24:04.747718Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi049","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi161","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-22T00:26:26.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7bbc0612e0 msgr2=0x7f7bbc0637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:26.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7bbc0612e0 0x7f7bbc0637a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7bc4006fd0 tx=0x7f7bc4008040).stop 2024-02-22T00:26:26.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 msgr2=0x7f7bdc06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:26.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 0x7f7bdc06b0d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7bdc061670 tx=0x7f7bcc002040).stop 2024-02-22T00:26:26.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 shutdown_connections 2024-02-22T00:26:26.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bc8003400 0x7f7bdc06b0d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:26.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7bbc0612e0 0x7f7bbc0637a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:26.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 --2- 172.21.15.161:0/933226181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bdc06b5c0 0x7f7bdc06ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:26.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 >> 172.21.15.161:0/933226181 conn(0x7f7bdc0f3200 msgr2=0x7f7bdc0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:26.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 shutdown_connections 2024-02-22T00:26:26.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:26:26.160+0000 7f7be1f83700 1 -- 172.21.15.161:0/933226181 wait complete. 2024-02-22T00:26:26.166 INFO:teuthology.orchestra.run.smithi161.stderr:dumped monmap epoch 2 2024-02-22T00:26:26.735 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-22T00:26:26.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph config generate-minimal-conf 2024-02-22T00:26:26.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:25.552769+0000 mgr.smithi049.rjblpr (mgr.14194) 10 : cephadm [INF] Deploying daemon node-exporter.smithi161 on smithi161 2024-02-22T00:26:26.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.607516+0000 mon.smithi049 (mon.0) 191 : cluster [DBG] mgrmap e18: smithi049.rjblpr(active, since 23s), standbys: smithi161.sazlam 2024-02-22T00:26:26.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:25.607698+0000 mon.smithi049 (mon.0) 192 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:26:26.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:25.755307+0000 mgr.smithi049.rjblpr (mgr.14194) 11 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:26.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:26.159513+0000 mon.smithi049 (mon.0) 193 : audit [DBG] from='client.? 172.21.15.161:0/933226181' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:26:26.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:26.500854+0000 mon.smithi049 (mon.0) 194 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:27.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:25.552769+0000 mgr.smithi049.rjblpr (mgr.14194) 10 : cephadm [INF] Deploying daemon node-exporter.smithi161 on smithi161 2024-02-22T00:26:27.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.607516+0000 mon.smithi049 (mon.0) 191 : cluster [DBG] mgrmap e18: smithi049.rjblpr(active, since 23s), standbys: smithi161.sazlam 2024-02-22T00:26:27.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:25.607698+0000 mon.smithi049 (mon.0) 192 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:26:27.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:25.755307+0000 mgr.smithi049.rjblpr (mgr.14194) 11 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:27.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:26.159513+0000 mon.smithi049 (mon.0) 193 : audit [DBG] from='client.? 172.21.15.161:0/933226181' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T00:26:27.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:26.500854+0000 mon.smithi049 (mon.0) 194 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:26:28.104 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:26.910490+0000 mon.smithi049 (mon.0) 195 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:28.220 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:26.910490+0000 mon.smithi049 (mon.0) 195 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.617+0000 7f09e1e7e700 1 -- 172.21.15.49:0/3415601896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc0fc540 msgr2=0x7f09dc0fc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.617+0000 7f09e1e7e700 1 --2- 172.21.15.49:0/3415601896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc0fc540 0x7f09dc0fc920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f09cc004770 tx=0x7f09cc009cb0).stop 2024-02-22T00:26:28.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.617+0000 7f09e1e7e700 1 -- 172.21.15.49:0/3415601896 shutdown_connections 2024-02-22T00:26:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.617+0000 7f09e1e7e700 1 --2- 172.21.15.49:0/3415601896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc0fc540 0x7f09dc0fc920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.617+0000 7f09e1e7e700 1 -- 172.21.15.49:0/3415601896 >> 172.21.15.49:0/3415601896 conn(0x7f09dc0f20f0 msgr2=0x7f09dc0f4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.617+0000 7f09e1e7e700 1 -- 172.21.15.49:0/3415601896 shutdown_connections 2024-02-22T00:26:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.617+0000 7f09e1e7e700 1 -- 172.21.15.49:0/3415601896 wait complete. 2024-02-22T00:26:28.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09e1e7e700 1 Processor -- start 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09e1e7e700 1 -- start start 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09e1e7e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0fc540 0x7f09dc108a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09e1e7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc108f20 0x7f09dc1118e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09e1e7e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc109430 con 0x7f09dc108f20 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09e1e7e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc109570 con 0x7f09dc0fc540 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc108f20 0x7f09dc1118e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc108f20 0x7f09dc1118e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58582/0 (socket says 172.21.15.49:58582) 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09daffd700 1 -- 172.21.15.49:0/1156574271 learned_addr learned my addr 172.21.15.49:0/1156574271 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.618+0000 7f09db7fe700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0fc540 0x7f09dc108a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09daffd700 1 -- 172.21.15.49:0/1156574271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0fc540 msgr2=0x7f09dc108a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09daffd700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0fc540 0x7f09dc108a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:28.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09daffd700 1 -- 172.21.15.49:0/1156574271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc005040 con 0x7f09dc108f20 2024-02-22T00:26:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09daffd700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc108f20 0x7f09dc1118e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f09d000b550 tx=0x7f09d00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09d8ff9700 1 -- 172.21.15.49:0/1156574271 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d000f6f0 con 0x7f09dc108f20 2024-02-22T00:26:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09d8ff9700 1 -- 172.21.15.49:0/1156574271 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f09d000fce0 con 0x7f09dc108f20 2024-02-22T00:26:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09d8ff9700 1 -- 172.21.15.49:0/1156574271 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d0011ce0 con 0x7f09dc108f20 2024-02-22T00:26:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc111dd0 con 0x7f09dc108f20 2024-02-22T00:26:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.619+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc112300 con 0x7f09dc108f20 2024-02-22T00:26:28.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.620+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc05fe60 con 0x7f09dc108f20 2024-02-22T00:26:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.620+0000 7f09d8ff9700 1 -- 172.21.15.49:0/1156574271 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f09d000f850 con 0x7f09dc108f20 2024-02-22T00:26:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.621+0000 7f09d8ff9700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f09c40612e0 0x7f09c40637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.621+0000 7f09d8ff9700 1 -- 172.21.15.49:0/1156574271 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f09d007b560 con 0x7f09dc108f20 2024-02-22T00:26:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.621+0000 7f09db7fe700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f09c40612e0 0x7f09c40637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:28.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.621+0000 7f09db7fe700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f09c40612e0 0x7f09c40637a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f09cc004e90 tx=0x7f09cc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:28.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.625+0000 7f09d8ff9700 1 -- 172.21.15.49:0/1156574271 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f09d004cb60 con 0x7f09dc108f20 2024-02-22T00:26:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.797+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f09dc060ed0 con 0x7f09dc108f20 2024-02-22T00:26:28.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.798+0000 7f09d8ff9700 1 -- 172.21.15.49:0/1156574271 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f09d0050180 con 0x7f09dc108f20 2024-02-22T00:26:28.802 INFO:teuthology.orchestra.run.smithi049.stdout:# minimal ceph.conf for 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:26:28.802 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-02-22T00:26:28.802 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:26:28.802 INFO:teuthology.orchestra.run.smithi049.stdout: mon_host = [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] 2024-02-22T00:26:28.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f09c40612e0 msgr2=0x7f09c40637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f09c40612e0 0x7f09c40637a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f09cc004e90 tx=0x7f09cc00b040).stop 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc108f20 msgr2=0x7f09dc1118e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc108f20 0x7f09dc1118e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f09d000b550 tx=0x7f09d00090f0).stop 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 shutdown_connections 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f09c40612e0 0x7f09c40637a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09dc0fc540 0x7f09dc108a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 --2- 172.21.15.49:0/1156574271 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f09dc108f20 0x7f09dc1118e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 >> 172.21.15.49:0/1156574271 conn(0x7f09dc0f20f0 msgr2=0x7f09dc0f2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 shutdown_connections 2024-02-22T00:26:28.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:28.800+0000 7f09e1e7e700 1 -- 172.21.15.49:0/1156574271 wait complete. 2024-02-22T00:26:29.138 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:27.755595+0000 mgr.smithi049.rjblpr (mgr.14194) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:29.138 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:28.799314+0000 mon.smithi049 (mon.0) 196 : audit [DBG] from='client.? 172.21.15.49:0/1156574271' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:29.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:27.755595+0000 mgr.smithi049.rjblpr (mgr.14194) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:29.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:28.799314+0000 mon.smithi049 (mon.0) 196 : audit [DBG] from='client.? 172.21.15.49:0/1156574271' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:29.463 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-22T00:26:29.464 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:26:29.464 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.conf 2024-02-22T00:26:29.496 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:26:29.496 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:26:29.564 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:26:29.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.conf 2024-02-22T00:26:29.596 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:26:29.596 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:26:29.663 INFO:tasks.cephadm:Deploying OSDs... 2024-02-22T00:26:29.663 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:26:29.663 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-02-22T00:26:29.682 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-22T00:26:29.682 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-02-22T00:26:29.740 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-22T00:26:29.740 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T00:26:29.740 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 192028 Links: 1 2024-02-22T00:26:29.740 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:26:29.740 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T00:26:29.741 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-02-22 00:25:52.975290464 +0000 2024-02-22T00:26:29.741 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-02-22 00:12:42.011739028 +0000 2024-02-22T00:26:29.741 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-02-22 00:12:42.011739028 +0000 2024-02-22T00:26:29.741 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-02-22T00:26:29.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-22T00:26:29.806 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-02-22T00:26:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-02-22T00:26:29.807 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 8.2438e-05 s, 6.2 MB/s 2024-02-22T00:26:29.808 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-22T00:26:29.867 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-02-22T00:26:29.925 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-22T00:26:29.925 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T00:26:29.925 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 199797 Links: 1 2024-02-22T00:26:29.925 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:26:29.925 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T00:26:29.926 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-02-22 00:25:52.976290436 +0000 2024-02-22T00:26:29.926 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-02-22 00:12:42.340729914 +0000 2024-02-22T00:26:29.926 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-02-22 00:12:42.340729914 +0000 2024-02-22T00:26:29.926 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-02-22T00:26:29.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-22T00:26:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-02-22T00:26:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-02-22T00:26:29.992 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000107745 s, 4.8 MB/s 2024-02-22T00:26:29.994 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-22T00:26:30.053 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 199863 Links: 1 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-02-22 00:25:52.976290436 +0000 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-02-22 00:12:42.699719967 +0000 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-02-22 00:12:42.699719967 +0000 2024-02-22T00:26:30.111 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-02-22T00:26:30.112 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-22T00:26:30.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:28.929439+0000 mon.smithi049 (mon.0) 197 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:30.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:28.942471+0000 mgr.smithi049.rjblpr (mgr.14194) 13 : cephadm [INF] Deploying daemon prometheus.smithi161 on smithi161 2024-02-22T00:26:30.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-02-22T00:26:30.176 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-02-22T00:26:30.176 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000105034 s, 4.9 MB/s 2024-02-22T00:26:30.177 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-22T00:26:30.236 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-02-22T00:26:30.294 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-22T00:26:30.295 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T00:26:30.295 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 6h/6d Inode: 195533 Links: 1 2024-02-22T00:26:30.295 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:26:30.295 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T00:26:30.295 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-02-22 00:25:52.976290436 +0000 2024-02-22T00:26:30.295 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-02-22 00:12:43.038710576 +0000 2024-02-22T00:26:30.295 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-02-22 00:12:43.038710576 +0000 2024-02-22T00:26:30.295 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-02-22T00:26:30.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-22T00:26:30.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:28.929439+0000 mon.smithi049 (mon.0) 197 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:30.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:28.942471+0000 mgr.smithi049.rjblpr (mgr.14194) 13 : cephadm [INF] Deploying daemon prometheus.smithi161 on smithi161 2024-02-22T00:26:30.361 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-02-22T00:26:30.361 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-02-22T00:26:30.361 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000106743 s, 4.8 MB/s 2024-02-22T00:26:30.362 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-22T00:26:30.421 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:26:30.421 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-02-22T00:26:30.440 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-22T00:26:30.440 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 200723 Links: 1 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-02-22 00:26:26.012756300 +0000 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-22 00:11:19.944523689 +0000 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-22 00:11:19.944523689 +0000 2024-02-22T00:26:30.499 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-22T00:26:30.500 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-22T00:26:30.565 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-02-22T00:26:30.565 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-02-22T00:26:30.565 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000257016 s, 2.0 MB/s 2024-02-22T00:26:30.566 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-22T00:26:30.626 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 200790 Links: 1 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-02-22 00:26:26.012756300 +0000 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-22 00:11:20.265517182 +0000 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-22 00:11:20.265517182 +0000 2024-02-22T00:26:30.684 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-22T00:26:30.685 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-22T00:26:30.749 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-02-22T00:26:30.749 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-02-22T00:26:30.749 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000236184 s, 2.2 MB/s 2024-02-22T00:26:30.750 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-22T00:26:30.809 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-02-22T00:26:30.867 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-22T00:26:30.867 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T00:26:30.867 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 199762 Links: 1 2024-02-22T00:26:30.867 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:26:30.867 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T00:26:30.868 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-02-22 00:26:26.012756300 +0000 2024-02-22T00:26:30.868 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-22 00:11:20.598510431 +0000 2024-02-22T00:26:30.868 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-22 00:11:20.598510431 +0000 2024-02-22T00:26:30.868 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-22T00:26:30.868 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-22T00:26:30.933 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-02-22T00:26:30.933 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-02-22T00:26:30.933 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000171418 s, 3.0 MB/s 2024-02-22T00:26:30.934 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-22T00:26:30.994 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 197192 Links: 1 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-02-22 00:26:26.012756300 +0000 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-22 00:11:20.953503235 +0000 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-22 00:11:20.953503235 +0000 2024-02-22T00:26:31.052 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-22T00:26:31.053 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-22T00:26:31.117 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-02-22T00:26:31.117 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-02-22T00:26:31.117 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000250773 s, 2.0 MB/s 2024-02-22T00:26:31.118 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-22T00:26:31.177 INFO:tasks.cephadm:Deploying osd.0 on smithi049 with /dev/vg_nvme/lv_4... 2024-02-22T00:26:31.177 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-22T00:26:31.208 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:29.755894+0000 mgr.smithi049.rjblpr (mgr.14194) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:31.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:29.755894+0000 mgr.smithi049.rjblpr (mgr.14194) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:33.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:31.756088+0000 mgr.smithi049.rjblpr (mgr.14194) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:33.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:31.914263+0000 mon.smithi049 (mon.0) 198 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:33.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:31.756088+0000 mgr.smithi049.rjblpr (mgr.14194) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:33.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:31.914263+0000 mon.smithi049 (mon.0) 198 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:33.327 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-22T00:26:33.327 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-22T00:26:33.327 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-02-22T00:26:33.327 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-02-22T00:26:33.328 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00899828 s, 1.2 GB/s 2024-02-22T00:26:33.328 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-02-22T00:26:33.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_4 2024-02-22T00:26:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:33.756439+0000 mgr.smithi049.rjblpr (mgr.14194) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:33.756439+0000 mgr.smithi049.rjblpr (mgr.14194) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:35.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.859+0000 7f10dadcd700 1 -- 172.21.15.49:0/1798869586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 msgr2=0x7f10d40f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.859+0000 7f10dadcd700 1 --2- 172.21.15.49:0/1798869586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 0x7f10d40f9110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f10c00047f0 tx=0x7f10c0009cb0).stop 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.859+0000 7f10dadcd700 1 -- 172.21.15.49:0/1798869586 shutdown_connections 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.859+0000 7f10dadcd700 1 --2- 172.21.15.49:0/1798869586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 0x7f10d40f9110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.859+0000 7f10dadcd700 1 --2- 172.21.15.49:0/1798869586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10d40f7a10 0x7f10d40f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.859+0000 7f10dadcd700 1 -- 172.21.15.49:0/1798869586 >> 172.21.15.49:0/1798869586 conn(0x7f10d40f3150 msgr2=0x7f10d40f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.859+0000 7f10dadcd700 1 -- 172.21.15.49:0/1798869586 shutdown_connections 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.859+0000 7f10dadcd700 1 -- 172.21.15.49:0/1798869586 wait complete. 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10dadcd700 1 Processor -- start 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10dadcd700 1 -- start start 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10dadcd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10d40f7a10 0x7f10d4108150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:35.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10dadcd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 0x7f10d4108640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10dadcd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4108bf0 con 0x7f10d40f8cb0 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10dadcd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4108d30 con 0x7f10d40f7a10 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 0x7f10d4108640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 0x7f10d4108640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45024/0 (socket says 172.21.15.49:45024) 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10d3fff700 1 -- 172.21.15.49:0/1731911195 learned_addr learned my addr 172.21.15.49:0/1731911195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10d8b69700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10d40f7a10 0x7f10d4108150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10d3fff700 1 -- 172.21.15.49:0/1731911195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10d40f7a10 msgr2=0x7f10d4108150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10d3fff700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10d40f7a10 0x7f10d4108150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10d3fff700 1 -- 172.21.15.49:0/1731911195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0005040 con 0x7f10d40f8cb0 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.860+0000 7f10d3fff700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 0x7f10d4108640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f10c0013470 tx=0x7f10c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.861+0000 7f10d1ffb700 1 -- 172.21.15.49:0/1731911195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c000e030 con 0x7f10d40f8cb0 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.861+0000 7f10d1ffb700 1 -- 172.21.15.49:0/1731911195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f10c0007e90 con 0x7f10d40f8cb0 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.861+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d410d770 con 0x7f10d40f8cb0 2024-02-22T00:26:35.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.861+0000 7f10d1ffb700 1 -- 172.21.15.49:0/1731911195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10c0018070 con 0x7f10d40f8cb0 2024-02-22T00:26:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.861+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d410dcb0 con 0x7f10d40f8cb0 2024-02-22T00:26:35.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.862+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d405fb50 con 0x7f10d40f8cb0 2024-02-22T00:26:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.862+0000 7f10d1ffb700 1 -- 172.21.15.49:0/1731911195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f10c001d420 con 0x7f10d40f8cb0 2024-02-22T00:26:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.862+0000 7f10d1ffb700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f10c4061110 0x7f10c40635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:26:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.862+0000 7f10d1ffb700 1 -- 172.21.15.49:0/1731911195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f10c007cc40 con 0x7f10d40f8cb0 2024-02-22T00:26:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.862+0000 7f10d8b69700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f10c4061110 0x7f10c40635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:26:35.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.863+0000 7f10d8b69700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f10c4061110 0x7f10c40635d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f10d40f8b10 tx=0x7f10c800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:26:35.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:35.867+0000 7f10d1ffb700 1 -- 172.21.15.49:0/1731911195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f10c0051bf0 con 0x7f10d40f8cb0 2024-02-22T00:26:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:26:36.047+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f10d4102180 con 0x7f10c4061110 2024-02-22T00:26:37.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:35.756781+0000 mgr.smithi049.rjblpr (mgr.14194) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:37.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:36.049654+0000 mgr.smithi049.rjblpr (mgr.14194) 18 : audit [DBG] from='client.14224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:26:37.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:36.052292+0000 mon.smithi049 (mon.0) 199 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:26:37.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:36.054320+0000 mon.smithi049 (mon.0) 200 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:26:37.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:36.054903+0000 mon.smithi049 (mon.0) 201 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:37.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:35.756781+0000 mgr.smithi049.rjblpr (mgr.14194) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:37.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:36.049654+0000 mgr.smithi049.rjblpr (mgr.14194) 18 : audit [DBG] from='client.14224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:26:37.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:36.052292+0000 mon.smithi049 (mon.0) 199 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:26:37.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:36.054320+0000 mon.smithi049 (mon.0) 200 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:26:37.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:36.054903+0000 mon.smithi049 (mon.0) 201 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:39.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:37.757261+0000 mgr.smithi049.rjblpr (mgr.14194) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:39.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:38.423804+0000 mon.smithi049 (mon.0) 202 : audit [INF] from='client.? 172.21.15.49:0/1127557303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14701491-880b-4aa8-b29c-2f93fad67550"}]: dispatch 2024-02-22T00:26:39.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:38.427317+0000 mon.smithi049 (mon.0) 203 : audit [INF] from='client.? 172.21.15.49:0/1127557303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14701491-880b-4aa8-b29c-2f93fad67550"}]': finished 2024-02-22T00:26:39.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:38.427385+0000 mon.smithi049 (mon.0) 204 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-22T00:26:39.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:38.427479+0000 mon.smithi049 (mon.0) 205 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:39.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:37.757261+0000 mgr.smithi049.rjblpr (mgr.14194) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:39.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:38.423804+0000 mon.smithi049 (mon.0) 202 : audit [INF] from='client.? 172.21.15.49:0/1127557303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14701491-880b-4aa8-b29c-2f93fad67550"}]: dispatch 2024-02-22T00:26:39.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:38.427317+0000 mon.smithi049 (mon.0) 203 : audit [INF] from='client.? 172.21.15.49:0/1127557303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14701491-880b-4aa8-b29c-2f93fad67550"}]': finished 2024-02-22T00:26:39.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:38.427385+0000 mon.smithi049 (mon.0) 204 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-02-22T00:26:39.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:38.427479+0000 mon.smithi049 (mon.0) 205 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:40.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:38.999752+0000 mon.smithi049 (mon.0) 206 : audit [DBG] from='client.? 172.21.15.49:0/3060140948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:26:40.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:38.999752+0000 mon.smithi049 (mon.0) 206 : audit [DBG] from='client.? 172.21.15.49:0/3060140948' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:26:41.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:39.757561+0000 mgr.smithi049.rjblpr (mgr.14194) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:41.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:40.090578+0000 mon.smithi049 (mon.0) 207 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:41.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:40.091466+0000 mon.smithi049 (mon.0) 208 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:26:41.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:39.757561+0000 mgr.smithi049.rjblpr (mgr.14194) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:41.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:40.090578+0000 mon.smithi049 (mon.0) 207 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:41.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:40.091466+0000 mon.smithi049 (mon.0) 208 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:26:43.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:41.757825+0000 mgr.smithi049.rjblpr (mgr.14194) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:43.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:41.919793+0000 mon.smithi049 (mon.0) 209 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:43.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:41.757825+0000 mgr.smithi049.rjblpr (mgr.14194) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:43.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:41.919793+0000 mon.smithi049 (mon.0) 209 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.232 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:42.988457+0000 mon.smithi049 (mon.0) 210 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.232 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:42.989065+0000 mon.smithi049 (mon.0) 211 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:44.232 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:42.989643+0000 mon.smithi049 (mon.0) 212 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:26:44.232 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:42.990456+0000 mgr.smithi049.rjblpr (mgr.14194) 22 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:26:44.232 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:42.990667+0000 mgr.smithi049.rjblpr (mgr.14194) 23 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:26:44.232 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:43.007124+0000 mon.smithi049 (mon.0) 213 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.233 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:43.020025+0000 mon.smithi049 (mon.0) 214 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.233 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:43.022642+0000 mon.smithi049 (mon.0) 215 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.233 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:43.025213+0000 mgr.smithi049.rjblpr (mgr.14194) 24 : cephadm [INF] Reconfiguring mon.smithi049 (unknown last config time)... 2024-02-22T00:26:44.233 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:43.025420+0000 mon.smithi049 (mon.0) 216 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:26:44.233 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:43.025935+0000 mon.smithi049 (mon.0) 217 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:26:44.233 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:43.026427+0000 mon.smithi049 (mon.0) 218 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:44.233 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:43.026874+0000 mgr.smithi049.rjblpr (mgr.14194) 25 : cephadm [INF] Reconfiguring daemon mon.smithi049 on smithi049 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:42.988457+0000 mon.smithi049 (mon.0) 210 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:42.989065+0000 mon.smithi049 (mon.0) 211 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:42.989643+0000 mon.smithi049 (mon.0) 212 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:42.990456+0000 mgr.smithi049.rjblpr (mgr.14194) 22 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:42.990667+0000 mgr.smithi049.rjblpr (mgr.14194) 23 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:43.007124+0000 mon.smithi049 (mon.0) 213 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:43.020025+0000 mon.smithi049 (mon.0) 214 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:43.022642+0000 mon.smithi049 (mon.0) 215 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:44.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:43.025213+0000 mgr.smithi049.rjblpr (mgr.14194) 24 : cephadm [INF] Reconfiguring mon.smithi049 (unknown last config time)... 2024-02-22T00:26:44.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:43.025420+0000 mon.smithi049 (mon.0) 216 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:26:44.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:43.025935+0000 mon.smithi049 (mon.0) 217 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:26:44.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:43.026427+0000 mon.smithi049 (mon.0) 218 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:44.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:43.026874+0000 mgr.smithi049.rjblpr (mgr.14194) 25 : cephadm [INF] Reconfiguring daemon mon.smithi049 on smithi049 2024-02-22T00:26:45.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:43.758155+0000 mgr.smithi049.rjblpr (mgr.14194) 26 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:45.343 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:43.758155+0000 mgr.smithi049.rjblpr (mgr.14194) 26 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:46.091 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:45.084985+0000 mon.smithi049 (mon.0) 219 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:46.091 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:45.085565+0000 mgr.smithi049.rjblpr (mgr.14194) 27 : cephadm [INF] Reconfiguring mgr.smithi049.rjblpr (unknown last config time)... 2024-02-22T00:26:46.091 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:45.085829+0000 mon.smithi049 (mon.0) 220 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rjblpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:26:46.091 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:45.086613+0000 mon.smithi049 (mon.0) 221 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:26:46.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:45.087188+0000 mon.smithi049 (mon.0) 222 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:46.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:45.087722+0000 mgr.smithi049.rjblpr (mgr.14194) 28 : cephadm [INF] Reconfiguring daemon mgr.smithi049.rjblpr on smithi049 2024-02-22T00:26:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:45.084985+0000 mon.smithi049 (mon.0) 219 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:45.085565+0000 mgr.smithi049.rjblpr (mgr.14194) 27 : cephadm [INF] Reconfiguring mgr.smithi049.rjblpr (unknown last config time)... 2024-02-22T00:26:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:45.085829+0000 mon.smithi049 (mon.0) 220 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rjblpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:26:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:45.086613+0000 mon.smithi049 (mon.0) 221 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:26:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:45.087188+0000 mon.smithi049 (mon.0) 222 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:45.087722+0000 mgr.smithi049.rjblpr (mgr.14194) 28 : cephadm [INF] Reconfiguring daemon mgr.smithi049.rjblpr on smithi049 2024-02-22T00:26:47.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:45.758385+0000 mgr.smithi049.rjblpr (mgr.14194) 29 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:47.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:46.474551+0000 mon.smithi049 (mon.0) 223 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T00:26:47.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:46.475318+0000 mon.smithi049 (mon.0) 224 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:47.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:45.758385+0000 mgr.smithi049.rjblpr (mgr.14194) 29 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:47.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:46.474551+0000 mon.smithi049 (mon.0) 223 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T00:26:47.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:46.475318+0000 mon.smithi049 (mon.0) 224 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:48.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:46.475904+0000 mgr.smithi049.rjblpr (mgr.14194) 30 : cephadm [INF] Deploying daemon osd.0 on smithi049 2024-02-22T00:26:48.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:47.907559+0000 mon.smithi049 (mon.0) 225 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:48.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:46.475904+0000 mgr.smithi049.rjblpr (mgr.14194) 30 : cephadm [INF] Deploying daemon osd.0 on smithi049 2024-02-22T00:26:48.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:47.907559+0000 mon.smithi049 (mon.0) 225 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:49.250 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:47.758608+0000 mgr.smithi049.rjblpr (mgr.14194) 31 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:49.251 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:47.908149+0000 mgr.smithi049.rjblpr (mgr.14194) 32 : cephadm [INF] Reconfiguring alertmanager.smithi049 (dependencies changed)... 2024-02-22T00:26:49.251 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:47.914027+0000 mgr.smithi049.rjblpr (mgr.14194) 33 : cephadm [INF] Reconfiguring daemon alertmanager.smithi049 on smithi049 2024-02-22T00:26:49.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:47.758608+0000 mgr.smithi049.rjblpr (mgr.14194) 31 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:49.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:47.908149+0000 mgr.smithi049.rjblpr (mgr.14194) 32 : cephadm [INF] Reconfiguring alertmanager.smithi049 (dependencies changed)... 2024-02-22T00:26:49.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:47.914027+0000 mgr.smithi049.rjblpr (mgr.14194) 33 : cephadm [INF] Reconfiguring daemon alertmanager.smithi049 on smithi049 2024-02-22T00:26:51.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:49.758831+0000 mgr.smithi049.rjblpr (mgr.14194) 34 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:51.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:49.758831+0000 mgr.smithi049.rjblpr (mgr.14194) 34 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:53.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:51.759076+0000 mgr.smithi049.rjblpr (mgr.14194) 35 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:53.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:51.759076+0000 mgr.smithi049.rjblpr (mgr.14194) 35 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:54.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:53.100629+0000 mon.smithi049 (mon.0) 226 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:54.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:53.100629+0000 mon.smithi049 (mon.0) 226 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:55.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:53.759396+0000 mgr.smithi049.rjblpr (mgr.14194) 36 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:55.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:53.759396+0000 mgr.smithi049.rjblpr (mgr.14194) 36 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:57.240 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:55.759733+0000 mgr.smithi049.rjblpr (mgr.14194) 37 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:57.240 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:56.974671+0000 mon.smithi049 (mon.0) 227 : audit [INF] from='osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T00:26:57.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:55.759733+0000 mgr.smithi049.rjblpr (mgr.14194) 37 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:57.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:56.974671+0000 mon.smithi049 (mon.0) 227 : audit [INF] from='osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T00:26:58.371 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:57.111328+0000 mon.smithi049 (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T00:26:58.371 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:57.111376+0000 mon.smithi049 (mon.0) 229 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-22T00:26:58.371 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:57.111668+0000 mon.smithi049 (mon.0) 230 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:58.371 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:57.111955+0000 mon.smithi049 (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:26:58.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:57.111328+0000 mon.smithi049 (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T00:26:58.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:57.111376+0000 mon.smithi049 (mon.0) 229 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-02-22T00:26:58.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:57.111668+0000 mon.smithi049 (mon.0) 230 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:58.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:57.111955+0000 mon.smithi049 (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:57.759957+0000 mgr.smithi049.rjblpr (mgr.14194) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:58.112706+0000 mon.smithi049 (mon.0) 232 : audit [INF] from='osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:58.112753+0000 mon.smithi049 (mon.0) 233 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:58.112849+0000 mon.smithi049 (mon.0) 234 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:58.116515+0000 mon.smithi049 (mon.0) 235 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:58.669397+0000 mon.smithi049 (mon.0) 236 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:58.670121+0000 mon.smithi049 (mon.0) 237 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:58.670757+0000 mon.smithi049 (mon.0) 238 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:59.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:26:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:59.116004+0000 mon.smithi049 (mon.0) 239 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:59.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:57.759957+0000 mgr.smithi049.rjblpr (mgr.14194) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:26:59.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:58.112706+0000 mon.smithi049 (mon.0) 232 : audit [INF] from='osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-02-22T00:26:59.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:58.112753+0000 mon.smithi049 (mon.0) 233 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-02-22T00:26:59.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:58.112849+0000 mon.smithi049 (mon.0) 234 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:59.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:58.116515+0000 mon.smithi049 (mon.0) 235 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:26:59.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:58.669397+0000 mon.smithi049 (mon.0) 236 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:26:59.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:58.670121+0000 mon.smithi049 (mon.0) 237 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:26:59.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:58.670757+0000 mon.smithi049 (mon.0) 238 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:26:59.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:26:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:59.116004+0000 mon.smithi049 (mon.0) 239 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:27:00.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.069+0000 7f10d1ffb700 1 -- 172.21.15.49:0/1731911195 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f10d4102180 con 0x7f10c4061110 2024-02-22T00:27:00.074 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 0 on host 'smithi049' 2024-02-22T00:27:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f10c4061110 msgr2=0x7f10c40635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:27:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f10c4061110 0x7f10c40635d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f10d40f8b10 tx=0x7f10c800b040).stop 2024-02-22T00:27:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 msgr2=0x7f10d4108640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:27:00.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 0x7f10d4108640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f10c0013470 tx=0x7f10c0009cb0).stop 2024-02-22T00:27:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 shutdown_connections 2024-02-22T00:27:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f10c4061110 0x7f10c40635d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10d40f7a10 0x7f10d4108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 --2- 172.21.15.49:0/1731911195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d40f8cb0 0x7f10d4108640 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.071+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 >> 172.21.15.49:0/1731911195 conn(0x7f10d40f3150 msgr2=0x7f10d40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:27:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.072+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 shutdown_connections 2024-02-22T00:27:00.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:00.072+0000 7f10dadcd700 1 -- 172.21.15.49:0/1731911195 wait complete. 2024-02-22T00:27:00.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:57.942557+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:27:00.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:57.942619+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:27:00.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:58.669869+0000 mgr.smithi049.rjblpr (mgr.14194) 39 : cephadm [INF] Reconfiguring crash.smithi049 (monmap changed)... 2024-02-22T00:27:00.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:26:58.671243+0000 mgr.smithi049.rjblpr (mgr.14194) 40 : cephadm [INF] Reconfiguring daemon crash.smithi049 on smithi049 2024-02-22T00:27:00.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:59.123418+0000 mon.smithi049 (mon.0) 240 : cluster [INF] osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] boot 2024-02-22T00:27:00.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:59.123455+0000 mon.smithi049 (mon.0) 241 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-22T00:27:00.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:26:59.123719+0000 mon.smithi049 (mon.0) 242 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:27:00.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:00.070323+0000 mon.smithi049 (mon.0) 243 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:00.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:57.942557+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:27:00.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:57.942619+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:27:00.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:58.669869+0000 mgr.smithi049.rjblpr (mgr.14194) 39 : cephadm [INF] Reconfiguring crash.smithi049 (monmap changed)... 2024-02-22T00:27:00.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:26:58.671243+0000 mgr.smithi049.rjblpr (mgr.14194) 40 : cephadm [INF] Reconfiguring daemon crash.smithi049 on smithi049 2024-02-22T00:27:00.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:59.123418+0000 mon.smithi049 (mon.0) 240 : cluster [INF] osd.0 [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] boot 2024-02-22T00:27:00.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:59.123455+0000 mon.smithi049 (mon.0) 241 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-02-22T00:27:00.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:26:59.123719+0000 mon.smithi049 (mon.0) 242 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:27:00.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:00.070323+0000 mon.smithi049 (mon.0) 243 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:01.310 DEBUG:teuthology.orchestra.run.smithi049:osd.0> sudo journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.0.service 2024-02-22T00:27:01.312 INFO:tasks.cephadm:Deploying osd.1 on smithi049 with /dev/vg_nvme/lv_3... 2024-02-22T00:27:01.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-22T00:27:01.347 INFO:journalctl@ceph.osd.0.smithi049.stdout:-- Logs begin at Wed 2024-02-21 23:57:02 UTC. -- 2024-02-22T00:27:01.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:26:59.760213+0000 mgr.smithi049.rjblpr (mgr.14194) 41 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:27:01.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:00.128442+0000 mon.smithi049 (mon.0) 244 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-22T00:27:01.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:26:59.760213+0000 mgr.smithi049.rjblpr (mgr.14194) 41 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T00:27:01.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:00.128442+0000 mon.smithi049 (mon.0) 244 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-22T00:27:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:01.742208+0000 mon.smithi049 (mon.0) 245 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:01.742890+0000 mgr.smithi049.rjblpr (mgr.14194) 42 : cephadm [INF] Reconfiguring grafana.smithi049 (dependencies changed)... 2024-02-22T00:27:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:01.760475+0000 mgr.smithi049.rjblpr (mgr.14194) 43 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:01.777232+0000 mgr.smithi049.rjblpr (mgr.14194) 44 : cephadm [INF] Reconfiguring daemon grafana.smithi049 on smithi049 2024-02-22T00:27:03.136 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:01.742208+0000 mon.smithi049 (mon.0) 245 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:03.137 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:01.742890+0000 mgr.smithi049.rjblpr (mgr.14194) 42 : cephadm [INF] Reconfiguring grafana.smithi049 (dependencies changed)... 2024-02-22T00:27:03.137 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:01.760475+0000 mgr.smithi049.rjblpr (mgr.14194) 43 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:03.137 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:01.777232+0000 mgr.smithi049.rjblpr (mgr.14194) 44 : cephadm [INF] Reconfiguring daemon grafana.smithi049 on smithi049 2024-02-22T00:27:05.159 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:03.760934+0000 mgr.smithi049.rjblpr (mgr.14194) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:05.279 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-22T00:27:05.279 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-22T00:27:05.279 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-02-22T00:27:05.279 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-02-22T00:27:05.279 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00924711 s, 1.1 GB/s 2024-02-22T00:27:05.279 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-02-22T00:27:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:03.760934+0000 mgr.smithi049.rjblpr (mgr.14194) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:05.819 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_3 2024-02-22T00:27:07.038 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:05.761229+0000 mgr.smithi049.rjblpr (mgr.14194) 46 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:07.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:05.761229+0000 mgr.smithi049.rjblpr (mgr.14194) 46 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.587+0000 7f573bb44700 1 -- 172.21.15.49:0/2106439960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 msgr2=0x7f57340fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:27:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.587+0000 7f573bb44700 1 --2- 172.21.15.49:0/2106439960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 0x7f57340fa3d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f57300047f0 tx=0x7f5730009cb0).stop 2024-02-22T00:27:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 -- 172.21.15.49:0/2106439960 shutdown_connections 2024-02-22T00:27:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 --2- 172.21.15.49:0/2106439960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57340fa950 0x7f57340fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:08.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 --2- 172.21.15.49:0/2106439960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 0x7f57340fa3d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 -- 172.21.15.49:0/2106439960 >> 172.21.15.49:0/2106439960 conn(0x7f57340f1e50 msgr2=0x7f57340f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 -- 172.21.15.49:0/2106439960 shutdown_connections 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 -- 172.21.15.49:0/2106439960 wait complete. 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 Processor -- start 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 -- start start 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 0x7f57340f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57340fa950 0x7f57340f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57340f8220 con 0x7f5734061280 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.588+0000 7f573bb44700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57340f67c0 con 0x7f57340fa950 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57398e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 0x7f57340f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:27:08.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57398e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 0x7f57340f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36586/0 (socket says 172.21.15.49:36586) 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57398e0700 1 -- 172.21.15.49:0/320151714 learned_addr learned my addr 172.21.15.49:0/320151714 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57390df700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57340fa950 0x7f57340f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57398e0700 1 -- 172.21.15.49:0/320151714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57340fa950 msgr2=0x7f57340f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57398e0700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57340fa950 0x7f57340f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57398e0700 1 -- 172.21.15.49:0/320151714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730005040 con 0x7f5734061280 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57390df700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57340fa950 0x7f57340f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f57398e0700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 0x7f57340f7c70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f5730013510 tx=0x7f5730009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f572affd700 1 -- 172.21.15.49:0/320151714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f573000e030 con 0x7f5734061280 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f572affd700 1 -- 172.21.15.49:0/320151714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5730007e90 con 0x7f5734061280 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57340f69e0 con 0x7f5734061280 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f572affd700 1 -- 172.21.15.49:0/320151714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5730018070 con 0x7f5734061280 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.589+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57340f6ec0 con 0x7f5734061280 2024-02-22T00:27:08.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.590+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57340f70e0 con 0x7f5734061280 2024-02-22T00:27:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.591+0000 7f572affd700 1 -- 172.21.15.49:0/320151714 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f573001da20 con 0x7f5734061280 2024-02-22T00:27:08.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.591+0000 7f572affd700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5720061180 0x7f5720063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:27:08.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.591+0000 7f572affd700 1 -- 172.21.15.49:0/320151714 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1849+0+0 (secure 0 0 0) 0x7f573007d0e0 con 0x7f5734061280 2024-02-22T00:27:08.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.591+0000 7f57390df700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5720061180 0x7f5720063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:27:08.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.592+0000 7f57390df700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5720061180 0x7f5720063640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5724007fd0 tx=0x7f5724009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:27:08.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.596+0000 7f572affd700 1 -- 172.21.15.49:0/320151714 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5730051e30 con 0x7f5734061280 2024-02-22T00:27:08.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:08.781+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5734059120 con 0x7f5720061180 2024-02-22T00:27:09.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:07.761468+0000 mgr.smithi049.rjblpr (mgr.14194) 47 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:09.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:08.785172+0000 mon.smithi049 (mon.0) 246 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:27:09.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:08.787026+0000 mon.smithi049 (mon.0) 247 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:27:09.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:08.787578+0000 mon.smithi049 (mon.0) 248 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:09.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:08.798728+0000 mon.smithi049 (mon.0) 249 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:09.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:08.800616+0000 mon.smithi049 (mon.0) 250 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:27:09.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:08.801292+0000 mon.smithi049 (mon.0) 251 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:09.226 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:07.761468+0000 mgr.smithi049.rjblpr (mgr.14194) 47 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:09.226 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:08.785172+0000 mon.smithi049 (mon.0) 246 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:27:09.226 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:08.787026+0000 mon.smithi049 (mon.0) 247 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:27:09.227 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:08.787578+0000 mon.smithi049 (mon.0) 248 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:09.227 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:08.798728+0000 mon.smithi049 (mon.0) 249 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:09.227 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:08.800616+0000 mon.smithi049 (mon.0) 250 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:27:09.227 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:08.801292+0000 mon.smithi049 (mon.0) 251 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:10.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:08.783150+0000 mgr.smithi049.rjblpr (mgr.14194) 48 : audit [DBG] from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:27:10.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:08.800339+0000 mgr.smithi049.rjblpr (mgr.14194) 49 : cephadm [INF] Reconfiguring crash.smithi161 (monmap changed)... 2024-02-22T00:27:10.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:08.801783+0000 mgr.smithi049.rjblpr (mgr.14194) 50 : cephadm [INF] Reconfiguring daemon crash.smithi161 on smithi161 2024-02-22T00:27:10.185 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:08.783150+0000 mgr.smithi049.rjblpr (mgr.14194) 48 : audit [DBG] from='client.14242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:27:10.185 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:08.800339+0000 mgr.smithi049.rjblpr (mgr.14194) 49 : cephadm [INF] Reconfiguring crash.smithi161 (monmap changed)... 2024-02-22T00:27:10.185 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:08.801783+0000 mgr.smithi049.rjblpr (mgr.14194) 50 : cephadm [INF] Reconfiguring daemon crash.smithi161 on smithi161 2024-02-22T00:27:11.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:09.761845+0000 mgr.smithi049.rjblpr (mgr.14194) 51 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:11.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:10.225871+0000 mon.smithi049 (mon.0) 252 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:11.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:10.226495+0000 mgr.smithi049.rjblpr (mgr.14194) 52 : cephadm [INF] Reconfiguring mgr.smithi161.sazlam (monmap changed)... 2024-02-22T00:27:11.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:10.226801+0000 mon.smithi049 (mon.0) 253 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:27:11.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:10.227537+0000 mon.smithi049 (mon.0) 254 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:27:11.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:10.228261+0000 mon.smithi049 (mon.0) 255 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:11.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:10.228898+0000 mgr.smithi049.rjblpr (mgr.14194) 53 : cephadm [INF] Reconfiguring daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:27:11.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:11.201831+0000 mon.smithi049 (mon.0) 256 : audit [INF] from='client.? 172.21.15.49:0/1815516286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a984f0c-ab4d-4881-baf7-7821af596292"}]: dispatch 2024-02-22T00:27:11.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:11.205485+0000 mon.smithi049 (mon.0) 257 : audit [INF] from='client.? 172.21.15.49:0/1815516286' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a984f0c-ab4d-4881-baf7-7821af596292"}]': finished 2024-02-22T00:27:11.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:11.205530+0000 mon.smithi049 (mon.0) 258 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-22T00:27:11.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:11.205657+0000 mon.smithi049 (mon.0) 259 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:09.761845+0000 mgr.smithi049.rjblpr (mgr.14194) 51 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:10.225871+0000 mon.smithi049 (mon.0) 252 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:10.226495+0000 mgr.smithi049.rjblpr (mgr.14194) 52 : cephadm [INF] Reconfiguring mgr.smithi161.sazlam (monmap changed)... 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:10.226801+0000 mon.smithi049 (mon.0) 253 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:10.227537+0000 mon.smithi049 (mon.0) 254 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:10.228261+0000 mon.smithi049 (mon.0) 255 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:10.228898+0000 mgr.smithi049.rjblpr (mgr.14194) 53 : cephadm [INF] Reconfiguring daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:11.201831+0000 mon.smithi049 (mon.0) 256 : audit [INF] from='client.? 172.21.15.49:0/1815516286' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a984f0c-ab4d-4881-baf7-7821af596292"}]: dispatch 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:11.205485+0000 mon.smithi049 (mon.0) 257 : audit [INF] from='client.? 172.21.15.49:0/1815516286' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a984f0c-ab4d-4881-baf7-7821af596292"}]': finished 2024-02-22T00:27:11.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:11.205530+0000 mon.smithi049 (mon.0) 258 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-02-22T00:27:11.681 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:11.205657+0000 mon.smithi049 (mon.0) 259 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:12.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:11.599090+0000 mon.smithi049 (mon.0) 260 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:12.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:11.599594+0000 mgr.smithi049.rjblpr (mgr.14194) 54 : cephadm [INF] Reconfiguring mon.smithi161 (monmap changed)... 2024-02-22T00:27:12.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:11.599799+0000 mon.smithi049 (mon.0) 261 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:27:12.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:11.600334+0000 mon.smithi049 (mon.0) 262 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:27:12.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:11.600816+0000 mon.smithi049 (mon.0) 263 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:12.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:11.601269+0000 mgr.smithi049.rjblpr (mgr.14194) 55 : cephadm [INF] Reconfiguring daemon mon.smithi161 on smithi161 2024-02-22T00:27:12.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:11.762094+0000 mgr.smithi049.rjblpr (mgr.14194) 56 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:12.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:11.818597+0000 mon.smithi049 (mon.0) 264 : audit [DBG] from='client.? 172.21.15.49:0/4025787263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:27:12.957 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:11.599090+0000 mon.smithi049 (mon.0) 260 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:12.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:11.599594+0000 mgr.smithi049.rjblpr (mgr.14194) 54 : cephadm [INF] Reconfiguring mon.smithi161 (monmap changed)... 2024-02-22T00:27:12.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:11.599799+0000 mon.smithi049 (mon.0) 261 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:27:12.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:11.600334+0000 mon.smithi049 (mon.0) 262 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:27:12.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:11.600816+0000 mon.smithi049 (mon.0) 263 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:12.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:11.601269+0000 mgr.smithi049.rjblpr (mgr.14194) 55 : cephadm [INF] Reconfiguring daemon mon.smithi161 on smithi161 2024-02-22T00:27:12.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:11.762094+0000 mgr.smithi049.rjblpr (mgr.14194) 56 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:12.958 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:11.818597+0000 mon.smithi049 (mon.0) 264 : audit [DBG] from='client.? 172.21.15.49:0/4025787263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:27:14.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:12.997631+0000 mon.smithi049 (mon.0) 265 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:14.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.000348+0000 mon.smithi049 (mon.0) 266 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:27:14.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.000670+0000 mgr.smithi049.rjblpr (mgr.14194) 57 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:27:14.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.001453+0000 mon.smithi049 (mon.0) 267 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T00:27:14.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.001687+0000 mgr.smithi049.rjblpr (mgr.14194) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T00:27:14.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.005213+0000 mon.smithi049 (mon.0) 268 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:14.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.011268+0000 mon.smithi049 (mon.0) 269 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.011615+0000 mgr.smithi049.rjblpr (mgr.14194) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.015056+0000 mon.smithi049 (mon.0) 270 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.015329+0000 mgr.smithi049.rjblpr (mgr.14194) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.019053+0000 mon.smithi049 (mon.0) 271 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.023443+0000 mon.smithi049 (mon.0) 272 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.023789+0000 mgr.smithi049.rjblpr (mgr.14194) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.026520+0000 mon.smithi049 (mon.0) 273 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi161.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.026805+0000 mgr.smithi049.rjblpr (mgr.14194) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi161.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.031624+0000 mon.smithi049 (mon.0) 274 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:14.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:13.033985+0000 mon.smithi049 (mon.0) 275 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:12.997631+0000 mon.smithi049 (mon.0) 265 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.000348+0000 mon.smithi049 (mon.0) 266 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.000670+0000 mgr.smithi049.rjblpr (mgr.14194) 57 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.001453+0000 mon.smithi049 (mon.0) 267 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.001687+0000 mgr.smithi049.rjblpr (mgr.14194) 58 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi049.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.005213+0000 mon.smithi049 (mon.0) 268 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.011268+0000 mon.smithi049 (mon.0) 269 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.011615+0000 mgr.smithi049.rjblpr (mgr.14194) 59 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:27:14.359 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.015056+0000 mon.smithi049 (mon.0) 270 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2024-02-22T00:27:14.360 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.015329+0000 mgr.smithi049.rjblpr (mgr.14194) 60 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi049.front.sepia.ceph.com:3000"}]: dispatch 2024-02-22T00:27:14.360 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.019053+0000 mon.smithi049 (mon.0) 271 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:14.360 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.023443+0000 mon.smithi049 (mon.0) 272 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:27:14.360 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.023789+0000 mgr.smithi049.rjblpr (mgr.14194) 61 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:27:14.360 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.026520+0000 mon.smithi049 (mon.0) 273 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi161.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T00:27:14.360 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.026805+0000 mgr.smithi049.rjblpr (mgr.14194) 62 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi161.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T00:27:14.360 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.031624+0000 mon.smithi049 (mon.0) 274 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:14.360 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:13.033985+0000 mon.smithi049 (mon.0) 275 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:15.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:13.762421+0000 mgr.smithi049.rjblpr (mgr.14194) 63 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:15.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:13.762421+0000 mgr.smithi049.rjblpr (mgr.14194) 63 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:17.042 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:15.695470+0000 mon.smithi049 (mon.0) 276 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:17.042 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:15.762668+0000 mgr.smithi049.rjblpr (mgr.14194) 64 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:17.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:15.695470+0000 mon.smithi049 (mon.0) 276 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:17.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:15.762668+0000 mgr.smithi049.rjblpr (mgr.14194) 64 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:18.333 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:17.097112+0000 mon.smithi049 (mon.0) 277 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:18.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:17.097112+0000 mon.smithi049 (mon.0) 277 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:19.352 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:17.762976+0000 mgr.smithi049.rjblpr (mgr.14194) 65 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:19.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:17.762976+0000 mgr.smithi049.rjblpr (mgr.14194) 65 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:21.414 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:19.763262+0000 mgr.smithi049.rjblpr (mgr.14194) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:21.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:20.473457+0000 mon.smithi049 (mon.0) 278 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T00:27:21.415 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:20.474075+0000 mon.smithi049 (mon.0) 279 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:19.763262+0000 mgr.smithi049.rjblpr (mgr.14194) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:21.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:20.473457+0000 mon.smithi049 (mon.0) 278 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T00:27:21.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:20.474075+0000 mon.smithi049 (mon.0) 279 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:20.474642+0000 mgr.smithi049.rjblpr (mgr.14194) 67 : cephadm [INF] Deploying daemon osd.1 on smithi049 2024-02-22T00:27:22.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:20.474642+0000 mgr.smithi049.rjblpr (mgr.14194) 67 : cephadm [INF] Deploying daemon osd.1 on smithi049 2024-02-22T00:27:23.346 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:21.763916+0000 mgr.smithi049.rjblpr (mgr.14194) 68 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:23.347 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:22.382206+0000 mon.smithi049 (mon.0) 280 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:23.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:21.763916+0000 mgr.smithi049.rjblpr (mgr.14194) 68 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:23.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:22.382206+0000 mon.smithi049 (mon.0) 280 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:24.305 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:22.377726+0000 mgr.smithi049.rjblpr (mgr.14194) 69 : cephadm [INF] Detected new or changed devices on smithi049 2024-02-22T00:27:24.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:23.517563+0000 mon.smithi049 (mon.0) 281 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:27:24.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:23.521904+0000 mon.smithi049 (mon.0) 282 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:24.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:23.522723+0000 mon.smithi049 (mon.0) 283 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:24.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:23.523323+0000 mon.smithi049 (mon.0) 284 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:27:24.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:23.526946+0000 mon.smithi049 (mon.0) 285 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:24.306 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:23.530406+0000 mon.smithi049 (mon.0) 286 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:24.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:22.377726+0000 mgr.smithi049.rjblpr (mgr.14194) 69 : cephadm [INF] Detected new or changed devices on smithi049 2024-02-22T00:27:24.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:23.517563+0000 mon.smithi049 (mon.0) 281 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:27:24.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:23.521904+0000 mon.smithi049 (mon.0) 282 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:24.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:23.522723+0000 mon.smithi049 (mon.0) 283 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:24.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:23.523323+0000 mon.smithi049 (mon.0) 284 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:27:24.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:23.526946+0000 mon.smithi049 (mon.0) 285 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:24.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:23.530406+0000 mon.smithi049 (mon.0) 286 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:25.255 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:23.518114+0000 mgr.smithi049.rjblpr (mgr.14194) 70 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 13922M 2024-02-22T00:27:25.255 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:23.764187+0000 mgr.smithi049.rjblpr (mgr.14194) 71 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:25.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:23.518114+0000 mgr.smithi049.rjblpr (mgr.14194) 70 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 13922M 2024-02-22T00:27:25.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:23.764187+0000 mgr.smithi049.rjblpr (mgr.14194) 71 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:27.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:25.764447+0000 mgr.smithi049.rjblpr (mgr.14194) 72 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:27.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:26.104000+0000 mon.smithi049 (mon.0) 287 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:27.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:25.764447+0000 mgr.smithi049.rjblpr (mgr.14194) 72 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:27.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:26.104000+0000 mon.smithi049 (mon.0) 287 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:29.363 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:27.765014+0000 mgr.smithi049.rjblpr (mgr.14194) 73 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:29.363 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:28.838388+0000 mon.smithi049 (mon.0) 288 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:29.363 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:28.839238+0000 mon.smithi049 (mon.0) 289 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:29.363 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:28.840040+0000 mon.smithi049 (mon.0) 290 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:27:29.363 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:28.844466+0000 mon.smithi049 (mon.0) 291 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:29.363 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:28.847822+0000 mon.smithi049 (mon.0) 292 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T00:27:29.363 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:28.849156+0000 mon.smithi049 (mon.0) 293 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:29.363 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:28.853106+0000 mon.smithi049 (mon.0) 294 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:29.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:27.765014+0000 mgr.smithi049.rjblpr (mgr.14194) 73 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:29.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:28.838388+0000 mon.smithi049 (mon.0) 288 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:29.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:28.839238+0000 mon.smithi049 (mon.0) 289 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:29.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:28.840040+0000 mon.smithi049 (mon.0) 290 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:27:29.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:28.844466+0000 mon.smithi049 (mon.0) 291 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:29.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:28.847822+0000 mon.smithi049 (mon.0) 292 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T00:27:29.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:28.849156+0000 mon.smithi049 (mon.0) 293 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:29.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:28.853106+0000 mon.smithi049 (mon.0) 294 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:30.318 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:28.841111+0000 mgr.smithi049.rjblpr (mgr.14194) 74 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:30.318 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:28.847543+0000 mgr.smithi049.rjblpr (mgr.14194) 75 : cephadm [INF] Reconfiguring osd.1 (unknown last config time)... 2024-02-22T00:27:30.318 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:28.850557+0000 mgr.smithi049.rjblpr (mgr.14194) 76 : cephadm [INF] Reconfiguring daemon osd.1 on smithi049 2024-02-22T00:27:30.318 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:29.836433+0000 mon.smithi049 (mon.0) 295 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T00:27:30.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:28.841111+0000 mgr.smithi049.rjblpr (mgr.14194) 74 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:30.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:28.847543+0000 mgr.smithi049.rjblpr (mgr.14194) 75 : cephadm [INF] Reconfiguring osd.1 (unknown last config time)... 2024-02-22T00:27:30.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:28.850557+0000 mgr.smithi049.rjblpr (mgr.14194) 76 : cephadm [INF] Reconfiguring daemon osd.1 on smithi049 2024-02-22T00:27:30.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:29.836433+0000 mon.smithi049 (mon.0) 295 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-02-22T00:27:31.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:30.372963+0000 mon.smithi049 (mon.0) 296 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:31.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:30.374092+0000 mon.smithi049 (mon.0) 297 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:31.620 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:30.841405+0000 mgr.smithi049.rjblpr (mgr.14194) 77 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:31.785 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:31 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:30.372963+0000 mon.smithi049 (mon.0) 296 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:31.785 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:31 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:30.374092+0000 mon.smithi049 (mon.0) 297 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:31.785 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:31 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:30.841405+0000 mgr.smithi049.rjblpr (mgr.14194) 77 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:33.016 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:31.908736+0000 mon.smithi049 (mon.0) 298 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:33.016 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:32.747810+0000 mon.smithi049 (mon.0) 299 : audit [INF] from='osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T00:27:33.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.035+0000 7f572affd700 1 -- 172.21.15.49:0/320151714 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5734059120 con 0x7f5720061180 2024-02-22T00:27:33.039 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 1 on host 'smithi049' 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5720061180 msgr2=0x7f5720063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5720061180 0x7f5720063640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5724007fd0 tx=0x7f5724009040).stop 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 msgr2=0x7f57340f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 0x7f57340f7c70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f5730013510 tx=0x7f5730009cb0).stop 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 shutdown_connections 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5734061280 0x7f57340f7c70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5720061180 0x7f5720063640 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 --2- 172.21.15.49:0/320151714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57340fa950 0x7f57340f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 >> 172.21.15.49:0/320151714 conn(0x7f57340f1e50 msgr2=0x7f57340f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 shutdown_connections 2024-02-22T00:27:33.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:33.037+0000 7f573bb44700 1 -- 172.21.15.49:0/320151714 wait complete. 2024-02-22T00:27:33.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:31.908736+0000 mon.smithi049 (mon.0) 298 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:33.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:32.747810+0000 mon.smithi049 (mon.0) 299 : audit [INF] from='osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T00:27:33.665 DEBUG:teuthology.orchestra.run.smithi049:osd.1> sudo journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.1.service 2024-02-22T00:27:33.667 INFO:tasks.cephadm:Deploying osd.2 on smithi049 with /dev/vg_nvme/lv_2... 2024-02-22T00:27:33.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-22T00:27:33.700 INFO:journalctl@ceph.osd.1.smithi049.stdout:-- Logs begin at Wed 2024-02-21 23:57:02 UTC. -- 2024-02-22T00:27:33.918 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:32.841829+0000 mgr.smithi049.rjblpr (mgr.14194) 78 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:33.918 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:32.911851+0000 mon.smithi049 (mon.0) 300 : audit [INF] from='osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T00:27:33.918 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:32.911895+0000 mon.smithi049 (mon.0) 301 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-22T00:27:33.918 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:32.912086+0000 mon.smithi049 (mon.0) 302 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:33.918 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:32.912368+0000 mon.smithi049 (mon.0) 303 : audit [INF] from='osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:27:33.918 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:33.035853+0000 mon.smithi049 (mon.0) 304 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:33.919 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:33.056523+0000 mon.smithi049 (mon.0) 305 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:34.179 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[86989]: debug 2024-02-22T00:27:33.915+0000 7fdbb7518700 -1 osd.1 0 waiting for initial osdmap 2024-02-22T00:27:34.180 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:27:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[86989]: debug 2024-02-22T00:27:33.919+0000 7fdbb1c90700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:27:34.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:32.841829+0000 mgr.smithi049.rjblpr (mgr.14194) 78 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:34.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:32.911851+0000 mon.smithi049 (mon.0) 300 : audit [INF] from='osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T00:27:34.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:32.911895+0000 mon.smithi049 (mon.0) 301 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-02-22T00:27:34.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:32.912086+0000 mon.smithi049 (mon.0) 302 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:34.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:32.912368+0000 mon.smithi049 (mon.0) 303 : audit [INF] from='osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:27:34.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:33.035853+0000 mon.smithi049 (mon.0) 304 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:34.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:33.056523+0000 mon.smithi049 (mon.0) 305 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:35.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:33.913310+0000 mon.smithi049 (mon.0) 306 : audit [INF] from='osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-02-22T00:27:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:33.913357+0000 mon.smithi049 (mon.0) 307 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-02-22T00:27:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:33.913687+0000 mon.smithi049 (mon.0) 308 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:33.917027+0000 mon.smithi049 (mon.0) 309 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:35.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:33.913310+0000 mon.smithi049 (mon.0) 306 : audit [INF] from='osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-02-22T00:27:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:33.913357+0000 mon.smithi049 (mon.0) 307 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-02-22T00:27:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:33.913687+0000 mon.smithi049 (mon.0) 308 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:33.917027+0000 mon.smithi049 (mon.0) 309 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:35.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:33.707165+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:27:35.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:33.707225+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:27:35.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:34.842213+0000 mgr.smithi049.rjblpr (mgr.14194) 79 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:35.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:34.918487+0000 mon.smithi049 (mon.0) 310 : cluster [INF] osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] boot 2024-02-22T00:27:35.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:34.918523+0000 mon.smithi049 (mon.0) 311 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-22T00:27:35.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:34.918851+0000 mon.smithi049 (mon.0) 312 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:36.279 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-22T00:27:36.279 INFO:teuthology.orchestra.run.smithi049.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-22T00:27:36.279 INFO:teuthology.orchestra.run.smithi049.stderr: stderr: 10+0 records in 2024-02-22T00:27:36.279 INFO:teuthology.orchestra.run.smithi049.stderr:10+0 records out 2024-02-22T00:27:36.280 INFO:teuthology.orchestra.run.smithi049.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00894912 s, 1.2 GB/s 2024-02-22T00:27:36.280 INFO:teuthology.orchestra.run.smithi049.stderr:--> Zapping successful for: 2024-02-22T00:27:36.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:35 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:33.707165+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:27:36.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:35 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:33.707225+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:27:36.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:35 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:34.842213+0000 mgr.smithi049.rjblpr (mgr.14194) 79 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-22T00:27:36.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:35 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:34.918487+0000 mon.smithi049 (mon.0) 310 : cluster [INF] osd.1 [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] boot 2024-02-22T00:27:36.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:35 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:34.918523+0000 mon.smithi049 (mon.0) 311 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-02-22T00:27:36.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:35 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:34.918851+0000 mon.smithi049 (mon.0) 312 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:27:37.091 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:35.930656+0000 mon.smithi049 (mon.0) 313 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-02-22T00:27:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:35.930656+0000 mon.smithi049 (mon.0) 313 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-02-22T00:27:37.461 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch daemon add osd smithi049:vg_nvme/lv_2 2024-02-22T00:27:38.256 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:36.842627+0000 mgr.smithi049.rjblpr (mgr.14194) 80 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:38.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:36.842627+0000 mgr.smithi049.rjblpr (mgr.14194) 80 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:39.214 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:38.043519+0000 mon.smithi049 (mon.0) 314 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.455+0000 7f98a5f43700 1 -- 172.21.15.49:0/1479062899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a0061280 msgr2=0x7f98a00fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:27:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.455+0000 7f98a5f43700 1 --2- 172.21.15.49:0/1479062899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a0061280 0x7f98a00fc7d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f9890009b60 tx=0x7f9890004d10).stop 2024-02-22T00:27:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.455+0000 7f98a5f43700 1 -- 172.21.15.49:0/1479062899 shutdown_connections 2024-02-22T00:27:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.455+0000 7f98a5f43700 1 --2- 172.21.15.49:0/1479062899 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a00fccc0 0x7f98a00ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.455+0000 7f98a5f43700 1 --2- 172.21.15.49:0/1479062899 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a0061280 0x7f98a00fc7d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.455+0000 7f98a5f43700 1 -- 172.21.15.49:0/1479062899 >> 172.21.15.49:0/1479062899 conn(0x7f98a00f1e50 msgr2=0x7f98a00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:27:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.455+0000 7f98a5f43700 1 -- 172.21.15.49:0/1479062899 shutdown_connections 2024-02-22T00:27:39.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.455+0000 7f98a5f43700 1 -- 172.21.15.49:0/1479062899 wait complete. 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.456+0000 7f98a5f43700 1 Processor -- start 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.456+0000 7f98a5f43700 1 -- start start 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.456+0000 7f98a5f43700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0061280 0x7f98a010a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.456+0000 7f98a5f43700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00fccc0 0x7f98a010a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.456+0000 7f98a5f43700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a010ac00 con 0x7f98a00fccc0 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.456+0000 7f98a5f43700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a010ad40 con 0x7f98a0061280 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00fccc0 0x7f98a010a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00fccc0 0x7f98a010a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39966/0 (socket says 172.21.15.49:39966) 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989effd700 1 -- 172.21.15.49:0/3270071493 learned_addr learned my addr 172.21.15.49:0/3270071493 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989f7fe700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0061280 0x7f98a010a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989effd700 1 -- 172.21.15.49:0/3270071493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0061280 msgr2=0x7f98a010a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:27:39.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989effd700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0061280 0x7f98a010a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:27:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989effd700 1 -- 172.21.15.49:0/3270071493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900097c0 con 0x7f98a00fccc0 2024-02-22T00:27:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989effd700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00fccc0 0x7f98a010a650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f988800c790 tx=0x7f9888007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:27:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989cff9700 1 -- 172.21.15.49:0/3270071493 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988800e680 con 0x7f98a00fccc0 2024-02-22T00:27:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989cff9700 1 -- 172.21.15.49:0/3270071493 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f988800ec70 con 0x7f98a00fccc0 2024-02-22T00:27:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a010f7e0 con 0x7f98a00fccc0 2024-02-22T00:27:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f989cff9700 1 -- 172.21.15.49:0/3270071493 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9888012ca0 con 0x7f98a00fccc0 2024-02-22T00:27:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.457+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a010fda0 con 0x7f98a00fccc0 2024-02-22T00:27:39.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.458+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a01021f0 con 0x7f98a00fccc0 2024-02-22T00:27:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.459+0000 7f989cff9700 1 -- 172.21.15.49:0/3270071493 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9888012490 con 0x7f98a00fccc0 2024-02-22T00:27:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.460+0000 7f989cff9700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c061180 0x7f988c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:27:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.460+0000 7f989cff9700 1 -- 172.21.15.49:0/3270071493 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2281+0+0 (secure 0 0 0) 0x7f988807b540 con 0x7f98a00fccc0 2024-02-22T00:27:39.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.460+0000 7f989f7fe700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c061180 0x7f988c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:27:39.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.460+0000 7f989f7fe700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c061180 0x7f988c063640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9890003380 tx=0x7f9890004d10).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:27:39.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.464+0000 7f989cff9700 1 -- 172.21.15.49:0/3270071493 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9888047f60 con 0x7f98a00fccc0 2024-02-22T00:27:39.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:38.043519+0000 mon.smithi049 (mon.0) 314 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:39.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:27:39.652+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f98a0059120 con 0x7f988c061180 2024-02-22T00:27:40.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:38.842995+0000 mgr.smithi049.rjblpr (mgr.14194) 81 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:40.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:39.656139+0000 mon.smithi049 (mon.0) 315 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:27:40.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:39.658068+0000 mon.smithi049 (mon.0) 316 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:27:40.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:39.658655+0000 mon.smithi049 (mon.0) 317 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:40.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:38.842995+0000 mgr.smithi049.rjblpr (mgr.14194) 81 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 580 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:40.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:39.656139+0000 mon.smithi049 (mon.0) 315 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:27:40.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:39.658068+0000 mon.smithi049 (mon.0) 316 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:27:40.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:39.658655+0000 mon.smithi049 (mon.0) 317 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:41.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:39.654116+0000 mgr.smithi049.rjblpr (mgr.14194) 82 : audit [DBG] from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:27:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:39.654116+0000 mgr.smithi049.rjblpr (mgr.14194) 82 : audit [DBG] from='client.14260 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:27:42.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:40.843250+0000 mgr.smithi049.rjblpr (mgr.14194) 83 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:40.843250+0000 mgr.smithi049.rjblpr (mgr.14194) 83 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:42.843508+0000 mgr.smithi049.rjblpr (mgr.14194) 84 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:43.758960+0000 mon.smithi049 (mon.0) 318 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:43.759817+0000 mon.smithi049 (mon.0) 319 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:43.760453+0000 mon.smithi049 (mon.0) 320 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:43.763621+0000 mon.smithi049 (mon.0) 321 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:43.764458+0000 mon.smithi049 (mon.0) 322 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:43.765013+0000 mon.smithi049 (mon.0) 323 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:43.769456+0000 mon.smithi049 (mon.0) 324 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:44.061 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:43.773083+0000 mon.smithi049 (mon.0) 325 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:44.417 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:42.843508+0000 mgr.smithi049.rjblpr (mgr.14194) 84 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:44.417 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:43.758960+0000 mon.smithi049 (mon.0) 318 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:44.417 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:43.759817+0000 mon.smithi049 (mon.0) 319 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:27:44.417 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:43.760453+0000 mon.smithi049 (mon.0) 320 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:27:44.417 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:43.763621+0000 mon.smithi049 (mon.0) 321 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:44.417 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:43.764458+0000 mon.smithi049 (mon.0) 322 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:44.417 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:43.765013+0000 mon.smithi049 (mon.0) 323 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:27:44.417 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:43.769456+0000 mon.smithi049 (mon.0) 324 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:44.418 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:43.773083+0000 mon.smithi049 (mon.0) 325 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:43.760860+0000 mgr.smithi049.rjblpr (mgr.14194) 85 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 6961M 2024-02-22T00:27:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:43.766028+0000 mgr.smithi049.rjblpr (mgr.14194) 86 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:44.559688+0000 mon.smithi049 (mon.0) 326 : audit [INF] from='client.? 172.21.15.49:0/269769452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fdbc04fa-88df-4bd8-9272-38e17a0ddc99"}]: dispatch 2024-02-22T00:27:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:44.563276+0000 mon.smithi049 (mon.0) 327 : audit [INF] from='client.? 172.21.15.49:0/269769452' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdbc04fa-88df-4bd8-9272-38e17a0ddc99"}]': finished 2024-02-22T00:27:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:44.563315+0000 mon.smithi049 (mon.0) 328 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-22T00:27:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:44.563419+0000 mon.smithi049 (mon.0) 329 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:27:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:44.761879+0000 mon.smithi049 (mon.0) 330 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-02-22T00:27:45.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:44.761933+0000 mon.smithi049 (mon.0) 331 : cluster [INF] Cluster is now healthy 2024-02-22T00:27:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:43.760860+0000 mgr.smithi049.rjblpr (mgr.14194) 85 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 6961M 2024-02-22T00:27:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:43.766028+0000 mgr.smithi049.rjblpr (mgr.14194) 86 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:44.559688+0000 mon.smithi049 (mon.0) 326 : audit [INF] from='client.? 172.21.15.49:0/269769452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fdbc04fa-88df-4bd8-9272-38e17a0ddc99"}]: dispatch 2024-02-22T00:27:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:44.563276+0000 mon.smithi049 (mon.0) 327 : audit [INF] from='client.? 172.21.15.49:0/269769452' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdbc04fa-88df-4bd8-9272-38e17a0ddc99"}]': finished 2024-02-22T00:27:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:44.563315+0000 mon.smithi049 (mon.0) 328 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-02-22T00:27:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:44.563419+0000 mon.smithi049 (mon.0) 329 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:27:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:44.761879+0000 mon.smithi049 (mon.0) 330 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-02-22T00:27:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:44.761933+0000 mon.smithi049 (mon.0) 331 : cluster [INF] Cluster is now healthy 2024-02-22T00:27:46.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:45.264156+0000 mon.smithi049 (mon.0) 332 : audit [DBG] from='client.? 172.21.15.49:0/4042396457' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:27:46.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:45.264156+0000 mon.smithi049 (mon.0) 332 : audit [DBG] from='client.? 172.21.15.49:0/4042396457' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:27:47.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:45.766286+0000 mgr.smithi049.rjblpr (mgr.14194) 87 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:47.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:46.441072+0000 mon.smithi049 (mon.0) 333 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:47.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:46.907489+0000 mon.smithi049 (mon.0) 334 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:47.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:45.766286+0000 mgr.smithi049.rjblpr (mgr.14194) 87 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:47.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:46.441072+0000 mon.smithi049 (mon.0) 333 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:47.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:46.907489+0000 mon.smithi049 (mon.0) 334 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:48.638 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:47.301568+0000 mon.smithi049 (mon.0) 335 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:48.638 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:47.302240+0000 mon.smithi049 (mon.0) 336 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:48.638 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:47.302869+0000 mon.smithi049 (mon.0) 337 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:27:48.638 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:47.306190+0000 mon.smithi049 (mon.0) 338 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:48.638 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:47.766557+0000 mgr.smithi049.rjblpr (mgr.14194) 88 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:48.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:47.301568+0000 mon.smithi049 (mon.0) 335 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:48.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:47.302240+0000 mon.smithi049 (mon.0) 336 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:48.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:47.302869+0000 mon.smithi049 (mon.0) 337 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:27:48.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:47.306190+0000 mon.smithi049 (mon.0) 338 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:48.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:47.766557+0000 mgr.smithi049.rjblpr (mgr.14194) 88 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:50.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:49.766907+0000 mgr.smithi049.rjblpr (mgr.14194) 89 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:51.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:49.766907+0000 mgr.smithi049.rjblpr (mgr.14194) 89 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:52.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:51.749035+0000 mon.smithi049 (mon.0) 339 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T00:27:52.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:51.749708+0000 mon.smithi049 (mon.0) 340 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:52.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:51.749035+0000 mon.smithi049 (mon.0) 339 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T00:27:52.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:51.749708+0000 mon.smithi049 (mon.0) 340 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:27:53.046 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:27:51.750259+0000 mgr.smithi049.rjblpr (mgr.14194) 90 : cephadm [INF] Deploying daemon osd.2 on smithi049 2024-02-22T00:27:53.046 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:51.767192+0000 mgr.smithi049.rjblpr (mgr.14194) 91 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:53.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:27:51.750259+0000 mgr.smithi049.rjblpr (mgr.14194) 90 : cephadm [INF] Deploying daemon osd.2 on smithi049 2024-02-22T00:27:53.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:51.767192+0000 mgr.smithi049.rjblpr (mgr.14194) 91 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:55.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:53.767413+0000 mgr.smithi049.rjblpr (mgr.14194) 92 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:53.767413+0000 mgr.smithi049.rjblpr (mgr.14194) 92 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:57.048 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:55.767679+0000 mgr.smithi049.rjblpr (mgr.14194) 93 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:57.048 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:56.534168+0000 mon.smithi049 (mon.0) 341 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:57.048 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:27:56.541864+0000 mon.smithi049 (mon.0) 342 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:55.767679+0000 mgr.smithi049.rjblpr (mgr.14194) 93 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:56.534168+0000 mon.smithi049 (mon.0) 341 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:27:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:27:56.541864+0000 mon.smithi049 (mon.0) 342 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:27:59.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:27:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:57.768008+0000 mgr.smithi049.rjblpr (mgr.14194) 94 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:27:59.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:27:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:57.768008+0000 mgr.smithi049.rjblpr (mgr.14194) 94 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:28:00.189 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 2 on host 'smithi049' 2024-02-22T00:28:00.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.185+0000 7f989cff9700 1 -- 172.21.15.49:0/3270071493 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f98a0059120 con 0x7f988c061180 2024-02-22T00:28:00.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c061180 msgr2=0x7f988c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:00.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c061180 0x7f988c063640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9890003380 tx=0x7f9890004d10).stop 2024-02-22T00:28:00.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00fccc0 msgr2=0x7f98a010a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:00.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00fccc0 0x7f98a010a650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f988800c790 tx=0x7f9888007f70).stop 2024-02-22T00:28:00.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 shutdown_connections 2024-02-22T00:28:00.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f988c061180 0x7f988c063640 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:00.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98a0061280 0x7f98a010a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:00.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 --2- 172.21.15.49:0/3270071493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98a00fccc0 0x7f98a010a650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:00.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 >> 172.21.15.49:0/3270071493 conn(0x7f98a00f1e50 msgr2=0x7f98a00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:28:00.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 shutdown_connections 2024-02-22T00:28:00.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:28:00.187+0000 7f98a5f43700 1 -- 172.21.15.49:0/3270071493 wait complete. 2024-02-22T00:28:00.855 DEBUG:teuthology.orchestra.run.smithi049:osd.2> sudo journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.2.service 2024-02-22T00:28:00.857 INFO:tasks.cephadm:Deploying osd.3 on smithi161 with /dev/vg_nvme/lv_4... 2024-02-22T00:28:00.857 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-22T00:28:00.888 INFO:journalctl@ceph.osd.2.smithi049.stdout:-- Logs begin at Wed 2024-02-21 23:57:02 UTC. -- 2024-02-22T00:28:01.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:27:59.768236+0000 mgr.smithi049.rjblpr (mgr.14194) 95 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:28:01.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:00.185601+0000 mon.smithi049 (mon.0) 343 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:01.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:00.413356+0000 mon.smithi161 (mon.1) 2 : audit [INF] from='osd.2 [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T00:28:01.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:00.413804+0000 mon.smithi049 (mon.0) 344 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T00:28:01.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:27:59.768236+0000 mgr.smithi049.rjblpr (mgr.14194) 95 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:28:01.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:00.185601+0000 mon.smithi049 (mon.0) 343 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:01.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:00.413356+0000 mon.smithi161 (mon.1) 2 : audit [INF] from='osd.2 [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T00:28:01.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:00.413804+0000 mon.smithi049 (mon.0) 344 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T00:28:02.449 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:01.187420+0000 mon.smithi049 (mon.0) 345 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T00:28:02.449 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:01.187468+0000 mon.smithi049 (mon.0) 346 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-22T00:28:02.449 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:01.187757+0000 mon.smithi049 (mon.0) 347 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:02.449 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:01.188420+0000 mon.smithi161 (mon.1) 3 : audit [INF] from='osd.2 [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:28:02.449 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:01.193605+0000 mon.smithi049 (mon.0) 348 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:28:02.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:01.187420+0000 mon.smithi049 (mon.0) 345 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T00:28:02.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:01.187468+0000 mon.smithi049 (mon.0) 346 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-02-22T00:28:02.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:01.187757+0000 mon.smithi049 (mon.0) 347 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:02.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:01.188420+0000 mon.smithi161 (mon.1) 3 : audit [INF] from='osd.2 [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:28:02.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:01.193605+0000 mon.smithi049 (mon.0) 348 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:28:02.680 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:28:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[93221]: debug 2024-02-22T00:28:02.195+0000 7f6286364700 -1 osd.2 0 waiting for initial osdmap 2024-02-22T00:28:02.680 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:28:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[93221]: debug 2024-02-22T00:28:02.200+0000 7f6282ae0700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:28:02.993 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-22T00:28:02.993 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-22T00:28:02.993 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2024-02-22T00:28:02.993 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2024-02-22T00:28:02.993 INFO:teuthology.orchestra.run.smithi161.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111703 s, 939 MB/s 2024-02-22T00:28:02.993 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2024-02-22T00:28:03.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:01.768633+0000 mgr.smithi049.rjblpr (mgr.14194) 96 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:28:03.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:02.192382+0000 mon.smithi049 (mon.0) 349 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-02-22T00:28:03.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:02.192449+0000 mon.smithi049 (mon.0) 350 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-02-22T00:28:03.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:02.192754+0000 mon.smithi049 (mon.0) 351 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:03.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:02.196014+0000 mon.smithi049 (mon.0) 352 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:03.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:02.508982+0000 mon.smithi049 (mon.0) 353 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:03.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:01.768633+0000 mgr.smithi049.rjblpr (mgr.14194) 96 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:28:03.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:02.192382+0000 mon.smithi049 (mon.0) 349 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-02-22T00:28:03.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:02.192449+0000 mon.smithi049 (mon.0) 350 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-02-22T00:28:03.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:02.192754+0000 mon.smithi049 (mon.0) 351 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:03.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:02.196014+0000 mon.smithi049 (mon.0) 352 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:03.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:02.508982+0000 mon.smithi049 (mon.0) 353 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:03.694 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch daemon add osd smithi161:vg_nvme/lv_4 2024-02-22T00:28:04.282 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:01.399349+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:28:04.283 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:01.399428+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:28:04.283 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:03.198388+0000 mon.smithi049 (mon.0) 354 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:04.283 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:03.201249+0000 mon.smithi049 (mon.0) 355 : cluster [INF] osd.2 [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] boot 2024-02-22T00:28:04.283 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:03.201283+0000 mon.smithi049 (mon.0) 356 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-22T00:28:04.283 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:03.201386+0000 mon.smithi049 (mon.0) 357 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:04.283 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:03.201739+0000 mon.smithi049 (mon.0) 358 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T00:28:04.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:01.399349+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:28:04.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:01.399428+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:28:04.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:03.198388+0000 mon.smithi049 (mon.0) 354 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:04.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:03.201249+0000 mon.smithi049 (mon.0) 355 : cluster [INF] osd.2 [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] boot 2024-02-22T00:28:04.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:03.201283+0000 mon.smithi049 (mon.0) 356 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-02-22T00:28:04.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:03.201386+0000 mon.smithi049 (mon.0) 357 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:28:04.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:03.201739+0000 mon.smithi049 (mon.0) 358 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T00:28:05.324 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:03.769111+0000 mgr.smithi049.rjblpr (mgr.14194) 97 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:28:05.324 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:04.207385+0000 mon.smithi049 (mon.0) 359 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-22T00:28:05.324 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:04.207431+0000 mon.smithi049 (mon.0) 360 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-22T00:28:05.324 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:04.208052+0000 mon.smithi049 (mon.0) 361 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T00:28:05.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:03.769111+0000 mgr.smithi049.rjblpr (mgr.14194) 97 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-22T00:28:05.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:04.207385+0000 mon.smithi049 (mon.0) 359 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-22T00:28:05.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:04.207431+0000 mon.smithi049 (mon.0) 360 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-02-22T00:28:05.472 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:04.208052+0000 mon.smithi049 (mon.0) 361 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T00:28:05.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.546+0000 7ff2d8449700 1 -- 172.21.15.161:0/3383483974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f7a10 msgr2=0x7ff2d00f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.546+0000 7ff2d8449700 1 --2- 172.21.15.161:0/3383483974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f7a10 0x7ff2d00f7e30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7ff2cc0047f0 tx=0x7ff2cc009cb0).stop 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.546+0000 7ff2d8449700 1 -- 172.21.15.161:0/3383483974 shutdown_connections 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.546+0000 7ff2d8449700 1 --2- 172.21.15.161:0/3383483974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d00f8cb0 0x7ff2d00f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.546+0000 7ff2d8449700 1 --2- 172.21.15.161:0/3383483974 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f7a10 0x7ff2d00f7e30 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.546+0000 7ff2d8449700 1 -- 172.21.15.161:0/3383483974 >> 172.21.15.161:0/3383483974 conn(0x7ff2d00f3150 msgr2=0x7ff2d00f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.546+0000 7ff2d8449700 1 -- 172.21.15.161:0/3383483974 shutdown_connections 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.546+0000 7ff2d8449700 1 -- 172.21.15.161:0/3383483974 wait complete. 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d8449700 1 Processor -- start 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d8449700 1 -- start start 2024-02-22T00:28:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d8449700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d00f7a10 0x7ff2d0108170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d8449700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f8cb0 0x7ff2d0108660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d8449700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0108c10 con 0x7ff2d00f7a10 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d8449700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0108d50 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d59e4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f8cb0 0x7ff2d0108660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d61e5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d00f7a10 0x7ff2d0108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d59e4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f8cb0 0x7ff2d0108660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58000/0 (socket says 172.21.15.161:58000) 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d59e4700 1 -- 172.21.15.161:0/486010501 learned_addr learned my addr 172.21.15.161:0/486010501 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d61e5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d00f7a10 0x7ff2d0108170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.161:35138/0 (socket says 172.21.15.161:35138) 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d59e4700 1 -- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d00f7a10 msgr2=0x7ff2d0108170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d59e4700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d00f7a10 0x7ff2d0108170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d59e4700 1 -- 172.21.15.161:0/486010501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc005040 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d59e4700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f8cb0 0x7ff2d0108660 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff2c0002770 tx=0x7ff2c0002a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:28:05.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2c77fe700 1 -- 172.21.15.161:0/486010501 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c0007b40 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2c77fe700 1 -- 172.21.15.161:0/486010501 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff2c000f040 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d010d7f0 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2c77fe700 1 -- 172.21.15.161:0/486010501 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2c0014780 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.547+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d010dd30 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.548+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d005fb50 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.549+0000 7ff2c77fe700 1 -- 172.21.15.161:0/486010501 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ff2c0007ca0 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.549+0000 7ff2c77fe700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff2bc061180 0x7ff2bc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.549+0000 7ff2c77fe700 1 -- 172.21.15.161:0/486010501 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3129+0+0 (secure 0 0 0) 0x7ff2c007bbe0 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.549+0000 7ff2d61e5700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff2bc061180 0x7ff2bc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.549+0000 7ff2d61e5700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff2bc061180 0x7ff2bc063640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff2cc004f10 tx=0x7ff2cc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:28:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.553+0000 7ff2c77fe700 1 -- 172.21.15.161:0/486010501 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff2c00504b0 con 0x7ff2d00f8cb0 2024-02-22T00:28:05.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:05.721+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2d01021c0 con 0x7ff2bc061180 2024-02-22T00:28:06.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.209624+0000 mon.smithi049 (mon.0) 362 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T00:28:06.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:05.209727+0000 mon.smithi049 (mon.0) 363 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-22T00:28:06.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.715390+0000 mon.smithi049 (mon.0) 364 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:06.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.716187+0000 mon.smithi049 (mon.0) 365 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:06.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.716766+0000 mon.smithi049 (mon.0) 366 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:06.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.717319+0000 mon.smithi049 (mon.0) 367 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:06.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.720601+0000 mon.smithi049 (mon.0) 368 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:06.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.721368+0000 mon.smithi049 (mon.0) 369 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.721894+0000 mon.smithi049 (mon.0) 370 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.725637+0000 mon.smithi049 (mon.0) 371 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.725760+0000 mon.smithi049 (mon.0) 372 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.729696+0000 mon.smithi049 (mon.0) 373 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.730777+0000 mon.smithi049 (mon.0) 374 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.731392+0000 mon.smithi049 (mon.0) 375 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.731576+0000 mon.smithi049 (mon.0) 376 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.732296+0000 mon.smithi049 (mon.0) 377 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.736153+0000 mon.smithi049 (mon.0) 378 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:06.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:06.211588+0000 mon.smithi049 (mon.0) 379 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-22T00:28:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.209624+0000 mon.smithi049 (mon.0) 362 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:05.209727+0000 mon.smithi049 (mon.0) 363 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.715390+0000 mon.smithi049 (mon.0) 364 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.716187+0000 mon.smithi049 (mon.0) 365 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.716766+0000 mon.smithi049 (mon.0) 366 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.717319+0000 mon.smithi049 (mon.0) 367 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.720601+0000 mon.smithi049 (mon.0) 368 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.721368+0000 mon.smithi049 (mon.0) 369 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.721894+0000 mon.smithi049 (mon.0) 370 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.725637+0000 mon.smithi049 (mon.0) 371 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.725760+0000 mon.smithi049 (mon.0) 372 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.729696+0000 mon.smithi049 (mon.0) 373 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.730777+0000 mon.smithi049 (mon.0) 374 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:28:06.681 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.731392+0000 mon.smithi049 (mon.0) 375 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:06.681 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.731576+0000 mon.smithi049 (mon.0) 376 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:06.681 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.732296+0000 mon.smithi049 (mon.0) 377 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:06.681 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.736153+0000 mon.smithi049 (mon.0) 378 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:06.681 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:06.211588+0000 mon.smithi049 (mon.0) 379 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-22T00:28:07.339 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:28:05.710822+0000 mgr.smithi049.rjblpr (mgr.14194) 98 : cephadm [INF] Detected new or changed devices on smithi049 2024-02-22T00:28:07.339 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:28:05.717743+0000 mgr.smithi049.rjblpr (mgr.14194) 99 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 4640M 2024-02-22T00:28:07.339 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:05.723155+0000 mgr.smithi049.rjblpr (mgr.14194) 100 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:28:07.339 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:05.769421+0000 mgr.smithi049.rjblpr (mgr.14194) 101 : cluster [DBG] pgmap v72: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:07.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:28:05.710822+0000 mgr.smithi049.rjblpr (mgr.14194) 98 : cephadm [INF] Detected new or changed devices on smithi049 2024-02-22T00:28:07.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:28:05.717743+0000 mgr.smithi049.rjblpr (mgr.14194) 99 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 4640M 2024-02-22T00:28:07.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:05.723155+0000 mgr.smithi049.rjblpr (mgr.14194) 100 : audit [DBG] from='client.24141 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:28:07.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:05.769421+0000 mgr.smithi049.rjblpr (mgr.14194) 101 : cluster [DBG] pgmap v72: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:08.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:08.088649+0000 mon.smithi161 (mon.1) 4 : audit [INF] from='client.? 172.21.15.161:0/2696992101' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70"}]: dispatch 2024-02-22T00:28:08.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:08.089397+0000 mon.smithi049 (mon.0) 380 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70"}]: dispatch 2024-02-22T00:28:08.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:08.093996+0000 mon.smithi049 (mon.0) 381 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70"}]': finished 2024-02-22T00:28:08.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:08.094064+0000 mon.smithi049 (mon.0) 382 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-22T00:28:08.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:08.094219+0000 mon.smithi049 (mon.0) 383 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:08.088649+0000 mon.smithi161 (mon.1) 4 : audit [INF] from='client.? 172.21.15.161:0/2696992101' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70"}]: dispatch 2024-02-22T00:28:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:08.089397+0000 mon.smithi049 (mon.0) 380 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70"}]: dispatch 2024-02-22T00:28:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:08.093996+0000 mon.smithi049 (mon.0) 381 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70"}]': finished 2024-02-22T00:28:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:08.094064+0000 mon.smithi049 (mon.0) 382 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-02-22T00:28:08.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:08.094219+0000 mon.smithi049 (mon.0) 383 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:09.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:07.769712+0000 mgr.smithi049.rjblpr (mgr.14194) 102 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:09.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:08.670911+0000 mon.smithi161 (mon.1) 5 : audit [DBG] from='client.? 172.21.15.161:0/314558543' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:28:09.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:07.769712+0000 mgr.smithi049.rjblpr (mgr.14194) 102 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:09.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:08.670911+0000 mon.smithi161 (mon.1) 5 : audit [DBG] from='client.? 172.21.15.161:0/314558543' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:28:11.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:09.770193+0000 mgr.smithi049.rjblpr (mgr.14194) 103 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:11.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:09.770193+0000 mgr.smithi049.rjblpr (mgr.14194) 103 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:13.500 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:11.770741+0000 mgr.smithi049.rjblpr (mgr.14194) 104 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:13.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:11.770741+0000 mgr.smithi049.rjblpr (mgr.14194) 104 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:15.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:13.771253+0000 mgr.smithi049.rjblpr (mgr.14194) 105 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:15.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:15.205325+0000 mon.smithi049 (mon.0) 384 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T00:28:15.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:15.206192+0000 mon.smithi049 (mon.0) 385 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:15.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:13.771253+0000 mgr.smithi049.rjblpr (mgr.14194) 105 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:15.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:15.205325+0000 mon.smithi049 (mon.0) 384 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T00:28:15.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:15.206192+0000 mon.smithi049 (mon.0) 385 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:16.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:28:15.206931+0000 mgr.smithi049.rjblpr (mgr.14194) 106 : cephadm [INF] Deploying daemon osd.3 on smithi161 2024-02-22T00:28:16.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:28:15.206931+0000 mgr.smithi049.rjblpr (mgr.14194) 106 : cephadm [INF] Deploying daemon osd.3 on smithi161 2024-02-22T00:28:17.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:15.771550+0000 mgr.smithi049.rjblpr (mgr.14194) 107 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:17.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:15.771550+0000 mgr.smithi049.rjblpr (mgr.14194) 107 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:19.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:17.772009+0000 mgr.smithi049.rjblpr (mgr.14194) 108 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:19.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:17.772009+0000 mgr.smithi049.rjblpr (mgr.14194) 108 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:21.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:19.772428+0000 mgr.smithi049.rjblpr (mgr.14194) 109 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:21.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:20.314148+0000 mon.smithi049 (mon.0) 386 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:21.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:20.340662+0000 mon.smithi049 (mon.0) 387 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:21.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:19.772428+0000 mgr.smithi049.rjblpr (mgr.14194) 109 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:21.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:20.314148+0000 mon.smithi049 (mon.0) 386 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:21.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:20.340662+0000 mon.smithi049 (mon.0) 387 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:23.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:21.772909+0000 mgr.smithi049.rjblpr (mgr.14194) 110 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:23.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:21.772909+0000 mgr.smithi049.rjblpr (mgr.14194) 110 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:24.245 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 3 on host 'smithi161' 2024-02-22T00:28:24.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.241+0000 7ff2c77fe700 1 -- 172.21.15.161:0/486010501 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff2d01021c0 con 0x7ff2bc061180 2024-02-22T00:28:24.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff2bc061180 msgr2=0x7ff2bc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:24.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff2bc061180 0x7ff2bc063640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff2cc004f10 tx=0x7ff2cc00b040).stop 2024-02-22T00:28:24.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f8cb0 msgr2=0x7ff2d0108660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:24.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f8cb0 0x7ff2d0108660 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff2c0002770 tx=0x7ff2c0002a80).stop 2024-02-22T00:28:24.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 shutdown_connections 2024-02-22T00:28:24.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2d00f7a10 0x7ff2d0108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:24.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff2bc061180 0x7ff2bc063640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:24.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 --2- 172.21.15.161:0/486010501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00f8cb0 0x7ff2d0108660 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:24.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 >> 172.21.15.161:0/486010501 conn(0x7ff2d00f3150 msgr2=0x7ff2d00fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:28:24.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 shutdown_connections 2024-02-22T00:28:24.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:24.244+0000 7ff2d8449700 1 -- 172.21.15.161:0/486010501 wait complete. 2024-02-22T00:28:24.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:24.210770+0000 mon.smithi161 (mon.1) 6 : audit [INF] from='osd.3 [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T00:28:24.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:24.211297+0000 mon.smithi049 (mon.0) 388 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T00:28:24.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:24.241958+0000 mon.smithi049 (mon.0) 389 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:24.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:24.210770+0000 mon.smithi161 (mon.1) 6 : audit [INF] from='osd.3 [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T00:28:24.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:24.211297+0000 mon.smithi049 (mon.0) 388 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T00:28:24.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:24.241958+0000 mon.smithi049 (mon.0) 389 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:25.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:23.773397+0000 mgr.smithi049.rjblpr (mgr.14194) 111 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:25.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:24.255135+0000 mon.smithi049 (mon.0) 390 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T00:28:25.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:24.255242+0000 mon.smithi049 (mon.0) 391 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-22T00:28:25.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:24.255395+0000 mon.smithi049 (mon.0) 392 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:25.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:24.256017+0000 mon.smithi161 (mon.1) 7 : audit [INF] from='osd.3 [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:28:25.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:24.256424+0000 mon.smithi049 (mon.0) 393 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:28:25.583 DEBUG:teuthology.orchestra.run.smithi161:osd.3> sudo journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.3.service 2024-02-22T00:28:25.586 INFO:tasks.cephadm:Deploying osd.4 on smithi161 with /dev/vg_nvme/lv_3... 2024-02-22T00:28:25.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-22T00:28:25.619 INFO:journalctl@ceph.osd.3.smithi161.stdout:-- Logs begin at Wed 2024-02-21 23:55:52 UTC. -- 2024-02-22T00:28:25.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:23.773397+0000 mgr.smithi049.rjblpr (mgr.14194) 111 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:25.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:24.255135+0000 mon.smithi049 (mon.0) 390 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T00:28:25.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:24.255242+0000 mon.smithi049 (mon.0) 391 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-02-22T00:28:25.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:24.255395+0000 mon.smithi049 (mon.0) 392 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:25.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:24.256017+0000 mon.smithi161 (mon.1) 7 : audit [INF] from='osd.3 [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:28:25.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:24.256424+0000 mon.smithi049 (mon.0) 393 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:28:26.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:25.256935+0000 mon.smithi049 (mon.0) 394 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-02-22T00:28:26.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:25.257030+0000 mon.smithi049 (mon.0) 395 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-22T00:28:26.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:25.257520+0000 mon.smithi049 (mon.0) 396 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:26.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:25.261723+0000 mon.smithi049 (mon.0) 397 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:26.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:25.286683+0000 mon.smithi049 (mon.0) 398 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:26.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:25.256935+0000 mon.smithi049 (mon.0) 394 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-02-22T00:28:26.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:25.257030+0000 mon.smithi049 (mon.0) 395 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-02-22T00:28:26.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:25.257520+0000 mon.smithi049 (mon.0) 396 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:26.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:25.261723+0000 mon.smithi049 (mon.0) 397 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:26.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:25.286683+0000 mon.smithi049 (mon.0) 398 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:27.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:25.246900+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:28:27.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:25.246969+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:28:27.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:25.773854+0000 mgr.smithi049.rjblpr (mgr.14194) 112 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:27.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:26.263013+0000 mon.smithi049 (mon.0) 399 : cluster [INF] osd.3 [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] boot 2024-02-22T00:28:27.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:26.263077+0000 mon.smithi049 (mon.0) 400 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-22T00:28:27.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:26.264852+0000 mon.smithi049 (mon.0) 401 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:27.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:27.263866+0000 mon.smithi049 (mon.0) 402 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-22T00:28:27.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:25.246900+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:28:27.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:25.246969+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:28:27.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:25.773854+0000 mgr.smithi049.rjblpr (mgr.14194) 112 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-22T00:28:27.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:26.263013+0000 mon.smithi049 (mon.0) 399 : cluster [INF] osd.3 [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] boot 2024-02-22T00:28:27.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:26.263077+0000 mon.smithi049 (mon.0) 400 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-22T00:28:27.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:26.264852+0000 mon.smithi049 (mon.0) 401 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:28:27.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:27.263866+0000 mon.smithi049 (mon.0) 402 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-22T00:28:28.189 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-22T00:28:28.189 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-22T00:28:28.189 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2024-02-22T00:28:28.189 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2024-02-22T00:28:28.189 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110721 s, 947 MB/s 2024-02-22T00:28:28.189 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2024-02-22T00:28:28.787 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch daemon add osd smithi161:vg_nvme/lv_3 2024-02-22T00:28:29.290 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:27.774264+0000 mgr.smithi049.rjblpr (mgr.14194) 113 : cluster [DBG] pgmap v89: 1 pgs: 1 peering; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:29.290 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:28.265420+0000 mon.smithi049 (mon.0) 403 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-02-22T00:28:29.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:27.774264+0000 mgr.smithi049.rjblpr (mgr.14194) 113 : cluster [DBG] pgmap v89: 1 pgs: 1 peering; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:29.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:28.265420+0000 mon.smithi049 (mon.0) 403 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-02-22T00:28:31.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.487+0000 7fca5774d700 1 -- 172.21.15.161:0/2933307369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f8aa0 msgr2=0x7fca500f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:31.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.487+0000 7fca5774d700 1 --2- 172.21.15.161:0/2933307369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f8aa0 0x7fca500f8f00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fca440047f0 tx=0x7fca44009cb0).stop 2024-02-22T00:28:31.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.488+0000 7fca5774d700 1 -- 172.21.15.161:0/2933307369 shutdown_connections 2024-02-22T00:28:31.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.488+0000 7fca5774d700 1 --2- 172.21.15.161:0/2933307369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f8aa0 0x7fca500f8f00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:31.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.488+0000 7fca5774d700 1 --2- 172.21.15.161:0/2933307369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca500f7800 0x7fca500f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:31.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.488+0000 7fca5774d700 1 -- 172.21.15.161:0/2933307369 >> 172.21.15.161:0/2933307369 conn(0x7fca500f2f80 msgr2=0x7fca500f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:28:31.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.488+0000 7fca5774d700 1 -- 172.21.15.161:0/2933307369 shutdown_connections 2024-02-22T00:28:31.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.488+0000 7fca5774d700 1 -- 172.21.15.161:0/2933307369 wait complete. 2024-02-22T00:28:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.488+0000 7fca5774d700 1 Processor -- start 2024-02-22T00:28:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.488+0000 7fca5774d700 1 -- start start 2024-02-22T00:28:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca5774d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f7800 0x7fca50107f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:31.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca5774d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca500f8aa0 0x7fca50108420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca5774d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca501089d0 con 0x7fca500f8aa0 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca5774d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca50108b10 con 0x7fca500f7800 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca554e9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f7800 0x7fca50107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca554e9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f7800 0x7fca50107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33704/0 (socket says 172.21.15.161:33704) 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca554e9700 1 -- 172.21.15.161:0/585393720 learned_addr learned my addr 172.21.15.161:0/585393720 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca54ce8700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca500f8aa0 0x7fca50108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca554e9700 1 -- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca500f8aa0 msgr2=0x7fca50108420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca554e9700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca500f8aa0 0x7fca50108420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca554e9700 1 -- 172.21.15.161:0/585393720 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca44005040 con 0x7fca500f7800 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca554e9700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f7800 0x7fca50107f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fca4000db00 tx=0x7fca40004e80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca4e7fc700 1 -- 172.21.15.161:0/585393720 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca40007e70 con 0x7fca500f7800 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5010d5b0 con 0x7fca500f7800 2024-02-22T00:28:31.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca4e7fc700 1 -- 172.21.15.161:0/585393720 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fca4000f040 con 0x7fca500f7800 2024-02-22T00:28:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca4e7fc700 1 -- 172.21.15.161:0/585393720 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca40013b70 con 0x7fca500f7800 2024-02-22T00:28:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.489+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5010daf0 con 0x7fca500f7800 2024-02-22T00:28:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.490+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca500fffc0 con 0x7fca500f7800 2024-02-22T00:28:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.491+0000 7fca4e7fc700 1 -- 172.21.15.161:0/585393720 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fca4000b750 con 0x7fca500f7800 2024-02-22T00:28:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.491+0000 7fca4e7fc700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fca38061180 0x7fca38063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.491+0000 7fca4e7fc700 1 -- 172.21.15.161:0/585393720 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3671+0+0 (secure 0 0 0) 0x7fca4007bd40 con 0x7fca500f7800 2024-02-22T00:28:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.492+0000 7fca54ce8700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fca38061180 0x7fca38063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:31.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.492+0000 7fca54ce8700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fca38061180 0x7fca38063640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fca440047c0 tx=0x7fca4400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:28:31.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.496+0000 7fca4e7fc700 1 -- 172.21.15.161:0/585393720 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fca40050370 con 0x7fca500f7800 2024-02-22T00:28:31.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:31 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:29.774652+0000 mgr.smithi049.rjblpr (mgr.14194) 114 : cluster [DBG] pgmap v91: 1 pgs: 1 peering; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:31.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:31.674+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fca50059120 con 0x7fca38061180 2024-02-22T00:28:31.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:29.774652+0000 mgr.smithi049.rjblpr (mgr.14194) 114 : cluster [DBG] pgmap v91: 1 pgs: 1 peering; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:32.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:28:31.509741+0000 mgr.smithi049.rjblpr (mgr.14194) 115 : cephadm [INF] Detected new or changed devices on smithi161 2024-02-22T00:28:32.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.514347+0000 mon.smithi049 (mon.0) 404 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:32.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.676784+0000 mgr.smithi049.rjblpr (mgr.14194) 116 : audit [DBG] from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:28:32.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.679173+0000 mon.smithi049 (mon.0) 405 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:28:32.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.681412+0000 mon.smithi049 (mon.0) 406 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.682136+0000 mon.smithi049 (mon.0) 407 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:31.775014+0000 mgr.smithi049.rjblpr (mgr.14194) 117 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.809560+0000 mon.smithi049 (mon.0) 408 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:28:31.810239+0000 mgr.smithi049.rjblpr (mgr.14194) 118 : cephadm [INF] Adjusting osd_memory_target on smithi161 to 14946M 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.814607+0000 mon.smithi049 (mon.0) 409 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.815836+0000 mon.smithi049 (mon.0) 410 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.816666+0000 mon.smithi049 (mon.0) 411 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.820857+0000 mon.smithi049 (mon.0) 412 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:31.825597+0000 mon.smithi049 (mon.0) 413 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:32.142123+0000 mon.smithi049 (mon.0) 414 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:32.142829+0000 mon.smithi049 (mon.0) 415 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:32.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:32.146858+0000 mon.smithi049 (mon.0) 416 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:32.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:28:31.509741+0000 mgr.smithi049.rjblpr (mgr.14194) 115 : cephadm [INF] Detected new or changed devices on smithi161 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.514347+0000 mon.smithi049 (mon.0) 404 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.676784+0000 mgr.smithi049.rjblpr (mgr.14194) 116 : audit [DBG] from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.679173+0000 mon.smithi049 (mon.0) 405 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.681412+0000 mon.smithi049 (mon.0) 406 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.682136+0000 mon.smithi049 (mon.0) 407 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:31.775014+0000 mgr.smithi049.rjblpr (mgr.14194) 117 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.809560+0000 mon.smithi049 (mon.0) 408 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:28:31.810239+0000 mgr.smithi049.rjblpr (mgr.14194) 118 : cephadm [INF] Adjusting osd_memory_target on smithi161 to 14946M 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.814607+0000 mon.smithi049 (mon.0) 409 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.815836+0000 mon.smithi049 (mon.0) 410 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:32.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.816666+0000 mon.smithi049 (mon.0) 411 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:32.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.820857+0000 mon.smithi049 (mon.0) 412 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:32.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:31.825597+0000 mon.smithi049 (mon.0) 413 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:32.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:32.142123+0000 mon.smithi049 (mon.0) 414 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:32.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:32.142829+0000 mon.smithi049 (mon.0) 415 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:32.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:32.146858+0000 mon.smithi049 (mon.0) 416 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:35.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:33.775355+0000 mgr.smithi049.rjblpr (mgr.14194) 119 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:35.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:34.076078+0000 mon.smithi161 (mon.1) 8 : audit [INF] from='client.? 172.21.15.161:0/3967503602' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a017d7c9-0283-4fe1-8839-1ccbdbd95972"}]: dispatch 2024-02-22T00:28:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:34.076694+0000 mon.smithi049 (mon.0) 417 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a017d7c9-0283-4fe1-8839-1ccbdbd95972"}]: dispatch 2024-02-22T00:28:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:34.080709+0000 mon.smithi049 (mon.0) 418 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a017d7c9-0283-4fe1-8839-1ccbdbd95972"}]': finished 2024-02-22T00:28:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:34.080765+0000 mon.smithi049 (mon.0) 419 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-22T00:28:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:34.080880+0000 mon.smithi049 (mon.0) 420 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:35.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:34.662004+0000 mon.smithi161 (mon.1) 9 : audit [DBG] from='client.? 172.21.15.161:0/4149707772' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:28:35.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:33.775355+0000 mgr.smithi049.rjblpr (mgr.14194) 119 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:34.076078+0000 mon.smithi161 (mon.1) 8 : audit [INF] from='client.? 172.21.15.161:0/3967503602' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a017d7c9-0283-4fe1-8839-1ccbdbd95972"}]: dispatch 2024-02-22T00:28:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:34.076694+0000 mon.smithi049 (mon.0) 417 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a017d7c9-0283-4fe1-8839-1ccbdbd95972"}]: dispatch 2024-02-22T00:28:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:34.080709+0000 mon.smithi049 (mon.0) 418 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a017d7c9-0283-4fe1-8839-1ccbdbd95972"}]': finished 2024-02-22T00:28:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:34.080765+0000 mon.smithi049 (mon.0) 419 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-02-22T00:28:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:34.080880+0000 mon.smithi049 (mon.0) 420 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:35.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:34.662004+0000 mon.smithi161 (mon.1) 9 : audit [DBG] from='client.? 172.21.15.161:0/4149707772' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:28:37.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:35.775663+0000 mgr.smithi049.rjblpr (mgr.14194) 120 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:35.775663+0000 mgr.smithi049.rjblpr (mgr.14194) 120 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:39.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:37.776187+0000 mgr.smithi049.rjblpr (mgr.14194) 121 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:39.267 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:37.776187+0000 mgr.smithi049.rjblpr (mgr.14194) 121 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:41.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:39.776552+0000 mgr.smithi049.rjblpr (mgr.14194) 122 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:41.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:39.776552+0000 mgr.smithi049.rjblpr (mgr.14194) 122 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:42.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:41.370630+0000 mon.smithi049 (mon.0) 421 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T00:28:42.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:41.371505+0000 mon.smithi049 (mon.0) 422 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:42.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:41.370630+0000 mon.smithi049 (mon.0) 421 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T00:28:42.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:41.371505+0000 mon.smithi049 (mon.0) 422 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:43.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:28:41.372225+0000 mgr.smithi049.rjblpr (mgr.14194) 123 : cephadm [INF] Deploying daemon osd.4 on smithi161 2024-02-22T00:28:43.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:41.776951+0000 mgr.smithi049.rjblpr (mgr.14194) 124 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:43.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:28:41.372225+0000 mgr.smithi049.rjblpr (mgr.14194) 123 : cephadm [INF] Deploying daemon osd.4 on smithi161 2024-02-22T00:28:43.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:41.776951+0000 mgr.smithi049.rjblpr (mgr.14194) 124 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:45.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:43.777459+0000 mgr.smithi049.rjblpr (mgr.14194) 125 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:43.777459+0000 mgr.smithi049.rjblpr (mgr.14194) 125 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:47.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:45.777815+0000 mgr.smithi049.rjblpr (mgr.14194) 126 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:47.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:46.337332+0000 mon.smithi049 (mon.0) 423 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:47.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:46.347706+0000 mon.smithi049 (mon.0) 424 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:47.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:45.777815+0000 mgr.smithi049.rjblpr (mgr.14194) 126 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:47.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:46.337332+0000 mon.smithi049 (mon.0) 423 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:47.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:46.347706+0000 mon.smithi049 (mon.0) 424 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:49.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:47.778306+0000 mgr.smithi049.rjblpr (mgr.14194) 127 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:49.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:47.778306+0000 mgr.smithi049.rjblpr (mgr.14194) 127 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:50.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.038+0000 7fca4e7fc700 1 -- 172.21.15.161:0/585393720 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fca50059120 con 0x7fca38061180 2024-02-22T00:28:50.042 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 4 on host 'smithi161' 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.040+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fca38061180 msgr2=0x7fca38063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.040+0000 7fca5774d700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fca38061180 0x7fca38063640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fca440047c0 tx=0x7fca4400b040).stop 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.040+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f7800 msgr2=0x7fca50107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.040+0000 7fca5774d700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f7800 0x7fca50107f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fca4000db00 tx=0x7fca40004e80).stop 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.041+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 shutdown_connections 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.041+0000 7fca5774d700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fca38061180 0x7fca38063640 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.041+0000 7fca5774d700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca500f7800 0x7fca50107f30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.041+0000 7fca5774d700 1 --2- 172.21.15.161:0/585393720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca500f8aa0 0x7fca50108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.041+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 >> 172.21.15.161:0/585393720 conn(0x7fca500f2f80 msgr2=0x7fca500fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:28:50.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.041+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 shutdown_connections 2024-02-22T00:28:50.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:50.041+0000 7fca5774d700 1 -- 172.21.15.161:0/585393720 wait complete. 2024-02-22T00:28:50.709 DEBUG:teuthology.orchestra.run.smithi161:osd.4> sudo journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.4.service 2024-02-22T00:28:50.711 INFO:tasks.cephadm:Deploying osd.5 on smithi161 with /dev/vg_nvme/lv_2... 2024-02-22T00:28:50.712 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-22T00:28:50.742 INFO:journalctl@ceph.osd.4.smithi161.stdout:-- Logs begin at Wed 2024-02-21 23:55:52 UTC. -- 2024-02-22T00:28:51.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:49.778713+0000 mgr.smithi049.rjblpr (mgr.14194) 128 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:51.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:50.038857+0000 mon.smithi049 (mon.0) 425 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:51.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:50.243145+0000 mon.smithi161 (mon.1) 10 : audit [INF] from='osd.4 [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T00:28:51.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:50.243639+0000 mon.smithi049 (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T00:28:51.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:49.778713+0000 mgr.smithi049.rjblpr (mgr.14194) 128 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:51.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:50.038857+0000 mon.smithi049 (mon.0) 425 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:51.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:50.243145+0000 mon.smithi161 (mon.1) 10 : audit [INF] from='osd.4 [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T00:28:51.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:50.243639+0000 mon.smithi049 (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T00:28:52.139 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:28:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[82065]: debug 2024-02-22T00:28:52.050+0000 7f9ded7e2700 -1 osd.4 0 waiting for initial osdmap 2024-02-22T00:28:52.139 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:28:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[82065]: debug 2024-02-22T00:28:52.058+0000 7f9de9f5e700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:28:52.140 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:51.041074+0000 mon.smithi049 (mon.0) 427 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T00:28:52.140 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:51.041154+0000 mon.smithi049 (mon.0) 428 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-22T00:28:52.140 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:51.041569+0000 mon.smithi049 (mon.0) 429 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:52.140 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:51.041684+0000 mon.smithi161 (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:28:52.140 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:51.042077+0000 mon.smithi049 (mon.0) 430 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:28:52.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:51.041074+0000 mon.smithi049 (mon.0) 427 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T00:28:52.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:51.041154+0000 mon.smithi049 (mon.0) 428 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-02-22T00:28:52.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:51.041569+0000 mon.smithi049 (mon.0) 429 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:52.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:51.041684+0000 mon.smithi161 (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:28:52.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:51.042077+0000 mon.smithi049 (mon.0) 430 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:28:53.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:51.779060+0000 mgr.smithi049.rjblpr (mgr.14194) 129 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:53.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:52.042707+0000 mon.smithi049 (mon.0) 431 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-02-22T00:28:53.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:52.042773+0000 mon.smithi049 (mon.0) 432 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-22T00:28:53.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:52.042909+0000 mon.smithi049 (mon.0) 433 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:53.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:52.049918+0000 mon.smithi049 (mon.0) 434 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:53.306 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:52.754904+0000 mon.smithi049 (mon.0) 435 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-22T00:28:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-22T00:28:53.318 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2024-02-22T00:28:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2024-02-22T00:28:53.319 INFO:teuthology.orchestra.run.smithi161.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114707 s, 914 MB/s 2024-02-22T00:28:53.319 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 2024-02-22T00:28:53.319 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2024-02-22T00:28:53.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:51.779060+0000 mgr.smithi049.rjblpr (mgr.14194) 129 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:53.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:52.042707+0000 mon.smithi049 (mon.0) 431 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-02-22T00:28:53.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:52.042773+0000 mon.smithi049 (mon.0) 432 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-02-22T00:28:53.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:52.042909+0000 mon.smithi049 (mon.0) 433 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:53.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:52.049918+0000 mon.smithi049 (mon.0) 434 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:53.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:52.754904+0000 mon.smithi049 (mon.0) 435 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:54.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:51.257682+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:28:54.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:51.257791+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:28:54.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:53.051273+0000 mon.smithi049 (mon.0) 436 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:54.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:53.054399+0000 mon.smithi049 (mon.0) 437 : cluster [INF] osd.4 [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] boot 2024-02-22T00:28:54.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:53.054454+0000 mon.smithi049 (mon.0) 438 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-22T00:28:54.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:53.054595+0000 mon.smithi049 (mon.0) 439 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:54.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:51.257682+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:28:54.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:51.257791+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:28:54.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:53.051273+0000 mon.smithi049 (mon.0) 436 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:54.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:53.054399+0000 mon.smithi049 (mon.0) 437 : cluster [INF] osd.4 [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] boot 2024-02-22T00:28:54.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:53.054454+0000 mon.smithi049 (mon.0) 438 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-22T00:28:54.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:53.054595+0000 mon.smithi049 (mon.0) 439 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:28:55.268 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph orch daemon add osd smithi161:vg_nvme/lv_2 2024-02-22T00:28:55.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:53.779353+0000 mgr.smithi049.rjblpr (mgr.14194) 130 : cluster [DBG] pgmap v107: 1 pgs: 1 peering; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:55.419 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:54.057548+0000 mon.smithi049 (mon.0) 440 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-22T00:28:55.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:53.779353+0000 mgr.smithi049.rjblpr (mgr.14194) 130 : cluster [DBG] pgmap v107: 1 pgs: 1 peering; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-22T00:28:55.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:54.057548+0000 mon.smithi049 (mon.0) 440 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-02-22T00:28:57.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:55.779700+0000 mgr.smithi049.rjblpr (mgr.14194) 131 : cluster [DBG] pgmap v109: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.852035+0000 mon.smithi049 (mon.0) 441 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.853143+0000 mon.smithi049 (mon.0) 442 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.854057+0000 mon.smithi049 (mon.0) 443 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.858614+0000 mon.smithi049 (mon.0) 444 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.859621+0000 mon.smithi049 (mon.0) 445 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.860374+0000 mon.smithi049 (mon.0) 446 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.864417+0000 mon.smithi049 (mon.0) 447 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.868862+0000 mon.smithi049 (mon.0) 448 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.870364+0000 mon.smithi049 (mon.0) 449 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.871076+0000 mon.smithi049 (mon.0) 450 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:57.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:56.875371+0000 mon.smithi049 (mon.0) 451 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:57.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:55.779700+0000 mgr.smithi049.rjblpr (mgr.14194) 131 : cluster [DBG] pgmap v109: 1 pgs: 1 peering; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:28:57.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.852035+0000 mon.smithi049 (mon.0) 441 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:57.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.853143+0000 mon.smithi049 (mon.0) 442 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:57.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.854057+0000 mon.smithi049 (mon.0) 443 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:28:57.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.858614+0000 mon.smithi049 (mon.0) 444 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:57.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.859621+0000 mon.smithi049 (mon.0) 445 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:57.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.860374+0000 mon.smithi049 (mon.0) 446 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:57.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.864417+0000 mon.smithi049 (mon.0) 447 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:57.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.868862+0000 mon.smithi049 (mon.0) 448 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:28:57.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.870364+0000 mon.smithi049 (mon.0) 449 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:57.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.871076+0000 mon.smithi049 (mon.0) 450 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:28:57.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:56.875371+0000 mon.smithi049 (mon.0) 451 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:28:57.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.788+0000 7f5603a4b700 1 -- 172.21.15.161:0/910424850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 msgr2=0x7f55fc0f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:57.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.788+0000 7f5603a4b700 1 --2- 172.21.15.161:0/910424850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 0x7f55fc0f8f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f55f80047f0 tx=0x7f55f8009cb0).stop 2024-02-22T00:28:57.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.788+0000 7f5603a4b700 1 -- 172.21.15.161:0/910424850 shutdown_connections 2024-02-22T00:28:57.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.788+0000 7f5603a4b700 1 --2- 172.21.15.161:0/910424850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 0x7f55fc0f8f00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.788+0000 7f5603a4b700 1 --2- 172.21.15.161:0/910424850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55fc0f7800 0x7f55fc0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.788+0000 7f5603a4b700 1 -- 172.21.15.161:0/910424850 >> 172.21.15.161:0/910424850 conn(0x7f55fc0f2f80 msgr2=0x7f55fc0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.788+0000 7f5603a4b700 1 -- 172.21.15.161:0/910424850 shutdown_connections 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.788+0000 7f5603a4b700 1 -- 172.21.15.161:0/910424850 wait complete. 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5603a4b700 1 Processor -- start 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5603a4b700 1 -- start start 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5603a4b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55fc0f7800 0x7f55fc06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5603a4b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 0x7f55fc06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5603a4b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc06cf80 con 0x7f55fc0f7800 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5603a4b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc06b520 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5600fe6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 0x7f55fc06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5600fe6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 0x7f55fc06b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59914/0 (socket says 172.21.15.161:59914) 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5600fe6700 1 -- 172.21.15.161:0/601111745 learned_addr learned my addr 172.21.15.161:0/601111745 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:28:57.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f56017e7700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55fc0f7800 0x7f55fc06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5600fe6700 1 -- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55fc0f7800 msgr2=0x7f55fc06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5600fe6700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55fc0f7800 0x7f55fc06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5600fe6700 1 -- 172.21.15.161:0/601111745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f8005040 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f5600fe6700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 0x7f55fc06b030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f55f8013470 tx=0x7f55f8009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.789+0000 7f55f27fc700 1 -- 172.21.15.161:0/601111745 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f800e030 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.790+0000 7f55f27fc700 1 -- 172.21.15.161:0/601111745 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f55f8007e90 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.790+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc06b740 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.790+0000 7f55f27fc700 1 -- 172.21.15.161:0/601111745 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f8018070 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.790+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc06bc20 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.790+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc06be90 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.791+0000 7f55f27fc700 1 -- 172.21.15.161:0/601111745 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f55f801d420 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.791+0000 7f55f27fc700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f55e8061180 0x7f55e8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:28:57.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.791+0000 7f55f27fc700 1 -- 172.21.15.161:0/601111745 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4103+0+0 (secure 0 0 0) 0x7f55f807d6a0 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.792+0000 7f56017e7700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f55e8061180 0x7f55e8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:28:57.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.792+0000 7f56017e7700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f55e8061180 0x7f55e8063640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f55fc0f8900 tx=0x7f55ec00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:28:57.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.796+0000 7f55f27fc700 1 -- 172.21.15.161:0/601111745 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f55f8051ba0 con 0x7f55fc0f8aa0 2024-02-22T00:28:57.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:28:57.972+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f55fc102040 con 0x7f55e8061180 2024-02-22T00:28:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:28:56.846848+0000 mgr.smithi049.rjblpr (mgr.14194) 132 : cephadm [INF] Detected new or changed devices on smithi161 2024-02-22T00:28:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:28:56.854769+0000 mgr.smithi049.rjblpr (mgr.14194) 133 : cephadm [INF] Adjusting osd_memory_target on smithi161 to 7473M 2024-02-22T00:28:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:57.976635+0000 mon.smithi049 (mon.0) 452 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:28:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:57.979093+0000 mon.smithi049 (mon.0) 453 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:28:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:57.979903+0000 mon.smithi049 (mon.0) 454 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:58.474 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:28:56.846848+0000 mgr.smithi049.rjblpr (mgr.14194) 132 : cephadm [INF] Detected new or changed devices on smithi161 2024-02-22T00:28:58.474 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:28:56.854769+0000 mgr.smithi049.rjblpr (mgr.14194) 133 : cephadm [INF] Adjusting osd_memory_target on smithi161 to 7473M 2024-02-22T00:28:58.474 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:57.976635+0000 mon.smithi049 (mon.0) 452 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-22T00:28:58.474 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:57.979093+0000 mon.smithi049 (mon.0) 453 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T00:28:58.474 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:57.979903+0000 mon.smithi049 (mon.0) 454 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:28:59.334 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:57.780060+0000 mgr.smithi049.rjblpr (mgr.14194) 134 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:28:59.335 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:28:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:28:57.974254+0000 mgr.smithi049.rjblpr (mgr.14194) 135 : audit [DBG] from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:28:59.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:57.780060+0000 mgr.smithi049.rjblpr (mgr.14194) 134 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:28:59.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:28:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:28:57.974254+0000 mgr.smithi049.rjblpr (mgr.14194) 135 : audit [DBG] from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:29:01.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:28:59.780439+0000 mgr.smithi049.rjblpr (mgr.14194) 136 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:01.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:00.338152+0000 mon.smithi161 (mon.1) 12 : audit [INF] from='client.? 172.21.15.161:0/377899285' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f97d2c3-52e0-490a-a7ec-d989884f03a8"}]: dispatch 2024-02-22T00:29:01.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:00.338642+0000 mon.smithi049 (mon.0) 455 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f97d2c3-52e0-490a-a7ec-d989884f03a8"}]: dispatch 2024-02-22T00:29:01.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:00.343253+0000 mon.smithi049 (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f97d2c3-52e0-490a-a7ec-d989884f03a8"}]': finished 2024-02-22T00:29:01.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:00.343321+0000 mon.smithi049 (mon.0) 457 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-22T00:29:01.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:00.343451+0000 mon.smithi049 (mon.0) 458 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:01.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:00.931086+0000 mon.smithi161 (mon.1) 13 : audit [DBG] from='client.? 172.21.15.161:0/3859222400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:29:01.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:28:59.780439+0000 mgr.smithi049.rjblpr (mgr.14194) 136 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:01.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:00.338152+0000 mon.smithi161 (mon.1) 12 : audit [INF] from='client.? 172.21.15.161:0/377899285' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f97d2c3-52e0-490a-a7ec-d989884f03a8"}]: dispatch 2024-02-22T00:29:01.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:00.338642+0000 mon.smithi049 (mon.0) 455 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3f97d2c3-52e0-490a-a7ec-d989884f03a8"}]: dispatch 2024-02-22T00:29:01.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:00.343253+0000 mon.smithi049 (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3f97d2c3-52e0-490a-a7ec-d989884f03a8"}]': finished 2024-02-22T00:29:01.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:00.343321+0000 mon.smithi049 (mon.0) 457 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-02-22T00:29:01.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:00.343451+0000 mon.smithi049 (mon.0) 458 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:01.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:00.931086+0000 mon.smithi161 (mon.1) 13 : audit [DBG] from='client.? 172.21.15.161:0/3859222400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T00:29:03.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:01.780826+0000 mgr.smithi049.rjblpr (mgr.14194) 137 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:03.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:01.780826+0000 mgr.smithi049.rjblpr (mgr.14194) 137 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:03.781349+0000 mgr.smithi049.rjblpr (mgr.14194) 138 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:03.781349+0000 mgr.smithi049.rjblpr (mgr.14194) 138 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:07.408 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:05.781892+0000 mgr.smithi049.rjblpr (mgr.14194) 139 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:07.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:05.781892+0000 mgr.smithi049.rjblpr (mgr.14194) 139 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:08.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:07.698774+0000 mon.smithi049 (mon.0) 459 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T00:29:08.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:07.699690+0000 mon.smithi049 (mon.0) 460 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:29:08.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:07.698774+0000 mon.smithi049 (mon.0) 459 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T00:29:08.431 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:07.699690+0000 mon.smithi049 (mon.0) 460 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:29:09.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:29:07.700501+0000 mgr.smithi049.rjblpr (mgr.14194) 140 : cephadm [INF] Deploying daemon osd.5 on smithi161 2024-02-22T00:29:09.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:07.782390+0000 mgr.smithi049.rjblpr (mgr.14194) 141 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:09.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:29:07.700501+0000 mgr.smithi049.rjblpr (mgr.14194) 140 : cephadm [INF] Deploying daemon osd.5 on smithi161 2024-02-22T00:29:09.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:07.782390+0000 mgr.smithi049.rjblpr (mgr.14194) 141 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:11.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:09.782773+0000 mgr.smithi049.rjblpr (mgr.14194) 142 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:11.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:09.782773+0000 mgr.smithi049.rjblpr (mgr.14194) 142 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:13.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:11.783074+0000 mgr.smithi049.rjblpr (mgr.14194) 143 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:13.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:12.707752+0000 mon.smithi049 (mon.0) 461 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:13.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:12.735300+0000 mon.smithi049 (mon.0) 462 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:29:13.471 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:11.783074+0000 mgr.smithi049.rjblpr (mgr.14194) 143 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:13.471 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:12.707752+0000 mon.smithi049 (mon.0) 461 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:13.471 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:12.735300+0000 mon.smithi049 (mon.0) 462 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:29:15.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:13.783551+0000 mgr.smithi049.rjblpr (mgr.14194) 144 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:15.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:13.783551+0000 mgr.smithi049.rjblpr (mgr.14194) 144 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:15.693 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 5 on host 'smithi161' 2024-02-22T00:29:15.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.690+0000 7f55f27fc700 1 -- 172.21.15.161:0/601111745 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f55ec00f040 con 0x7f55e8061180 2024-02-22T00:29:15.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f55e8061180 msgr2=0x7f55e8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:15.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f55e8061180 0x7f55e8063640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f55fc0f8900 tx=0x7f55ec00b040).stop 2024-02-22T00:29:15.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 msgr2=0x7f55fc06b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:15.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 0x7f55fc06b030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f55f8013470 tx=0x7f55f8009cb0).stop 2024-02-22T00:29:15.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 shutdown_connections 2024-02-22T00:29:15.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55fc0f7800 0x7f55fc06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:15.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f55e8061180 0x7f55e8063640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:15.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 --2- 172.21.15.161:0/601111745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55fc0f8aa0 0x7f55fc06b030 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:15.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 >> 172.21.15.161:0/601111745 conn(0x7f55fc0f2f80 msgr2=0x7f55fc0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:15.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 shutdown_connections 2024-02-22T00:29:15.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:15.692+0000 7f5603a4b700 1 -- 172.21.15.161:0/601111745 wait complete. 2024-02-22T00:29:16.436 DEBUG:teuthology.orchestra.run.smithi161:osd.5> sudo journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.5.service 2024-02-22T00:29:16.438 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-22T00:29:16.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd stat -f json 2024-02-22T00:29:16.471 INFO:journalctl@ceph.osd.5.smithi161.stdout:-- Logs begin at Wed 2024-02-21 23:55:52 UTC. -- 2024-02-22T00:29:16.700 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:29:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[87416]: debug 2024-02-22T00:29:16.598+0000 7fbeb0c97380 -1 osd.5 0 log_to_monitors {default=true} 2024-02-22T00:29:16.787 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:15.690124+0000 mon.smithi049 (mon.0) 463 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:16.788 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:15.783950+0000 mgr.smithi049.rjblpr (mgr.14194) 145 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:16.788 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:16.602116+0000 mon.smithi161 (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T00:29:16.788 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:16.602473+0000 mon.smithi049 (mon.0) 464 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T00:29:17.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:15.690124+0000 mon.smithi049 (mon.0) 463 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:17.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:15.783950+0000 mgr.smithi049.rjblpr (mgr.14194) 145 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:17.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:16.602116+0000 mon.smithi161 (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T00:29:17.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:16.602473+0000 mon.smithi049 (mon.0) 464 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T00:29:17.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:16.694967+0000 mon.smithi049 (mon.0) 465 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T00:29:17.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:16.695046+0000 mon.smithi049 (mon.0) 466 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-22T00:29:17.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:16.695167+0000 mon.smithi049 (mon.0) 467 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:17.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:16.699882+0000 mon.smithi161 (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:29:17.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:16.700263+0000 mon.smithi049 (mon.0) 468 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:29:18.044 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:29:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[87416]: debug 2024-02-22T00:29:17.698+0000 7fbea7205700 -1 osd.5 0 waiting for initial osdmap 2024-02-22T00:29:18.044 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:29:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[87416]: debug 2024-02-22T00:29:17.706+0000 7fbea097b700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:29:18.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:16.694967+0000 mon.smithi049 (mon.0) 465 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T00:29:18.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:16.695046+0000 mon.smithi049 (mon.0) 466 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-02-22T00:29:18.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:16.695167+0000 mon.smithi049 (mon.0) 467 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:18.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:16.699882+0000 mon.smithi161 (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:29:18.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:16.700263+0000 mon.smithi049 (mon.0) 468 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:29:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.452+0000 7feb2e954700 1 -- 172.21.15.49:0/2123226568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f66f0 msgr2=0x7feb280f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.452+0000 7feb2e954700 1 --2- 172.21.15.49:0/2123226568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f66f0 0x7feb280f6b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7feb180047f0 tx=0x7feb18009cb0).stop 2024-02-22T00:29:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.452+0000 7feb2e954700 1 -- 172.21.15.49:0/2123226568 shutdown_connections 2024-02-22T00:29:18.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.452+0000 7feb2e954700 1 --2- 172.21.15.49:0/2123226568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb280f7990 0x7feb280f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:18.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.452+0000 7feb2e954700 1 --2- 172.21.15.49:0/2123226568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f66f0 0x7feb280f6b10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:18.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.452+0000 7feb2e954700 1 -- 172.21.15.49:0/2123226568 >> 172.21.15.49:0/2123226568 conn(0x7feb280f1e50 msgr2=0x7feb280f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:18.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.452+0000 7feb2e954700 1 -- 172.21.15.49:0/2123226568 shutdown_connections 2024-02-22T00:29:18.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.452+0000 7feb2e954700 1 -- 172.21.15.49:0/2123226568 wait complete. 2024-02-22T00:29:18.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.453+0000 7feb2e954700 1 Processor -- start 2024-02-22T00:29:18.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.453+0000 7feb2e954700 1 -- start start 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.453+0000 7feb2e954700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb280f66f0 0x7feb28061060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.453+0000 7feb2e954700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f7990 0x7feb2810cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.453+0000 7feb2e954700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2810d270 con 0x7feb280f7990 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.453+0000 7feb2e954700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2810d3b0 con 0x7feb280f66f0 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.453+0000 7feb277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f7990 0x7feb2810cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb27fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb280f66f0 0x7feb28061060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb277fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f7990 0x7feb2810cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54660/0 (socket says 172.21.15.49:54660) 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb277fe700 1 -- 172.21.15.49:0/1444429274 learned_addr learned my addr 172.21.15.49:0/1444429274 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:18.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb277fe700 1 -- 172.21.15.49:0/1444429274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb280f66f0 msgr2=0x7feb28061060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb277fe700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb280f66f0 0x7feb28061060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb277fe700 1 -- 172.21.15.49:0/1444429274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb18005040 con 0x7feb280f7990 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb277fe700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f7990 0x7feb2810cd80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7feb1c002820 tx=0x7feb1c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb257fa700 1 -- 172.21.15.49:0/1444429274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb1c007b40 con 0x7feb280f7990 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2810d610 con 0x7feb280f7990 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb257fa700 1 -- 172.21.15.49:0/1444429274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7feb1c00f040 con 0x7feb280f7990 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb257fa700 1 -- 172.21.15.49:0/1444429274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb1c00d740 con 0x7feb280f7990 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.454+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2810db50 con 0x7feb280f7990 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.455+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb280feeb0 con 0x7feb280f7990 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.456+0000 7feb257fa700 1 -- 172.21.15.49:0/1444429274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7feb1c009110 con 0x7feb280f7990 2024-02-22T00:29:18.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.456+0000 7feb257fa700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7feb10061180 0x7feb10063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.456+0000 7feb27fff700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7feb10061180 0x7feb10063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.456+0000 7feb257fa700 1 -- 172.21.15.49:0/1444429274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4255+0+0 (secure 0 0 0) 0x7feb1c07bd70 con 0x7feb280f7990 2024-02-22T00:29:18.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.457+0000 7feb27fff700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7feb10061180 0x7feb10063640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7feb18004f10 tx=0x7feb1800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:18.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.461+0000 7feb257fa700 1 -- 172.21.15.49:0/1444429274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7feb1c050160 con 0x7feb280f7990 2024-02-22T00:29:18.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.633+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7feb28059920 con 0x7feb280f7990 2024-02-22T00:29:18.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.633+0000 7feb257fa700 1 -- 172.21.15.49:0/1444429274 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7feb1c04fd50 con 0x7feb280f7990 2024-02-22T00:29:18.637 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:29:18.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7feb10061180 msgr2=0x7feb10063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:18.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7feb10061180 0x7feb10063640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7feb18004f10 tx=0x7feb1800b040).stop 2024-02-22T00:29:18.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f7990 msgr2=0x7feb2810cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:18.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f7990 0x7feb2810cd80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7feb1c002820 tx=0x7feb1c009f60).stop 2024-02-22T00:29:18.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 shutdown_connections 2024-02-22T00:29:18.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7feb10061180 0x7feb10063640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:18.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb280f66f0 0x7feb28061060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:18.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 --2- 172.21.15.49:0/1444429274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb280f7990 0x7feb2810cd80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:18.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 >> 172.21.15.49:0/1444429274 conn(0x7feb280f1e50 msgr2=0x7feb280fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:18.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 shutdown_connections 2024-02-22T00:29:18.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:18.635+0000 7feb2e954700 1 -- 172.21.15.49:0/1444429274 wait complete. 2024-02-22T00:29:18.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:17.696129+0000 mon.smithi049 (mon.0) 469 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-02-22T00:29:18.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:17.696195+0000 mon.smithi049 (mon.0) 470 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-22T00:29:18.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:17.696514+0000 mon.smithi049 (mon.0) 471 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:18.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:17.699633+0000 mon.smithi049 (mon.0) 472 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:18.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:17.784296+0000 mgr.smithi049.rjblpr (mgr.14194) 146 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:18.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:18.218967+0000 mon.smithi049 (mon.0) 473 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:18.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:18.634724+0000 mon.smithi049 (mon.0) 474 : audit [DBG] from='client.? 172.21.15.49:0/1444429274' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T00:29:18.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:17.696129+0000 mon.smithi049 (mon.0) 469 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-02-22T00:29:18.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:17.696195+0000 mon.smithi049 (mon.0) 470 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-02-22T00:29:18.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:17.696514+0000 mon.smithi049 (mon.0) 471 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:18.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:17.699633+0000 mon.smithi049 (mon.0) 472 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:18.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:17.784296+0000 mgr.smithi049.rjblpr (mgr.14194) 146 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-22T00:29:18.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:18.218967+0000 mon.smithi049 (mon.0) 473 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:18.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:18.634724+0000 mon.smithi049 (mon.0) 474 : audit [DBG] from='client.? 172.21.15.49:0/1444429274' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T00:29:19.283 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1708561733,"num_in_osds":6,"osd_in_since":1708561740,"num_remapped_pgs":0} 2024-02-22T00:29:20.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:17.568632+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:29:20.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:17.568701+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:29:20.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:18.700723+0000 mon.smithi049 (mon.0) 475 : cluster [INF] osd.5 [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] boot 2024-02-22T00:29:20.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:18.700755+0000 mon.smithi049 (mon.0) 476 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-22T00:29:20.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:18.701025+0000 mon.smithi049 (mon.0) 477 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:20.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:17.568632+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T00:29:20.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:17.568701+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T00:29:20.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:18.700723+0000 mon.smithi049 (mon.0) 475 : cluster [INF] osd.5 [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] boot 2024-02-22T00:29:20.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:18.700755+0000 mon.smithi049 (mon.0) 476 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-22T00:29:20.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:18.701025+0000 mon.smithi049 (mon.0) 477 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:29:20.284 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd stat -f json 2024-02-22T00:29:20.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:19.712973+0000 mon.smithi049 (mon.0) 478 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-22T00:29:20.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:19.784702+0000 mgr.smithi049.rjblpr (mgr.14194) 147 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:21.007 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:19.712973+0000 mon.smithi049 (mon.0) 478 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-02-22T00:29:21.007 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:19.784702+0000 mgr.smithi049.rjblpr (mgr.14194) 147 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 -- 172.21.15.49:0/3844991123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 msgr2=0x7f5d000f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 --2- 172.21.15.49:0/3844991123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 0x7f5d000f6b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5cfc0047f0 tx=0x7f5cfc009cb0).stop 2024-02-22T00:29:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 -- 172.21.15.49:0/3844991123 shutdown_connections 2024-02-22T00:29:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 --2- 172.21.15.49:0/3844991123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d000f7990 0x7f5d000f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 --2- 172.21.15.49:0/3844991123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 0x7f5d000f6b10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 -- 172.21.15.49:0/3844991123 >> 172.21.15.49:0/3844991123 conn(0x7f5d000f1e50 msgr2=0x7f5d000f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 -- 172.21.15.49:0/3844991123 shutdown_connections 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 -- 172.21.15.49:0/3844991123 wait complete. 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 Processor -- start 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.392+0000 7f5d07f9d700 1 -- start start 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d07f9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 0x7f5d000fae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d07f9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d000f7990 0x7f5d000f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d07f9d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000fb440 con 0x7f5d000f66f0 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d07f9d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000f99e0 con 0x7f5d000f7990 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d05d39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 0x7f5d000fae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d05d39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 0x7f5d000fae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46708/0 (socket says 172.21.15.49:46708) 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d05d39700 1 -- 172.21.15.49:0/4189200185 learned_addr learned my addr 172.21.15.49:0/4189200185 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d05538700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d000f7990 0x7f5d000f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d05d39700 1 -- 172.21.15.49:0/4189200185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d000f7990 msgr2=0x7f5d000f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d05d39700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d000f7990 0x7f5d000f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d05d39700 1 -- 172.21.15.49:0/4189200185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc005040 con 0x7f5d000f66f0 2024-02-22T00:29:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d05d39700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 0x7f5d000fae90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5cfc004f10 tx=0x7f5cfc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5cf2ffd700 1 -- 172.21.15.49:0/4189200185 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cfc00e070 con 0x7f5d000f66f0 2024-02-22T00:29:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5cf2ffd700 1 -- 172.21.15.49:0/4189200185 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5cfc007e90 con 0x7f5d000f66f0 2024-02-22T00:29:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d000f9c00 con 0x7f5d000f66f0 2024-02-22T00:29:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5cf2ffd700 1 -- 172.21.15.49:0/4189200185 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cfc018070 con 0x7f5d000f66f0 2024-02-22T00:29:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.393+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d000fa0e0 con 0x7f5d000f66f0 2024-02-22T00:29:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.394+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d000fa350 con 0x7f5d000f66f0 2024-02-22T00:29:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.395+0000 7f5cf2ffd700 1 -- 172.21.15.49:0/4189200185 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f5cfc0123c0 con 0x7f5d000f66f0 2024-02-22T00:29:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.395+0000 7f5cf2ffd700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5cec061180 0x7f5cec063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.395+0000 7f5cf2ffd700 1 -- 172.21.15.49:0/4189200185 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f5cfc07d240 con 0x7f5d000f66f0 2024-02-22T00:29:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.395+0000 7f5d05538700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5cec061180 0x7f5cec063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.396+0000 7f5d05538700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5cec061180 0x7f5cec063640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5cf4004de0 tx=0x7f5cf400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:22.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.400+0000 7f5cf2ffd700 1 -- 172.21.15.49:0/4189200185 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5cfc051590 con 0x7f5d000f66f0 2024-02-22T00:29:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:29:21.374852+0000 mgr.smithi049.rjblpr (mgr.14194) 148 : cephadm [INF] Detected new or changed devices on smithi161 2024-02-22T00:29:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.379467+0000 mon.smithi049 (mon.0) 479 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.380355+0000 mon.smithi049 (mon.0) 480 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:29:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.381008+0000 mon.smithi049 (mon.0) 481 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:29:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.381597+0000 mon.smithi049 (mon.0) 482 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:29:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:29:21.382054+0000 mgr.smithi049.rjblpr (mgr.14194) 149 : cephadm [INF] Adjusting osd_memory_target on smithi161 to 4982M 2024-02-22T00:29:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.386091+0000 mon.smithi049 (mon.0) 483 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.387087+0000 mon.smithi049 (mon.0) 484 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:29:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.387712+0000 mon.smithi049 (mon.0) 485 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:29:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.391646+0000 mon.smithi049 (mon.0) 486 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.395341+0000 mon.smithi049 (mon.0) 487 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:29:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.396624+0000 mon.smithi049 (mon.0) 488 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:29:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.397234+0000 mon.smithi049 (mon.0) 489 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:29:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:21.400999+0000 mon.smithi049 (mon.0) 490 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:21.785018+0000 mgr.smithi049.rjblpr (mgr.14194) 150 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:22.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.572+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f5d00110670 con 0x7f5d000f66f0 2024-02-22T00:29:22.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.572+0000 7f5cf2ffd700 1 -- 172.21.15.49:0/4189200185 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f5cfc051180 con 0x7f5d000f66f0 2024-02-22T00:29:22.575 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5cec061180 msgr2=0x7f5cec063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5cec061180 0x7f5cec063640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5cf4004de0 tx=0x7f5cf400b040).stop 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 msgr2=0x7f5d000fae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 0x7f5d000fae90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f5cfc004f10 tx=0x7f5cfc009cb0).stop 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 shutdown_connections 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d000f66f0 0x7f5d000fae90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5cec061180 0x7f5cec063640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 --2- 172.21.15.49:0/4189200185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5d000f7990 0x7f5d000f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:22.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 >> 172.21.15.49:0/4189200185 conn(0x7f5d000f1e50 msgr2=0x7f5d00060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:22.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 shutdown_connections 2024-02-22T00:29:22.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:22.574+0000 7f5d07f9d700 1 -- 172.21.15.49:0/4189200185 wait complete. 2024-02-22T00:29:22.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:29:21.374852+0000 mgr.smithi049.rjblpr (mgr.14194) 148 : cephadm [INF] Detected new or changed devices on smithi161 2024-02-22T00:29:22.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.379467+0000 mon.smithi049 (mon.0) 479 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.380355+0000 mon.smithi049 (mon.0) 480 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.381008+0000 mon.smithi049 (mon.0) 481 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.381597+0000 mon.smithi049 (mon.0) 482 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:29:21.382054+0000 mgr.smithi049.rjblpr (mgr.14194) 149 : cephadm [INF] Adjusting osd_memory_target on smithi161 to 4982M 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.386091+0000 mon.smithi049 (mon.0) 483 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.387087+0000 mon.smithi049 (mon.0) 484 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.387712+0000 mon.smithi049 (mon.0) 485 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.391646+0000 mon.smithi049 (mon.0) 486 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.395341+0000 mon.smithi049 (mon.0) 487 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.396624+0000 mon.smithi049 (mon.0) 488 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.397234+0000 mon.smithi049 (mon.0) 489 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:21.400999+0000 mon.smithi049 (mon.0) 490 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:29:22.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:21.785018+0000 mgr.smithi049.rjblpr (mgr.14194) 150 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:23.297 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1708561758,"num_in_osds":6,"osd_in_since":1708561740,"num_remapped_pgs":0} 2024-02-22T00:29:23.298 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd dump --format=json 2024-02-22T00:29:23.577 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:23.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:22.573425+0000 mon.smithi049 (mon.0) 491 : audit [DBG] from='client.? 172.21.15.49:0/4189200185' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T00:29:23.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:22.573425+0000 mon.smithi049 (mon.0) 491 : audit [DBG] from='client.? 172.21.15.49:0/4189200185' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T00:29:24.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:23.785425+0000 mgr.smithi049.rjblpr (mgr.14194) 151 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:24.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:23.785425+0000 mgr.smithi049.rjblpr (mgr.14194) 151 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 -- 172.21.15.49:0/673186285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 msgr2=0x7fc1880f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 --2- 172.21.15.49:0/673186285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 0x7fc1880f90b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fc1780047f0 tx=0x7fc178009cb0).stop 2024-02-22T00:29:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 -- 172.21.15.49:0/673186285 shutdown_connections 2024-02-22T00:29:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 --2- 172.21.15.49:0/673186285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 0x7fc1880f90b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 --2- 172.21.15.49:0/673186285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1880f79b0 0x7fc1880f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 -- 172.21.15.49:0/673186285 >> 172.21.15.49:0/673186285 conn(0x7fc1880f30f0 msgr2=0x7fc1880f5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 -- 172.21.15.49:0/673186285 shutdown_connections 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 -- 172.21.15.49:0/673186285 wait complete. 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.200+0000 7fc18d731700 1 Processor -- start 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc18d731700 1 -- start start 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc18d731700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1880f79b0 0x7fc18806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc18d731700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 0x7fc18806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc18d731700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18806cf80 con 0x7fc1880f8c50 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc18d731700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18806b520 con 0x7fc1880f79b0 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc1867fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 0x7fc18806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc1867fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 0x7fc18806b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46732/0 (socket says 172.21.15.49:46732) 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc1867fc700 1 -- 172.21.15.49:0/421396326 learned_addr learned my addr 172.21.15.49:0/421396326 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc186ffd700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1880f79b0 0x7fc18806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc1867fc700 1 -- 172.21.15.49:0/421396326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1880f79b0 msgr2=0x7fc18806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc1867fc700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1880f79b0 0x7fc18806c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc1867fc700 1 -- 172.21.15.49:0/421396326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178005040 con 0x7fc1880f8c50 2024-02-22T00:29:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc1867fc700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 0x7fc18806b030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc178013510 tx=0x7fc178009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.201+0000 7fc17ffff700 1 -- 172.21.15.49:0/421396326 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc17800e030 con 0x7fc1880f8c50 2024-02-22T00:29:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.202+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18806b740 con 0x7fc1880f8c50 2024-02-22T00:29:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.202+0000 7fc17ffff700 1 -- 172.21.15.49:0/421396326 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc178007e90 con 0x7fc1880f8c50 2024-02-22T00:29:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.202+0000 7fc17ffff700 1 -- 172.21.15.49:0/421396326 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc178018070 con 0x7fc1880f8c50 2024-02-22T00:29:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.202+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18806bc20 con 0x7fc1880f8c50 2024-02-22T00:29:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.203+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18806be40 con 0x7fc1880f8c50 2024-02-22T00:29:25.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.203+0000 7fc17ffff700 1 -- 172.21.15.49:0/421396326 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fc17801c780 con 0x7fc1880f8c50 2024-02-22T00:29:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.203+0000 7fc17ffff700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fc174061180 0x7fc174063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.203+0000 7fc17ffff700 1 -- 172.21.15.49:0/421396326 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fc17807dbb0 con 0x7fc1880f8c50 2024-02-22T00:29:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.203+0000 7fc186ffd700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fc174061180 0x7fc174063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:25.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.204+0000 7fc186ffd700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fc174061180 0x7fc174063640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc1880f8ab0 tx=0x7fc170009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:25.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.207+0000 7fc17ffff700 1 -- 172.21.15.49:0/421396326 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc178084080 con 0x7fc1880f8c50 2024-02-22T00:29:25.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.379+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc188102010 con 0x7fc1880f8c50 2024-02-22T00:29:25.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.380+0000 7fc17ffff700 1 -- 172.21.15.49:0/421396326 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10913 (secure 0 0 0) 0x7fc178051e80 con 0x7fc1880f8c50 2024-02-22T00:29:25.383 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:29:25.383 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","created":"2024-02-22T00:24:07.498307+0000","modified":"2024-02-22T00:29:19.705944+0000","last_up_change":"2024-02-22T00:29:18.697160+0000","last_in_change":"2024-02-22T00:29:00.339229+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T00:28:03.647916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"14701491-880b-4aa8-b29c-2f93fad67550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6803","nonce":683996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6805","nonce":683996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6809","nonce":683996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6807","nonce":683996799}]},"public_addr":"172.21.15.49:6803/683996799","cluster_addr":"172.21.15.49:6805/683996799","heartbeat_back_addr":"172.21.15.49:6809/683996799","heartbeat_front_addr":"172.21.15.49:6807/683996799","state":["exists","up"]},{"osd":1,"uuid":"6a984f0c-ab4d-4881-baf7-7821af596292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6811","nonce":3836451812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6813","nonce":3836451812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6817","nonce":3836451812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6815","nonce":3836451812}]},"public_addr":"172.21.15.49:6811/3836451812","cluster_addr":"172.21.15.49:6813/3836451812","heartbeat_back_addr":"172.21.15.49:6817/3836451812","heartbeat_front_addr":"172.21.15.49:6815/3836451812","state":["exists","up"]},{"osd":2,"uuid":"fdbc04fa-88df-4bd8-9272-38e17a0ddc99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6819","nonce":153604959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6821","nonce":153604959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6825","nonce":153604959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6823","nonce":153604959}]},"public_addr":"172.21.15.49:6819/153604959","cluster_addr":"172.21.15.49:6821/153604959","heartbeat_back_addr":"172.21.15.49:6825/153604959","heartbeat_front_addr":"172.21.15.49:6823/153604959","state":["exists","up"]},{"osd":3,"uuid":"b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6801","nonce":1725433098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6803","nonce":1725433098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6807","nonce":1725433098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6805","nonce":1725433098}]},"public_addr":"172.21.15.161:6801/1725433098","cluster_addr":"172.21.15.161:6803/1725433098","heartbeat_back_addr":"172.21.15.161:6807/1725433098","heartbeat_front_addr":"172.21.15.161:6805/1725433098","state":["exists","up"]},{"osd":4,"uuid":"a017d7c9-0283-4fe1-8839-1ccbdbd95972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6809","nonce":1996423243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6811","nonce":1996423243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6815","nonce":1996423243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6813","nonce":1996423243}]},"public_addr":"172.21.15.161:6809/1996423243","cluster_addr":"172.21.15.161:6811/1996423243","heartbeat_back_addr":"172.21.15.161:6815/1996423243","heartbeat_front_addr":"172.21.15.161:6813/1996423243","state":["exists","up"]},{"osd":5,"uuid":"3f97d2c3-52e0-490a-a7ec-d989884f03a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6817","nonce":1791237181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6819","nonce":1791237181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6823","nonce":1791237181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6821","nonce":1791237181}]},"public_addr":"172.21.15.161:6817/1791237181","cluster_addr":"172.21.15.161:6819/1791237181","heartbeat_back_addr":"172.21.15.161:6823/1791237181","heartbeat_front_addr":"172.21.15.161:6821/1791237181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:26:57.942621+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:27:33.707227+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:01.399431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:25.246971+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:51.257793+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:29:17.568705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6801/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/1752326277":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/755765908":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/2319195782":"2024-02-23T00:25:10.135002+0000","172.21.15.49:6801/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:6800/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/4194533393":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6801/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/1567499828":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/3181714365":"2024-02-23T00:24:40.044887+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-22T00:29:25.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fc174061180 msgr2=0x7fc174063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fc174061180 0x7fc174063640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc1880f8ab0 tx=0x7fc170009040).stop 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 msgr2=0x7fc18806b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 0x7fc18806b030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc178013510 tx=0x7fc178009cb0).stop 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 shutdown_connections 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fc174061180 0x7fc174063640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1880f79b0 0x7fc18806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 --2- 172.21.15.49:0/421396326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc1880f8c50 0x7fc18806b030 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.381+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 >> 172.21.15.49:0/421396326 conn(0x7fc1880f30f0 msgr2=0x7fc1880fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.382+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 shutdown_connections 2024-02-22T00:29:25.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:25.382+0000 7fc18d731700 1 -- 172.21.15.49:0/421396326 wait complete. 2024-02-22T00:29:25.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:25.380646+0000 mon.smithi049 (mon.0) 492 : audit [DBG] from='client.? 172.21.15.49:0/421396326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T00:29:25.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:25.380646+0000 mon.smithi049 (mon.0) 492 : audit [DBG] from='client.? 172.21.15.49:0/421396326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T00:29:25.993 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-22T00:28:03.647916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-02-22T00:29:25.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-22T00:29:26.271 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:26.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:25.785709+0000 mgr.smithi049.rjblpr (mgr.14194) 152 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:26.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:25.785709+0000 mgr.smithi049.rjblpr (mgr.14194) 152 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:28.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.039+0000 7f6cd3f39700 1 -- 172.21.15.49:0/2973895656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 msgr2=0x7f6ccc0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.039+0000 7f6cd3f39700 1 --2- 172.21.15.49:0/2973895656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 0x7f6ccc0f7dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f6cbc0047f0 tx=0x7f6cbc009cb0).stop 2024-02-22T00:29:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.039+0000 7f6cd3f39700 1 -- 172.21.15.49:0/2973895656 shutdown_connections 2024-02-22T00:29:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.039+0000 7f6cd3f39700 1 --2- 172.21.15.49:0/2973895656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc0f8c40 0x7f6ccc0f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.039+0000 7f6cd3f39700 1 --2- 172.21.15.49:0/2973895656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 0x7f6ccc0f7dc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.039+0000 7f6cd3f39700 1 -- 172.21.15.49:0/2973895656 >> 172.21.15.49:0/2973895656 conn(0x7f6ccc0f3100 msgr2=0x7f6ccc0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.039+0000 7f6cd3f39700 1 -- 172.21.15.49:0/2973895656 shutdown_connections 2024-02-22T00:29:28.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.039+0000 7f6cd3f39700 1 -- 172.21.15.49:0/2973895656 wait complete. 2024-02-22T00:29:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd3f39700 1 Processor -- start 2024-02-22T00:29:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd3f39700 1 -- start start 2024-02-22T00:29:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd3f39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 0x7f6ccc1080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd3f39700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc0f8c40 0x7f6ccc108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd3f39700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc108b40 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd3f39700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ccc108c80 con 0x7f6ccc0f8c40 2024-02-22T00:29:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd1cd5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 0x7f6ccc1080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:28.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd1cd5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 0x7f6ccc1080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46754/0 (socket says 172.21.15.49:46754) 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.040+0000 7f6cd1cd5700 1 -- 172.21.15.49:0/127718882 learned_addr learned my addr 172.21.15.49:0/127718882 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cd14d4700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc0f8c40 0x7f6ccc108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cd1cd5700 1 -- 172.21.15.49:0/127718882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc0f8c40 msgr2=0x7f6ccc108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cd1cd5700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc0f8c40 0x7f6ccc108590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cd1cd5700 1 -- 172.21.15.49:0/127718882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc005040 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cd1cd5700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 0x7f6ccc1080a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f6cbc004f10 tx=0x7f6cbc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/127718882 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cbc00e070 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/127718882 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f6cbc007e90 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ccc10d6c0 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/127718882 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cbc018070 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.041+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc10dc00 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.042+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ccc1000f0 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.043+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/127718882 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f6cbc0123c0 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.043+0000 7f6cc2ffd700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6cb8061180 0x7f6cb8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.043+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/127718882 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f6cbc07d400 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.043+0000 7f6cd14d4700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6cb8061180 0x7f6cb8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:28.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.043+0000 7f6cd14d4700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6cb8061180 0x7f6cb8063640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6cc8009170 tx=0x7f6cc8009d60).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:28.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.047+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/127718882 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6cbc051750 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.217+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6ccc101f60 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.217+0000 7f6cc2ffd700 1 -- 172.21.15.49:0/127718882 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v38) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6cbc051340 con 0x7f6ccc0f79a0 2024-02-22T00:29:28.221 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-02-22T00:29:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6cb8061180 msgr2=0x7f6cb8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6cb8061180 0x7f6cb8063640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6cc8009170 tx=0x7f6cc8009d60).stop 2024-02-22T00:29:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 msgr2=0x7f6ccc1080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 0x7f6ccc1080a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f6cbc004f10 tx=0x7f6cbc009cb0).stop 2024-02-22T00:29:28.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 shutdown_connections 2024-02-22T00:29:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ccc0f79a0 0x7f6ccc1080a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6cb8061180 0x7f6cb8063640 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 --2- 172.21.15.49:0/127718882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ccc0f8c40 0x7f6ccc108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 >> 172.21.15.49:0/127718882 conn(0x7f6ccc0f3100 msgr2=0x7f6ccc0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 shutdown_connections 2024-02-22T00:29:28.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:28.219+0000 7f6cd3f39700 1 -- 172.21.15.49:0/127718882 wait complete. 2024-02-22T00:29:28.848 INFO:tasks.cephadm:Setting up client nodes... 2024-02-22T00:29:28.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-22T00:29:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:27.786058+0000 mgr.smithi049.rjblpr (mgr.14194) 153 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:28.218493+0000 mon.smithi049 (mon.0) 493 : audit [DBG] from='client.? 172.21.15.49:0/127718882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T00:29:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:27.786058+0000 mgr.smithi049.rjblpr (mgr.14194) 153 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:28.218493+0000 mon.smithi049 (mon.0) 493 : audit [DBG] from='client.? 172.21.15.49:0/127718882' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T00:29:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.774+0000 7f9ca5189700 1 -- 172.21.15.49:0/3710863024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 msgr2=0x7f9ca00f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.774+0000 7f9ca5189700 1 --2- 172.21.15.49:0/3710863024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 0x7f9ca00f6b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9c880047f0 tx=0x7f9c88009cb0).stop 2024-02-22T00:29:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.774+0000 7f9ca5189700 1 -- 172.21.15.49:0/3710863024 shutdown_connections 2024-02-22T00:29:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.774+0000 7f9ca5189700 1 --2- 172.21.15.49:0/3710863024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca00f7990 0x7f9ca00f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:29:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.774+0000 7f9ca5189700 1 --2- 172.21.15.49:0/3710863024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 0x7f9ca00f6b10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.774+0000 7f9ca5189700 1 -- 172.21.15.49:0/3710863024 >> 172.21.15.49:0/3710863024 conn(0x7f9ca00f1e50 msgr2=0x7f9ca00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.774+0000 7f9ca5189700 1 -- 172.21.15.49:0/3710863024 shutdown_connections 2024-02-22T00:29:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.774+0000 7f9ca5189700 1 -- 172.21.15.49:0/3710863024 wait complete. 2024-02-22T00:29:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.775+0000 7f9ca5189700 1 Processor -- start 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.775+0000 7f9ca5189700 1 -- start start 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9ca5189700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 0x7f9ca00fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9ca5189700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca00f7990 0x7f9ca00f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9ca5189700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00f91c0 con 0x7f9ca00f66f0 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9ca5189700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00f9300 con 0x7f9ca00f7990 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c9ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 0x7f9ca00fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c9ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 0x7f9ca00fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46762/0 (socket says 172.21.15.49:46762) 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c9ed9d700 1 -- 172.21.15.49:0/1246354973 learned_addr learned my addr 172.21.15.49:0/1246354973 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c9e59c700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca00f7990 0x7f9ca00f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c9ed9d700 1 -- 172.21.15.49:0/1246354973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca00f7990 msgr2=0x7f9ca00f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c9ed9d700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca00f7990 0x7f9ca00f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c9ed9d700 1 -- 172.21.15.49:0/1246354973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88005040 con 0x7f9ca00f66f0 2024-02-22T00:29:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c9ed9d700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 0x7f9ca00fa670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9c88013470 tx=0x7f9c88009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c97fff700 1 -- 172.21.15.49:0/1246354973 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c8800e030 con 0x7f9ca00f66f0 2024-02-22T00:29:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c97fff700 1 -- 172.21.15.49:0/1246354973 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9c88007e90 con 0x7f9ca00f66f0 2024-02-22T00:29:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca00f9580 con 0x7f9ca00f66f0 2024-02-22T00:29:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9c97fff700 1 -- 172.21.15.49:0/1246354973 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c88018070 con 0x7f9ca00f66f0 2024-02-22T00:29:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.776+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca00f9a60 con 0x7f9ca00f66f0 2024-02-22T00:29:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.777+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca00fef30 con 0x7f9ca00f66f0 2024-02-22T00:29:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.778+0000 7f9c97fff700 1 -- 172.21.15.49:0/1246354973 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9c8801d420 con 0x7f9ca00f66f0 2024-02-22T00:29:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.778+0000 7f9c97fff700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9c8c061180 0x7f9c8c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.778+0000 7f9c97fff700 1 -- 172.21.15.49:0/1246354973 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f9c8807d950 con 0x7f9ca00f66f0 2024-02-22T00:29:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.778+0000 7f9c9e59c700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9c8c061180 0x7f9c8c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.778+0000 7f9c9e59c700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9c8c061180 0x7f9c8c063640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9c90006fd0 tx=0x7f9c90009060).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:30.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:30.782+0000 7f9c97fff700 1 -- 172.21.15.49:0/1246354973 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9c88051ca0 con 0x7f9ca00f66f0 2024-02-22T00:29:31.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.021+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9ca0110750 con 0x7f9ca00f66f0 2024-02-22T00:29:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.025+0000 7f9c97fff700 1 -- 172.21.15.49:0/1246354973 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9c88051890 con 0x7f9ca00f66f0 2024-02-22T00:29:31.028 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-02-22T00:29:31.028 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQBrldZlNuheARAA4QjLyBylVnMULpDwUUd1XQ== 2024-02-22T00:29:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9c8c061180 msgr2=0x7f9c8c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9c8c061180 0x7f9c8c063640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9c90006fd0 tx=0x7f9c90009060).stop 2024-02-22T00:29:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 msgr2=0x7f9ca00fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 0x7f9ca00fa670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9c88013470 tx=0x7f9c88009cb0).stop 2024-02-22T00:29:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 shutdown_connections 2024-02-22T00:29:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca00f66f0 0x7f9ca00fa670 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9c8c061180 0x7f9c8c063640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 --2- 172.21.15.49:0/1246354973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca00f7990 0x7f9ca00f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 >> 172.21.15.49:0/1246354973 conn(0x7f9ca00f1e50 msgr2=0x7f9ca0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 shutdown_connections 2024-02-22T00:29:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:31.027+0000 7f9ca5189700 1 -- 172.21.15.49:0/1246354973 wait complete. 2024-02-22T00:29:31.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:29.786365+0000 mgr.smithi049.rjblpr (mgr.14194) 154 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:31.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:29.786365+0000 mgr.smithi049.rjblpr (mgr.14194) 154 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:31.625 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:29:31.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-22T00:29:31.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-22T00:29:31.667 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-22T00:29:31.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:31.022801+0000 mon.smithi049 (mon.0) 494 : audit [INF] from='client.? 172.21.15.49:0/1246354973' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T00:29:31.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:31.026324+0000 mon.smithi049 (mon.0) 495 : audit [INF] from='client.? 172.21.15.49:0/1246354973' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T00:29:32.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:31 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:31.022801+0000 mon.smithi049 (mon.0) 494 : audit [INF] from='client.? 172.21.15.49:0/1246354973' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T00:29:32.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:31 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:31.026324+0000 mon.smithi049 (mon.0) 495 : audit [INF] from='client.? 172.21.15.49:0/1246354973' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T00:29:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:31.786664+0000 mgr.smithi049.rjblpr (mgr.14194) 155 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:33.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:31.786664+0000 mgr.smithi049.rjblpr (mgr.14194) 155 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.640+0000 7f0862546700 1 -- 172.21.15.161:0/1284707132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f7a10 msgr2=0x7f085c0f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.640+0000 7f0862546700 1 --2- 172.21.15.161:0/1284707132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f7a10 0x7f085c0f7e30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f08440047f0 tx=0x7f0844009cb0).stop 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.640+0000 7f0862546700 1 -- 172.21.15.161:0/1284707132 shutdown_connections 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.640+0000 7f0862546700 1 --2- 172.21.15.161:0/1284707132 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f085c0f8cb0 0x7f085c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.640+0000 7f0862546700 1 --2- 172.21.15.161:0/1284707132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f7a10 0x7f085c0f7e30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.640+0000 7f0862546700 1 -- 172.21.15.161:0/1284707132 >> 172.21.15.161:0/1284707132 conn(0x7f085c0f3150 msgr2=0x7f085c0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.640+0000 7f0862546700 1 -- 172.21.15.161:0/1284707132 shutdown_connections 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.640+0000 7f0862546700 1 -- 172.21.15.161:0/1284707132 wait complete. 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f0862546700 1 Processor -- start 2024-02-22T00:29:33.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f0862546700 1 -- start start 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f0862546700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f085c0f7a10 0x7f085c1081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f0862546700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f8cb0 0x7f085c1086b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f0862546700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c108c60 con 0x7f085c0f7a10 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f0862546700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085c108da0 con 0x7f085c0f8cb0 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f085b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f8cb0 0x7f085c1086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f085b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f8cb0 0x7f085c1086b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35110/0 (socket says 172.21.15.161:35110) 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f085b7fe700 1 -- 172.21.15.161:0/1814760834 learned_addr learned my addr 172.21.15.161:0/1814760834 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f085bfff700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f085c0f7a10 0x7f085c1081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f085b7fe700 1 -- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f085c0f7a10 msgr2=0x7f085c1081c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f085b7fe700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f085c0f7a10 0x7f085c1081c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f085b7fe700 1 -- 172.21.15.161:0/1814760834 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844005040 con 0x7f085c0f8cb0 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f085b7fe700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f8cb0 0x7f085c1086b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f084c00c790 tx=0x7f084c00cb50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:33.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.641+0000 7f08597fa700 1 -- 172.21.15.161:0/1814760834 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f084c0106f0 con 0x7f085c0f8cb0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.642+0000 7f08597fa700 1 -- 172.21.15.161:0/1814760834 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f084c010ce0 con 0x7f085c0f8cb0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.642+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c10d840 con 0x7f085c0f8cb0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.642+0000 7f08597fa700 1 -- 172.21.15.161:0/1814760834 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f084c012de0 con 0x7f085c0f8cb0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.642+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085c10dd80 con 0x7f085c0f8cb0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.642+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085c05fb50 con 0x7f085c0f8cb0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.643+0000 7f08597fa700 1 -- 172.21.15.161:0/1814760834 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f084c010850 con 0x7f085c0f8cb0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.643+0000 7f08597fa700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0848061180 0x7f0848063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.643+0000 7f08597fa700 1 -- 172.21.15.161:0/1814760834 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f084c07bea0 con 0x7f085c0f8cb0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.643+0000 7f085bfff700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0848061180 0x7f0848063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.644+0000 7f085bfff700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0848061180 0x7f0848063640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0844013470 tx=0x7f084400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:33.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.647+0000 7f08597fa700 1 -- 172.21.15.161:0/1814760834 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f084c048f60 con 0x7f085c0f8cb0 2024-02-22T00:29:33.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.870+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f085c1001f0 con 0x7f085c0f8cb0 2024-02-22T00:29:33.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.875+0000 7f08597fa700 1 -- 172.21.15.161:0/1814760834 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f084c050170 con 0x7f085c0f8cb0 2024-02-22T00:29:33.878 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2024-02-22T00:29:33.878 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQBtldZl927+MxAAzoD11BDFo+vMXgfEQgkfzQ== 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0848061180 msgr2=0x7f0848063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0848061180 0x7f0848063640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f0844013470 tx=0x7f084400b040).stop 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f8cb0 msgr2=0x7f085c1086b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f8cb0 0x7f085c1086b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f084c00c790 tx=0x7f084c00cb50).stop 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 shutdown_connections 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f085c0f7a10 0x7f085c1081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0848061180 0x7f0848063640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 --2- 172.21.15.161:0/1814760834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f085c0f8cb0 0x7f085c1086b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 >> 172.21.15.161:0/1814760834 conn(0x7f085c0f3150 msgr2=0x7f085c0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:33.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 shutdown_connections 2024-02-22T00:29:33.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-02-22T00:29:33.877+0000 7f0862546700 1 -- 172.21.15.161:0/1814760834 wait complete. 2024-02-22T00:29:34.216 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:33.871525+0000 mon.smithi161 (mon.1) 16 : audit [INF] from='client.? 172.21.15.161:0/1814760834' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T00:29:34.216 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:33.872078+0000 mon.smithi049 (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T00:29:34.216 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:33.875736+0000 mon.smithi049 (mon.0) 497 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T00:29:34.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:33.871525+0000 mon.smithi161 (mon.1) 16 : audit [INF] from='client.? 172.21.15.161:0/1814760834' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T00:29:34.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:33.872078+0000 mon.smithi049 (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T00:29:34.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:33.875736+0000 mon.smithi049 (mon.0) 497 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T00:29:34.483 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:29:34.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-22T00:29:34.483 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-22T00:29:34.522 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-22T00:29:34.522 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-22T00:29:34.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph mgr dump --format=json 2024-02-22T00:29:34.813 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:35.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:35 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:33.787211+0000 mgr.smithi049.rjblpr (mgr.14194) 156 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:35.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:33.787211+0000 mgr.smithi049.rjblpr (mgr.14194) 156 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:36.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 -- 172.21.15.49:0/3040770878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f8c40 msgr2=0x7f01f00f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:36.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 --2- 172.21.15.49:0/3040770878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f8c40 0x7f01f00f90a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f01e00047f0 tx=0x7f01e0009cb0).stop 2024-02-22T00:29:36.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 -- 172.21.15.49:0/3040770878 shutdown_connections 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 --2- 172.21.15.49:0/3040770878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f8c40 0x7f01f00f90a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 --2- 172.21.15.49:0/3040770878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f00f79a0 0x7f01f00f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 -- 172.21.15.49:0/3040770878 >> 172.21.15.49:0/3040770878 conn(0x7f01f00f3100 msgr2=0x7f01f00f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 -- 172.21.15.49:0/3040770878 shutdown_connections 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 -- 172.21.15.49:0/3040770878 wait complete. 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 Processor -- start 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.468+0000 7f01f83b0700 1 -- start start 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f83b0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f79a0 0x7f01f0108130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:36.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f83b0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f00f8c40 0x7f01f0108620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f83b0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0108c60 con 0x7f01f00f79a0 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f83b0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0108da0 con 0x7f01f00f8c40 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f614c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f79a0 0x7f01f0108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f614c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f79a0 0x7f01f0108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33694/0 (socket says 172.21.15.49:33694) 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f614c700 1 -- 172.21.15.49:0/1558317445 learned_addr learned my addr 172.21.15.49:0/1558317445 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f594b700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f00f8c40 0x7f01f0108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f614c700 1 -- 172.21.15.49:0/1558317445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f00f8c40 msgr2=0x7f01f0108620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f614c700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f00f8c40 0x7f01f0108620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f614c700 1 -- 172.21.15.49:0/1558317445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e0005040 con 0x7f01f00f79a0 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f614c700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f79a0 0x7f01f0108130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f01ec00b480 tx=0x7f01ec0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:36.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01e77fe700 1 -- 172.21.15.49:0/1558317445 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01ec002500 con 0x7f01f00f79a0 2024-02-22T00:29:36.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f010d840 con 0x7f01f00f79a0 2024-02-22T00:29:36.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01e77fe700 1 -- 172.21.15.49:0/1558317445 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f01ec00be80 con 0x7f01f00f79a0 2024-02-22T00:29:36.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01e77fe700 1 -- 172.21.15.49:0/1558317445 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01ec012b80 con 0x7f01f00f79a0 2024-02-22T00:29:36.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.469+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f010dd80 con 0x7f01f00f79a0 2024-02-22T00:29:36.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.470+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f0100190 con 0x7f01f00f79a0 2024-02-22T00:29:36.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.471+0000 7f01e77fe700 1 -- 172.21.15.49:0/1558317445 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f01ec002660 con 0x7f01f00f79a0 2024-02-22T00:29:36.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.471+0000 7f01e77fe700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f01dc061180 0x7f01dc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:36.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.471+0000 7f01e77fe700 1 -- 172.21.15.49:0/1558317445 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f01ec07c540 con 0x7f01f00f79a0 2024-02-22T00:29:36.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.471+0000 7f01f594b700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f01dc061180 0x7f01dc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:36.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.472+0000 7f01f594b700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f01dc061180 0x7f01dc063640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f01e00047c0 tx=0x7f01e000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:36.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.475+0000 7f01e77fe700 1 -- 172.21.15.49:0/1558317445 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f01ec0507b0 con 0x7f01f00f79a0 2024-02-22T00:29:36.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.695+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f01f0059990 con 0x7f01f00f79a0 2024-02-22T00:29:36.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.698+0000 7f01e77fe700 1 -- 172.21.15.49:0/1558317445 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+152026 (secure 0 0 0) 0x7f01ec0503a0 con 0x7f01f00f79a0 2024-02-22T00:29:36.704 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.700+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f01dc061180 msgr2=0x7f01dc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.700+0000 7f01f83b0700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f01dc061180 0x7f01dc063640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f01e00047c0 tx=0x7f01e000b040).stop 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f79a0 msgr2=0x7f01f0108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f79a0 0x7f01f0108130 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f01ec00b480 tx=0x7f01ec0090f0).stop 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 shutdown_connections 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f01f00f79a0 0x7f01f0108130 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f01dc061180 0x7f01dc063640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 --2- 172.21.15.49:0/1558317445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01f00f8c40 0x7f01f0108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 >> 172.21.15.49:0/1558317445 conn(0x7f01f00f3100 msgr2=0x7f01f00fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:36.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 shutdown_connections 2024-02-22T00:29:36.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:36.701+0000 7f01f83b0700 1 -- 172.21.15.49:0/1558317445 wait complete. 2024-02-22T00:29:37.271 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"active_gid":14194,"active_name":"smithi049.rjblpr","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":3085400794},{"type":"v1","addr":"172.21.15.49:6801","nonce":3085400794}]},"active_addr":"172.21.15.49:6801/3085400794","active_change":"2024-02-22T00:26:01.748152+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":14210,"name":"smithi161.sazlam","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.49:8443/","prometheus":"http://172.21.15.49:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3432989727}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1848258748}]}]} 2024-02-22T00:29:37.276 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-22T00:29:37.277 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-22T00:29:37.277 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd dump --format=json 2024-02-22T00:29:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:35.787501+0000 mgr.smithi049.rjblpr (mgr.14194) 157 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:36.697168+0000 mon.smithi049 (mon.0) 498 : audit [DBG] from='client.? 172.21.15.49:0/1558317445' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T00:29:37.308 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:35.787501+0000 mgr.smithi049.rjblpr (mgr.14194) 157 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:37.308 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:36.697168+0000 mon.smithi049 (mon.0) 498 : audit [DBG] from='client.? 172.21.15.49:0/1558317445' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T00:29:37.553 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.150+0000 7f3841ccf700 1 -- 172.21.15.49:0/668221691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 msgr2=0x7f383c0fa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.150+0000 7f3841ccf700 1 --2- 172.21.15.49:0/668221691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 0x7f383c0fa5e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f382c0047f0 tx=0x7f382c009cb0).stop 2024-02-22T00:29:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.150+0000 7f3841ccf700 1 -- 172.21.15.49:0/668221691 shutdown_connections 2024-02-22T00:29:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.150+0000 7f3841ccf700 1 --2- 172.21.15.49:0/668221691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383c0fab60 0x7f383c0fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:29:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.150+0000 7f3841ccf700 1 --2- 172.21.15.49:0/668221691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 0x7f383c0fa5e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:39.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.150+0000 7f3841ccf700 1 -- 172.21.15.49:0/668221691 >> 172.21.15.49:0/668221691 conn(0x7f383c0f2020 msgr2=0x7f383c0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.150+0000 7f3841ccf700 1 -- 172.21.15.49:0/668221691 shutdown_connections 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.150+0000 7f3841ccf700 1 -- 172.21.15.49:0/668221691 wait complete. 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f3841ccf700 1 Processor -- start 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f3841ccf700 1 -- start start 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f3841ccf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 0x7f383c108100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f3841ccf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383c0fab60 0x7f383c1085f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f3841ccf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c108c30 con 0x7f383c061780 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f3841ccf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c108d70 con 0x7f383c0fab60 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f383b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 0x7f383c108100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f383b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 0x7f383c108100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33716/0 (socket says 172.21.15.49:33716) 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.151+0000 7f383b7fe700 1 -- 172.21.15.49:0/746762379 learned_addr learned my addr 172.21.15.49:0/746762379 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:39.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f383affd700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383c0fab60 0x7f383c1085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f383b7fe700 1 -- 172.21.15.49:0/746762379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383c0fab60 msgr2=0x7f383c1085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f383b7fe700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383c0fab60 0x7f383c1085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f383b7fe700 1 -- 172.21.15.49:0/746762379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c005040 con 0x7f383c061780 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f383affd700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383c0fab60 0x7f383c1085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f383b7fe700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 0x7f383c108100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f382c013510 tx=0x7f382c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f3838ff9700 1 -- 172.21.15.49:0/746762379 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382c00e030 con 0x7f383c061780 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c10d7b0 con 0x7f383c061780 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f3838ff9700 1 -- 172.21.15.49:0/746762379 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f382c007e90 con 0x7f383c061780 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f3838ff9700 1 -- 172.21.15.49:0/746762379 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382c018070 con 0x7f383c061780 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.152+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c10dc90 con 0x7f383c061780 2024-02-22T00:29:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.153+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c100190 con 0x7f383c061780 2024-02-22T00:29:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.153+0000 7f3838ff9700 1 -- 172.21.15.49:0/746762379 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f382c01da20 con 0x7f383c061780 2024-02-22T00:29:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.154+0000 7f3838ff9700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3824061160 0x7f3824063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.154+0000 7f3838ff9700 1 -- 172.21.15.49:0/746762379 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f382c07db50 con 0x7f383c061780 2024-02-22T00:29:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.154+0000 7f383affd700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3824061160 0x7f3824063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.154+0000 7f383affd700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3824061160 0x7f3824063620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f383c061550 tx=0x7f3830008040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.158+0000 7f3838ff9700 1 -- 172.21.15.49:0/746762379 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f382c051e20 con 0x7f383c061780 2024-02-22T00:29:39.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:37.787970+0000 mgr.smithi049.rjblpr (mgr.14194) 158 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:39.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:37.787970+0000 mgr.smithi049.rjblpr (mgr.14194) 158 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.329+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f383c0598f0 con 0x7f383c061780 2024-02-22T00:29:39.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.330+0000 7f3838ff9700 1 -- 172.21.15.49:0/746762379 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10913 (secure 0 0 0) 0x7f382c009870 con 0x7f383c061780 2024-02-22T00:29:39.333 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:29:39.333 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","created":"2024-02-22T00:24:07.498307+0000","modified":"2024-02-22T00:29:19.705944+0000","last_up_change":"2024-02-22T00:29:18.697160+0000","last_in_change":"2024-02-22T00:29:00.339229+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T00:28:03.647916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"14701491-880b-4aa8-b29c-2f93fad67550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6803","nonce":683996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6805","nonce":683996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6809","nonce":683996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6807","nonce":683996799}]},"public_addr":"172.21.15.49:6803/683996799","cluster_addr":"172.21.15.49:6805/683996799","heartbeat_back_addr":"172.21.15.49:6809/683996799","heartbeat_front_addr":"172.21.15.49:6807/683996799","state":["exists","up"]},{"osd":1,"uuid":"6a984f0c-ab4d-4881-baf7-7821af596292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6811","nonce":3836451812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6813","nonce":3836451812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6817","nonce":3836451812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6815","nonce":3836451812}]},"public_addr":"172.21.15.49:6811/3836451812","cluster_addr":"172.21.15.49:6813/3836451812","heartbeat_back_addr":"172.21.15.49:6817/3836451812","heartbeat_front_addr":"172.21.15.49:6815/3836451812","state":["exists","up"]},{"osd":2,"uuid":"fdbc04fa-88df-4bd8-9272-38e17a0ddc99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6819","nonce":153604959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6821","nonce":153604959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6825","nonce":153604959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6823","nonce":153604959}]},"public_addr":"172.21.15.49:6819/153604959","cluster_addr":"172.21.15.49:6821/153604959","heartbeat_back_addr":"172.21.15.49:6825/153604959","heartbeat_front_addr":"172.21.15.49:6823/153604959","state":["exists","up"]},{"osd":3,"uuid":"b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6801","nonce":1725433098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6803","nonce":1725433098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6807","nonce":1725433098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6805","nonce":1725433098}]},"public_addr":"172.21.15.161:6801/1725433098","cluster_addr":"172.21.15.161:6803/1725433098","heartbeat_back_addr":"172.21.15.161:6807/1725433098","heartbeat_front_addr":"172.21.15.161:6805/1725433098","state":["exists","up"]},{"osd":4,"uuid":"a017d7c9-0283-4fe1-8839-1ccbdbd95972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6809","nonce":1996423243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6811","nonce":1996423243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6815","nonce":1996423243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6813","nonce":1996423243}]},"public_addr":"172.21.15.161:6809/1996423243","cluster_addr":"172.21.15.161:6811/1996423243","heartbeat_back_addr":"172.21.15.161:6815/1996423243","heartbeat_front_addr":"172.21.15.161:6813/1996423243","state":["exists","up"]},{"osd":5,"uuid":"3f97d2c3-52e0-490a-a7ec-d989884f03a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6817","nonce":1791237181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6819","nonce":1791237181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6823","nonce":1791237181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6821","nonce":1791237181}]},"public_addr":"172.21.15.161:6817/1791237181","cluster_addr":"172.21.15.161:6819/1791237181","heartbeat_back_addr":"172.21.15.161:6823/1791237181","heartbeat_front_addr":"172.21.15.161:6821/1791237181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:26:57.942621+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:27:33.707227+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:01.399431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:25.246971+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:51.257793+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:29:17.568705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6801/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/1752326277":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/755765908":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/2319195782":"2024-02-23T00:25:10.135002+0000","172.21.15.49:6801/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:6800/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/4194533393":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6801/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/1567499828":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/3181714365":"2024-02-23T00:24:40.044887+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-22T00:29:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3824061160 msgr2=0x7f3824063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3824061160 0x7f3824063620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f383c061550 tx=0x7f3830008040).stop 2024-02-22T00:29:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 msgr2=0x7f383c108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 0x7f383c108100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f382c013510 tx=0x7f382c009cb0).stop 2024-02-22T00:29:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 shutdown_connections 2024-02-22T00:29:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f383c061780 0x7f383c108100 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:39.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3824061160 0x7f3824063620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:39.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 --2- 172.21.15.49:0/746762379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383c0fab60 0x7f383c1085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:39.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 >> 172.21.15.49:0/746762379 conn(0x7f383c0f2020 msgr2=0x7f383c0f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:39.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 shutdown_connections 2024-02-22T00:29:39.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:39.332+0000 7f3841ccf700 1 -- 172.21.15.49:0/746762379 wait complete. 2024-02-22T00:29:40.070 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-22T00:29:40.071 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd dump --format=json 2024-02-22T00:29:40.391 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:40.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:39.330225+0000 mon.smithi049 (mon.0) 499 : audit [DBG] from='client.? 172.21.15.49:0/746762379' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T00:29:40.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:39.330225+0000 mon.smithi049 (mon.0) 499 : audit [DBG] from='client.? 172.21.15.49:0/746762379' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T00:29:41.355 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:39.788283+0000 mgr.smithi049.rjblpr (mgr.14194) 159 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:39.788283+0000 mgr.smithi049.rjblpr (mgr.14194) 159 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:42.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.355+0000 7fcd30723700 1 -- 172.21.15.49:0/3379331428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 msgr2=0x7fcd280f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.355+0000 7fcd30723700 1 --2- 172.21.15.49:0/3379331428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 0x7fcd280f7fa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fcd180047f0 tx=0x7fcd18009cb0).stop 2024-02-22T00:29:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.355+0000 7fcd30723700 1 -- 172.21.15.49:0/3379331428 shutdown_connections 2024-02-22T00:29:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.355+0000 7fcd30723700 1 --2- 172.21.15.49:0/3379331428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 0x7fcd280f7fa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.355+0000 7fcd30723700 1 --2- 172.21.15.49:0/3379331428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd280f68a0 0x7fcd280f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:29:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.355+0000 7fcd30723700 1 -- 172.21.15.49:0/3379331428 >> 172.21.15.49:0/3379331428 conn(0x7fcd280f2020 msgr2=0x7fcd280f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.355+0000 7fcd30723700 1 -- 172.21.15.49:0/3379331428 shutdown_connections 2024-02-22T00:29:42.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.355+0000 7fcd30723700 1 -- 172.21.15.49:0/3379331428 wait complete. 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd30723700 1 Processor -- start 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd30723700 1 -- start start 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd30723700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd280f68a0 0x7fcd280fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd30723700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 0x7fcd280f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd30723700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280f9370 con 0x7fcd280f7b40 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd30723700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280f94b0 con 0x7fcd280f68a0 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd2dcbe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 0x7fcd280f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd2dcbe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 0x7fcd280f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44362/0 (socket says 172.21.15.49:44362) 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.356+0000 7fcd2dcbe700 1 -- 172.21.15.49:0/2032660031 learned_addr learned my addr 172.21.15.49:0/2032660031 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:42.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd2dcbe700 1 -- 172.21.15.49:0/2032660031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd280f68a0 msgr2=0x7fcd280fa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd2e4bf700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd280f68a0 0x7fcd280fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd2dcbe700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd280f68a0 0x7fcd280fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd2dcbe700 1 -- 172.21.15.49:0/2032660031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18005040 con 0x7fcd280f7b40 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd2dcbe700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 0x7fcd280f8e80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fcd18013510 tx=0x7fcd18009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd1f7fe700 1 -- 172.21.15.49:0/2032660031 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd1800e030 con 0x7fcd280f7b40 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd1f7fe700 1 -- 172.21.15.49:0/2032660031 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcd18007e90 con 0x7fcd280f7b40 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd280f9730 con 0x7fcd280f7b40 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd1f7fe700 1 -- 172.21.15.49:0/2032660031 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd18018070 con 0x7fcd280f7b40 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.357+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd280f9c10 con 0x7fcd280f7b40 2024-02-22T00:29:42.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.358+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd28047540 con 0x7fcd280f7b40 2024-02-22T00:29:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.358+0000 7fcd1f7fe700 1 -- 172.21.15.49:0/2032660031 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fcd1801da20 con 0x7fcd280f7b40 2024-02-22T00:29:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.359+0000 7fcd1f7fe700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcd14061180 0x7fcd14063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.359+0000 7fcd2e4bf700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcd14061180 0x7fcd14063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.359+0000 7fcd1f7fe700 1 -- 172.21.15.49:0/2032660031 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fcd1807da00 con 0x7fcd280f7b40 2024-02-22T00:29:42.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.359+0000 7fcd2e4bf700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcd14061180 0x7fcd14063640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fcd280f79a0 tx=0x7fcd24008040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:42.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.363+0000 7fcd1f7fe700 1 -- 172.21.15.49:0/2032660031 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcd18051d50 con 0x7fcd280f7b40 2024-02-22T00:29:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.533+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd281108f0 con 0x7fcd280f7b40 2024-02-22T00:29:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.534+0000 7fcd1f7fe700 1 -- 172.21.15.49:0/2032660031 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10913 (secure 0 0 0) 0x7fcd18009870 con 0x7fcd280f7b40 2024-02-22T00:29:42.538 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:29:42.538 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":38,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","created":"2024-02-22T00:24:07.498307+0000","modified":"2024-02-22T00:29:19.705944+0000","last_up_change":"2024-02-22T00:29:18.697160+0000","last_in_change":"2024-02-22T00:29:00.339229+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T00:28:03.647916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"14701491-880b-4aa8-b29c-2f93fad67550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6803","nonce":683996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6805","nonce":683996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6809","nonce":683996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6807","nonce":683996799}]},"public_addr":"172.21.15.49:6803/683996799","cluster_addr":"172.21.15.49:6805/683996799","heartbeat_back_addr":"172.21.15.49:6809/683996799","heartbeat_front_addr":"172.21.15.49:6807/683996799","state":["exists","up"]},{"osd":1,"uuid":"6a984f0c-ab4d-4881-baf7-7821af596292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6811","nonce":3836451812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6813","nonce":3836451812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6817","nonce":3836451812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6815","nonce":3836451812}]},"public_addr":"172.21.15.49:6811/3836451812","cluster_addr":"172.21.15.49:6813/3836451812","heartbeat_back_addr":"172.21.15.49:6817/3836451812","heartbeat_front_addr":"172.21.15.49:6815/3836451812","state":["exists","up"]},{"osd":2,"uuid":"fdbc04fa-88df-4bd8-9272-38e17a0ddc99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6819","nonce":153604959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6821","nonce":153604959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6825","nonce":153604959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6823","nonce":153604959}]},"public_addr":"172.21.15.49:6819/153604959","cluster_addr":"172.21.15.49:6821/153604959","heartbeat_back_addr":"172.21.15.49:6825/153604959","heartbeat_front_addr":"172.21.15.49:6823/153604959","state":["exists","up"]},{"osd":3,"uuid":"b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6801","nonce":1725433098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6803","nonce":1725433098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6807","nonce":1725433098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6805","nonce":1725433098}]},"public_addr":"172.21.15.161:6801/1725433098","cluster_addr":"172.21.15.161:6803/1725433098","heartbeat_back_addr":"172.21.15.161:6807/1725433098","heartbeat_front_addr":"172.21.15.161:6805/1725433098","state":["exists","up"]},{"osd":4,"uuid":"a017d7c9-0283-4fe1-8839-1ccbdbd95972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6809","nonce":1996423243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6811","nonce":1996423243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6815","nonce":1996423243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6813","nonce":1996423243}]},"public_addr":"172.21.15.161:6809/1996423243","cluster_addr":"172.21.15.161:6811/1996423243","heartbeat_back_addr":"172.21.15.161:6815/1996423243","heartbeat_front_addr":"172.21.15.161:6813/1996423243","state":["exists","up"]},{"osd":5,"uuid":"3f97d2c3-52e0-490a-a7ec-d989884f03a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6817","nonce":1791237181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6819","nonce":1791237181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6823","nonce":1791237181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6821","nonce":1791237181}]},"public_addr":"172.21.15.161:6817/1791237181","cluster_addr":"172.21.15.161:6819/1791237181","heartbeat_back_addr":"172.21.15.161:6823/1791237181","heartbeat_front_addr":"172.21.15.161:6821/1791237181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:26:57.942621+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:27:33.707227+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:01.399431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:25.246971+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:51.257793+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:29:17.568705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6801/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/1752326277":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/755765908":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/2319195782":"2024-02-23T00:25:10.135002+0000","172.21.15.49:6801/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:6800/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/4194533393":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6801/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/1567499828":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/3181714365":"2024-02-23T00:24:40.044887+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-22T00:29:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcd14061180 msgr2=0x7fcd14063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcd14061180 0x7fcd14063640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fcd280f79a0 tx=0x7fcd24008040).stop 2024-02-22T00:29:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 msgr2=0x7fcd280f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 0x7fcd280f8e80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fcd18013510 tx=0x7fcd18009cb0).stop 2024-02-22T00:29:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 shutdown_connections 2024-02-22T00:29:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcd14061180 0x7fcd14063640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd280f68a0 0x7fcd280fa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 --2- 172.21.15.49:0/2032660031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcd280f7b40 0x7fcd280f8e80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 >> 172.21.15.49:0/2032660031 conn(0x7fcd280f2020 msgr2=0x7fcd28061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 shutdown_connections 2024-02-22T00:29:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:42.536+0000 7fcd30723700 1 -- 172.21.15.49:0/2032660031 wait complete. 2024-02-22T00:29:43.101 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:41.788674+0000 mgr.smithi049.rjblpr (mgr.14194) 160 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:43.102 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:42.535062+0000 mon.smithi049 (mon.0) 500 : audit [DBG] from='client.? 172.21.15.49:0/2032660031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T00:29:43.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-22T00:29:43.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-22T00:29:43.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-22T00:29:43.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-22T00:29:43.123 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-22T00:29:43.124 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-22T00:29:43.476 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:43.487 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:41.788674+0000 mgr.smithi049.rjblpr (mgr.14194) 160 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:42.535062+0000 mon.smithi049 (mon.0) 500 : audit [DBG] from='client.? 172.21.15.49:0/2032660031' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T00:29:45.329 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:45.352 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:45.357 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:45.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:43.789059+0000 mgr.smithi049.rjblpr (mgr.14194) 161 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:45.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:43.789059+0000 mgr.smithi049.rjblpr (mgr.14194) 161 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:47.389 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:45.789357+0000 mgr.smithi049.rjblpr (mgr.14194) 162 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:47.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:45.789357+0000 mgr.smithi049.rjblpr (mgr.14194) 162 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:48.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.370+0000 7ff76992f700 1 -- 172.21.15.49:0/1969674704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 msgr2=0x7ff7640f8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:48.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.370+0000 7ff76992f700 1 --2- 172.21.15.49:0/1969674704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 0x7ff7640f8d70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff74c0047f0 tx=0x7ff74c009cb0).stop 2024-02-22T00:29:48.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.370+0000 7ff76992f700 1 -- 172.21.15.49:0/1969674704 shutdown_connections 2024-02-22T00:29:48.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.370+0000 7ff76992f700 1 --2- 172.21.15.49:0/1969674704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 0x7ff7640f8d70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:48.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.370+0000 7ff76992f700 1 --2- 172.21.15.49:0/1969674704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7640f5c50 0x7ff7640f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:48.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.370+0000 7ff76992f700 1 -- 172.21.15.49:0/1969674704 >> 172.21.15.49:0/1969674704 conn(0x7ff7640f1770 msgr2=0x7ff7640f3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:48.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.370+0000 7ff76992f700 1 -- 172.21.15.49:0/1969674704 shutdown_connections 2024-02-22T00:29:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.370+0000 7ff76992f700 1 -- 172.21.15.49:0/1969674704 wait complete. 2024-02-22T00:29:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.371+0000 7ff76992f700 1 Processor -- start 2024-02-22T00:29:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.371+0000 7ff76992f700 1 -- start start 2024-02-22T00:29:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.371+0000 7ff76992f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7640f5c50 0x7ff7641080c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:48.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.371+0000 7ff76992f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 0x7ff7641085b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff76992f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764108b60 con 0x7ff7640f65f0 2024-02-22T00:29:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff76992f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff764108ca0 con 0x7ff7640f5c50 2024-02-22T00:29:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff7627fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 0x7ff7641085b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff7627fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 0x7ff7641085b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44374/0 (socket says 172.21.15.49:44374) 2024-02-22T00:29:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff7627fc700 1 -- 172.21.15.49:0/1625327706 learned_addr learned my addr 172.21.15.49:0/1625327706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:48.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff762ffd700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7640f5c50 0x7ff7641080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:48.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff7627fc700 1 -- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7640f5c50 msgr2=0x7ff7641080c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:48.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff7627fc700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7640f5c50 0x7ff7641080c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:48.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff7627fc700 1 -- 172.21.15.49:0/1625327706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74c005040 con 0x7ff7640f65f0 2024-02-22T00:29:48.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff762ffd700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7640f5c50 0x7ff7641080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:29:48.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff7627fc700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 0x7ff7641085b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff74c013470 tx=0x7ff74c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:48.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c00e030 con 0x7ff7640f65f0 2024-02-22T00:29:48.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff74c007e90 con 0x7ff7640f65f0 2024-02-22T00:29:48.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76410d6e0 con 0x7ff7640f65f0 2024-02-22T00:29:48.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c018070 con 0x7ff7640f65f0 2024-02-22T00:29:48.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.372+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76410dc20 con 0x7ff7640f65f0 2024-02-22T00:29:48.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.373+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff76405f5f0 con 0x7ff7640f65f0 2024-02-22T00:29:48.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.373+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ff74c01d940 con 0x7ff7640f65f0 2024-02-22T00:29:48.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.374+0000 7ff75bfff700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff750061180 0x7ff750063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:48.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.374+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7ff74c07dbc0 con 0x7ff7640f65f0 2024-02-22T00:29:48.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.374+0000 7ff762ffd700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff750061180 0x7ff750063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:48.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.374+0000 7ff75bfff700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] conn(0x7ff750066d50 0x7ff750069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:48.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.374+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 --> [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff750069810 con 0x7ff750066d50 2024-02-22T00:29:48.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.374+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff74c083220 con 0x7ff7640f65f0 2024-02-22T00:29:48.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.374+0000 7ff762ffd700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff750061180 0x7ff750063640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff764060850 tx=0x7ff754009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:48.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.374+0000 7ff7637fe700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] conn(0x7ff750066d50 0x7ff750069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:48.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.375+0000 7ff7637fe700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] conn(0x7ff750066d50 0x7ff750069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:48.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.376+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 <== osd.4 v2:172.21.15.161:6808/1996423243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7ff750069810 con 0x7ff750066d50 2024-02-22T00:29:48.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.390+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 --> [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff764059360 con 0x7ff750066d50 2024-02-22T00:29:48.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.390+0000 7ff75bfff700 1 -- 172.21.15.49:0/1625327706 <== osd.4 v2:172.21.15.161:6808/1996423243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff764059360 con 0x7ff750066d50 2024-02-22T00:29:48.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] conn(0x7ff750066d50 msgr2=0x7ff750069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:48.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] conn(0x7ff750066d50 0x7ff750069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:48.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff750061180 msgr2=0x7ff750063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:48.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff750061180 0x7ff750063640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff764060850 tx=0x7ff754009040).stop 2024-02-22T00:29:48.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 msgr2=0x7ff7641085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:48.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 0x7ff7641085b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff74c013470 tx=0x7ff74c009cb0).stop 2024-02-22T00:29:48.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 shutdown_connections 2024-02-22T00:29:48.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff750061180 0x7ff750063640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:48.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7640f5c50 0x7ff7641080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:48.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.161:6808/1996423243,v1:172.21.15.161:6809/1996423243] conn(0x7ff750066d50 0x7ff750069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:48.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 --2- 172.21.15.49:0/1625327706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7640f65f0 0x7ff7641085b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:48.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 >> 172.21.15.49:0/1625327706 conn(0x7ff7640f1770 msgr2=0x7ff7640fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:48.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 shutdown_connections 2024-02-22T00:29:48.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:48.391+0000 7ff76992f700 1 -- 172.21.15.49:0/1625327706 wait complete. 2024-02-22T00:29:49.255 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:47.789694+0000 mgr.smithi049.rjblpr (mgr.14194) 163 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:49.282 INFO:teuthology.orchestra.run.smithi049.stdout:137438953486 2024-02-22T00:29:49.282 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-22T00:29:49.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:47.789694+0000 mgr.smithi049.rjblpr (mgr.14194) 163 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.723+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/1338774694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 msgr2=0x7f3ef00f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:50.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.723+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/1338774694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 0x7f3ef00f7dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3ee00047f0 tx=0x7f3ee0009cb0).stop 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.723+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/1338774694 shutdown_connections 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.723+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/1338774694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ef00f8c40 0x7f3ef00f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.723+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/1338774694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 0x7f3ef00f7dc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.723+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/1338774694 >> 172.21.15.49:0/1338774694 conn(0x7f3ef00f3100 msgr2=0x7f3ef00f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.723+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/1338774694 shutdown_connections 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.724+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/1338774694 wait complete. 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.724+0000 7f3ef5ea8700 1 Processor -- start 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.724+0000 7f3ef5ea8700 1 -- start start 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3ef5ea8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 0x7f3ef01080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3ef5ea8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ef00f8c40 0x7f3ef0108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3ef5ea8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef0108b40 con 0x7f3ef00f79a0 2024-02-22T00:29:50.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3ef5ea8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef0108c80 con 0x7f3ef00f8c40 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 0x7f3ef01080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 0x7f3ef01080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44384/0 (socket says 172.21.15.49:44384) 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eef7fe700 1 -- 172.21.15.49:0/92553930 learned_addr learned my addr 172.21.15.49:0/92553930 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eeeffd700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ef00f8c40 0x7f3ef0108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eef7fe700 1 -- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ef00f8c40 msgr2=0x7f3ef0108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eef7fe700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ef00f8c40 0x7f3ef0108590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eef7fe700 1 -- 172.21.15.49:0/92553930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee0005040 con 0x7f3ef00f79a0 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eef7fe700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 0x7f3ef01080a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3ee0013470 tx=0x7f3ee0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee000e030 con 0x7f3ef00f79a0 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3ee0007e90 con 0x7f3ef00f79a0 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef010d6c0 con 0x7f3ef00f79a0 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee0018070 con 0x7f3ef00f79a0 2024-02-22T00:29:50.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.725+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef010dc00 con 0x7f3ef00f79a0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.726+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ef005f5f0 con 0x7f3ef00f79a0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f3ee001d420 con 0x7f3ef00f79a0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eecff9700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ed8061180 0x7f3ed8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f3ee007da90 con 0x7f3ef00f79a0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eeeffd700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ed8061180 0x7f3ed8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eecff9700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] conn(0x7f3ed8066d50 0x7f3ed8069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 --> [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ed8069810 con 0x7f3ed8066d50 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ee0082220 con 0x7f3ef00f79a0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eeeffd700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ed8061180 0x7f3ed8063640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3ee40041d0 tx=0x7f3ee4009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.727+0000 7f3eeffff700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] conn(0x7f3ed8066d50 0x7f3ed8069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.728+0000 7f3eeffff700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] conn(0x7f3ed8066d50 0x7f3ed8069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:50.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.728+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 <== osd.3 v2:172.21.15.161:6800/1725433098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f3ed8069810 con 0x7f3ed8066d50 2024-02-22T00:29:50.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.744+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 --> [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ef0059360 con 0x7f3ed8066d50 2024-02-22T00:29:50.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.744+0000 7f3eecff9700 1 -- 172.21.15.49:0/92553930 <== osd.3 v2:172.21.15.161:6800/1725433098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3ef0059360 con 0x7f3ed8066d50 2024-02-22T00:29:50.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] conn(0x7f3ed8066d50 msgr2=0x7f3ed8069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:50.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] conn(0x7f3ed8066d50 0x7f3ed8069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:50.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ed8061180 msgr2=0x7f3ed8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:50.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ed8061180 0x7f3ed8063640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3ee40041d0 tx=0x7f3ee4009040).stop 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 msgr2=0x7f3ef01080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 0x7f3ef01080a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f3ee0013470 tx=0x7f3ee0009cb0).stop 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 shutdown_connections 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:6800/1725433098,v1:172.21.15.161:6801/1725433098] conn(0x7f3ed8066d50 0x7f3ed8069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ef00f79a0 0x7f3ef01080a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ed8061180 0x7f3ed8063640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 --2- 172.21.15.49:0/92553930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ef00f8c40 0x7f3ef0108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 >> 172.21.15.49:0/92553930 conn(0x7f3ef00f3100 msgr2=0x7f3ef00fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 shutdown_connections 2024-02-22T00:29:50.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:50.745+0000 7f3ef5ea8700 1 -- 172.21.15.49:0/92553930 wait complete. 2024-02-22T00:29:51.369 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:49.790175+0000 mgr.smithi049.rjblpr (mgr.14194) 164 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.213+0000 7f1a7dd37700 1 -- 172.21.15.49:0/2273980783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f8c50 msgr2=0x7f1a780f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.213+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/2273980783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f8c50 0x7f1a780f90b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1a6c0047f0 tx=0x7f1a6c009cb0).stop 2024-02-22T00:29:51.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.213+0000 7f1a7dd37700 1 -- 172.21.15.49:0/2273980783 shutdown_connections 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.213+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/2273980783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f8c50 0x7f1a780f90b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.213+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/2273980783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780f79b0 0x7f1a780f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.213+0000 7f1a7dd37700 1 -- 172.21.15.49:0/2273980783 >> 172.21.15.49:0/2273980783 conn(0x7f1a780f30f0 msgr2=0x7f1a780f5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.213+0000 7f1a7dd37700 1 -- 172.21.15.49:0/2273980783 shutdown_connections 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.213+0000 7f1a7dd37700 1 -- 172.21.15.49:0/2273980783 wait complete. 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.214+0000 7f1a7dd37700 1 Processor -- start 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.214+0000 7f1a7dd37700 1 -- start start 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.214+0000 7f1a7dd37700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f79b0 0x7f1a78108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.214+0000 7f1a7dd37700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780f8c50 0x7f1a78108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.214+0000 7f1a7dd37700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78108ae0 con 0x7f1a780f79b0 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.214+0000 7f1a7dd37700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78108c20 con 0x7f1a780f8c50 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f79b0 0x7f1a78108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:51.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f79b0 0x7f1a78108040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44394/0 (socket says 172.21.15.49:44394) 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a777fe700 1 -- 172.21.15.49:0/1487815967 learned_addr learned my addr 172.21.15.49:0/1487815967 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a76ffd700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780f8c50 0x7f1a78108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a777fe700 1 -- 172.21.15.49:0/1487815967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780f8c50 msgr2=0x7f1a78108530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a777fe700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780f8c50 0x7f1a78108530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a777fe700 1 -- 172.21.15.49:0/1487815967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c005040 con 0x7f1a780f79b0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a777fe700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f79b0 0x7f1a78108040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f1a68002820 tx=0x7f1a68009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a68007b40 con 0x7f1a780f79b0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1a6800f040 con 0x7f1a780f79b0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7810d6c0 con 0x7f1a780f79b0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a680147c0 con 0x7f1a780f79b0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.215+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7810dc00 con 0x7f1a780f79b0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.216+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a7805f5f0 con 0x7f1a780f79b0 2024-02-22T00:29:51.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.217+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f1a68009110 con 0x7f1a780f79b0 2024-02-22T00:29:51.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.217+0000 7f1a74ff9700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f1a60061180 0x7f1a60063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:51.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.217+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f1a6807c4d0 con 0x7f1a780f79b0 2024-02-22T00:29:51.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.217+0000 7f1a76ffd700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f1a60061180 0x7f1a60063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:51.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.217+0000 7f1a74ff9700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] conn(0x7f1a60066d50 0x7f1a60069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:51.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.217+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 --> [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a60069810 con 0x7f1a60066d50 2024-02-22T00:29:51.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.217+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a6807c8d0 con 0x7f1a780f79b0 2024-02-22T00:29:51.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.217+0000 7f1a77fff700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] conn(0x7f1a60066d50 0x7f1a60069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:51.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.218+0000 7f1a76ffd700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f1a60061180 0x7f1a60063640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f1a6c0047c0 tx=0x7f1a6c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.218+0000 7f1a77fff700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] conn(0x7f1a60066d50 0x7f1a60069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.218+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 <== osd.1 v2:172.21.15.49:6810/3836451812 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f1a60069810 con 0x7f1a60066d50 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.234+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 --> [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a78059360 con 0x7f1a60066d50 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a74ff9700 1 -- 172.21.15.49:0/1487815967 <== osd.1 v2:172.21.15.49:6810/3836451812 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a78059360 con 0x7f1a60066d50 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] conn(0x7f1a60066d50 msgr2=0x7f1a60069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] conn(0x7f1a60066d50 0x7f1a60069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f1a60061180 msgr2=0x7f1a60063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f1a60061180 0x7f1a60063640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f1a6c0047c0 tx=0x7f1a6c00b040).stop 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f79b0 msgr2=0x7f1a78108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f79b0 0x7f1a78108040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f1a68002820 tx=0x7f1a68009f00).stop 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 shutdown_connections 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6810/3836451812,v1:172.21.15.49:6811/3836451812] conn(0x7f1a60066d50 0x7f1a60069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:51.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a780f79b0 0x7f1a78108040 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:51.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f1a60061180 0x7f1a60063640 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:51.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 --2- 172.21.15.49:0/1487815967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780f8c50 0x7f1a78108530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:51.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 >> 172.21.15.49:0/1487815967 conn(0x7f1a780f30f0 msgr2=0x7f1a780fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:51.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 shutdown_connections 2024-02-22T00:29:51.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.235+0000 7f1a7dd37700 1 -- 172.21.15.49:0/1487815967 wait complete. 2024-02-22T00:29:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:49.790175+0000 mgr.smithi049.rjblpr (mgr.14194) 164 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 -- 172.21.15.49:0/1219330227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f6660 msgr2=0x7fa3fc0f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1219330227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f6660 0x7fa3fc0f6a80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fa3ec0047f0 tx=0x7fa3ec009cb0).stop 2024-02-22T00:29:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 -- 172.21.15.49:0/1219330227 shutdown_connections 2024-02-22T00:29:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1219330227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3fc0f7900 0x7fa3fc0f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1219330227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f6660 0x7fa3fc0f6a80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 -- 172.21.15.49:0/1219330227 >> 172.21.15.49:0/1219330227 conn(0x7fa3fc0f1de0 msgr2=0x7fa3fc0f4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 -- 172.21.15.49:0/1219330227 shutdown_connections 2024-02-22T00:29:52.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 -- 172.21.15.49:0/1219330227 wait complete. 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.324+0000 7fa4013a0700 1 Processor -- start 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa4013a0700 1 -- start start 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa4013a0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3fc0f6660 0x7fa3fc10ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa4013a0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f7900 0x7fa3fc10d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa4013a0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc0618f0 con 0x7fa3fc0f7900 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa4013a0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3fc061a30 con 0x7fa3fc0f6660 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f7900 0x7fa3fc10d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f7900 0x7fa3fc10d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44410/0 (socket says 172.21.15.49:44410) 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fb7fe700 1 -- 172.21.15.49:0/1075558759 learned_addr learned my addr 172.21.15.49:0/1075558759 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fbfff700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3fc0f6660 0x7fa3fc10ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fb7fe700 1 -- 172.21.15.49:0/1075558759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3fc0f6660 msgr2=0x7fa3fc10ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fb7fe700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3fc0f6660 0x7fa3fc10ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:52.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fb7fe700 1 -- 172.21.15.49:0/1075558759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec005040 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fbfff700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3fc0f6660 0x7fa3fc10ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.325+0000 7fa3fb7fe700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f7900 0x7fa3fc10d180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa3f00041d0 tx=0x7fa3f0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.326+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f0007b40 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.326+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3fc10d790 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.326+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa3f000f040 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.326+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3f000d760 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.326+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc10dca0 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.326+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3fc05eff0 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.327+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fa3f0009110 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.327+0000 7fa3f97fa700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fa3e40611d0 0x7fa3e4063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.327+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fa3f007c030 con 0x7fa3fc0f7900 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.327+0000 7fa3fbfff700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fa3e40611d0 0x7fa3e4063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.328+0000 7fa3f97fa700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] conn(0x7fa3e4066da0 0x7fa3e40691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:52.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.328+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 --> [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3e4069860 con 0x7fa3e4066da0 2024-02-22T00:29:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.328+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3f007c430 con 0x7fa3fc0f7900 2024-02-22T00:29:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.328+0000 7fa400b9f700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] conn(0x7fa3e4066da0 0x7fa3e40691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.328+0000 7fa3fbfff700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fa3e40611d0 0x7fa3e4063690 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa3ec0043d0 tx=0x7fa3ec00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.328+0000 7fa400b9f700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] conn(0x7fa3e4066da0 0x7fa3e40691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.329+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 <== osd.2 v2:172.21.15.49:6818/153604959 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fa3e4069860 con 0x7fa3e4066da0 2024-02-22T00:29:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.343+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 --> [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3fc0593e0 con 0x7fa3e4066da0 2024-02-22T00:29:52.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.343+0000 7fa3f97fa700 1 -- 172.21.15.49:0/1075558759 <== osd.2 v2:172.21.15.49:6818/153604959 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3fc0593e0 con 0x7fa3e4066da0 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.343+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] conn(0x7fa3e4066da0 msgr2=0x7fa3e40691e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.343+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] conn(0x7fa3e4066da0 0x7fa3e40691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.343+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fa3e40611d0 msgr2=0x7fa3e4063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.343+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fa3e40611d0 0x7fa3e4063690 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa3ec0043d0 tx=0x7fa3ec00b040).stop 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.343+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f7900 msgr2=0x7fa3fc10d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.343+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f7900 0x7fa3fc10d180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fa3f00041d0 tx=0x7fa3f0009f60).stop 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.344+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 shutdown_connections 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.344+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6818/153604959,v1:172.21.15.49:6819/153604959] conn(0x7fa3e4066da0 0x7fa3e40691e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.344+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fa3e40611d0 0x7fa3e4063690 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.344+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3fc0f6660 0x7fa3fc10ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.344+0000 7fa4013a0700 1 --2- 172.21.15.49:0/1075558759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3fc0f7900 0x7fa3fc10d180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:52.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.344+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 >> 172.21.15.49:0/1075558759 conn(0x7fa3fc0f1de0 msgr2=0x7fa3fc0fb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:52.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.344+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 shutdown_connections 2024-02-22T00:29:52.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:51.344+0000 7fa4013a0700 1 -- 172.21.15.49:0/1075558759 wait complete. 2024-02-22T00:29:52.959 INFO:teuthology.orchestra.run.smithi049.stdout:81604378648 2024-02-22T00:29:52.960 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-22T00:29:53.287 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:51.790624+0000 mgr.smithi049.rjblpr (mgr.14194) 165 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:53.320 INFO:teuthology.orchestra.run.smithi049.stdout:111669149716 2024-02-22T00:29:53.321 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-22T00:29:53.327 INFO:teuthology.orchestra.run.smithi049.stdout:60129542174 2024-02-22T00:29:53.327 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-22T00:29:53.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:51.790624+0000 mgr.smithi049.rjblpr (mgr.14194) 165 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 -- 172.21.15.49:0/1715937376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 msgr2=0x7f60e80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 --2- 172.21.15.49:0/1715937376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 0x7f60e80f6cc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f60e40047f0 tx=0x7f60e4009cb0).stop 2024-02-22T00:29:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 -- 172.21.15.49:0/1715937376 shutdown_connections 2024-02-22T00:29:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 --2- 172.21.15.49:0/1715937376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e80f7b40 0x7f60e80f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:29:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 --2- 172.21.15.49:0/1715937376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 0x7f60e80f6cc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 -- 172.21.15.49:0/1715937376 >> 172.21.15.49:0/1715937376 conn(0x7f60e80f2020 msgr2=0x7f60e80f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 -- 172.21.15.49:0/1715937376 shutdown_connections 2024-02-22T00:29:54.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 -- 172.21.15.49:0/1715937376 wait complete. 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.979+0000 7f60f0424700 1 Processor -- start 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60f0424700 1 -- start start 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60f0424700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 0x7f60e80615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60f0424700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e80f7b40 0x7f60e810cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60f0424700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e810d3f0 con 0x7f60e80f68a0 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60f0424700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e810d530 con 0x7f60e80f7b40 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ee1c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 0x7f60e80615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ee1c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 0x7f60e80615a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43220/0 (socket says 172.21.15.49:43220) 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ee1c0700 1 -- 172.21.15.49:0/1127214261 learned_addr learned my addr 172.21.15.49:0/1127214261 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ed9bf700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e80f7b40 0x7f60e810cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ee1c0700 1 -- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e80f7b40 msgr2=0x7f60e810cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ee1c0700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e80f7b40 0x7f60e810cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ee1c0700 1 -- 172.21.15.49:0/1127214261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4005040 con 0x7f60e80f68a0 2024-02-22T00:29:54.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ed9bf700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e80f7b40 0x7f60e810cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60ee1c0700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 0x7f60e80615a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f60e4013470 tx=0x7f60e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e400e030 con 0x7f60e80f68a0 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e810d7b0 con 0x7f60e80f68a0 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f60e4007e90 con 0x7f60e80f68a0 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e4018070 con 0x7f60e80f68a0 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.980+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e810dc90 con 0x7f60e80f68a0 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.981+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60e805f5f0 con 0x7f60e80f68a0 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.982+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f60e401d940 con 0x7f60e80f68a0 2024-02-22T00:29:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.982+0000 7f60db7fe700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f60d4061180 0x7f60d4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.982+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f60e407e200 con 0x7f60e80f68a0 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.982+0000 7f60ed9bf700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f60d4061180 0x7f60d4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.982+0000 7f60db7fe700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] conn(0x7f60d4066d50 0x7f60d4069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.982+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 --> [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60d4069810 con 0x7f60d4066d50 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.982+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60e407e600 con 0x7f60e80f68a0 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.983+0000 7f60ed9bf700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f60d4061180 0x7f60d4063640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f60dc00a900 tx=0x7f60dc008040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.983+0000 7f60ee9c1700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] conn(0x7f60d4066d50 0x7f60d4069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.983+0000 7f60ee9c1700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] conn(0x7f60d4066d50 0x7f60d4069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.984+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 <== osd.5 v2:172.21.15.161:6816/1791237181 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f60d4069810 con 0x7f60d4066d50 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.999+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 --> [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60e8059360 con 0x7f60d4066d50 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.999+0000 7f60db7fe700 1 -- 172.21.15.49:0/1127214261 <== osd.5 v2:172.21.15.161:6816/1791237181 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f60e8059360 con 0x7f60d4066d50 2024-02-22T00:29:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.999+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] conn(0x7f60d4066d50 msgr2=0x7f60d4069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.999+0000 7f60f0424700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] conn(0x7f60d4066d50 0x7f60d4069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.999+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f60d4061180 msgr2=0x7f60d4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.999+0000 7f60f0424700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f60d4061180 0x7f60d4063640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f60dc00a900 tx=0x7f60dc008040).stop 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.999+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 msgr2=0x7f60e80615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:53.999+0000 7f60f0424700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 0x7f60e80615a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f60e4013470 tx=0x7f60e4009cb0).stop 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:54.000+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 shutdown_connections 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:54.000+0000 7f60f0424700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60e80f68a0 0x7f60e80615a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:54.000+0000 7f60f0424700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:6816/1791237181,v1:172.21.15.161:6817/1791237181] conn(0x7f60d4066d50 0x7f60d4069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:54.000+0000 7f60f0424700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f60d4061180 0x7f60d4063640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:54.000+0000 7f60f0424700 1 --2- 172.21.15.49:0/1127214261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e80f7b40 0x7f60e810cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:54.000+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 >> 172.21.15.49:0/1127214261 conn(0x7f60e80f2020 msgr2=0x7f60e80fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:54.000+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 shutdown_connections 2024-02-22T00:29:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:54.000+0000 7f60f0424700 1 -- 172.21.15.49:0/1127214261 wait complete. 2024-02-22T00:29:54.050 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:55.384 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:53.790918+0000 mgr.smithi049.rjblpr (mgr.14194) 166 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:55.406 INFO:teuthology.orchestra.run.smithi049.stdout:158913789962 2024-02-22T00:29:55.407 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-22T00:29:55.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:53.790918+0000 mgr.smithi049.rjblpr (mgr.14194) 166 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:55.648 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:56.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/2983767909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f8c40 msgr2=0x7fdb240f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:56.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/2983767909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f8c40 0x7fdb240f90a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdb140047f0 tx=0x7fdb14009cb0).stop 2024-02-22T00:29:56.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/2983767909 shutdown_connections 2024-02-22T00:29:56.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/2983767909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f8c40 0x7fdb240f90a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:56.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/2983767909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb240f79a0 0x7fdb240f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:56.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/2983767909 >> 172.21.15.49:0/2983767909 conn(0x7fdb240f3100 msgr2=0x7fdb240f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:56.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/2983767909 shutdown_connections 2024-02-22T00:29:56.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/2983767909 wait complete. 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.466+0000 7fdb2b8d9700 1 Processor -- start 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb2b8d9700 1 -- start start 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb2b8d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f79a0 0x7fdb24108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb2b8d9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb240f8c40 0x7fdb24108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb2b8d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb24108b20 con 0x7fdb240f79a0 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb2b8d9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb24108c60 con 0x7fdb240f8c40 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb29675700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f79a0 0x7fdb24108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb29675700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f79a0 0x7fdb24108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43234/0 (socket says 172.21.15.49:43234) 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb29675700 1 -- 172.21.15.49:0/1983173316 learned_addr learned my addr 172.21.15.49:0/1983173316 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb28e74700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb240f8c40 0x7fdb24108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb29675700 1 -- 172.21.15.49:0/1983173316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb240f8c40 msgr2=0x7fdb24108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:56.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb29675700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb240f8c40 0x7fdb24108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb29675700 1 -- 172.21.15.49:0/1983173316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14005040 con 0x7fdb240f79a0 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb28e74700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb240f8c40 0x7fdb24108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb29675700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f79a0 0x7fdb24108080 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fdb2000c790 tx=0x7fdb20007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb200106f0 con 0x7fdb240f79a0 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fdb20010ce0 con 0x7fdb240f79a0 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb2410d700 con 0x7fdb240f79a0 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.467+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb20012c80 con 0x7fdb240f79a0 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.468+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2410dc40 con 0x7fdb240f79a0 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.468+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb2405f5f0 con 0x7fdb240f79a0 2024-02-22T00:29:56.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.469+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fdb20012400 con 0x7fdb240f79a0 2024-02-22T00:29:56.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.469+0000 7fdb1a7fc700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdb10061180 0x7fdb10063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:56.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.469+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fdb2007bee0 con 0x7fdb240f79a0 2024-02-22T00:29:56.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.469+0000 7fdb28e74700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdb10061180 0x7fdb10063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.469+0000 7fdb1a7fc700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] conn(0x7fdb10066d50 0x7fdb10069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.469+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 --> [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb10069810 con 0x7fdb10066d50 2024-02-22T00:29:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.469+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb2007e550 con 0x7fdb240f79a0 2024-02-22T00:29:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.470+0000 7fdb29e76700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] conn(0x7fdb10066d50 0x7fdb10069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.470+0000 7fdb28e74700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdb10061180 0x7fdb10063640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdb14013470 tx=0x7fdb1400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.470+0000 7fdb29e76700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] conn(0x7fdb10066d50 0x7fdb10069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:56.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.471+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 <== osd.0 v2:172.21.15.49:6802/683996799 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fdb10069810 con 0x7fdb10066d50 2024-02-22T00:29:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 --> [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb24059360 con 0x7fdb10066d50 2024-02-22T00:29:56.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb1a7fc700 1 -- 172.21.15.49:0/1983173316 <== osd.0 v2:172.21.15.49:6802/683996799 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdb24059360 con 0x7fdb10066d50 2024-02-22T00:29:56.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] conn(0x7fdb10066d50 msgr2=0x7fdb10069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:56.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] conn(0x7fdb10066d50 0x7fdb10069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:56.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdb10061180 msgr2=0x7fdb10063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:56.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdb10061180 0x7fdb10063640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdb14013470 tx=0x7fdb1400b040).stop 2024-02-22T00:29:56.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f79a0 msgr2=0x7fdb24108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:56.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f79a0 0x7fdb24108080 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fdb2000c790 tx=0x7fdb20007f70).stop 2024-02-22T00:29:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 shutdown_connections 2024-02-22T00:29:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdb240f79a0 0x7fdb24108080 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6802/683996799,v1:172.21.15.49:6803/683996799] conn(0x7fdb10066d50 0x7fdb10069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdb10061180 0x7fdb10063640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 --2- 172.21.15.49:0/1983173316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb240f8c40 0x7fdb24108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 >> 172.21.15.49:0/1983173316 conn(0x7fdb240f3100 msgr2=0x7fdb240fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 shutdown_connections 2024-02-22T00:29:56.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:56.485+0000 7fdb2b8d9700 1 -- 172.21.15.49:0/1983173316 wait complete. 2024-02-22T00:29:57.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:55.791218+0000 mgr.smithi049.rjblpr (mgr.14194) 167 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:57.527 INFO:teuthology.orchestra.run.smithi049.stdout:38654705703 2024-02-22T00:29:57.528 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-22T00:29:57.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:55.791218+0000 mgr.smithi049.rjblpr (mgr.14194) 167 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:57.760 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:57.760 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.298+0000 7f41f02bb700 1 -- 172.21.15.49:0/2415563389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 msgr2=0x7f41e80f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.298+0000 7f41f02bb700 1 --2- 172.21.15.49:0/2415563389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 0x7f41e80f7fa0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f41d80047f0 tx=0x7f41d8009cb0).stop 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.298+0000 7f41f02bb700 1 -- 172.21.15.49:0/2415563389 shutdown_connections 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.298+0000 7f41f02bb700 1 --2- 172.21.15.49:0/2415563389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 0x7f41e80f7fa0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.298+0000 7f41f02bb700 1 --2- 172.21.15.49:0/2415563389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e80f68a0 0x7f41e80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.298+0000 7f41f02bb700 1 -- 172.21.15.49:0/2415563389 >> 172.21.15.49:0/2415563389 conn(0x7f41e80f2020 msgr2=0x7f41e80f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.298+0000 7f41f02bb700 1 -- 172.21.15.49:0/2415563389 shutdown_connections 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.298+0000 7f41f02bb700 1 -- 172.21.15.49:0/2415563389 wait complete. 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41f02bb700 1 Processor -- start 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41f02bb700 1 -- start start 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41f02bb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e80f68a0 0x7f41e80615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:59.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41f02bb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 0x7f41e810ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41f02bb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e810d320 con 0x7f41e80f7b40 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41f02bb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e810d460 con 0x7f41e80f68a0 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41ed856700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 0x7f41e810ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41ed856700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 0x7f41e810ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43246/0 (socket says 172.21.15.49:43246) 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.299+0000 7f41ed856700 1 -- 172.21.15.49:0/3631539720 learned_addr learned my addr 172.21.15.49:0/3631539720 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41ed856700 1 -- 172.21.15.49:0/3631539720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e80f68a0 msgr2=0x7f41e80615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41ee057700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e80f68a0 0x7f41e80615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41ed856700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e80f68a0 0x7f41e80615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41ed856700 1 -- 172.21.15.49:0/3631539720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8005040 con 0x7f41e80f7b40 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41ed856700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 0x7f41e810ce30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f41d8013510 tx=0x7f41d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41df779700 1 -- 172.21.15.49:0/3631539720 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d800e030 con 0x7f41e80f7b40 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41df779700 1 -- 172.21.15.49:0/3631539720 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f41d8007e90 con 0x7f41e80f7b40 2024-02-22T00:29:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e810d660 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41df779700 1 -- 172.21.15.49:0/3631539720 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41d8018070 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.300+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e810db40 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.301+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e80feff0 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.301+0000 7f41df779700 1 -- 172.21.15.49:0/3631539720 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f41d801d420 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.302+0000 7f41df779700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f41d4061180 0x7f41d4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.302+0000 7f41df779700 1 -- 172.21.15.49:0/3631539720 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f41d807d9a0 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.302+0000 7f41ee057700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f41d4061180 0x7f41d4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.302+0000 7f41ee057700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f41d4061180 0x7f41d4063640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f41e4009fd0 tx=0x7f41e400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.306+0000 7f41df779700 1 -- 172.21.15.49:0/3631539720 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f41d8051c30 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.478+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f41e8059990 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.478+0000 7f41df779700 1 -- 172.21.15.49:0/3631539720 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f41d8051820 con 0x7f41e80f7b40 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f41d4061180 msgr2=0x7f41d4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f41d4061180 0x7f41d4063640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f41e4009fd0 tx=0x7f41e400b040).stop 2024-02-22T00:29:59.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 msgr2=0x7f41e810ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 0x7f41e810ce30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f41d8013510 tx=0x7f41d8009cb0).stop 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 shutdown_connections 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f41d4061180 0x7f41d4063640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41e80f68a0 0x7f41e80615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 --2- 172.21.15.49:0/3631539720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41e80f7b40 0x7f41e810ce30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.480+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 >> 172.21.15.49:0/3631539720 conn(0x7f41e80f2020 msgr2=0x7f41e80fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.481+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 shutdown_connections 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:29:58.481+0000 7f41f02bb700 1 -- 172.21.15.49:0/3631539720 wait complete. 2024-02-22T00:29:59.122 INFO:teuthology.orchestra.run.smithi049.stdout:137438953488 2024-02-22T00:29:59.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:57.791656+0000 mgr.smithi049.rjblpr (mgr.14194) 168 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:59.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:29:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:29:58.479811+0000 mon.smithi049 (mon.0) 501 : audit [DBG] from='client.? 172.21.15.49:0/3631539720' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-22T00:29:59.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:57.791656+0000 mgr.smithi049.rjblpr (mgr.14194) 168 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:29:59.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:29:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:29:58.479811+0000 mon.smithi049 (mon.0) 501 : audit [DBG] from='client.? 172.21.15.49:0/3631539720' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-22T00:29:59.569 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:30:00.425 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:00.000120+0000 mon.smithi049 (mon.0) 502 : cluster [INF] overall HEALTH_OK 2024-02-22T00:30:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:00.000120+0000 mon.smithi049 (mon.0) 502 : cluster [INF] overall HEALTH_OK 2024-02-22T00:30:00.955 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953486 got 137438953488 for osd.4 2024-02-22T00:30:00.956 DEBUG:teuthology.parallel:result is None 2024-02-22T00:30:01.375 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:29:59.792068+0000 mgr.smithi049.rjblpr (mgr.14194) 169 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:01.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:29:59.792068+0000 mgr.smithi049.rjblpr (mgr.14194) 169 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:02.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.218+0000 7f3ee28e1700 1 -- 172.21.15.49:0/3289183141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f7b40 msgr2=0x7f3edc0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:02.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.218+0000 7f3ee28e1700 1 --2- 172.21.15.49:0/3289183141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f7b40 0x7f3edc0f7fa0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f3ed00047f0 tx=0x7f3ed0009cb0).stop 2024-02-22T00:30:02.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.218+0000 7f3ee28e1700 1 -- 172.21.15.49:0/3289183141 shutdown_connections 2024-02-22T00:30:02.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.218+0000 7f3ee28e1700 1 --2- 172.21.15.49:0/3289183141 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f7b40 0x7f3edc0f7fa0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:02.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.218+0000 7f3ee28e1700 1 --2- 172.21.15.49:0/3289183141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3edc0f68a0 0x7f3edc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:30:02.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.218+0000 7f3ee28e1700 1 -- 172.21.15.49:0/3289183141 >> 172.21.15.49:0/3289183141 conn(0x7f3edc0f2020 msgr2=0x7f3edc0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.218+0000 7f3ee28e1700 1 -- 172.21.15.49:0/3289183141 shutdown_connections 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.218+0000 7f3ee28e1700 1 -- 172.21.15.49:0/3289183141 wait complete. 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3ee28e1700 1 Processor -- start 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3ee28e1700 1 -- start start 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3ee28e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f68a0 0x7f3edc0fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3ee28e1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3edc0f7b40 0x7f3edc0f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3ee28e1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0f9370 con 0x7f3edc0f68a0 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3ee28e1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0f94b0 con 0x7f3edc0f7b40 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f68a0 0x7f3edc0fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3edbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f68a0 0x7f3edc0fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52130/0 (socket says 172.21.15.49:52130) 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3edbfff700 1 -- 172.21.15.49:0/1555935977 learned_addr learned my addr 172.21.15.49:0/1555935977 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3edbfff700 1 -- 172.21.15.49:0/1555935977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3edc0f7b40 msgr2=0x7f3edc0f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:02.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3edbfff700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3edc0f7b40 0x7f3edc0f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.219+0000 7f3edbfff700 1 -- 172.21.15.49:0/1555935977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0005040 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.220+0000 7f3edbfff700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f68a0 0x7f3edc0fa820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f3ecc00b480 tx=0x7f3ecc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.220+0000 7f3ed97fa700 1 -- 172.21.15.49:0/1555935977 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ecc002500 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.220+0000 7f3ed97fa700 1 -- 172.21.15.49:0/1555935977 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3ecc002af0 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.220+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc0f9790 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.220+0000 7f3ed97fa700 1 -- 172.21.15.49:0/1555935977 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ecc012c30 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.220+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc0f9cd0 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.221+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc0ff090 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.221+0000 7f3ed97fa700 1 -- 172.21.15.49:0/1555935977 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f3ecc002660 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.222+0000 7f3ed97fa700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ec4061180 0x7f3ec4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.222+0000 7f3ed97fa700 1 -- 172.21.15.49:0/1555935977 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f3ecc07c5d0 con 0x7f3edc0f68a0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.222+0000 7f3edb7fe700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ec4061180 0x7f3ec4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.222+0000 7f3edb7fe700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ec4061180 0x7f3ec4063640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3ed0013510 tx=0x7f3ed0009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:02.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.226+0000 7f3ed97fa700 1 -- 172.21.15.49:0/1555935977 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3ecc050840 con 0x7f3edc0f68a0 2024-02-22T00:30:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.396+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3edc110a30 con 0x7f3edc0f68a0 2024-02-22T00:30:02.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.397+0000 7f3ed97fa700 1 -- 172.21.15.49:0/1555935977 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ecc050430 con 0x7f3edc0f68a0 2024-02-22T00:30:02.400 INFO:teuthology.orchestra.run.smithi049.stdout:81604378650 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ec4061180 msgr2=0x7f3ec4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ec4061180 0x7f3ec4063640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3ed0013510 tx=0x7f3ed0009cb0).stop 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f68a0 msgr2=0x7f3edc0fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f68a0 0x7f3edc0fa820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f3ecc00b480 tx=0x7f3ecc0090f0).stop 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 shutdown_connections 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3edc0f68a0 0x7f3edc0fa820 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3ec4061180 0x7f3ec4063640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 --2- 172.21.15.49:0/1555935977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3edc0f7b40 0x7f3edc0f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 >> 172.21.15.49:0/1555935977 conn(0x7f3edc0f2020 msgr2=0x7f3edc061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:02.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 shutdown_connections 2024-02-22T00:30:02.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:02.399+0000 7f3ee28e1700 1 -- 172.21.15.49:0/1555935977 wait complete. 2024-02-22T00:30:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:30:03.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:01.792429+0000 mgr.smithi049.rjblpr (mgr.14194) 170 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:03.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:02.398258+0000 mon.smithi049 (mon.0) 503 : audit [DBG] from='client.? 172.21.15.49:0/1555935977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-22T00:30:03.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:01.792429+0000 mgr.smithi049.rjblpr (mgr.14194) 170 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:03.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:02.398258+0000 mon.smithi049 (mon.0) 503 : audit [DBG] from='client.? 172.21.15.49:0/1555935977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.524+0000 7f5e4e15d700 1 -- 172.21.15.49:0/1125078392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 msgr2=0x7f5e480f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.524+0000 7f5e4e15d700 1 --2- 172.21.15.49:0/1125078392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 0x7f5e480f6cc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f5e380047f0 tx=0x7f5e38009cb0).stop 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.524+0000 7f5e4e15d700 1 -- 172.21.15.49:0/1125078392 shutdown_connections 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.524+0000 7f5e4e15d700 1 --2- 172.21.15.49:0/1125078392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e480f7b40 0x7f5e480f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.524+0000 7f5e4e15d700 1 --2- 172.21.15.49:0/1125078392 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 0x7f5e480f6cc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.524+0000 7f5e4e15d700 1 -- 172.21.15.49:0/1125078392 >> 172.21.15.49:0/1125078392 conn(0x7f5e480f2020 msgr2=0x7f5e480f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.524+0000 7f5e4e15d700 1 -- 172.21.15.49:0/1125078392 shutdown_connections 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.524+0000 7f5e4e15d700 1 -- 172.21.15.49:0/1125078392 wait complete. 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e4e15d700 1 Processor -- start 2024-02-22T00:30:03.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e4e15d700 1 -- start start 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e4e15d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 0x7f5e4810a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e4e15d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e480f7b40 0x7f5e4810a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e4e15d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4810ae70 con 0x7f5e480f68a0 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e4e15d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4810afb0 con 0x7f5e480f7b40 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 0x7f5e4810a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 0x7f5e4810a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52160/0 (socket says 172.21.15.49:52160) 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e477fe700 1 -- 172.21.15.49:0/3395949397 learned_addr learned my addr 172.21.15.49:0/3395949397 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e46ffd700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e480f7b40 0x7f5e4810a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e477fe700 1 -- 172.21.15.49:0/3395949397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e480f7b40 msgr2=0x7f5e4810a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e477fe700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e480f7b40 0x7f5e4810a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e477fe700 1 -- 172.21.15.49:0/3395949397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38005040 con 0x7f5e480f68a0 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.525+0000 7f5e46ffd700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e480f7b40 0x7f5e4810a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:30:03.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.526+0000 7f5e477fe700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 0x7f5e4810a340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5e38013470 tx=0x7f5e38009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.526+0000 7f5e44ff9700 1 -- 172.21.15.49:0/3395949397 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e3800e030 con 0x7f5e480f68a0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.526+0000 7f5e44ff9700 1 -- 172.21.15.49:0/3395949397 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5e38007e90 con 0x7f5e480f68a0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.526+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4810f9f0 con 0x7f5e480f68a0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.526+0000 7f5e44ff9700 1 -- 172.21.15.49:0/3395949397 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e38018070 con 0x7f5e480f68a0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.526+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4810fed0 con 0x7f5e480f68a0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.527+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e480ff070 con 0x7f5e480f68a0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.527+0000 7f5e44ff9700 1 -- 172.21.15.49:0/3395949397 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f5e3801d940 con 0x7f5e480f68a0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.527+0000 7f5e44ff9700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e34061160 0x7f5e34063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.527+0000 7f5e44ff9700 1 -- 172.21.15.49:0/3395949397 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f5e3807dba0 con 0x7f5e480f68a0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.528+0000 7f5e46ffd700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e34061160 0x7f5e34063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.528+0000 7f5e46ffd700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e34061160 0x7f5e34063620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5e3000a900 tx=0x7f5e30008040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:03.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.532+0000 7f5e44ff9700 1 -- 172.21.15.49:0/3395949397 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5e38051e70 con 0x7f5e480f68a0 2024-02-22T00:30:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.704+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5e48110810 con 0x7f5e480f68a0 2024-02-22T00:30:03.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.705+0000 7f5e44ff9700 1 -- 172.21.15.49:0/3395949397 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e38051a60 con 0x7f5e480f68a0 2024-02-22T00:30:03.709 INFO:teuthology.orchestra.run.smithi049.stdout:158913789964 2024-02-22T00:30:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e34061160 msgr2=0x7f5e34063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e34061160 0x7f5e34063620 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5e3000a900 tx=0x7f5e30008040).stop 2024-02-22T00:30:03.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 msgr2=0x7f5e4810a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 0x7f5e4810a340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f5e38013470 tx=0x7f5e38009cb0).stop 2024-02-22T00:30:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 shutdown_connections 2024-02-22T00:30:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e480f68a0 0x7f5e4810a340 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e34061160 0x7f5e34063620 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 --2- 172.21.15.49:0/3395949397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e480f7b40 0x7f5e4810a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 >> 172.21.15.49:0/3395949397 conn(0x7f5e480f2020 msgr2=0x7f5e48061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.706+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 shutdown_connections 2024-02-22T00:30:03.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:03.707+0000 7f5e4e15d700 1 -- 172.21.15.49:0/3395949397 wait complete. 2024-02-22T00:30:04.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:03.706027+0000 mon.smithi049 (mon.0) 504 : audit [DBG] from='client.? 172.21.15.49:0/3395949397' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-22T00:30:04.489 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789962 got 158913789964 for osd.5 2024-02-22T00:30:04.489 DEBUG:teuthology.parallel:result is None 2024-02-22T00:30:04.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:03.706027+0000 mon.smithi049 (mon.0) 504 : audit [DBG] from='client.? 172.21.15.49:0/3395949397' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-22T00:30:05.034 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-02-22T00:30:05.034 DEBUG:teuthology.parallel:result is None 2024-02-22T00:30:05.344 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:03.792748+0000 mgr.smithi049.rjblpr (mgr.14194) 171 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:05.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:03.792748+0000 mgr.smithi049.rjblpr (mgr.14194) 171 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:07.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.031+0000 7fbce2067700 1 -- 172.21.15.49:0/1092033634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f79a0 msgr2=0x7fbcdc0f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.031+0000 7fbce2067700 1 --2- 172.21.15.49:0/1092033634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f79a0 0x7fbcdc0f7dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fbccc0047f0 tx=0x7fbccc009cb0).stop 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.031+0000 7fbce2067700 1 -- 172.21.15.49:0/1092033634 shutdown_connections 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.031+0000 7fbce2067700 1 --2- 172.21.15.49:0/1092033634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc0f8c40 0x7fbcdc0f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.031+0000 7fbce2067700 1 --2- 172.21.15.49:0/1092033634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f79a0 0x7fbcdc0f7dc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.031+0000 7fbce2067700 1 -- 172.21.15.49:0/1092033634 >> 172.21.15.49:0/1092033634 conn(0x7fbcdc0f3100 msgr2=0x7fbcdc0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.031+0000 7fbce2067700 1 -- 172.21.15.49:0/1092033634 shutdown_connections 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.031+0000 7fbce2067700 1 -- 172.21.15.49:0/1092033634 wait complete. 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbce2067700 1 Processor -- start 2024-02-22T00:30:07.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbce2067700 1 -- start start 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbce2067700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc0f79a0 0x7fbcdc06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbce2067700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f8c40 0x7fbcdc06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbce2067700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc06cf80 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbce2067700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc06b520 con 0x7fbcdc0f79a0 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbcdaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f8c40 0x7fbcdc06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbcdaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f8c40 0x7fbcdc06b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52174/0 (socket says 172.21.15.49:52174) 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbcdaffd700 1 -- 172.21.15.49:0/1143112342 learned_addr learned my addr 172.21.15.49:0/1143112342 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbcdb7fe700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc0f79a0 0x7fbcdc06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbcdaffd700 1 -- 172.21.15.49:0/1143112342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc0f79a0 msgr2=0x7fbcdc06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbcdaffd700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc0f79a0 0x7fbcdc06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.032+0000 7fbcdaffd700 1 -- 172.21.15.49:0/1143112342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc005040 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.033+0000 7fbcdaffd700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f8c40 0x7fbcdc06b030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fbcd0002770 tx=0x7fbcd0002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:07.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.033+0000 7fbcd8ff9700 1 -- 172.21.15.49:0/1143112342 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcd0007b40 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.033+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc06b7a0 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.033+0000 7fbcd8ff9700 1 -- 172.21.15.49:0/1143112342 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbcd000f040 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.033+0000 7fbcd8ff9700 1 -- 172.21.15.49:0/1143112342 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcd0014780 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.033+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc06bce0 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.034+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc047540 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.034+0000 7fbcd8ff9700 1 -- 172.21.15.49:0/1143112342 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fbcd0007ca0 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.035+0000 7fbcd8ff9700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fbcc4061180 0x7fbcc4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.035+0000 7fbcd8ff9700 1 -- 172.21.15.49:0/1143112342 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fbcd007c1e0 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.035+0000 7fbcdb7fe700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fbcc4061180 0x7fbcc4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.035+0000 7fbcdb7fe700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fbcc4061180 0x7fbcc4063640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fbccc004f10 tx=0x7fbccc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:07.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.043+0000 7fbcd8ff9700 1 -- 172.21.15.49:0/1143112342 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbcd00504b0 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.219+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbcdc0598f0 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.219+0000 7fbcd8ff9700 1 -- 172.21.15.49:0/1143112342 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcd00500a0 con 0x7fbcdc0f8c40 2024-02-22T00:30:07.222 INFO:teuthology.orchestra.run.smithi049.stdout:111669149719 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fbcc4061180 msgr2=0x7fbcc4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fbcc4061180 0x7fbcc4063640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fbccc004f10 tx=0x7fbccc00b040).stop 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f8c40 msgr2=0x7fbcdc06b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f8c40 0x7fbcdc06b030 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fbcd0002770 tx=0x7fbcd0002a80).stop 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 shutdown_connections 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fbcc4061180 0x7fbcc4063640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcdc0f79a0 0x7fbcdc06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 --2- 172.21.15.49:0/1143112342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcdc0f8c40 0x7fbcdc06b030 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 >> 172.21.15.49:0/1143112342 conn(0x7fbcdc0f3100 msgr2=0x7fbcdc0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:07.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 shutdown_connections 2024-02-22T00:30:07.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.221+0000 7fbce2067700 1 -- 172.21.15.49:0/1143112342 wait complete. 2024-02-22T00:30:07.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.255+0000 7f2b6ca50700 1 -- 172.21.15.49:0/2738950144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f7b40 msgr2=0x7f2b680f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.255+0000 7f2b6ca50700 1 --2- 172.21.15.49:0/2738950144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f7b40 0x7f2b680f7fa0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f2b5c0047f0 tx=0x7f2b5c009cb0).stop 2024-02-22T00:30:07.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.255+0000 7f2b6ca50700 1 -- 172.21.15.49:0/2738950144 shutdown_connections 2024-02-22T00:30:07.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.255+0000 7f2b6ca50700 1 --2- 172.21.15.49:0/2738950144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f7b40 0x7f2b680f7fa0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.255+0000 7f2b6ca50700 1 --2- 172.21.15.49:0/2738950144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b680f68a0 0x7f2b680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.255+0000 7f2b6ca50700 1 -- 172.21.15.49:0/2738950144 >> 172.21.15.49:0/2738950144 conn(0x7f2b680f2020 msgr2=0x7f2b680f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:07.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.255+0000 7f2b6ca50700 1 -- 172.21.15.49:0/2738950144 shutdown_connections 2024-02-22T00:30:07.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.255+0000 7f2b6ca50700 1 -- 172.21.15.49:0/2738950144 wait complete. 2024-02-22T00:30:07.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6ca50700 1 Processor -- start 2024-02-22T00:30:07.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6ca50700 1 -- start start 2024-02-22T00:30:07.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6ca50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f68a0 0x7f2b68108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6ca50700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b680f7b40 0x7f2b68108540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6ca50700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68108af0 con 0x7f2b680f68a0 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6ca50700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68108c30 con 0x7f2b680f7b40 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f68a0 0x7f2b68108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f68a0 0x7f2b68108050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52184/0 (socket says 172.21.15.49:52184) 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b6659c700 1 -- 172.21.15.49:0/1121076684 learned_addr learned my addr 172.21.15.49:0/1121076684 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.256+0000 7f2b65d9b700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b680f7b40 0x7f2b68108540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b6659c700 1 -- 172.21.15.49:0/1121076684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b680f7b40 msgr2=0x7f2b68108540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b6659c700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b680f7b40 0x7f2b68108540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b6659c700 1 -- 172.21.15.49:0/1121076684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c005040 con 0x7f2b680f68a0 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b6659c700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f68a0 0x7f2b68108050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f2b58002820 tx=0x7f2b58009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b577fe700 1 -- 172.21.15.49:0/1121076684 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b58007b40 con 0x7f2b680f68a0 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6810d6d0 con 0x7f2b680f68a0 2024-02-22T00:30:07.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b577fe700 1 -- 172.21.15.49:0/1121076684 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2b5800f040 con 0x7f2b680f68a0 2024-02-22T00:30:07.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b577fe700 1 -- 172.21.15.49:0/1121076684 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b580147c0 con 0x7f2b680f68a0 2024-02-22T00:30:07.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.257+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6810dc10 con 0x7f2b680f68a0 2024-02-22T00:30:07.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.258+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b680feff0 con 0x7f2b680f68a0 2024-02-22T00:30:07.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.258+0000 7f2b577fe700 1 -- 172.21.15.49:0/1121076684 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f2b58009110 con 0x7f2b680f68a0 2024-02-22T00:30:07.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.259+0000 7f2b577fe700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2b50061180 0x7f2b50063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.259+0000 7f2b577fe700 1 -- 172.21.15.49:0/1121076684 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f2b5807c150 con 0x7f2b680f68a0 2024-02-22T00:30:07.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.259+0000 7f2b65d9b700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2b50061180 0x7f2b50063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.259+0000 7f2b65d9b700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2b50061180 0x7f2b50063640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2b5c0047c0 tx=0x7f2b5c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:07.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.263+0000 7f2b577fe700 1 -- 172.21.15.49:0/1121076684 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2b58050420 con 0x7f2b680f68a0 2024-02-22T00:30:07.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.939+0000 7faf7649f700 1 -- 172.21.15.49:0/25098573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700fab00 msgr2=0x7faf700fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.939+0000 7faf7649f700 1 --2- 172.21.15.49:0/25098573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700fab00 0x7faf700fcf50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7faf640047f0 tx=0x7faf64009cb0).stop 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.939+0000 7faf7649f700 1 -- 172.21.15.49:0/25098573 shutdown_connections 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.939+0000 7faf7649f700 1 --2- 172.21.15.49:0/25098573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700fab00 0x7faf700fcf50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.939+0000 7faf7649f700 1 --2- 172.21.15.49:0/25098573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf700617e0 0x7faf700fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.939+0000 7faf7649f700 1 -- 172.21.15.49:0/25098573 >> 172.21.15.49:0/25098573 conn(0x7faf700f2020 msgr2=0x7faf700f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.939+0000 7faf7649f700 1 -- 172.21.15.49:0/25098573 shutdown_connections 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.939+0000 7faf7649f700 1 -- 172.21.15.49:0/25098573 wait complete. 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf7649f700 1 Processor -- start 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf7649f700 1 -- start start 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf7649f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700617e0 0x7faf700f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf7649f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf700fab00 0x7faf700f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf7649f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700f83d0 con 0x7faf700617e0 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf7649f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf700f6970 con 0x7faf700fab00 2024-02-22T00:30:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf6ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700617e0 0x7faf700f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf6ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700617e0 0x7faf700f7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52164/0 (socket says 172.21.15.49:52164) 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf6ffff700 1 -- 172.21.15.49:0/1776162082 learned_addr learned my addr 172.21.15.49:0/1776162082 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf6f7fe700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf700fab00 0x7faf700f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.940+0000 7faf6ffff700 1 -- 172.21.15.49:0/1776162082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf700fab00 msgr2=0x7faf700f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.941+0000 7faf6ffff700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf700fab00 0x7faf700f6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.941+0000 7faf6ffff700 1 -- 172.21.15.49:0/1776162082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64005040 con 0x7faf700617e0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.941+0000 7faf6ffff700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700617e0 0x7faf700f7e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7faf6000e8f0 tx=0x7faf6000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.941+0000 7faf6d7fa700 1 -- 172.21.15.49:0/1776162082 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf6000ee90 con 0x7faf700617e0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.941+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf700f6bf0 con 0x7faf700617e0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.941+0000 7faf6d7fa700 1 -- 172.21.15.49:0/1776162082 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7faf6000f040 con 0x7faf700617e0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.941+0000 7faf6d7fa700 1 -- 172.21.15.49:0/1776162082 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf6000c810 con 0x7faf700617e0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.941+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf700f71b0 con 0x7faf700617e0 2024-02-22T00:30:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.942+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf701000f0 con 0x7faf700617e0 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.943+0000 7faf6d7fa700 1 -- 172.21.15.49:0/1776162082 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7faf60009360 con 0x7faf700617e0 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.943+0000 7faf6d7fa700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7faf58061180 0x7faf58063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.944+0000 7faf6d7fa700 1 -- 172.21.15.49:0/1776162082 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7faf6007bff0 con 0x7faf700617e0 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.944+0000 7faf6f7fe700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7faf58061180 0x7faf58063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.944+0000 7faf6f7fe700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7faf58061180 0x7faf58063640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7faf64004e60 tx=0x7faf6400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:06.948+0000 7faf6d7fa700 1 -- 172.21.15.49:0/1776162082 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7faf6004af60 con 0x7faf700617e0 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.126+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faf700598f0 con 0x7faf700617e0 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.126+0000 7faf6d7fa700 1 -- 172.21.15.49:0/1776162082 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf60019090 con 0x7faf700617e0 2024-02-22T00:30:07.383 INFO:teuthology.orchestra.run.smithi049.stdout:38654705705 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7faf58061180 msgr2=0x7faf58063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7faf58061180 0x7faf58063640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7faf64004e60 tx=0x7faf6400b040).stop 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700617e0 msgr2=0x7faf700f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700617e0 0x7faf700f7e20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7faf6000e8f0 tx=0x7faf6000b040).stop 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 shutdown_connections 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faf700617e0 0x7faf700f7e20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7faf58061180 0x7faf58063640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 --2- 172.21.15.49:0/1776162082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf700fab00 0x7faf700f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 >> 172.21.15.49:0/1776162082 conn(0x7faf700f2020 msgr2=0x7faf700f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 shutdown_connections 2024-02-22T00:30:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.128+0000 7faf7649f700 1 -- 172.21.15.49:0/1776162082 wait complete. 2024-02-22T00:30:07.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:05.793074+0000 mgr.smithi049.rjblpr (mgr.14194) 172 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.436+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2b6810e5d0 con 0x7f2b680f68a0 2024-02-22T00:30:07.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.436+0000 7f2b577fe700 1 -- 172.21.15.49:0/1121076684 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b58050010 con 0x7f2b680f68a0 2024-02-22T00:30:07.439 INFO:teuthology.orchestra.run.smithi049.stdout:60129542176 2024-02-22T00:30:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2b50061180 msgr2=0x7f2b50063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2b50061180 0x7f2b50063640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2b5c0047c0 tx=0x7f2b5c00b040).stop 2024-02-22T00:30:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f68a0 msgr2=0x7f2b68108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:07.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f68a0 0x7f2b68108050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f2b58002820 tx=0x7f2b58009f00).stop 2024-02-22T00:30:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 shutdown_connections 2024-02-22T00:30:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2b680f68a0 0x7f2b68108050 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f2b50061180 0x7f2b50063640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 --2- 172.21.15.49:0/1121076684 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b680f7b40 0x7f2b68108540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 >> 172.21.15.49:0/1121076684 conn(0x7f2b680f2020 msgr2=0x7f2b68061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 shutdown_connections 2024-02-22T00:30:07.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:07.438+0000 7f2b6ca50700 1 -- 172.21.15.49:0/1121076684 wait complete. 2024-02-22T00:30:07.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:05.793074+0000 mgr.smithi049.rjblpr (mgr.14194) 172 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:08.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:07.127658+0000 mon.smithi049 (mon.0) 505 : audit [DBG] from='client.? 172.21.15.49:0/1776162082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-22T00:30:08.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:07.220402+0000 mon.smithi049 (mon.0) 506 : audit [DBG] from='client.? 172.21.15.49:0/1143112342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-22T00:30:08.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:07.437806+0000 mon.smithi049 (mon.0) 507 : audit [DBG] from='client.? 172.21.15.49:0/1121076684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-22T00:30:08.287 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-02-22T00:30:08.287 DEBUG:teuthology.parallel:result is None 2024-02-22T00:30:08.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:07.127658+0000 mon.smithi049 (mon.0) 505 : audit [DBG] from='client.? 172.21.15.49:0/1776162082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-22T00:30:08.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:07.220402+0000 mon.smithi049 (mon.0) 506 : audit [DBG] from='client.? 172.21.15.49:0/1143112342' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-22T00:30:08.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:07.437806+0000 mon.smithi049 (mon.0) 507 : audit [DBG] from='client.? 172.21.15.49:0/1121076684' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-22T00:30:08.886 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149716 got 111669149719 for osd.3 2024-02-22T00:30:08.886 DEBUG:teuthology.parallel:result is None 2024-02-22T00:30:09.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:07.793369+0000 mgr.smithi049.rjblpr (mgr.14194) 173 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:09.245 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705703 got 38654705705 for osd.0 2024-02-22T00:30:09.245 DEBUG:teuthology.parallel:result is None 2024-02-22T00:30:09.245 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-22T00:30:09.246 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph pg dump --format=json 2024-02-22T00:30:09.528 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:30:09.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:07.793369+0000 mgr.smithi049.rjblpr (mgr.14194) 173 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.230+0000 7ff5dac42700 1 -- 172.21.15.49:0/432222369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 msgr2=0x7ff5d40f8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.230+0000 7ff5dac42700 1 --2- 172.21.15.49:0/432222369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 0x7ff5d40f8d70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ff5c00047f0 tx=0x7ff5c0009cb0).stop 2024-02-22T00:30:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.230+0000 7ff5dac42700 1 -- 172.21.15.49:0/432222369 shutdown_connections 2024-02-22T00:30:11.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.230+0000 7ff5dac42700 1 --2- 172.21.15.49:0/432222369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 0x7ff5d40f8d70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:11.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.230+0000 7ff5dac42700 1 --2- 172.21.15.49:0/432222369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d40f5c50 0x7ff5d40f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:11.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.230+0000 7ff5dac42700 1 -- 172.21.15.49:0/432222369 >> 172.21.15.49:0/432222369 conn(0x7ff5d40f1770 msgr2=0x7ff5d40f3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:11.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.230+0000 7ff5dac42700 1 -- 172.21.15.49:0/432222369 shutdown_connections 2024-02-22T00:30:11.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.230+0000 7ff5dac42700 1 -- 172.21.15.49:0/432222369 wait complete. 2024-02-22T00:30:11.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5dac42700 1 Processor -- start 2024-02-22T00:30:11.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5dac42700 1 -- start start 2024-02-22T00:30:11.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5dac42700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d40f5c50 0x7ff5d41081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5dac42700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 0x7ff5d41086b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5dac42700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4108c60 con 0x7ff5d40f65f0 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5dac42700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4108da0 con 0x7ff5d40f5c50 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 0x7ff5d41086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 0x7ff5d41086b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52204/0 (socket says 172.21.15.49:52204) 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d3fff700 1 -- 172.21.15.49:0/3934388311 learned_addr learned my addr 172.21.15.49:0/3934388311 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d89de700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d40f5c50 0x7ff5d41081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d3fff700 1 -- 172.21.15.49:0/3934388311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d40f5c50 msgr2=0x7ff5d41081c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d3fff700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d40f5c50 0x7ff5d41081c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d3fff700 1 -- 172.21.15.49:0/3934388311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c0005040 con 0x7ff5d40f65f0 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d89de700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d40f5c50 0x7ff5d41081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.231+0000 7ff5d3fff700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 0x7ff5d41086b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ff5c0013580 tx=0x7ff5c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:11.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.232+0000 7ff5d1ffb700 1 -- 172.21.15.49:0/3934388311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c0018070 con 0x7ff5d40f65f0 2024-02-22T00:30:11.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.232+0000 7ff5d1ffb700 1 -- 172.21.15.49:0/3934388311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff5c0007e90 con 0x7ff5d40f65f0 2024-02-22T00:30:11.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.232+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d410d7e0 con 0x7ff5d40f65f0 2024-02-22T00:30:11.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.232+0000 7ff5d1ffb700 1 -- 172.21.15.49:0/3934388311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c00123c0 con 0x7ff5d40f65f0 2024-02-22T00:30:11.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.232+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d410dda0 con 0x7ff5d40f65f0 2024-02-22T00:30:11.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.233+0000 7ff5d1ffb700 1 -- 172.21.15.49:0/3934388311 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ff5c001d420 con 0x7ff5d40f65f0 2024-02-22T00:30:11.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.233+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d4100100 con 0x7ff5d40f65f0 2024-02-22T00:30:11.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.233+0000 7ff5d1ffb700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5c4061180 0x7ff5c4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:11.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.234+0000 7ff5d1ffb700 1 -- 172.21.15.49:0/3934388311 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7ff5c007d270 con 0x7ff5d40f65f0 2024-02-22T00:30:11.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.234+0000 7ff5d89de700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5c4061180 0x7ff5c4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:11.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.234+0000 7ff5d89de700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5c4061180 0x7ff5c4063640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff5c8007fd0 tx=0x7ff5c800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:11.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.238+0000 7ff5d1ffb700 1 -- 172.21.15.49:0/3934388311 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff5c0051480 con 0x7ff5d40f65f0 2024-02-22T00:30:11.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.407+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5d4059120 con 0x7ff5c4061180 2024-02-22T00:30:11.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.409+0000 7ff5d1ffb700 1 -- 172.21.15.49:0/3934388311 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27536 (secure 0 0 0) 0x7ff5d4059120 con 0x7ff5c4061180 2024-02-22T00:30:11.413 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5c4061180 msgr2=0x7ff5c4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5c4061180 0x7ff5c4063640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff5c8007fd0 tx=0x7ff5c800b040).stop 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 msgr2=0x7ff5d41086b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 0x7ff5d41086b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7ff5c0013580 tx=0x7ff5c0009cb0).stop 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 shutdown_connections 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5c4061180 0x7ff5c4063640 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d40f5c50 0x7ff5d41081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 --2- 172.21.15.49:0/3934388311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5d40f65f0 0x7ff5d41086b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:11.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 >> 172.21.15.49:0/3934388311 conn(0x7ff5d40f1770 msgr2=0x7ff5d40fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:11.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 shutdown_connections 2024-02-22T00:30:11.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:11.411+0000 7ff5dac42700 1 -- 172.21.15.49:0/3934388311 wait complete. 2024-02-22T00:30:11.415 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-02-22T00:30:11.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:09.793749+0000 mgr.smithi049.rjblpr (mgr.14194) 174 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:11.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:09.793749+0000 mgr.smithi049.rjblpr (mgr.14194) 174 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:12.177 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-02-22T00:30:09.793580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1784568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":1782528,"kb_avail":560686344,"statfs":{"total":575970213888,"available":574142816256,"internally_reserved":0,"allocated":2039808,"data_stored":762216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1825308672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-22T00:29:16.945792+0000","last_change":"2024-02-22T00:28:53.621230+0000","last_active":"2024-02-22T00:29:16.945792+0000","last_peered":"2024-02-22T00:29:16.945792+0000","last_clean":"2024-02-22T00:29:16.945792+0000","last_became_active":"2024-02-22T00:28:53.620892+0000","last_became_peered":"2024-02-22T00:28:53.620892+0000","last_unstale":"2024-02-22T00:29:16.945792+0000","last_undegraded":"2024-02-22T00:29:16.945792+0000","last_fullsized":"2024-02-22T00:29:16.945792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T00:28:04.199616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T00:28:04.199616+0000","last_clean_scrub_stamp":"2024-02-22T00:28:04.199616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 00:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.628},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Feb 22 00:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Feb 22 00:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Feb 22 00:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 00:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.443}]},{"osd":1,"last update":"Thu Feb 22 00:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Feb 22 00:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Feb 22 00:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.34599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 00:30:06 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.377,"15min":0.377},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Feb 22 00:30:06 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.374,"15min":0.375},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51600000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.39500000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Feb 22 00:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Feb 22 00:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 22 00:29:38 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32300000000000001,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.40699999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.312,"15min":0.309},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Feb 22 00:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.377},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Feb 22 00:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.5}]},{"osd":4,"last update":"Thu Feb 22 00:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.442},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 00:29:38 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.48799999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.219,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Feb 22 00:29:04 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.316}]},{"osd":3,"last update":"Thu Feb 22 00:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.442},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Feb 22 00:29:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-22T00:30:12.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph pg dump --format=json 2024-02-22T00:30:12.458 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:30:13.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:11.409399+0000 mgr.smithi049.rjblpr (mgr.14194) 175 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T00:30:13.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:11.794209+0000 mgr.smithi049.rjblpr (mgr.14194) 176 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:13.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:11.409399+0000 mgr.smithi049.rjblpr (mgr.14194) 175 : audit [DBG] from='client.14394 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T00:30:13.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:11.794209+0000 mgr.smithi049.rjblpr (mgr.14194) 176 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.118+0000 7f8130da2700 1 -- 172.21.15.49:0/2291565596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 msgr2=0x7f812c0f8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.118+0000 7f8130da2700 1 --2- 172.21.15.49:0/2291565596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 0x7f812c0f8060 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f81140047f0 tx=0x7f8114009cb0).stop 2024-02-22T00:30:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.118+0000 7f8130da2700 1 -- 172.21.15.49:0/2291565596 shutdown_connections 2024-02-22T00:30:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.118+0000 7f8130da2700 1 --2- 172.21.15.49:0/2291565596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f812c0f6940 0x7f812c0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.118+0000 7f8130da2700 1 --2- 172.21.15.49:0/2291565596 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 0x7f812c0f8060 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.118+0000 7f8130da2700 1 -- 172.21.15.49:0/2291565596 >> 172.21.15.49:0/2291565596 conn(0x7f812c0f1570 msgr2=0x7f812c0f3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.118+0000 7f8130da2700 1 -- 172.21.15.49:0/2291565596 shutdown_connections 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.119+0000 7f8130da2700 1 -- 172.21.15.49:0/2291565596 wait complete. 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.119+0000 7f8130da2700 1 Processor -- start 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.119+0000 7f8130da2700 1 -- start start 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.119+0000 7f8130da2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f812c0f6940 0x7f812c107f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.119+0000 7f8130da2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 0x7f812c108410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f8130da2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c1089c0 con 0x7f812c0f7c40 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f8130da2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c108b00 con 0x7f812c0f6940 2024-02-22T00:30:14.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 0x7f812c108410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 0x7f812c108410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43638/0 (socket says 172.21.15.49:43638) 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812affd700 1 -- 172.21.15.49:0/4119214742 learned_addr learned my addr 172.21.15.49:0/4119214742 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812b7fe700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f812c0f6940 0x7f812c107f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812affd700 1 -- 172.21.15.49:0/4119214742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f812c0f6940 msgr2=0x7f812c107f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812affd700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f812c0f6940 0x7f812c107f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812affd700 1 -- 172.21.15.49:0/4119214742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114005040 con 0x7f812c0f7c40 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812b7fe700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f812c0f6940 0x7f812c107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f812affd700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 0x7f812c108410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f811c00c790 tx=0x7f811c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f8128ff9700 1 -- 172.21.15.49:0/4119214742 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f811c00e680 con 0x7f812c0f7c40 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f8128ff9700 1 -- 172.21.15.49:0/4119214742 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f811c00ec70 con 0x7f812c0f7c40 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c1094a0 con 0x7f812c0f7c40 2024-02-22T00:30:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f8128ff9700 1 -- 172.21.15.49:0/4119214742 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f811c013db0 con 0x7f812c0f7c40 2024-02-22T00:30:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.120+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c1099e0 con 0x7f812c0f7c40 2024-02-22T00:30:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.121+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c046ce0 con 0x7f812c0f7c40 2024-02-22T00:30:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.122+0000 7f8128ff9700 1 -- 172.21.15.49:0/4119214742 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f811c00e7e0 con 0x7f812c0f7c40 2024-02-22T00:30:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.122+0000 7f8128ff9700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f81180611d0 0x7f8118063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.122+0000 7f8128ff9700 1 -- 172.21.15.49:0/4119214742 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f811c07c7a0 con 0x7f812c0f7c40 2024-02-22T00:30:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.122+0000 7f812b7fe700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f81180611d0 0x7f8118063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.123+0000 7f812b7fe700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f81180611d0 0x7f8118063690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8114013470 tx=0x7f811400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:14.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.126+0000 7f8128ff9700 1 -- 172.21.15.49:0/4119214742 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f811c050a70 con 0x7f812c0f7c40 2024-02-22T00:30:14.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.294+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f812c0fbd90 con 0x7f81180611d0 2024-02-22T00:30:14.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.295+0000 7f8128ff9700 1 -- 172.21.15.49:0/4119214742 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27487 (secure 0 0 0) 0x7f812c0fbd90 con 0x7f81180611d0 2024-02-22T00:30:14.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f81180611d0 msgr2=0x7f8118063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f81180611d0 0x7f8118063690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8114013470 tx=0x7f811400b040).stop 2024-02-22T00:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 msgr2=0x7f812c108410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:14.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 0x7f812c108410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f811c00c790 tx=0x7f811c007f10).stop 2024-02-22T00:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 shutdown_connections 2024-02-22T00:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f81180611d0 0x7f8118063690 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f812c0f6940 0x7f812c107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 --2- 172.21.15.49:0/4119214742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f812c0f7c40 0x7f812c108410 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 >> 172.21.15.49:0/4119214742 conn(0x7f812c0f1570 msgr2=0x7f812c0f6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 shutdown_connections 2024-02-22T00:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:14.297+0000 7f8130da2700 1 -- 172.21.15.49:0/4119214742 wait complete. 2024-02-22T00:30:14.300 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-02-22T00:30:14.907 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-02-22T00:30:13.794686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1784568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":1782528,"kb_avail":560686344,"statfs":{"total":575970213888,"available":574142816256,"internally_reserved":0,"allocated":2039808,"data_stored":762216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1825308672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-02-22T00:29:16.945792+0000","last_change":"2024-02-22T00:28:53.621230+0000","last_active":"2024-02-22T00:29:16.945792+0000","last_peered":"2024-02-22T00:29:16.945792+0000","last_clean":"2024-02-22T00:29:16.945792+0000","last_became_active":"2024-02-22T00:28:53.620892+0000","last_became_peered":"2024-02-22T00:28:53.620892+0000","last_unstale":"2024-02-22T00:29:16.945792+0000","last_undegraded":"2024-02-22T00:29:16.945792+0000","last_fullsized":"2024-02-22T00:29:16.945792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T00:28:04.199616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T00:28:04.199616+0000","last_clean_scrub_stamp":"2024-02-22T00:28:04.199616+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 00:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.628},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Feb 22 00:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Feb 22 00:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Feb 22 00:29:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 00:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.37}]},{"osd":1,"last update":"Thu Feb 22 00:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Feb 22 00:29:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.378}]},{"osd":4,"last update":"Thu Feb 22 00:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.30299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 00:30:06 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.377,"15min":0.377},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu Feb 22 00:30:06 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.374,"15min":0.375},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51600000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.39400000000000002,"15min":0.39500000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Feb 22 00:29:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Feb 22 00:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 22 00:29:38 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.32300000000000001,"15min":0.32400000000000001},"min":{"1min":0.24299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.40699999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.312,"15min":0.309},"min":{"1min":0.26100000000000001,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.499}]},{"osd":2,"last update":"Thu Feb 22 00:30:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.375,"15min":0.378},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.47399999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Feb 22 00:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Feb 22 00:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 00:29:38 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.32400000000000001,"15min":0.32200000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.48799999999999999,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.32800000000000001},"min":{"1min":0.219,"5min":0.216,"15min":0.216},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Feb 22 00:30:09 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.371,"15min":0.377},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.55200000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.309},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.38300000000000001,"15min":0.38900000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Feb 22 00:29:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Feb 22 00:29:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-22T00:30:14.908 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-22T00:30:14.909 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-22T00:30:14.909 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-22T00:30:14.909 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph health --format=json 2024-02-22T00:30:15.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:13.794829+0000 mgr.smithi049.rjblpr (mgr.14194) 177 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:15.190 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:30:15.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:13.794829+0000 mgr.smithi049.rjblpr (mgr.14194) 177 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:16.388 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:14.294635+0000 mgr.smithi049.rjblpr (mgr.14194) 178 : audit [DBG] from='client.14398 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T00:30:16.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:14.294635+0000 mgr.smithi049.rjblpr (mgr.14194) 178 : audit [DBG] from='client.14398 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T00:30:16.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.911+0000 7f6f63273700 1 -- 172.21.15.49:0/3026861402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f8c40 msgr2=0x7f6f5c0f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:16.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.911+0000 7f6f63273700 1 --2- 172.21.15.49:0/3026861402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f8c40 0x7f6f5c0f90a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f6f4c0047f0 tx=0x7f6f4c009cb0).stop 2024-02-22T00:30:16.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.911+0000 7f6f63273700 1 -- 172.21.15.49:0/3026861402 shutdown_connections 2024-02-22T00:30:16.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.911+0000 7f6f63273700 1 --2- 172.21.15.49:0/3026861402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f8c40 0x7f6f5c0f90a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:16.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.911+0000 7f6f63273700 1 --2- 172.21.15.49:0/3026861402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0f79a0 0x7f6f5c0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:30:16.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.911+0000 7f6f63273700 1 -- 172.21.15.49:0/3026861402 >> 172.21.15.49:0/3026861402 conn(0x7f6f5c0f3100 msgr2=0x7f6f5c0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:16.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.911+0000 7f6f63273700 1 -- 172.21.15.49:0/3026861402 shutdown_connections 2024-02-22T00:30:16.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.911+0000 7f6f63273700 1 -- 172.21.15.49:0/3026861402 wait complete. 2024-02-22T00:30:16.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.912+0000 7f6f63273700 1 Processor -- start 2024-02-22T00:30:16.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.912+0000 7f6f63273700 1 -- start start 2024-02-22T00:30:16.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.912+0000 7f6f63273700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f79a0 0x7f6f5c108130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:16.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.912+0000 7f6f63273700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0f8c40 0x7f6f5c108620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:16.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.912+0000 7f6f63273700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c108c60 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.912+0000 7f6f63273700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c108da0 con 0x7f6f5c0f8c40 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.912+0000 7f6f6100f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f79a0 0x7f6f5c108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f6100f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f79a0 0x7f6f5c108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43654/0 (socket says 172.21.15.49:43654) 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f6100f700 1 -- 172.21.15.49:0/3168454117 learned_addr learned my addr 172.21.15.49:0/3168454117 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f6100f700 1 -- 172.21.15.49:0/3168454117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0f8c40 msgr2=0x7f6f5c108620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f6080e700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0f8c40 0x7f6f5c108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f6100f700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0f8c40 0x7f6f5c108620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f6100f700 1 -- 172.21.15.49:0/3168454117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c005040 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f6100f700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f79a0 0x7f6f5c108130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6f5800b480 tx=0x7f6f580090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:16.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f52777700 1 -- 172.21.15.49:0/3168454117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f58002500 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f52777700 1 -- 172.21.15.49:0/3168454117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f6f58002af0 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c10d840 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f52777700 1 -- 172.21.15.49:0/3168454117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f58012c40 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.913+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c10dd80 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.914+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c100190 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.915+0000 7f6f52777700 1 -- 172.21.15.49:0/3168454117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f6f58002660 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.915+0000 7f6f52777700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6f48061180 0x7f6f48063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:16.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.915+0000 7f6f52777700 1 -- 172.21.15.49:0/3168454117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f6f5807c4f0 con 0x7f6f5c0f79a0 2024-02-22T00:30:16.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.915+0000 7f6f6080e700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6f48061180 0x7f6f48063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:16.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.916+0000 7f6f6080e700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6f48061180 0x7f6f48063640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6f4c004f10 tx=0x7f6f4c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:16.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:16.920+0000 7f6f52777700 1 -- 172.21.15.49:0/3168454117 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6f58050840 con 0x7f6f5c0f79a0 2024-02-22T00:30:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.130+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6f5c0598f0 con 0x7f6f5c0f79a0 2024-02-22T00:30:17.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.130+0000 7f6f52777700 1 -- 172.21.15.49:0/3168454117 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f6f58050430 con 0x7f6f5c0f79a0 2024-02-22T00:30:17.133 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6f48061180 msgr2=0x7f6f48063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6f48061180 0x7f6f48063640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f6f4c004f10 tx=0x7f6f4c00b040).stop 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f79a0 msgr2=0x7f6f5c108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f79a0 0x7f6f5c108130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6f5800b480 tx=0x7f6f580090f0).stop 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 shutdown_connections 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f5c0f79a0 0x7f6f5c108130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6f48061180 0x7f6f48063640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 --2- 172.21.15.49:0/3168454117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5c0f8c40 0x7f6f5c108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 >> 172.21.15.49:0/3168454117 conn(0x7f6f5c0f3100 msgr2=0x7f6f5c0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 shutdown_connections 2024-02-22T00:30:17.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:17.132+0000 7f6f63273700 1 -- 172.21.15.49:0/3168454117 wait complete. 2024-02-22T00:30:17.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:15.795133+0000 mgr.smithi049.rjblpr (mgr.14194) 179 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:17.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:15.795133+0000 mgr.smithi049.rjblpr (mgr.14194) 179 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:17.782 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-22T00:30:17.782 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-22T00:30:17.782 INFO:tasks.cephadm:Setup complete, yielding 2024-02-22T00:30:17.783 INFO:teuthology.run_tasks:Running task print... 2024-02-22T00:30:17.793 INFO:teuthology.task.print:**** done end installing pacific cephadm ... 2024-02-22T00:30:17.793 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T00:30:17.801 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:30:17.801 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-22T00:30:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:17.131401+0000 mon.smithi049 (mon.0) 508 : audit [DBG] from='client.? 172.21.15.49:0/3168454117' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T00:30:18.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:17.131401+0000 mon.smithi049 (mon.0) 508 : audit [DBG] from='client.? 172.21.15.49:0/3168454117' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T00:30:19.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:17.795440+0000 mgr.smithi049.rjblpr (mgr.14194) 180 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:17.795440+0000 mgr.smithi049.rjblpr (mgr.14194) 180 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.750+0000 7fe51049c700 1 -- 172.21.15.49:0/1887565522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f7800 msgr2=0x7fe5080f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.750+0000 7fe51049c700 1 --2- 172.21.15.49:0/1887565522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f7800 0x7fe5080f7c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fe4f80047f0 tx=0x7fe4f8009cb0).stop 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.750+0000 7fe51049c700 1 -- 172.21.15.49:0/1887565522 shutdown_connections 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.750+0000 7fe51049c700 1 --2- 172.21.15.49:0/1887565522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5080f8aa0 0x7fe5080f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.750+0000 7fe51049c700 1 --2- 172.21.15.49:0/1887565522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f7800 0x7fe5080f7c20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.750+0000 7fe51049c700 1 -- 172.21.15.49:0/1887565522 >> 172.21.15.49:0/1887565522 conn(0x7fe5080f2f80 msgr2=0x7fe5080f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.750+0000 7fe51049c700 1 -- 172.21.15.49:0/1887565522 shutdown_connections 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.750+0000 7fe51049c700 1 -- 172.21.15.49:0/1887565522 wait complete. 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe51049c700 1 Processor -- start 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe51049c700 1 -- start start 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe51049c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5080f7800 0x7fe508107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:19.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe51049c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f8aa0 0x7fe508108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe51049c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508108a00 con 0x7fe5080f8aa0 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe51049c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508108b40 con 0x7fe5080f7800 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe50da37700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f8aa0 0x7fe508108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe50da37700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f8aa0 0x7fe508108450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43670/0 (socket says 172.21.15.49:43670) 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe50da37700 1 -- 172.21.15.49:0/4088455466 learned_addr learned my addr 172.21.15.49:0/4088455466 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe50e238700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5080f7800 0x7fe508107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe50da37700 1 -- 172.21.15.49:0/4088455466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5080f7800 msgr2=0x7fe508107f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe50da37700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5080f7800 0x7fe508107f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.751+0000 7fe50da37700 1 -- 172.21.15.49:0/4088455466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8005040 con 0x7fe5080f8aa0 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.752+0000 7fe50da37700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f8aa0 0x7fe508108450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fe5040041d0 tx=0x7fe504009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.752+0000 7fe4ff7fe700 1 -- 172.21.15.49:0/4088455466 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe504007b40 con 0x7fe5080f8aa0 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.752+0000 7fe4ff7fe700 1 -- 172.21.15.49:0/4088455466 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe50400f040 con 0x7fe5080f8aa0 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.752+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50810d5e0 con 0x7fe5080f8aa0 2024-02-22T00:30:19.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.752+0000 7fe4ff7fe700 1 -- 172.21.15.49:0/4088455466 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5040146f0 con 0x7fe5080f8aa0 2024-02-22T00:30:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.752+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50810db20 con 0x7fe5080f8aa0 2024-02-22T00:30:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.753+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5080fffc0 con 0x7fe5080f8aa0 2024-02-22T00:30:19.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.753+0000 7fe4ff7fe700 1 -- 172.21.15.49:0/4088455466 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fe504009110 con 0x7fe5080f8aa0 2024-02-22T00:30:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.753+0000 7fe4ff7fe700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe4f4061180 0x7fe4f4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.754+0000 7fe4ff7fe700 1 -- 172.21.15.49:0/4088455466 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fe50407c4e0 con 0x7fe5080f8aa0 2024-02-22T00:30:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.754+0000 7fe50e238700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe4f4061180 0x7fe4f4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:19.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.754+0000 7fe50e238700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe4f4061180 0x7fe4f4063640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe4f8004f10 tx=0x7fe4f800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:19.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.758+0000 7fe4ff7fe700 1 -- 172.21.15.49:0/4088455466 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe504050830 con 0x7fe5080f8aa0 2024-02-22T00:30:19.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.928+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fe5080598f0 con 0x7fe5080f8aa0 2024-02-22T00:30:19.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.932+0000 7fe4ff7fe700 1 -- 172.21.15.49:0/4088455466 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fe504050420 con 0x7fe5080f8aa0 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe4f4061180 msgr2=0x7fe4f4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe4f4061180 0x7fe4f4063640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe4f8004f10 tx=0x7fe4f800b040).stop 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f8aa0 msgr2=0x7fe508108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f8aa0 0x7fe508108450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fe5040041d0 tx=0x7fe504009f60).stop 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 shutdown_connections 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe4f4061180 0x7fe4f4063640 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5080f7800 0x7fe508107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 --2- 172.21.15.49:0/4088455466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5080f8aa0 0x7fe508108450 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:19.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 >> 172.21.15.49:0/4088455466 conn(0x7fe5080f2f80 msgr2=0x7fe5080fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 shutdown_connections 2024-02-22T00:30:19.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:19.934+0000 7fe51049c700 1 -- 172.21.15.49:0/4088455466 wait complete. 2024-02-22T00:30:20.628 INFO:teuthology.run_tasks:Running task print... 2024-02-22T00:30:20.638 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-22T00:30:20.638 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T00:30:20.662 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:30:20.662 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph orch status' 2024-02-22T00:30:21.281 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:19.795713+0000 mgr.smithi049.rjblpr (mgr.14194) 181 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:21.281 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:19.933307+0000 mon.smithi049 (mon.0) 509 : audit [INF] from='client.? 172.21.15.49:0/4088455466' entity='client.admin' 2024-02-22T00:30:21.281 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:19.988171+0000 mon.smithi049 (mon.0) 510 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:30:21.281 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:20.308345+0000 mon.smithi049 (mon.0) 511 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:21.281 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:20.309022+0000 mon.smithi049 (mon.0) 512 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:30:21.282 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:20.313083+0000 mon.smithi049 (mon.0) 513 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:19.795713+0000 mgr.smithi049.rjblpr (mgr.14194) 181 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:19.933307+0000 mon.smithi049 (mon.0) 509 : audit [INF] from='client.? 172.21.15.49:0/4088455466' entity='client.admin' 2024-02-22T00:30:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:19.988171+0000 mon.smithi049 (mon.0) 510 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:30:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:20.308345+0000 mon.smithi049 (mon.0) 511 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:20.309022+0000 mon.smithi049 (mon.0) 512 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:30:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:20.313083+0000 mon.smithi049 (mon.0) 513 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:22.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 -- 172.21.15.49:0/1829096791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc0061280 msgr2=0x7fccc00fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 --2- 172.21.15.49:0/1829096791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc0061280 0x7fccc00fa3d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fccb40047f0 tx=0x7fccb4009cb0).stop 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 -- 172.21.15.49:0/1829096791 shutdown_connections 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 --2- 172.21.15.49:0/1829096791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccc00fa950 0x7fccc00fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 --2- 172.21.15.49:0/1829096791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc0061280 0x7fccc00fa3d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 -- 172.21.15.49:0/1829096791 >> 172.21.15.49:0/1829096791 conn(0x7fccc00f1e50 msgr2=0x7fccc00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 -- 172.21.15.49:0/1829096791 shutdown_connections 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 -- 172.21.15.49:0/1829096791 wait complete. 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.548+0000 7fccc5771700 1 Processor -- start 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccc5771700 1 -- start start 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccc5771700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccc0061280 0x7fccc0107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:22.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccc5771700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc00fa950 0x7fccc0108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccc5771700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc0108a00 con 0x7fccc00fa950 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccc5771700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc0108b40 con 0x7fccc0061280 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc00fa950 0x7fccc0108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc00fa950 0x7fccc0108450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49216/0 (socket says 172.21.15.49:49216) 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbe7fc700 1 -- 172.21.15.49:0/3769642380 learned_addr learned my addr 172.21.15.49:0/3769642380 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbeffd700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccc0061280 0x7fccc0107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbe7fc700 1 -- 172.21.15.49:0/3769642380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccc0061280 msgr2=0x7fccc0107f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbe7fc700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccc0061280 0x7fccc0107f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbe7fc700 1 -- 172.21.15.49:0/3769642380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4005040 con 0x7fccc00fa950 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbeffd700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccc0061280 0x7fccc0107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccbe7fc700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc00fa950 0x7fccc0108450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fccb0002780 tx=0x7fccb0009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fcca7fff700 1 -- 172.21.15.49:0/3769642380 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb0007b40 con 0x7fccc00fa950 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc010d5e0 con 0x7fccc00fa950 2024-02-22T00:30:22.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fcca7fff700 1 -- 172.21.15.49:0/3769642380 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fccb000f040 con 0x7fccc00fa950 2024-02-22T00:30:22.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.549+0000 7fcca7fff700 1 -- 172.21.15.49:0/3769642380 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb00146f0 con 0x7fccc00fa950 2024-02-22T00:30:22.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.550+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc010db20 con 0x7fccc00fa950 2024-02-22T00:30:22.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.550+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac005150 con 0x7fccc00fa950 2024-02-22T00:30:22.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.551+0000 7fcca7fff700 1 -- 172.21.15.49:0/3769642380 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fccb00149c0 con 0x7fccc00fa950 2024-02-22T00:30:22.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.551+0000 7fcca7fff700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcca8061180 0x7fcca8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:22.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.551+0000 7fcca7fff700 1 -- 172.21.15.49:0/3769642380 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fccb007c400 con 0x7fccc00fa950 2024-02-22T00:30:22.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.551+0000 7fccbeffd700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcca8061180 0x7fcca8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:22.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.552+0000 7fccbeffd700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcca8061180 0x7fcca8063640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fccb4013470 tx=0x7fccb400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:22.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.555+0000 7fcca7fff700 1 -- 172.21.15.49:0/3769642380 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fccb00506f0 con 0x7fccc00fa950 2024-02-22T00:30:22.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.743+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccac000bf0 con 0x7fcca8061180 2024-02-22T00:30:22.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.744+0000 7fcca7fff700 1 -- 172.21.15.49:0/3769642380 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fccac000bf0 con 0x7fcca8061180 2024-02-22T00:30:22.747 INFO:teuthology.orchestra.run.smithi049.stdout:Backend: cephadm 2024-02-22T00:30:22.747 INFO:teuthology.orchestra.run.smithi049.stdout:Available: Yes 2024-02-22T00:30:22.747 INFO:teuthology.orchestra.run.smithi049.stdout:Paused: No 2024-02-22T00:30:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcca8061180 msgr2=0x7fcca8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcca8061180 0x7fcca8063640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fccb4013470 tx=0x7fccb400b040).stop 2024-02-22T00:30:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc00fa950 msgr2=0x7fccc0108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc00fa950 0x7fccc0108450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fccb0002780 tx=0x7fccb0009ee0).stop 2024-02-22T00:30:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 shutdown_connections 2024-02-22T00:30:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fcca8061180 0x7fcca8063640 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:22.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccc0061280 0x7fccc0107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 --2- 172.21.15.49:0/3769642380 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fccc00fa950 0x7fccc0108450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 >> 172.21.15.49:0/3769642380 conn(0x7fccc00f1e50 msgr2=0x7fccc00f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 shutdown_connections 2024-02-22T00:30:22.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:22.746+0000 7fccc5771700 1 -- 172.21.15.49:0/3769642380 wait complete. 2024-02-22T00:30:23.081 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:21.796186+0000 mgr.smithi049.rjblpr (mgr.14194) 182 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:21.796186+0000 mgr.smithi049.rjblpr (mgr.14194) 182 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:23.417 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-22T00:30:24.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:22.745573+0000 mgr.smithi049.rjblpr (mgr.14194) 183 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:22.745573+0000 mgr.smithi049.rjblpr (mgr.14194) 183 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:25.136 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:23.796482+0000 mgr.smithi049.rjblpr (mgr.14194) 184 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:25.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:23.796482+0000 mgr.smithi049.rjblpr (mgr.14194) 184 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.366+0000 7f9d2857b700 1 -- 172.21.15.49:0/3131680053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d200fa9b0 msgr2=0x7f9d200fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.366+0000 7f9d2857b700 1 --2- 172.21.15.49:0/3131680053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d200fa9b0 0x7f9d200fcda0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f9d100047f0 tx=0x7f9d10009cb0).stop 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.366+0000 7f9d2857b700 1 -- 172.21.15.49:0/3131680053 shutdown_connections 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.366+0000 7f9d2857b700 1 --2- 172.21.15.49:0/3131680053 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d200fa9b0 0x7f9d200fcda0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.366+0000 7f9d2857b700 1 --2- 172.21.15.49:0/3131680053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d20061220 0x7f9d200fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.366+0000 7f9d2857b700 1 -- 172.21.15.49:0/3131680053 >> 172.21.15.49:0/3131680053 conn(0x7f9d200f1e50 msgr2=0x7f9d200f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.366+0000 7f9d2857b700 1 -- 172.21.15.49:0/3131680053 shutdown_connections 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.366+0000 7f9d2857b700 1 -- 172.21.15.49:0/3131680053 wait complete. 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d2857b700 1 Processor -- start 2024-02-22T00:30:25.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d2857b700 1 -- start start 2024-02-22T00:30:25.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d2857b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20061220 0x7f9d200f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d2857b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d200fa9b0 0x7f9d200f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d2857b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200f8280 con 0x7f9d20061220 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d2857b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200f6820 con 0x7f9d200fa9b0 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d26317700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20061220 0x7f9d200f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d26317700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20061220 0x7f9d200f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49234/0 (socket says 172.21.15.49:49234) 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d26317700 1 -- 172.21.15.49:0/316034840 learned_addr learned my addr 172.21.15.49:0/316034840 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.367+0000 7f9d25b16700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d200fa9b0 0x7f9d200f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d26317700 1 -- 172.21.15.49:0/316034840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d200fa9b0 msgr2=0x7f9d200f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d26317700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d200fa9b0 0x7f9d200f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d26317700 1 -- 172.21.15.49:0/316034840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d10005040 con 0x7f9d20061220 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d26317700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20061220 0x7f9d200f7cd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9d1c00dad0 tx=0x7f9d1c004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d177fe700 1 -- 172.21.15.49:0/316034840 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1c00b750 con 0x7f9d20061220 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d200f6aa0 con 0x7f9d20061220 2024-02-22T00:30:25.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d177fe700 1 -- 172.21.15.49:0/316034840 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9d1c00f040 con 0x7f9d20061220 2024-02-22T00:30:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d177fe700 1 -- 172.21.15.49:0/316034840 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1c013b60 con 0x7f9d20061220 2024-02-22T00:30:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.368+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d200f6fe0 con 0x7f9d20061220 2024-02-22T00:30:25.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.369+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d200fffb0 con 0x7f9d20061220 2024-02-22T00:30:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.369+0000 7f9d177fe700 1 -- 172.21.15.49:0/316034840 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9d1c013ce0 con 0x7f9d20061220 2024-02-22T00:30:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.370+0000 7f9d177fe700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9d0c061180 0x7f9d0c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.370+0000 7f9d177fe700 1 -- 172.21.15.49:0/316034840 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f9d1c07beb0 con 0x7f9d20061220 2024-02-22T00:30:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.370+0000 7f9d25b16700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9d0c061180 0x7f9d0c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:25.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.370+0000 7f9d25b16700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9d0c061180 0x7f9d0c063640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9d10013470 tx=0x7f9d10009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:25.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.374+0000 7f9d177fe700 1 -- 172.21.15.49:0/316034840 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9d1c049f60 con 0x7f9d20061220 2024-02-22T00:30:25.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.555+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d20059120 con 0x7f9d0c061180 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.563+0000 7f9d177fe700 1 -- 172.21.15.49:0/316034840 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2700 (secure 0 0 0) 0x7f9d20059120 con 0x7f9d0c061180 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (3m) 2m ago 4m 15.4M - 0.23.0 ba2b418f427c 05fc98ae8941 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (4m) 2m ago 4m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (4m) 67s ago 4m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (3m) 2m ago 4m 44.4M - 8.3.5 dad864ee21e9 d07a1ce3ae93 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:9283 running (6m) 2m ago 6m 425M - 16.2.14-550-geb66ed92 7403d1862307 c15a70e0a1be 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 running (4m) 67s ago 4m 385M - 16.2.14-550-geb66ed92 7403d1862307 dbe4d534c748 2024-02-22T00:30:25.566 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (6m) 2m ago 6m 47.8M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (4m) 67s ago 4m 53.4M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (4m) 2m ago 4m 20.1M - 1.3.1 1dbe0e931976 22b6c923dd53 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (3m) 67s ago 3m 21.7M - 1.3.1 1dbe0e931976 3bd6815e682e 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (3m) 2m ago 3m 34.1M 4640M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (2m) 2m ago 2m 33.6M 4640M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (2m) 2m ago 2m 13.5M 4640M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (2m) 67s ago 2m 35.5M 4982M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (99s) 67s ago 99s 34.4M 4982M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (73s) 67s ago 72s 10.5M 4982M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:30:25.567 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (3m) 67s ago 3m 55.8M - 2.33.4 514e6a882f6e 0880324bb723 2024-02-22T00:30:25.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9d0c061180 msgr2=0x7f9d0c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:25.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9d0c061180 0x7f9d0c063640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9d10013470 tx=0x7f9d10009cb0).stop 2024-02-22T00:30:25.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20061220 msgr2=0x7f9d200f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:25.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20061220 0x7f9d200f7cd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9d1c00dad0 tx=0x7f9d1c004ee0).stop 2024-02-22T00:30:25.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 shutdown_connections 2024-02-22T00:30:25.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d20061220 0x7f9d200f7cd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:25.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9d0c061180 0x7f9d0c063640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:25.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 --2- 172.21.15.49:0/316034840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d200fa9b0 0x7f9d200f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:25.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 >> 172.21.15.49:0/316034840 conn(0x7f9d200f1e50 msgr2=0x7f9d200f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:25.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 shutdown_connections 2024-02-22T00:30:25.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:25.565+0000 7f9d2857b700 1 -- 172.21.15.49:0/316034840 wait complete. 2024-02-22T00:30:26.310 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-22T00:30:27.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:25.556945+0000 mgr.smithi049.rjblpr (mgr.14194) 185 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:27.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:25.796941+0000 mgr.smithi049.rjblpr (mgr.14194) 186 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:25.556945+0000 mgr.smithi049.rjblpr (mgr.14194) 185 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:27.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:25.796941+0000 mgr.smithi049.rjblpr (mgr.14194) 186 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:28.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.197+0000 7f4adfae7700 1 -- 172.21.15.49:0/787036329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f66f0 msgr2=0x7f4ad80f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.197+0000 7f4adfae7700 1 --2- 172.21.15.49:0/787036329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f66f0 0x7f4ad80f6b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f4ac80047f0 tx=0x7f4ac8009cb0).stop 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.197+0000 7f4adfae7700 1 -- 172.21.15.49:0/787036329 shutdown_connections 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.197+0000 7f4adfae7700 1 --2- 172.21.15.49:0/787036329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ad80f7990 0x7f4ad80f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.197+0000 7f4adfae7700 1 --2- 172.21.15.49:0/787036329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f66f0 0x7f4ad80f6b10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.197+0000 7f4adfae7700 1 -- 172.21.15.49:0/787036329 >> 172.21.15.49:0/787036329 conn(0x7f4ad80f1e50 msgr2=0x7f4ad80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.197+0000 7f4adfae7700 1 -- 172.21.15.49:0/787036329 shutdown_connections 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.197+0000 7f4adfae7700 1 -- 172.21.15.49:0/787036329 wait complete. 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4adfae7700 1 Processor -- start 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4adfae7700 1 -- start start 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4adfae7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ad80f66f0 0x7f4ad8107f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4adfae7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f7990 0x7f4ad8108460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4adfae7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8108a10 con 0x7f4ad80f7990 2024-02-22T00:30:28.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4adfae7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8108b50 con 0x7f4ad80f66f0 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4add082700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f7990 0x7f4ad8108460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4add082700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f7990 0x7f4ad8108460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49244/0 (socket says 172.21.15.49:49244) 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4add082700 1 -- 172.21.15.49:0/2475604714 learned_addr learned my addr 172.21.15.49:0/2475604714 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4add883700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ad80f66f0 0x7f4ad8107f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4add082700 1 -- 172.21.15.49:0/2475604714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ad80f66f0 msgr2=0x7f4ad8107f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4add082700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ad80f66f0 0x7f4ad8107f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.198+0000 7f4add082700 1 -- 172.21.15.49:0/2475604714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac8005040 con 0x7f4ad80f7990 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.199+0000 7f4add082700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f7990 0x7f4ad8108460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f4ad40041d0 tx=0x7f4ad4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.199+0000 7f4acef78700 1 -- 172.21.15.49:0/2475604714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad4007b40 con 0x7f4ad80f7990 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.199+0000 7f4acef78700 1 -- 172.21.15.49:0/2475604714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4ad400f040 con 0x7f4ad80f7990 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.199+0000 7f4acef78700 1 -- 172.21.15.49:0/2475604714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad40146f0 con 0x7f4ad80f7990 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.199+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad810d5f0 con 0x7f4ad80f7990 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.199+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad810db30 con 0x7f4ad80f7990 2024-02-22T00:30:28.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.200+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad80feeb0 con 0x7f4ad80f7990 2024-02-22T00:30:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.200+0000 7f4acef78700 1 -- 172.21.15.49:0/2475604714 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f4ad4009110 con 0x7f4ad80f7990 2024-02-22T00:30:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.200+0000 7f4acef78700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4ac4061180 0x7f4ac4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.201+0000 7f4acef78700 1 -- 172.21.15.49:0/2475604714 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f4ad407c560 con 0x7f4ad80f7990 2024-02-22T00:30:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.201+0000 7f4add883700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4ac4061180 0x7f4ac4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:28.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.201+0000 7f4add883700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4ac4061180 0x7f4ac4063640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f4ac8004f10 tx=0x7f4ac800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:28.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.204+0000 7f4acef78700 1 -- 172.21.15.49:0/2475604714 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4ad4050830 con 0x7f4ad80f7990 2024-02-22T00:30:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.384+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ad80fbdd0 con 0x7f4ac4061180 2024-02-22T00:30:28.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.388+0000 7f4acef78700 1 -- 172.21.15.49:0/2475604714 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f4ad80fbdd0 con 0x7f4ac4061180 2024-02-22T00:30:28.391 INFO:teuthology.orchestra.run.smithi049.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-22T00:30:28.391 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-02-22T00:30:28.391 INFO:teuthology.orchestra.run.smithi049.stdout:crash 2/2 2m ago 5m * 2024-02-22T00:30:28.392 INFO:teuthology.orchestra.run.smithi049.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-02-22T00:30:28.392 INFO:teuthology.orchestra.run.smithi049.stdout:mgr 2/2 2m ago 5m count:2 2024-02-22T00:30:28.392 INFO:teuthology.orchestra.run.smithi049.stdout:mon 2/2 2m ago 4m smithi049:172.21.15.49=smithi049;smithi161:172.21.15.161=smithi161;count:2 2024-02-22T00:30:28.392 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-02-22T00:30:28.392 INFO:teuthology.orchestra.run.smithi049.stdout:osd 6 2m ago - 2024-02-22T00:30:28.392 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus ?:9095 1/1 70s ago 5m count:1 2024-02-22T00:30:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4ac4061180 msgr2=0x7f4ac4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4ac4061180 0x7f4ac4063640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f4ac8004f10 tx=0x7f4ac800b040).stop 2024-02-22T00:30:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f7990 msgr2=0x7f4ad8108460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f7990 0x7f4ad8108460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f4ad40041d0 tx=0x7f4ad4009f60).stop 2024-02-22T00:30:28.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 shutdown_connections 2024-02-22T00:30:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4ac4061180 0x7f4ac4063640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ad80f66f0 0x7f4ad8107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 --2- 172.21.15.49:0/2475604714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ad80f7990 0x7f4ad8108460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 >> 172.21.15.49:0/2475604714 conn(0x7f4ad80f1e50 msgr2=0x7f4ad8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 shutdown_connections 2024-02-22T00:30:28.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:28.390+0000 7f4adfae7700 1 -- 172.21.15.49:0/2475604714 wait complete. 2024-02-22T00:30:29.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-22T00:30:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:27.797262+0000 mgr.smithi049.rjblpr (mgr.14194) 187 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:29.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:27.797262+0000 mgr.smithi049.rjblpr (mgr.14194) 187 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:30.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:28.386389+0000 mgr.smithi049.rjblpr (mgr.14194) 188 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:30.344 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:28.386389+0000 mgr.smithi049.rjblpr (mgr.14194) 188 : audit [DBG] from='client.14418 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:30.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.862+0000 7f5829a90700 1 -- 172.21.15.49:0/3565731805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f79a0 msgr2=0x7f58240f7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:30.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.862+0000 7f5829a90700 1 --2- 172.21.15.49:0/3565731805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f79a0 0x7f58240f7e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f580c0047f0 tx=0x7f580c009cb0).stop 2024-02-22T00:30:30.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.862+0000 7f5829a90700 1 -- 172.21.15.49:0/3565731805 shutdown_connections 2024-02-22T00:30:30.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.862+0000 7f5829a90700 1 --2- 172.21.15.49:0/3565731805 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f79a0 0x7f58240f7e00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:30.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.862+0000 7f5829a90700 1 --2- 172.21.15.49:0/3565731805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58240f6700 0x7f58240f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.862+0000 7f5829a90700 1 -- 172.21.15.49:0/3565731805 >> 172.21.15.49:0/3565731805 conn(0x7f58240f1e60 msgr2=0x7f58240f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.862+0000 7f5829a90700 1 -- 172.21.15.49:0/3565731805 shutdown_connections 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.862+0000 7f5829a90700 1 -- 172.21.15.49:0/3565731805 wait complete. 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.863+0000 7f5829a90700 1 Processor -- start 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.863+0000 7f5829a90700 1 -- start start 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.863+0000 7f5829a90700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f6700 0x7f5824061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.863+0000 7f5829a90700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58240f79a0 0x7f582410ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.863+0000 7f5829a90700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582410d2f0 con 0x7f58240f6700 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.863+0000 7f5829a90700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582410d430 con 0x7f58240f79a0 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f58237fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f6700 0x7f5824061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f58237fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f6700 0x7f5824061040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49270/0 (socket says 172.21.15.49:49270) 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f58237fe700 1 -- 172.21.15.49:0/3864671459 learned_addr learned my addr 172.21.15.49:0/3864671459 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f5822ffd700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58240f79a0 0x7f582410ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f58237fe700 1 -- 172.21.15.49:0/3864671459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58240f79a0 msgr2=0x7f582410ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f58237fe700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58240f79a0 0x7f582410ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f58237fe700 1 -- 172.21.15.49:0/3864671459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c005040 con 0x7f58240f6700 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f58237fe700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f6700 0x7f5824061040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f581400b480 tx=0x7f58140090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f5820f74700 1 -- 172.21.15.49:0/3864671459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5814002500 con 0x7f58240f6700 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582410d710 con 0x7f58240f6700 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f5820f74700 1 -- 172.21.15.49:0/3864671459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5814002af0 con 0x7f58240f6700 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f5820f74700 1 -- 172.21.15.49:0/3864671459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5814012bb0 con 0x7f58240f6700 2024-02-22T00:30:30.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.864+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582410dc50 con 0x7f58240f6700 2024-02-22T00:30:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.865+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58240fef60 con 0x7f58240f6700 2024-02-22T00:30:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.866+0000 7f5820f74700 1 -- 172.21.15.49:0/3864671459 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f5814002660 con 0x7f58240f6700 2024-02-22T00:30:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.866+0000 7f5820f74700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5810061180 0x7f5810063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.866+0000 7f5820f74700 1 -- 172.21.15.49:0/3864671459 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f581407c500 con 0x7f58240f6700 2024-02-22T00:30:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.866+0000 7f5822ffd700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5810061180 0x7f5810063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.866+0000 7f5822ffd700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5810061180 0x7f5810063640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f580c0047c0 tx=0x7f580c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:30.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:30.870+0000 7f5820f74700 1 -- 172.21.15.49:0/3864671459 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5814050770 con 0x7f58240f6700 2024-02-22T00:30:31.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.049+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5824059120 con 0x7f5810061180 2024-02-22T00:30:31.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.051+0000 7f5820f74700 1 -- 172.21.15.49:0/3864671459 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f5824059120 con 0x7f5810061180 2024-02-22T00:30:31.054 INFO:teuthology.orchestra.run.smithi049.stdout:HOST ADDR LABELS STATUS 2024-02-22T00:30:31.054 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 172.21.15.49 2024-02-22T00:30:31.054 INFO:teuthology.orchestra.run.smithi049.stdout:smithi161 172.21.15.161 2024-02-22T00:30:31.054 INFO:teuthology.orchestra.run.smithi049.stdout:2 hosts in cluster 2024-02-22T00:30:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5810061180 msgr2=0x7f5810063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5810061180 0x7f5810063640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f580c0047c0 tx=0x7f580c00b040).stop 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f6700 msgr2=0x7f5824061040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f6700 0x7f5824061040 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f581400b480 tx=0x7f58140090f0).stop 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 shutdown_connections 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58240f6700 0x7f5824061040 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5810061180 0x7f5810063640 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 --2- 172.21.15.49:0/3864671459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58240f79a0 0x7f582410ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 >> 172.21.15.49:0/3864671459 conn(0x7f58240f1e60 msgr2=0x7f58240fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 shutdown_connections 2024-02-22T00:30:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:31.052+0000 7f5829a90700 1 -- 172.21.15.49:0/3864671459 wait complete. 2024-02-22T00:30:31.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:29.797645+0000 mgr.smithi049.rjblpr (mgr.14194) 189 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:31.387 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:29.797645+0000 mgr.smithi049.rjblpr (mgr.14194) 189 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:31.772 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-22T00:30:32.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:31.051550+0000 mgr.smithi049.rjblpr (mgr.14194) 190 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:32.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:31 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:31.051550+0000 mgr.smithi049.rjblpr (mgr.14194) 190 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:31.797929+0000 mgr.smithi049.rjblpr (mgr.14194) 191 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:33.299 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:31.797929+0000 mgr.smithi049.rjblpr (mgr.14194) 191 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:33.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.864+0000 7fdfb4644700 1 -- 172.21.15.49:0/600023957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f7990 msgr2=0x7fdfac0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:33.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.864+0000 7fdfb4644700 1 --2- 172.21.15.49:0/600023957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f7990 0x7fdfac0f7df0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fdf9c0047f0 tx=0x7fdf9c009cb0).stop 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.864+0000 7fdfb4644700 1 -- 172.21.15.49:0/600023957 shutdown_connections 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.864+0000 7fdfb4644700 1 --2- 172.21.15.49:0/600023957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f7990 0x7fdfac0f7df0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.864+0000 7fdfb4644700 1 --2- 172.21.15.49:0/600023957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfac0f66f0 0x7fdfac0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.864+0000 7fdfb4644700 1 -- 172.21.15.49:0/600023957 >> 172.21.15.49:0/600023957 conn(0x7fdfac0f1e50 msgr2=0x7fdfac0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.864+0000 7fdfb4644700 1 -- 172.21.15.49:0/600023957 shutdown_connections 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.864+0000 7fdfb4644700 1 -- 172.21.15.49:0/600023957 wait complete. 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb4644700 1 Processor -- start 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb4644700 1 -- start start 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb4644700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f66f0 0x7fdfac107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb4644700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfac0f7990 0x7fdfac108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb4644700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac1089f0 con 0x7fdfac0f66f0 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb4644700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfac108b30 con 0x7fdfac0f7990 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb23e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f66f0 0x7fdfac107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb23e0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f66f0 0x7fdfac107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36346/0 (socket says 172.21.15.49:36346) 2024-02-22T00:30:33.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb23e0700 1 -- 172.21.15.49:0/2189668667 learned_addr learned my addr 172.21.15.49:0/2189668667 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb1bdf700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfac0f7990 0x7fdfac108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb23e0700 1 -- 172.21.15.49:0/2189668667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfac0f7990 msgr2=0x7fdfac108440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb23e0700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfac0f7990 0x7fdfac108440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb23e0700 1 -- 172.21.15.49:0/2189668667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c005040 con 0x7fdfac0f66f0 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfb23e0700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f66f0 0x7fdfac107f50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fdfa800c790 tx=0x7fdfa8007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.865+0000 7fdfa37fe700 1 -- 172.21.15.49:0/2189668667 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa800e680 con 0x7fdfac0f66f0 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.866+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac10d5d0 con 0x7fdfac0f66f0 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.866+0000 7fdfa37fe700 1 -- 172.21.15.49:0/2189668667 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fdfa800ec70 con 0x7fdfac0f66f0 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.866+0000 7fdfa37fe700 1 -- 172.21.15.49:0/2189668667 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa8013db0 con 0x7fdfac0f66f0 2024-02-22T00:30:33.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.866+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfac10db10 con 0x7fdfac0f66f0 2024-02-22T00:30:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.867+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfac0feeb0 con 0x7fdfac0f66f0 2024-02-22T00:30:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.867+0000 7fdfa37fe700 1 -- 172.21.15.49:0/2189668667 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fdfa800e7e0 con 0x7fdfac0f66f0 2024-02-22T00:30:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.868+0000 7fdfa37fe700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdf98061180 0x7fdf98063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.868+0000 7fdfa37fe700 1 -- 172.21.15.49:0/2189668667 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fdfa807c8b0 con 0x7fdfac0f66f0 2024-02-22T00:30:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.868+0000 7fdfb1bdf700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdf98061180 0x7fdf98063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:33.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.868+0000 7fdfb1bdf700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdf98061180 0x7fdf98063640 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdf9c013470 tx=0x7fdf9c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:33.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:33.872+0000 7fdfa37fe700 1 -- 172.21.15.49:0/2189668667 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fdfa8050b80 con 0x7fdfac0f66f0 2024-02-22T00:30:34.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.050+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfac0fbdd0 con 0x7fdf98061180 2024-02-22T00:30:34.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.051+0000 7fdfa37fe700 1 -- 172.21.15.49:0/2189668667 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fdfac0fbdd0 con 0x7fdf98061180 2024-02-22T00:30:34.054 INFO:teuthology.orchestra.run.smithi049.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-22T00:30:34.055 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 /dev/nvme0n1 ssd INTEL SSDPED1D480GA_PHMB747500D2480DGN 447G 2m ago Has a FileSystem, LVM detected 2024-02-22T00:30:34.055 INFO:teuthology.orchestra.run.smithi049.stdout:smithi161 /dev/nvme0n1 ssd INTEL SSDPEDMD400G4_CVFT6233001X400BGN 372G 72s ago Has a FileSystem, LVM detected 2024-02-22T00:30:34.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdf98061180 msgr2=0x7fdf98063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:34.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdf98061180 0x7fdf98063640 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fdf9c013470 tx=0x7fdf9c00b040).stop 2024-02-22T00:30:34.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f66f0 msgr2=0x7fdfac107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:34.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f66f0 0x7fdfac107f50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fdfa800c790 tx=0x7fdfa8007f10).stop 2024-02-22T00:30:34.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 shutdown_connections 2024-02-22T00:30:34.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfac0f66f0 0x7fdfac107f50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:34.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fdf98061180 0x7fdf98063640 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:34.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 --2- 172.21.15.49:0/2189668667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfac0f7990 0x7fdfac108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:34.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 >> 172.21.15.49:0/2189668667 conn(0x7fdfac0f1e50 msgr2=0x7fdfac060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:34.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 shutdown_connections 2024-02-22T00:30:34.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:34.053+0000 7fdfb4644700 1 -- 172.21.15.49:0/2189668667 wait complete. 2024-02-22T00:30:34.735 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T00:30:34.746 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:30:34.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-22T00:30:35.234 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:33.798261+0000 mgr.smithi049.rjblpr (mgr.14194) 192 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:35.234 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:34.052155+0000 mgr.smithi049.rjblpr (mgr.14194) 193 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:35.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:33.798261+0000 mgr.smithi049.rjblpr (mgr.14194) 192 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:35.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:34.052155+0000 mgr.smithi049.rjblpr (mgr.14194) 193 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.523+0000 7f5b24f26700 1 -- 172.21.15.49:0/2294651362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 msgr2=0x7f5b200f7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.523+0000 7f5b24f26700 1 --2- 172.21.15.49:0/2294651362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 0x7f5b200f7120 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f5b140047f0 tx=0x7f5b14009cb0).stop 2024-02-22T00:30:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.523+0000 7f5b24f26700 1 -- 172.21.15.49:0/2294651362 shutdown_connections 2024-02-22T00:30:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.523+0000 7f5b24f26700 1 --2- 172.21.15.49:0/2294651362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b200f76a0 0x7f5b200f7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.523+0000 7f5b24f26700 1 --2- 172.21.15.49:0/2294651362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 0x7f5b200f7120 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.523+0000 7f5b24f26700 1 -- 172.21.15.49:0/2294651362 >> 172.21.15.49:0/2294651362 conn(0x7f5b200f1610 msgr2=0x7f5b200f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.523+0000 7f5b24f26700 1 -- 172.21.15.49:0/2294651362 shutdown_connections 2024-02-22T00:30:36.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.523+0000 7f5b24f26700 1 -- 172.21.15.49:0/2294651362 wait complete. 2024-02-22T00:30:36.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.524+0000 7f5b24f26700 1 Processor -- start 2024-02-22T00:30:36.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.524+0000 7f5b24f26700 1 -- start start 2024-02-22T00:30:36.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.524+0000 7f5b24f26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 0x7f5b200f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:36.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.524+0000 7f5b24f26700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b200f76a0 0x7f5b2010ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:36.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.524+0000 7f5b24f26700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2010d360 con 0x7f5b200f6d00 2024-02-22T00:30:36.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.524+0000 7f5b24f26700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2010d4a0 con 0x7f5b200f76a0 2024-02-22T00:30:36.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b1e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 0x7f5b200f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b1e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 0x7f5b200f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36358/0 (socket says 172.21.15.49:36358) 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b1e59c700 1 -- 172.21.15.49:0/2072972191 learned_addr learned my addr 172.21.15.49:0/2072972191 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b1dd9b700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b200f76a0 0x7f5b2010ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b1e59c700 1 -- 172.21.15.49:0/2072972191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b200f76a0 msgr2=0x7f5b2010ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b1e59c700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b200f76a0 0x7f5b2010ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b1e59c700 1 -- 172.21.15.49:0/2072972191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b14005040 con 0x7f5b200f6d00 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b1e59c700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 0x7f5b200f64e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f5b14009380 tx=0x7f5b14009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b0f7fe700 1 -- 172.21.15.49:0/2072972191 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1400e030 con 0x7f5b200f6d00 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b0f7fe700 1 -- 172.21.15.49:0/2072972191 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5b14007e90 con 0x7f5b200f6d00 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2010d6a0 con 0x7f5b200f6d00 2024-02-22T00:30:36.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b0f7fe700 1 -- 172.21.15.49:0/2072972191 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b14018070 con 0x7f5b200f6d00 2024-02-22T00:30:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.525+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2010db50 con 0x7f5b200f6d00 2024-02-22T00:30:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.526+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b200fef20 con 0x7f5b200f6d00 2024-02-22T00:30:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.526+0000 7f5b0f7fe700 1 -- 172.21.15.49:0/2072972191 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f5b1401d420 con 0x7f5b200f6d00 2024-02-22T00:30:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.527+0000 7f5b0f7fe700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b08061180 0x7f5b08063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.527+0000 7f5b0f7fe700 1 -- 172.21.15.49:0/2072972191 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f5b1407da10 con 0x7f5b200f6d00 2024-02-22T00:30:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.527+0000 7f5b1dd9b700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b08061180 0x7f5b08063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:36.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.527+0000 7f5b1dd9b700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b08061180 0x7f5b08063640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5b100041d0 tx=0x7f5b10009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:36.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.531+0000 7f5b0f7fe700 1 -- 172.21.15.49:0/2072972191 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5b14051d60 con 0x7f5b200f6d00 2024-02-22T00:30:36.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:36.729+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b20059120 con 0x7f5b08061180 2024-02-22T00:30:37.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:35.798579+0000 mgr.smithi049.rjblpr (mgr.14194) 194 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:37.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:35.798579+0000 mgr.smithi049.rjblpr (mgr.14194) 194 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:38.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.252+0000 7f5b0f7fe700 1 -- 172.21.15.49:0/2072972191 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5b20059120 con 0x7f5b08061180 2024-02-22T00:30:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b08061180 msgr2=0x7f5b08063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b08061180 0x7f5b08063640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5b100041d0 tx=0x7f5b10009040).stop 2024-02-22T00:30:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 msgr2=0x7f5b200f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 0x7f5b200f64e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f5b14009380 tx=0x7f5b14009cb0).stop 2024-02-22T00:30:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 shutdown_connections 2024-02-22T00:30:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b200f6d00 0x7f5b200f64e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b08061180 0x7f5b08063640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 --2- 172.21.15.49:0/2072972191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b200f76a0 0x7f5b2010ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 >> 172.21.15.49:0/2072972191 conn(0x7f5b200f1610 msgr2=0x7f5b200fb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 shutdown_connections 2024-02-22T00:30:38.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:38.254+0000 7f5b24f26700 1 -- 172.21.15.49:0/2072972191 wait complete. 2024-02-22T00:30:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:36.731006+0000 mgr.smithi049.rjblpr (mgr.14194) 195 : audit [DBG] from='client.14430 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:36.731533+0000 mon.smithi049 (mon.0) 514 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-22T00:30:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:37.214616+0000 mon.smithi049 (mon.0) 515 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-22T00:30:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:37.214659+0000 mon.smithi049 (mon.0) 516 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-22T00:30:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:37.215455+0000 mon.smithi049 (mon.0) 517 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-22T00:30:38.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:30:38.228+0000 7f5c1ba1c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-22T00:30:38.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:36.731006+0000 mgr.smithi049.rjblpr (mgr.14194) 195 : audit [DBG] from='client.14430 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:30:38.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:36.731533+0000 mon.smithi049 (mon.0) 514 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-22T00:30:38.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:37.214616+0000 mon.smithi049 (mon.0) 515 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-22T00:30:38.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:37.214659+0000 mon.smithi049 (mon.0) 516 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-02-22T00:30:38.509 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:37.215455+0000 mon.smithi049 (mon.0) 517 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-22T00:30:38.980 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-22T00:30:39.488 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:37.798909+0000 mgr.smithi049.rjblpr (mgr.14194) 196 : cluster [DBG] pgmap v166: 33 pgs: 9 creating+peering, 23 unknown, 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.219346+0000 mon.smithi049 (mon.0) 518 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:38.219621+0000 mon.smithi049 (mon.0) 519 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.229046+0000 mon.smithi049 (mon.0) 520 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:38.229992+0000 mon.smithi049 (mon.0) 521 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:38.230023+0000 mon.smithi049 (mon.0) 522 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:38.241845+0000 mon.smithi049 (mon.0) 523 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.242173+0000 mon.smithi049 (mon.0) 524 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:38.242277+0000 mon.smithi049 (mon.0) 525 : cluster [DBG] fsmap cephfs:0 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:30:38.246508+0000 mgr.smithi049.rjblpr (mgr.14194) 197 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.252715+0000 mon.smithi049 (mon.0) 526 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.266335+0000 mon.smithi049 (mon.0) 527 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.267987+0000 mon.smithi049 (mon.0) 528 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.268646+0000 mon.smithi049 (mon.0) 529 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:30:39.489 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.273017+0000 mon.smithi049 (mon.0) 530 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:39.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.280312+0000 mon.smithi049 (mon.0) 531 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:39.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.281314+0000 mon.smithi049 (mon.0) 532 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.vwomak", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:30:39.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.284756+0000 mon.smithi049 (mon.0) 533 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.vwomak", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-22T00:30:39.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:38.285455+0000 mon.smithi049 (mon.0) 534 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:39.490 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:30:38.286060+0000 mgr.smithi049.rjblpr (mgr.14194) 198 : cephadm [INF] Deploying daemon mds.cephfs.smithi049.vwomak on smithi049 2024-02-22T00:30:39.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:37.798909+0000 mgr.smithi049.rjblpr (mgr.14194) 196 : cluster [DBG] pgmap v166: 33 pgs: 9 creating+peering, 23 unknown, 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:39.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.219346+0000 mon.smithi049 (mon.0) 518 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:38.219621+0000 mon.smithi049 (mon.0) 519 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.229046+0000 mon.smithi049 (mon.0) 520 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:38.229992+0000 mon.smithi049 (mon.0) 521 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:38.230023+0000 mon.smithi049 (mon.0) 522 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:38.241845+0000 mon.smithi049 (mon.0) 523 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.242173+0000 mon.smithi049 (mon.0) 524 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:38.242277+0000 mon.smithi049 (mon.0) 525 : cluster [DBG] fsmap cephfs:0 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:30:38.246508+0000 mgr.smithi049.rjblpr (mgr.14194) 197 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.252715+0000 mon.smithi049 (mon.0) 526 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.266335+0000 mon.smithi049 (mon.0) 527 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.267987+0000 mon.smithi049 (mon.0) 528 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.268646+0000 mon.smithi049 (mon.0) 529 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:30:39.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.273017+0000 mon.smithi049 (mon.0) 530 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:39.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.280312+0000 mon.smithi049 (mon.0) 531 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:39.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.281314+0000 mon.smithi049 (mon.0) 532 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.vwomak", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:30:39.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.284756+0000 mon.smithi049 (mon.0) 533 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.vwomak", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-22T00:30:39.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:38.285455+0000 mon.smithi049 (mon.0) 534 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:39.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:30:38.286060+0000 mgr.smithi049.rjblpr (mgr.14194) 198 : cephadm [INF] Deploying daemon mds.cephfs.smithi049.vwomak on smithi049 2024-02-22T00:30:40.503 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:39.241143+0000 mon.smithi049 (mon.0) 535 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-02-22T00:30:40.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:39.241143+0000 mon.smithi049 (mon.0) 535 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-02-22T00:30:41.524 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:39.799427+0000 mgr.smithi049.rjblpr (mgr.14194) 199 : cluster [DBG] pgmap v170: 65 pgs: 12 creating+peering, 27 unknown, 26 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:41.524 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:40.246205+0000 mon.smithi049 (mon.0) 536 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-02-22T00:30:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:39.799427+0000 mgr.smithi049.rjblpr (mgr.14194) 199 : cluster [DBG] pgmap v170: 65 pgs: 12 creating+peering, 27 unknown, 26 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:40.246205+0000 mon.smithi049 (mon.0) 536 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-02-22T00:30:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.907+0000 7fe9f865b700 1 -- 172.21.15.49:0/1744797599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f8ab0 msgr2=0x7fe9f00f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.907+0000 7fe9f865b700 1 --2- 172.21.15.49:0/1744797599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f8ab0 0x7fe9f00f8f10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe9e00047f0 tx=0x7fe9e0009cb0).stop 2024-02-22T00:30:41.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.907+0000 7fe9f865b700 1 -- 172.21.15.49:0/1744797599 shutdown_connections 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.907+0000 7fe9f865b700 1 --2- 172.21.15.49:0/1744797599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f8ab0 0x7fe9f00f8f10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.907+0000 7fe9f865b700 1 --2- 172.21.15.49:0/1744797599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9f00f7810 0x7fe9f00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.907+0000 7fe9f865b700 1 -- 172.21.15.49:0/1744797599 >> 172.21.15.49:0/1744797599 conn(0x7fe9f00f2f50 msgr2=0x7fe9f00f5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.907+0000 7fe9f865b700 1 -- 172.21.15.49:0/1744797599 shutdown_connections 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.907+0000 7fe9f865b700 1 -- 172.21.15.49:0/1744797599 wait complete. 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f865b700 1 Processor -- start 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f865b700 1 -- start start 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f865b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f7810 0x7fe9f006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f865b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9f00f8ab0 0x7fe9f006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f865b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f006cf80 con 0x7fe9f00f7810 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f865b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f006b520 con 0x7fe9f00f8ab0 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f63f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f7810 0x7fe9f006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:41.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f63f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f7810 0x7fe9f006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46196/0 (socket says 172.21.15.49:46196) 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f63f7700 1 -- 172.21.15.49:0/2961467740 learned_addr learned my addr 172.21.15.49:0/2961467740 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f5bf6700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9f00f8ab0 0x7fe9f006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f63f7700 1 -- 172.21.15.49:0/2961467740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9f00f8ab0 msgr2=0x7fe9f006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f63f7700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9f00f8ab0 0x7fe9f006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f63f7700 1 -- 172.21.15.49:0/2961467740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e0005040 con 0x7fe9f00f7810 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f5bf6700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9f00f8ab0 0x7fe9f006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.908+0000 7fe9f63f7700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f7810 0x7fe9f006c9d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe9ec002770 tx=0x7fe9ec002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.909+0000 7fe9e77fe700 1 -- 172.21.15.49:0/2961467740 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9ec007b40 con 0x7fe9f00f7810 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.909+0000 7fe9e77fe700 1 -- 172.21.15.49:0/2961467740 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe9ec00f040 con 0x7fe9f00f7810 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.909+0000 7fe9e77fe700 1 -- 172.21.15.49:0/2961467740 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9ec00d790 con 0x7fe9f00f7810 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.909+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f006b7a0 con 0x7fe9f00f7810 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.909+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f006bce0 con 0x7fe9f00f7810 2024-02-22T00:30:41.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.910+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f00fffd0 con 0x7fe9f00f7810 2024-02-22T00:30:41.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.910+0000 7fe9e77fe700 1 -- 172.21.15.49:0/2961467740 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fe9ec007ca0 con 0x7fe9f00f7810 2024-02-22T00:30:41.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.910+0000 7fe9e77fe700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe9dc061180 0x7fe9dc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:41.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.910+0000 7fe9e77fe700 1 -- 172.21.15.49:0/2961467740 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fe9ec07c4c0 con 0x7fe9f00f7810 2024-02-22T00:30:41.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.911+0000 7fe9f5bf6700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe9dc061180 0x7fe9dc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:41.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.911+0000 7fe9f5bf6700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe9dc061180 0x7fe9dc063640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe9e00043d0 tx=0x7fe9e0009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:41.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:41.915+0000 7fe9e77fe700 1 -- 172.21.15.49:0/2961467740 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe9ec0504d0 con 0x7fe9f00f7810 2024-02-22T00:30:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.132+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9f00598f0 con 0x7fe9f00f7810 2024-02-22T00:30:42.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.133+0000 7fe9e77fe700 1 -- 172.21.15.49:0/2961467740 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1034 (secure 0 0 0) 0x7fe9ec0500c0 con 0x7fe9f00f7810 2024-02-22T00:30:42.136 INFO:teuthology.orchestra.run.smithi049.stdout:e2 2024-02-22T00:30:42.136 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:30:42.136 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 2 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:30:38.229893+0000 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:30:42.137 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 1 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:in 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 0 2024-02-22T00:30:42.138 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:42.139 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:42.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe9dc061180 msgr2=0x7fe9dc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:42.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe9dc061180 0x7fe9dc063640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe9e00043d0 tx=0x7fe9e0009cb0).stop 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f7810 msgr2=0x7fe9f006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f7810 0x7fe9f006c9d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe9ec002770 tx=0x7fe9ec002b30).stop 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 shutdown_connections 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9f00f7810 0x7fe9f006c9d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe9dc061180 0x7fe9dc063640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 --2- 172.21.15.49:0/2961467740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9f00f8ab0 0x7fe9f006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 >> 172.21.15.49:0/2961467740 conn(0x7fe9f00f2f50 msgr2=0x7fe9f00fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 shutdown_connections 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:42.135+0000 7fe9f865b700 1 -- 172.21.15.49:0/2961467740 wait complete. 2024-02-22T00:30:42.140 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 2 2024-02-22T00:30:42.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:42.134205+0000 mon.smithi049 (mon.0) 537 : audit [DBG] from='client.? 172.21.15.49:0/2961467740' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:30:42.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:42.157636+0000 mon.smithi049 (mon.0) 538 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:42.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:42.159136+0000 mon.smithi049 (mon.0) 539 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.wycpud", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:30:42.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:42.162743+0000 mon.smithi049 (mon.0) 540 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.wycpud", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-22T00:30:42.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:42.163476+0000 mon.smithi049 (mon.0) 541 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:42.134205+0000 mon.smithi049 (mon.0) 537 : audit [DBG] from='client.? 172.21.15.49:0/2961467740' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:30:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:42.157636+0000 mon.smithi049 (mon.0) 538 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:42.159136+0000 mon.smithi049 (mon.0) 539 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.wycpud", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:30:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:42.162743+0000 mon.smithi049 (mon.0) 540 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.wycpud", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-22T00:30:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:42.163476+0000 mon.smithi049 (mon.0) 541 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:42.990 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T00:30:43.000 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:30:43.003 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-22T00:30:43.508 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:41.799741+0000 mgr.smithi049.rjblpr (mgr.14194) 200 : cluster [DBG] pgmap v172: 65 pgs: 12 creating+peering, 6 unknown, 47 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:43.508 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:30:42.164030+0000 mgr.smithi049.rjblpr (mgr.14194) 201 : cephadm [INF] Deploying daemon mds.cephfs.smithi161.wycpud on smithi161 2024-02-22T00:30:43.508 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:42.254013+0000 mon.smithi049 (mon.0) 542 : cluster [DBG] mds.? [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] up:boot 2024-02-22T00:30:43.508 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:42.254048+0000 mon.smithi049 (mon.0) 543 : cluster [INF] daemon mds.cephfs.smithi049.vwomak assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-22T00:30:43.509 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:42.254093+0000 mon.smithi049 (mon.0) 544 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-22T00:30:43.509 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:42.254122+0000 mon.smithi049 (mon.0) 545 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-22T00:30:43.509 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:42.254133+0000 mon.smithi049 (mon.0) 546 : cluster [INF] Cluster is now healthy 2024-02-22T00:30:43.509 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:42.254270+0000 mon.smithi049 (mon.0) 547 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-02-22T00:30:43.509 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:42.254498+0000 mon.smithi049 (mon.0) 548 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:30:43.509 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:42.260526+0000 mon.smithi049 (mon.0) 549 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi049.vwomak=up:creating} 2024-02-22T00:30:43.509 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:42.271123+0000 mon.smithi049 (mon.0) 550 : cluster [INF] daemon mds.cephfs.smithi049.vwomak is now active in filesystem cephfs as rank 0 2024-02-22T00:30:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:41.799741+0000 mgr.smithi049.rjblpr (mgr.14194) 200 : cluster [DBG] pgmap v172: 65 pgs: 12 creating+peering, 6 unknown, 47 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:30:42.164030+0000 mgr.smithi049.rjblpr (mgr.14194) 201 : cephadm [INF] Deploying daemon mds.cephfs.smithi161.wycpud on smithi161 2024-02-22T00:30:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:42.254013+0000 mon.smithi049 (mon.0) 542 : cluster [DBG] mds.? [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] up:boot 2024-02-22T00:30:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:42.254048+0000 mon.smithi049 (mon.0) 543 : cluster [INF] daemon mds.cephfs.smithi049.vwomak assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-22T00:30:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:42.254093+0000 mon.smithi049 (mon.0) 544 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-22T00:30:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:42.254122+0000 mon.smithi049 (mon.0) 545 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-22T00:30:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:42.254133+0000 mon.smithi049 (mon.0) 546 : cluster [INF] Cluster is now healthy 2024-02-22T00:30:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:42.254270+0000 mon.smithi049 (mon.0) 547 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-02-22T00:30:43.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:42.254498+0000 mon.smithi049 (mon.0) 548 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:30:43.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:42.260526+0000 mon.smithi049 (mon.0) 549 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi049.vwomak=up:creating} 2024-02-22T00:30:43.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:42.271123+0000 mon.smithi049 (mon.0) 550 : cluster [INF] daemon mds.cephfs.smithi049.vwomak is now active in filesystem cephfs as rank 0 2024-02-22T00:30:44.382 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:43.260134+0000 mon.smithi049 (mon.0) 551 : cluster [DBG] mds.? [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] up:active 2024-02-22T00:30:44.382 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:43.260180+0000 mon.smithi049 (mon.0) 552 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi049.vwomak=up:active} 2024-02-22T00:30:44.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:43.260134+0000 mon.smithi049 (mon.0) 551 : cluster [DBG] mds.? [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] up:active 2024-02-22T00:30:44.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:43.260180+0000 mon.smithi049 (mon.0) 552 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi049.vwomak=up:active} 2024-02-22T00:30:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.898+0000 7ff5f434f700 1 -- 172.21.15.49:0/565081077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f8cb0 msgr2=0x7ff5ec0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.898+0000 7ff5f434f700 1 --2- 172.21.15.49:0/565081077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f8cb0 0x7ff5ec0f9110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff5dc0047f0 tx=0x7ff5dc009cb0).stop 2024-02-22T00:30:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.899+0000 7ff5f434f700 1 -- 172.21.15.49:0/565081077 shutdown_connections 2024-02-22T00:30:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.899+0000 7ff5f434f700 1 --2- 172.21.15.49:0/565081077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f8cb0 0x7ff5ec0f9110 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.899+0000 7ff5f434f700 1 --2- 172.21.15.49:0/565081077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5ec0f7a10 0x7ff5ec0f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.899+0000 7ff5f434f700 1 -- 172.21.15.49:0/565081077 >> 172.21.15.49:0/565081077 conn(0x7ff5ec0f3150 msgr2=0x7ff5ec0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.899+0000 7ff5f434f700 1 -- 172.21.15.49:0/565081077 shutdown_connections 2024-02-22T00:30:44.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.899+0000 7ff5f434f700 1 -- 172.21.15.49:0/565081077 wait complete. 2024-02-22T00:30:44.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.899+0000 7ff5f434f700 1 Processor -- start 2024-02-22T00:30:44.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.899+0000 7ff5f434f700 1 -- start start 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f434f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f7a10 0x7ff5ec108150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f434f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5ec0f8cb0 0x7ff5ec108640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f434f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec108bf0 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f434f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec108d30 con 0x7ff5ec0f8cb0 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f20eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f7a10 0x7ff5ec108150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f20eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f7a10 0x7ff5ec108150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46222/0 (socket says 172.21.15.49:46222) 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f20eb700 1 -- 172.21.15.49:0/1448320675 learned_addr learned my addr 172.21.15.49:0/1448320675 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f18ea700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5ec0f8cb0 0x7ff5ec108640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f20eb700 1 -- 172.21.15.49:0/1448320675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5ec0f8cb0 msgr2=0x7ff5ec108640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f20eb700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5ec0f8cb0 0x7ff5ec108640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f20eb700 1 -- 172.21.15.49:0/1448320675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc005040 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.900+0000 7ff5f20eb700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f7a10 0x7ff5ec108150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7ff5e800c790 tx=0x7ff5e8007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:44.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.901+0000 7ff5e37fe700 1 -- 172.21.15.49:0/1448320675 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e800e680 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.901+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec10d7d0 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.901+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec10dd10 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.901+0000 7ff5e37fe700 1 -- 172.21.15.49:0/1448320675 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff5e800ec70 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.901+0000 7ff5e37fe700 1 -- 172.21.15.49:0/1448320675 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e8013d90 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.902+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d0005150 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.902+0000 7ff5e37fe700 1 -- 172.21.15.49:0/1448320675 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ff5e8013410 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.903+0000 7ff5e37fe700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5d8061180 0x7ff5d8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.903+0000 7ff5e37fe700 1 -- 172.21.15.49:0/1448320675 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7ff5e807ca60 con 0x7ff5ec0f7a10 2024-02-22T00:30:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.903+0000 7ff5f18ea700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5d8061180 0x7ff5d8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:44.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.903+0000 7ff5f18ea700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5d8061180 0x7ff5d8063640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff5dc0047c0 tx=0x7ff5dc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:44.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:44.909+0000 7ff5e37fe700 1 -- 172.21.15.49:0/1448320675 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff5e8050a70 con 0x7ff5ec0f7a10 2024-02-22T00:30:45.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.132+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7ff5d0005da0 con 0x7ff5ec0f7a10 2024-02-22T00:30:45.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.268+0000 7ff5e37fe700 1 -- 172.21.15.49:0/1448320675 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7ff5e8050660 con 0x7ff5ec0f7a10 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5d8061180 msgr2=0x7ff5d8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5d8061180 0x7ff5d8063640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff5dc0047c0 tx=0x7ff5dc00b040).stop 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f7a10 msgr2=0x7ff5ec108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f7a10 0x7ff5ec108150 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7ff5e800c790 tx=0x7ff5e8007f10).stop 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 shutdown_connections 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5ec0f7a10 0x7ff5ec108150 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff5d8061180 0x7ff5d8063640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 --2- 172.21.15.49:0/1448320675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5ec0f8cb0 0x7ff5ec108640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 >> 172.21.15.49:0/1448320675 conn(0x7ff5ec0f3150 msgr2=0x7ff5ec0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 shutdown_connections 2024-02-22T00:30:45.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:45.270+0000 7ff5f434f700 1 -- 172.21.15.49:0/1448320675 wait complete. 2024-02-22T00:30:45.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:43.800274+0000 mgr.smithi049.rjblpr (mgr.14194) 202 : cluster [DBG] pgmap v173: 65 pgs: 3 creating+peering, 62 active+clean; 1.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:44.688458+0000 mon.smithi049 (mon.0) 553 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:44.689466+0000 mon.smithi049 (mon.0) 554 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.rrqshp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:30:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:44.692192+0000 mon.smithi049 (mon.0) 555 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.rrqshp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-22T00:30:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:44.692957+0000 mon.smithi049 (mon.0) 556 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:45.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:45.133570+0000 mon.smithi049 (mon.0) 557 : audit [INF] from='client.? 172.21.15.49:0/1448320675' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-22T00:30:45.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:43.800274+0000 mgr.smithi049.rjblpr (mgr.14194) 202 : cluster [DBG] pgmap v173: 65 pgs: 3 creating+peering, 62 active+clean; 1.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:30:45.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:44.688458+0000 mon.smithi049 (mon.0) 553 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:45.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:44.689466+0000 mon.smithi049 (mon.0) 554 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.rrqshp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:30:45.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:44.692192+0000 mon.smithi049 (mon.0) 555 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.rrqshp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-22T00:30:45.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:44.692957+0000 mon.smithi049 (mon.0) 556 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:45.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:45.133570+0000 mon.smithi049 (mon.0) 557 : audit [INF] from='client.? 172.21.15.49:0/1448320675' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-22T00:30:46.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:30:44.693625+0000 mgr.smithi049.rjblpr (mgr.14194) 203 : cephadm [INF] Deploying daemon mds.cephfs.smithi049.rrqshp on smithi049 2024-02-22T00:30:46.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.263777+0000 mon.smithi049 (mon.0) 558 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-22T00:30:46.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.269076+0000 mon.smithi049 (mon.0) 559 : cluster [DBG] mds.? [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] up:boot 2024-02-22T00:30:46.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:45.269124+0000 mon.smithi049 (mon.0) 560 : audit [INF] from='client.? 172.21.15.49:0/1448320675' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-22T00:30:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.269200+0000 mon.smithi049 (mon.0) 561 : cluster [INF] daemon mds.cephfs.smithi161.wycpud assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-22T00:30:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.269287+0000 mon.smithi049 (mon.0) 562 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-22T00:30:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.269310+0000 mon.smithi049 (mon.0) 563 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-22T00:30:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.269509+0000 mon.smithi049 (mon.0) 564 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi049.vwomak=up:active} 1 up:standby 2024-02-22T00:30:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:45.269602+0000 mon.smithi049 (mon.0) 565 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:30:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.273445+0000 mon.smithi049 (mon.0) 566 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:creating} 2024-02-22T00:30:46.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.285386+0000 mon.smithi049 (mon.0) 567 : cluster [INF] daemon mds.cephfs.smithi161.wycpud is now active in filesystem cephfs as rank 1 2024-02-22T00:30:46.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:30:44.693625+0000 mgr.smithi049.rjblpr (mgr.14194) 203 : cephadm [INF] Deploying daemon mds.cephfs.smithi049.rrqshp on smithi049 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.263777+0000 mon.smithi049 (mon.0) 558 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.269076+0000 mon.smithi049 (mon.0) 559 : cluster [DBG] mds.? [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] up:boot 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:45.269124+0000 mon.smithi049 (mon.0) 560 : audit [INF] from='client.? 172.21.15.49:0/1448320675' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.269200+0000 mon.smithi049 (mon.0) 561 : cluster [INF] daemon mds.cephfs.smithi161.wycpud assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.269287+0000 mon.smithi049 (mon.0) 562 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.269310+0000 mon.smithi049 (mon.0) 563 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.269509+0000 mon.smithi049 (mon.0) 564 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi049.vwomak=up:active} 1 up:standby 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:45.269602+0000 mon.smithi049 (mon.0) 565 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.273445+0000 mon.smithi049 (mon.0) 566 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:creating} 2024-02-22T00:30:46.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.285386+0000 mon.smithi049 (mon.0) 567 : cluster [INF] daemon mds.cephfs.smithi161.wycpud is now active in filesystem cephfs as rank 1 2024-02-22T00:30:46.719 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T00:30:46.729 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:30:46.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-02-22T00:30:47.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:45.800702+0000 mgr.smithi049.rjblpr (mgr.14194) 204 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 2.1 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.0 KiB/s wr, 12 op/s 2024-02-22T00:30:47.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:46.275404+0000 mon.smithi049 (mon.0) 568 : cluster [DBG] mds.? [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] up:active 2024-02-22T00:30:47.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:46.275456+0000 mon.smithi049 (mon.0) 569 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2024-02-22T00:30:47.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:46.911675+0000 mon.smithi049 (mon.0) 570 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:47.578 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:45.800702+0000 mgr.smithi049.rjblpr (mgr.14194) 204 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 2.1 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.0 KiB/s wr, 12 op/s 2024-02-22T00:30:47.578 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:46.275404+0000 mon.smithi049 (mon.0) 568 : cluster [DBG] mds.? [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] up:active 2024-02-22T00:30:47.578 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:46.275456+0000 mon.smithi049 (mon.0) 569 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2024-02-22T00:30:47.578 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:46.911675+0000 mon.smithi049 (mon.0) 570 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:48.760 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:47.622205+0000 mon.smithi049 (mon.0) 571 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:48.760 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:47.623166+0000 mon.smithi049 (mon.0) 572 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.plrhpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:47.626074+0000 mon.smithi049 (mon.0) 573 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.plrhpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:47.626637+0000 mon.smithi049 (mon.0) 574 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:30:47.627183+0000 mgr.smithi049.rjblpr (mgr.14194) 205 : cephadm [INF] Deploying daemon mds.cephfs.smithi161.plrhpg on smithi161 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:47.801134+0000 mgr.smithi049.rjblpr (mgr.14194) 206 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 3.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s wr, 13 op/s 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:48.275690+0000 mon.smithi049 (mon.0) 575 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:48.275722+0000 mon.smithi049 (mon.0) 576 : cluster [INF] Cluster is now healthy 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:48.279430+0000 mon.smithi049 (mon.0) 577 : cluster [DBG] mds.? [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] up:boot 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:48.279488+0000 mon.smithi049 (mon.0) 578 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 1 up:standby 2024-02-22T00:30:48.761 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:48.279633+0000 mon.smithi049 (mon.0) 579 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:30:48.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 -- 172.21.15.49:0/3952946293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 msgr2=0x7fb15c0f7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 --2- 172.21.15.49:0/3952946293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 0x7fb15c0f7e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb1440047f0 tx=0x7fb144009cb0).stop 2024-02-22T00:30:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 -- 172.21.15.49:0/3952946293 shutdown_connections 2024-02-22T00:30:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 --2- 172.21.15.49:0/3952946293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 0x7fb15c0f7e00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 --2- 172.21.15.49:0/3952946293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb15c0f6700 0x7fb15c0f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 -- 172.21.15.49:0/3952946293 >> 172.21.15.49:0/3952946293 conn(0x7fb15c0f1e60 msgr2=0x7fb15c0f4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 -- 172.21.15.49:0/3952946293 shutdown_connections 2024-02-22T00:30:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 -- 172.21.15.49:0/3952946293 wait complete. 2024-02-22T00:30:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.897+0000 7fb1628c5700 1 Processor -- start 2024-02-22T00:30:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb1628c5700 1 -- start start 2024-02-22T00:30:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb1628c5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb15c0f6700 0x7fb15c108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb1628c5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 0x7fb15c108540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb1628c5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c108af0 con 0x7fb15c0f79a0 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb1628c5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c108c30 con 0x7fb15c0f6700 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb15b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 0x7fb15c108540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb15b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 0x7fb15c108540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46260/0 (socket says 172.21.15.49:46260) 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb15b7fe700 1 -- 172.21.15.49:0/2212485145 learned_addr learned my addr 172.21.15.49:0/2212485145 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb15bfff700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb15c0f6700 0x7fb15c108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb15b7fe700 1 -- 172.21.15.49:0/2212485145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb15c0f6700 msgr2=0x7fb15c108050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb15b7fe700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb15c0f6700 0x7fb15c108050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb15b7fe700 1 -- 172.21.15.49:0/2212485145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144005040 con 0x7fb15c0f79a0 2024-02-22T00:30:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.898+0000 7fb15b7fe700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 0x7fb15c108540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb144013580 tx=0x7fb144009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.899+0000 7fb1597fa700 1 -- 172.21.15.49:0/2212485145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb144018070 con 0x7fb15c0f79a0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.899+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15c10d670 con 0x7fb15c0f79a0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.899+0000 7fb1597fa700 1 -- 172.21.15.49:0/2212485145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb144007e90 con 0x7fb15c0f79a0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.899+0000 7fb1597fa700 1 -- 172.21.15.49:0/2212485145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1440123c0 con 0x7fb15c0f79a0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.899+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15c10dc30 con 0x7fb15c0f79a0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.900+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15c0feec0 con 0x7fb15c0f79a0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.900+0000 7fb1597fa700 1 -- 172.21.15.49:0/2212485145 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fb14401d420 con 0x7fb15c0f79a0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.900+0000 7fb1597fa700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb148061180 0x7fb148063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.900+0000 7fb1597fa700 1 -- 172.21.15.49:0/2212485145 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fb14407d490 con 0x7fb15c0f79a0 2024-02-22T00:30:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.900+0000 7fb15bfff700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb148061180 0x7fb148063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.901+0000 7fb15bfff700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb148061180 0x7fb148063640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb15c0f7800 tx=0x7fb14c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:48.904+0000 7fb1597fa700 1 -- 172.21.15.49:0/2212485145 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb144051420 con 0x7fb15c0f79a0 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:47.622205+0000 mon.smithi049 (mon.0) 571 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:47.623166+0000 mon.smithi049 (mon.0) 572 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.plrhpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:47.626074+0000 mon.smithi049 (mon.0) 573 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.plrhpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:47.626637+0000 mon.smithi049 (mon.0) 574 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:30:47.627183+0000 mgr.smithi049.rjblpr (mgr.14194) 205 : cephadm [INF] Deploying daemon mds.cephfs.smithi161.plrhpg on smithi161 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:47.801134+0000 mgr.smithi049.rjblpr (mgr.14194) 206 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 3.5 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s wr, 13 op/s 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:48.275690+0000 mon.smithi049 (mon.0) 575 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:48.275722+0000 mon.smithi049 (mon.0) 576 : cluster [INF] Cluster is now healthy 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:48.279430+0000 mon.smithi049 (mon.0) 577 : cluster [DBG] mds.? [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] up:boot 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:48.279488+0000 mon.smithi049 (mon.0) 578 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 1 up:standby 2024-02-22T00:30:48.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:48.279633+0000 mon.smithi049 (mon.0) 579 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:30:49.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.118+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb15c0ff050 con 0x7fb15c0f79a0 2024-02-22T00:30:49.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.631+0000 7fb1597fa700 1 -- 172.21.15.49:0/2212485145 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb15c0ff050 con 0x7fb15c0f79a0 2024-02-22T00:30:49.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb148061180 msgr2=0x7fb148063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb148061180 0x7fb148063640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb15c0f7800 tx=0x7fb14c00b040).stop 2024-02-22T00:30:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 msgr2=0x7fb15c108540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 0x7fb15c108540 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb144013580 tx=0x7fb144009cb0).stop 2024-02-22T00:30:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 shutdown_connections 2024-02-22T00:30:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb148061180 0x7fb148063640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb15c0f6700 0x7fb15c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 --2- 172.21.15.49:0/2212485145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb15c0f79a0 0x7fb15c108540 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:49.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 >> 172.21.15.49:0/2212485145 conn(0x7fb15c0f1e60 msgr2=0x7fb15c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 shutdown_connections 2024-02-22T00:30:49.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:49.634+0000 7fb1628c5700 1 -- 172.21.15.49:0/2212485145 wait complete. 2024-02-22T00:30:49.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:49.120293+0000 mon.smithi049 (mon.0) 580 : audit [INF] from='client.? 172.21.15.49:0/2212485145' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-22T00:30:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:49.120293+0000 mon.smithi049 (mon.0) 580 : audit [INF] from='client.? 172.21.15.49:0/2212485145' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-22T00:30:50.372 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T00:30:50.384 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:30:50.384 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-22T00:30:50.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:49.632739+0000 mon.smithi049 (mon.0) 581 : audit [INF] from='client.? 172.21.15.49:0/2212485145' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-22T00:30:50.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:49.632804+0000 mon.smithi049 (mon.0) 582 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 1 up:standby 2024-02-22T00:30:50.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:49.801567+0000 mgr.smithi049.rjblpr (mgr.14194) 207 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s wr, 11 op/s 2024-02-22T00:30:50.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:50.114916+0000 mon.smithi049 (mon.0) 583 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:50.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:50.116227+0000 mon.smithi049 (mon.0) 584 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:30:51.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:49.632739+0000 mon.smithi049 (mon.0) 581 : audit [INF] from='client.? 172.21.15.49:0/2212485145' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-22T00:30:51.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:49.632804+0000 mon.smithi049 (mon.0) 582 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 1 up:standby 2024-02-22T00:30:51.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:49.801567+0000 mgr.smithi049.rjblpr (mgr.14194) 207 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s wr, 11 op/s 2024-02-22T00:30:51.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:50.114916+0000 mon.smithi049 (mon.0) 583 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:51.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:50.116227+0000 mon.smithi049 (mon.0) 584 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:30:51.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:50.637256+0000 mon.smithi049 (mon.0) 585 : cluster [DBG] mds.? [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] up:boot 2024-02-22T00:30:51.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:50.637315+0000 mon.smithi049 (mon.0) 586 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:30:51.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:50.637411+0000 mon.smithi049 (mon.0) 587 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:30:52.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:50.637256+0000 mon.smithi049 (mon.0) 585 : cluster [DBG] mds.? [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] up:boot 2024-02-22T00:30:52.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:50.637315+0000 mon.smithi049 (mon.0) 586 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:30:52.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:50.637411+0000 mon.smithi049 (mon.0) 587 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:30:52.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 -- 172.21.15.49:0/319241488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 msgr2=0x7f3b300fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 --2- 172.21.15.49:0/319241488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 0x7f3b300fcda0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f3b200047f0 tx=0x7f3b20009cb0).stop 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 -- 172.21.15.49:0/319241488 shutdown_connections 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 --2- 172.21.15.49:0/319241488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 0x7f3b300fcda0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 --2- 172.21.15.49:0/319241488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b30061280 0x7f3b300fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 -- 172.21.15.49:0/319241488 >> 172.21.15.49:0/319241488 conn(0x7f3b300f1e50 msgr2=0x7f3b300f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 -- 172.21.15.49:0/319241488 shutdown_connections 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 -- 172.21.15.49:0/319241488 wait complete. 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 Processor -- start 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 -- start start 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.765+0000 7f3b379dd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b30061280 0x7f3b30107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b379dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 0x7f3b30108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:52.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b379dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30108a00 con 0x7f3b300fa950 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b379dd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30108b40 con 0x7f3b30061280 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b34f78700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 0x7f3b30108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b34f78700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 0x7f3b30108450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45130/0 (socket says 172.21.15.49:45130) 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b34f78700 1 -- 172.21.15.49:0/4052411573 learned_addr learned my addr 172.21.15.49:0/4052411573 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b35779700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b30061280 0x7f3b30107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b34f78700 1 -- 172.21.15.49:0/4052411573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b30061280 msgr2=0x7f3b30107f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b34f78700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b30061280 0x7f3b30107f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b34f78700 1 -- 172.21.15.49:0/4052411573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20005040 con 0x7f3b300fa950 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b34f78700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 0x7f3b30108450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f3b20004f10 tx=0x7f3b20009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b267fc700 1 -- 172.21.15.49:0/4052411573 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b2000e070 con 0x7f3b300fa950 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b267fc700 1 -- 172.21.15.49:0/4052411573 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3b20007e90 con 0x7f3b300fa950 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3010d580 con 0x7f3b300fa950 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b267fc700 1 -- 172.21.15.49:0/4052411573 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b20018070 con 0x7f3b300fa950 2024-02-22T00:30:52.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.766+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3010dac0 con 0x7f3b300fa950 2024-02-22T00:30:52.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.767+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b300fffb0 con 0x7f3b300fa950 2024-02-22T00:30:52.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.768+0000 7f3b267fc700 1 -- 172.21.15.49:0/4052411573 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f3b200123c0 con 0x7f3b300fa950 2024-02-22T00:30:52.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.768+0000 7f3b267fc700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3b1c061110 0x7f3b1c0635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:52.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.768+0000 7f3b267fc700 1 -- 172.21.15.49:0/4052411573 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f3b2007d670 con 0x7f3b300fa950 2024-02-22T00:30:52.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.768+0000 7f3b35779700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3b1c061110 0x7f3b1c0635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:52.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.769+0000 7f3b35779700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3b1c061110 0x7f3b1c0635d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3b2c004dc0 tx=0x7f3b2c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:52.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.772+0000 7f3b267fc700 1 -- 172.21.15.49:0/4052411573 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3b20051600 con 0x7f3b300fa950 2024-02-22T00:30:52.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:52.990+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f3b30101e20 con 0x7f3b300fa950 2024-02-22T00:30:53.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:51.801961+0000 mgr.smithi049.rjblpr (mgr.14194) 208 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-02-22T00:30:53.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:51.965151+0000 mon.smithi049 (mon.0) 588 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:53.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:51.801961+0000 mgr.smithi049.rjblpr (mgr.14194) 208 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s wr, 8 op/s 2024-02-22T00:30:53.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:51.965151+0000 mon.smithi049 (mon.0) 588 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:53.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.970+0000 7f3b267fc700 1 -- 172.21.15.49:0/4052411573 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3b200511f0 con 0x7f3b300fa950 2024-02-22T00:30:53.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3b1c061110 msgr2=0x7f3b1c0635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3b1c061110 0x7f3b1c0635d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3b2c004dc0 tx=0x7f3b2c00b040).stop 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 msgr2=0x7f3b30108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 0x7f3b30108450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f3b20004f10 tx=0x7f3b20009cb0).stop 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 shutdown_connections 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3b1c061110 0x7f3b1c0635d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b30061280 0x7f3b30107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 --2- 172.21.15.49:0/4052411573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3b300fa950 0x7f3b30108450 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 >> 172.21.15.49:0/4052411573 conn(0x7f3b300f1e50 msgr2=0x7f3b300f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 shutdown_connections 2024-02-22T00:30:53.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:53.972+0000 7f3b379dd700 1 -- 172.21.15.49:0/4052411573 wait complete. 2024-02-22T00:30:53.976 INFO:teuthology.orchestra.run.smithi049.stderr:inline data disabled 2024-02-22T00:30:54.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:52.991716+0000 mon.smithi049 (mon.0) 589 : audit [INF] from='client.? 172.21.15.49:0/4052411573' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-22T00:30:54.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:52.995441+0000 mon.smithi049 (mon.0) 590 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:54.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:52.991716+0000 mon.smithi049 (mon.0) 589 : audit [INF] from='client.? 172.21.15.49:0/4052411573' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-22T00:30:54.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:52.995441+0000 mon.smithi049 (mon.0) 590 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:54.831 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T00:30:54.842 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:30:54.843 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-22T00:30:55.158 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:53.802361+0000 mgr.smithi049.rjblpr (mgr.14194) 209 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-02-22T00:30:55.159 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:53.971260+0000 mon.smithi049 (mon.0) 591 : audit [INF] from='client.? 172.21.15.49:0/4052411573' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-22T00:30:55.159 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:53.971311+0000 mon.smithi049 (mon.0) 592 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:30:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:53.802361+0000 mgr.smithi049.rjblpr (mgr.14194) 209 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-02-22T00:30:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:53.971260+0000 mon.smithi049 (mon.0) 591 : audit [INF] from='client.? 172.21.15.49:0/4052411573' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-22T00:30:55.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:53.971311+0000 mon.smithi049 (mon.0) 592 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.987+0000 7fb2fcd23700 1 -- 172.21.15.49:0/4162866516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f8cb0 msgr2=0x7fb2f80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.987+0000 7fb2fcd23700 1 --2- 172.21.15.49:0/4162866516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f8cb0 0x7fb2f80f9110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fb2e00047f0 tx=0x7fb2e0009cb0).stop 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.987+0000 7fb2fcd23700 1 -- 172.21.15.49:0/4162866516 shutdown_connections 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.987+0000 7fb2fcd23700 1 --2- 172.21.15.49:0/4162866516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f8cb0 0x7fb2f80f9110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.987+0000 7fb2fcd23700 1 --2- 172.21.15.49:0/4162866516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2f80f7a10 0x7fb2f80f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.987+0000 7fb2fcd23700 1 -- 172.21.15.49:0/4162866516 >> 172.21.15.49:0/4162866516 conn(0x7fb2f80f3150 msgr2=0x7fb2f80f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.987+0000 7fb2fcd23700 1 -- 172.21.15.49:0/4162866516 shutdown_connections 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.987+0000 7fb2fcd23700 1 -- 172.21.15.49:0/4162866516 wait complete. 2024-02-22T00:30:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2fcd23700 1 Processor -- start 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2fcd23700 1 -- start start 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2fcd23700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f7a10 0x7fb2f806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2fcd23700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2f80f8cb0 0x7fb2f806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2fcd23700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f806cf80 con 0x7fb2f80f7a10 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2fcd23700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f806b520 con 0x7fb2f80f8cb0 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f7a10 0x7fb2f806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f7a10 0x7fb2f806c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45156/0 (socket says 172.21.15.49:45156) 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f659c700 1 -- 172.21.15.49:0/21113155 learned_addr learned my addr 172.21.15.49:0/21113155 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f5d9b700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2f80f8cb0 0x7fb2f806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f659c700 1 -- 172.21.15.49:0/21113155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2f80f8cb0 msgr2=0x7fb2f806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f659c700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2f80f8cb0 0x7fb2f806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f659c700 1 -- 172.21.15.49:0/21113155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0005040 con 0x7fb2f80f7a10 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f5d9b700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2f80f8cb0 0x7fb2f806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:30:56.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.988+0000 7fb2f659c700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f7a10 0x7fb2f806c9d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fb2e800c790 tx=0x7fb2e8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.989+0000 7fb2ef7fe700 1 -- 172.21.15.49:0/21113155 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e80106f0 con 0x7fb2f80f7a10 2024-02-22T00:30:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.989+0000 7fb2ef7fe700 1 -- 172.21.15.49:0/21113155 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb2e8010ce0 con 0x7fb2f80f7a10 2024-02-22T00:30:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.989+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f806b7a0 con 0x7fb2f80f7a10 2024-02-22T00:30:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.989+0000 7fb2ef7fe700 1 -- 172.21.15.49:0/21113155 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e8012dc0 con 0x7fb2f80f7a10 2024-02-22T00:30:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.989+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f806bce0 con 0x7fb2f80f7a10 2024-02-22T00:30:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.990+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f805fb50 con 0x7fb2f80f7a10 2024-02-22T00:30:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.990+0000 7fb2ef7fe700 1 -- 172.21.15.49:0/21113155 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fb2e8012400 con 0x7fb2f80f7a10 2024-02-22T00:30:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.990+0000 7fb2ef7fe700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb2e4061180 0x7fb2e4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:30:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.990+0000 7fb2ef7fe700 1 -- 172.21.15.49:0/21113155 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fb2e807c7f0 con 0x7fb2f80f7a10 2024-02-22T00:30:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.991+0000 7fb2f5d9b700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb2e4061180 0x7fb2e4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:30:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.991+0000 7fb2f5d9b700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb2e4061180 0x7fb2e4063640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb2e0009a00 tx=0x7fb2e0009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:30:56.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:56.995+0000 7fb2ef7fe700 1 -- 172.21.15.49:0/21113155 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb2e8050780 con 0x7fb2f80f7a10 2024-02-22T00:30:57.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:55.802753+0000 mgr.smithi049.rjblpr (mgr.14194) 210 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-02-22T00:30:57.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.254+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb2f81001d0 con 0x7fb2f80f7a10 2024-02-22T00:30:57.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.254+0000 7fb2ef7fe700 1 -- 172.21.15.49:0/21113155 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1771 (secure 0 0 0) 0x7fb2e8050370 con 0x7fb2f80f7a10 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:e12 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 12 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:30:57.258 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:30:53.965310+0000 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:30:57.259 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:30:57.260 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:57.261 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:57.261 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:30:57.261 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:30:57.261 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:30:57.261 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:30:57.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.256+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb2e4061180 msgr2=0x7fb2e4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:57.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.256+0000 7fb2fcd23700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb2e4061180 0x7fb2e4063640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb2e0009a00 tx=0x7fb2e0009cb0).stop 2024-02-22T00:30:57.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.256+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f7a10 msgr2=0x7fb2f806c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:30:57.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.256+0000 7fb2fcd23700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f7a10 0x7fb2f806c9d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fb2e800c790 tx=0x7fb2e8007f90).stop 2024-02-22T00:30:57.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.256+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 shutdown_connections 2024-02-22T00:30:57.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.257+0000 7fb2fcd23700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2f80f7a10 0x7fb2f806c9d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:57.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.257+0000 7fb2fcd23700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb2e4061180 0x7fb2e4063640 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:57.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.257+0000 7fb2fcd23700 1 --2- 172.21.15.49:0/21113155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2f80f8cb0 0x7fb2f806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:30:57.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.257+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 >> 172.21.15.49:0/21113155 conn(0x7fb2f80f3150 msgr2=0x7fb2f80fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:30:57.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.257+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 shutdown_connections 2024-02-22T00:30:57.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:30:57.257+0000 7fb2fcd23700 1 -- 172.21.15.49:0/21113155 wait complete. 2024-02-22T00:30:57.263 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 12 2024-02-22T00:30:57.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:55.802753+0000 mgr.smithi049.rjblpr (mgr.14194) 210 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-02-22T00:30:57.874 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-22T00:30:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:57.175508+0000 mon.smithi049 (mon.0) 593 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:57.176289+0000 mon.smithi049 (mon.0) 594 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:57.176923+0000 mon.smithi049 (mon.0) 595 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:30:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:57.180859+0000 mon.smithi049 (mon.0) 596 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:57.185058+0000 mon.smithi049 (mon.0) 597 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:30:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:30:57.255873+0000 mon.smithi049 (mon.0) 598 : audit [DBG] from='client.? 172.21.15.49:0/21113155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:30:58.507 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:57.175508+0000 mon.smithi049 (mon.0) 593 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:58.507 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:57.176289+0000 mon.smithi049 (mon.0) 594 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:30:58.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:57.176923+0000 mon.smithi049 (mon.0) 595 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:30:58.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:57.180859+0000 mon.smithi049 (mon.0) 596 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:30:58.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:57.185058+0000 mon.smithi049 (mon.0) 597 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:30:58.508 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:30:57.255873+0000 mon.smithi049 (mon.0) 598 : audit [DBG] from='client.? 172.21.15.49:0/21113155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:30:59.450 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:30:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:57.803254+0000 mgr.smithi049.rjblpr (mgr.14194) 211 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-02-22T00:30:59.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:30:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:57.803254+0000 mgr.smithi049.rjblpr (mgr.14194) 211 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-02-22T00:31:00.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.201+0000 7f160bc71700 1 -- 172.21.15.49:0/1465010599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f66f0 msgr2=0x7f16040f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.201+0000 7f160bc71700 1 --2- 172.21.15.49:0/1465010599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f66f0 0x7f16040f6b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f16000047f0 tx=0x7f1600009cb0).stop 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.201+0000 7f160bc71700 1 -- 172.21.15.49:0/1465010599 shutdown_connections 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.201+0000 7f160bc71700 1 --2- 172.21.15.49:0/1465010599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16040f7990 0x7f16040f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.201+0000 7f160bc71700 1 --2- 172.21.15.49:0/1465010599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f66f0 0x7f16040f6b10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.201+0000 7f160bc71700 1 -- 172.21.15.49:0/1465010599 >> 172.21.15.49:0/1465010599 conn(0x7f16040f1e50 msgr2=0x7f16040f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.201+0000 7f160bc71700 1 -- 172.21.15.49:0/1465010599 shutdown_connections 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.201+0000 7f160bc71700 1 -- 172.21.15.49:0/1465010599 wait complete. 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160bc71700 1 Processor -- start 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160bc71700 1 -- start start 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160bc71700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16040f66f0 0x7f16040610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160bc71700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f7990 0x7f160410ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160bc71700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160410d330 con 0x7f16040f7990 2024-02-22T00:31:00.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160bc71700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160410d470 con 0x7f16040f66f0 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160920c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f7990 0x7f160410ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160920c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f7990 0x7f160410ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45170/0 (socket says 172.21.15.49:45170) 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160920c700 1 -- 172.21.15.49:0/2979196267 learned_addr learned my addr 172.21.15.49:0/2979196267 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f1609a0d700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16040f66f0 0x7f16040610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160920c700 1 -- 172.21.15.49:0/2979196267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16040f66f0 msgr2=0x7f16040610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160920c700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16040f66f0 0x7f16040610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160920c700 1 -- 172.21.15.49:0/2979196267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600005040 con 0x7f16040f7990 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.202+0000 7f160920c700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f7990 0x7f160410ce40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f15f400e910 tx=0x7f15f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.203+0000 7f15faffd700 1 -- 172.21.15.49:0/2979196267 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f4007b40 con 0x7f16040f7990 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.203+0000 7f15faffd700 1 -- 172.21.15.49:0/2979196267 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f15f400f040 con 0x7f16040f7990 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.203+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160410d6a0 con 0x7f16040f7990 2024-02-22T00:31:00.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.203+0000 7f15faffd700 1 -- 172.21.15.49:0/2979196267 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f4014850 con 0x7f16040f7990 2024-02-22T00:31:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.203+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160410dc60 con 0x7f16040f7990 2024-02-22T00:31:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.204+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16040feed0 con 0x7f16040f7990 2024-02-22T00:31:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.204+0000 7f15faffd700 1 -- 172.21.15.49:0/2979196267 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f15f4014b10 con 0x7f16040f7990 2024-02-22T00:31:00.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.204+0000 7f15faffd700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f15f0061180 0x7f15f0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.205+0000 7f15faffd700 1 -- 172.21.15.49:0/2979196267 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f15f407c260 con 0x7f16040f7990 2024-02-22T00:31:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.205+0000 7f1609a0d700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f15f0061180 0x7f15f0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:00.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.205+0000 7f1609a0d700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f15f0061180 0x7f15f0063640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f16000047c0 tx=0x7f1600009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:00.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.209+0000 7f15faffd700 1 -- 172.21.15.49:0/2979196267 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f15f4049f60 con 0x7f16040f7990 2024-02-22T00:31:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.435+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16040598f0 con 0x7f16040f7990 2024-02-22T00:31:00.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.436+0000 7f15faffd700 1 -- 172.21.15.49:0/2979196267 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f15f40501f0 con 0x7f16040f7990 2024-02-22T00:31:00.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.437+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f15f0061180 msgr2=0x7f15f0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.437+0000 7f160bc71700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f15f0061180 0x7f15f0063640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f16000047c0 tx=0x7f1600009cb0).stop 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.437+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f7990 msgr2=0x7f160410ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.437+0000 7f160bc71700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f7990 0x7f160410ce40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f15f400e910 tx=0x7f15f400b040).stop 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.438+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 shutdown_connections 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.438+0000 7f160bc71700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f15f0061180 0x7f15f0063640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.438+0000 7f160bc71700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16040f66f0 0x7f16040610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.438+0000 7f160bc71700 1 --2- 172.21.15.49:0/2979196267 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16040f7990 0x7f160410ce40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.438+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 >> 172.21.15.49:0/2979196267 conn(0x7f16040f1e50 msgr2=0x7f16040fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.438+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 shutdown_connections 2024-02-22T00:31:00.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:00.438+0000 7f160bc71700 1 -- 172.21.15.49:0/2979196267 wait complete. 2024-02-22T00:31:00.442 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 12 2024-02-22T00:31:00.451 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:31:01.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-22T00:31:01.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:30:59.803839+0000 mgr.smithi049.rjblpr (mgr.14194) 212 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 1 op/s 2024-02-22T00:31:01.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:00.298859+0000 mon.smithi049 (mon.0) 599 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:01.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:00.436970+0000 mon.smithi049 (mon.0) 600 : audit [DBG] from='client.? 172.21.15.49:0/2979196267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-22T00:31:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:30:59.803839+0000 mgr.smithi049.rjblpr (mgr.14194) 212 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 1 op/s 2024-02-22T00:31:01.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:00.298859+0000 mon.smithi049 (mon.0) 599 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:01.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:00.436970+0000 mon.smithi049 (mon.0) 600 : audit [DBG] from='client.? 172.21.15.49:0/2979196267' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-22T00:31:03.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:01.804196+0000 mgr.smithi049.rjblpr (mgr.14194) 213 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-22T00:31:03.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:01.911709+0000 mon.smithi049 (mon.0) 601 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:03.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:01.804196+0000 mgr.smithi049.rjblpr (mgr.14194) 213 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-02-22T00:31:03.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:01.911709+0000 mon.smithi049 (mon.0) 601 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.469+0000 7f5b31e7d700 1 -- 172.21.15.49:0/3977401752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f66f0 msgr2=0x7f5b2c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.469+0000 7f5b31e7d700 1 --2- 172.21.15.49:0/3977401752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f66f0 0x7f5b2c0f6b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f5b200047f0 tx=0x7f5b20009cb0).stop 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.469+0000 7f5b31e7d700 1 -- 172.21.15.49:0/3977401752 shutdown_connections 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.469+0000 7f5b31e7d700 1 --2- 172.21.15.49:0/3977401752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b2c0f7990 0x7f5b2c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.469+0000 7f5b31e7d700 1 --2- 172.21.15.49:0/3977401752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f66f0 0x7f5b2c0f6b10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.469+0000 7f5b31e7d700 1 -- 172.21.15.49:0/3977401752 >> 172.21.15.49:0/3977401752 conn(0x7f5b2c0f1e50 msgr2=0x7f5b2c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.470+0000 7f5b31e7d700 1 -- 172.21.15.49:0/3977401752 shutdown_connections 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.470+0000 7f5b31e7d700 1 -- 172.21.15.49:0/3977401752 wait complete. 2024-02-22T00:31:03.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.470+0000 7f5b31e7d700 1 Processor -- start 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.470+0000 7f5b31e7d700 1 -- start start 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.470+0000 7f5b31e7d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b2c0f66f0 0x7f5b2c0fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b31e7d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f7990 0x7f5b2c0f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b31e7d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0fac20 con 0x7f5b2c0f7990 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b31e7d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0f91c0 con 0x7f5b2c0f66f0 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b2affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f7990 0x7f5b2c0f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b2affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f7990 0x7f5b2c0f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34608/0 (socket says 172.21.15.49:34608) 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b2affd700 1 -- 172.21.15.49:0/492556489 learned_addr learned my addr 172.21.15.49:0/492556489 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b2b7fe700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b2c0f66f0 0x7f5b2c0fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b2affd700 1 -- 172.21.15.49:0/492556489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b2c0f66f0 msgr2=0x7f5b2c0fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b2affd700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b2c0f66f0 0x7f5b2c0fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:03.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b2affd700 1 -- 172.21.15.49:0/492556489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20005040 con 0x7f5b2c0f7990 2024-02-22T00:31:03.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b2affd700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f7990 0x7f5b2c0f8cd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5b1c0041d0 tx=0x7f5b1c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:03.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b28ff9700 1 -- 172.21.15.49:0/492556489 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c007b40 con 0x7f5b2c0f7990 2024-02-22T00:31:03.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0f9440 con 0x7f5b2c0f7990 2024-02-22T00:31:03.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b28ff9700 1 -- 172.21.15.49:0/492556489 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5b1c00f040 con 0x7f5b2c0f7990 2024-02-22T00:31:03.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b28ff9700 1 -- 172.21.15.49:0/492556489 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c013730 con 0x7f5b2c0f7990 2024-02-22T00:31:03.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.471+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c0f9980 con 0x7f5b2c0f7990 2024-02-22T00:31:03.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.472+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c0feed0 con 0x7f5b2c0f7990 2024-02-22T00:31:03.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.473+0000 7f5b28ff9700 1 -- 172.21.15.49:0/492556489 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f5b1c009110 con 0x7f5b2c0f7990 2024-02-22T00:31:03.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.473+0000 7f5b28ff9700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b14061180 0x7f5b14063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:03.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.473+0000 7f5b28ff9700 1 -- 172.21.15.49:0/492556489 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f5b1c07c2a0 con 0x7f5b2c0f7990 2024-02-22T00:31:03.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.473+0000 7f5b2b7fe700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b14061180 0x7f5b14063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:03.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.474+0000 7f5b2b7fe700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b14061180 0x7f5b14063640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f5b20004f10 tx=0x7f5b2000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:03.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.478+0000 7f5b28ff9700 1 -- 172.21.15.49:0/492556489 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5b1c050230 con 0x7f5b2c0f7990 2024-02-22T00:31:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.715+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f5b2c110730 con 0x7f5b2c0f7990 2024-02-22T00:31:03.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.716+0000 7f5b28ff9700 1 -- 172.21.15.49:0/492556489 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v12) v1 ==== 78+0+101 (secure 0 0 0) 0x7f5b1c04fe20 con 0x7f5b2c0f7990 2024-02-22T00:31:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b14061180 msgr2=0x7f5b14063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b14061180 0x7f5b14063640 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f5b20004f10 tx=0x7f5b2000b040).stop 2024-02-22T00:31:03.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f7990 msgr2=0x7f5b2c0f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f7990 0x7f5b2c0f8cd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5b1c0041d0 tx=0x7f5b1c009f60).stop 2024-02-22T00:31:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 shutdown_connections 2024-02-22T00:31:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5b14061180 0x7f5b14063640 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b2c0f66f0 0x7f5b2c0fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 --2- 172.21.15.49:0/492556489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b2c0f7990 0x7f5b2c0f8cd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.717+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 >> 172.21.15.49:0/492556489 conn(0x7f5b2c0f1e50 msgr2=0x7f5b2c060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.718+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 shutdown_connections 2024-02-22T00:31:03.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:03.718+0000 7f5b31e7d700 1 -- 172.21.15.49:0/492556489 wait complete. 2024-02-22T00:31:03.730 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:31:04.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:03.716941+0000 mon.smithi049 (mon.0) 602 : audit [DBG] from='client.? 172.21.15.49:0/492556489' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-22T00:31:04.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:03.716941+0000 mon.smithi049 (mon.0) 602 : audit [DBG] from='client.? 172.21.15.49:0/492556489' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-22T00:31:04.737 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-22T00:31:04.750 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-22T00:31:05.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.153+0000 7f9fe162a700 1 -- 172.21.15.49:0/1337168246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0612a0 msgr2=0x7f9fdc0fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.153+0000 7f9fe162a700 1 --2- 172.21.15.49:0/1337168246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0612a0 0x7f9fdc0fa3d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9fcc0047f0 tx=0x7f9fcc009cb0).stop 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.153+0000 7f9fe162a700 1 -- 172.21.15.49:0/1337168246 shutdown_connections 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.153+0000 7f9fe162a700 1 --2- 172.21.15.49:0/1337168246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fdc0fa950 0x7f9fdc0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.153+0000 7f9fe162a700 1 --2- 172.21.15.49:0/1337168246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0612a0 0x7f9fdc0fa3d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.153+0000 7f9fe162a700 1 -- 172.21.15.49:0/1337168246 >> 172.21.15.49:0/1337168246 conn(0x7f9fdc0f1df0 msgr2=0x7f9fdc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.153+0000 7f9fe162a700 1 -- 172.21.15.49:0/1337168246 shutdown_connections 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.153+0000 7f9fe162a700 1 -- 172.21.15.49:0/1337168246 wait complete. 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fe162a700 1 Processor -- start 2024-02-22T00:31:05.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fe162a700 1 -- start start 2024-02-22T00:31:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fe162a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fdc0612a0 0x7f9fdc0f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fe162a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0fa950 0x7f9fdc0f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fe162a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0f67c0 con 0x7f9fdc0fa950 2024-02-22T00:31:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fe162a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0f6900 con 0x7f9fdc0612a0 2024-02-22T00:31:05.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fda7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0fa950 0x7f9fdc0f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fda7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0fa950 0x7f9fdc0f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34620/0 (socket says 172.21.15.49:34620) 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.154+0000 7f9fda7fc700 1 -- 172.21.15.49:0/1652108442 learned_addr learned my addr 172.21.15.49:0/1652108442 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fdaffd700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fdc0612a0 0x7f9fdc0f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fda7fc700 1 -- 172.21.15.49:0/1652108442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fdc0612a0 msgr2=0x7f9fdc0f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fda7fc700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fdc0612a0 0x7f9fdc0f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fda7fc700 1 -- 172.21.15.49:0/1652108442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc005040 con 0x7f9fdc0fa950 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fda7fc700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0fa950 0x7f9fdc0f62d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f9fd000b480 tx=0x7f9fd00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fc3fff700 1 -- 172.21.15.49:0/1652108442 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd0002500 con 0x7f9fdc0fa950 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fc3fff700 1 -- 172.21.15.49:0/1652108442 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9fd0002af0 con 0x7f9fdc0fa950 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc0f6be0 con 0x7f9fdc0fa950 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fc3fff700 1 -- 172.21.15.49:0/1652108442 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd0012c30 con 0x7f9fdc0fa950 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.155+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc0f7120 con 0x7f9fdc0fa950 2024-02-22T00:31:05.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.156+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc100050 con 0x7f9fdc0fa950 2024-02-22T00:31:05.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.156+0000 7f9fc3fff700 1 -- 172.21.15.49:0/1652108442 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f9fd0002660 con 0x7f9fdc0fa950 2024-02-22T00:31:05.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.157+0000 7f9fc3fff700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9fc4061180 0x7f9fc4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.157+0000 7f9fc3fff700 1 -- 172.21.15.49:0/1652108442 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f9fd007c850 con 0x7f9fdc0fa950 2024-02-22T00:31:05.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.157+0000 7f9fdaffd700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9fc4061180 0x7f9fc4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.157+0000 7f9fdaffd700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9fc4061180 0x7f9fc4063640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9fcc007cf0 tx=0x7f9fcc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:05.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.161+0000 7f9fc3fff700 1 -- 172.21.15.49:0/1652108442 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9fd0050800 con 0x7f9fdc0fa950 2024-02-22T00:31:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:03.804553+0000 mgr.smithi049.rjblpr (mgr.14194) 214 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:03.804553+0000 mgr.smithi049.rjblpr (mgr.14194) 214 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:05.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.377+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fdc0598f0 con 0x7f9fdc0fa950 2024-02-22T00:31:05.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.378+0000 7f9fc3fff700 1 -- 172.21.15.49:0/1652108442 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14098 (secure 0 0 0) 0x7f9fd00503f0 con 0x7f9fdc0fa950 2024-02-22T00:31:05.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:31:05.381 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":43,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","created":"2024-02-22T00:24:07.498307+0000","modified":"2024-02-22T00:30:40.239200+0000","last_up_change":"2024-02-22T00:29:18.697160+0000","last_in_change":"2024-02-22T00:29:00.339229+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T00:28:03.647916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-22T00:30:37.161023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-22T00:30:37.647309+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14701491-880b-4aa8-b29c-2f93fad67550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6803","nonce":683996799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6805","nonce":683996799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6809","nonce":683996799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":683996799},{"type":"v1","addr":"172.21.15.49:6807","nonce":683996799}]},"public_addr":"172.21.15.49:6803/683996799","cluster_addr":"172.21.15.49:6805/683996799","heartbeat_back_addr":"172.21.15.49:6809/683996799","heartbeat_front_addr":"172.21.15.49:6807/683996799","state":["exists","up"]},{"osd":1,"uuid":"6a984f0c-ab4d-4881-baf7-7821af596292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6811","nonce":3836451812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6813","nonce":3836451812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6817","nonce":3836451812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3836451812},{"type":"v1","addr":"172.21.15.49:6815","nonce":3836451812}]},"public_addr":"172.21.15.49:6811/3836451812","cluster_addr":"172.21.15.49:6813/3836451812","heartbeat_back_addr":"172.21.15.49:6817/3836451812","heartbeat_front_addr":"172.21.15.49:6815/3836451812","state":["exists","up"]},{"osd":2,"uuid":"fdbc04fa-88df-4bd8-9272-38e17a0ddc99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6819","nonce":153604959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6821","nonce":153604959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6825","nonce":153604959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":153604959},{"type":"v1","addr":"172.21.15.49:6823","nonce":153604959}]},"public_addr":"172.21.15.49:6819/153604959","cluster_addr":"172.21.15.49:6821/153604959","heartbeat_back_addr":"172.21.15.49:6825/153604959","heartbeat_front_addr":"172.21.15.49:6823/153604959","state":["exists","up"]},{"osd":3,"uuid":"b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6801","nonce":1725433098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6803","nonce":1725433098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6807","nonce":1725433098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1725433098},{"type":"v1","addr":"172.21.15.161:6805","nonce":1725433098}]},"public_addr":"172.21.15.161:6801/1725433098","cluster_addr":"172.21.15.161:6803/1725433098","heartbeat_back_addr":"172.21.15.161:6807/1725433098","heartbeat_front_addr":"172.21.15.161:6805/1725433098","state":["exists","up"]},{"osd":4,"uuid":"a017d7c9-0283-4fe1-8839-1ccbdbd95972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6809","nonce":1996423243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6811","nonce":1996423243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6815","nonce":1996423243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1996423243},{"type":"v1","addr":"172.21.15.161:6813","nonce":1996423243}]},"public_addr":"172.21.15.161:6809/1996423243","cluster_addr":"172.21.15.161:6811/1996423243","heartbeat_back_addr":"172.21.15.161:6815/1996423243","heartbeat_front_addr":"172.21.15.161:6813/1996423243","state":["exists","up"]},{"osd":5,"uuid":"3f97d2c3-52e0-490a-a7ec-d989884f03a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6817","nonce":1791237181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6819","nonce":1791237181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6823","nonce":1791237181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":1791237181},{"type":"v1","addr":"172.21.15.161:6821","nonce":1791237181}]},"public_addr":"172.21.15.161:6817/1791237181","cluster_addr":"172.21.15.161:6819/1791237181","heartbeat_back_addr":"172.21.15.161:6823/1791237181","heartbeat_front_addr":"172.21.15.161:6821/1791237181","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:26:57.942621+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:27:33.707227+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:01.399431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:25.246971+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:51.257793+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:29:17.568705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:6801/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/1752326277":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/755765908":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/2319195782":"2024-02-23T00:25:10.135002+0000","172.21.15.49:6801/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:6800/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/4194533393":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6801/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/1567499828":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/3181714365":"2024-02-23T00:24:40.044887+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-22T00:31:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9fc4061180 msgr2=0x7f9fc4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9fc4061180 0x7f9fc4063640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9fcc007cf0 tx=0x7f9fcc00b040).stop 2024-02-22T00:31:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0fa950 msgr2=0x7f9fdc0f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0fa950 0x7f9fdc0f62d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f9fd000b480 tx=0x7f9fd00090f0).stop 2024-02-22T00:31:05.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 shutdown_connections 2024-02-22T00:31:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f9fc4061180 0x7f9fc4063640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fdc0612a0 0x7f9fdc0f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 --2- 172.21.15.49:0/1652108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9fdc0fa950 0x7f9fdc0f62d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 >> 172.21.15.49:0/1652108442 conn(0x7f9fdc0f1df0 msgr2=0x7f9fdc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 shutdown_connections 2024-02-22T00:31:05.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.380+0000 7f9fe162a700 1 -- 172.21.15.49:0/1652108442 wait complete. 2024-02-22T00:31:05.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-22T00:28:03.647916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-22T00:30:37.161023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-22T00:30:37.647309+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-22T00:31:05.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-02-22T00:31:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 -- 172.21.15.49:0/2329189025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f6710 msgr2=0x7f54040f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 --2- 172.21.15.49:0/2329189025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f6710 0x7f54040f6b30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f54000047f0 tx=0x7f5400009cb0).stop 2024-02-22T00:31:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 -- 172.21.15.49:0/2329189025 shutdown_connections 2024-02-22T00:31:05.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 --2- 172.21.15.49:0/2329189025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54040f7020 0x7f54040f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 --2- 172.21.15.49:0/2329189025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f6710 0x7f54040f6b30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 -- 172.21.15.49:0/2329189025 >> 172.21.15.49:0/2329189025 conn(0x7f54040f1ec0 msgr2=0x7f54040f42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 -- 172.21.15.49:0/2329189025 shutdown_connections 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 -- 172.21.15.49:0/2329189025 wait complete. 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 Processor -- start 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.518+0000 7f540c6e2700 1 -- start start 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f540c6e2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54040f6710 0x7f5404061670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f540c6e2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f7020 0x7f540410ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f540c6e2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540410d320 con 0x7f54040f7020 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f540c6e2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540410d460 con 0x7f54040f6710 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f5409c7d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f7020 0x7f540410ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f5409c7d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f7020 0x7f540410ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34628/0 (socket says 172.21.15.49:34628) 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f5409c7d700 1 -- 172.21.15.49:0/2479545552 learned_addr learned my addr 172.21.15.49:0/2479545552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f540a47e700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54040f6710 0x7f5404061670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f5409c7d700 1 -- 172.21.15.49:0/2479545552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54040f6710 msgr2=0x7f5404061670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f5409c7d700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54040f6710 0x7f5404061670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f5409c7d700 1 -- 172.21.15.49:0/2479545552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400005040 con 0x7f54040f7020 2024-02-22T00:31:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f5409c7d700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f7020 0x7f540410ce30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f53f40027b0 tx=0x7f53f4009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f53fb7fe700 1 -- 172.21.15.49:0/2479545552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f4007b40 con 0x7f54040f7020 2024-02-22T00:31:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f53fb7fe700 1 -- 172.21.15.49:0/2479545552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f53f400f040 con 0x7f54040f7020 2024-02-22T00:31:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540410d6c0 con 0x7f54040f7020 2024-02-22T00:31:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f53fb7fe700 1 -- 172.21.15.49:0/2479545552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f4014740 con 0x7f54040f7020 2024-02-22T00:31:05.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.519+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540410dc00 con 0x7f54040f7020 2024-02-22T00:31:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.521+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54040feec0 con 0x7f54040f7020 2024-02-22T00:31:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.521+0000 7f53fb7fe700 1 -- 172.21.15.49:0/2479545552 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f53f4009110 con 0x7f54040f7020 2024-02-22T00:31:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.521+0000 7f53fb7fe700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f53f0061180 0x7f53f0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.521+0000 7f53fb7fe700 1 -- 172.21.15.49:0/2479545552 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f53f407c800 con 0x7f54040f7020 2024-02-22T00:31:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.521+0000 7f540a47e700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f53f0061180 0x7f53f0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.521+0000 7f540a47e700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f53f0061180 0x7f53f0063640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5400004f10 tx=0x7f540000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:05.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.525+0000 7f53fb7fe700 1 -- 172.21.15.49:0/2479545552 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f53f4050790 con 0x7f54040f7020 2024-02-22T00:31:05.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.697+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5404059920 con 0x7f54040f7020 2024-02-22T00:31:05.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.697+0000 7f53fb7fe700 1 -- 172.21.15.49:0/2479545552 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v43) v1 ==== 110+0+10 (secure 0 0 0) 0x7f53f4050380 con 0x7f54040f7020 2024-02-22T00:31:05.700 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-02-22T00:31:05.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f53f0061180 msgr2=0x7f53f0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f53f0061180 0x7f53f0063640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5400004f10 tx=0x7f540000b040).stop 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f7020 msgr2=0x7f540410ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f7020 0x7f540410ce30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f53f40027b0 tx=0x7f53f4009ee0).stop 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 shutdown_connections 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f53f0061180 0x7f53f0063640 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54040f6710 0x7f5404061670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 --2- 172.21.15.49:0/2479545552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54040f7020 0x7f540410ce30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 >> 172.21.15.49:0/2479545552 conn(0x7f54040f1ec0 msgr2=0x7f54040fb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 shutdown_connections 2024-02-22T00:31:05.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.699+0000 7f540c6e2700 1 -- 172.21.15.49:0/2479545552 wait complete. 2024-02-22T00:31:05.715 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-22T00:31:05.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.834+0000 7f505bc6b700 1 -- 172.21.15.49:0/2576560443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 msgr2=0x7f50540f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.834+0000 7f505bc6b700 1 --2- 172.21.15.49:0/2576560443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 0x7f50540f6af0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f50500047f0 tx=0x7f5050009cb0).stop 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.834+0000 7f505bc6b700 1 -- 172.21.15.49:0/2576560443 shutdown_connections 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.834+0000 7f505bc6b700 1 --2- 172.21.15.49:0/2576560443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50540f7970 0x7f50540f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.834+0000 7f505bc6b700 1 --2- 172.21.15.49:0/2576560443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 0x7f50540f6af0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.834+0000 7f505bc6b700 1 -- 172.21.15.49:0/2576560443 >> 172.21.15.49:0/2576560443 conn(0x7f50540f1df0 msgr2=0x7f50540f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f505bc6b700 1 -- 172.21.15.49:0/2576560443 shutdown_connections 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f505bc6b700 1 -- 172.21.15.49:0/2576560443 wait complete. 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f505bc6b700 1 Processor -- start 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f505bc6b700 1 -- start start 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f505bc6b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 0x7f50540fa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f505bc6b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50540f7970 0x7f50540f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f505bc6b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540fac00 con 0x7f50540f66d0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f505bc6b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540f91a0 con 0x7f50540f7970 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f5059a07700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 0x7f50540fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f5059a07700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 0x7f50540fa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34654/0 (socket says 172.21.15.49:34654) 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.835+0000 7f5059a07700 1 -- 172.21.15.49:0/3531071274 learned_addr learned my addr 172.21.15.49:0/3531071274 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f5059a07700 1 -- 172.21.15.49:0/3531071274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50540f7970 msgr2=0x7f50540f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f5059206700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50540f7970 0x7f50540f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f5059a07700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50540f7970 0x7f50540f8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f5059a07700 1 -- 172.21.15.49:0/3531071274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050005040 con 0x7f50540f66d0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f5059206700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50540f7970 0x7f50540f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f5059a07700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 0x7f50540fa650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f5050004f10 tx=0x7f5050009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f504affd700 1 -- 172.21.15.49:0/3531071274 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f505000e070 con 0x7f50540f66d0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50540f93c0 con 0x7f50540f66d0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f504affd700 1 -- 172.21.15.49:0/3531071274 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5050007e90 con 0x7f50540f66d0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f504affd700 1 -- 172.21.15.49:0/3531071274 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5050018070 con 0x7f50540f66d0 2024-02-22T00:31:05.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.836+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50540f98a0 con 0x7f50540f66d0 2024-02-22T00:31:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.837+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50540f9ac0 con 0x7f50540f66d0 2024-02-22T00:31:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.838+0000 7f504affd700 1 -- 172.21.15.49:0/3531071274 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f50500123c0 con 0x7f50540f66d0 2024-02-22T00:31:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.838+0000 7f504affd700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5040061180 0x7f5040063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.838+0000 7f504affd700 1 -- 172.21.15.49:0/3531071274 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f505007d790 con 0x7f50540f66d0 2024-02-22T00:31:05.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.838+0000 7f5059206700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5040061180 0x7f5040063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:05.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.838+0000 7f5059206700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5040061180 0x7f5040063640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f5044004c80 tx=0x7f504400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:05.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:05.842+0000 7f504affd700 1 -- 172.21.15.49:0/3531071274 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5050051720 con 0x7f50540f66d0 2024-02-22T00:31:06.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.012+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f50540fee90 con 0x7f50540f66d0 2024-02-22T00:31:06.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.013+0000 7f504affd700 1 -- 172.21.15.49:0/3531071274 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f5050051310 con 0x7f50540f66d0 2024-02-22T00:31:06.016 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5040061180 msgr2=0x7f5040063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5040061180 0x7f5040063640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f5044004c80 tx=0x7f504400b040).stop 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 msgr2=0x7f50540fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 0x7f50540fa650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f5050004f10 tx=0x7f5050009cb0).stop 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 shutdown_connections 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f50540f66d0 0x7f50540fa650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5040061180 0x7f5040063640 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 --2- 172.21.15.49:0/3531071274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50540f7970 0x7f50540f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 >> 172.21.15.49:0/3531071274 conn(0x7f50540f1df0 msgr2=0x7f5054060d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 shutdown_connections 2024-02-22T00:31:06.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.015+0000 7f505bc6b700 1 -- 172.21.15.49:0/3531071274 wait complete. 2024-02-22T00:31:06.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-22T00:31:06.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.149+0000 7f417ae7f700 1 -- 172.21.15.49:0/1024931384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 msgr2=0x7f41740ff0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.149+0000 7f417ae7f700 1 --2- 172.21.15.49:0/1024931384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 0x7f41740ff0f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f41600047f0 tx=0x7f4160009cb0).stop 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.149+0000 7f417ae7f700 1 -- 172.21.15.49:0/1024931384 shutdown_connections 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.149+0000 7f417ae7f700 1 --2- 172.21.15.49:0/1024931384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 0x7f41740ff0f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.149+0000 7f417ae7f700 1 --2- 172.21.15.49:0/1024931384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4174061240 0x7f41740fc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.149+0000 7f417ae7f700 1 -- 172.21.15.49:0/1024931384 >> 172.21.15.49:0/1024931384 conn(0x7f41740f1df0 msgr2=0x7f41740f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f417ae7f700 1 -- 172.21.15.49:0/1024931384 shutdown_connections 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f417ae7f700 1 -- 172.21.15.49:0/1024931384 wait complete. 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f417ae7f700 1 Processor -- start 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f417ae7f700 1 -- start start 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f417ae7f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4174061240 0x7f417410a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f417ae7f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 0x7f417410a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:06.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f417ae7f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417410acd0 con 0x7f41740fcd00 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f417ae7f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417410ae10 con 0x7f4174061240 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.150+0000 7f4173fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 0x7f417410a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4173fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 0x7f417410a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34672/0 (socket says 172.21.15.49:34672) 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4173fff700 1 -- 172.21.15.49:0/2365430468 learned_addr learned my addr 172.21.15.49:0/2365430468 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4178c1b700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4174061240 0x7f417410a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4173fff700 1 -- 172.21.15.49:0/2365430468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4174061240 msgr2=0x7f417410a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4173fff700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4174061240 0x7f417410a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4173fff700 1 -- 172.21.15.49:0/2365430468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160005040 con 0x7f41740fcd00 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4173fff700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 0x7f417410a720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4160013580 tx=0x7f4160009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4171ffb700 1 -- 172.21.15.49:0/2365430468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4160018070 con 0x7f41740fcd00 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4171ffb700 1 -- 172.21.15.49:0/2365430468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4160007e90 con 0x7f41740fcd00 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f4171ffb700 1 -- 172.21.15.49:0/2365430468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41600123c0 con 0x7f41740fcd00 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417410f850 con 0x7f41740fcd00 2024-02-22T00:31:06.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.151+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417410fe10 con 0x7f41740fcd00 2024-02-22T00:31:06.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.152+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4174102190 con 0x7f41740fcd00 2024-02-22T00:31:06.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.153+0000 7f4171ffb700 1 -- 172.21.15.49:0/2365430468 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f416001d420 con 0x7f41740fcd00 2024-02-22T00:31:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.153+0000 7f4171ffb700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4164061180 0x7f4164063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.153+0000 7f4171ffb700 1 -- 172.21.15.49:0/2365430468 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f416007d540 con 0x7f41740fcd00 2024-02-22T00:31:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.153+0000 7f4178c1b700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4164061180 0x7f4164063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:06.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.153+0000 7f4178c1b700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4164061180 0x7f4164063640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f41680048b0 tx=0x7f416800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:06.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.157+0000 7f4171ffb700 1 -- 172.21.15.49:0/2365430468 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f41600514d0 con 0x7f41740fcd00 2024-02-22T00:31:06.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.331+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f41740599b0 con 0x7f41740fcd00 2024-02-22T00:31:06.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.331+0000 7f4171ffb700 1 -- 172.21.15.49:0/2365430468 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4160013e60 con 0x7f41740fcd00 2024-02-22T00:31:06.335 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-02-22T00:31:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4164061180 msgr2=0x7f4164063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4164061180 0x7f4164063640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f41680048b0 tx=0x7f416800b040).stop 2024-02-22T00:31:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 msgr2=0x7f417410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 0x7f417410a720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4160013580 tx=0x7f4160009cb0).stop 2024-02-22T00:31:06.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 shutdown_connections 2024-02-22T00:31:06.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f4164061180 0x7f4164063640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4174061240 0x7f417410a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 --2- 172.21.15.49:0/2365430468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41740fcd00 0x7f417410a720 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 >> 172.21.15.49:0/2365430468 conn(0x7f41740f1df0 msgr2=0x7f41740f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:06.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 shutdown_connections 2024-02-22T00:31:06.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.333+0000 7f417ae7f700 1 -- 172.21.15.49:0/2365430468 wait complete. 2024-02-22T00:31:06.348 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-22T00:31:06.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.465+0000 7f7e05572700 1 -- 172.21.15.49:0/61539665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 msgr2=0x7f7e000f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.465+0000 7f7e05572700 1 --2- 172.21.15.49:0/61539665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 0x7f7e000f7dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f7df40047f0 tx=0x7f7df4009cb0).stop 2024-02-22T00:31:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.465+0000 7f7e05572700 1 -- 172.21.15.49:0/61539665 shutdown_connections 2024-02-22T00:31:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.465+0000 7f7e05572700 1 --2- 172.21.15.49:0/61539665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 0x7f7e000f7dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.465+0000 7f7e05572700 1 --2- 172.21.15.49:0/61539665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e000f66c0 0x7f7e000f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.465+0000 7f7e05572700 1 -- 172.21.15.49:0/61539665 >> 172.21.15.49:0/61539665 conn(0x7f7e000f1e20 msgr2=0x7f7e000f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.465+0000 7f7e05572700 1 -- 172.21.15.49:0/61539665 shutdown_connections 2024-02-22T00:31:06.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.465+0000 7f7e05572700 1 -- 172.21.15.49:0/61539665 wait complete. 2024-02-22T00:31:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.466+0000 7f7e05572700 1 Processor -- start 2024-02-22T00:31:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.466+0000 7f7e05572700 1 -- start start 2024-02-22T00:31:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7e05572700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e000f66c0 0x7f7e00106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7e05572700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 0x7f7e00107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7e05572700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001078f0 con 0x7f7e000f7960 2024-02-22T00:31:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7e05572700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e00107a30 con 0x7f7e000f66c0 2024-02-22T00:31:06.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7dfe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 0x7f7e00107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7dfe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 0x7f7e00107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34690/0 (socket says 172.21.15.49:34690) 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7dfe7fc700 1 -- 172.21.15.49:0/1812575395 learned_addr learned my addr 172.21.15.49:0/1812575395 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7dfe7fc700 1 -- 172.21.15.49:0/1812575395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e000f66c0 msgr2=0x7f7e00106e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7dfeffd700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e000f66c0 0x7f7e00106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7dfe7fc700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e000f66c0 0x7f7e00106e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7dfe7fc700 1 -- 172.21.15.49:0/1812575395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4005040 con 0x7f7e000f7960 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7dfe7fc700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 0x7f7e00107340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f7df4013510 tx=0x7f7df4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7de7fff700 1 -- 172.21.15.49:0/1812575395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7df400e030 con 0x7f7e000f7960 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7de7fff700 1 -- 172.21.15.49:0/1812575395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7df4007e90 con 0x7f7e000f7960 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0010c470 con 0x7f7e000f7960 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7de7fff700 1 -- 172.21.15.49:0/1812575395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7df4018070 con 0x7f7e000f7960 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.467+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0010c9b0 con 0x7f7e000f7960 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.468+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e000feea0 con 0x7f7e000f7960 2024-02-22T00:31:06.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.469+0000 7f7de7fff700 1 -- 172.21.15.49:0/1812575395 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f7df401da20 con 0x7f7e000f7960 2024-02-22T00:31:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.469+0000 7f7de7fff700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7de8061180 0x7f7de8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.469+0000 7f7de7fff700 1 -- 172.21.15.49:0/1812575395 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f7df407ddb0 con 0x7f7e000f7960 2024-02-22T00:31:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.469+0000 7f7dfeffd700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7de8061180 0x7f7de8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:06.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.470+0000 7f7dfeffd700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7de8061180 0x7f7de8063640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7df00041d0 tx=0x7f7df0009040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:06.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.473+0000 7f7de7fff700 1 -- 172.21.15.49:0/1812575395 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7df4051dc0 con 0x7f7e000f7960 2024-02-22T00:31:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:05.353324+0000 mon.smithi049 (mon.0) 603 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:05.354085+0000 mon.smithi049 (mon.0) 604 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:31:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:05.354715+0000 mon.smithi049 (mon.0) 605 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:31:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:05.358325+0000 mon.smithi049 (mon.0) 606 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:05.378869+0000 mon.smithi049 (mon.0) 607 : audit [DBG] from='client.? 172.21.15.49:0/1652108442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T00:31:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:05.698746+0000 mon.smithi049 (mon.0) 608 : audit [DBG] from='client.? 172.21.15.49:0/2479545552' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T00:31:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:05.804955+0000 mgr.smithi049.rjblpr (mgr.14194) 215 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:06.013954+0000 mon.smithi049 (mon.0) 609 : audit [DBG] from='client.? 172.21.15.49:0/3531071274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-22T00:31:06.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:06.332459+0000 mon.smithi049 (mon.0) 610 : audit [DBG] from='client.? 172.21.15.49:0/2365430468' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-22T00:31:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.689+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e00100dc0 con 0x7f7e000f7960 2024-02-22T00:31:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.689+0000 7f7de7fff700 1 -- 172.21.15.49:0/1812575395 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f7df40519b0 con 0x7f7e000f7960 2024-02-22T00:31:06.692 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:31:06.692 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:30:53.965310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14438,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.49:6827/502304157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":502304157},{"type":"v1","addr":"172.21.15.49:6827","nonce":502304157}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi161.wycpud","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.161:6825/1178849707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1178849707},{"type":"v1","addr":"172.21.15.161:6825","nonce":1178849707}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-22T00:31:06.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7de8061180 msgr2=0x7f7de8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7de8061180 0x7f7de8063640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7df00041d0 tx=0x7f7df0009040).stop 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 msgr2=0x7f7e00107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 0x7f7e00107340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f7df4013510 tx=0x7f7df4009cb0).stop 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 shutdown_connections 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f7de8061180 0x7f7de8063640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e000f66c0 0x7f7e00106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 --2- 172.21.15.49:0/1812575395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7e000f7960 0x7f7e00107340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 >> 172.21.15.49:0/1812575395 conn(0x7f7e000f1e20 msgr2=0x7f7e000fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 shutdown_connections 2024-02-22T00:31:06.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:06.691+0000 7f7e05572700 1 -- 172.21.15.49:0/1812575395 wait complete. 2024-02-22T00:31:06.696 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 12 2024-02-22T00:31:06.706 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 2, 'flags': 18} 2024-02-22T00:31:06.706 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-22T00:31:06.731 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-22T00:31:06.732 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-02-22T00:31:06.732 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-22T00:31:06.732 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-22T00:31:06.732 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:06.732 INFO:tasks.ceph_fuse:client.1 config is {} 2024-02-22T00:31:06.732 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-22T00:31:06.732 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:06.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:06.733 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-02-22T00:31:06.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:06.757 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2024-02-22T00:31:06.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:05.353324+0000 mon.smithi049 (mon.0) 603 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:06.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:05.354085+0000 mon.smithi049 (mon.0) 604 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:31:06.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:05.354715+0000 mon.smithi049 (mon.0) 605 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:31:06.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:05.358325+0000 mon.smithi049 (mon.0) 606 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:06.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:05.378869+0000 mon.smithi049 (mon.0) 607 : audit [DBG] from='client.? 172.21.15.49:0/1652108442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T00:31:06.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:05.698746+0000 mon.smithi049 (mon.0) 608 : audit [DBG] from='client.? 172.21.15.49:0/2479545552' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T00:31:06.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:05.804955+0000 mgr.smithi049.rjblpr (mgr.14194) 215 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:06.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:06.013954+0000 mon.smithi049 (mon.0) 609 : audit [DBG] from='client.? 172.21.15.49:0/3531071274' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-22T00:31:06.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:06.332459+0000 mon.smithi049 (mon.0) 610 : audit [DBG] from='client.? 172.21.15.49:0/2365430468' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-22T00:31:06.833 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2024-02-22T00:31:06.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T00:31:06.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:06.835 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-02-22T00:31:06.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:06.854 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-02-22T00:31:06.924 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-02-22T00:31:06.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T00:31:06.925 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-22T00:31:06.926 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph fs ls 2024-02-22T00:31:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:31:07.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:06.690531+0000 mon.smithi049 (mon.0) 611 : audit [DBG] from='client.? 172.21.15.49:0/1812575395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-22T00:31:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:06.690531+0000 mon.smithi049 (mon.0) 611 : audit [DBG] from='client.? 172.21.15.49:0/1812575395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-22T00:31:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:07.805546+0000 mgr.smithi049.rjblpr (mgr.14194) 216 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:08.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 -- 172.21.15.49:0/1884105237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 msgr2=0x7f40000f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:08.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 --2- 172.21.15.49:0/1884105237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 0x7f40000f7fa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f3fe80047f0 tx=0x7f3fe8009cb0).stop 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 -- 172.21.15.49:0/1884105237 shutdown_connections 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 --2- 172.21.15.49:0/1884105237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 0x7f40000f7fa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 --2- 172.21.15.49:0/1884105237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40000f68a0 0x7f40000f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 -- 172.21.15.49:0/1884105237 >> 172.21.15.49:0/1884105237 conn(0x7f40000f2020 msgr2=0x7f40000f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 -- 172.21.15.49:0/1884105237 shutdown_connections 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 -- 172.21.15.49:0/1884105237 wait complete. 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.762+0000 7f400550c700 1 Processor -- start 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f400550c700 1 -- start start 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f400550c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40000f68a0 0x7f400010a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f400550c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 0x7f400010a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f400550c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400010ad00 con 0x7f40000f7b40 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f400550c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400010ae40 con 0x7f40000f68a0 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f3ffe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 0x7f400010a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:08.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f3ffe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 0x7f400010a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34706/0 (socket says 172.21.15.49:34706) 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f3ffe7fc700 1 -- 172.21.15.49:0/207621346 learned_addr learned my addr 172.21.15.49:0/207621346 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f3ffeffd700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40000f68a0 0x7f400010a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f3ffe7fc700 1 -- 172.21.15.49:0/207621346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40000f68a0 msgr2=0x7f400010a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f3ffe7fc700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40000f68a0 0x7f400010a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f3ffe7fc700 1 -- 172.21.15.49:0/207621346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8005040 con 0x7f40000f7b40 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.763+0000 7f3ffe7fc700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 0x7f400010a750 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3fe8013470 tx=0x7f3fe8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.764+0000 7f3ff7fff700 1 -- 172.21.15.49:0/207621346 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fe800e030 con 0x7f40000f7b40 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.764+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400010f880 con 0x7f40000f7b40 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.764+0000 7f3ff7fff700 1 -- 172.21.15.49:0/207621346 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3fe8007e90 con 0x7f40000f7b40 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.764+0000 7f3ff7fff700 1 -- 172.21.15.49:0/207621346 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fe8018070 con 0x7f40000f7b40 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.764+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400010fdc0 con 0x7f40000f7b40 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.764+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40000feff0 con 0x7f40000f7b40 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.765+0000 7f3ff7fff700 1 -- 172.21.15.49:0/207621346 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f3fe801d420 con 0x7f40000f7b40 2024-02-22T00:31:08.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.765+0000 7f3ff7fff700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3fec061180 0x7f3fec063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.765+0000 7f3ff7fff700 1 -- 172.21.15.49:0/207621346 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f3fe807dd50 con 0x7f40000f7b40 2024-02-22T00:31:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.765+0000 7f3ffeffd700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3fec061180 0x7f3fec063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.766+0000 7f3ffeffd700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3fec061180 0x7f3fec063640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f40000f79a0 tx=0x7f3ff0009d80).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:08.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.769+0000 7f3ff7fff700 1 -- 172.21.15.49:0/207621346 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3fe8051ce0 con 0x7f40000f7b40 2024-02-22T00:31:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:07.805546+0000 mgr.smithi049.rjblpr (mgr.14194) 216 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:08.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.982+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40001106f0 con 0x7f40000f7b40 2024-02-22T00:31:08.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.982+0000 7f3ff7fff700 1 -- 172.21.15.49:0/207621346 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+83 (secure 0 0 0) 0x7f3fe80518d0 con 0x7f40000f7b40 2024-02-22T00:31:08.986 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3fec061180 msgr2=0x7f3fec063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3fec061180 0x7f3fec063640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f40000f79a0 tx=0x7f3ff0009d80).stop 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 msgr2=0x7f400010a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 0x7f400010a750 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f3fe8013470 tx=0x7f3fe8009cb0).stop 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 shutdown_connections 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f3fec061180 0x7f3fec063640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40000f68a0 0x7f400010a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 --2- 172.21.15.49:0/207621346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40000f7b40 0x7f400010a750 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 >> 172.21.15.49:0/207621346 conn(0x7f40000f2020 msgr2=0x7f4000060af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 shutdown_connections 2024-02-22T00:31:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:08.984+0000 7f400550c700 1 -- 172.21.15.49:0/207621346 wait complete. 2024-02-22T00:31:09.624 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:08.983622+0000 mon.smithi049 (mon.0) 612 : audit [DBG] from='client.? 172.21.15.49:0/207621346' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-22T00:31:09.645 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-22T00:31:09.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:09.646 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-02-22T00:31:09.667 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 41167sec preferred_lft 41167sec 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-02-22T00:31:09.668 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-02-22T00:31:09.669 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-22T00:31:09.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:09.669 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-02-22T00:31:09.669 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-02-22T00:31:09.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-02-22T00:31:09.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-02-22T00:31:09.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-02-22T00:31:09.669 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-22T00:31:09.669 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-02-22T00:31:09.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:08.983622+0000 mon.smithi049 (mon.0) 612 : audit [DBG] from='client.? 172.21.15.49:0/207621346' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-22T00:31:09.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:09.837 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-22T00:31:09.866 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-02-22T00:31:09.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:09.868 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-02-22T00:31:09.953 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-02-22T00:31:09.953 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-22T00:31:09.953 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-02-22T00:31:09.953 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-02-22T00:31:09.953 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-22T00:31:09.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:09.954 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-02-22T00:31:09.954 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-02-22T00:31:09.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-02-22T00:31:09.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-02-22T00:31:09.954 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-02-22T00:31:09.954 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-02-22T00:31:10.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:10.214 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-02-22T00:31:10.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:10.233 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-02-22T00:31:10.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:10.291 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-02-22T00:31:10.291 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-02-22T00:31:10.291 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-22T00:31:10.292 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-22T00:31:10.292 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-02-22T00:31:10.388 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-22T00:31:10.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:10.389 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-02-22T00:31:10.389 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-02-22T00:31:10.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-22T00:31:10.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-22T00:31:10.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-22T00:31:10.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-22T00:31:10.389 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-22T00:31:10.389 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-02-22T00:31:10.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:10.601 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec bash -c ' 2024-02-22T00:31:10.601 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-02-22T00:31:10.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-02-22T00:31:10.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-02-22T00:31:10.601 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-02-22T00:31:10.641 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:09.805902+0000 mgr.smithi049.rjblpr (mgr.14194) 217 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:10.700 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-22T00:31:10.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-22T00:31:10.700 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:10.759 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-22T00:31:10.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-22T00:31:10.760 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:09.805902+0000 mgr.smithi049.rjblpr (mgr.14194) 217 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:10.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-02-22T00:31:10.886 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-22T00:31:10.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-22T00:31:10.953 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-22T00:31:10.954 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-22T00:31:10.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:10.955 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-02-22T00:31:11.013 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-22T00:31:11.013 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-22T00:31:11.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo modprobe fuse 2024-02-22T00:31:11.084 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-22T00:31:11.084 DEBUG:teuthology.orchestra.run.smithi049:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-22T00:31:11.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:2024-02-22T00:31:11.146+0000 7fd10090d3c0 -1 init, newargv = 0x55762d929600 newargc=15 2024-02-22T00:31:11.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[106471]: starting ceph client 2024-02-22T00:31:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-22T00:31:11.154 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-22T00:31:11.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:11.155 DEBUG:teuthology.orchestra.run.smithi049:> ls /sys/fs/fuse/connections 2024-02-22T00:31:11.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[106471]: starting fuse 2024-02-22T00:31:11.176 INFO:teuthology.orchestra.run.smithi049.stdout:149 2024-02-22T00:31:11.176 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [149] 2024-02-22T00:31:11.176 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-02-22T00:31:11.176 DEBUG:teuthology.orchestra.run.smithi049:> import glob 2024-02-22T00:31:11.176 DEBUG:teuthology.orchestra.run.smithi049:> import re 2024-02-22T00:31:11.176 DEBUG:teuthology.orchestra.run.smithi049:> import os 2024-02-22T00:31:11.176 DEBUG:teuthology.orchestra.run.smithi049:> import subprocess 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> def _find_admin_socket(client_name): 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> files = glob.glob(asok_path) 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> # Given a non-glob path, it better be there 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> if "*" not in asok_path: 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> assert(len(files) == 1) 2024-02-22T00:31:11.177 DEBUG:teuthology.orchestra.run.smithi049:> return files[0] 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> for f in files: 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> contents = proc_f.read() 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> if mountpoint in contents: 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> return f 2024-02-22T00:31:11.178 DEBUG:teuthology.orchestra.run.smithi049:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-22T00:31:11.179 DEBUG:teuthology.orchestra.run.smithi049:> 2024-02-22T00:31:11.179 DEBUG:teuthology.orchestra.run.smithi049:> print(_find_admin_socket("client.0")) 2024-02-22T00:31:11.179 DEBUG:teuthology.orchestra.run.smithi049:> ' 2024-02-22T00:31:11.301 INFO:teuthology.orchestra.run.smithi049.stdout:/var/run/ceph/ceph-client.0.106471.asok 2024-02-22T00:31:11.484 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.106471.asok 2024-02-22T00:31:11.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:11.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.106471.asok status 2024-02-22T00:31:11.643 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:31:11.643 INFO:teuthology.orchestra.run.smithi049.stdout: "metadata": { 2024-02-22T00:31:11.643 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_sha1": "eb66ed921e744301e6863be6353618d63967ea59", 2024-02-22T00:31:11.643 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)", 2024-02-22T00:31:11.643 INFO:teuthology.orchestra.run.smithi049.stdout: "entity_id": "0", 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": "smithi049", 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "pid": "106471", 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "root": "/" 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_count": 0, 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "dentry_pinned_count": 0, 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 14502, 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "inst": { 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "name": { 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "client", 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "num": 14502 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:31:11.644 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3038596590 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": { 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "192.168.0.1:0", 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3038596590 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "inst_str": "client.14502 192.168.0.1:0/3038596590", 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "addr_str": "192.168.0.1:0/3038596590", 2024-02-22T00:31:11.645 INFO:teuthology.orchestra.run.smithi049.stdout: "inode_count": 1, 2024-02-22T00:31:11.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_epoch": 12, 2024-02-22T00:31:11.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch": 43, 2024-02-22T00:31:11.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_epoch_barrier": 0, 2024-02-22T00:31:11.646 INFO:teuthology.orchestra.run.smithi049.stdout: "blocklisted": false, 2024-02-22T00:31:11.646 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs" 2024-02-22T00:31:11.646 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:31:11.653 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- ceph fs ls 2024-02-22T00:31:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/mon.smithi049/config 2024-02-22T00:31:13.015 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:11.806409+0000 mgr.smithi049.rjblpr (mgr.14194) 218 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:13.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:11.806409+0000 mgr.smithi049.rjblpr (mgr.14194) 218 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:13.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.558+0000 7f608f5c7700 1 -- 172.21.15.49:0/3715153631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 msgr2=0x7f60880f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:13.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.558+0000 7f608f5c7700 1 --2- 172.21.15.49:0/3715153631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 0x7f60880f7dd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f60840047f0 tx=0x7f6084009cb0).stop 2024-02-22T00:31:13.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.558+0000 7f608f5c7700 1 -- 172.21.15.49:0/3715153631 shutdown_connections 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.558+0000 7f608f5c7700 1 --2- 172.21.15.49:0/3715153631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60880f8c50 0x7f60880f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.558+0000 7f608f5c7700 1 --2- 172.21.15.49:0/3715153631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 0x7f60880f7dd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.558+0000 7f608f5c7700 1 -- 172.21.15.49:0/3715153631 >> 172.21.15.49:0/3715153631 conn(0x7f60880f30f0 msgr2=0x7f60880f5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.558+0000 7f608f5c7700 1 -- 172.21.15.49:0/3715153631 shutdown_connections 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.558+0000 7f608f5c7700 1 -- 172.21.15.49:0/3715153631 wait complete. 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608f5c7700 1 Processor -- start 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608f5c7700 1 -- start start 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608f5c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 0x7f608806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608f5c7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60880f8c50 0x7f608806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608f5c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608806cf80 con 0x7f60880f79b0 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608f5c7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608806b520 con 0x7f60880f8c50 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608d363700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 0x7f608806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608d363700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 0x7f608806c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38930/0 (socket says 172.21.15.49:38930) 2024-02-22T00:31:13.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608d363700 1 -- 172.21.15.49:0/1202743626 learned_addr learned my addr 172.21.15.49:0/1202743626 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608cb62700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60880f8c50 0x7f608806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608d363700 1 -- 172.21.15.49:0/1202743626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60880f8c50 msgr2=0x7f608806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608d363700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60880f8c50 0x7f608806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608d363700 1 -- 172.21.15.49:0/1202743626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084005040 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f608d363700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 0x7f608806c9d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f6084004f10 tx=0x7f6084009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.559+0000 7f607e7fc700 1 -- 172.21.15.49:0/1202743626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608400e070 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.560+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608806b740 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.560+0000 7f607e7fc700 1 -- 172.21.15.49:0/1202743626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f6084007e90 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.560+0000 7f607e7fc700 1 -- 172.21.15.49:0/1202743626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6084018070 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.560+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608806bc20 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.561+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f608806be40 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.561+0000 7f607e7fc700 1 -- 172.21.15.49:0/1202743626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f60840123c0 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.561+0000 7f607e7fc700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6074061180 0x7f6074063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.561+0000 7f607e7fc700 1 -- 172.21.15.49:0/1202743626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f608407d790 con 0x7f60880f79b0 2024-02-22T00:31:13.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.561+0000 7f608cb62700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6074061180 0x7f6074063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:13.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.562+0000 7f608cb62700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6074061180 0x7f6074063640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6078009170 tx=0x7f6078009da0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:13.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.566+0000 7f607e7fc700 1 -- 172.21.15.49:0/1202743626 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6084051720 con 0x7f60880f79b0 2024-02-22T00:31:13.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.781+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6088102060 con 0x7f60880f79b0 2024-02-22T00:31:13.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.781+0000 7f607e7fc700 1 -- 172.21.15.49:0/1202743626 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+83 (secure 0 0 0) 0x7f6084051310 con 0x7f60880f79b0 2024-02-22T00:31:13.784 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-22T00:31:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6074061180 msgr2=0x7f6074063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6074061180 0x7f6074063640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6078009170 tx=0x7f6078009da0).stop 2024-02-22T00:31:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 msgr2=0x7f608806c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 0x7f608806c9d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f6084004f10 tx=0x7f6084009cb0).stop 2024-02-22T00:31:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 shutdown_connections 2024-02-22T00:31:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60880f79b0 0x7f608806c9d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f6074061180 0x7f6074063640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:13.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 --2- 172.21.15.49:0/1202743626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60880f8c50 0x7f608806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 >> 172.21.15.49:0/1202743626 conn(0x7f60880f30f0 msgr2=0x7f60880fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 shutdown_connections 2024-02-22T00:31:13.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:13.783+0000 7f608f5c7700 1 -- 172.21.15.49:0/1202743626 wait complete. 2024-02-22T00:31:14.133 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:13.782790+0000 mon.smithi049 (mon.0) 613 : audit [DBG] from='client.? 172.21.15.49:0/1202743626' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-22T00:31:14.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:13.782790+0000 mon.smithi049 (mon.0) 613 : audit [DBG] from='client.? 172.21.15.49:0/1202743626' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-22T00:31:14.418 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-22T00:31:14.418 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-22T00:31:14.418 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2024-02-22T00:31:14.418 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-22T00:31:14.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:14.419 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-22T00:31:14.419 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-22T00:31:14.419 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-22T00:31:14.419 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-22T00:31:14.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:14.419 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2024-02-22T00:31:14.443 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 41092sec preferred_lft 41092sec 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2024-02-22T00:31:14.444 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2024-02-22T00:31:14.445 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-22T00:31:14.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:14.445 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-02-22T00:31:14.445 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-02-22T00:31:14.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2024-02-22T00:31:14.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2024-02-22T00:31:14.446 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2024-02-22T00:31:14.446 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-22T00:31:14.446 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-02-22T00:31:14.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:14.628 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-22T00:31:14.657 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-02-22T00:31:14.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:14.658 DEBUG:teuthology.orchestra.run.smithi161:> route 2024-02-22T00:31:14.737 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2024-02-22T00:31:14.737 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-22T00:31:14.738 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-22T00:31:14.738 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-22T00:31:14.738 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-22T00:31:14.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:14.739 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-02-22T00:31:14.739 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-02-22T00:31:14.739 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-22T00:31:14.739 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-22T00:31:14.739 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-22T00:31:14.739 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-02-22T00:31:15.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:15.059 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2024-02-22T00:31:15.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:15.078 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2024-02-22T00:31:15.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:15.136 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-02-22T00:31:15.136 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-02-22T00:31:15.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-22T00:31:15.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-22T00:31:15.136 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-02-22T00:31:15.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:13.806758+0000 mgr.smithi049.rjblpr (mgr.14194) 219 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 4.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-22T00:31:15.215 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:13.806758+0000 mgr.smithi049.rjblpr (mgr.14194) 219 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 4.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-22T00:31:15.230 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-22T00:31:15.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:15.231 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-02-22T00:31:15.231 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-02-22T00:31:15.231 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-22T00:31:15.231 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-22T00:31:15.231 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-22T00:31:15.231 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-22T00:31:15.231 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-22T00:31:15.231 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-02-22T00:31:15.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:15.478 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2024-02-22T00:31:15.479 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2024-02-22T00:31:15.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2024-02-22T00:31:15.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2024-02-22T00:31:15.479 DEBUG:teuthology.orchestra.run.smithi161:> ') 2024-02-22T00:31:15.575 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-02-22T00:31:15.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-22T00:31:15.576 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:15.593 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-22T00:31:15.594 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-22T00:31:15.594 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:15.651 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2024-02-22T00:31:15.719 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-22T00:31:15.719 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-22T00:31:15.786 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-22T00:31:15.787 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-22T00:31:15.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:15.787 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2024-02-22T00:31:15.845 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-22T00:31:15.845 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-02-22T00:31:15.888 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2024-02-22T00:31:15.914 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-22T00:31:15.914 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-22T00:31:15.981 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-22T00:31:15.982 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-22T00:31:15.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:15.982 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2024-02-22T00:31:16.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:2024-02-22T00:31:16.040+0000 7fe838fea3c0 -1 init, newargv = 0x55ae11588800 newargc=15 2024-02-22T00:31:16.043 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[92600]: starting ceph client 2024-02-22T00:31:16.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi161.stderr:ceph-fuse[92600]: starting fuse 2024-02-22T00:31:17.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2024-02-22T00:31:17.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:15.807298+0000 mgr.smithi049.rjblpr (mgr.14194) 220 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 4.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-22T00:31:17.176 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-02-22T00:31:17.176 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-02-22T00:31:17.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:15.807298+0000 mgr.smithi049.rjblpr (mgr.14194) 220 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 4.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-22T00:31:17.247 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-02-22T00:31:17.248 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-02-22T00:31:17.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:17.249 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2024-02-22T00:31:17.309 INFO:teuthology.orchestra.run.smithi161.stdout:137 2024-02-22T00:31:17.309 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [137] 2024-02-22T00:31:17.309 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-02-22T00:31:17.309 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2024-02-22T00:31:17.309 DEBUG:teuthology.orchestra.run.smithi161:> import re 2024-02-22T00:31:17.309 DEBUG:teuthology.orchestra.run.smithi161:> import os 2024-02-22T00:31:17.309 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2024-02-22T00:31:17.309 DEBUG:teuthology.orchestra.run.smithi161:> 2024-02-22T00:31:17.309 DEBUG:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2024-02-22T00:31:17.309 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2024-02-22T00:31:17.310 DEBUG:teuthology.orchestra.run.smithi161:> return f 2024-02-22T00:31:17.311 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-22T00:31:17.311 DEBUG:teuthology.orchestra.run.smithi161:> 2024-02-22T00:31:17.311 DEBUG:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.1")) 2024-02-22T00:31:17.311 DEBUG:teuthology.orchestra.run.smithi161:> ' 2024-02-22T00:31:17.434 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.1.92600.asok 2024-02-22T00:31:17.617 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.92600.asok 2024-02-22T00:31:17.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:17.618 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.92600.asok status 2024-02-22T00:31:17.769 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-02-22T00:31:17.769 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "eb66ed921e744301e6863be6353618d63967ea59", 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)", 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "1", 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "92600", 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 24325, 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2024-02-22T00:31:17.770 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 24325 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3479989706 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3479989706 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-02-22T00:31:17.771 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.24325 192.168.0.1:0/3479989706", 2024-02-22T00:31:17.772 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.1:0/3479989706", 2024-02-22T00:31:17.772 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2024-02-22T00:31:17.772 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 12, 2024-02-22T00:31:17.772 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 43, 2024-02-22T00:31:17.772 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2024-02-22T00:31:17.772 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2024-02-22T00:31:17.772 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2024-02-22T00:31:17.772 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-02-22T00:31:17.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:17.779 DEBUG:teuthology.orchestra.run.smithi049:> stat --file-system '--printf=%T 2024-02-22T00:31:17.779 DEBUG:teuthology.orchestra.run.smithi049:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:17.805 INFO:teuthology.orchestra.run.smithi049.stdout:fuseblk 2024-02-22T00:31:17.805 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:17.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:17.806 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:17.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:17.885 DEBUG:teuthology.orchestra.run.smithi161:> stat --file-system '--printf=%T 2024-02-22T00:31:17.885 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:17.903 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2024-02-22T00:31:17.903 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:17.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T00:31:17.903 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:19.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:17.807888+0000 mgr.smithi049.rjblpr (mgr.14194) 221 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 4.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-22T00:31:19.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:17.807888+0000 mgr.smithi049.rjblpr (mgr.14194) 221 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 4.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-22T00:31:21.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:19.808495+0000 mgr.smithi049.rjblpr (mgr.14194) 222 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 4.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-22T00:31:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:19.808495+0000 mgr.smithi049.rjblpr (mgr.14194) 222 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 4.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-02-22T00:31:22.035 INFO:teuthology.run_tasks:Running task print... 2024-02-22T00:31:22.045 INFO:teuthology.task.print:**** done client 2024-02-22T00:31:22.045 INFO:teuthology.run_tasks:Running task parallel... 2024-02-22T00:31:22.068 INFO:teuthology.task.parallel:starting parallel... 2024-02-22T00:31:22.069 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-22T00:31:22.069 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-22T00:31:22.070 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:31:22.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-22T00:31:22.071 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-22T00:31:22.071 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-22T00:31:22.074 INFO:tasks.workunit:Pulling workunits from ref c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:31:22.075 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-22T00:31:22.075 INFO:tasks.workunit:timeout=3h 2024-02-22T00:31:22.075 INFO:tasks.workunit:cleanup=True 2024-02-22T00:31:22.075 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:22.100 INFO:teuthology.orchestra.run.smithi049.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:22.101 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-22T00:31:22.101 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 95h/149d Inode: 1 Links: 2 2024-02-22T00:31:22.101 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:31:22.101 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-22T00:31:22.101 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-22T00:31:22.101 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-02-22 00:30:42.258707581 +0000 2024-02-22T00:31:22.101 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-02-22 00:31:17.879971061 +0000 2024-02-22T00:31:22.101 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: - 2024-02-22T00:31:22.101 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-22T00:31:22.101 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-22T00:31:22.184 DEBUG:teuthology.orchestra.run.smithi161:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 89h/137d Inode: 1 Links: 3 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-02-22 00:31:22.175575267 +0000 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-02-22 00:31:22.175575267 +0000 2024-02-22T00:31:22.208 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2024-02-22T00:31:22.208 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-22T00:31:22.209 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-22T00:31:22.287 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:31:22.288 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:31:22.308 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-22T00:31:22.347 INFO:tasks.workunit.client.1.smithi161.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-22T00:31:23.148 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:21.809162+0000 mgr.smithi049.rjblpr (mgr.14194) 223 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 5.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-22T00:31:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:21.809162+0000 mgr.smithi049.rjblpr (mgr.14194) 223 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 5.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-22T00:31:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.888+0000 7f40d9079700 1 -- 172.21.15.49:0/1538855813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d40fa950 msgr2=0x7f40d40fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.889+0000 7f40d9079700 1 --2- 172.21.15.49:0/1538855813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d40fa950 0x7f40d40fcda0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f40c80047f0 tx=0x7f40c8009cb0).stop 2024-02-22T00:31:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.889+0000 7f40d9079700 1 -- 172.21.15.49:0/1538855813 shutdown_connections 2024-02-22T00:31:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.889+0000 7f40d9079700 1 --2- 172.21.15.49:0/1538855813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d40fa950 0x7f40d40fcda0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.889+0000 7f40d9079700 1 --2- 172.21.15.49:0/1538855813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40d4061280 0x7f40d40fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.889+0000 7f40d9079700 1 -- 172.21.15.49:0/1538855813 >> 172.21.15.49:0/1538855813 conn(0x7f40d40f1e50 msgr2=0x7f40d40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.889+0000 7f40d9079700 1 -- 172.21.15.49:0/1538855813 shutdown_connections 2024-02-22T00:31:23.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.889+0000 7f40d9079700 1 -- 172.21.15.49:0/1538855813 wait complete. 2024-02-22T00:31:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.889+0000 7f40d9079700 1 Processor -- start 2024-02-22T00:31:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d9079700 1 -- start start 2024-02-22T00:31:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d9079700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4061280 0x7f40d4107f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d9079700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40d40fa950 0x7f40d4108400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d9079700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d41089b0 con 0x7f40d4061280 2024-02-22T00:31:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d9079700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d4108af0 con 0x7f40d40fa950 2024-02-22T00:31:23.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4061280 0x7f40d4107f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d2d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4061280 0x7f40d4107f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53220/0 (socket says 172.21.15.49:53220) 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d2d9d700 1 -- 172.21.15.49:0/3897876727 learned_addr learned my addr 172.21.15.49:0/3897876727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d259c700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40d40fa950 0x7f40d4108400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d2d9d700 1 -- 172.21.15.49:0/3897876727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40d40fa950 msgr2=0x7f40d4108400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d2d9d700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40d40fa950 0x7f40d4108400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d2d9d700 1 -- 172.21.15.49:0/3897876727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8005040 con 0x7f40d4061280 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.890+0000 7f40d2d9d700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4061280 0x7f40d4107f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f40c40041d0 tx=0x7f40c4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.891+0000 7f40bbfff700 1 -- 172.21.15.49:0/3897876727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40c4007b40 con 0x7f40d4061280 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.891+0000 7f40bbfff700 1 -- 172.21.15.49:0/3897876727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f40c400f040 con 0x7f40d4061280 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.891+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d410d590 con 0x7f40d4061280 2024-02-22T00:31:23.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.891+0000 7f40bbfff700 1 -- 172.21.15.49:0/3897876727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40c40146f0 con 0x7f40d4061280 2024-02-22T00:31:23.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.891+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d410dad0 con 0x7f40d4061280 2024-02-22T00:31:23.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.892+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d40fffb0 con 0x7f40d4061280 2024-02-22T00:31:23.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.893+0000 7f40bbfff700 1 -- 172.21.15.49:0/3897876727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f40c4009110 con 0x7f40d4061280 2024-02-22T00:31:23.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.893+0000 7f40bbfff700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f40bc061180 0x7f40bc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:23.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.893+0000 7f40bbfff700 1 -- 172.21.15.49:0/3897876727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f40c407cbd0 con 0x7f40d4061280 2024-02-22T00:31:23.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.893+0000 7f40d259c700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f40bc061180 0x7f40bc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:23.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.893+0000 7f40d259c700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f40bc061180 0x7f40bc063640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f40c8013470 tx=0x7f40c8009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:23.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:23.897+0000 7f40bbfff700 1 -- 172.21.15.49:0/3897876727 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f40c4050be0 con 0x7f40d4061280 2024-02-22T00:31:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.068+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f40d4101e20 con 0x7f40d4061280 2024-02-22T00:31:24.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.068+0000 7f40bbfff700 1 -- 172.21.15.49:0/3897876727 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f40c40507d0 con 0x7f40d4061280 2024-02-22T00:31:24.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f40bc061180 msgr2=0x7f40bc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:24.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f40bc061180 0x7f40bc063640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f40c8013470 tx=0x7f40c8009cb0).stop 2024-02-22T00:31:24.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4061280 msgr2=0x7f40d4107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:24.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4061280 0x7f40d4107f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f40c40041d0 tx=0x7f40c4009f60).stop 2024-02-22T00:31:24.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 shutdown_connections 2024-02-22T00:31:24.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f40d4061280 0x7f40d4107f10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:24.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f40bc061180 0x7f40bc063640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:24.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 --2- 172.21.15.49:0/3897876727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40d40fa950 0x7f40d4108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 >> 172.21.15.49:0/3897876727 conn(0x7f40d40f1e50 msgr2=0x7f40d40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 shutdown_connections 2024-02-22T00:31:24.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:24.070+0000 7f40d9079700 1 -- 172.21.15.49:0/3897876727 wait complete. 2024-02-22T00:31:24.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-22T00:31:25.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:23.809591+0000 mgr.smithi049.rjblpr (mgr.14194) 224 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 8.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-22T00:31:25.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:23.809591+0000 mgr.smithi049.rjblpr (mgr.14194) 224 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 8.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-22T00:31:26.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.534+0000 7fe811e79700 1 -- 172.21.15.49:0/1894044890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c0fcd40 msgr2=0x7fe80c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.534+0000 7fe811e79700 1 --2- 172.21.15.49:0/1894044890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c0fcd40 0x7fe80c0ff130 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fe7fc004820 tx=0x7fe7fc009cb0).stop 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.534+0000 7fe811e79700 1 -- 172.21.15.49:0/1894044890 shutdown_connections 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.534+0000 7fe811e79700 1 --2- 172.21.15.49:0/1894044890 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c0fcd40 0x7fe80c0ff130 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.534+0000 7fe811e79700 1 --2- 172.21.15.49:0/1894044890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe80c061200 0x7fe80c0fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.534+0000 7fe811e79700 1 -- 172.21.15.49:0/1894044890 >> 172.21.15.49:0/1894044890 conn(0x7fe80c0f1e50 msgr2=0x7fe80c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.534+0000 7fe811e79700 1 -- 172.21.15.49:0/1894044890 shutdown_connections 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.534+0000 7fe811e79700 1 -- 172.21.15.49:0/1894044890 wait complete. 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe811e79700 1 Processor -- start 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe811e79700 1 -- start start 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe811e79700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c061200 0x7fe80c10a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe811e79700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe80c0fcd40 0x7fe80c10a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:26.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe811e79700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c10ad30 con 0x7fe80c061200 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe811e79700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c10ae70 con 0x7fe80c0fcd40 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe80b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c061200 0x7fe80c10a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe80b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c061200 0x7fe80c10a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53230/0 (socket says 172.21.15.49:53230) 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.535+0000 7fe80b7fe700 1 -- 172.21.15.49:0/1823418975 learned_addr learned my addr 172.21.15.49:0/1823418975 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe80b7fe700 1 -- 172.21.15.49:0/1823418975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe80c0fcd40 msgr2=0x7fe80c10a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe80b7fe700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe80c0fcd40 0x7fe80c10a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe80b7fe700 1 -- 172.21.15.49:0/1823418975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc005040 con 0x7fe80c061200 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe80b7fe700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c061200 0x7fe80c10a200 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fe7f400b4b0 tx=0x7fe7f40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe808ff9700 1 -- 172.21.15.49:0/1823418975 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f4002500 con 0x7fe80c061200 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe808ff9700 1 -- 172.21.15.49:0/1823418975 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe7f4002af0 con 0x7fe80c061200 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe808ff9700 1 -- 172.21.15.49:0/1823418975 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7f4012c80 con 0x7fe80c061200 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c10f910 con 0x7fe80c061200 2024-02-22T00:31:26.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.536+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c10fe50 con 0x7fe80c061200 2024-02-22T00:31:26.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.537+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c102240 con 0x7fe80c061200 2024-02-22T00:31:26.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.537+0000 7fe808ff9700 1 -- 172.21.15.49:0/1823418975 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fe7f4002660 con 0x7fe80c061200 2024-02-22T00:31:26.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.538+0000 7fe808ff9700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe7f8061180 0x7fe7f8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.538+0000 7fe808ff9700 1 -- 172.21.15.49:0/1823418975 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fe7f407c990 con 0x7fe80c061200 2024-02-22T00:31:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.538+0000 7fe80affd700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe7f8061180 0x7fe7f8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:26.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.538+0000 7fe80affd700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe7f8061180 0x7fe7f8063640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe7fc000c00 tx=0x7fe7fc009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:26.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.542+0000 7fe808ff9700 1 -- 172.21.15.49:0/1823418975 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe7f4050920 con 0x7fe80c061200 2024-02-22T00:31:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.714+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fe80c10faa0 con 0x7fe80c061200 2024-02-22T00:31:26.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.714+0000 7fe808ff9700 1 -- 172.21.15.49:0/1823418975 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe80c10faa0 con 0x7fe80c061200 2024-02-22T00:31:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe7f8061180 msgr2=0x7fe7f8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe7f8061180 0x7fe7f8063640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe7fc000c00 tx=0x7fe7fc009cb0).stop 2024-02-22T00:31:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c061200 msgr2=0x7fe80c10a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:26.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c061200 0x7fe80c10a200 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fe7f400b4b0 tx=0x7fe7f40090f0).stop 2024-02-22T00:31:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 shutdown_connections 2024-02-22T00:31:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe80c061200 0x7fe80c10a200 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe7f8061180 0x7fe7f8063640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 --2- 172.21.15.49:0/1823418975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe80c0fcd40 0x7fe80c10a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:31:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 >> 172.21.15.49:0/1823418975 conn(0x7fe80c0f1e50 msgr2=0x7fe80c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 shutdown_connections 2024-02-22T00:31:26.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:26.716+0000 7fe811e79700 1 -- 172.21.15.49:0/1823418975 wait complete. 2024-02-22T00:31:27.058 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:25.810020+0000 mgr.smithi049.rjblpr (mgr.14194) 225 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 8.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-22T00:31:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:25.810020+0000 mgr.smithi049.rjblpr (mgr.14194) 225 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 8.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-22T00:31:27.543 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-22T00:31:29.098 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:27.810447+0000 mgr.smithi049.rjblpr (mgr.14194) 226 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-22T00:31:29.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:27.810447+0000 mgr.smithi049.rjblpr (mgr.14194) 226 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-22T00:31:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 -- 172.21.15.49:0/1641198921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06b560 msgr2=0x7f583c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 --2- 172.21.15.49:0/1641198921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06b560 0x7f583c06b9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f58280047f0 tx=0x7f5828009cb0).stop 2024-02-22T00:31:29.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 -- 172.21.15.49:0/1641198921 shutdown_connections 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 --2- 172.21.15.49:0/1641198921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06b560 0x7f583c06b9e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 --2- 172.21.15.49:0/1641198921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c06cb70 0x7f583c06b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 -- 172.21.15.49:0/1641198921 >> 172.21.15.49:0/1641198921 conn(0x7f583c0f2f80 msgr2=0x7f583c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 -- 172.21.15.49:0/1641198921 shutdown_connections 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 -- 172.21.15.49:0/1641198921 wait complete. 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 Processor -- start 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.643+0000 7f5842a7f700 1 -- start start 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f5842a7f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c06b560 0x7f583c10a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f5842a7f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06cb70 0x7f583c10a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f5842a7f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c10acb0 con 0x7f583c06cb70 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f5842a7f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c10adf0 con 0x7f583c06b560 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f583bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06cb70 0x7f583c10a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:29.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f583bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06cb70 0x7f583c10a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53240/0 (socket says 172.21.15.49:53240) 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f583bfff700 1 -- 172.21.15.49:0/427582538 learned_addr learned my addr 172.21.15.49:0/427582538 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f584081b700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c06b560 0x7f583c10a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f583bfff700 1 -- 172.21.15.49:0/427582538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c06b560 msgr2=0x7f583c10a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f583bfff700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c06b560 0x7f583c10a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f583bfff700 1 -- 172.21.15.49:0/427582538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828005040 con 0x7f583c06cb70 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f583bfff700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06cb70 0x7f583c10a700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f5828013580 tx=0x7f5828009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f5839f76700 1 -- 172.21.15.49:0/427582538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5828018070 con 0x7f583c06cb70 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f5839f76700 1 -- 172.21.15.49:0/427582538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5828007e90 con 0x7f583c06cb70 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.644+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c10f830 con 0x7f583c06cb70 2024-02-22T00:31:29.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.645+0000 7f5839f76700 1 -- 172.21.15.49:0/427582538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58280123c0 con 0x7f583c06cb70 2024-02-22T00:31:29.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.645+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c10fdf0 con 0x7f583c06cb70 2024-02-22T00:31:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.646+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c1021b0 con 0x7f583c06cb70 2024-02-22T00:31:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.646+0000 7f5839f76700 1 -- 172.21.15.49:0/427582538 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f582801d420 con 0x7f583c06cb70 2024-02-22T00:31:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.647+0000 7f5839f76700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f582c061180 0x7f582c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.647+0000 7f5839f76700 1 -- 172.21.15.49:0/427582538 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f582807d490 con 0x7f583c06cb70 2024-02-22T00:31:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.647+0000 7f584081b700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f582c061180 0x7f582c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:29.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.647+0000 7f584081b700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f582c061180 0x7f582c063640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f58300048b0 tx=0x7f583000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:29.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.651+0000 7f5839f76700 1 -- 172.21.15.49:0/427582538 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5828051420 con 0x7f583c06cb70 2024-02-22T00:31:29.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.823+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f583c059960 con 0x7f583c06cb70 2024-02-22T00:31:29.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.828+0000 7f5839f76700 1 -- 172.21.15.49:0/427582538 <== mon.0 v2:172.21.15.49:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5828051420 con 0x7f583c06cb70 2024-02-22T00:31:29.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.828+0000 7f5839f76700 1 -- 172.21.15.49:0/427582538 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v22)=0 v22) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5828051010 con 0x7f583c06cb70 2024-02-22T00:31:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f582c061180 msgr2=0x7f582c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f582c061180 0x7f582c063640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f58300048b0 tx=0x7f583000b040).stop 2024-02-22T00:31:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06cb70 msgr2=0x7f583c10a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06cb70 0x7f583c10a700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f5828013580 tx=0x7f5828009cb0).stop 2024-02-22T00:31:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 shutdown_connections 2024-02-22T00:31:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f582c061180 0x7f582c063640 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f583c06b560 0x7f583c10a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 --2- 172.21.15.49:0/427582538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f583c06cb70 0x7f583c10a700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 >> 172.21.15.49:0/427582538 conn(0x7f583c0f2f80 msgr2=0x7f583c0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 shutdown_connections 2024-02-22T00:31:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:29.832+0000 7f5842a7f700 1 -- 172.21.15.49:0/427582538 wait complete. 2024-02-22T00:31:30.533 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-22T00:31:31.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:29.810825+0000 mgr.smithi049.rjblpr (mgr.14194) 227 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-22T00:31:31.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:29.829213+0000 mon.smithi049 (mon.0) 614 : audit [INF] from='client.? 172.21.15.49:0/427582538' entity='client.admin' 2024-02-22T00:31:31.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:29.875400+0000 mon.smithi049 (mon.0) 615 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:31:31.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:30.210418+0000 mon.smithi049 (mon.0) 616 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:31:31.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:30.211186+0000 mon.smithi049 (mon.0) 617 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:31:31.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:30.215628+0000 mon.smithi049 (mon.0) 618 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:31.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:29.810825+0000 mgr.smithi049.rjblpr (mgr.14194) 227 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-02-22T00:31:31.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:29.829213+0000 mon.smithi049 (mon.0) 614 : audit [INF] from='client.? 172.21.15.49:0/427582538' entity='client.admin' 2024-02-22T00:31:31.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:29.875400+0000 mon.smithi049 (mon.0) 615 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:31:31.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:30.210418+0000 mon.smithi049 (mon.0) 616 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:31:31.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:30.211186+0000 mon.smithi049 (mon.0) 617 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:31:31.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:30.215628+0000 mon.smithi049 (mon.0) 618 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.552+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/1827533674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f7990 msgr2=0x7fb1e40f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.552+0000 7fb1eb7d8700 1 --2- 172.21.15.49:0/1827533674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f7990 0x7fb1e40f7df0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fb1d40047f0 tx=0x7fb1d4009cb0).stop 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.552+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/1827533674 shutdown_connections 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.552+0000 7fb1eb7d8700 1 --2- 172.21.15.49:0/1827533674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f7990 0x7fb1e40f7df0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.552+0000 7fb1eb7d8700 1 --2- 172.21.15.49:0/1827533674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1e40f66f0 0x7fb1e40f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.552+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/1827533674 >> 172.21.15.49:0/1827533674 conn(0x7fb1e40f1e50 msgr2=0x7fb1e40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.552+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/1827533674 shutdown_connections 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.552+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/1827533674 wait complete. 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1eb7d8700 1 Processor -- start 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1eb7d8700 1 -- start start 2024-02-22T00:31:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1eb7d8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f66f0 0x7fb1e4061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1eb7d8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1e40f7990 0x7fb1e410f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1eb7d8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4108c70 con 0x7fb1e40f66f0 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1eb7d8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e410f780 con 0x7fb1e40f7990 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1e9574700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f66f0 0x7fb1e4061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1e9574700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f66f0 0x7fb1e4061040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37158/0 (socket says 172.21.15.49:37158) 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1e9574700 1 -- 172.21.15.49:0/2166788660 learned_addr learned my addr 172.21.15.49:0/2166788660 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.553+0000 7fb1e8d73700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1e40f7990 0x7fb1e410f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1e9574700 1 -- 172.21.15.49:0/2166788660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1e40f7990 msgr2=0x7fb1e410f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1e9574700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1e40f7990 0x7fb1e410f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1e9574700 1 -- 172.21.15.49:0/2166788660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4005040 con 0x7fb1e40f66f0 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1e9574700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f66f0 0x7fb1e4061040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb1e000e910 tx=0x7fb1e000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1da7fc700 1 -- 172.21.15.49:0/2166788660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e0007b40 con 0x7fb1e40f66f0 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1da7fc700 1 -- 172.21.15.49:0/2166788660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb1e000f040 con 0x7fb1e40f66f0 2024-02-22T00:31:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e410f920 con 0x7fb1e40f66f0 2024-02-22T00:31:32.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1da7fc700 1 -- 172.21.15.49:0/2166788660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1e0014910 con 0x7fb1e40f66f0 2024-02-22T00:31:32.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.554+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e410feb0 con 0x7fb1e40f66f0 2024-02-22T00:31:32.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.555+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e40feed0 con 0x7fb1e40f66f0 2024-02-22T00:31:32.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.555+0000 7fb1da7fc700 1 -- 172.21.15.49:0/2166788660 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fb1e0007ca0 con 0x7fb1e40f66f0 2024-02-22T00:31:32.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.556+0000 7fb1da7fc700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb1d0061180 0x7fb1d0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:31:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.556+0000 7fb1da7fc700 1 -- 172.21.15.49:0/2166788660 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fb1e007c200 con 0x7fb1e40f66f0 2024-02-22T00:31:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.556+0000 7fb1e8d73700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb1d0061180 0x7fb1d0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:31:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.556+0000 7fb1e8d73700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb1d0061180 0x7fb1d0063640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fb1d40047c0 tx=0x7fb1d4009cb0).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:31:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.560+0000 7fb1da7fc700 1 -- 172.21.15.49:0/2166788660 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb1e0049f60 con 0x7fb1e40f66f0 2024-02-22T00:31:32.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:31:32.785+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1e4059290 con 0x7fb1d0061180 2024-02-22T00:31:33.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:31.811194+0000 mgr.smithi049.rjblpr (mgr.14194) 228 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-22T00:31:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:31.811194+0000 mgr.smithi049.rjblpr (mgr.14194) 228 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-22T00:31:34.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:33 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:31:32.787419+0000 mgr.smithi049.rjblpr (mgr.14194) 229 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:31:34.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:33 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:31:32.787419+0000 mgr.smithi049.rjblpr (mgr.14194) 229 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:31:35.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:33.811563+0000 mgr.smithi049.rjblpr (mgr.14194) 230 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-22T00:31:35.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:33.811563+0000 mgr.smithi049.rjblpr (mgr.14194) 230 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-22T00:31:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:35.811973+0000 mgr.smithi049.rjblpr (mgr.14194) 231 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-22T00:31:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:35.811973+0000 mgr.smithi049.rjblpr (mgr.14194) 231 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-22T00:31:39.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:37.812374+0000 mgr.smithi049.rjblpr (mgr.14194) 232 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-22T00:31:39.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:37.812374+0000 mgr.smithi049.rjblpr (mgr.14194) 232 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-02-22T00:31:41.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:39.812758+0000 mgr.smithi049.rjblpr (mgr.14194) 233 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-22T00:31:41.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:39.812758+0000 mgr.smithi049.rjblpr (mgr.14194) 233 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-22T00:31:43.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:41.813156+0000 mgr.smithi049.rjblpr (mgr.14194) 234 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-22T00:31:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:41.813156+0000 mgr.smithi049.rjblpr (mgr.14194) 234 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-22T00:31:45.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:43.813496+0000 mgr.smithi049.rjblpr (mgr.14194) 235 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:31:45.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:43.813496+0000 mgr.smithi049.rjblpr (mgr.14194) 235 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:31:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:45.813877+0000 mgr.smithi049.rjblpr (mgr.14194) 236 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-22T00:31:47.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:45.813877+0000 mgr.smithi049.rjblpr (mgr.14194) 236 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-22T00:31:49.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:47.814314+0000 mgr.smithi049.rjblpr (mgr.14194) 237 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-22T00:31:49.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:47.814314+0000 mgr.smithi049.rjblpr (mgr.14194) 237 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-22T00:31:51.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:49.814766+0000 mgr.smithi049.rjblpr (mgr.14194) 238 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:51.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:49.814766+0000 mgr.smithi049.rjblpr (mgr.14194) 238 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:53.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:51.815188+0000 mgr.smithi049.rjblpr (mgr.14194) 239 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:53.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:51.815188+0000 mgr.smithi049.rjblpr (mgr.14194) 239 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:55.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:53.815608+0000 mgr.smithi049.rjblpr (mgr.14194) 240 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:53.815608+0000 mgr.smithi049.rjblpr (mgr.14194) 240 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:57.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:55.816094+0000 mgr.smithi049.rjblpr (mgr.14194) 241 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:55.816094+0000 mgr.smithi049.rjblpr (mgr.14194) 241 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:59.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:31:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:57.816559+0000 mgr.smithi049.rjblpr (mgr.14194) 242 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:31:59.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:31:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:57.816559+0000 mgr.smithi049.rjblpr (mgr.14194) 242 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:01.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:31:59.816928+0000 mgr.smithi049.rjblpr (mgr.14194) 243 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:01.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:31:59.816928+0000 mgr.smithi049.rjblpr (mgr.14194) 243 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:03.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:01.817300+0000 mgr.smithi049.rjblpr (mgr.14194) 244 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:03.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:01.817300+0000 mgr.smithi049.rjblpr (mgr.14194) 244 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:03.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.661+0000 7fb1da7fc700 1 -- 172.21.15.49:0/2166788660 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fb1e4059290 con 0x7fb1d0061180 2024-02-22T00:32:03.663 INFO:teuthology.orchestra.run.smithi049.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:32:03.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.663+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb1d0061180 msgr2=0x7fb1d0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.663+0000 7fb1eb7d8700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb1d0061180 0x7fb1d0063640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fb1d40047c0 tx=0x7fb1d4009cb0).stop 2024-02-22T00:32:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.663+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f66f0 msgr2=0x7fb1e4061040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.663+0000 7fb1eb7d8700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f66f0 0x7fb1e4061040 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb1e000e910 tx=0x7fb1e000b040).stop 2024-02-22T00:32:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.664+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 shutdown_connections 2024-02-22T00:32:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.664+0000 7fb1eb7d8700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1e40f66f0 0x7fb1e4061040 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:03.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.664+0000 7fb1eb7d8700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb1d0061180 0x7fb1d0063640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.664+0000 7fb1eb7d8700 1 --2- 172.21.15.49:0/2166788660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1e40f7990 0x7fb1e410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.664+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 >> 172.21.15.49:0/2166788660 conn(0x7fb1e40f1e50 msgr2=0x7fb1e40fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.664+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 shutdown_connections 2024-02-22T00:32:03.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:03.664+0000 7fb1eb7d8700 1 -- 172.21.15.49:0/2166788660 wait complete. 2024-02-22T00:32:04.390 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-22T00:32:04.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:03.656498+0000 mgr.smithi049.rjblpr (mgr.14194) 245 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:32:04.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:03.660861+0000 mon.smithi049 (mon.0) 619 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:04.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:03.667492+0000 mon.smithi049 (mon.0) 620 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:04.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:03.669374+0000 mon.smithi049 (mon.0) 621 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:32:04.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:03.670191+0000 mon.smithi049 (mon.0) 622 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:32:04.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:03.674819+0000 mon.smithi049 (mon.0) 623 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:04.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:03.679928+0000 mgr.smithi049.rjblpr (mgr.14194) 246 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:32:04.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:03.817732+0000 mgr.smithi049.rjblpr (mgr.14194) 247 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:05.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:03.656498+0000 mgr.smithi049.rjblpr (mgr.14194) 245 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:32:05.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:03.660861+0000 mon.smithi049 (mon.0) 619 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:05.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:03.667492+0000 mon.smithi049 (mon.0) 620 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:05.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:03.669374+0000 mon.smithi049 (mon.0) 621 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:32:05.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:03.670191+0000 mon.smithi049 (mon.0) 622 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:32:05.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:03.674819+0000 mon.smithi049 (mon.0) 623 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:05.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:03.679928+0000 mgr.smithi049.rjblpr (mgr.14194) 246 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:32:05.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:03.817732+0000 mgr.smithi049.rjblpr (mgr.14194) 247 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:07.160 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:05.818197+0000 mgr.smithi049.rjblpr (mgr.14194) 248 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:07.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:05.818197+0000 mgr.smithi049.rjblpr (mgr.14194) 248 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.417+0000 7f729a31c700 1 -- 172.21.15.49:0/224984489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 msgr2=0x7f72940fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.417+0000 7f729a31c700 1 --2- 172.21.15.49:0/224984489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 0x7f72940fa3d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f72840047f0 tx=0x7f7284009cb0).stop 2024-02-22T00:32:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.417+0000 7f729a31c700 1 -- 172.21.15.49:0/224984489 shutdown_connections 2024-02-22T00:32:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.417+0000 7f729a31c700 1 --2- 172.21.15.49:0/224984489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72940fa950 0x7f72940fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.417+0000 7f729a31c700 1 --2- 172.21.15.49:0/224984489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 0x7f72940fa3d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.417+0000 7f729a31c700 1 -- 172.21.15.49:0/224984489 >> 172.21.15.49:0/224984489 conn(0x7f72940f1e50 msgr2=0x7f72940f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.417+0000 7f729a31c700 1 -- 172.21.15.49:0/224984489 shutdown_connections 2024-02-22T00:32:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.417+0000 7f729a31c700 1 -- 172.21.15.49:0/224984489 wait complete. 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f729a31c700 1 Processor -- start 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f729a31c700 1 -- start start 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f729a31c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 0x7f72941080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f729a31c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72940fa950 0x7f7294108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f729a31c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294108b40 con 0x7f7294061280 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f729a31c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294108c80 con 0x7f72940fa950 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f7293fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 0x7f72941080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f7293fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 0x7f72941080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34696/0 (socket says 172.21.15.49:34696) 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f72937fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72940fa950 0x7f7294108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:07.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.418+0000 7f7293fff700 1 -- 172.21.15.49:0/3696367823 learned_addr learned my addr 172.21.15.49:0/3696367823 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f72937fe700 1 -- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 msgr2=0x7f72941080a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f72937fe700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 0x7f72941080a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f72937fe700 1 -- 172.21.15.49:0/3696367823 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7284005040 con 0x7f72940fa950 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f7293fff700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 0x7f72941080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f72937fe700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72940fa950 0x7f7294108590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f728800e840 tx=0x7f728800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f72917fa700 1 -- 172.21.15.49:0/3696367823 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7288007b40 con 0x7f72940fa950 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729410d720 con 0x7f72940fa950 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f72917fa700 1 -- 172.21.15.49:0/3696367823 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f728800f040 con 0x7f72940fa950 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f72917fa700 1 -- 172.21.15.49:0/3696367823 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7288014890 con 0x7f72940fa950 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.419+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729410dce0 con 0x7f72940fa950 2024-02-22T00:32:07.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.420+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7294100000 con 0x7f72940fa950 2024-02-22T00:32:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.421+0000 7f72917fa700 1 -- 172.21.15.49:0/3696367823 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f7288014b50 con 0x7f72940fa950 2024-02-22T00:32:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.421+0000 7f72917fa700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f727c061180 0x7f727c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.421+0000 7f72917fa700 1 -- 172.21.15.49:0/3696367823 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f728807c2e0 con 0x7f72940fa950 2024-02-22T00:32:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.421+0000 7f7293fff700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f727c061180 0x7f727c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.422+0000 7f7293fff700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f727c061180 0x7f727c063640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7284009bc0 tx=0x7f728400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.430+0000 7f72917fa700 1 -- 172.21.15.49:0/3696367823 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7288049f60 con 0x7f72940fa950 2024-02-22T00:32:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.625+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7294059120 con 0x7f727c061180 2024-02-22T00:32:07.717 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.627+0000 7f72917fa700 1 -- 172.21.15.49:0/3696367823 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f7294059120 con 0x7f727c061180 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f727c061180 msgr2=0x7f727c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f727c061180 0x7f727c063640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7284009bc0 tx=0x7f728400b040).stop 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72940fa950 msgr2=0x7f7294108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72940fa950 0x7f7294108590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f728800e840 tx=0x7f728800b040).stop 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 shutdown_connections 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7294061280 0x7f72941080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f727c061180 0x7f727c063640 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 --2- 172.21.15.49:0/3696367823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72940fa950 0x7f7294108590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 >> 172.21.15.49:0/3696367823 conn(0x7f72940f1e50 msgr2=0x7f72940f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:07.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 shutdown_connections 2024-02-22T00:32:07.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.629+0000 7f729a31c700 1 -- 172.21.15.49:0/3696367823 wait complete. 2024-02-22T00:32:07.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.743+0000 7f0f56add700 1 -- 172.21.15.49:0/1747087867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f5ab0 msgr2=0x7f0f500f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:07.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.743+0000 7f0f56add700 1 --2- 172.21.15.49:0/1747087867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f5ab0 0x7f0f500f5ed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0f440047f0 tx=0x7f0f44009cb0).stop 2024-02-22T00:32:07.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.743+0000 7f0f56add700 1 -- 172.21.15.49:0/1747087867 shutdown_connections 2024-02-22T00:32:07.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.743+0000 7f0f56add700 1 --2- 172.21.15.49:0/1747087867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f500f6450 0x7f0f500f8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.743+0000 7f0f56add700 1 --2- 172.21.15.49:0/1747087867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f5ab0 0x7f0f500f5ed0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.743+0000 7f0f56add700 1 -- 172.21.15.49:0/1747087867 >> 172.21.15.49:0/1747087867 conn(0x7f0f500f15d0 msgr2=0x7f0f500f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:07.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.744+0000 7f0f56add700 1 -- 172.21.15.49:0/1747087867 shutdown_connections 2024-02-22T00:32:07.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.744+0000 7f0f56add700 1 -- 172.21.15.49:0/1747087867 wait complete. 2024-02-22T00:32:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.744+0000 7f0f56add700 1 Processor -- start 2024-02-22T00:32:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.744+0000 7f0f56add700 1 -- start start 2024-02-22T00:32:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f56add700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f500f5ab0 0x7f0f500f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:07.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f56add700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f6450 0x7f0f500f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f56add700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500f8a30 con 0x7f0f500f6450 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f56add700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5010be20 con 0x7f0f500f5ab0 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f54879700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f500f5ab0 0x7f0f500f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f54879700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f500f5ab0 0x7f0f500f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:60486/0 (socket says 172.21.15.49:60486) 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f54879700 1 -- 172.21.15.49:0/2344010910 learned_addr learned my addr 172.21.15.49:0/2344010910 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f4ffff700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f6450 0x7f0f500f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f4ffff700 1 -- 172.21.15.49:0/2344010910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f500f5ab0 msgr2=0x7f0f500f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f4ffff700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f500f5ab0 0x7f0f500f8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f4ffff700 1 -- 172.21.15.49:0/2344010910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44005040 con 0x7f0f500f6450 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f54879700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f500f5ab0 0x7f0f500f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.745+0000 7f0f4ffff700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f6450 0x7f0f500f6ae0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f0f3c00e840 tx=0x7f0f3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:07.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.746+0000 7f0f4df76700 1 -- 172.21.15.49:0/2344010910 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c007b40 con 0x7f0f500f6450 2024-02-22T00:32:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.746+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5010c0a0 con 0x7f0f500f6450 2024-02-22T00:32:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.746+0000 7f0f4df76700 1 -- 172.21.15.49:0/2344010910 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f3c00f040 con 0x7f0f500f6450 2024-02-22T00:32:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.746+0000 7f0f4df76700 1 -- 172.21.15.49:0/2344010910 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f3c014810 con 0x7f0f500f6450 2024-02-22T00:32:07.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.746+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5010c660 con 0x7f0f500f6450 2024-02-22T00:32:07.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.747+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f50100000 con 0x7f0f500f6450 2024-02-22T00:32:07.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.748+0000 7f0f4df76700 1 -- 172.21.15.49:0/2344010910 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f0f3c014a40 con 0x7f0f500f6450 2024-02-22T00:32:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.749+0000 7f0f4df76700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0f40061180 0x7f0f40063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.749+0000 7f0f54879700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0f40061180 0x7f0f40063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.749+0000 7f0f54879700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0f40061180 0x7f0f40063640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0f44009bc0 tx=0x7f0f4400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.757+0000 7f0f4df76700 1 -- 172.21.15.49:0/2344010910 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f0f3c050160 con 0x7f0f500f6450 2024-02-22T00:32:07.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:07.757+0000 7f0f4df76700 1 -- 172.21.15.49:0/2344010910 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0f3c081060 con 0x7f0f500f6450 2024-02-22T00:32:08.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.107+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f50101f80 con 0x7f0f40061180 2024-02-22T00:32:08.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.108+0000 7f0f4df76700 1 -- 172.21.15.49:0/2344010910 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f0f50101f80 con 0x7f0f40061180 2024-02-22T00:32:08.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0f40061180 msgr2=0x7f0f40063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0f40061180 0x7f0f40063640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0f44009bc0 tx=0x7f0f4400b040).stop 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f6450 msgr2=0x7f0f500f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f6450 0x7f0f500f6ae0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f0f3c00e840 tx=0x7f0f3c00b040).stop 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 shutdown_connections 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0f40061180 0x7f0f40063640 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f500f5ab0 0x7f0f500f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 --2- 172.21.15.49:0/2344010910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f500f6450 0x7f0f500f6ae0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 >> 172.21.15.49:0/2344010910 conn(0x7f0f500f15d0 msgr2=0x7f0f500fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 shutdown_connections 2024-02-22T00:32:08.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.111+0000 7f0f56add700 1 -- 172.21.15.49:0/2344010910 wait complete. 2024-02-22T00:32:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.216+0000 7f0b14c51700 1 -- 172.21.15.49:0/3103751527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100f64d0 msgr2=0x7f0b100f8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.216+0000 7f0b14c51700 1 --2- 172.21.15.49:0/3103751527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100f64d0 0x7f0b100f8c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f0b040047f0 tx=0x7f0b04009cb0).stop 2024-02-22T00:32:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.216+0000 7f0b14c51700 1 -- 172.21.15.49:0/3103751527 shutdown_connections 2024-02-22T00:32:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.216+0000 7f0b14c51700 1 --2- 172.21.15.49:0/3103751527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100f64d0 0x7f0b100f8c50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.216+0000 7f0b14c51700 1 --2- 172.21.15.49:0/3103751527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100f5b30 0x7f0b100f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.216+0000 7f0b14c51700 1 -- 172.21.15.49:0/3103751527 >> 172.21.15.49:0/3103751527 conn(0x7f0b100f1670 msgr2=0x7f0b100f3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:08.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.216+0000 7f0b14c51700 1 -- 172.21.15.49:0/3103751527 shutdown_connections 2024-02-22T00:32:08.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.216+0000 7f0b14c51700 1 -- 172.21.15.49:0/3103751527 wait complete. 2024-02-22T00:32:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.217+0000 7f0b14c51700 1 Processor -- start 2024-02-22T00:32:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.217+0000 7f0b14c51700 1 -- start start 2024-02-22T00:32:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b14c51700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100f5b30 0x7f0b100f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b14c51700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100f64d0 0x7f0b100f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b14c51700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100f8ab0 con 0x7f0b100f5b30 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b14c51700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100f7050 con 0x7f0b100f64d0 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b0dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100f64d0 0x7f0b100f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b0dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100f64d0 0x7f0b100f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:60510/0 (socket says 172.21.15.49:60510) 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b0dd9b700 1 -- 172.21.15.49:0/2133926284 learned_addr learned my addr 172.21.15.49:0/2133926284 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b0e59c700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100f5b30 0x7f0b100f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b0dd9b700 1 -- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100f5b30 msgr2=0x7f0b100f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b0dd9b700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100f5b30 0x7f0b100f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b0dd9b700 1 -- 172.21.15.49:0/2133926284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04005040 con 0x7f0b100f64d0 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0b0dd9b700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100f64d0 0x7f0b100f6b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b04013560 tx=0x7f0b04009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.218+0000 7f0aff7fe700 1 -- 172.21.15.49:0/2133926284 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b04018070 con 0x7f0b100f64d0 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.219+0000 7f0aff7fe700 1 -- 172.21.15.49:0/2133926284 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b04007e90 con 0x7f0b100f64d0 2024-02-22T00:32:08.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.219+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b100f7270 con 0x7f0b100f64d0 2024-02-22T00:32:08.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.219+0000 7f0aff7fe700 1 -- 172.21.15.49:0/2133926284 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0401c5e0 con 0x7f0b100f64d0 2024-02-22T00:32:08.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.219+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b100f77d0 con 0x7f0b100f64d0 2024-02-22T00:32:08.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.220+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b10100000 con 0x7f0b100f64d0 2024-02-22T00:32:08.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.221+0000 7f0aff7fe700 1 -- 172.21.15.49:0/2133926284 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f0b04012870 con 0x7f0b100f64d0 2024-02-22T00:32:08.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.221+0000 7f0aff7fe700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0af8061180 0x7f0af8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.221+0000 7f0aff7fe700 1 -- 172.21.15.49:0/2133926284 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f0b0407d1c0 con 0x7f0b100f64d0 2024-02-22T00:32:08.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.222+0000 7f0b0e59c700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0af8061180 0x7f0af8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:08.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.222+0000 7f0b0e59c700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0af8061180 0x7f0af8063640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0b100608e0 tx=0x7f0b0000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:08.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.230+0000 7f0aff7fe700 1 -- 172.21.15.49:0/2133926284 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0b040516a0 con 0x7f0b100f64d0 2024-02-22T00:32:08.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.417+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b10059120 con 0x7f0af8061180 2024-02-22T00:32:08.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.427+0000 7f0aff7fe700 1 -- 172.21.15.49:0/2133926284 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0b10059120 con 0x7f0af8061180 2024-02-22T00:32:08.430 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:32:08.430 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (5m) 63s ago 6m 23.8M - 0.23.0 ba2b418f427c 05fc98ae8941 2024-02-22T00:32:08.430 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (6m) 63s ago 6m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:32:08.430 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (5m) 68s ago 5m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:32:08.430 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (5m) 63s ago 6m 52.2M - 8.3.5 dad864ee21e9 d07a1ce3ae93 2024-02-22T00:32:08.430 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (81s) 63s ago 80s 12.2M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (86s) 63s ago 86s 14.1M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (78s) 68s ago 78s 12.2M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (84s) 68s ago 83s 16.8M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:9283 running (7m) 63s ago 7m 433M - 16.2.14-550-geb66ed92 7403d1862307 c15a70e0a1be 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 running (5m) 68s ago 5m 386M - 16.2.14-550-geb66ed92 7403d1862307 dbe4d534c748 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (7m) 63s ago 8m 61.7M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (5m) 68s ago 5m 63.5M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (6m) 63s ago 6m 23.1M - 1.3.1 1dbe0e931976 22b6c923dd53 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (5m) 68s ago 5m 21.3M - 1.3.1 1dbe0e931976 3bd6815e682e 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (5m) 63s ago 5m 40.2M 4640M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (4m) 63s ago 4m 41.2M 4640M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 63s ago 4m 42.5M 4640M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (3m) 68s ago 3m 41.4M 4982M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:32:08.431 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (3m) 68s ago 3m 39.6M 4982M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:32:08.432 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (2m) 68s ago 2m 39.5M 4982M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:32:08.432 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (5m) 68s ago 5m 60.2M - 2.33.4 514e6a882f6e 0880324bb723 2024-02-22T00:32:08.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0af8061180 msgr2=0x7f0af8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0af8061180 0x7f0af8063640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0b100608e0 tx=0x7f0b0000b040).stop 2024-02-22T00:32:08.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100f64d0 msgr2=0x7f0b100f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100f64d0 0x7f0b100f6b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b04013560 tx=0x7f0b04009cb0).stop 2024-02-22T00:32:08.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 shutdown_connections 2024-02-22T00:32:08.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100f5b30 0x7f0b100f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f0af8061180 0x7f0af8063640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 --2- 172.21.15.49:0/2133926284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100f64d0 0x7f0b100f6b60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 >> 172.21.15.49:0/2133926284 conn(0x7f0b100f1670 msgr2=0x7f0b100fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:08.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 shutdown_connections 2024-02-22T00:32:08.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.429+0000 7f0b14c51700 1 -- 172.21.15.49:0/2133926284 wait complete. 2024-02-22T00:32:08.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.539+0000 7fb32bbb2700 1 -- 172.21.15.49:0/2505251364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3240f7990 msgr2=0x7fb3240f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.539+0000 7fb32bbb2700 1 --2- 172.21.15.49:0/2505251364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3240f7990 0x7fb3240f7df0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fb3140047f0 tx=0x7fb314009cb0).stop 2024-02-22T00:32:08.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.539+0000 7fb32bbb2700 1 -- 172.21.15.49:0/2505251364 shutdown_connections 2024-02-22T00:32:08.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.539+0000 7fb32bbb2700 1 --2- 172.21.15.49:0/2505251364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3240f7990 0x7fb3240f7df0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.539+0000 7fb32bbb2700 1 --2- 172.21.15.49:0/2505251364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3240f66f0 0x7fb3240f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.539+0000 7fb32bbb2700 1 -- 172.21.15.49:0/2505251364 >> 172.21.15.49:0/2505251364 conn(0x7fb3240f1e50 msgr2=0x7fb3240f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:08.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.539+0000 7fb32bbb2700 1 -- 172.21.15.49:0/2505251364 shutdown_connections 2024-02-22T00:32:08.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.539+0000 7fb32bbb2700 1 -- 172.21.15.49:0/2505251364 wait complete. 2024-02-22T00:32:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.540+0000 7fb32bbb2700 1 Processor -- start 2024-02-22T00:32:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.540+0000 7fb32bbb2700 1 -- start start 2024-02-22T00:32:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.540+0000 7fb32bbb2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3240f66f0 0x7fb3240fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.540+0000 7fb32bbb2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3240f7990 0x7fb3240fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.540+0000 7fb32bbb2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240fec40 con 0x7fb3240f66f0 2024-02-22T00:32:08.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.540+0000 7fb32bbb2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240fd1e0 con 0x7fb3240f7990 2024-02-22T00:32:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.541+0000 7fb32914d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3240f7990 0x7fb3240fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.541+0000 7fb32914d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3240f7990 0x7fb3240fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:60530/0 (socket says 172.21.15.49:60530) 2024-02-22T00:32:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.541+0000 7fb32914d700 1 -- 172.21.15.49:0/112410415 learned_addr learned my addr 172.21.15.49:0/112410415 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.541+0000 7fb32914d700 1 -- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3240f66f0 msgr2=0x7fb3240fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.541+0000 7fb32914d700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3240f66f0 0x7fb3240fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:32:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.541+0000 7fb32914d700 1 -- 172.21.15.49:0/112410415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314005040 con 0x7fb3240f7990 2024-02-22T00:32:08.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.541+0000 7fb32914d700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3240f7990 0x7fb3240fccf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb314013560 tx=0x7fb314009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.543+0000 7fb31affd700 1 -- 172.21.15.49:0/112410415 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb314018070 con 0x7fb3240f7990 2024-02-22T00:32:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.543+0000 7fb31affd700 1 -- 172.21.15.49:0/112410415 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb314007e90 con 0x7fb3240f7990 2024-02-22T00:32:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.543+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3240fd400 con 0x7fb3240f7990 2024-02-22T00:32:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.543+0000 7fb31affd700 1 -- 172.21.15.49:0/112410415 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb31401c5e0 con 0x7fb3240f7990 2024-02-22T00:32:08.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.543+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3240fd960 con 0x7fb3240f7990 2024-02-22T00:32:08.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.545+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb324100000 con 0x7fb3240f7990 2024-02-22T00:32:08.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.545+0000 7fb31affd700 1 -- 172.21.15.49:0/112410415 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fb3140123c0 con 0x7fb3240f7990 2024-02-22T00:32:08.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.546+0000 7fb31affd700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb3100611c0 0x7fb310063680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.546+0000 7fb31affd700 1 -- 172.21.15.49:0/112410415 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fb31407d660 con 0x7fb3240f7990 2024-02-22T00:32:08.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.546+0000 7fb32994e700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb3100611c0 0x7fb310063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:08.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.546+0000 7fb32994e700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb3100611c0 0x7fb310063680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb3240f77f0 tx=0x7fb32000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:08.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.553+0000 7fb31affd700 1 -- 172.21.15.49:0/112410415 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb3140515b0 con 0x7fb3240f7990 2024-02-22T00:32:08.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:07.627777+0000 mgr.smithi049.rjblpr (mgr.14194) 249 : audit [DBG] from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:07.655249+0000 mon.smithi049 (mon.0) 624 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:07.656294+0000 mgr.smithi049.rjblpr (mgr.14194) 250 : cephadm [INF] Upgrade: Target is version 18.2.1-638-gc1dc18f4 (unknown) 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:07.656379+0000 mgr.smithi049.rjblpr (mgr.14194) 251 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0, digests ['quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0'] 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:07.657437+0000 mon.smithi049 (mon.0) 625 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:07.663999+0000 mon.smithi049 (mon.0) 626 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:07.665129+0000 mgr.smithi049.rjblpr (mgr.14194) 252 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi049.rjblpr) 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:07.818652+0000 mgr.smithi049.rjblpr (mgr.14194) 253 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:07.958161+0000 mgr.smithi049.rjblpr (mgr.14194) 254 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0 on smithi161 2024-02-22T00:32:08.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:08.109222+0000 mgr.smithi049.rjblpr (mgr.14194) 255 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:08.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.863+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3240598f0 con 0x7fb3240f7990 2024-02-22T00:32:08.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.864+0000 7fb31affd700 1 -- 172.21.15.49:0/112410415 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7fb3140511a0 con 0x7fb3240f7990 2024-02-22T00:32:08.867 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:32:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:32:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:32:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:32:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:32:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:32:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:32:08.867 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 14 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:32:08.868 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:32:08.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.866+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb3100611c0 msgr2=0x7fb310063680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.866+0000 7fb32bbb2700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb3100611c0 0x7fb310063680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb3240f77f0 tx=0x7fb32000b040).stop 2024-02-22T00:32:08.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.866+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3240f7990 msgr2=0x7fb3240fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.866+0000 7fb32bbb2700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3240f7990 0x7fb3240fccf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb314013560 tx=0x7fb314009cb0).stop 2024-02-22T00:32:08.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.867+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 shutdown_connections 2024-02-22T00:32:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.867+0000 7fb32bbb2700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3240f66f0 0x7fb3240fe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:32:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.867+0000 7fb32bbb2700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fb3100611c0 0x7fb310063680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.867+0000 7fb32bbb2700 1 --2- 172.21.15.49:0/112410415 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3240f7990 0x7fb3240fccf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.867+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 >> 172.21.15.49:0/112410415 conn(0x7fb3240f1e50 msgr2=0x7fb3240fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.867+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 shutdown_connections 2024-02-22T00:32:08.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.867+0000 7fb32bbb2700 1 -- 172.21.15.49:0/112410415 wait complete. 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:07.627777+0000 mgr.smithi049.rjblpr (mgr.14194) 249 : audit [DBG] from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:07.655249+0000 mon.smithi049 (mon.0) 624 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:07.656294+0000 mgr.smithi049.rjblpr (mgr.14194) 250 : cephadm [INF] Upgrade: Target is version 18.2.1-638-gc1dc18f4 (unknown) 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:07.656379+0000 mgr.smithi049.rjblpr (mgr.14194) 251 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0, digests ['quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0'] 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:07.657437+0000 mon.smithi049 (mon.0) 625 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:07.663999+0000 mon.smithi049 (mon.0) 626 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:07.665129+0000 mgr.smithi049.rjblpr (mgr.14194) 252 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi049.rjblpr) 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:07.818652+0000 mgr.smithi049.rjblpr (mgr.14194) 253 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:07.958161+0000 mgr.smithi049.rjblpr (mgr.14194) 254 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0 on smithi161 2024-02-22T00:32:08.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:08.109222+0000 mgr.smithi049.rjblpr (mgr.14194) 255 : audit [DBG] from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.982+0000 7f5e6133e700 1 -- 172.21.15.49:0/3441291965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c0f7990 msgr2=0x7f5e5c0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.983+0000 7f5e6133e700 1 --2- 172.21.15.49:0/3441291965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c0f7990 0x7f5e5c0f7df0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5e500047f0 tx=0x7f5e50009cb0).stop 2024-02-22T00:32:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.983+0000 7f5e6133e700 1 -- 172.21.15.49:0/3441291965 shutdown_connections 2024-02-22T00:32:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.983+0000 7f5e6133e700 1 --2- 172.21.15.49:0/3441291965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c0f7990 0x7f5e5c0f7df0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.983+0000 7f5e6133e700 1 --2- 172.21.15.49:0/3441291965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5c0f66f0 0x7f5e5c0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:32:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.983+0000 7f5e6133e700 1 -- 172.21.15.49:0/3441291965 >> 172.21.15.49:0/3441291965 conn(0x7f5e5c0f1e50 msgr2=0x7f5e5c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.983+0000 7f5e6133e700 1 -- 172.21.15.49:0/3441291965 shutdown_connections 2024-02-22T00:32:08.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.983+0000 7f5e6133e700 1 -- 172.21.15.49:0/3441291965 wait complete. 2024-02-22T00:32:08.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.983+0000 7f5e6133e700 1 Processor -- start 2024-02-22T00:32:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e6133e700 1 -- start start 2024-02-22T00:32:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e6133e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5c0f66f0 0x7f5e5c0fedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e6133e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c0f7990 0x7f5e5c0fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e6133e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0fd920 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e6133e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0fda60 con 0x7f5e5c0f7990 2024-02-22T00:32:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e5affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5c0f66f0 0x7f5e5c0fedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e5affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5c0f66f0 0x7f5e5c0fedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34756/0 (socket says 172.21.15.49:34756) 2024-02-22T00:32:08.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e5affd700 1 -- 172.21.15.49:0/912574877 learned_addr learned my addr 172.21.15.49:0/912574877 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e5a7fc700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c0f7990 0x7f5e5c0fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e5affd700 1 -- 172.21.15.49:0/912574877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c0f7990 msgr2=0x7f5e5c0fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e5affd700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c0f7990 0x7f5e5c0fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.984+0000 7f5e5affd700 1 -- 172.21.15.49:0/912574877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50005040 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.985+0000 7f5e5affd700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5c0f66f0 0x7f5e5c0fedd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f5e4c00b480 tx=0x7f5e4c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.985+0000 7f5e43fff700 1 -- 172.21.15.49:0/912574877 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c002500 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.985+0000 7f5e43fff700 1 -- 172.21.15.49:0/912574877 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5e4c002b10 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.985+0000 7f5e43fff700 1 -- 172.21.15.49:0/912574877 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4c012c90 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.985+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5c0fdd40 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.985+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c0fe280 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.986+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c100050 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.987+0000 7f5e43fff700 1 -- 172.21.15.49:0/912574877 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f5e4c002660 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.987+0000 7f5e43fff700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e44061180 0x7f5e44063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.988+0000 7f5e43fff700 1 -- 172.21.15.49:0/912574877 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f5e4c07c920 con 0x7f5e5c0f66f0 2024-02-22T00:32:08.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.988+0000 7f5e5a7fc700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e44061180 0x7f5e44063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:08.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.988+0000 7f5e5a7fc700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e44061180 0x7f5e44063640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5e50004f10 tx=0x7f5e5000b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:08.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:08.995+0000 7f5e43fff700 1 -- 172.21.15.49:0/912574877 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5e4c050870 con 0x7f5e5c0f66f0 2024-02-22T00:32:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.186+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e5c059120 con 0x7f5e44061180 2024-02-22T00:32:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.188+0000 7f5e43fff700 1 -- 172.21.15.49:0/912574877 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f5e5c059120 con 0x7f5e44061180 2024-02-22T00:32:09.190 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:32:09.190 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:32:09.191 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:32:09.191 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:32:09.191 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-02-22T00:32:09.191 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "0/2 daemons upgraded", 2024-02-22T00:32:09.191 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0 image on host smithi161", 2024-02-22T00:32:09.191 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:32:09.191 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:32:09.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e44061180 msgr2=0x7f5e44063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e44061180 0x7f5e44063640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f5e50004f10 tx=0x7f5e5000b040).stop 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5c0f66f0 msgr2=0x7f5e5c0fedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5c0f66f0 0x7f5e5c0fedd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f5e4c00b480 tx=0x7f5e4c0090f0).stop 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 shutdown_connections 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e5c0f66f0 0x7f5e5c0fedd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f5e44061180 0x7f5e44063640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 --2- 172.21.15.49:0/912574877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e5c0f7990 0x7f5e5c0fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 >> 172.21.15.49:0/912574877 conn(0x7f5e5c0f1e50 msgr2=0x7f5e5c0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:09.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 shutdown_connections 2024-02-22T00:32:09.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:09.190+0000 7f5e6133e700 1 -- 172.21.15.49:0/912574877 wait complete. 2024-02-22T00:32:09.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:08.419370+0000 mgr.smithi049.rjblpr (mgr.14194) 256 : audit [DBG] from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:09.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:08.865100+0000 mon.smithi161 (mon.1) 17 : audit [DBG] from='client.? 172.21.15.49:0/112410415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:32:09.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:09.188694+0000 mgr.smithi049.rjblpr (mgr.14194) 257 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:10.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:08.419370+0000 mgr.smithi049.rjblpr (mgr.14194) 256 : audit [DBG] from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:10.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:08.865100+0000 mon.smithi161 (mon.1) 17 : audit [DBG] from='client.? 172.21.15.49:0/112410415' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:32:10.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:09.188694+0000 mgr.smithi049.rjblpr (mgr.14194) 257 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:09.819125+0000 mgr.smithi049.rjblpr (mgr.14194) 258 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:11.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:09.819125+0000 mgr.smithi049.rjblpr (mgr.14194) 258 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:13.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:11.819571+0000 mgr.smithi049.rjblpr (mgr.14194) 259 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:13.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:11.819571+0000 mgr.smithi049.rjblpr (mgr.14194) 259 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:14.954 INFO:tasks.workunit.client.1.smithi161.stderr:Updating files: 94% (11364/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-02-22T00:32:15.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:13.819987+0000 mgr.smithi049.rjblpr (mgr.14194) 260 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:15.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:13.819987+0000 mgr.smithi049.rjblpr (mgr.14194) 260 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr:Note: switching to 'c1dc18f444603397768fcb7c34a8488b10284df6'. 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr:state without impacting any branches by switching back to a branch. 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr: git switch -c 2024-02-22T00:32:15.817 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-02-22T00:32:15.818 INFO:tasks.workunit.client.1.smithi161.stderr:Or undo this operation with: 2024-02-22T00:32:15.818 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-02-22T00:32:15.818 INFO:tasks.workunit.client.1.smithi161.stderr: git switch - 2024-02-22T00:32:15.818 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-02-22T00:32:15.818 INFO:tasks.workunit.client.1.smithi161.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-22T00:32:15.818 INFO:tasks.workunit.client.1.smithi161.stderr: 2024-02-22T00:32:15.818 INFO:tasks.workunit.client.1.smithi161.stderr:HEAD is now at c1dc18f4446 Merge branch 'wip-64505-reef' of https://github.com/batrick/ceph into wip-yuri10-testing-2024-02-21-1249-reef 2024-02-22T00:32:15.822 DEBUG:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-22T00:32:15.888 INFO:tasks.workunit.client.1.smithi161.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-22T00:32:15.891 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-22T00:32:15.891 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-22T00:32:16.362 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-22T00:32:16.420 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-22T00:32:16.461 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-22T00:32:16.462 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-22T00:32:16.462 INFO:tasks.workunit.client.1.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-22T00:32:16.500 INFO:tasks.workunit.client.1.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-22T00:32:16.503 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-02-22T00:32:16.503 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-22T00:32:16.562 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-22T00:32:16.563 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-22T00:32:16.564 DEBUG:teuthology.orchestra.run.smithi161:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c1dc18f444603397768fcb7c34a8488b10284df6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-22T00:32:16.633 INFO:tasks.workunit.client.1.smithi161.stderr:+ mkdir -p fsstress 2024-02-22T00:32:16.635 INFO:tasks.workunit.client.1.smithi161.stderr:+ pushd fsstress 2024-02-22T00:32:16.637 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-22T00:32:16.637 INFO:tasks.workunit.client.1.smithi161.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-22T00:32:17.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:15.820453+0000 mgr.smithi049.rjblpr (mgr.14194) 261 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:17.195 INFO:tasks.workunit.client.1.smithi161.stderr:+ tar xzf ltp-full.tgz 2024-02-22T00:32:17.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:15.820453+0000 mgr.smithi049.rjblpr (mgr.14194) 261 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:32:19.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:17.823407+0000 mgr.smithi049.rjblpr (mgr.14194) 262 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 46 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s wr, 0 op/s 2024-02-22T00:32:19.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:17.823407+0000 mgr.smithi049.rjblpr (mgr.14194) 262 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 46 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s wr, 0 op/s 2024-02-22T00:32:21.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:19.823768+0000 mgr.smithi049.rjblpr (mgr.14194) 263 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 5.4 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 471 KiB/s wr, 25 op/s 2024-02-22T00:32:21.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:19.823768+0000 mgr.smithi049.rjblpr (mgr.14194) 263 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 5.4 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 471 KiB/s wr, 25 op/s 2024-02-22T00:32:23.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:21.824135+0000 mgr.smithi049.rjblpr (mgr.14194) 264 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s wr, 52 op/s 2024-02-22T00:32:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:21.824135+0000 mgr.smithi049.rjblpr (mgr.14194) 264 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s wr, 52 op/s 2024-02-22T00:32:23.353 INFO:tasks.workunit.client.0.smithi049.stderr:Updating files: 85% (10379/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-02-22T00:32:23.961 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to 'c1dc18f444603397768fcb7c34a8488b10284df6'. 2024-02-22T00:32:23.961 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-02-22T00:32:23.961 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-22T00:32:23.961 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-22T00:32:23.962 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-02-22T00:32:23.963 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at c1dc18f4446 Merge branch 'wip-64505-reef' of https://github.com/batrick/ceph into wip-yuri10-testing-2024-02-21-1249-reef 2024-02-22T00:32:23.967 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-22T00:32:23.997 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-22T00:32:23.999 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-22T00:32:24.000 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-22T00:32:25.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:23.824502+0000 mgr.smithi049.rjblpr (mgr.14194) 265 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s wr, 73 op/s 2024-02-22T00:32:25.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:23.824502+0000 mgr.smithi049.rjblpr (mgr.14194) 265 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s wr, 73 op/s 2024-02-22T00:32:26.609 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-22T00:32:26.727 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-22T00:32:26.846 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-22T00:32:26.848 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-22T00:32:26.848 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-22T00:32:26.902 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-22T00:32:26.907 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T00:32:26.908 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-22T00:32:26.969 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-22T00:32:26.971 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-22T00:32:26.971 DEBUG:teuthology.orchestra.run.smithi049:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c1dc18f444603397768fcb7c34a8488b10284df6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-22T00:32:27.064 INFO:tasks.workunit.client.0.smithi049.stderr:+ mkdir -p fsstress 2024-02-22T00:32:27.067 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd fsstress 2024-02-22T00:32:27.069 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-22T00:32:27.069 INFO:tasks.workunit.client.0.smithi049.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-22T00:32:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:25.824876+0000 mgr.smithi049.rjblpr (mgr.14194) 266 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s wr, 147 op/s 2024-02-22T00:32:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:25.824876+0000 mgr.smithi049.rjblpr (mgr.14194) 266 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s wr, 147 op/s 2024-02-22T00:32:28.598 INFO:tasks.workunit.client.0.smithi049.stderr:+ tar xzf ltp-full.tgz 2024-02-22T00:32:29.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:27.825333+0000 mgr.smithi049.rjblpr (mgr.14194) 267 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 24 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s wr, 192 op/s 2024-02-22T00:32:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:27.896862+0000 mon.smithi049 (mon.0) 627 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:32:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:27.825333+0000 mgr.smithi049.rjblpr (mgr.14194) 267 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 24 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s wr, 192 op/s 2024-02-22T00:32:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:27.896862+0000 mon.smithi049 (mon.0) 627 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:32:31.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:29.825803+0000 mgr.smithi049.rjblpr (mgr.14194) 268 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s wr, 253 op/s 2024-02-22T00:32:31.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:29.825803+0000 mgr.smithi049.rjblpr (mgr.14194) 268 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 32 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s wr, 253 op/s 2024-02-22T00:32:33.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:31.826243+0000 mgr.smithi049.rjblpr (mgr.14194) 269 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 46 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s wr, 281 op/s 2024-02-22T00:32:33.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:31.826243+0000 mgr.smithi049.rjblpr (mgr.14194) 269 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 46 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s wr, 281 op/s 2024-02-22T00:32:35.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:33.826582+0000 mgr.smithi049.rjblpr (mgr.14194) 270 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 287 op/s 2024-02-22T00:32:35.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:33.826582+0000 mgr.smithi049.rjblpr (mgr.14194) 270 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 54 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 287 op/s 2024-02-22T00:32:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:35.827063+0000 mgr.smithi049.rjblpr (mgr.14194) 271 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 65 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 388 op/s 2024-02-22T00:32:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:36.203322+0000 mgr.smithi049.rjblpr (mgr.14194) 272 : cephadm [INF] Upgrade: Updating mgr.smithi161.sazlam 2024-02-22T00:32:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:36.208463+0000 mon.smithi049 (mon.0) 628 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:36.209511+0000 mon.smithi049 (mon.0) 629 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:32:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:36.210425+0000 mon.smithi049 (mon.0) 630 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:32:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:36.211050+0000 mon.smithi049 (mon.0) 631 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:32:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:36.211782+0000 mgr.smithi049.rjblpr (mgr.14194) 273 : cephadm [INF] Deploying daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:32:37.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:35.827063+0000 mgr.smithi049.rjblpr (mgr.14194) 271 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 65 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 388 op/s 2024-02-22T00:32:37.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:36.203322+0000 mgr.smithi049.rjblpr (mgr.14194) 272 : cephadm [INF] Upgrade: Updating mgr.smithi161.sazlam 2024-02-22T00:32:37.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:36.208463+0000 mon.smithi049 (mon.0) 628 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:37.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:36.209511+0000 mon.smithi049 (mon.0) 629 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:32:37.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:36.210425+0000 mon.smithi049 (mon.0) 630 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:32:37.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:36.211050+0000 mon.smithi049 (mon.0) 631 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:32:37.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:36.211782+0000 mgr.smithi049.rjblpr (mgr.14194) 273 : cephadm [INF] Deploying daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:32:39.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.334+0000 7fe6fe656700 1 -- 172.21.15.49:0/2301012999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 msgr2=0x7fe6f80f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:39.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.334+0000 7fe6fe656700 1 --2- 172.21.15.49:0/2301012999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 0x7fe6f80f7c20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fe6e80047f0 tx=0x7fe6e8009cb0).stop 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.334+0000 7fe6fe656700 1 -- 172.21.15.49:0/2301012999 shutdown_connections 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.334+0000 7fe6fe656700 1 --2- 172.21.15.49:0/2301012999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6f80f8aa0 0x7fe6f80f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.334+0000 7fe6fe656700 1 --2- 172.21.15.49:0/2301012999 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 0x7fe6f80f7c20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.334+0000 7fe6fe656700 1 -- 172.21.15.49:0/2301012999 >> 172.21.15.49:0/2301012999 conn(0x7fe6f80f2f80 msgr2=0x7fe6f80f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.334+0000 7fe6fe656700 1 -- 172.21.15.49:0/2301012999 shutdown_connections 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.334+0000 7fe6fe656700 1 -- 172.21.15.49:0/2301012999 wait complete. 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.335+0000 7fe6fe656700 1 Processor -- start 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.335+0000 7fe6fe656700 1 -- start start 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.335+0000 7fe6fe656700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 0x7fe6f810e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.335+0000 7fe6fe656700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6f80f8aa0 0x7fe6f810eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.335+0000 7fe6fe656700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f810f120 con 0x7fe6f80f7800 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.335+0000 7fe6fe656700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f810f260 con 0x7fe6f80f8aa0 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 0x7fe6f810e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:39.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 0x7fe6f810e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43820/0 (socket says 172.21.15.49:43820) 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f7fff700 1 -- 172.21.15.49:0/3139478041 learned_addr learned my addr 172.21.15.49:0/3139478041 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f77fe700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6f80f8aa0 0x7fe6f810eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f7fff700 1 -- 172.21.15.49:0/3139478041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6f80f8aa0 msgr2=0x7fe6f810eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f7fff700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6f80f8aa0 0x7fe6f810eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f7fff700 1 -- 172.21.15.49:0/3139478041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e8005040 con 0x7fe6f80f7800 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f7fff700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 0x7fe6f810e680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fe6e8013560 tx=0x7fe6e8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f57fa700 1 -- 172.21.15.49:0/3139478041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6e8018070 con 0x7fe6f80f7800 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f8113ca0 con 0x7fe6f80f7800 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f8114190 con 0x7fe6f80f7800 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f57fa700 1 -- 172.21.15.49:0/3139478041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe6e8007e90 con 0x7fe6f80f7800 2024-02-22T00:32:39.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.336+0000 7fe6f57fa700 1 -- 172.21.15.49:0/3139478041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6e801c380 con 0x7fe6f80f7800 2024-02-22T00:32:39.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.337+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e4005150 con 0x7fe6f80f7800 2024-02-22T00:32:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.342+0000 7fe6f57fa700 1 -- 172.21.15.49:0/3139478041 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7fe6e80097c0 con 0x7fe6f80f7800 2024-02-22T00:32:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.342+0000 7fe6f57fa700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe6e00611d0 0x7fe6e0063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.342+0000 7fe6f57fa700 1 -- 172.21.15.49:0/3139478041 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fe6e807d640 con 0x7fe6f80f7800 2024-02-22T00:32:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.342+0000 7fe6f77fe700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe6e00611d0 0x7fe6e0063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:39.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.343+0000 7fe6f77fe700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe6e00611d0 0x7fe6e0063690 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe6ec0048b0 tx=0x7fe6ec00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:39.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.343+0000 7fe6f57fa700 1 -- 172.21.15.49:0/3139478041 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe6e8051590 con 0x7fe6f80f7800 2024-02-22T00:32:39.452 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:37.827447+0000 mgr.smithi049.rjblpr (mgr.14194) 274 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 373 op/s 2024-02-22T00:32:39.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.553+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6e4000bc0 con 0x7fe6e00611d0 2024-02-22T00:32:39.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.554+0000 7fe6f57fa700 1 -- 172.21.15.49:0/3139478041 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fe6e4000bc0 con 0x7fe6e00611d0 2024-02-22T00:32:39.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe6e00611d0 msgr2=0x7fe6e0063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe6e00611d0 0x7fe6e0063690 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe6ec0048b0 tx=0x7fe6ec00b040).stop 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 msgr2=0x7fe6f810e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 0x7fe6f810e680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fe6e8013560 tx=0x7fe6e8009cb0).stop 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 shutdown_connections 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6f80f7800 0x7fe6f810e680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7fe6e00611d0 0x7fe6e0063690 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 --2- 172.21.15.49:0/3139478041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6f80f8aa0 0x7fe6f810eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 >> 172.21.15.49:0/3139478041 conn(0x7fe6f80f2f80 msgr2=0x7fe6f80fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 shutdown_connections 2024-02-22T00:32:39.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.558+0000 7fe6fe656700 1 -- 172.21.15.49:0/3139478041 wait complete. 2024-02-22T00:32:39.574 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:32:39.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:37.827447+0000 mgr.smithi049.rjblpr (mgr.14194) 274 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 72 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 373 op/s 2024-02-22T00:32:39.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.694+0000 7f9207c65700 1 -- 172.21.15.49:0/3966105290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f8aa0 msgr2=0x7f92000f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.694+0000 7f9207c65700 1 --2- 172.21.15.49:0/3966105290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f8aa0 0x7f92000f8f00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f91f00047f0 tx=0x7f91f0009cb0).stop 2024-02-22T00:32:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.694+0000 7f9207c65700 1 -- 172.21.15.49:0/3966105290 shutdown_connections 2024-02-22T00:32:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.694+0000 7f9207c65700 1 --2- 172.21.15.49:0/3966105290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f8aa0 0x7f92000f8f00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.694+0000 7f9207c65700 1 --2- 172.21.15.49:0/3966105290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92000f7800 0x7f92000f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.694+0000 7f9207c65700 1 -- 172.21.15.49:0/3966105290 >> 172.21.15.49:0/3966105290 conn(0x7f92000f2f80 msgr2=0x7f92000f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.694+0000 7f9207c65700 1 -- 172.21.15.49:0/3966105290 shutdown_connections 2024-02-22T00:32:39.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.694+0000 7f9207c65700 1 -- 172.21.15.49:0/3966105290 wait complete. 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9207c65700 1 Processor -- start 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9207c65700 1 -- start start 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9207c65700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f7800 0x7f9200069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9207c65700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92000f8aa0 0x7f920006a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9207c65700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920006a980 con 0x7f92000f8aa0 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9207c65700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920006aaf0 con 0x7f92000f7800 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9205200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92000f8aa0 0x7f920006a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9205200700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92000f8aa0 0x7f920006a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43838/0 (socket says 172.21.15.49:43838) 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9205200700 1 -- 172.21.15.49:0/87592745 learned_addr learned my addr 172.21.15.49:0/87592745 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:39.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.695+0000 7f9205a01700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f7800 0x7f9200069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f9205200700 1 -- 172.21.15.49:0/87592745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f7800 msgr2=0x7f9200069ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f9205200700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f7800 0x7f9200069ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f9205200700 1 -- 172.21.15.49:0/87592745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f0005040 con 0x7f92000f8aa0 2024-02-22T00:32:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f9205a01700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f7800 0x7f9200069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:32:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f9205200700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92000f8aa0 0x7f920006a3d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f91f0013560 tx=0x7f91f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f91f6ffd700 1 -- 172.21.15.49:0/87592745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91f0018070 con 0x7f92000f8aa0 2024-02-22T00:32:39.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9200115e80 con 0x7f92000f8aa0 2024-02-22T00:32:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92001163b0 con 0x7f92000f8aa0 2024-02-22T00:32:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f91f6ffd700 1 -- 172.21.15.49:0/87592745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91f0007e90 con 0x7f92000f8aa0 2024-02-22T00:32:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.696+0000 7f91f6ffd700 1 -- 172.21.15.49:0/87592745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91f001c380 con 0x7f92000f8aa0 2024-02-22T00:32:39.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.697+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e4005150 con 0x7f92000f8aa0 2024-02-22T00:32:39.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.699+0000 7f91f6ffd700 1 -- 172.21.15.49:0/87592745 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f91f00123c0 con 0x7f92000f8aa0 2024-02-22T00:32:39.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.700+0000 7f91f6ffd700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f91ec065590 0x7f91ec067a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:39.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.700+0000 7f91f6ffd700 1 -- 172.21.15.49:0/87592745 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f91f007d5f0 con 0x7f92000f8aa0 2024-02-22T00:32:39.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.701+0000 7f9205a01700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f91ec065590 0x7f91ec067a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:39.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.701+0000 7f9205a01700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f91ec065590 0x7f91ec067a50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f91fc007fd0 tx=0x7f91fc00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:39.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:39.706+0000 7f91f6ffd700 1 -- 172.21.15.49:0/87592745 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f91f00515a0 con 0x7f92000f8aa0 2024-02-22T00:32:40.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.001+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91e4000bf0 con 0x7f91ec065590 2024-02-22T00:32:40.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.003+0000 7f91f6ffd700 1 -- 172.21.15.49:0/87592745 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f91e4000bf0 con 0x7f91ec065590 2024-02-22T00:32:40.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.005+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f91ec065590 msgr2=0x7f91ec067a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.005+0000 7f9207c65700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f91ec065590 0x7f91ec067a50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f91fc007fd0 tx=0x7f91fc00b040).stop 2024-02-22T00:32:40.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.005+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92000f8aa0 msgr2=0x7f920006a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.005+0000 7f9207c65700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92000f8aa0 0x7f920006a3d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f91f0013560 tx=0x7f91f0009cb0).stop 2024-02-22T00:32:40.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.006+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 shutdown_connections 2024-02-22T00:32:40.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.006+0000 7f9207c65700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f91ec065590 0x7f91ec067a50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.006+0000 7f9207c65700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92000f7800 0x7f9200069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.006+0000 7f9207c65700 1 --2- 172.21.15.49:0/87592745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92000f8aa0 0x7f920006a3d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.006+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 >> 172.21.15.49:0/87592745 conn(0x7f92000f2f80 msgr2=0x7f92000fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:40.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.006+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 shutdown_connections 2024-02-22T00:32:40.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.006+0000 7f9207c65700 1 -- 172.21.15.49:0/87592745 wait complete. 2024-02-22T00:32:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.149+0000 7f8b674b8700 1 -- 172.21.15.49:0/3487864743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 msgr2=0x7f8b600fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.149+0000 7f8b674b8700 1 --2- 172.21.15.49:0/3487864743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 0x7f8b600fcda0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f8b500047f0 tx=0x7f8b50009cb0).stop 2024-02-22T00:32:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.149+0000 7f8b674b8700 1 -- 172.21.15.49:0/3487864743 shutdown_connections 2024-02-22T00:32:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.149+0000 7f8b674b8700 1 --2- 172.21.15.49:0/3487864743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 0x7f8b600fcda0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.149+0000 7f8b674b8700 1 --2- 172.21.15.49:0/3487864743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b60061280 0x7f8b600fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.149+0000 7f8b674b8700 1 -- 172.21.15.49:0/3487864743 >> 172.21.15.49:0/3487864743 conn(0x7f8b600f1e50 msgr2=0x7f8b600f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.149+0000 7f8b674b8700 1 -- 172.21.15.49:0/3487864743 shutdown_connections 2024-02-22T00:32:40.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.150+0000 7f8b674b8700 1 -- 172.21.15.49:0/3487864743 wait complete. 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.150+0000 7f8b674b8700 1 Processor -- start 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.150+0000 7f8b674b8700 1 -- start start 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.150+0000 7f8b674b8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b60061280 0x7f8b60110c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.150+0000 7f8b674b8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 0x7f8b60111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.150+0000 7f8b674b8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601116d0 con 0x7f8b600fa950 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.150+0000 7f8b674b8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60111840 con 0x7f8b60061280 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b65254700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b60061280 0x7f8b60110c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b64a53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 0x7f8b60111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b64a53700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 0x7f8b60111120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43850/0 (socket says 172.21.15.49:43850) 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b64a53700 1 -- 172.21.15.49:0/1278940800 learned_addr learned my addr 172.21.15.49:0/1278940800 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:40.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b65254700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b60061280 0x7f8b60110c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:37332/0 (socket says 172.21.15.49:37332) 2024-02-22T00:32:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b64a53700 1 -- 172.21.15.49:0/1278940800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b60061280 msgr2=0x7f8b60110c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b64a53700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b60061280 0x7f8b60110c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b64a53700 1 -- 172.21.15.49:0/1278940800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50005040 con 0x7f8b600fa950 2024-02-22T00:32:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b64a53700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 0x7f8b60111120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8b50000c00 tx=0x7f8b50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.151+0000 7f8b567fc700 1 -- 172.21.15.49:0/1278940800 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5001c070 con 0x7f8b600fa950 2024-02-22T00:32:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.152+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b600f61b0 con 0x7f8b600fa950 2024-02-22T00:32:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.152+0000 7f8b567fc700 1 -- 172.21.15.49:0/1278940800 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b50007e90 con 0x7f8b600fa950 2024-02-22T00:32:40.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.152+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b600f6710 con 0x7f8b600fa950 2024-02-22T00:32:40.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.152+0000 7f8b567fc700 1 -- 172.21.15.49:0/1278940800 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b50021780 con 0x7f8b600fa950 2024-02-22T00:32:40.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.153+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44005150 con 0x7f8b600fa950 2024-02-22T00:32:40.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.153+0000 7f8b567fc700 1 -- 172.21.15.49:0/1278940800 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f8b500125d0 con 0x7f8b600fa950 2024-02-22T00:32:40.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.154+0000 7f8b567fc700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f8b4c0611d0 0x7f8b4c063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:40.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.154+0000 7f8b567fc700 1 -- 172.21.15.49:0/1278940800 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f8b500817b0 con 0x7f8b600fa950 2024-02-22T00:32:40.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.154+0000 7f8b65254700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f8b4c0611d0 0x7f8b4c063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:40.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.154+0000 7f8b65254700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f8b4c0611d0 0x7f8b4c063690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8b5c004ee0 tx=0x7f8b5c00b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:40.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.159+0000 7f8b567fc700 1 -- 172.21.15.49:0/1278940800 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8b50055700 con 0x7f8b600fa950 2024-02-22T00:32:40.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.469+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b44000bf0 con 0x7f8b4c0611d0 2024-02-22T00:32:40.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.479+0000 7f8b567fc700 1 -- 172.21.15.49:0/1278940800 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f8b44000bf0 con 0x7f8b4c0611d0 2024-02-22T00:32:40.481 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:32:40.481 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (5m) 95s ago 7m 23.8M - 0.23.0 ba2b418f427c 05fc98ae8941 2024-02-22T00:32:40.481 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 95s ago 7m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:32:40.481 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (6m) 100s ago 6m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:32:40.481 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (5m) 95s ago 6m 52.2M - 8.3.5 dad864ee21e9 d07a1ce3ae93 2024-02-22T00:32:40.481 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (113s) 95s ago 112s 12.2M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (118s) 95s ago 118s 14.1M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (110s) 100s ago 110s 12.2M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (116s) 100s ago 115s 16.8M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:9283 running (8m) 95s ago 8m 433M - 16.2.14-550-geb66ed92 7403d1862307 c15a70e0a1be 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 starting - - - - 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (8m) 95s ago 8m 61.7M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (6m) 100s ago 6m 63.5M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (6m) 95s ago 6m 23.1M - 1.3.1 1dbe0e931976 22b6c923dd53 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 100s ago 6m 21.3M - 1.3.1 1dbe0e931976 3bd6815e682e 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (5m) 95s ago 5m 40.2M 4640M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 95s ago 5m 41.2M 4640M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 95s ago 4m 42.5M 4640M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:32:40.482 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (4m) 100s ago 4m 41.4M 4982M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:32:40.483 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (3m) 100s ago 3m 39.6M 4982M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:32:40.483 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (3m) 100s ago 3m 39.5M 4982M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:32:40.483 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (6m) 100s ago 6m 60.2M - 2.33.4 514e6a882f6e 0880324bb723 2024-02-22T00:32:40.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f8b4c0611d0 msgr2=0x7f8b4c063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f8b4c0611d0 0x7f8b4c063690 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8b5c004ee0 tx=0x7f8b5c00b040).stop 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 msgr2=0x7f8b60111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 0x7f8b60111120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8b50000c00 tx=0x7f8b50009cb0).stop 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 shutdown_connections 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f8b4c0611d0 0x7f8b4c063690 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b60061280 0x7f8b60110c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 --2- 172.21.15.49:0/1278940800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b600fa950 0x7f8b60111120 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 >> 172.21.15.49:0/1278940800 conn(0x7f8b600f1e50 msgr2=0x7f8b600f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 shutdown_connections 2024-02-22T00:32:40.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.481+0000 7f8b674b8700 1 -- 172.21.15.49:0/1278940800 wait complete. 2024-02-22T00:32:40.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.594+0000 7ff67bd2e700 1 -- 172.21.15.49:0/3519238681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 msgr2=0x7ff6740fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.594+0000 7ff67bd2e700 1 --2- 172.21.15.49:0/3519238681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 0x7ff6740fa3d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7ff6700047f0 tx=0x7ff670009cb0).stop 2024-02-22T00:32:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.594+0000 7ff67bd2e700 1 -- 172.21.15.49:0/3519238681 shutdown_connections 2024-02-22T00:32:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.594+0000 7ff67bd2e700 1 --2- 172.21.15.49:0/3519238681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6740fa950 0x7ff6740fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.594+0000 7ff67bd2e700 1 --2- 172.21.15.49:0/3519238681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 0x7ff6740fa3d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.594+0000 7ff67bd2e700 1 -- 172.21.15.49:0/3519238681 >> 172.21.15.49:0/3519238681 conn(0x7ff6740f1e50 msgr2=0x7ff6740f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.595+0000 7ff67bd2e700 1 -- 172.21.15.49:0/3519238681 shutdown_connections 2024-02-22T00:32:40.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.595+0000 7ff67bd2e700 1 -- 172.21.15.49:0/3519238681 wait complete. 2024-02-22T00:32:40.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.595+0000 7ff67bd2e700 1 Processor -- start 2024-02-22T00:32:40.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.595+0000 7ff67bd2e700 1 -- start start 2024-02-22T00:32:40.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff67bd2e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 0x7ff6740f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:40.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff67bd2e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6740fa950 0x7ff6740f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:40.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff67bd2e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740f8220 con 0x7ff674061280 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff67bd2e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740f67c0 con 0x7ff6740fa950 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff679aca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 0x7ff6740f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff679aca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 0x7ff6740f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43874/0 (socket says 172.21.15.49:43874) 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff679aca700 1 -- 172.21.15.49:0/1990756256 learned_addr learned my addr 172.21.15.49:0/1990756256 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff6792c9700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6740fa950 0x7ff6740f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff679aca700 1 -- 172.21.15.49:0/1990756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6740fa950 msgr2=0x7ff6740f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff679aca700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6740fa950 0x7ff6740f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff679aca700 1 -- 172.21.15.49:0/1990756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff670005040 con 0x7ff674061280 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff6792c9700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6740fa950 0x7ff6740f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.596+0000 7ff679aca700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 0x7ff6740f7c70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7ff670013560 tx=0x7ff670009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.597+0000 7ff66affd700 1 -- 172.21.15.49:0/1990756256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff670018070 con 0x7ff674061280 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.597+0000 7ff66affd700 1 -- 172.21.15.49:0/1990756256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff670007e90 con 0x7ff674061280 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.597+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6740f69e0 con 0x7ff674061280 2024-02-22T00:32:40.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.597+0000 7ff66affd700 1 -- 172.21.15.49:0/1990756256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff67001c5e0 con 0x7ff674061280 2024-02-22T00:32:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.597+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6740f6f40 con 0x7ff674061280 2024-02-22T00:32:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.598+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6740fffe0 con 0x7ff674061280 2024-02-22T00:32:40.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.599+0000 7ff66affd700 1 -- 172.21.15.49:0/1990756256 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7ff6700123c0 con 0x7ff674061280 2024-02-22T00:32:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.600+0000 7ff66affd700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff6600611c0 0x7ff660063680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.600+0000 7ff66affd700 1 -- 172.21.15.49:0/1990756256 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7ff67007d7f0 con 0x7ff674061280 2024-02-22T00:32:40.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.600+0000 7ff6792c9700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff6600611c0 0x7ff660063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:40.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.600+0000 7ff6792c9700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff6600611c0 0x7ff660063680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff664009f20 tx=0x7ff66400b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:40.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.603+0000 7ff66affd700 1 -- 172.21.15.49:0/1990756256 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff670051800 con 0x7ff674061280 2024-02-22T00:32:40.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.941+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff674101e50 con 0x7ff674061280 2024-02-22T00:32:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.941+0000 7ff66affd700 1 -- 172.21.15.49:0/1990756256 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+648 (secure 0 0 0) 0x7ff6700513f0 con 0x7ff674061280 2024-02-22T00:32:40.943 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:32:40.943 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 14 2024-02-22T00:32:40.944 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:32:40.945 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:32:40.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff6600611c0 msgr2=0x7ff660063680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff6600611c0 0x7ff660063680 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff664009f20 tx=0x7ff66400b040).stop 2024-02-22T00:32:40.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 msgr2=0x7ff6740f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:40.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 0x7ff6740f7c70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7ff670013560 tx=0x7ff670009cb0).stop 2024-02-22T00:32:40.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 shutdown_connections 2024-02-22T00:32:40.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff674061280 0x7ff6740f7c70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7ff6600611c0 0x7ff660063680 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 --2- 172.21.15.49:0/1990756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6740fa950 0x7ff6740f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 >> 172.21.15.49:0/1990756256 conn(0x7ff6740f1e50 msgr2=0x7ff6740f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 shutdown_connections 2024-02-22T00:32:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:40.945+0000 7ff67bd2e700 1 -- 172.21.15.49:0/1990756256 wait complete. 2024-02-22T00:32:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.095+0000 7f18f02ba700 1 -- 172.21.15.49:0/2841443033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f7800 msgr2=0x7f18e80f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.095+0000 7f18f02ba700 1 --2- 172.21.15.49:0/2841443033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f7800 0x7f18e80f7c20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f18e40047f0 tx=0x7f18e4009cb0).stop 2024-02-22T00:32:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.095+0000 7f18f02ba700 1 -- 172.21.15.49:0/2841443033 shutdown_connections 2024-02-22T00:32:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.095+0000 7f18f02ba700 1 --2- 172.21.15.49:0/2841443033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e80f8110 0x7f18e80f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.095+0000 7f18f02ba700 1 --2- 172.21.15.49:0/2841443033 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f7800 0x7f18e80f7c20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.095+0000 7f18f02ba700 1 -- 172.21.15.49:0/2841443033 >> 172.21.15.49:0/2841443033 conn(0x7f18e80f2fe0 msgr2=0x7f18e80f5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:41.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.095+0000 7f18f02ba700 1 -- 172.21.15.49:0/2841443033 shutdown_connections 2024-02-22T00:32:41.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.095+0000 7f18f02ba700 1 -- 172.21.15.49:0/2841443033 wait complete. 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18f02ba700 1 Processor -- start 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18f02ba700 1 -- start start 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18f02ba700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e80f7800 0x7f18e8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18f02ba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f8110 0x7f18e81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18f02ba700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8106960 con 0x7f18e80f8110 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18f02ba700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e8106aa0 con 0x7f18e80f7800 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18ed855700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f8110 0x7f18e81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18ed855700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f8110 0x7f18e81063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43892/0 (socket says 172.21.15.49:43892) 2024-02-22T00:32:41.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18ed855700 1 -- 172.21.15.49:0/4217564728 learned_addr learned my addr 172.21.15.49:0/4217564728 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.096+0000 7f18ee056700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e80f7800 0x7f18e8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18ee056700 1 -- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f8110 msgr2=0x7f18e81063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18ee056700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f8110 0x7f18e81063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18ee056700 1 -- 172.21.15.49:0/4217564728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e4005040 con 0x7f18e80f7800 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18ee056700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e80f7800 0x7f18e8105ec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f18e4013560 tx=0x7f18e4009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18df779700 1 -- 172.21.15.49:0/4217564728 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e4018070 con 0x7f18e80f7800 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18df779700 1 -- 172.21.15.49:0/4217564728 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f18e4007e90 con 0x7f18e80f7800 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e810b4e0 con 0x7f18e80f7800 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18df779700 1 -- 172.21.15.49:0/4217564728 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e40123c0 con 0x7f18e80f7800 2024-02-22T00:32:41.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.097+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e810baa0 con 0x7f18e80f7800 2024-02-22T00:32:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.099+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e8100000 con 0x7f18e80f7800 2024-02-22T00:32:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.099+0000 7f18df779700 1 -- 172.21.15.49:0/4217564728 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 18) v1 ==== 77151+0+0 (secure 0 0 0) 0x7f18e401d420 con 0x7f18e80f7800 2024-02-22T00:32:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.099+0000 7f18df779700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f18d4061180 0x7f18d4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:32:41.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.099+0000 7f18df779700 1 -- 172.21.15.49:0/4217564728 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f18e407d590 con 0x7f18e80f7800 2024-02-22T00:32:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.099+0000 7f18ed855700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f18d4061180 0x7f18d4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:32:41.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.100+0000 7f18ed855700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f18d4061180 0x7f18d4063640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f18d8004e80 tx=0x7f18d800b040).ready entity=mgr.14194 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:32:41.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.105+0000 7f18df779700 1 -- 172.21.15.49:0/4217564728 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f18e4051520 con 0x7f18e80f7800 2024-02-22T00:32:41.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.396+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 --> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18e80fd060 con 0x7f18d4061180 2024-02-22T00:32:41.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.397+0000 7f18df779700 1 -- 172.21.15.49:0/4217564728 <== mgr.14194 v2:172.21.15.49:6800/3085400794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f18e80fd060 con 0x7f18d4061180 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "", 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mgr daemons", 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:32:41.399 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:32:41.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f18d4061180 msgr2=0x7f18d4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:41.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f18d4061180 0x7f18d4063640 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f18d8004e80 tx=0x7f18d800b040).stop 2024-02-22T00:32:41.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e80f7800 msgr2=0x7f18e8105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:32:41.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e80f7800 0x7f18e8105ec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f18e4013560 tx=0x7f18e4009cb0).stop 2024-02-22T00:32:41.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 shutdown_connections 2024-02-22T00:32:41.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:6800/3085400794,v1:172.21.15.49:6801/3085400794] conn(0x7f18d4061180 0x7f18d4063640 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:41.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18e80f7800 0x7f18e8105ec0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:41.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 --2- 172.21.15.49:0/4217564728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18e80f8110 0x7f18e81063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:32:41.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 >> 172.21.15.49:0/4217564728 conn(0x7f18e80f2fe0 msgr2=0x7f18e806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:32:41.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 shutdown_connections 2024-02-22T00:32:41.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:32:41.399+0000 7f18f02ba700 1 -- 172.21.15.49:0/4217564728 wait complete. 2024-02-22T00:32:41.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:39.554499+0000 mgr.smithi049.rjblpr (mgr.14194) 275 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:39.827920+0000 mgr.smithi049.rjblpr (mgr.14194) 276 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s wr, 411 op/s 2024-02-22T00:32:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:40.002681+0000 mgr.smithi049.rjblpr (mgr.14194) 277 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:40.267973+0000 mon.smithi049 (mon.0) 632 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:40.268945+0000 mon.smithi049 (mon.0) 633 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:40.941631+0000 mon.smithi049 (mon.0) 634 : audit [DBG] from='client.? 172.21.15.49:0/1990756256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:32:41.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:39.554499+0000 mgr.smithi049.rjblpr (mgr.14194) 275 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:41.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:39.827920+0000 mgr.smithi049.rjblpr (mgr.14194) 276 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 78 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.8 MiB/s wr, 411 op/s 2024-02-22T00:32:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:40.002681+0000 mgr.smithi049.rjblpr (mgr.14194) 277 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:40.267973+0000 mon.smithi049 (mon.0) 632 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:40.268945+0000 mon.smithi049 (mon.0) 633 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:40.941631+0000 mon.smithi049 (mon.0) 634 : audit [DBG] from='client.? 172.21.15.49:0/1990756256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:32:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:40.470708+0000 mgr.smithi049.rjblpr (mgr.14194) 278 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:40.470708+0000 mgr.smithi049.rjblpr (mgr.14194) 278 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:41.397279+0000 mgr.smithi049.rjblpr (mgr.14194) 279 : audit [DBG] from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:43 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:41.828299+0000 mgr.smithi049.rjblpr (mgr.14194) 280 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 401 op/s 2024-02-22T00:32:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:41.397279+0000 mgr.smithi049.rjblpr (mgr.14194) 279 : audit [DBG] from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:32:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:41.828299+0000 mgr.smithi049.rjblpr (mgr.14194) 280 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 81 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 401 op/s 2024-02-22T00:32:45.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:43.828750+0000 mgr.smithi049.rjblpr (mgr.14194) 281 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 381 op/s 2024-02-22T00:32:45.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:43.828750+0000 mgr.smithi049.rjblpr (mgr.14194) 281 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 88 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 381 op/s 2024-02-22T00:32:47.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:45.829242+0000 mgr.smithi049.rjblpr (mgr.14194) 282 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 91 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s wr, 430 op/s 2024-02-22T00:32:47.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:45.829242+0000 mgr.smithi049.rjblpr (mgr.14194) 282 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 91 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s wr, 430 op/s 2024-02-22T00:32:49.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:47.829649+0000 mgr.smithi049.rjblpr (mgr.14194) 283 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s wr, 362 op/s 2024-02-22T00:32:49.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:48.676070+0000 mon.smithi049 (mon.0) 635 : cluster [DBG] Standby manager daemon smithi161.sazlam restarted 2024-02-22T00:32:49.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:48.676204+0000 mon.smithi049 (mon.0) 636 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:32:49.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:48.679686+0000 mon.smithi161 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:32:49.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:48.680142+0000 mon.smithi161 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:32:49.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:48.683629+0000 mon.smithi161 (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:32:49.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:48.684006+0000 mon.smithi161 (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:32:49.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:47.829649+0000 mgr.smithi049.rjblpr (mgr.14194) 283 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 3.3 MiB/s wr, 362 op/s 2024-02-22T00:32:49.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:48.676070+0000 mon.smithi049 (mon.0) 635 : cluster [DBG] Standby manager daemon smithi161.sazlam restarted 2024-02-22T00:32:49.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:48.676204+0000 mon.smithi049 (mon.0) 636 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:32:49.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:48.679686+0000 mon.smithi161 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:32:49.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:48.680142+0000 mon.smithi161 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:32:49.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:48.683629+0000 mon.smithi161 (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:32:49.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:48.684006+0000 mon.smithi161 (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:49.290889+0000 mon.smithi049 (mon.0) 637 : cluster [DBG] mgrmap e19: smithi049.rjblpr(active, since 6m), standbys: smithi161.sazlam 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.332529+0000 mon.smithi049 (mon.0) 638 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.721500+0000 mon.smithi049 (mon.0) 639 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.722261+0000 mon.smithi049 (mon.0) 640 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.726958+0000 mon.smithi049 (mon.0) 641 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.732532+0000 mon.smithi049 (mon.0) 642 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.737035+0000 mon.smithi049 (mon.0) 643 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr fail", "who": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:49.743308+0000 mon.smithi049 (mon.0) 644 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-02-22T00:32:50.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.743569+0000 mon.smithi049 (mon.0) 645 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "mgr fail", "who": "smithi049.rjblpr"}]': finished 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:49.743634+0000 mon.smithi049 (mon.0) 646 : cluster [DBG] mgrmap e20: smithi161.sazlam(active, starting, since 0.00603642s) 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.745014+0000 mon.smithi161 (mon.1) 22 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.745243+0000 mon.smithi161 (mon.1) 23 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.746058+0000 mon.smithi161 (mon.1) 24 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.746391+0000 mon.smithi161 (mon.1) 25 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.746603+0000 mon.smithi161 (mon.1) 26 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.746873+0000 mon.smithi161 (mon.1) 27 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.747332+0000 mon.smithi161 (mon.1) 28 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.747613+0000 mon.smithi161 (mon.1) 29 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.747864+0000 mon.smithi161 (mon.1) 30 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.748254+0000 mon.smithi161 (mon.1) 31 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:32:50.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.748558+0000 mon.smithi161 (mon.1) 32 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.748865+0000 mon.smithi161 (mon.1) 33 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.749174+0000 mon.smithi161 (mon.1) 34 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.750778+0000 mon.smithi161 (mon.1) 35 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.751183+0000 mon.smithi161 (mon.1) 36 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.751735+0000 mon.smithi161 (mon.1) 37 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:49.788117+0000 mon.smithi049 (mon.0) 647 : cluster [INF] Manager daemon smithi161.sazlam is now available 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.813717+0000 mon.smithi049 (mon.0) 648 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.822344+0000 mon.smithi161 (mon.1) 38 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.826421+0000 mon.smithi161 (mon.1) 39 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.839721+0000 mon.smithi161 (mon.1) 40 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.887308+0000 mon.smithi161 (mon.1) 41 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.sazlam/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.887780+0000 mon.smithi049 (mon.0) 649 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.sazlam/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:32:50.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.908776+0000 mon.smithi161 (mon.1) 42 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.sazlam/trash_purge_schedule"}]: dispatch 2024-02-22T00:32:50.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.912424+0000 mon.smithi049 (mon.0) 650 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.sazlam/trash_purge_schedule"}]: dispatch 2024-02-22T00:32:50.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:49.916757+0000 mon.smithi049 (mon.0) 651 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:49.290889+0000 mon.smithi049 (mon.0) 637 : cluster [DBG] mgrmap e19: smithi049.rjblpr(active, since 6m), standbys: smithi161.sazlam 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.332529+0000 mon.smithi049 (mon.0) 638 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.721500+0000 mon.smithi049 (mon.0) 639 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.722261+0000 mon.smithi049 (mon.0) 640 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.726958+0000 mon.smithi049 (mon.0) 641 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.732532+0000 mon.smithi049 (mon.0) 642 : audit [DBG] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.737035+0000 mon.smithi049 (mon.0) 643 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr fail", "who": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:49.743308+0000 mon.smithi049 (mon.0) 644 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-02-22T00:32:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.743569+0000 mon.smithi049 (mon.0) 645 : audit [INF] from='mgr.14194 172.21.15.49:0/1936519449' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "mgr fail", "who": "smithi049.rjblpr"}]': finished 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:49.743634+0000 mon.smithi049 (mon.0) 646 : cluster [DBG] mgrmap e20: smithi161.sazlam(active, starting, since 0.00603642s) 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.745014+0000 mon.smithi161 (mon.1) 22 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.745243+0000 mon.smithi161 (mon.1) 23 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.746058+0000 mon.smithi161 (mon.1) 24 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.746391+0000 mon.smithi161 (mon.1) 25 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.746603+0000 mon.smithi161 (mon.1) 26 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.746873+0000 mon.smithi161 (mon.1) 27 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.747332+0000 mon.smithi161 (mon.1) 28 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.747613+0000 mon.smithi161 (mon.1) 29 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.747864+0000 mon.smithi161 (mon.1) 30 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.748254+0000 mon.smithi161 (mon.1) 31 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.748558+0000 mon.smithi161 (mon.1) 32 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:32:50.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.748865+0000 mon.smithi161 (mon.1) 33 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.749174+0000 mon.smithi161 (mon.1) 34 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.750778+0000 mon.smithi161 (mon.1) 35 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.751183+0000 mon.smithi161 (mon.1) 36 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.751735+0000 mon.smithi161 (mon.1) 37 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:49.788117+0000 mon.smithi049 (mon.0) 647 : cluster [INF] Manager daemon smithi161.sazlam is now available 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.813717+0000 mon.smithi049 (mon.0) 648 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.822344+0000 mon.smithi161 (mon.1) 38 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.826421+0000 mon.smithi161 (mon.1) 39 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.839721+0000 mon.smithi161 (mon.1) 40 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.887308+0000 mon.smithi161 (mon.1) 41 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.sazlam/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.887780+0000 mon.smithi049 (mon.0) 649 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.sazlam/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.908776+0000 mon.smithi161 (mon.1) 42 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.sazlam/trash_purge_schedule"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.912424+0000 mon.smithi049 (mon.0) 650 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi161.sazlam/trash_purge_schedule"}]: dispatch 2024-02-22T00:32:50.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:49.916757+0000 mon.smithi049 (mon.0) 651 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:51.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:50.401844+0000 mgr.smithi161.sazlam (mgr.24369) 1 : cephadm [INF] Deploying cephadm binary to smithi049 2024-02-22T00:32:51.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:50.407755+0000 mgr.smithi161.sazlam (mgr.24369) 2 : cephadm [INF] Deploying cephadm binary to smithi161 2024-02-22T00:32:51.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:50.746520+0000 mon.smithi049 (mon.0) 652 : cluster [DBG] mgrmap e21: smithi161.sazlam(active, since 1.00892s) 2024-02-22T00:32:51.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:50.758377+0000 mgr.smithi161.sazlam (mgr.24369) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 125 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:32:51.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:51.229831+0000 mon.smithi049 (mon.0) 653 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:51.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:51.253740+0000 mon.smithi049 (mon.0) 654 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:52.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:50.401844+0000 mgr.smithi161.sazlam (mgr.24369) 1 : cephadm [INF] Deploying cephadm binary to smithi049 2024-02-22T00:32:52.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:50.407755+0000 mgr.smithi161.sazlam (mgr.24369) 2 : cephadm [INF] Deploying cephadm binary to smithi161 2024-02-22T00:32:52.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:50.746520+0000 mon.smithi049 (mon.0) 652 : cluster [DBG] mgrmap e21: smithi161.sazlam(active, since 1.00892s) 2024-02-22T00:32:52.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:50.758377+0000 mgr.smithi161.sazlam (mgr.24369) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 125 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:32:52.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:51.229831+0000 mon.smithi049 (mon.0) 653 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:52.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:51.253740+0000 mon.smithi049 (mon.0) 654 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:51.750833+0000 mgr.smithi161.sazlam (mgr.24369) 4 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 125 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:32:53.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:51.848761+0000 mon.smithi161 (mon.1) 43 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-22T00:32:53.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:51.849354+0000 mon.smithi049 (mon.0) 655 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-22T00:32:53.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:51.750833+0000 mgr.smithi161.sazlam (mgr.24369) 4 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 125 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:32:53.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:51.848761+0000 mon.smithi161 (mon.1) 43 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-22T00:32:53.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:51.849354+0000 mon.smithi049 (mon.0) 655 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-22T00:32:54.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:52.718516+0000 mgr.smithi161.sazlam (mgr.24369) 5 : cephadm [INF] [22/Feb/2024:00:32:52] ENGINE Bus STARTING 2024-02-22T00:32:54.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:52.754674+0000 mon.smithi049 (mon.0) 656 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]': finished 2024-02-22T00:32:54.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:52.754791+0000 mon.smithi049 (mon.0) 657 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-02-22T00:32:54.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:52.756235+0000 mon.smithi161 (mon.1) 44 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-22T00:32:54.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:52.759280+0000 mon.smithi049 (mon.0) 658 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-22T00:32:54.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:52.858856+0000 mgr.smithi161.sazlam (mgr.24369) 6 : cephadm [INF] [22/Feb/2024:00:32:52] ENGINE Serving on https://172.21.15.161:7150 2024-02-22T00:32:54.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:52.961131+0000 mgr.smithi161.sazlam (mgr.24369) 7 : cephadm [INF] [22/Feb/2024:00:32:52] ENGINE Serving on http://172.21.15.161:8765 2024-02-22T00:32:54.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:32:52.961229+0000 mgr.smithi161.sazlam (mgr.24369) 8 : cephadm [INF] [22/Feb/2024:00:32:52] ENGINE Bus STARTED 2024-02-22T00:32:54.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:52.718516+0000 mgr.smithi161.sazlam (mgr.24369) 5 : cephadm [INF] [22/Feb/2024:00:32:52] ENGINE Bus STARTING 2024-02-22T00:32:54.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:52.754674+0000 mon.smithi049 (mon.0) 656 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]': finished 2024-02-22T00:32:54.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:52.754791+0000 mon.smithi049 (mon.0) 657 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-02-22T00:32:54.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:52.756235+0000 mon.smithi161 (mon.1) 44 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-22T00:32:54.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:52.759280+0000 mon.smithi049 (mon.0) 658 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-22T00:32:54.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:52.858856+0000 mgr.smithi161.sazlam (mgr.24369) 6 : cephadm [INF] [22/Feb/2024:00:32:52] ENGINE Serving on https://172.21.15.161:7150 2024-02-22T00:32:54.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:52.961131+0000 mgr.smithi161.sazlam (mgr.24369) 7 : cephadm [INF] [22/Feb/2024:00:32:52] ENGINE Serving on http://172.21.15.161:8765 2024-02-22T00:32:54.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:53 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:32:52.961229+0000 mgr.smithi161.sazlam (mgr.24369) 8 : cephadm [INF] [22/Feb/2024:00:32:52] ENGINE Bus STARTED 2024-02-22T00:32:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:53.751133+0000 mgr.smithi161.sazlam (mgr.24369) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 125 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:32:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:53.756079+0000 mon.smithi049 (mon.0) 659 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-22T00:32:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:53.756150+0000 mon.smithi049 (mon.0) 660 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-02-22T00:32:55.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:53.751133+0000 mgr.smithi161.sazlam (mgr.24369) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 125 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:32:55.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:53.756079+0000 mon.smithi049 (mon.0) 659 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-22T00:32:55.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:53.756150+0000 mon.smithi049 (mon.0) 660 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-02-22T00:32:56.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:54.766406+0000 mon.smithi049 (mon.0) 661 : cluster [DBG] mgrmap e22: smithi161.sazlam(active, since 5s) 2024-02-22T00:32:56.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:55.034535+0000 mon.smithi049 (mon.0) 662 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:56.072 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:54.766406+0000 mon.smithi049 (mon.0) 661 : cluster [DBG] mgrmap e22: smithi161.sazlam(active, since 5s) 2024-02-22T00:32:56.073 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:55.034535+0000 mon.smithi049 (mon.0) 662 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:57.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:55.751458+0000 mgr.smithi161.sazlam (mgr.24369) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 1.8 MiB/s wr, 204 op/s 2024-02-22T00:32:57.353 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:55.751458+0000 mgr.smithi161.sazlam (mgr.24369) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 133 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 1.8 MiB/s wr, 204 op/s 2024-02-22T00:32:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:57.499434+0000 mon.smithi049 (mon.0) 663 : cluster [DBG] Standby manager daemon smithi049.rjblpr started 2024-02-22T00:32:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:57.502516+0000 mon.smithi049 (mon.0) 664 : audit [DBG] from='mgr.? 172.21.15.49:0/2754303419' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rjblpr/crt"}]: dispatch 2024-02-22T00:32:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:57.503465+0000 mon.smithi049 (mon.0) 665 : audit [DBG] from='mgr.? 172.21.15.49:0/2754303419' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:32:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:57.504782+0000 mon.smithi049 (mon.0) 666 : audit [DBG] from='mgr.? 172.21.15.49:0/2754303419' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rjblpr/key"}]: dispatch 2024-02-22T00:32:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:57.506154+0000 mon.smithi049 (mon.0) 667 : audit [DBG] from='mgr.? 172.21.15.49:0/2754303419' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:32:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:32:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:57.741604+0000 mon.smithi049 (mon.0) 668 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:32:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:57.499434+0000 mon.smithi049 (mon.0) 663 : cluster [DBG] Standby manager daemon smithi049.rjblpr started 2024-02-22T00:32:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:57.502516+0000 mon.smithi049 (mon.0) 664 : audit [DBG] from='mgr.? 172.21.15.49:0/2754303419' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rjblpr/crt"}]: dispatch 2024-02-22T00:32:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:57.503465+0000 mon.smithi049 (mon.0) 665 : audit [DBG] from='mgr.? 172.21.15.49:0/2754303419' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:32:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:57.504782+0000 mon.smithi049 (mon.0) 666 : audit [DBG] from='mgr.? 172.21.15.49:0/2754303419' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rjblpr/key"}]: dispatch 2024-02-22T00:32:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:57.506154+0000 mon.smithi049 (mon.0) 667 : audit [DBG] from='mgr.? 172.21.15.49:0/2754303419' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:32:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:57.741604+0000 mon.smithi049 (mon.0) 668 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:00.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:57.751938+0000 mgr.smithi161.sazlam (mgr.24369) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 141 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2024-02-22T00:33:00.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:58.046546+0000 mon.smithi049 (mon.0) 669 : cluster [DBG] mgrmap e23: smithi161.sazlam(active, since 8s), standbys: smithi049.rjblpr 2024-02-22T00:33:00.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:58.047928+0000 mon.smithi161 (mon.1) 45 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:33:00.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:32:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:58.865578+0000 mon.smithi049 (mon.0) 670 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-22T00:33:00.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:57.751938+0000 mgr.smithi161.sazlam (mgr.24369) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 141 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2024-02-22T00:33:00.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:58.046546+0000 mon.smithi049 (mon.0) 669 : cluster [DBG] mgrmap e23: smithi161.sazlam(active, since 8s), standbys: smithi049.rjblpr 2024-02-22T00:33:00.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:58.047928+0000 mon.smithi161 (mon.1) 45 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:33:00.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:58.865578+0000 mon.smithi049 (mon.0) 670 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-22T00:33:01.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:58.865759+0000 mon.smithi161 (mon.1) 46 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:33:01.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:58.865929+0000 mon.smithi161 (mon.1) 47 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:33:01.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:32:59.752278+0000 mgr.smithi161.sazlam (mgr.24369) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 141 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 2.3 MiB/s wr, 299 op/s 2024-02-22T00:33:01.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:59.833801+0000 mon.smithi049 (mon.0) 671 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-22T00:33:01.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:32:59.835568+0000 mon.smithi161 (mon.1) 48 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-22T00:33:01.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:00.396921+0000 mon.smithi161 (mon.1) 49 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-22T00:33:01.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:00.397090+0000 mon.smithi161 (mon.1) 50 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:33:01.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:00.400792+0000 mon.smithi161 (mon.1) 51 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:33:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:58.865759+0000 mon.smithi161 (mon.1) 46 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:33:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:58.865929+0000 mon.smithi161 (mon.1) 47 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:33:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:32:59.752278+0000 mgr.smithi161.sazlam (mgr.24369) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 141 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 2.3 MiB/s wr, 299 op/s 2024-02-22T00:33:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:59.833801+0000 mon.smithi049 (mon.0) 671 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-22T00:33:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:32:59.835568+0000 mon.smithi161 (mon.1) 48 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-22T00:33:01.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:00.396921+0000 mon.smithi161 (mon.1) 49 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-22T00:33:01.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:00.397090+0000 mon.smithi161 (mon.1) 50 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:33:01.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:00.400792+0000 mon.smithi161 (mon.1) 51 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:33:03.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:01.752755+0000 mgr.smithi161.sazlam (mgr.24369) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 157 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 489 op/s 2024-02-22T00:33:03.224 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:01.752755+0000 mgr.smithi161.sazlam (mgr.24369) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 157 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 4.0 MiB/s wr, 489 op/s 2024-02-22T00:33:05.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:03.753147+0000 mgr.smithi161.sazlam (mgr.24369) 14 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 157 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 3.6 MiB/s wr, 440 op/s 2024-02-22T00:33:05.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:04.839886+0000 mon.smithi161 (mon.1) 52 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:33:05.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:03.753147+0000 mgr.smithi161.sazlam (mgr.24369) 14 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 157 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 3.6 MiB/s wr, 440 op/s 2024-02-22T00:33:05.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:04.839886+0000 mon.smithi161 (mon.1) 52 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:33:06.370 INFO:tasks.workunit.client.1.smithi161.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-22T00:33:06.378 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-22T00:33:06.378 INFO:tasks.workunit.client.1.smithi161.stderr:+ make 2024-02-22T00:33:06.519 INFO:tasks.workunit.client.1.smithi161.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-22T00:33:06.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:05.615893+0000 mon.smithi049 (mon.0) 672 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:06.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:05.626128+0000 mon.smithi049 (mon.0) 673 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:06.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:05.753664+0000 mgr.smithi161.sazlam (mgr.24369) 15 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 169 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 8.3 KiB/s rd, 4.0 MiB/s wr, 439 op/s 2024-02-22T00:33:06.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:06.461887+0000 mon.smithi049 (mon.0) 674 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:06.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:06.469414+0000 mon.smithi049 (mon.0) 675 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:05.615893+0000 mon.smithi049 (mon.0) 672 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:05.626128+0000 mon.smithi049 (mon.0) 673 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:05.753664+0000 mgr.smithi161.sazlam (mgr.24369) 15 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 169 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 8.3 KiB/s rd, 4.0 MiB/s wr, 439 op/s 2024-02-22T00:33:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:06.461887+0000 mon.smithi049 (mon.0) 674 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:06.469414+0000 mon.smithi049 (mon.0) 675 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:07.155 INFO:tasks.workunit.client.1.smithi161.stderr:++ readlink -f fsstress 2024-02-22T00:33:07.158 INFO:tasks.workunit.client.1.smithi161.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-22T00:33:07.158 INFO:tasks.workunit.client.1.smithi161.stderr:+ popd 2024-02-22T00:33:07.159 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-22T00:33:07.159 INFO:tasks.workunit.client.1.smithi161.stderr:+ popd 2024-02-22T00:33:07.160 INFO:tasks.workunit.client.1.smithi161.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-22T00:33:07.160 INFO:tasks.workunit.client.1.smithi161.stderr:++ mktemp -d -p . 2024-02-22T00:33:07.163 INFO:tasks.workunit.client.1.smithi161.stderr:+ T=./tmp.TB2r9i9K8m 2024-02-22T00:33:07.163 INFO:tasks.workunit.client.1.smithi161.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.TB2r9i9K8m -l 1 -n 1000 -p 10 -v 2024-02-22T00:33:07.170 INFO:tasks.workunit.client.1.smithi161.stdout:seed = 1708393116 2024-02-22T00:33:07.175 INFO:tasks.workunit.client.1.smithi161.stdout:0/0: read - no filename 2024-02-22T00:33:07.177 INFO:tasks.workunit.client.1.smithi161.stdout:1/0: dread - no filename 2024-02-22T00:33:07.178 INFO:tasks.workunit.client.1.smithi161.stdout:0/1: creat f0 x:0 0 0 2024-02-22T00:33:07.181 INFO:tasks.workunit.client.1.smithi161.stdout:2/0: dread - no filename 2024-02-22T00:33:07.181 INFO:tasks.workunit.client.1.smithi161.stdout:1/1: getdents . 0 2024-02-22T00:33:07.182 INFO:tasks.workunit.client.1.smithi161.stdout:1/2: write - no filename 2024-02-22T00:33:07.182 INFO:tasks.workunit.client.1.smithi161.stdout:1/3: truncate - no filename 2024-02-22T00:33:07.182 INFO:tasks.workunit.client.1.smithi161.stdout:1/4: rename - no filename 2024-02-22T00:33:07.187 INFO:tasks.workunit.client.1.smithi161.stdout:4/0: chown . 1698653 1 2024-02-22T00:33:07.187 INFO:tasks.workunit.client.1.smithi161.stdout:4/1: write - no filename 2024-02-22T00:33:07.187 INFO:tasks.workunit.client.1.smithi161.stdout:0/2: dwrite f0 [0,4194304] 0 2024-02-22T00:33:07.187 INFO:tasks.workunit.client.1.smithi161.stdout:2/1: creat f0 x:0 0 0 2024-02-22T00:33:07.189 INFO:tasks.workunit.client.1.smithi161.stdout:1/5: getdents . 0 2024-02-22T00:33:07.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/0: dwrite - no filename 2024-02-22T00:33:07.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/1: write - no filename 2024-02-22T00:33:07.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/2: link - no file 2024-02-22T00:33:07.193 INFO:tasks.workunit.client.1.smithi161.stdout:5/3: unlink - no file 2024-02-22T00:33:07.194 INFO:tasks.workunit.client.1.smithi161.stdout:2/2: creat f1 x:0 0 0 2024-02-22T00:33:07.195 INFO:tasks.workunit.client.1.smithi161.stdout:0/3: rename f0 to f1 0 2024-02-22T00:33:07.195 INFO:tasks.workunit.client.1.smithi161.stdout:2/3: chown f0 3880 1 2024-02-22T00:33:07.197 INFO:tasks.workunit.client.1.smithi161.stdout:3/0: creat f0 x:0 0 0 2024-02-22T00:33:07.197 INFO:tasks.workunit.client.1.smithi161.stdout:2/4: chown f1 16487 1 2024-02-22T00:33:07.198 INFO:tasks.workunit.client.1.smithi161.stdout:4/2: creat f0 x:0 0 0 2024-02-22T00:33:07.198 INFO:tasks.workunit.client.1.smithi161.stdout:4/3: dread - f0 zero size 2024-02-22T00:33:07.199 INFO:tasks.workunit.client.1.smithi161.stdout:4/4: dread - f0 zero size 2024-02-22T00:33:07.204 INFO:tasks.workunit.client.1.smithi161.stdout:1/6: creat f0 x:0 0 0 2024-02-22T00:33:07.205 INFO:tasks.workunit.client.1.smithi161.stdout:3/1: symlink l1 0 2024-02-22T00:33:07.207 INFO:tasks.workunit.client.1.smithi161.stdout:4/5: mknod c1 0 2024-02-22T00:33:07.208 INFO:tasks.workunit.client.1.smithi161.stdout:5/4: symlink l0 0 2024-02-22T00:33:07.211 INFO:tasks.workunit.client.1.smithi161.stdout:1/7: creat f1 x:0 0 0 2024-02-22T00:33:07.213 INFO:tasks.workunit.client.1.smithi161.stdout:4/6: creat f2 x:0 0 0 2024-02-22T00:33:07.214 INFO:tasks.workunit.client.1.smithi161.stdout:5/5: symlink l1 0 2024-02-22T00:33:07.215 INFO:tasks.workunit.client.1.smithi161.stdout:4/7: write f2 [550300,32433] 0 2024-02-22T00:33:07.215 INFO:tasks.workunit.client.1.smithi161.stdout:5/6: stat l1 0 2024-02-22T00:33:07.216 INFO:tasks.workunit.client.1.smithi161.stdout:5/7: stat l0 0 2024-02-22T00:33:07.216 INFO:tasks.workunit.client.1.smithi161.stdout:5/8: read - no filename 2024-02-22T00:33:07.216 INFO:tasks.workunit.client.1.smithi161.stdout:8/0: write - no filename 2024-02-22T00:33:07.217 INFO:tasks.workunit.client.1.smithi161.stdout:8/1: rmdir - no directory 2024-02-22T00:33:07.217 INFO:tasks.workunit.client.1.smithi161.stdout:8/2: dread - no filename 2024-02-22T00:33:07.217 INFO:tasks.workunit.client.1.smithi161.stdout:8/3: rename - no filename 2024-02-22T00:33:07.217 INFO:tasks.workunit.client.1.smithi161.stdout:8/4: write - no filename 2024-02-22T00:33:07.217 INFO:tasks.workunit.client.1.smithi161.stdout:8/5: link - no file 2024-02-22T00:33:07.217 INFO:tasks.workunit.client.1.smithi161.stdout:8/6: dread - no filename 2024-02-22T00:33:07.218 INFO:tasks.workunit.client.1.smithi161.stdout:0/4: fdatasync f1 0 2024-02-22T00:33:07.218 INFO:tasks.workunit.client.1.smithi161.stdout:0/5: chown f1 442006 1 2024-02-22T00:33:07.219 INFO:tasks.workunit.client.1.smithi161.stdout:3/2: link f0 f2 0 2024-02-22T00:33:07.220 INFO:tasks.workunit.client.1.smithi161.stdout:4/8: creat f3 x:0 0 0 2024-02-22T00:33:07.221 INFO:tasks.workunit.client.1.smithi161.stdout:4/9: dread - f3 zero size 2024-02-22T00:33:07.222 INFO:tasks.workunit.client.1.smithi161.stdout:7/0: mknod c0 0 2024-02-22T00:33:07.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/0: dread - no filename 2024-02-22T00:33:07.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/1: dread - no filename 2024-02-22T00:33:07.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/2: read - no filename 2024-02-22T00:33:07.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/3: write - no filename 2024-02-22T00:33:07.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/4: dwrite - no filename 2024-02-22T00:33:07.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/5: fsync - no filename 2024-02-22T00:33:07.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/6: fsync - no filename 2024-02-22T00:33:07.228 INFO:tasks.workunit.client.1.smithi161.stdout:5/9: creat f2 x:0 0 0 2024-02-22T00:33:07.228 INFO:tasks.workunit.client.1.smithi161.stdout:1/8: link f0 f2 0 2024-02-22T00:33:07.228 INFO:tasks.workunit.client.1.smithi161.stdout:3/3: symlink l3 0 2024-02-22T00:33:07.229 INFO:tasks.workunit.client.1.smithi161.stdout:4/10: symlink l4 0 2024-02-22T00:33:07.231 INFO:tasks.workunit.client.1.smithi161.stdout:5/10: mkdir d3 0 2024-02-22T00:33:07.231 INFO:tasks.workunit.client.1.smithi161.stdout:5/11: chown d3 2 1 2024-02-22T00:33:07.231 INFO:tasks.workunit.client.1.smithi161.stdout:5/12: readlink l0 0 2024-02-22T00:33:07.231 INFO:tasks.workunit.client.1.smithi161.stdout:1/9: symlink l3 0 2024-02-22T00:33:07.231 INFO:tasks.workunit.client.1.smithi161.stdout:5/13: chown f2 415 1 2024-02-22T00:33:07.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/7: symlink l0 0 2024-02-22T00:33:07.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/8: fdatasync - no filename 2024-02-22T00:33:07.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/9: dread - no filename 2024-02-22T00:33:07.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/10: dread - no filename 2024-02-22T00:33:07.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/11: truncate - no filename 2024-02-22T00:33:07.237 INFO:tasks.workunit.client.1.smithi161.stdout:9/12: mkdir d1 0 2024-02-22T00:33:07.237 INFO:tasks.workunit.client.1.smithi161.stdout:9/13: fdatasync - no filename 2024-02-22T00:33:07.238 INFO:tasks.workunit.client.1.smithi161.stdout:5/14: creat d3/f4 x:0 0 0 2024-02-22T00:33:07.239 INFO:tasks.workunit.client.1.smithi161.stdout:9/14: mkdir d1/d2 0 2024-02-22T00:33:07.240 INFO:tasks.workunit.client.1.smithi161.stdout:9/15: chown d1 14 1 2024-02-22T00:33:07.241 INFO:tasks.workunit.client.1.smithi161.stdout:9/16: chown d1 782 1 2024-02-22T00:33:07.242 INFO:tasks.workunit.client.1.smithi161.stdout:5/15: rename f2 to d3/f5 0 2024-02-22T00:33:07.244 INFO:tasks.workunit.client.1.smithi161.stdout:1/10: dwrite f0 [0,4194304] 0 2024-02-22T00:33:07.245 INFO:tasks.workunit.client.1.smithi161.stdout:9/17: symlink d1/l3 0 2024-02-22T00:33:07.245 INFO:tasks.workunit.client.1.smithi161.stdout:9/18: readlink d1/l3 0 2024-02-22T00:33:07.247 INFO:tasks.workunit.client.1.smithi161.stdout:1/11: mknod c4 0 2024-02-22T00:33:07.251 INFO:tasks.workunit.client.1.smithi161.stdout:9/19: mkdir d1/d2/d4 0 2024-02-22T00:33:07.255 INFO:tasks.workunit.client.1.smithi161.stdout:9/20: mkdir d1/d5 0 2024-02-22T00:33:07.256 INFO:tasks.workunit.client.1.smithi161.stdout:2/5: getdents . 0 2024-02-22T00:33:07.258 INFO:tasks.workunit.client.1.smithi161.stdout:2/6: dread - f0 zero size 2024-02-22T00:33:07.258 INFO:tasks.workunit.client.1.smithi161.stdout:1/12: dwrite f1 [0,4194304] 0 2024-02-22T00:33:07.258 INFO:tasks.workunit.client.1.smithi161.stdout:2/7: fdatasync f0 0 2024-02-22T00:33:07.259 INFO:tasks.workunit.client.1.smithi161.stdout:9/21: mkdir d1/d2/d4/d6 0 2024-02-22T00:33:07.259 INFO:tasks.workunit.client.1.smithi161.stdout:9/22: truncate - no filename 2024-02-22T00:33:07.259 INFO:tasks.workunit.client.1.smithi161.stdout:1/13: write f0 [2730858,30144] 0 2024-02-22T00:33:07.261 INFO:tasks.workunit.client.1.smithi161.stdout:0/6: truncate f1 2745741 0 2024-02-22T00:33:07.261 INFO:tasks.workunit.client.1.smithi161.stdout:1/14: write f2 [83575,118789] 0 2024-02-22T00:33:07.262 INFO:tasks.workunit.client.1.smithi161.stdout:9/23: stat d1/l3 0 2024-02-22T00:33:07.262 INFO:tasks.workunit.client.1.smithi161.stdout:9/24: truncate - no filename 2024-02-22T00:33:07.263 INFO:tasks.workunit.client.1.smithi161.stdout:0/7: fdatasync f1 0 2024-02-22T00:33:07.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/25: mkdir d1/d2/d7 0 2024-02-22T00:33:07.266 INFO:tasks.workunit.client.1.smithi161.stdout:4/11: fsync f2 0 2024-02-22T00:33:07.273 INFO:tasks.workunit.client.1.smithi161.stdout:4/12: mkdir d5 0 2024-02-22T00:33:07.273 INFO:tasks.workunit.client.1.smithi161.stdout:2/8: dwrite f1 [0,4194304] 0 2024-02-22T00:33:07.276 INFO:tasks.workunit.client.1.smithi161.stdout:9/26: symlink d1/d5/l8 0 2024-02-22T00:33:07.280 INFO:tasks.workunit.client.1.smithi161.stdout:9/27: mkdir d1/d5/d9 0 2024-02-22T00:33:07.281 INFO:tasks.workunit.client.1.smithi161.stdout:4/13: getdents d5 0 2024-02-22T00:33:07.283 INFO:tasks.workunit.client.1.smithi161.stdout:2/9: link f1 f2 0 2024-02-22T00:33:07.284 INFO:tasks.workunit.client.1.smithi161.stdout:2/10: write f1 [3218246,103675] 0 2024-02-22T00:33:07.290 INFO:tasks.workunit.client.1.smithi161.stdout:9/28: getdents d1/d5/d9 0 2024-02-22T00:33:07.291 INFO:tasks.workunit.client.1.smithi161.stdout:4/14: getdents d5 0 2024-02-22T00:33:07.292 INFO:tasks.workunit.client.1.smithi161.stdout:4/15: write f3 [934386,76069] 0 2024-02-22T00:33:07.293 INFO:tasks.workunit.client.1.smithi161.stdout:9/29: mkdir d1/d2/d7/da 0 2024-02-22T00:33:07.293 INFO:tasks.workunit.client.1.smithi161.stdout:9/30: truncate - no filename 2024-02-22T00:33:07.294 INFO:tasks.workunit.client.1.smithi161.stdout:2/11: fdatasync f1 0 2024-02-22T00:33:07.295 INFO:tasks.workunit.client.1.smithi161.stdout:5/16: fsync d3/f5 0 2024-02-22T00:33:07.296 INFO:tasks.workunit.client.1.smithi161.stdout:1/15: write f0 [4555612,95856] 0 2024-02-22T00:33:07.297 INFO:tasks.workunit.client.1.smithi161.stdout:9/31: rename d1/d2 to d1/d2/d4/db 22 2024-02-22T00:33:07.299 INFO:tasks.workunit.client.1.smithi161.stdout:9/32: readlink l0 0 2024-02-22T00:33:07.300 INFO:tasks.workunit.client.1.smithi161.stdout:0/8: rename f1 to f2 0 2024-02-22T00:33:07.303 INFO:tasks.workunit.client.1.smithi161.stdout:1/16: creat f5 x:0 0 0 2024-02-22T00:33:07.305 INFO:tasks.workunit.client.1.smithi161.stdout:9/33: rename d1/d5 to d1/d5/d9/dc 22 2024-02-22T00:33:07.305 INFO:tasks.workunit.client.1.smithi161.stdout:9/34: write - no filename 2024-02-22T00:33:07.306 INFO:tasks.workunit.client.1.smithi161.stdout:9/35: truncate - no filename 2024-02-22T00:33:07.306 INFO:tasks.workunit.client.1.smithi161.stdout:9/36: dwrite - no filename 2024-02-22T00:33:07.306 INFO:tasks.workunit.client.1.smithi161.stdout:4/16: dwrite f0 [0,4194304] 0 2024-02-22T00:33:07.308 INFO:tasks.workunit.client.1.smithi161.stdout:1/17: symlink l6 0 2024-02-22T00:33:07.309 INFO:tasks.workunit.client.1.smithi161.stdout:5/17: getdents d3 0 2024-02-22T00:33:07.310 INFO:tasks.workunit.client.1.smithi161.stdout:9/37: creat d1/d2/fd x:0 0 0 2024-02-22T00:33:07.311 INFO:tasks.workunit.client.1.smithi161.stdout:2/12: dwrite f0 [0,4194304] 0 2024-02-22T00:33:07.313 INFO:tasks.workunit.client.1.smithi161.stdout:5/18: write d3/f5 [340267,114640] 0 2024-02-22T00:33:07.315 INFO:tasks.workunit.client.1.smithi161.stdout:4/17: creat d5/f6 x:0 0 0 2024-02-22T00:33:07.316 INFO:tasks.workunit.client.1.smithi161.stdout:2/13: creat f3 x:0 0 0 2024-02-22T00:33:07.322 INFO:tasks.workunit.client.1.smithi161.stdout:0/9: rename f2 to f3 0 2024-02-22T00:33:07.324 INFO:tasks.workunit.client.1.smithi161.stdout:5/19: creat d3/f6 x:0 0 0 2024-02-22T00:33:07.325 INFO:tasks.workunit.client.1.smithi161.stdout:1/18: dwrite f5 [0,4194304] 0 2024-02-22T00:33:07.328 INFO:tasks.workunit.client.1.smithi161.stdout:9/38: fsync d1/d2/fd 0 2024-02-22T00:33:07.330 INFO:tasks.workunit.client.1.smithi161.stdout:5/20: read - d3/f6 zero size 2024-02-22T00:33:07.330 INFO:tasks.workunit.client.1.smithi161.stdout:0/10: mknod c4 0 2024-02-22T00:33:07.333 INFO:tasks.workunit.client.1.smithi161.stdout:1/19: creat f7 x:0 0 0 2024-02-22T00:33:07.335 INFO:tasks.workunit.client.1.smithi161.stdout:5/21: chown d3/f4 106157205 1 2024-02-22T00:33:07.335 INFO:tasks.workunit.client.1.smithi161.stdout:0/11: stat f3 0 2024-02-22T00:33:07.336 INFO:tasks.workunit.client.1.smithi161.stdout:1/20: symlink l8 0 2024-02-22T00:33:07.336 INFO:tasks.workunit.client.1.smithi161.stdout:4/18: dwrite d5/f6 [0,4194304] 0 2024-02-22T00:33:07.337 INFO:tasks.workunit.client.1.smithi161.stdout:9/39: mknod d1/d2/ce 0 2024-02-22T00:33:07.340 INFO:tasks.workunit.client.1.smithi161.stdout:2/14: dwrite f1 [4194304,4194304] 0 2024-02-22T00:33:07.345 INFO:tasks.workunit.client.1.smithi161.stdout:4/19: write f0 [3000854,5488] 0 2024-02-22T00:33:07.345 INFO:tasks.workunit.client.1.smithi161.stdout:0/12: mknod c5 0 2024-02-22T00:33:07.347 INFO:tasks.workunit.client.1.smithi161.stdout:4/20: truncate f2 952416 0 2024-02-22T00:33:07.349 INFO:tasks.workunit.client.1.smithi161.stdout:1/21: creat f9 x:0 0 0 2024-02-22T00:33:07.349 INFO:tasks.workunit.client.1.smithi161.stdout:4/21: write f0 [136977,44537] 0 2024-02-22T00:33:07.350 INFO:tasks.workunit.client.1.smithi161.stdout:2/15: creat f4 x:0 0 0 2024-02-22T00:33:07.350 INFO:tasks.workunit.client.1.smithi161.stdout:5/22: rename d3/f6 to d3/f7 0 2024-02-22T00:33:07.352 INFO:tasks.workunit.client.1.smithi161.stdout:5/23: chown l1 43060949 1 2024-02-22T00:33:07.352 INFO:tasks.workunit.client.1.smithi161.stdout:4/22: write f3 [569936,98579] 0 2024-02-22T00:33:07.353 INFO:tasks.workunit.client.1.smithi161.stdout:5/24: stat l1 0 2024-02-22T00:33:07.353 INFO:tasks.workunit.client.1.smithi161.stdout:2/16: chown f1 2 1 2024-02-22T00:33:07.354 INFO:tasks.workunit.client.1.smithi161.stdout:1/22: creat fa x:0 0 0 2024-02-22T00:33:07.357 INFO:tasks.workunit.client.1.smithi161.stdout:5/25: truncate d3/f7 833202 0 2024-02-22T00:33:07.359 INFO:tasks.workunit.client.1.smithi161.stdout:1/23: rename f0 to fb 0 2024-02-22T00:33:07.359 INFO:tasks.workunit.client.1.smithi161.stdout:4/23: dread f2 [0,4194304] 0 2024-02-22T00:33:07.361 INFO:tasks.workunit.client.1.smithi161.stdout:0/13: dread f3 [0,4194304] 0 2024-02-22T00:33:07.362 INFO:tasks.workunit.client.1.smithi161.stdout:5/26: symlink d3/l8 0 2024-02-22T00:33:07.362 INFO:tasks.workunit.client.1.smithi161.stdout:1/24: chown fa 34201874 1 2024-02-22T00:33:07.364 INFO:tasks.workunit.client.1.smithi161.stdout:4/24: creat d5/f7 x:0 0 0 2024-02-22T00:33:07.366 INFO:tasks.workunit.client.1.smithi161.stdout:4/25: chown d5 21065 1 2024-02-22T00:33:07.366 INFO:tasks.workunit.client.1.smithi161.stdout:9/40: dwrite d1/d2/fd [0,4194304] 0 2024-02-22T00:33:07.372 INFO:tasks.workunit.client.1.smithi161.stdout:5/27: write d3/f5 [155958,4764] 0 2024-02-22T00:33:07.373 INFO:tasks.workunit.client.1.smithi161.stdout:4/26: mkdir d5/d8 0 2024-02-22T00:33:07.377 INFO:tasks.workunit.client.1.smithi161.stdout:5/28: truncate d3/f5 469241 0 2024-02-22T00:33:07.377 INFO:tasks.workunit.client.1.smithi161.stdout:9/41: mknod d1/d2/cf 0 2024-02-22T00:33:07.378 INFO:tasks.workunit.client.1.smithi161.stdout:2/17: dread f2 [0,4194304] 0 2024-02-22T00:33:07.378 INFO:tasks.workunit.client.1.smithi161.stdout:0/14: dread f3 [0,4194304] 0 2024-02-22T00:33:07.379 INFO:tasks.workunit.client.1.smithi161.stdout:1/25: dread f5 [0,4194304] 0 2024-02-22T00:33:07.381 INFO:tasks.workunit.client.1.smithi161.stdout:5/29: fdatasync d3/f5 0 2024-02-22T00:33:07.382 INFO:tasks.workunit.client.1.smithi161.stdout:9/42: creat d1/d2/f10 x:0 0 0 2024-02-22T00:33:07.383 INFO:tasks.workunit.client.1.smithi161.stdout:2/18: mknod c5 0 2024-02-22T00:33:07.387 INFO:tasks.workunit.client.1.smithi161.stdout:2/19: creat f6 x:0 0 0 2024-02-22T00:33:07.387 INFO:tasks.workunit.client.1.smithi161.stdout:9/43: mkdir d1/d2/d4/d11 0 2024-02-22T00:33:07.390 INFO:tasks.workunit.client.1.smithi161.stdout:0/15: link c4 c6 0 2024-02-22T00:33:07.391 INFO:tasks.workunit.client.1.smithi161.stdout:4/27: truncate f2 513188 0 2024-02-22T00:33:07.393 INFO:tasks.workunit.client.1.smithi161.stdout:1/26: dwrite f9 [0,4194304] 0 2024-02-22T00:33:07.398 INFO:tasks.workunit.client.1.smithi161.stdout:1/27: unlink l8 0 2024-02-22T00:33:07.399 INFO:tasks.workunit.client.1.smithi161.stdout:4/28: creat d5/d8/f9 x:0 0 0 2024-02-22T00:33:07.400 INFO:tasks.workunit.client.1.smithi161.stdout:5/30: dwrite d3/f7 [0,4194304] 0 2024-02-22T00:33:07.402 INFO:tasks.workunit.client.1.smithi161.stdout:5/31: stat d3/f5 0 2024-02-22T00:33:07.408 INFO:tasks.workunit.client.1.smithi161.stdout:4/29: symlink d5/la 0 2024-02-22T00:33:07.411 INFO:tasks.workunit.client.1.smithi161.stdout:9/44: dwrite d1/d2/f10 [0,4194304] 0 2024-02-22T00:33:07.412 INFO:tasks.workunit.client.1.smithi161.stdout:4/30: rename d5/d8 to d5/d8/db 22 2024-02-22T00:33:07.422 INFO:tasks.workunit.client.1.smithi161.stdout:0/16: dwrite f3 [0,4194304] 0 2024-02-22T00:33:07.423 INFO:tasks.workunit.client.1.smithi161.stdout:4/31: rename c1 to d5/d8/cc 0 2024-02-22T00:33:07.423 INFO:tasks.workunit.client.1.smithi161.stdout:0/17: readlink - no filename 2024-02-22T00:33:07.429 INFO:tasks.workunit.client.1.smithi161.stdout:0/18: write f3 [4021748,99809] 0 2024-02-22T00:33:07.430 INFO:tasks.workunit.client.1.smithi161.stdout:5/32: dwrite d3/f5 [0,4194304] 0 2024-02-22T00:33:07.431 INFO:tasks.workunit.client.1.smithi161.stdout:4/32: symlink d5/d8/ld 0 2024-02-22T00:33:07.440 INFO:tasks.workunit.client.1.smithi161.stdout:4/33: write f3 [882958,85927] 0 2024-02-22T00:33:07.440 INFO:tasks.workunit.client.1.smithi161.stdout:0/19: creat f7 x:0 0 0 2024-02-22T00:33:07.440 INFO:tasks.workunit.client.1.smithi161.stdout:1/28: dwrite f5 [0,4194304] 0 2024-02-22T00:33:07.445 INFO:tasks.workunit.client.1.smithi161.stdout:0/20: write f7 [274432,123399] 0 2024-02-22T00:33:07.445 INFO:tasks.workunit.client.1.smithi161.stdout:1/29: write f5 [1199182,105992] 0 2024-02-22T00:33:07.447 INFO:tasks.workunit.client.1.smithi161.stdout:9/45: dwrite d1/d2/fd [0,4194304] 0 2024-02-22T00:33:07.451 INFO:tasks.workunit.client.1.smithi161.stdout:0/21: creat f8 x:0 0 0 2024-02-22T00:33:07.452 INFO:tasks.workunit.client.1.smithi161.stdout:1/30: symlink lc 0 2024-02-22T00:33:07.457 INFO:tasks.workunit.client.1.smithi161.stdout:9/46: read d1/d2/fd [1301181,19840] 0 2024-02-22T00:33:07.457 INFO:tasks.workunit.client.1.smithi161.stdout:1/31: dread - f7 zero size 2024-02-22T00:33:07.457 INFO:tasks.workunit.client.1.smithi161.stdout:5/33: dread d3/f5 [0,4194304] 0 2024-02-22T00:33:07.457 INFO:tasks.workunit.client.1.smithi161.stdout:1/32: read f9 [4111236,8304] 0 2024-02-22T00:33:07.460 INFO:tasks.workunit.client.1.smithi161.stdout:9/47: creat d1/d2/d4/f12 x:0 0 0 2024-02-22T00:33:07.461 INFO:tasks.workunit.client.1.smithi161.stdout:4/34: getdents d5 0 2024-02-22T00:33:07.466 INFO:tasks.workunit.client.1.smithi161.stdout:4/35: creat d5/fe x:0 0 0 2024-02-22T00:33:07.468 INFO:tasks.workunit.client.1.smithi161.stdout:0/22: dwrite f8 [0,4194304] 0 2024-02-22T00:33:07.473 INFO:tasks.workunit.client.1.smithi161.stdout:1/33: dread f1 [0,4194304] 0 2024-02-22T00:33:07.476 INFO:tasks.workunit.client.1.smithi161.stdout:4/36: creat d5/ff x:0 0 0 2024-02-22T00:33:07.477 INFO:tasks.workunit.client.1.smithi161.stdout:9/48: creat d1/d2/d7/da/f13 x:0 0 0 2024-02-22T00:33:07.477 INFO:tasks.workunit.client.1.smithi161.stdout:0/23: symlink l9 0 2024-02-22T00:33:07.477 INFO:tasks.workunit.client.1.smithi161.stdout:5/34: dwrite d3/f4 [0,4194304] 0 2024-02-22T00:33:07.478 INFO:tasks.workunit.client.1.smithi161.stdout:0/24: stat c5 0 2024-02-22T00:33:07.479 INFO:tasks.workunit.client.1.smithi161.stdout:4/37: mkdir d5/d10 0 2024-02-22T00:33:07.481 INFO:tasks.workunit.client.1.smithi161.stdout:1/34: link l3 ld 0 2024-02-22T00:33:07.483 INFO:tasks.workunit.client.1.smithi161.stdout:9/49: write d1/d2/d7/da/f13 [718258,13508] 0 2024-02-22T00:33:07.484 INFO:tasks.workunit.client.1.smithi161.stdout:4/38: mknod d5/c11 0 2024-02-22T00:33:07.488 INFO:tasks.workunit.client.1.smithi161.stdout:9/50: fsync d1/d2/f10 0 2024-02-22T00:33:07.492 INFO:tasks.workunit.client.1.smithi161.stdout:4/39: mknod d5/c12 0 2024-02-22T00:33:07.494 INFO:tasks.workunit.client.1.smithi161.stdout:0/25: dread f3 [0,4194304] 0 2024-02-22T00:33:07.496 INFO:tasks.workunit.client.1.smithi161.stdout:9/51: mknod d1/d5/d9/c14 0 2024-02-22T00:33:07.496 INFO:tasks.workunit.client.1.smithi161.stdout:5/35: dwrite d3/f7 [4194304,4194304] 0 2024-02-22T00:33:07.499 INFO:tasks.workunit.client.1.smithi161.stdout:4/40: rename d5/ff to d5/f13 0 2024-02-22T00:33:07.502 INFO:tasks.workunit.client.1.smithi161.stdout:1/35: dwrite f5 [0,4194304] 0 2024-02-22T00:33:07.503 INFO:tasks.workunit.client.1.smithi161.stdout:4/41: read - d5/fe zero size 2024-02-22T00:33:07.504 INFO:tasks.workunit.client.1.smithi161.stdout:5/36: write d3/f5 [708437,123465] 0 2024-02-22T00:33:07.505 INFO:tasks.workunit.client.1.smithi161.stdout:4/42: fsync f0 0 2024-02-22T00:33:07.508 INFO:tasks.workunit.client.1.smithi161.stdout:4/43: readlink d5/la 0 2024-02-22T00:33:07.510 INFO:tasks.workunit.client.1.smithi161.stdout:4/44: fdatasync d5/fe 0 2024-02-22T00:33:07.511 INFO:tasks.workunit.client.1.smithi161.stdout:5/37: creat d3/f9 x:0 0 0 2024-02-22T00:33:07.512 INFO:tasks.workunit.client.1.smithi161.stdout:0/26: dread f8 [0,4194304] 0 2024-02-22T00:33:07.513 INFO:tasks.workunit.client.1.smithi161.stdout:4/45: read - d5/f13 zero size 2024-02-22T00:33:07.515 INFO:tasks.workunit.client.1.smithi161.stdout:1/36: dread fb [0,4194304] 0 2024-02-22T00:33:07.516 INFO:tasks.workunit.client.1.smithi161.stdout:0/27: unlink l9 0 2024-02-22T00:33:07.516 INFO:tasks.workunit.client.1.smithi161.stdout:0/28: rmdir - no directory 2024-02-22T00:33:07.517 INFO:tasks.workunit.client.1.smithi161.stdout:9/52: dwrite d1/d2/d4/f12 [0,4194304] 0 2024-02-22T00:33:07.521 INFO:tasks.workunit.client.1.smithi161.stdout:0/29: creat fa x:0 0 0 2024-02-22T00:33:07.529 INFO:tasks.workunit.client.1.smithi161.stdout:5/38: dwrite d3/f7 [4194304,4194304] 0 2024-02-22T00:33:07.531 INFO:tasks.workunit.client.1.smithi161.stdout:4/46: dwrite d5/d8/f9 [0,4194304] 0 2024-02-22T00:33:07.532 INFO:tasks.workunit.client.1.smithi161.stdout:9/53: dread d1/d2/fd [0,4194304] 0 2024-02-22T00:33:07.533 INFO:tasks.workunit.client.1.smithi161.stdout:1/37: dread f9 [0,4194304] 0 2024-02-22T00:33:07.533 INFO:tasks.workunit.client.1.smithi161.stdout:0/30: dread f8 [0,4194304] 0 2024-02-22T00:33:07.536 INFO:tasks.workunit.client.1.smithi161.stdout:4/47: read f0 [4029429,130765] 0 2024-02-22T00:33:07.538 INFO:tasks.workunit.client.1.smithi161.stdout:5/39: mknod d3/ca 0 2024-02-22T00:33:07.539 INFO:tasks.workunit.client.1.smithi161.stdout:0/31: creat fb x:0 0 0 2024-02-22T00:33:07.541 INFO:tasks.workunit.client.1.smithi161.stdout:1/38: symlink le 0 2024-02-22T00:33:07.542 INFO:tasks.workunit.client.1.smithi161.stdout:1/39: chown lc 3 1 2024-02-22T00:33:07.542 INFO:tasks.workunit.client.1.smithi161.stdout:1/40: stat f9 0 2024-02-22T00:33:07.544 INFO:tasks.workunit.client.1.smithi161.stdout:0/32: creat fc x:0 0 0 2024-02-22T00:33:07.545 INFO:tasks.workunit.client.1.smithi161.stdout:9/54: mknod d1/d2/d4/d6/c15 0 2024-02-22T00:33:07.546 INFO:tasks.workunit.client.1.smithi161.stdout:9/55: write d1/d2/f10 [3275060,35551] 0 2024-02-22T00:33:07.546 INFO:tasks.workunit.client.1.smithi161.stdout:4/48: fsync f2 0 2024-02-22T00:33:07.547 INFO:tasks.workunit.client.1.smithi161.stdout:4/49: read - d5/f7 zero size 2024-02-22T00:33:07.547 INFO:tasks.workunit.client.1.smithi161.stdout:9/56: stat d1/d2/cf 0 2024-02-22T00:33:07.550 INFO:tasks.workunit.client.1.smithi161.stdout:0/33: creat fd x:0 0 0 2024-02-22T00:33:07.551 INFO:tasks.workunit.client.1.smithi161.stdout:0/34: dread - fb zero size 2024-02-22T00:33:07.552 INFO:tasks.workunit.client.1.smithi161.stdout:0/35: read - fc zero size 2024-02-22T00:33:07.552 INFO:tasks.workunit.client.1.smithi161.stdout:0/36: readlink - no filename 2024-02-22T00:33:07.553 INFO:tasks.workunit.client.1.smithi161.stdout:4/50: rmdir d5 39 2024-02-22T00:33:07.554 INFO:tasks.workunit.client.1.smithi161.stdout:5/40: truncate d3/f7 5843446 0 2024-02-22T00:33:07.556 INFO:tasks.workunit.client.1.smithi161.stdout:9/57: rename d1/d2/d4/f12 to d1/d2/d7/f16 0 2024-02-22T00:33:07.557 INFO:tasks.workunit.client.1.smithi161.stdout:0/37: dread f7 [0,4194304] 0 2024-02-22T00:33:07.560 INFO:tasks.workunit.client.1.smithi161.stdout:5/41: mknod d3/cb 0 2024-02-22T00:33:07.563 INFO:tasks.workunit.client.1.smithi161.stdout:0/38: link f7 fe 0 2024-02-22T00:33:07.563 INFO:tasks.workunit.client.1.smithi161.stdout:4/51: chown d5/d8/cc 10 1 2024-02-22T00:33:07.565 INFO:tasks.workunit.client.1.smithi161.stdout:9/58: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:07.566 INFO:tasks.workunit.client.1.smithi161.stdout:4/52: mkdir d5/d10/d14 0 2024-02-22T00:33:07.572 INFO:tasks.workunit.client.1.smithi161.stdout:4/53: truncate f2 179085 0 2024-02-22T00:33:07.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/42: read d3/f7 [5827360,9656] 0 2024-02-22T00:33:07.576 INFO:tasks.workunit.client.1.smithi161.stdout:5/43: write d3/f9 [602972,92318] 0 2024-02-22T00:33:07.578 INFO:tasks.workunit.client.1.smithi161.stdout:9/59: dread d1/d2/fd [0,4194304] 0 2024-02-22T00:33:07.579 INFO:tasks.workunit.client.1.smithi161.stdout:0/39: dwrite fe [0,4194304] 0 2024-02-22T00:33:07.582 INFO:tasks.workunit.client.1.smithi161.stdout:4/54: link d5/la d5/l15 0 2024-02-22T00:33:07.587 INFO:tasks.workunit.client.1.smithi161.stdout:5/44: getdents d3 0 2024-02-22T00:33:07.590 INFO:tasks.workunit.client.1.smithi161.stdout:5/45: read d3/f7 [3756356,129244] 0 2024-02-22T00:33:07.590 INFO:tasks.workunit.client.1.smithi161.stdout:0/40: dwrite fd [0,4194304] 0 2024-02-22T00:33:07.591 INFO:tasks.workunit.client.1.smithi161.stdout:4/55: symlink d5/d10/d14/l16 0 2024-02-22T00:33:07.592 INFO:tasks.workunit.client.1.smithi161.stdout:4/56: chown d5/f13 777796 1 2024-02-22T00:33:07.594 INFO:tasks.workunit.client.1.smithi161.stdout:4/57: mkdir d5/d17 0 2024-02-22T00:33:07.597 INFO:tasks.workunit.client.1.smithi161.stdout:9/60: truncate d1/d2/f10 366316 0 2024-02-22T00:33:07.598 INFO:tasks.workunit.client.1.smithi161.stdout:0/41: dread f8 [0,4194304] 0 2024-02-22T00:33:07.600 INFO:tasks.workunit.client.1.smithi161.stdout:0/42: write fa [121301,45912] 0 2024-02-22T00:33:07.602 INFO:tasks.workunit.client.1.smithi161.stdout:9/61: creat d1/d2/d7/da/f17 x:0 0 0 2024-02-22T00:33:07.603 INFO:tasks.workunit.client.1.smithi161.stdout:0/43: dread - fc zero size 2024-02-22T00:33:07.603 INFO:tasks.workunit.client.1.smithi161.stdout:5/46: dwrite d3/f7 [0,4194304] 0 2024-02-22T00:33:07.604 INFO:tasks.workunit.client.1.smithi161.stdout:4/58: dread f3 [0,4194304] 0 2024-02-22T00:33:07.605 INFO:tasks.workunit.client.1.smithi161.stdout:0/44: mknod cf 0 2024-02-22T00:33:07.607 INFO:tasks.workunit.client.1.smithi161.stdout:5/47: creat d3/fc x:0 0 0 2024-02-22T00:33:07.608 INFO:tasks.workunit.client.1.smithi161.stdout:4/59: readlink d5/la 0 2024-02-22T00:33:07.610 INFO:tasks.workunit.client.1.smithi161.stdout:5/48: creat d3/fd x:0 0 0 2024-02-22T00:33:07.611 INFO:tasks.workunit.client.1.smithi161.stdout:4/60: mknod d5/d8/c18 0 2024-02-22T00:33:07.614 INFO:tasks.workunit.client.1.smithi161.stdout:0/45: dwrite fa [0,4194304] 0 2024-02-22T00:33:07.615 INFO:tasks.workunit.client.1.smithi161.stdout:4/61: symlink d5/d8/l19 0 2024-02-22T00:33:07.616 INFO:tasks.workunit.client.1.smithi161.stdout:9/62: dread d1/d2/f10 [0,4194304] 0 2024-02-22T00:33:07.618 INFO:tasks.workunit.client.1.smithi161.stdout:0/46: mknod c10 0 2024-02-22T00:33:07.624 INFO:tasks.workunit.client.1.smithi161.stdout:9/63: rmdir d1/d5/d9 39 2024-02-22T00:33:07.625 INFO:tasks.workunit.client.1.smithi161.stdout:0/47: creat f11 x:0 0 0 2024-02-22T00:33:07.626 INFO:tasks.workunit.client.1.smithi161.stdout:4/62: getdents d5/d17 0 2024-02-22T00:33:07.628 INFO:tasks.workunit.client.1.smithi161.stdout:4/63: write f3 [949950,43977] 0 2024-02-22T00:33:07.629 INFO:tasks.workunit.client.1.smithi161.stdout:5/49: getdents d3 0 2024-02-22T00:33:07.629 INFO:tasks.workunit.client.1.smithi161.stdout:4/64: readlink d5/l15 0 2024-02-22T00:33:07.630 INFO:tasks.workunit.client.1.smithi161.stdout:0/48: symlink l12 0 2024-02-22T00:33:07.631 INFO:tasks.workunit.client.1.smithi161.stdout:9/64: creat d1/d5/d9/f18 x:0 0 0 2024-02-22T00:33:07.633 INFO:tasks.workunit.client.1.smithi161.stdout:5/50: creat d3/fe x:0 0 0 2024-02-22T00:33:07.634 INFO:tasks.workunit.client.1.smithi161.stdout:4/65: mknod d5/c1a 0 2024-02-22T00:33:07.636 INFO:tasks.workunit.client.1.smithi161.stdout:0/49: symlink l13 0 2024-02-22T00:33:07.637 INFO:tasks.workunit.client.1.smithi161.stdout:9/65: symlink d1/d2/d7/l19 0 2024-02-22T00:33:07.638 INFO:tasks.workunit.client.1.smithi161.stdout:5/51: mknod d3/cf 0 2024-02-22T00:33:07.639 INFO:tasks.workunit.client.1.smithi161.stdout:4/66: creat d5/d10/f1b x:0 0 0 2024-02-22T00:33:07.640 INFO:tasks.workunit.client.1.smithi161.stdout:0/50: mkdir d14 0 2024-02-22T00:33:07.641 INFO:tasks.workunit.client.1.smithi161.stdout:9/66: creat d1/d2/f1a x:0 0 0 2024-02-22T00:33:07.646 INFO:tasks.workunit.client.1.smithi161.stdout:5/52: dwrite d3/f4 [0,4194304] 0 2024-02-22T00:33:07.647 INFO:tasks.workunit.client.1.smithi161.stdout:5/53: write d3/f7 [5885426,63368] 0 2024-02-22T00:33:07.647 INFO:tasks.workunit.client.1.smithi161.stdout:9/67: mknod d1/d5/c1b 0 2024-02-22T00:33:07.647 INFO:tasks.workunit.client.1.smithi161.stdout:5/54: stat l1 0 2024-02-22T00:33:07.650 INFO:tasks.workunit.client.1.smithi161.stdout:5/55: unlink d3/cf 0 2024-02-22T00:33:07.652 INFO:tasks.workunit.client.1.smithi161.stdout:4/67: getdents d5/d10/d14 0 2024-02-22T00:33:07.656 INFO:tasks.workunit.client.1.smithi161.stdout:5/56: mkdir d3/d10 0 2024-02-22T00:33:07.657 INFO:tasks.workunit.client.1.smithi161.stdout:5/57: chown d3/fc 821610 1 2024-02-22T00:33:07.658 INFO:tasks.workunit.client.1.smithi161.stdout:5/58: fsync d3/f9 0 2024-02-22T00:33:07.658 INFO:tasks.workunit.client.1.smithi161.stdout:5/59: readlink l0 0 2024-02-22T00:33:07.659 INFO:tasks.workunit.client.1.smithi161.stdout:9/68: dwrite d1/d2/d7/f16 [0,4194304] 0 2024-02-22T00:33:07.660 INFO:tasks.workunit.client.1.smithi161.stdout:0/51: truncate fa 3943180 0 2024-02-22T00:33:07.661 INFO:tasks.workunit.client.1.smithi161.stdout:4/68: creat d5/d10/d14/f1c x:0 0 0 2024-02-22T00:33:07.661 INFO:tasks.workunit.client.1.smithi161.stdout:9/69: dread - d1/d2/f1a zero size 2024-02-22T00:33:07.663 INFO:tasks.workunit.client.1.smithi161.stdout:4/69: write d5/d10/d14/f1c [212976,55407] 0 2024-02-22T00:33:07.665 INFO:tasks.workunit.client.1.smithi161.stdout:9/70: truncate d1/d5/d9/f18 86478 0 2024-02-22T00:33:07.669 INFO:tasks.workunit.client.1.smithi161.stdout:0/52: link l12 d14/l15 0 2024-02-22T00:33:07.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/71: write d1/d5/d9/f18 [408753,121905] 0 2024-02-22T00:33:07.671 INFO:tasks.workunit.client.1.smithi161.stdout:5/60: dwrite d3/fe [0,4194304] 0 2024-02-22T00:33:07.676 INFO:tasks.workunit.client.1.smithi161.stdout:0/53: creat d14/f16 x:0 0 0 2024-02-22T00:33:07.677 INFO:tasks.workunit.client.1.smithi161.stdout:4/70: dwrite d5/d10/d14/f1c [0,4194304] 0 2024-02-22T00:33:07.678 INFO:tasks.workunit.client.1.smithi161.stdout:0/54: stat d14/f16 0 2024-02-22T00:33:07.687 INFO:tasks.workunit.client.1.smithi161.stdout:5/61: dread d3/f9 [0,4194304] 0 2024-02-22T00:33:07.688 INFO:tasks.workunit.client.1.smithi161.stdout:4/71: getdents d5/d8 0 2024-02-22T00:33:07.692 INFO:tasks.workunit.client.1.smithi161.stdout:0/55: dwrite f8 [0,4194304] 0 2024-02-22T00:33:07.696 INFO:tasks.workunit.client.1.smithi161.stdout:5/62: dwrite d3/f7 [0,4194304] 0 2024-02-22T00:33:07.704 INFO:tasks.workunit.client.1.smithi161.stdout:9/72: truncate d1/d2/d7/f16 2238020 0 2024-02-22T00:33:07.705 INFO:tasks.workunit.client.1.smithi161.stdout:0/56: dwrite fb [0,4194304] 0 2024-02-22T00:33:07.705 INFO:tasks.workunit.client.1.smithi161.stdout:0/57: chown cf 14078511 1 2024-02-22T00:33:07.707 INFO:tasks.workunit.client.1.smithi161.stdout:5/63: rename d3/cb to d3/d10/c11 0 2024-02-22T00:33:07.708 INFO:tasks.workunit.client.1.smithi161.stdout:9/73: truncate d1/d2/d7/da/f17 1017669 0 2024-02-22T00:33:07.708 INFO:tasks.workunit.client.1.smithi161.stdout:5/64: chown d3/f7 0 1 2024-02-22T00:33:07.708 INFO:tasks.workunit.client.1.smithi161.stdout:0/58: creat d14/f17 x:0 0 0 2024-02-22T00:33:07.712 INFO:tasks.workunit.client.1.smithi161.stdout:0/59: rename fe to d14/f18 0 2024-02-22T00:33:07.715 INFO:tasks.workunit.client.1.smithi161.stdout:9/74: creat d1/d2/d4/d11/f1c x:0 0 0 2024-02-22T00:33:07.717 INFO:tasks.workunit.client.1.smithi161.stdout:0/60: dread fd [0,4194304] 0 2024-02-22T00:33:07.719 INFO:tasks.workunit.client.1.smithi161.stdout:5/65: rename d3/f4 to d3/d10/f12 0 2024-02-22T00:33:07.720 INFO:tasks.workunit.client.1.smithi161.stdout:9/75: mkdir d1/d2/d4/d11/d1d 0 2024-02-22T00:33:07.723 INFO:tasks.workunit.client.1.smithi161.stdout:0/61: rename f7 to d14/f19 0 2024-02-22T00:33:07.724 INFO:tasks.workunit.client.1.smithi161.stdout:5/66: creat d3/d10/f13 x:0 0 0 2024-02-22T00:33:07.726 INFO:tasks.workunit.client.1.smithi161.stdout:9/76: truncate d1/d2/f10 191676 0 2024-02-22T00:33:07.727 INFO:tasks.workunit.client.1.smithi161.stdout:0/62: mkdir d14/d1a 0 2024-02-22T00:33:07.728 INFO:tasks.workunit.client.1.smithi161.stdout:0/63: truncate d14/f17 912409 0 2024-02-22T00:33:07.729 INFO:tasks.workunit.client.1.smithi161.stdout:9/77: dread d1/d5/d9/f18 [0,4194304] 0 2024-02-22T00:33:07.730 INFO:tasks.workunit.client.1.smithi161.stdout:5/67: dread d3/d10/f12 [0,4194304] 0 2024-02-22T00:33:07.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/64: creat d14/d1a/f1b x:0 0 0 2024-02-22T00:33:07.734 INFO:tasks.workunit.client.1.smithi161.stdout:5/68: symlink d3/d10/l14 0 2024-02-22T00:33:07.734 INFO:tasks.workunit.client.1.smithi161.stdout:5/69: chown l0 820359001 1 2024-02-22T00:33:07.736 INFO:tasks.workunit.client.1.smithi161.stdout:9/78: rename d1/d2/d4/d11/d1d to d1/d2/d7/d1e 0 2024-02-22T00:33:07.736 INFO:tasks.workunit.client.1.smithi161.stdout:0/65: dread d14/f18 [0,4194304] 0 2024-02-22T00:33:07.739 INFO:tasks.workunit.client.1.smithi161.stdout:5/70: rename d3/f9 to d3/f15 0 2024-02-22T00:33:07.740 INFO:tasks.workunit.client.1.smithi161.stdout:0/66: creat d14/f1c x:0 0 0 2024-02-22T00:33:07.742 INFO:tasks.workunit.client.1.smithi161.stdout:9/79: rename d1/d2/d4/d6 to d1/d2/d4/d1f 0 2024-02-22T00:33:07.743 INFO:tasks.workunit.client.1.smithi161.stdout:0/67: symlink d14/d1a/l1d 0 2024-02-22T00:33:07.744 INFO:tasks.workunit.client.1.smithi161.stdout:0/68: write f11 [230485,101723] 0 2024-02-22T00:33:07.748 INFO:tasks.workunit.client.1.smithi161.stdout:5/71: fsync d3/d10/f13 0 2024-02-22T00:33:07.750 INFO:tasks.workunit.client.1.smithi161.stdout:0/69: dwrite f8 [0,4194304] 0 2024-02-22T00:33:07.754 INFO:tasks.workunit.client.1.smithi161.stdout:0/70: read - fc zero size 2024-02-22T00:33:07.754 INFO:tasks.workunit.client.1.smithi161.stdout:0/71: chown l13 6731092 1 2024-02-22T00:33:07.757 INFO:tasks.workunit.client.1.smithi161.stdout:0/72: chown d14/f17 0 1 2024-02-22T00:33:07.759 INFO:tasks.workunit.client.1.smithi161.stdout:0/73: mknod d14/c1e 0 2024-02-22T00:33:07.761 INFO:tasks.workunit.client.1.smithi161.stdout:0/74: creat d14/f1f x:0 0 0 2024-02-22T00:33:07.761 INFO:tasks.workunit.client.1.smithi161.stdout:0/75: fdatasync d14/f1c 0 2024-02-22T00:33:07.763 INFO:tasks.workunit.client.1.smithi161.stdout:0/76: symlink d14/l20 0 2024-02-22T00:33:07.769 INFO:tasks.workunit.client.1.smithi161.stdout:5/72: truncate d3/f5 4025349 0 2024-02-22T00:33:07.770 INFO:tasks.workunit.client.1.smithi161.stdout:0/77: dwrite f3 [0,4194304] 0 2024-02-22T00:33:07.771 INFO:tasks.workunit.client.1.smithi161.stdout:5/73: chown d3/f7 1359 1 2024-02-22T00:33:07.776 INFO:tasks.workunit.client.1.smithi161.stdout:5/74: dread d3/d10/f12 [0,4194304] 0 2024-02-22T00:33:07.777 INFO:tasks.workunit.client.1.smithi161.stdout:0/78: getdents d14/d1a 0 2024-02-22T00:33:07.778 INFO:tasks.workunit.client.1.smithi161.stdout:0/79: write fb [127023,17267] 0 2024-02-22T00:33:07.780 INFO:tasks.workunit.client.1.smithi161.stdout:0/80: truncate fc 64962 0 2024-02-22T00:33:07.781 INFO:tasks.workunit.client.1.smithi161.stdout:0/81: fdatasync d14/f17 0 2024-02-22T00:33:07.782 INFO:tasks.workunit.client.1.smithi161.stdout:0/82: fsync d14/f16 0 2024-02-22T00:33:07.783 INFO:tasks.workunit.client.1.smithi161.stdout:5/75: rename d3/d10/c11 to d3/d10/c16 0 2024-02-22T00:33:07.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/83: chown c4 1288005883 1 2024-02-22T00:33:07.789 INFO:tasks.workunit.client.1.smithi161.stdout:5/76: rename d3/d10/f13 to d3/f17 0 2024-02-22T00:33:07.793 INFO:tasks.workunit.client.1.smithi161.stdout:5/77: creat d3/d10/f18 x:0 0 0 2024-02-22T00:33:07.794 INFO:tasks.workunit.client.1.smithi161.stdout:5/78: chown d3/f15 1 1 2024-02-22T00:33:07.794 INFO:tasks.workunit.client.1.smithi161.stdout:5/79: dread - d3/f17 zero size 2024-02-22T00:33:07.794 INFO:tasks.workunit.client.1.smithi161.stdout:0/84: dread fa [0,4194304] 0 2024-02-22T00:33:07.795 INFO:tasks.workunit.client.1.smithi161.stdout:0/85: write f11 [749113,112575] 0 2024-02-22T00:33:07.797 INFO:tasks.workunit.client.1.smithi161.stdout:5/80: creat d3/f19 x:0 0 0 2024-02-22T00:33:07.800 INFO:tasks.workunit.client.1.smithi161.stdout:5/81: creat d3/f1a x:0 0 0 2024-02-22T00:33:07.801 INFO:tasks.workunit.client.1.smithi161.stdout:5/82: dread d3/f15 [0,4194304] 0 2024-02-22T00:33:07.802 INFO:tasks.workunit.client.1.smithi161.stdout:0/86: rename l12 to d14/d1a/l21 0 2024-02-22T00:33:07.805 INFO:tasks.workunit.client.1.smithi161.stdout:5/83: rmdir d3/d10 39 2024-02-22T00:33:07.806 INFO:tasks.workunit.client.1.smithi161.stdout:0/87: dread fb [0,4194304] 0 2024-02-22T00:33:07.806 INFO:tasks.workunit.client.1.smithi161.stdout:5/84: truncate d3/f1a 897851 0 2024-02-22T00:33:07.806 INFO:tasks.workunit.client.1.smithi161.stdout:0/88: rename d14 to d14/d1a/d22 22 2024-02-22T00:33:07.806 INFO:tasks.workunit.client.1.smithi161.stdout:5/85: fsync d3/f19 0 2024-02-22T00:33:07.807 INFO:tasks.workunit.client.1.smithi161.stdout:0/89: write d14/f1f [957870,56569] 0 2024-02-22T00:33:07.811 INFO:tasks.workunit.client.1.smithi161.stdout:0/90: link d14/d1a/f1b d14/d1a/f23 0 2024-02-22T00:33:07.814 INFO:tasks.workunit.client.1.smithi161.stdout:0/91: creat d14/d1a/f24 x:0 0 0 2024-02-22T00:33:07.817 INFO:tasks.workunit.client.1.smithi161.stdout:5/86: dwrite d3/f17 [0,4194304] 0 2024-02-22T00:33:07.817 INFO:tasks.workunit.client.1.smithi161.stdout:0/92: creat d14/f25 x:0 0 0 2024-02-22T00:33:07.817 INFO:tasks.workunit.client.1.smithi161.stdout:5/87: fdatasync d3/fe 0 2024-02-22T00:33:07.821 INFO:tasks.workunit.client.1.smithi161.stdout:0/93: creat d14/d1a/f26 x:0 0 0 2024-02-22T00:33:07.822 INFO:tasks.workunit.client.1.smithi161.stdout:5/88: mkdir d3/d1b 0 2024-02-22T00:33:07.833 INFO:tasks.workunit.client.1.smithi161.stdout:0/94: dwrite d14/f18 [4194304,4194304] 0 2024-02-22T00:33:07.833 INFO:tasks.workunit.client.1.smithi161.stdout:5/89: dwrite d3/f1a [0,4194304] 0 2024-02-22T00:33:07.835 INFO:tasks.workunit.client.1.smithi161.stdout:5/90: fsync d3/fd 0 2024-02-22T00:33:07.840 INFO:tasks.workunit.client.1.smithi161.stdout:0/95: creat d14/d1a/f27 x:0 0 0 2024-02-22T00:33:07.842 INFO:tasks.workunit.client.1.smithi161.stdout:0/96: creat d14/d1a/f28 x:0 0 0 2024-02-22T00:33:07.843 INFO:tasks.workunit.client.1.smithi161.stdout:5/91: dread d3/f1a [0,4194304] 0 2024-02-22T00:33:07.844 INFO:tasks.workunit.client.1.smithi161.stdout:0/97: chown d14/f17 927546 1 2024-02-22T00:33:07.847 INFO:tasks.workunit.client.1.smithi161.stdout:5/92: mkdir d3/d1c 0 2024-02-22T00:33:07.851 INFO:tasks.workunit.client.1.smithi161.stdout:5/93: creat d3/d1b/f1d x:0 0 0 2024-02-22T00:33:07.854 INFO:tasks.workunit.client.1.smithi161.stdout:0/98: dwrite d14/d1a/f27 [0,4194304] 0 2024-02-22T00:33:07.854 INFO:tasks.workunit.client.1.smithi161.stdout:5/94: symlink d3/l1e 0 2024-02-22T00:33:07.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/99: mkdir d14/d29 0 2024-02-22T00:33:07.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/100: chown d14 280 1 2024-02-22T00:33:07.857 INFO:tasks.workunit.client.1.smithi161.stdout:5/95: fdatasync d3/f5 0 2024-02-22T00:33:07.859 INFO:tasks.workunit.client.1.smithi161.stdout:0/101: mknod d14/c2a 0 2024-02-22T00:33:07.860 INFO:tasks.workunit.client.1.smithi161.stdout:5/96: stat d3/d10/f12 0 2024-02-22T00:33:07.869 INFO:tasks.workunit.client.1.smithi161.stdout:5/97: dwrite d3/fd [0,4194304] 0 2024-02-22T00:33:07.869 INFO:tasks.workunit.client.1.smithi161.stdout:5/98: dread - d3/f19 zero size 2024-02-22T00:33:07.874 INFO:tasks.workunit.client.1.smithi161.stdout:5/99: mkdir d3/d1c/d1f 0 2024-02-22T00:33:07.875 INFO:tasks.workunit.client.1.smithi161.stdout:5/100: chown d3/f15 9 1 2024-02-22T00:33:07.875 INFO:tasks.workunit.client.1.smithi161.stdout:5/101: dread - d3/d10/f18 zero size 2024-02-22T00:33:07.876 INFO:tasks.workunit.client.1.smithi161.stdout:5/102: chown d3/f19 3114888 1 2024-02-22T00:33:07.879 INFO:tasks.workunit.client.1.smithi161.stdout:5/103: rename d3/d10 to d3/d1c/d20 0 2024-02-22T00:33:07.882 INFO:tasks.workunit.client.1.smithi161.stdout:5/104: mknod d3/d1c/d1f/c21 0 2024-02-22T00:33:07.884 INFO:tasks.workunit.client.1.smithi161.stdout:5/105: unlink d3/fd 0 2024-02-22T00:33:07.892 INFO:tasks.workunit.client.1.smithi161.stdout:5/106: dwrite d3/fe [0,4194304] 0 2024-02-22T00:33:07.894 INFO:tasks.workunit.client.1.smithi161.stdout:5/107: creat d3/d1b/f22 x:0 0 0 2024-02-22T00:33:07.897 INFO:tasks.workunit.client.1.smithi161.stdout:5/108: creat d3/d1c/d1f/f23 x:0 0 0 2024-02-22T00:33:07.917 INFO:tasks.workunit.client.1.smithi161.stdout:0/102: write d14/d1a/f1b [957708,53750] 0 2024-02-22T00:33:07.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/103: dread f11 [0,4194304] 0 2024-02-22T00:33:07.924 INFO:tasks.workunit.client.1.smithi161.stdout:5/109: truncate d3/fe 2497336 0 2024-02-22T00:33:07.927 INFO:tasks.workunit.client.1.smithi161.stdout:0/104: dwrite d14/d1a/f28 [0,4194304] 0 2024-02-22T00:33:08.014 INFO:tasks.workunit.client.1.smithi161.stdout:5/110: unlink d3/d1b/f22 0 2024-02-22T00:33:08.016 INFO:tasks.workunit.client.1.smithi161.stdout:0/105: symlink d14/d29/l2b 0 2024-02-22T00:33:08.020 INFO:tasks.workunit.client.1.smithi161.stdout:5/111: creat d3/f24 x:0 0 0 2024-02-22T00:33:08.025 INFO:tasks.workunit.client.1.smithi161.stdout:5/112: dwrite d3/f7 [0,4194304] 0 2024-02-22T00:33:08.026 INFO:tasks.workunit.client.1.smithi161.stdout:5/113: readlink d3/l8 0 2024-02-22T00:33:08.026 INFO:tasks.workunit.client.1.smithi161.stdout:5/114: stat d3/f17 0 2024-02-22T00:33:08.034 INFO:tasks.workunit.client.1.smithi161.stdout:5/115: dwrite d3/fe [0,4194304] 0 2024-02-22T00:33:08.035 INFO:tasks.workunit.client.1.smithi161.stdout:5/116: write d3/f17 [3510872,83784] 0 2024-02-22T00:33:08.045 INFO:tasks.workunit.client.1.smithi161.stdout:5/117: getdents d3/d1c/d20 0 2024-02-22T00:33:08.049 INFO:tasks.workunit.client.1.smithi161.stdout:5/118: rename d3/d1c/d1f to d3/d1b/d25 0 2024-02-22T00:33:08.050 INFO:tasks.workunit.client.1.smithi161.stdout:5/119: stat l1 0 2024-02-22T00:33:08.052 INFO:tasks.workunit.client.1.smithi161.stdout:5/120: write d3/f1a [3244920,96473] 0 2024-02-22T00:33:08.054 INFO:tasks.workunit.client.1.smithi161.stdout:5/121: read d3/f1a [2646033,91990] 0 2024-02-22T00:33:08.061 INFO:tasks.workunit.client.1.smithi161.stdout:5/122: link d3/f1a d3/f26 0 2024-02-22T00:33:08.100 INFO:tasks.workunit.client.1.smithi161.stdout:5/123: getdents d3/d1c 0 2024-02-22T00:33:08.104 INFO:tasks.workunit.client.1.smithi161.stdout:5/124: rmdir d3 39 2024-02-22T00:33:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:06.866554+0000 mon.smithi049 (mon.0) 676 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:06.872717+0000 mon.smithi049 (mon.0) 677 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:07.772432+0000 mon.smithi049 (mon.0) 678 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:07.784518+0000 mon.smithi049 (mon.0) 679 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:08.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:06.866554+0000 mon.smithi049 (mon.0) 676 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:08.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:06.872717+0000 mon.smithi049 (mon.0) 677 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:08.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:07.772432+0000 mon.smithi049 (mon.0) 678 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:08.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:07.784518+0000 mon.smithi049 (mon.0) 679 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:09.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:07.754236+0000 mgr.smithi161.sazlam (mgr.24369) 16 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 183 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.6 MiB/s wr, 466 op/s 2024-02-22T00:33:09.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:07.754236+0000 mgr.smithi161.sazlam (mgr.24369) 16 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 183 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.6 MiB/s wr, 466 op/s 2024-02-22T00:33:11.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:09.754581+0000 mgr.smithi161.sazlam (mgr.24369) 17 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 183 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3.8 MiB/s wr, 351 op/s 2024-02-22T00:33:11.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:09.754581+0000 mgr.smithi161.sazlam (mgr.24369) 17 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 183 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3.8 MiB/s wr, 351 op/s 2024-02-22T00:33:11.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 -- 172.21.15.49:0/3739063162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 msgr2=0x7f0c700fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:11.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 --2- 172.21.15.49:0/3739063162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 0x7f0c700fcda0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f0c640047f0 tx=0x7f0c64009cb0).stop 2024-02-22T00:33:11.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 -- 172.21.15.49:0/3739063162 shutdown_connections 2024-02-22T00:33:11.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 --2- 172.21.15.49:0/3739063162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 0x7f0c700fcda0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 --2- 172.21.15.49:0/3739063162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c70061220 0x7f0c700fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 -- 172.21.15.49:0/3739063162 >> 172.21.15.49:0/3739063162 conn(0x7f0c700f1e50 msgr2=0x7f0c700f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:11.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 -- 172.21.15.49:0/3739063162 shutdown_connections 2024-02-22T00:33:11.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 -- 172.21.15.49:0/3739063162 wait complete. 2024-02-22T00:33:11.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.525+0000 7f0c7640c700 1 Processor -- start 2024-02-22T00:33:11.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c7640c700 1 -- start start 2024-02-22T00:33:11.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c7640c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c70061220 0x7f0c70107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c7640c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 0x7f0c70108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c7640c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70108a20 con 0x7f0c700fa9b0 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c7640c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c70108b60 con 0x7f0c70061220 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c6f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 0x7f0c70108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c6f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 0x7f0c70108470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35858/0 (socket says 172.21.15.49:35858) 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c6f7fe700 1 -- 172.21.15.49:0/781520270 learned_addr learned my addr 172.21.15.49:0/781520270 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c6ffff700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c70061220 0x7f0c70107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c6f7fe700 1 -- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c70061220 msgr2=0x7f0c70107f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c6f7fe700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c70061220 0x7f0c70107f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.526+0000 7f0c6f7fe700 1 -- 172.21.15.49:0/781520270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c64005040 con 0x7f0c700fa9b0 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.527+0000 7f0c6f7fe700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 0x7f0c70108470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f0c64013620 tx=0x7f0c64009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.527+0000 7f0c6d7fa700 1 -- 172.21.15.49:0/781520270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c6400e070 con 0x7f0c700fa9b0 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.527+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7010d5a0 con 0x7f0c700fa9b0 2024-02-22T00:33:11.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.527+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7010dae0 con 0x7f0c700fa9b0 2024-02-22T00:33:11.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.527+0000 7f0c6d7fa700 1 -- 172.21.15.49:0/781520270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c64007e90 con 0x7f0c700fa9b0 2024-02-22T00:33:11.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.527+0000 7f0c6d7fa700 1 -- 172.21.15.49:0/781520270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c64018070 con 0x7f0c700fa9b0 2024-02-22T00:33:11.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.528+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c005150 con 0x7f0c700fa9b0 2024-02-22T00:33:11.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.529+0000 7f0c6d7fa700 1 -- 172.21.15.49:0/781520270 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f0c640097f0 con 0x7f0c700fa9b0 2024-02-22T00:33:11.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.529+0000 7f0c6d7fa700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0c58066dc0 0x7f0c58069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.529+0000 7f0c6d7fa700 1 -- 172.21.15.49:0/781520270 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f0c64084f00 con 0x7f0c700fa9b0 2024-02-22T00:33:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.529+0000 7f0c6ffff700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0c58066dc0 0x7f0c58069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:11.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.530+0000 7f0c6ffff700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0c58066dc0 0x7f0c58069280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0c60004e60 tx=0x7f0c6000b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:11.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.535+0000 7f0c6d7fa700 1 -- 172.21.15.49:0/781520270 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f0c64052fa0 con 0x7f0c700fa9b0 2024-02-22T00:33:11.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.803+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c5c000bf0 con 0x7f0c58066dc0 2024-02-22T00:33:11.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.805+0000 7f0c6d7fa700 1 -- 172.21.15.49:0/781520270 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f0c5c000bf0 con 0x7f0c58066dc0 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0c58066dc0 msgr2=0x7f0c58069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0c58066dc0 0x7f0c58069280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0c60004e60 tx=0x7f0c6000b040).stop 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 msgr2=0x7f0c70108470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 0x7f0c70108470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f0c64013620 tx=0x7f0c64009cb0).stop 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 shutdown_connections 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0c58066dc0 0x7f0c58069280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c70061220 0x7f0c70107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 --2- 172.21.15.49:0/781520270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c700fa9b0 0x7f0c70108470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.807+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 >> 172.21.15.49:0/781520270 conn(0x7f0c700f1e50 msgr2=0x7f0c700f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.808+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 shutdown_connections 2024-02-22T00:33:11.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.808+0000 7f0c7640c700 1 -- 172.21.15.49:0/781520270 wait complete. 2024-02-22T00:33:11.823 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 -- 172.21.15.49:0/501952864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880fa960 msgr2=0x7f8c880fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 --2- 172.21.15.49:0/501952864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880fa960 0x7f8c880fcdb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f8c840047f0 tx=0x7f8c84009cb0).stop 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 -- 172.21.15.49:0/501952864 shutdown_connections 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 --2- 172.21.15.49:0/501952864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880fa960 0x7f8c880fcdb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 --2- 172.21.15.49:0/501952864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c880611e0 0x7f8c880fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 -- 172.21.15.49:0/501952864 >> 172.21.15.49:0/501952864 conn(0x7f8c880f1e50 msgr2=0x7f8c880f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 -- 172.21.15.49:0/501952864 shutdown_connections 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 -- 172.21.15.49:0/501952864 wait complete. 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 Processor -- start 2024-02-22T00:33:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.927+0000 7f8c90620700 1 -- start start 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c90620700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880611e0 0x7f8c88108060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c90620700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c880fa960 0x7f8c88108550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c90620700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88108b00 con 0x7f8c880611e0 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c90620700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88108c40 con 0x7f8c880fa960 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c8e3bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880611e0 0x7f8c88108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c8e3bc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880611e0 0x7f8c88108060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35880/0 (socket says 172.21.15.49:35880) 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c8e3bc700 1 -- 172.21.15.49:0/282692711 learned_addr learned my addr 172.21.15.49:0/282692711 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c8dbbb700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c880fa960 0x7f8c88108550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c8e3bc700 1 -- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c880fa960 msgr2=0x7f8c88108550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c8e3bc700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c880fa960 0x7f8c88108550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c8e3bc700 1 -- 172.21.15.49:0/282692711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c84005040 con 0x7f8c880611e0 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c8e3bc700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880611e0 0x7f8c88108060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f8c7800e8f0 tx=0x7f8c7800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c7f7fe700 1 -- 172.21.15.49:0/282692711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c78007b40 con 0x7f8c880611e0 2024-02-22T00:33:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c7f7fe700 1 -- 172.21.15.49:0/282692711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c7800f040 con 0x7f8c880611e0 2024-02-22T00:33:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8810d6e0 con 0x7f8c880611e0 2024-02-22T00:33:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c7f7fe700 1 -- 172.21.15.49:0/282692711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c78014920 con 0x7f8c880611e0 2024-02-22T00:33:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.928+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8810dca0 con 0x7f8c880611e0 2024-02-22T00:33:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.929+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c880fffc0 con 0x7f8c880611e0 2024-02-22T00:33:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.930+0000 7f8c7f7fe700 1 -- 172.21.15.49:0/282692711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f8c78007ca0 con 0x7f8c880611e0 2024-02-22T00:33:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.930+0000 7f8c7f7fe700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c74066dc0 0x7f8c74069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.930+0000 7f8c7f7fe700 1 -- 172.21.15.49:0/282692711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f8c78083f90 con 0x7f8c880611e0 2024-02-22T00:33:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.930+0000 7f8c8dbbb700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c74066dc0 0x7f8c74069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.931+0000 7f8c8dbbb700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c74066dc0 0x7f8c74069280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8c840047c0 tx=0x7f8c84009cb0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:11.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:11.935+0000 7f8c7f7fe700 1 -- 172.21.15.49:0/282692711 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f8c78052030 con 0x7f8c880611e0 2024-02-22T00:33:12.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.222+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c88059120 con 0x7f8c74066dc0 2024-02-22T00:33:12.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.223+0000 7f8c7f7fe700 1 -- 172.21.15.49:0/282692711 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f8c88059120 con 0x7f8c74066dc0 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c74066dc0 msgr2=0x7f8c74069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c74066dc0 0x7f8c74069280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f8c840047c0 tx=0x7f8c84009cb0).stop 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880611e0 msgr2=0x7f8c88108060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880611e0 0x7f8c88108060 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f8c7800e8f0 tx=0x7f8c7800b040).stop 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 shutdown_connections 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c74066dc0 0x7f8c74069280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c880611e0 0x7f8c88108060 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 --2- 172.21.15.49:0/282692711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c880fa960 0x7f8c88108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 >> 172.21.15.49:0/282692711 conn(0x7f8c880f1e50 msgr2=0x7f8c880f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:12.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 shutdown_connections 2024-02-22T00:33:12.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.226+0000 7f8c90620700 1 -- 172.21.15.49:0/282692711 wait complete. 2024-02-22T00:33:12.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.364+0000 7f8c2bb17700 1 -- 172.21.15.49:0/102413471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f7990 msgr2=0x7f8c240f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.364+0000 7f8c2bb17700 1 --2- 172.21.15.49:0/102413471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f7990 0x7f8c240f7df0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f8c140047b0 tx=0x7f8c14009cb0).stop 2024-02-22T00:33:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.364+0000 7f8c2bb17700 1 -- 172.21.15.49:0/102413471 shutdown_connections 2024-02-22T00:33:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.364+0000 7f8c2bb17700 1 --2- 172.21.15.49:0/102413471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f7990 0x7f8c240f7df0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.364+0000 7f8c2bb17700 1 --2- 172.21.15.49:0/102413471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c240f66f0 0x7f8c240f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.364+0000 7f8c2bb17700 1 -- 172.21.15.49:0/102413471 >> 172.21.15.49:0/102413471 conn(0x7f8c240f1e50 msgr2=0x7f8c240f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.364+0000 7f8c2bb17700 1 -- 172.21.15.49:0/102413471 shutdown_connections 2024-02-22T00:33:12.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.364+0000 7f8c2bb17700 1 -- 172.21.15.49:0/102413471 wait complete. 2024-02-22T00:33:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c2bb17700 1 Processor -- start 2024-02-22T00:33:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c2bb17700 1 -- start start 2024-02-22T00:33:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c2bb17700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f66f0 0x7f8c24109550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c2bb17700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c240f7990 0x7f8c24109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:12.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c2bb17700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24105fa0 con 0x7f8c240f66f0 2024-02-22T00:33:12.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c2bb17700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241060e0 con 0x7f8c240f7990 2024-02-22T00:33:12.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c290b2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c240f7990 0x7f8c24109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:12.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c290b2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c240f7990 0x7f8c24109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:52922/0 (socket says 172.21.15.49:52922) 2024-02-22T00:33:12.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.365+0000 7f8c290b2700 1 -- 172.21.15.49:0/420935722 learned_addr learned my addr 172.21.15.49:0/420935722 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:12.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.366+0000 7f8c298b3700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f66f0 0x7f8c24109550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.366+0000 7f8c290b2700 1 -- 172.21.15.49:0/420935722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f66f0 msgr2=0x7f8c24109550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.366+0000 7f8c290b2700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f66f0 0x7f8c24109550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.366+0000 7f8c290b2700 1 -- 172.21.15.49:0/420935722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14005040 con 0x7f8c240f7990 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.366+0000 7f8c298b3700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f66f0 0x7f8c24109550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.366+0000 7f8c290b2700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c240f7990 0x7f8c24109a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8c14004e20 tx=0x7f8c14009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.366+0000 7f8c1affd700 1 -- 172.21.15.49:0/420935722 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c140094c0 con 0x7f8c240f7990 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.366+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c24106360 con 0x7f8c240f7990 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.367+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c241068c0 con 0x7f8c240f7990 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.367+0000 7f8c1affd700 1 -- 172.21.15.49:0/420935722 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c14009620 con 0x7f8c240f7990 2024-02-22T00:33:12.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.367+0000 7f8c1affd700 1 -- 172.21.15.49:0/420935722 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1400f410 con 0x7f8c240f7990 2024-02-22T00:33:12.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.368+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c08005150 con 0x7f8c240f7990 2024-02-22T00:33:12.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.368+0000 7f8c1affd700 1 -- 172.21.15.49:0/420935722 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f8c14018040 con 0x7f8c240f7990 2024-02-22T00:33:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.369+0000 7f8c1affd700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c10066dc0 0x7f8c10069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.369+0000 7f8c1affd700 1 -- 172.21.15.49:0/420935722 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f8c14085520 con 0x7f8c240f7990 2024-02-22T00:33:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.369+0000 7f8c298b3700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c10066dc0 0x7f8c10069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.370+0000 7f8c298b3700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c10066dc0 0x7f8c10069280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8c20009a00 tx=0x7f8c2000b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.375+0000 7f8c1affd700 1 -- 172.21.15.49:0/420935722 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f8c14053580 con 0x7f8c240f7990 2024-02-22T00:33:12.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.623+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c08000bf0 con 0x7f8c10066dc0 2024-02-22T00:33:12.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.633+0000 7f8c1affd700 1 -- 172.21.15.49:0/420935722 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8c08000bf0 con 0x7f8c10066dc0 2024-02-22T00:33:12.635 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:33:12.635 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (6m) 5s ago 7m 24.4M - 0.23.0 ba2b418f427c 05fc98ae8941 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 5s ago 7m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (7m) 7s ago 6m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (6m) 5s ago 7m 54.7M - 8.3.5 dad864ee21e9 d07a1ce3ae93 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (2m) 5s ago 2m 13.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (2m) 5s ago 2m 96.8M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (2m) 7s ago 2m 13.3M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (2m) 7s ago 2m 75.0M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:9283 running (8m) 5s ago 8m 182M - 16.2.14-550-geb66ed92 7403d1862307 c15a70e0a1be 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 running (33s) 7s ago 6m 483M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d128d026ba47 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 5s ago 9m 50.4M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (6m) 7s ago 6m 43.5M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (7m) 5s ago 7m 22.8M - 1.3.1 1dbe0e931976 22b6c923dd53 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 7s ago 6m 21.5M - 1.3.1 1dbe0e931976 3bd6815e682e 2024-02-22T00:33:12.636 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 5s ago 6m 93.7M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:33:12.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 5s ago 5m 103M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:33:12.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 5s ago 5m 85.9M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:33:12.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (4m) 7s ago 4m 102M 4982M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:33:12.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (4m) 7s ago 4m 96.4M 4982M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:33:12.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (4m) 7s ago 3m 90.7M 4982M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:33:12.637 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (6m) 7s ago 6m 60.3M - 2.33.4 514e6a882f6e 0880324bb723 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c10066dc0 msgr2=0x7f8c10069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c10066dc0 0x7f8c10069280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8c20009a00 tx=0x7f8c2000b040).stop 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c240f7990 msgr2=0x7f8c24109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c240f7990 0x7f8c24109a40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8c14004e20 tx=0x7f8c14009cb0).stop 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 shutdown_connections 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f8c10066dc0 0x7f8c10069280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c240f66f0 0x7f8c24109550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 --2- 172.21.15.49:0/420935722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c240f7990 0x7f8c24109a40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 >> 172.21.15.49:0/420935722 conn(0x7f8c240f1e50 msgr2=0x7f8c240fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 shutdown_connections 2024-02-22T00:33:12.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.635+0000 7f8c2bb17700 1 -- 172.21.15.49:0/420935722 wait complete. 2024-02-22T00:33:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.311193+0000 mon.smithi049 (mon.0) 680 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.316666+0000 mon.smithi049 (mon.0) 681 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.318164+0000 mon.smithi161 (mon.1) 53 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.318563+0000 mon.smithi049 (mon.0) 682 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.319398+0000 mon.smithi161 (mon.1) 54 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.319749+0000 mon.smithi049 (mon.0) 683 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.320392+0000 mon.smithi161 (mon.1) 55 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.320718+0000 mon.smithi049 (mon.0) 684 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:11.321444+0000 mgr.smithi161.sazlam (mgr.24369) 18 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 1910M 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.325934+0000 mon.smithi049 (mon.0) 685 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:11.755063+0000 mgr.smithi161.sazlam (mgr.24369) 19 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 297 KiB/s rd, 21 MiB/s wr, 482 op/s 2024-02-22T00:33:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:11.805392+0000 mgr.smithi161.sazlam (mgr.24369) 20 : audit [DBG] from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:12.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.753+0000 7fd466319700 1 -- 172.21.15.49:0/2537917283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 msgr2=0x7fd4600f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:12.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.753+0000 7fd466319700 1 --2- 172.21.15.49:0/2537917283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 0x7fd4600f5950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fd4540047f0 tx=0x7fd454009cb0).stop 2024-02-22T00:33:12.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.753+0000 7fd466319700 1 -- 172.21.15.49:0/2537917283 shutdown_connections 2024-02-22T00:33:12.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.753+0000 7fd466319700 1 --2- 172.21.15.49:0/2537917283 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 0x7fd4600f5950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.753+0000 7fd466319700 1 --2- 172.21.15.49:0/2537917283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4600f8e30 0x7fd4600f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.753+0000 7fd466319700 1 -- 172.21.15.49:0/2537917283 >> 172.21.15.49:0/2537917283 conn(0x7fd4600f15d0 msgr2=0x7fd4600f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:12.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.753+0000 7fd466319700 1 -- 172.21.15.49:0/2537917283 shutdown_connections 2024-02-22T00:33:12.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.753+0000 7fd466319700 1 -- 172.21.15.49:0/2537917283 wait complete. 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.754+0000 7fd466319700 1 Processor -- start 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.754+0000 7fd466319700 1 -- start start 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd466319700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4600f8e30 0x7fd460110c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd466319700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 0x7fd460111100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd466319700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd460111700 con 0x7fd4600f97d0 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd466319700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd460111840 con 0x7fd4600f8e30 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4600f8e30 0x7fd460110c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 0x7fd460111100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45ffff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4600f8e30 0x7fd460110c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:52944/0 (socket says 172.21.15.49:52944) 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45ffff700 1 -- 172.21.15.49:0/1652499633 learned_addr learned my addr 172.21.15.49:0/1652499633 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 0x7fd460111100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35936/0 (socket says 172.21.15.49:35936) 2024-02-22T00:33:12.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45ffff700 1 -- 172.21.15.49:0/1652499633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 msgr2=0x7fd460111100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45ffff700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 0x7fd460111100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45ffff700 1 -- 172.21.15.49:0/1652499633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454005040 con 0x7fd4600f8e30 2024-02-22T00:33:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45f7fe700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 0x7fd460111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:33:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45ffff700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4600f8e30 0x7fd460110c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd450002820 tx=0x7fd450009f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.755+0000 7fd45d7fa700 1 -- 172.21.15.49:0/1652499633 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd450007b40 con 0x7fd4600f8e30 2024-02-22T00:33:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.756+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4600f6ac0 con 0x7fd4600f8e30 2024-02-22T00:33:12.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.756+0000 7fd45d7fa700 1 -- 172.21.15.49:0/1652499633 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd45000f040 con 0x7fd4600f8e30 2024-02-22T00:33:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.756+0000 7fd45d7fa700 1 -- 172.21.15.49:0/1652499633 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd450014820 con 0x7fd4600f8e30 2024-02-22T00:33:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.756+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4600f7030 con 0x7fd4600f8e30 2024-02-22T00:33:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.757+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd460062cb0 con 0x7fd4600f8e30 2024-02-22T00:33:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.757+0000 7fd45d7fa700 1 -- 172.21.15.49:0/1652499633 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7fd450009110 con 0x7fd4600f8e30 2024-02-22T00:33:12.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.758+0000 7fd45d7fa700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd448066dc0 0x7fd448069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:12.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.758+0000 7fd45d7fa700 1 -- 172.21.15.49:0/1652499633 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fd450083ff0 con 0x7fd4600f8e30 2024-02-22T00:33:12.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.758+0000 7fd45f7fe700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd448066dc0 0x7fd448069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:12.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.758+0000 7fd45f7fe700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd448066dc0 0x7fd448069280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd454004f10 tx=0x7fd45400b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:12.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:12.764+0000 7fd45d7fa700 1 -- 172.21.15.49:0/1652499633 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fd4500b7320 con 0x7fd4600f8e30 2024-02-22T00:33:12.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.311193+0000 mon.smithi049 (mon.0) 680 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:12.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.316666+0000 mon.smithi049 (mon.0) 681 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.318164+0000 mon.smithi161 (mon.1) 53 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.318563+0000 mon.smithi049 (mon.0) 682 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.319398+0000 mon.smithi161 (mon.1) 54 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.319749+0000 mon.smithi049 (mon.0) 683 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.320392+0000 mon.smithi161 (mon.1) 55 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.320718+0000 mon.smithi049 (mon.0) 684 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:11.321444+0000 mgr.smithi161.sazlam (mgr.24369) 18 : cephadm [INF] Adjusting osd_memory_target on smithi049 to 1910M 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.325934+0000 mon.smithi049 (mon.0) 685 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:11.755063+0000 mgr.smithi161.sazlam (mgr.24369) 19 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 297 KiB/s rd, 21 MiB/s wr, 482 op/s 2024-02-22T00:33:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:11.805392+0000 mgr.smithi161.sazlam (mgr.24369) 20 : audit [DBG] from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.069+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd4600f8430 con 0x7fd4600f8e30 2024-02-22T00:33:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.070+0000 7fd45d7fa700 1 -- 172.21.15.49:0/1652499633 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+858 (secure 0 0 0) 0x7fd45004e5a0 con 0x7fd4600f8e30 2024-02-22T00:33:13.072 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:33:13.072 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:33:13.072 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:33:13.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:33:13.072 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:33:13.072 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1, 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 13, 2024-02-22T00:33:13.073 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:33:13.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:33:13.074 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:33:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd448066dc0 msgr2=0x7fd448069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd448066dc0 0x7fd448069280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd454004f10 tx=0x7fd45400b040).stop 2024-02-22T00:33:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4600f8e30 msgr2=0x7fd460110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4600f8e30 0x7fd460110c10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fd450002820 tx=0x7fd450009f00).stop 2024-02-22T00:33:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 shutdown_connections 2024-02-22T00:33:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd448066dc0 0x7fd448069280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4600f8e30 0x7fd460110c10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 --2- 172.21.15.49:0/1652499633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4600f97d0 0x7fd460111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 >> 172.21.15.49:0/1652499633 conn(0x7fd4600f15d0 msgr2=0x7fd4600fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 shutdown_connections 2024-02-22T00:33:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.072+0000 7fd466319700 1 -- 172.21.15.49:0/1652499633 wait complete. 2024-02-22T00:33:13.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 -- 172.21.15.49:0/700932019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 msgr2=0x7f55300f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 --2- 172.21.15.49:0/700932019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 0x7f55300f6b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f55200047f0 tx=0x7f5520009cb0).stop 2024-02-22T00:33:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 -- 172.21.15.49:0/700932019 shutdown_connections 2024-02-22T00:33:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 --2- 172.21.15.49:0/700932019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55300f7990 0x7f55300f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 --2- 172.21.15.49:0/700932019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 0x7f55300f6b10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 -- 172.21.15.49:0/700932019 >> 172.21.15.49:0/700932019 conn(0x7f55300f1e50 msgr2=0x7f55300f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 -- 172.21.15.49:0/700932019 shutdown_connections 2024-02-22T00:33:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 -- 172.21.15.49:0/700932019 wait complete. 2024-02-22T00:33:13.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.185+0000 7f5535b63700 1 Processor -- start 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f5535b63700 1 -- start start 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f5535b63700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 0x7f553010a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f5535b63700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55300f7990 0x7f553010a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f5535b63700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553010ae50 con 0x7f55300f66f0 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f5535b63700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553010af90 con 0x7f55300f7990 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 0x7f553010a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 0x7f553010a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35950/0 (socket says 172.21.15.49:35950) 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552f7fe700 1 -- 172.21.15.49:0/543017557 learned_addr learned my addr 172.21.15.49:0/543017557 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552effd700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55300f7990 0x7f553010a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552f7fe700 1 -- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55300f7990 msgr2=0x7f553010a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552f7fe700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55300f7990 0x7f553010a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:13.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552f7fe700 1 -- 172.21.15.49:0/543017557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520005040 con 0x7f55300f66f0 2024-02-22T00:33:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552effd700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55300f7990 0x7f553010a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:33:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.186+0000 7f552f7fe700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 0x7f553010a3b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5520004e60 tx=0x7f5520009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.187+0000 7f552cff9700 1 -- 172.21.15.49:0/543017557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f552000e070 con 0x7f55300f66f0 2024-02-22T00:33:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.187+0000 7f552cff9700 1 -- 172.21.15.49:0/543017557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f55200094c0 con 0x7f55300f66f0 2024-02-22T00:33:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.187+0000 7f5535b63700 1 -- 172.21.15.49:0/543017557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553010f9d0 con 0x7f55300f66f0 2024-02-22T00:33:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.187+0000 7f552cff9700 1 -- 172.21.15.49:0/543017557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f552000f410 con 0x7f55300f66f0 2024-02-22T00:33:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.187+0000 7f5535b63700 1 -- 172.21.15.49:0/543017557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553010ff90 con 0x7f55300f66f0 2024-02-22T00:33:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.188+0000 7f55167fc700 1 -- 172.21.15.49:0/543017557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55300fddd0 con 0x7f55300f66f0 2024-02-22T00:33:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.188+0000 7f552cff9700 1 -- 172.21.15.49:0/543017557 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f5520018040 con 0x7f55300f66f0 2024-02-22T00:33:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.189+0000 7f552cff9700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f5518066dc0 0x7f5518069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.189+0000 7f552cff9700 1 -- 172.21.15.49:0/543017557 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f5520084f80 con 0x7f55300f66f0 2024-02-22T00:33:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.189+0000 7f552effd700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f5518066dc0 0x7f5518069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.190+0000 7f552effd700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f5518066dc0 0x7f5518069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5524007bf0 tx=0x7f552400b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:13.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.195+0000 7f552cff9700 1 -- 172.21.15.49:0/543017557 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f5520053020 con 0x7f55300f66f0 2024-02-22T00:33:13.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/7: sync 2024-02-22T00:33:13.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/8: dwrite - no filename 2024-02-22T00:33:13.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/9: chown . 6 1 2024-02-22T00:33:13.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/10: readlink - no filename 2024-02-22T00:33:13.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/11: write - no filename 2024-02-22T00:33:13.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/12: dwrite - no filename 2024-02-22T00:33:13.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/13: fsync - no filename 2024-02-22T00:33:13.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/14: link - no file 2024-02-22T00:33:13.403 INFO:tasks.workunit.client.1.smithi161.stdout:8/15: creat f0 x:0 0 0 2024-02-22T00:33:13.405 INFO:tasks.workunit.client.1.smithi161.stdout:8/16: mkdir d1 0 2024-02-22T00:33:13.405 INFO:tasks.workunit.client.1.smithi161.stdout:8/17: chown f0 1810174 1 2024-02-22T00:33:13.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/1: sync 2024-02-22T00:33:13.406 INFO:tasks.workunit.client.1.smithi161.stdout:3/4: sync 2024-02-22T00:33:13.406 INFO:tasks.workunit.client.1.smithi161.stdout:6/0: sync 2024-02-22T00:33:13.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/2: dread - no filename 2024-02-22T00:33:13.406 INFO:tasks.workunit.client.1.smithi161.stdout:6/1: chown . 221 1 2024-02-22T00:33:13.406 INFO:tasks.workunit.client.1.smithi161.stdout:6/2: chown . 63065625 1 2024-02-22T00:33:13.407 INFO:tasks.workunit.client.1.smithi161.stdout:6/3: rmdir - no directory 2024-02-22T00:33:13.408 INFO:tasks.workunit.client.1.smithi161.stdout:7/3: creat f1 x:0 0 0 2024-02-22T00:33:13.408 INFO:tasks.workunit.client.1.smithi161.stdout:3/5: mknod c4 0 2024-02-22T00:33:13.410 INFO:tasks.workunit.client.1.smithi161.stdout:3/6: dread - f2 zero size 2024-02-22T00:33:13.410 INFO:tasks.workunit.client.1.smithi161.stdout:7/4: creat f2 x:0 0 0 2024-02-22T00:33:13.410 INFO:tasks.workunit.client.1.smithi161.stdout:6/4: creat f0 x:0 0 0 2024-02-22T00:33:13.411 INFO:tasks.workunit.client.1.smithi161.stdout:3/7: dread - f2 zero size 2024-02-22T00:33:13.414 INFO:tasks.workunit.client.1.smithi161.stdout:8/18: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.414 INFO:tasks.workunit.client.1.smithi161.stdout:7/5: mkdir d3 0 2024-02-22T00:33:13.414 INFO:tasks.workunit.client.1.smithi161.stdout:3/8: creat f5 x:0 0 0 2024-02-22T00:33:13.415 INFO:tasks.workunit.client.1.smithi161.stdout:3/9: dread - f5 zero size 2024-02-22T00:33:13.417 INFO:tasks.workunit.client.1.smithi161.stdout:8/19: symlink d1/l2 0 2024-02-22T00:33:13.420 INFO:tasks.workunit.client.1.smithi161.stdout:7/6: link f2 d3/f4 0 2024-02-22T00:33:13.420 INFO:tasks.workunit.client.1.smithi161.stdout:8/20: symlink d1/l3 0 2024-02-22T00:33:13.421 INFO:tasks.workunit.client.1.smithi161.stdout:8/21: readlink d1/l2 0 2024-02-22T00:33:13.423 INFO:tasks.workunit.client.1.smithi161.stdout:7/7: unlink f1 0 2024-02-22T00:33:13.425 INFO:tasks.workunit.client.1.smithi161.stdout:8/22: symlink d1/l4 0 2024-02-22T00:33:13.426 INFO:tasks.workunit.client.1.smithi161.stdout:8/23: read f0 [4060710,14650] 0 2024-02-22T00:33:13.429 INFO:tasks.workunit.client.1.smithi161.stdout:7/8: symlink d3/l5 0 2024-02-22T00:33:13.430 INFO:tasks.workunit.client.1.smithi161.stdout:7/9: dread - f2 zero size 2024-02-22T00:33:13.434 INFO:tasks.workunit.client.1.smithi161.stdout:7/10: write f2 [126128,19460] 0 2024-02-22T00:33:13.437 INFO:tasks.workunit.client.1.smithi161.stdout:7/11: dread f2 [0,4194304] 0 2024-02-22T00:33:13.439 INFO:tasks.workunit.client.1.smithi161.stdout:7/12: unlink d3/l5 0 2024-02-22T00:33:13.441 INFO:tasks.workunit.client.1.smithi161.stdout:7/13: creat d3/f6 x:0 0 0 2024-02-22T00:33:13.443 INFO:tasks.workunit.client.1.smithi161.stdout:7/14: creat d3/f7 x:0 0 0 2024-02-22T00:33:13.448 INFO:tasks.workunit.client.1.smithi161.stdout:8/24: fsync f0 0 2024-02-22T00:33:13.450 INFO:tasks.workunit.client.1.smithi161.stdout:7/15: dwrite d3/f7 [0,4194304] 0 2024-02-22T00:33:13.452 INFO:tasks.workunit.client.1.smithi161.stdout:6/5: fsync f0 0 2024-02-22T00:33:13.454 INFO:tasks.workunit.client.1.smithi161.stdout:7/16: symlink d3/l8 0 2024-02-22T00:33:13.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/10: truncate f0 18655 0 2024-02-22T00:33:13.459 INFO:tasks.workunit.client.1.smithi161.stdout:3/11: unlink l1 0 2024-02-22T00:33:13.460 INFO:tasks.workunit.client.1.smithi161.stdout:6/6: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.461 INFO:tasks.workunit.client.1.smithi161.stdout:3/12: truncate f5 871093 0 2024-02-22T00:33:13.464 INFO:tasks.workunit.client.1.smithi161.stdout:3/13: mknod c6 0 2024-02-22T00:33:13.468 INFO:tasks.workunit.client.1.smithi161.stdout:8/25: truncate f0 512034 0 2024-02-22T00:33:13.475 INFO:tasks.workunit.client.1.smithi161.stdout:3/14: read f2 [9941,118357] 0 2024-02-22T00:33:13.477 INFO:tasks.workunit.client.1.smithi161.stdout:3/15: creat f7 x:0 0 0 2024-02-22T00:33:13.479 INFO:tasks.workunit.client.1.smithi161.stdout:7/17: dwrite d3/f7 [4194304,4194304] 0 2024-02-22T00:33:13.483 INFO:tasks.workunit.client.1.smithi161.stdout:7/18: creat d3/f9 x:0 0 0 2024-02-22T00:33:13.484 INFO:tasks.workunit.client.1.smithi161.stdout:7/19: dread d3/f4 [0,4194304] 0 2024-02-22T00:33:13.485 INFO:tasks.workunit.client.1.smithi161.stdout:7/20: truncate d3/f4 844880 0 2024-02-22T00:33:13.490 INFO:tasks.workunit.client.1.smithi161.stdout:7/21: rename d3/f6 to d3/fa 0 2024-02-22T00:33:13.493 INFO:tasks.workunit.client.1.smithi161.stdout:7/22: symlink d3/lb 0 2024-02-22T00:33:13.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.495+0000 7f55167fc700 1 -- 172.21.15.49:0/543017557 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55300fdf60 con 0x7f5518066dc0 2024-02-22T00:33:13.498 INFO:tasks.workunit.client.1.smithi161.stdout:3/16: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.498 INFO:tasks.workunit.client.1.smithi161.stdout:8/26: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.497+0000 7f552cff9700 1 -- 172.21.15.49:0/543017557 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f55300fdf60 con 0x7f5518066dc0 2024-02-22T00:33:13.499 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:33:13.499 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:33:13.499 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:33:13.499 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:33:13.500 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-02-22T00:33:13.500 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "1/2 daemons upgraded", 2024-02-22T00:33:13.500 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-02-22T00:33:13.500 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:33:13.500 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:33:13.501 INFO:tasks.workunit.client.1.smithi161.stdout:8/27: chown d1/l2 7 1 2024-02-22T00:33:13.501 INFO:tasks.workunit.client.1.smithi161.stdout:8/28: chown d1 219732 1 2024-02-22T00:33:13.501 INFO:tasks.workunit.client.1.smithi161.stdout:7/23: rename d3/l8 to d3/lc 0 2024-02-22T00:33:13.501 INFO:tasks.workunit.client.1.smithi161.stdout:7/24: write d3/f7 [3454930,46040] 0 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.499+0000 7f55167fc700 1 -- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f5518066dc0 msgr2=0x7f5518069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.499+0000 7f55167fc700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f5518066dc0 0x7f5518069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5524007bf0 tx=0x7f552400b040).stop 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.499+0000 7f55167fc700 1 -- 172.21.15.49:0/543017557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 msgr2=0x7f553010a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.499+0000 7f55167fc700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 0x7f553010a3b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f5520004e60 tx=0x7f5520009cb0).stop 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.500+0000 7f55167fc700 1 -- 172.21.15.49:0/543017557 shutdown_connections 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.500+0000 7f55167fc700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f5518066dc0 0x7f5518069280 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0x7f5524007bf0 tx=0x7f552400b040).stop 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.500+0000 7f55167fc700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55300f66f0 0x7f553010a3b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.500+0000 7f55167fc700 1 --2- 172.21.15.49:0/543017557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55300f7990 0x7f553010a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.500+0000 7f55167fc700 1 -- 172.21.15.49:0/543017557 >> 172.21.15.49:0/543017557 conn(0x7f55300f1e50 msgr2=0x7f55300fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.500+0000 7f55167fc700 1 -- 172.21.15.49:0/543017557 shutdown_connections 2024-02-22T00:33:13.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:13.500+0000 7f55167fc700 1 -- 172.21.15.49:0/543017557 wait complete. 2024-02-22T00:33:13.504 INFO:tasks.workunit.client.1.smithi161.stdout:8/29: mknod d1/c5 0 2024-02-22T00:33:13.509 INFO:tasks.workunit.client.1.smithi161.stdout:7/25: fsync d3/f4 0 2024-02-22T00:33:13.512 INFO:tasks.workunit.client.1.smithi161.stdout:7/26: mkdir d3/dd 0 2024-02-22T00:33:13.515 INFO:tasks.workunit.client.1.smithi161.stdout:7/27: creat d3/dd/fe x:0 0 0 2024-02-22T00:33:13.518 INFO:tasks.workunit.client.1.smithi161.stdout:7/28: mkdir d3/df 0 2024-02-22T00:33:13.518 INFO:tasks.workunit.client.1.smithi161.stdout:3/17: fdatasync f0 0 2024-02-22T00:33:13.520 INFO:tasks.workunit.client.1.smithi161.stdout:7/29: creat d3/f10 x:0 0 0 2024-02-22T00:33:13.522 INFO:tasks.workunit.client.1.smithi161.stdout:7/30: mknod d3/dd/c11 0 2024-02-22T00:33:13.525 INFO:tasks.workunit.client.1.smithi161.stdout:3/18: getdents . 0 2024-02-22T00:33:13.529 INFO:tasks.workunit.client.1.smithi161.stdout:8/30: fsync f0 0 2024-02-22T00:33:13.530 INFO:tasks.workunit.client.1.smithi161.stdout:7/31: dwrite d3/f7 [0,4194304] 0 2024-02-22T00:33:13.530 INFO:tasks.workunit.client.1.smithi161.stdout:8/31: chown d1 253411635 1 2024-02-22T00:33:13.533 INFO:tasks.workunit.client.1.smithi161.stdout:8/32: creat d1/f6 x:0 0 0 2024-02-22T00:33:13.540 INFO:tasks.workunit.client.1.smithi161.stdout:7/32: dwrite d3/f10 [0,4194304] 0 2024-02-22T00:33:13.544 INFO:tasks.workunit.client.1.smithi161.stdout:8/33: dwrite f0 [4194304,4194304] 0 2024-02-22T00:33:13.547 INFO:tasks.workunit.client.1.smithi161.stdout:8/34: truncate d1/f6 318648 0 2024-02-22T00:33:13.547 INFO:tasks.workunit.client.1.smithi161.stdout:7/33: symlink d3/df/l12 0 2024-02-22T00:33:13.548 INFO:tasks.workunit.client.1.smithi161.stdout:7/34: write d3/f4 [20977,1654] 0 2024-02-22T00:33:13.550 INFO:tasks.workunit.client.1.smithi161.stdout:8/35: mknod d1/c7 0 2024-02-22T00:33:13.552 INFO:tasks.workunit.client.1.smithi161.stdout:7/35: read d3/f7 [6979635,53725] 0 2024-02-22T00:33:13.554 INFO:tasks.workunit.client.1.smithi161.stdout:8/36: mkdir d1/d8 0 2024-02-22T00:33:13.559 INFO:tasks.workunit.client.1.smithi161.stdout:8/37: mknod d1/c9 0 2024-02-22T00:33:13.566 INFO:tasks.workunit.client.1.smithi161.stdout:7/36: rmdir d3 39 2024-02-22T00:33:13.570 INFO:tasks.workunit.client.1.smithi161.stdout:8/38: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.571 INFO:tasks.workunit.client.1.smithi161.stdout:7/37: rename d3/f10 to d3/dd/f13 0 2024-02-22T00:33:13.571 INFO:tasks.workunit.client.1.smithi161.stdout:7/38: chown d3 5014891 1 2024-02-22T00:33:13.571 INFO:tasks.workunit.client.1.smithi161.stdout:8/39: rename d1/d8 to d1/d8/da 22 2024-02-22T00:33:13.574 INFO:tasks.workunit.client.1.smithi161.stdout:8/40: creat d1/d8/fb x:0 0 0 2024-02-22T00:33:13.576 INFO:tasks.workunit.client.1.smithi161.stdout:8/41: dread - d1/d8/fb zero size 2024-02-22T00:33:13.577 INFO:tasks.workunit.client.1.smithi161.stdout:8/42: write f0 [668377,14058] 0 2024-02-22T00:33:13.579 INFO:tasks.workunit.client.1.smithi161.stdout:8/43: write d1/f6 [889980,44323] 0 2024-02-22T00:33:13.579 INFO:tasks.workunit.client.1.smithi161.stdout:7/39: dwrite f2 [0,4194304] 0 2024-02-22T00:33:13.582 INFO:tasks.workunit.client.1.smithi161.stdout:8/44: read - d1/d8/fb zero size 2024-02-22T00:33:13.586 INFO:tasks.workunit.client.1.smithi161.stdout:7/40: rename d3/f4 to d3/f14 0 2024-02-22T00:33:13.589 INFO:tasks.workunit.client.1.smithi161.stdout:8/45: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.590 INFO:tasks.workunit.client.1.smithi161.stdout:8/46: readlink d1/l3 0 2024-02-22T00:33:13.591 INFO:tasks.workunit.client.1.smithi161.stdout:8/47: chown d1/d8/fb 0 1 2024-02-22T00:33:13.591 INFO:tasks.workunit.client.1.smithi161.stdout:7/41: symlink d3/dd/l15 0 2024-02-22T00:33:13.592 INFO:tasks.workunit.client.1.smithi161.stdout:8/48: read - d1/d8/fb zero size 2024-02-22T00:33:13.592 INFO:tasks.workunit.client.1.smithi161.stdout:7/42: read d3/f14 [574316,86516] 0 2024-02-22T00:33:13.592 INFO:tasks.workunit.client.1.smithi161.stdout:7/43: chown d3 2068668 1 2024-02-22T00:33:13.593 INFO:tasks.workunit.client.1.smithi161.stdout:8/49: fdatasync d1/d8/fb 0 2024-02-22T00:33:13.594 INFO:tasks.workunit.client.1.smithi161.stdout:8/50: fdatasync d1/f6 0 2024-02-22T00:33:13.597 INFO:tasks.workunit.client.1.smithi161.stdout:8/51: creat d1/d8/fc x:0 0 0 2024-02-22T00:33:13.599 INFO:tasks.workunit.client.1.smithi161.stdout:8/52: mknod d1/cd 0 2024-02-22T00:33:13.600 INFO:tasks.workunit.client.1.smithi161.stdout:7/44: link d3/df/l12 d3/df/l16 0 2024-02-22T00:33:13.601 INFO:tasks.workunit.client.1.smithi161.stdout:7/45: fdatasync d3/f14 0 2024-02-22T00:33:13.603 INFO:tasks.workunit.client.1.smithi161.stdout:7/46: write d3/f14 [5188330,63935] 0 2024-02-22T00:33:13.606 INFO:tasks.workunit.client.1.smithi161.stdout:7/47: creat d3/f17 x:0 0 0 2024-02-22T00:33:13.608 INFO:tasks.workunit.client.1.smithi161.stdout:7/48: rmdir d3/df 39 2024-02-22T00:33:13.608 INFO:tasks.workunit.client.1.smithi161.stdout:7/49: chown d3/dd/fe 7560 1 2024-02-22T00:33:13.609 INFO:tasks.workunit.client.1.smithi161.stdout:7/50: read - d3/f9 zero size 2024-02-22T00:33:13.609 INFO:tasks.workunit.client.1.smithi161.stdout:8/53: truncate f0 8164692 0 2024-02-22T00:33:13.609 INFO:tasks.workunit.client.1.smithi161.stdout:8/54: chown d1/l4 162408 1 2024-02-22T00:33:13.611 INFO:tasks.workunit.client.1.smithi161.stdout:7/51: mknod d3/df/c18 0 2024-02-22T00:33:13.612 INFO:tasks.workunit.client.1.smithi161.stdout:7/52: write d3/dd/fe [994541,115521] 0 2024-02-22T00:33:13.612 INFO:tasks.workunit.client.1.smithi161.stdout:8/55: link d1/f6 d1/fe 0 2024-02-22T00:33:13.614 INFO:tasks.workunit.client.1.smithi161.stdout:9/80: sync 2024-02-22T00:33:13.614 INFO:tasks.workunit.client.1.smithi161.stdout:5/125: sync 2024-02-22T00:33:13.614 INFO:tasks.workunit.client.1.smithi161.stdout:0/106: sync 2024-02-22T00:33:13.614 INFO:tasks.workunit.client.1.smithi161.stdout:1/41: sync 2024-02-22T00:33:13.614 INFO:tasks.workunit.client.1.smithi161.stdout:2/20: sync 2024-02-22T00:33:13.614 INFO:tasks.workunit.client.1.smithi161.stdout:4/72: sync 2024-02-22T00:33:13.614 INFO:tasks.workunit.client.1.smithi161.stdout:7/53: symlink d3/dd/l19 0 2024-02-22T00:33:13.617 INFO:tasks.workunit.client.1.smithi161.stdout:8/56: chown d1/c7 72665 1 2024-02-22T00:33:13.618 INFO:tasks.workunit.client.1.smithi161.stdout:1/42: truncate fb 5023412 0 2024-02-22T00:33:13.619 INFO:tasks.workunit.client.1.smithi161.stdout:9/81: mknod d1/d5/c20 0 2024-02-22T00:33:13.620 INFO:tasks.workunit.client.1.smithi161.stdout:8/57: creat d1/ff x:0 0 0 2024-02-22T00:33:13.625 INFO:tasks.workunit.client.1.smithi161.stdout:9/82: chown d1/d2/fd 52419 1 2024-02-22T00:33:13.626 INFO:tasks.workunit.client.1.smithi161.stdout:5/126: write d3/f19 [17033,13129] 0 2024-02-22T00:33:13.627 INFO:tasks.workunit.client.1.smithi161.stdout:8/58: creat d1/d8/f10 x:0 0 0 2024-02-22T00:33:13.628 INFO:tasks.workunit.client.1.smithi161.stdout:0/107: dread fa [0,4194304] 0 2024-02-22T00:33:13.629 INFO:tasks.workunit.client.1.smithi161.stdout:5/127: chown d3 6539 1 2024-02-22T00:33:13.633 INFO:tasks.workunit.client.1.smithi161.stdout:9/83: dread d1/d2/f10 [0,4194304] 0 2024-02-22T00:33:13.634 INFO:tasks.workunit.client.1.smithi161.stdout:2/21: dread f0 [0,4194304] 0 2024-02-22T00:33:13.634 INFO:tasks.workunit.client.1.smithi161.stdout:7/54: dwrite d3/f9 [0,4194304] 0 2024-02-22T00:33:13.636 INFO:tasks.workunit.client.1.smithi161.stdout:4/73: dread d5/d8/f9 [0,4194304] 0 2024-02-22T00:33:13.637 INFO:tasks.workunit.client.1.smithi161.stdout:0/108: rename d14/d1a/f27 to d14/f2c 0 2024-02-22T00:33:13.637 INFO:tasks.workunit.client.1.smithi161.stdout:1/43: dread f5 [0,4194304] 0 2024-02-22T00:33:13.638 INFO:tasks.workunit.client.1.smithi161.stdout:1/44: rmdir - no directory 2024-02-22T00:33:13.639 INFO:tasks.workunit.client.1.smithi161.stdout:5/128: fdatasync d3/d1c/d20/f18 0 2024-02-22T00:33:13.640 INFO:tasks.workunit.client.1.smithi161.stdout:2/22: mknod c7 0 2024-02-22T00:33:13.641 INFO:tasks.workunit.client.1.smithi161.stdout:7/55: mknod d3/df/c1a 0 2024-02-22T00:33:13.642 INFO:tasks.workunit.client.1.smithi161.stdout:9/84: mkdir d1/d2/d4/d11/d21 0 2024-02-22T00:33:13.644 INFO:tasks.workunit.client.1.smithi161.stdout:4/74: creat d5/d10/f1d x:0 0 0 2024-02-22T00:33:13.645 INFO:tasks.workunit.client.1.smithi161.stdout:0/109: rename d14/f1c to d14/d1a/f2d 0 2024-02-22T00:33:13.645 INFO:tasks.workunit.client.1.smithi161.stdout:7/56: fsync d3/dd/fe 0 2024-02-22T00:33:13.646 INFO:tasks.workunit.client.1.smithi161.stdout:2/23: creat f8 x:0 0 0 2024-02-22T00:33:13.647 INFO:tasks.workunit.client.1.smithi161.stdout:8/59: dwrite d1/ff [0,4194304] 0 2024-02-22T00:33:13.648 INFO:tasks.workunit.client.1.smithi161.stdout:5/129: dread - d3/d1b/f1d zero size 2024-02-22T00:33:13.653 INFO:tasks.workunit.client.1.smithi161.stdout:2/24: chown f0 4117 1 2024-02-22T00:33:13.655 INFO:tasks.workunit.client.1.smithi161.stdout:4/75: creat d5/d17/f1e x:0 0 0 2024-02-22T00:33:13.657 INFO:tasks.workunit.client.1.smithi161.stdout:5/130: rename d3/d1c/d20/f18 to d3/d1b/d25/f27 0 2024-02-22T00:33:13.657 INFO:tasks.workunit.client.1.smithi161.stdout:8/60: creat d1/d8/f11 x:0 0 0 2024-02-22T00:33:13.658 INFO:tasks.workunit.client.1.smithi161.stdout:5/131: chown d3/d1b/d25/f23 4166633 1 2024-02-22T00:33:13.659 INFO:tasks.workunit.client.1.smithi161.stdout:2/25: rename f6 to f9 0 2024-02-22T00:33:13.659 INFO:tasks.workunit.client.1.smithi161.stdout:2/26: stat f2 0 2024-02-22T00:33:13.661 INFO:tasks.workunit.client.1.smithi161.stdout:7/57: creat d3/f1b x:0 0 0 2024-02-22T00:33:13.662 INFO:tasks.workunit.client.1.smithi161.stdout:7/58: rename d3/dd to d3/dd/d1c 22 2024-02-22T00:33:13.663 INFO:tasks.workunit.client.1.smithi161.stdout:8/61: unlink d1/fe 0 2024-02-22T00:33:13.670 INFO:tasks.workunit.client.1.smithi161.stdout:7/59: creat d3/dd/f1d x:0 0 0 2024-02-22T00:33:13.670 INFO:tasks.workunit.client.1.smithi161.stdout:1/45: write f2 [5736441,15818] 0 2024-02-22T00:33:13.670 INFO:tasks.workunit.client.1.smithi161.stdout:9/85: write d1/d2/f10 [1039137,46327] 0 2024-02-22T00:33:13.673 INFO:tasks.workunit.client.1.smithi161.stdout:4/76: write d5/f13 [188400,35830] 0 2024-02-22T00:33:13.674 INFO:tasks.workunit.client.1.smithi161.stdout:7/60: chown d3/df/c1a 0 1 2024-02-22T00:33:13.675 INFO:tasks.workunit.client.1.smithi161.stdout:5/132: write d3/f26 [3569055,4314] 0 2024-02-22T00:33:13.676 INFO:tasks.workunit.client.1.smithi161.stdout:2/27: read - f9 zero size 2024-02-22T00:33:13.676 INFO:tasks.workunit.client.1.smithi161.stdout:4/77: chown l4 0 1 2024-02-22T00:33:13.677 INFO:tasks.workunit.client.1.smithi161.stdout:9/86: symlink d1/d2/d4/d1f/l22 0 2024-02-22T00:33:13.678 INFO:tasks.workunit.client.1.smithi161.stdout:2/28: stat f2 0 2024-02-22T00:33:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:12.224422+0000 mgr.smithi161.sazlam (mgr.24369) 21 : audit [DBG] from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:12.625170+0000 mgr.smithi161.sazlam (mgr.24369) 22 : audit [DBG] from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:13 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:13.070844+0000 mon.smithi161 (mon.1) 56 : audit [DBG] from='client.? 172.21.15.49:0/1652499633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:33:13.690 INFO:tasks.workunit.client.1.smithi161.stdout:8/62: dread d1/ff [0,4194304] 0 2024-02-22T00:33:13.692 INFO:tasks.workunit.client.1.smithi161.stdout:7/61: rename d3/df/c1a to d3/df/c1e 0 2024-02-22T00:33:13.693 INFO:tasks.workunit.client.1.smithi161.stdout:0/110: dwrite d14/d1a/f28 [0,4194304] 0 2024-02-22T00:33:13.693 INFO:tasks.workunit.client.1.smithi161.stdout:4/78: creat d5/d10/f1f x:0 0 0 2024-02-22T00:33:13.693 INFO:tasks.workunit.client.1.smithi161.stdout:7/62: read - d3/f17 zero size 2024-02-22T00:33:13.695 INFO:tasks.workunit.client.1.smithi161.stdout:7/63: fsync d3/dd/f1d 0 2024-02-22T00:33:13.696 INFO:tasks.workunit.client.1.smithi161.stdout:7/64: chown c0 89 1 2024-02-22T00:33:13.696 INFO:tasks.workunit.client.1.smithi161.stdout:8/63: rename d1/d8/fc to d1/f12 0 2024-02-22T00:33:13.700 INFO:tasks.workunit.client.1.smithi161.stdout:7/65: dread d3/f7 [4194304,4194304] 0 2024-02-22T00:33:13.701 INFO:tasks.workunit.client.1.smithi161.stdout:4/79: creat d5/d10/d14/f20 x:0 0 0 2024-02-22T00:33:13.705 INFO:tasks.workunit.client.1.smithi161.stdout:8/64: mknod d1/d8/c13 0 2024-02-22T00:33:13.707 INFO:tasks.workunit.client.1.smithi161.stdout:7/66: rmdir d3/df 39 2024-02-22T00:33:13.708 INFO:tasks.workunit.client.1.smithi161.stdout:8/65: symlink d1/l14 0 2024-02-22T00:33:13.709 INFO:tasks.workunit.client.1.smithi161.stdout:7/67: rename d3/dd to d3/dd/d1f 22 2024-02-22T00:33:13.710 INFO:tasks.workunit.client.1.smithi161.stdout:9/87: dwrite d1/d2/fd [0,4194304] 0 2024-02-22T00:33:13.712 INFO:tasks.workunit.client.1.smithi161.stdout:5/133: truncate d3/f26 2386837 0 2024-02-22T00:33:13.713 INFO:tasks.workunit.client.1.smithi161.stdout:7/68: dread - d3/dd/f1d zero size 2024-02-22T00:33:13.715 INFO:tasks.workunit.client.1.smithi161.stdout:8/66: creat d1/d8/f15 x:0 0 0 2024-02-22T00:33:13.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/80: write f2 [847039,65971] 0 2024-02-22T00:33:13.718 INFO:tasks.workunit.client.1.smithi161.stdout:0/111: dwrite fa [0,4194304] 0 2024-02-22T00:33:13.719 INFO:tasks.workunit.client.1.smithi161.stdout:9/88: mkdir d1/d2/d4/d11/d21/d23 0 2024-02-22T00:33:13.720 INFO:tasks.workunit.client.1.smithi161.stdout:4/81: rmdir d5/d8 39 2024-02-22T00:33:13.720 INFO:tasks.workunit.client.1.smithi161.stdout:9/89: readlink d1/l3 0 2024-02-22T00:33:13.720 INFO:tasks.workunit.client.1.smithi161.stdout:4/82: stat f0 0 2024-02-22T00:33:13.721 INFO:tasks.workunit.client.1.smithi161.stdout:0/112: symlink d14/d1a/l2e 0 2024-02-22T00:33:13.721 INFO:tasks.workunit.client.1.smithi161.stdout:4/83: stat d5/d17/f1e 0 2024-02-22T00:33:13.722 INFO:tasks.workunit.client.1.smithi161.stdout:7/69: chown d3/df/l12 137 1 2024-02-22T00:33:13.725 INFO:tasks.workunit.client.1.smithi161.stdout:7/70: dread - d3/f17 zero size 2024-02-22T00:33:13.726 INFO:tasks.workunit.client.1.smithi161.stdout:0/113: read d14/f17 [860135,125665] 0 2024-02-22T00:33:13.727 INFO:tasks.workunit.client.1.smithi161.stdout:4/84: symlink d5/l21 0 2024-02-22T00:33:13.727 INFO:tasks.workunit.client.1.smithi161.stdout:8/67: dread f0 [0,4194304] 0 2024-02-22T00:33:13.727 INFO:tasks.workunit.client.1.smithi161.stdout:0/114: chown c6 16790097 1 2024-02-22T00:33:13.731 INFO:tasks.workunit.client.1.smithi161.stdout:7/71: symlink d3/l20 0 2024-02-22T00:33:13.731 INFO:tasks.workunit.client.1.smithi161.stdout:5/134: write d3/d1b/d25/f23 [319294,9152] 0 2024-02-22T00:33:13.732 INFO:tasks.workunit.client.1.smithi161.stdout:4/85: readlink d5/d8/ld 0 2024-02-22T00:33:13.732 INFO:tasks.workunit.client.1.smithi161.stdout:0/115: read - d14/d1a/f24 zero size 2024-02-22T00:33:13.735 INFO:tasks.workunit.client.1.smithi161.stdout:8/68: rename d1/d8/fb to d1/d8/f16 0 2024-02-22T00:33:13.737 INFO:tasks.workunit.client.1.smithi161.stdout:9/90: rename d1/d2/d4/d1f/l22 to d1/d5/l24 0 2024-02-22T00:33:13.738 INFO:tasks.workunit.client.1.smithi161.stdout:5/135: mknod d3/d1c/d20/c28 0 2024-02-22T00:33:13.741 INFO:tasks.workunit.client.1.smithi161.stdout:8/69: mknod d1/c17 0 2024-02-22T00:33:13.742 INFO:tasks.workunit.client.1.smithi161.stdout:8/70: chown d1/l14 164 1 2024-02-22T00:33:13.743 INFO:tasks.workunit.client.1.smithi161.stdout:9/91: fdatasync d1/d2/d7/da/f13 0 2024-02-22T00:33:13.747 INFO:tasks.workunit.client.1.smithi161.stdout:0/116: write fd [4632476,105410] 0 2024-02-22T00:33:13.749 INFO:tasks.workunit.client.1.smithi161.stdout:9/92: mkdir d1/d25 0 2024-02-22T00:33:13.750 INFO:tasks.workunit.client.1.smithi161.stdout:5/136: mkdir d3/d29 0 2024-02-22T00:33:13.751 INFO:tasks.workunit.client.1.smithi161.stdout:7/72: getdents d3/df 0 2024-02-22T00:33:13.752 INFO:tasks.workunit.client.1.smithi161.stdout:0/117: symlink d14/l2f 0 2024-02-22T00:33:13.754 INFO:tasks.workunit.client.1.smithi161.stdout:5/137: write d3/fe [2368466,69370] 0 2024-02-22T00:33:13.755 INFO:tasks.workunit.client.1.smithi161.stdout:8/71: getdents d1/d8 0 2024-02-22T00:33:13.756 INFO:tasks.workunit.client.1.smithi161.stdout:4/86: dwrite d5/fe [0,4194304] 0 2024-02-22T00:33:13.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/118: symlink d14/d1a/l30 0 2024-02-22T00:33:13.758 INFO:tasks.workunit.client.1.smithi161.stdout:5/138: dread - d3/d1b/f1d zero size 2024-02-22T00:33:13.758 INFO:tasks.workunit.client.1.smithi161.stdout:9/93: truncate d1/d2/d7/da/f17 619223 0 2024-02-22T00:33:13.763 INFO:tasks.workunit.client.1.smithi161.stdout:8/72: rmdir d1 39 2024-02-22T00:33:13.764 INFO:tasks.workunit.client.1.smithi161.stdout:0/119: symlink d14/d1a/l31 0 2024-02-22T00:33:13.765 INFO:tasks.workunit.client.1.smithi161.stdout:9/94: truncate d1/d5/d9/f18 87491 0 2024-02-22T00:33:13.767 INFO:tasks.workunit.client.1.smithi161.stdout:7/73: link d3/dd/l15 d3/df/l21 0 2024-02-22T00:33:13.769 INFO:tasks.workunit.client.1.smithi161.stdout:5/139: mknod d3/c2a 0 2024-02-22T00:33:13.770 INFO:tasks.workunit.client.1.smithi161.stdout:9/95: truncate d1/d2/f10 1664717 0 2024-02-22T00:33:13.771 INFO:tasks.workunit.client.1.smithi161.stdout:8/73: fdatasync d1/ff 0 2024-02-22T00:33:13.773 INFO:tasks.workunit.client.1.smithi161.stdout:5/140: fsync d3/f15 0 2024-02-22T00:33:13.773 INFO:tasks.workunit.client.1.smithi161.stdout:4/87: dwrite d5/d10/f1f [0,4194304] 0 2024-02-22T00:33:13.777 INFO:tasks.workunit.client.1.smithi161.stdout:7/74: link d3/f17 d3/f22 0 2024-02-22T00:33:13.777 INFO:tasks.workunit.client.1.smithi161.stdout:0/120: dread d14/f2c [0,4194304] 0 2024-02-22T00:33:13.780 INFO:tasks.workunit.client.1.smithi161.stdout:5/141: fsync d3/fc 0 2024-02-22T00:33:13.782 INFO:tasks.workunit.client.1.smithi161.stdout:5/142: chown d3/d1b/d25/f27 3 1 2024-02-22T00:33:13.782 INFO:tasks.workunit.client.1.smithi161.stdout:4/88: rename d5/c1a to d5/d10/c22 0 2024-02-22T00:33:13.787 INFO:tasks.workunit.client.1.smithi161.stdout:8/74: dwrite d1/d8/f16 [0,4194304] 0 2024-02-22T00:33:13.789 INFO:tasks.workunit.client.1.smithi161.stdout:8/75: truncate d1/d8/f10 994312 0 2024-02-22T00:33:13.790 INFO:tasks.workunit.client.1.smithi161.stdout:8/76: dread - d1/f12 zero size 2024-02-22T00:33:13.792 INFO:tasks.workunit.client.1.smithi161.stdout:5/143: dread d3/f5 [0,4194304] 0 2024-02-22T00:33:13.792 INFO:tasks.workunit.client.1.smithi161.stdout:7/75: link d3/lc d3/dd/l23 0 2024-02-22T00:33:13.793 INFO:tasks.workunit.client.1.smithi161.stdout:7/76: fsync d3/f14 0 2024-02-22T00:33:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:12.224422+0000 mgr.smithi161.sazlam (mgr.24369) 21 : audit [DBG] from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:12.625170+0000 mgr.smithi161.sazlam (mgr.24369) 22 : audit [DBG] from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:13.070844+0000 mon.smithi161 (mon.1) 56 : audit [DBG] from='client.? 172.21.15.49:0/1652499633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:33:13.796 INFO:tasks.workunit.client.1.smithi161.stdout:8/77: mkdir d1/d8/d18 0 2024-02-22T00:33:13.800 INFO:tasks.workunit.client.1.smithi161.stdout:5/144: rename l1 to d3/d1b/d25/l2b 0 2024-02-22T00:33:13.805 INFO:tasks.workunit.client.1.smithi161.stdout:8/78: dread d1/ff [0,4194304] 0 2024-02-22T00:33:13.805 INFO:tasks.workunit.client.1.smithi161.stdout:4/89: truncate d5/fe 2511967 0 2024-02-22T00:33:13.807 INFO:tasks.workunit.client.1.smithi161.stdout:7/77: truncate f2 4705929 0 2024-02-22T00:33:13.809 INFO:tasks.workunit.client.1.smithi161.stdout:8/79: write d1/d8/f15 [18363,131028] 0 2024-02-22T00:33:13.809 INFO:tasks.workunit.client.1.smithi161.stdout:4/90: fsync f0 0 2024-02-22T00:33:13.811 INFO:tasks.workunit.client.1.smithi161.stdout:0/121: dwrite d14/d1a/f1b [0,4194304] 0 2024-02-22T00:33:13.811 INFO:tasks.workunit.client.1.smithi161.stdout:7/78: read d3/f9 [2929841,117503] 0 2024-02-22T00:33:13.811 INFO:tasks.workunit.client.1.smithi161.stdout:8/80: chown d1/ff 66640489 1 2024-02-22T00:33:13.819 INFO:tasks.workunit.client.1.smithi161.stdout:5/145: write d3/f26 [826395,103645] 0 2024-02-22T00:33:13.819 INFO:tasks.workunit.client.1.smithi161.stdout:8/81: rename d1/d8 to d1/d19 0 2024-02-22T00:33:13.822 INFO:tasks.workunit.client.1.smithi161.stdout:5/146: stat d3/d1b/d25/c21 0 2024-02-22T00:33:13.824 INFO:tasks.workunit.client.1.smithi161.stdout:8/82: unlink d1/cd 0 2024-02-22T00:33:13.824 INFO:tasks.workunit.client.1.smithi161.stdout:4/91: dread d5/f6 [0,4194304] 0 2024-02-22T00:33:13.825 INFO:tasks.workunit.client.1.smithi161.stdout:0/122: dwrite fa [0,4194304] 0 2024-02-22T00:33:13.827 INFO:tasks.workunit.client.1.smithi161.stdout:4/92: read - d5/f7 zero size 2024-02-22T00:33:13.830 INFO:tasks.workunit.client.1.smithi161.stdout:0/123: rename d14/d29/l2b to d14/d29/l32 0 2024-02-22T00:33:13.832 INFO:tasks.workunit.client.1.smithi161.stdout:4/93: creat d5/d10/d14/f23 x:0 0 0 2024-02-22T00:33:13.836 INFO:tasks.workunit.client.1.smithi161.stdout:4/94: truncate d5/f6 1622894 0 2024-02-22T00:33:13.839 INFO:tasks.workunit.client.1.smithi161.stdout:4/95: mkdir d5/d10/d14/d24 0 2024-02-22T00:33:13.841 INFO:tasks.workunit.client.1.smithi161.stdout:4/96: stat d5/d10/d14/f20 0 2024-02-22T00:33:13.842 INFO:tasks.workunit.client.1.smithi161.stdout:7/79: dwrite f2 [0,4194304] 0 2024-02-22T00:33:13.846 INFO:tasks.workunit.client.1.smithi161.stdout:4/97: write d5/f13 [889851,49563] 0 2024-02-22T00:33:13.848 INFO:tasks.workunit.client.1.smithi161.stdout:5/147: dwrite d3/f5 [4194304,4194304] 0 2024-02-22T00:33:13.849 INFO:tasks.workunit.client.1.smithi161.stdout:7/80: fdatasync d3/f17 0 2024-02-22T00:33:13.850 INFO:tasks.workunit.client.1.smithi161.stdout:4/98: dread - d5/f7 zero size 2024-02-22T00:33:13.855 INFO:tasks.workunit.client.1.smithi161.stdout:5/148: truncate d3/f24 797847 0 2024-02-22T00:33:13.855 INFO:tasks.workunit.client.1.smithi161.stdout:7/81: mkdir d3/dd/d24 0 2024-02-22T00:33:13.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/124: dwrite d14/d1a/f26 [0,4194304] 0 2024-02-22T00:33:13.861 INFO:tasks.workunit.client.1.smithi161.stdout:7/82: write d3/fa [964818,37102] 0 2024-02-22T00:33:13.863 INFO:tasks.workunit.client.1.smithi161.stdout:0/125: mknod d14/c33 0 2024-02-22T00:33:13.865 INFO:tasks.workunit.client.1.smithi161.stdout:5/149: dread d3/fe [0,4194304] 0 2024-02-22T00:33:13.865 INFO:tasks.workunit.client.1.smithi161.stdout:4/99: link d5/l15 d5/d10/d14/l25 0 2024-02-22T00:33:13.866 INFO:tasks.workunit.client.1.smithi161.stdout:7/83: mkdir d3/dd/d25 0 2024-02-22T00:33:13.868 INFO:tasks.workunit.client.1.smithi161.stdout:5/150: rmdir d3/d1b 39 2024-02-22T00:33:13.869 INFO:tasks.workunit.client.1.smithi161.stdout:5/151: fsync d3/f24 0 2024-02-22T00:33:13.872 INFO:tasks.workunit.client.1.smithi161.stdout:0/126: rename d14/d1a/l21 to d14/d29/l34 0 2024-02-22T00:33:13.873 INFO:tasks.workunit.client.1.smithi161.stdout:5/152: chown d3/d1b/d25/c21 94364 1 2024-02-22T00:33:13.874 INFO:tasks.workunit.client.1.smithi161.stdout:0/127: creat d14/f35 x:0 0 0 2024-02-22T00:33:13.876 INFO:tasks.workunit.client.1.smithi161.stdout:0/128: symlink d14/d1a/l36 0 2024-02-22T00:33:13.877 INFO:tasks.workunit.client.1.smithi161.stdout:0/129: readlink d14/d29/l32 0 2024-02-22T00:33:13.878 INFO:tasks.workunit.client.1.smithi161.stdout:0/130: fdatasync d14/d1a/f28 0 2024-02-22T00:33:13.880 INFO:tasks.workunit.client.1.smithi161.stdout:0/131: mkdir d14/d37 0 2024-02-22T00:33:13.882 INFO:tasks.workunit.client.1.smithi161.stdout:0/132: dread - d14/d1a/f2d zero size 2024-02-22T00:33:13.886 INFO:tasks.workunit.client.1.smithi161.stdout:5/153: write d3/fc [349467,73032] 0 2024-02-22T00:33:13.892 INFO:tasks.workunit.client.1.smithi161.stdout:0/133: truncate fd 1385591 0 2024-02-22T00:33:13.893 INFO:tasks.workunit.client.1.smithi161.stdout:5/154: write d3/d1b/d25/f27 [897319,53783] 0 2024-02-22T00:33:13.893 INFO:tasks.workunit.client.1.smithi161.stdout:7/84: dwrite d3/f17 [0,4194304] 0 2024-02-22T00:33:13.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/155: chown d3/d1b/d25/f27 18734 1 2024-02-22T00:33:13.895 INFO:tasks.workunit.client.1.smithi161.stdout:0/134: rmdir d14 39 2024-02-22T00:33:13.896 INFO:tasks.workunit.client.1.smithi161.stdout:5/156: fdatasync d3/f1a 0 2024-02-22T00:33:13.896 INFO:tasks.workunit.client.1.smithi161.stdout:5/157: stat d3/ca 0 2024-02-22T00:33:13.899 INFO:tasks.workunit.client.1.smithi161.stdout:0/135: chown d14/l20 24307 1 2024-02-22T00:33:13.902 INFO:tasks.workunit.client.1.smithi161.stdout:0/136: rmdir d14 39 2024-02-22T00:33:13.906 INFO:tasks.workunit.client.1.smithi161.stdout:0/137: creat d14/d1a/f38 x:0 0 0 2024-02-22T00:33:13.907 INFO:tasks.workunit.client.1.smithi161.stdout:5/158: link d3/d1c/d20/c16 d3/d1b/c2c 0 2024-02-22T00:33:13.912 INFO:tasks.workunit.client.1.smithi161.stdout:5/159: link d3/f24 d3/d1c/f2d 0 2024-02-22T00:33:13.913 INFO:tasks.workunit.client.1.smithi161.stdout:7/85: truncate d3/f14 3378603 0 2024-02-22T00:33:13.914 INFO:tasks.workunit.client.1.smithi161.stdout:0/138: link l13 d14/d37/l39 0 2024-02-22T00:33:13.916 INFO:tasks.workunit.client.1.smithi161.stdout:5/160: symlink d3/d29/l2e 0 2024-02-22T00:33:13.917 INFO:tasks.workunit.client.1.smithi161.stdout:7/86: mkdir d3/dd/d24/d26 0 2024-02-22T00:33:13.921 INFO:tasks.workunit.client.1.smithi161.stdout:0/139: link d14/d29/l34 d14/d1a/l3a 0 2024-02-22T00:33:13.927 INFO:tasks.workunit.client.1.smithi161.stdout:0/140: dread d14/f1f [0,4194304] 0 2024-02-22T00:33:13.931 INFO:tasks.workunit.client.1.smithi161.stdout:0/141: dread fa [0,4194304] 0 2024-02-22T00:33:13.932 INFO:tasks.workunit.client.1.smithi161.stdout:0/142: symlink d14/d1a/l3b 0 2024-02-22T00:33:13.933 INFO:tasks.workunit.client.1.smithi161.stdout:0/143: fdatasync d14/d1a/f28 0 2024-02-22T00:33:13.935 INFO:tasks.workunit.client.1.smithi161.stdout:7/87: dwrite d3/f14 [0,4194304] 0 2024-02-22T00:33:13.935 INFO:tasks.workunit.client.1.smithi161.stdout:0/144: write d14/d1a/f38 [518173,112857] 0 2024-02-22T00:33:13.941 INFO:tasks.workunit.client.1.smithi161.stdout:7/88: dwrite d3/f17 [0,4194304] 0 2024-02-22T00:33:13.941 INFO:tasks.workunit.client.1.smithi161.stdout:0/145: dread d14/d1a/f26 [0,4194304] 0 2024-02-22T00:33:13.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/7: sync 2024-02-22T00:33:13.944 INFO:tasks.workunit.client.1.smithi161.stdout:6/8: chown f0 4 1 2024-02-22T00:33:13.947 INFO:tasks.workunit.client.1.smithi161.stdout:0/146: symlink d14/d1a/l3c 0 2024-02-22T00:33:13.948 INFO:tasks.workunit.client.1.smithi161.stdout:7/89: dread d3/f17 [0,4194304] 0 2024-02-22T00:33:13.950 INFO:tasks.workunit.client.1.smithi161.stdout:0/147: dread - d14/f25 zero size 2024-02-22T00:33:13.952 INFO:tasks.workunit.client.1.smithi161.stdout:6/9: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.953 INFO:tasks.workunit.client.1.smithi161.stdout:7/90: link d3/fa d3/dd/d25/f27 0 2024-02-22T00:33:13.954 INFO:tasks.workunit.client.1.smithi161.stdout:6/10: mknod c1 0 2024-02-22T00:33:13.956 INFO:tasks.workunit.client.1.smithi161.stdout:6/11: write f0 [4343293,67519] 0 2024-02-22T00:33:13.957 INFO:tasks.workunit.client.1.smithi161.stdout:7/91: rename d3/dd/f13 to d3/dd/d24/f28 0 2024-02-22T00:33:13.958 INFO:tasks.workunit.client.1.smithi161.stdout:0/148: dread d14/f19 [0,4194304] 0 2024-02-22T00:33:13.959 INFO:tasks.workunit.client.1.smithi161.stdout:0/149: chown d14/d1a/f2d 606567 1 2024-02-22T00:33:13.961 INFO:tasks.workunit.client.1.smithi161.stdout:0/150: write d14/f35 [100993,48136] 0 2024-02-22T00:33:13.965 INFO:tasks.workunit.client.1.smithi161.stdout:0/151: creat d14/d1a/f3d x:0 0 0 2024-02-22T00:33:13.968 INFO:tasks.workunit.client.1.smithi161.stdout:6/12: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.971 INFO:tasks.workunit.client.1.smithi161.stdout:7/92: dwrite d3/dd/f1d [0,4194304] 0 2024-02-22T00:33:13.972 INFO:tasks.workunit.client.1.smithi161.stdout:7/93: readlink d3/df/l12 0 2024-02-22T00:33:13.975 INFO:tasks.workunit.client.1.smithi161.stdout:7/94: fsync d3/dd/fe 0 2024-02-22T00:33:13.976 INFO:tasks.workunit.client.1.smithi161.stdout:7/95: stat d3/f9 0 2024-02-22T00:33:13.984 INFO:tasks.workunit.client.1.smithi161.stdout:0/152: dwrite d14/f17 [0,4194304] 0 2024-02-22T00:33:13.986 INFO:tasks.workunit.client.1.smithi161.stdout:0/153: chown fb 20786702 1 2024-02-22T00:33:13.987 INFO:tasks.workunit.client.1.smithi161.stdout:6/13: dwrite f0 [0,4194304] 0 2024-02-22T00:33:13.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/14: creat f2 x:0 0 0 2024-02-22T00:33:13.990 INFO:tasks.workunit.client.1.smithi161.stdout:6/15: readlink - no filename 2024-02-22T00:33:13.991 INFO:tasks.workunit.client.1.smithi161.stdout:6/16: write f0 [4962059,43826] 0 2024-02-22T00:33:13.998 INFO:tasks.workunit.client.1.smithi161.stdout:0/154: dread d14/d1a/f26 [0,4194304] 0 2024-02-22T00:33:14.005 INFO:tasks.workunit.client.1.smithi161.stdout:7/96: dwrite d3/fa [0,4194304] 0 2024-02-22T00:33:14.008 INFO:tasks.workunit.client.1.smithi161.stdout:7/97: write d3/f7 [616994,9588] 0 2024-02-22T00:33:14.012 INFO:tasks.workunit.client.1.smithi161.stdout:0/155: dwrite d14/f17 [0,4194304] 0 2024-02-22T00:33:14.014 INFO:tasks.workunit.client.1.smithi161.stdout:6/17: dread f0 [4194304,4194304] 0 2024-02-22T00:33:14.014 INFO:tasks.workunit.client.1.smithi161.stdout:7/98: creat d3/dd/d24/d26/f29 x:0 0 0 2024-02-22T00:33:14.015 INFO:tasks.workunit.client.1.smithi161.stdout:0/156: symlink d14/d29/l3e 0 2024-02-22T00:33:14.016 INFO:tasks.workunit.client.1.smithi161.stdout:7/99: read d3/dd/d24/f28 [3136456,117705] 0 2024-02-22T00:33:14.019 INFO:tasks.workunit.client.1.smithi161.stdout:7/100: unlink d3/dd/l19 0 2024-02-22T00:33:14.021 INFO:tasks.workunit.client.1.smithi161.stdout:7/101: write d3/dd/d24/d26/f29 [591578,95908] 0 2024-02-22T00:33:14.024 INFO:tasks.workunit.client.1.smithi161.stdout:7/102: dread - d3/f1b zero size 2024-02-22T00:33:14.026 INFO:tasks.workunit.client.1.smithi161.stdout:6/18: dwrite f0 [4194304,4194304] 0 2024-02-22T00:33:14.027 INFO:tasks.workunit.client.1.smithi161.stdout:6/19: write f0 [1286587,58397] 0 2024-02-22T00:33:14.028 INFO:tasks.workunit.client.1.smithi161.stdout:7/103: mknod d3/dd/c2a 0 2024-02-22T00:33:14.029 INFO:tasks.workunit.client.1.smithi161.stdout:6/20: write f2 [638561,123329] 0 2024-02-22T00:33:14.032 INFO:tasks.workunit.client.1.smithi161.stdout:7/104: creat d3/f2b x:0 0 0 2024-02-22T00:33:14.037 INFO:tasks.workunit.client.1.smithi161.stdout:7/105: creat d3/dd/d25/f2c x:0 0 0 2024-02-22T00:33:14.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/106: chown d3/f7 3 1 2024-02-22T00:33:14.041 INFO:tasks.workunit.client.1.smithi161.stdout:7/107: unlink d3/f22 0 2024-02-22T00:33:14.041 INFO:tasks.workunit.client.1.smithi161.stdout:6/21: dwrite f2 [0,4194304] 0 2024-02-22T00:33:14.044 INFO:tasks.workunit.client.1.smithi161.stdout:6/22: mkdir d3 0 2024-02-22T00:33:14.045 INFO:tasks.workunit.client.1.smithi161.stdout:6/23: write f0 [7904863,80162] 0 2024-02-22T00:33:14.046 INFO:tasks.workunit.client.1.smithi161.stdout:7/108: link d3/f7 d3/dd/d24/d26/f2d 0 2024-02-22T00:33:14.056 INFO:tasks.workunit.client.1.smithi161.stdout:6/24: dwrite f0 [4194304,4194304] 0 2024-02-22T00:33:14.057 INFO:tasks.workunit.client.1.smithi161.stdout:7/109: dwrite d3/dd/d25/f27 [0,4194304] 0 2024-02-22T00:33:14.065 INFO:tasks.workunit.client.1.smithi161.stdout:6/25: dwrite f0 [4194304,4194304] 0 2024-02-22T00:33:14.067 INFO:tasks.workunit.client.1.smithi161.stdout:6/26: write f2 [1051092,63759] 0 2024-02-22T00:33:14.074 INFO:tasks.workunit.client.1.smithi161.stdout:6/27: dwrite f2 [0,4194304] 0 2024-02-22T00:33:14.075 INFO:tasks.workunit.client.1.smithi161.stdout:6/28: chown f2 45 1 2024-02-22T00:33:14.076 INFO:tasks.workunit.client.1.smithi161.stdout:6/29: write f0 [5621102,72648] 0 2024-02-22T00:33:14.077 INFO:tasks.workunit.client.1.smithi161.stdout:3/19: sync 2024-02-22T00:33:14.077 INFO:tasks.workunit.client.1.smithi161.stdout:2/29: sync 2024-02-22T00:33:14.077 INFO:tasks.workunit.client.1.smithi161.stdout:1/46: sync 2024-02-22T00:33:14.077 INFO:tasks.workunit.client.1.smithi161.stdout:9/96: sync 2024-02-22T00:33:14.078 INFO:tasks.workunit.client.1.smithi161.stdout:3/20: write f7 [969826,85035] 0 2024-02-22T00:33:14.079 INFO:tasks.workunit.client.1.smithi161.stdout:2/30: creat fa x:0 0 0 2024-02-22T00:33:14.080 INFO:tasks.workunit.client.1.smithi161.stdout:3/21: chown c4 104 1 2024-02-22T00:33:14.082 INFO:tasks.workunit.client.1.smithi161.stdout:9/97: dread d1/d2/d7/f16 [0,4194304] 0 2024-02-22T00:33:14.082 INFO:tasks.workunit.client.1.smithi161.stdout:2/31: symlink lb 0 2024-02-22T00:33:14.082 INFO:tasks.workunit.client.1.smithi161.stdout:6/30: mknod d3/c4 0 2024-02-22T00:33:14.083 INFO:tasks.workunit.client.1.smithi161.stdout:2/32: dread - fa zero size 2024-02-22T00:33:14.084 INFO:tasks.workunit.client.1.smithi161.stdout:3/22: write f2 [4492410,35511] 0 2024-02-22T00:33:14.085 INFO:tasks.workunit.client.1.smithi161.stdout:2/33: unlink f0 0 2024-02-22T00:33:14.086 INFO:tasks.workunit.client.1.smithi161.stdout:2/34: rmdir - no directory 2024-02-22T00:33:14.087 INFO:tasks.workunit.client.1.smithi161.stdout:3/23: symlink l8 0 2024-02-22T00:33:14.088 INFO:tasks.workunit.client.1.smithi161.stdout:7/110: fdatasync d3/dd/d25/f27 0 2024-02-22T00:33:14.088 INFO:tasks.workunit.client.1.smithi161.stdout:2/35: rename f9 to fc 0 2024-02-22T00:33:14.089 INFO:tasks.workunit.client.1.smithi161.stdout:7/111: write d3/f1b [846814,1724] 0 2024-02-22T00:33:14.095 INFO:tasks.workunit.client.1.smithi161.stdout:1/47: write fa [721849,6202] 0 2024-02-22T00:33:14.096 INFO:tasks.workunit.client.1.smithi161.stdout:7/112: truncate d3/f7 4869262 0 2024-02-22T00:33:14.097 INFO:tasks.workunit.client.1.smithi161.stdout:6/31: getdents d3 0 2024-02-22T00:33:14.097 INFO:tasks.workunit.client.1.smithi161.stdout:9/98: write d1/d2/f1a [332915,77462] 0 2024-02-22T00:33:14.099 INFO:tasks.workunit.client.1.smithi161.stdout:3/24: dread f0 [0,4194304] 0 2024-02-22T00:33:14.099 INFO:tasks.workunit.client.1.smithi161.stdout:1/48: rename l6 to lf 0 2024-02-22T00:33:14.101 INFO:tasks.workunit.client.1.smithi161.stdout:7/113: symlink d3/dd/d24/d26/l2e 0 2024-02-22T00:33:14.102 INFO:tasks.workunit.client.1.smithi161.stdout:2/36: getdents . 0 2024-02-22T00:33:14.102 INFO:tasks.workunit.client.1.smithi161.stdout:6/32: mkdir d3/d5 0 2024-02-22T00:33:14.103 INFO:tasks.workunit.client.1.smithi161.stdout:3/25: rename l3 to l9 0 2024-02-22T00:33:14.107 INFO:tasks.workunit.client.1.smithi161.stdout:3/26: chown f0 93480654 1 2024-02-22T00:33:14.107 INFO:tasks.workunit.client.1.smithi161.stdout:7/114: symlink d3/l2f 0 2024-02-22T00:33:14.111 INFO:tasks.workunit.client.1.smithi161.stdout:3/27: mkdir da 0 2024-02-22T00:33:14.113 INFO:tasks.workunit.client.1.smithi161.stdout:7/115: mkdir d3/dd/d24/d26/d30 0 2024-02-22T00:33:14.113 INFO:tasks.workunit.client.1.smithi161.stdout:1/49: write f5 [3147267,42877] 0 2024-02-22T00:33:14.114 INFO:tasks.workunit.client.1.smithi161.stdout:6/33: getdents d3 0 2024-02-22T00:33:14.117 INFO:tasks.workunit.client.1.smithi161.stdout:7/116: write d3/fa [987743,55336] 0 2024-02-22T00:33:14.117 INFO:tasks.workunit.client.1.smithi161.stdout:3/28: dread f0 [0,4194304] 0 2024-02-22T00:33:14.118 INFO:tasks.workunit.client.1.smithi161.stdout:2/37: write f4 [394899,92036] 0 2024-02-22T00:33:14.118 INFO:tasks.workunit.client.1.smithi161.stdout:6/34: chown c1 126387030 1 2024-02-22T00:33:14.122 INFO:tasks.workunit.client.1.smithi161.stdout:3/29: symlink da/lb 0 2024-02-22T00:33:14.123 INFO:tasks.workunit.client.1.smithi161.stdout:7/117: symlink d3/dd/d25/l31 0 2024-02-22T00:33:14.127 INFO:tasks.workunit.client.1.smithi161.stdout:9/99: dwrite d1/d2/d4/d11/f1c [0,4194304] 0 2024-02-22T00:33:14.128 INFO:tasks.workunit.client.1.smithi161.stdout:2/38: link fc fd 0 2024-02-22T00:33:14.128 INFO:tasks.workunit.client.1.smithi161.stdout:2/39: rmdir - no directory 2024-02-22T00:33:14.130 INFO:tasks.workunit.client.1.smithi161.stdout:6/35: truncate f2 3901124 0 2024-02-22T00:33:14.132 INFO:tasks.workunit.client.1.smithi161.stdout:2/40: mkdir de 0 2024-02-22T00:33:14.135 INFO:tasks.workunit.client.1.smithi161.stdout:6/36: unlink c1 0 2024-02-22T00:33:14.137 INFO:tasks.workunit.client.1.smithi161.stdout:1/50: dwrite f7 [0,4194304] 0 2024-02-22T00:33:14.140 INFO:tasks.workunit.client.1.smithi161.stdout:7/118: truncate d3/dd/d24/d26/f2d 3485951 0 2024-02-22T00:33:14.144 INFO:tasks.workunit.client.1.smithi161.stdout:3/30: dwrite f2 [4194304,4194304] 0 2024-02-22T00:33:14.146 INFO:tasks.workunit.client.1.smithi161.stdout:1/51: link fa f10 0 2024-02-22T00:33:14.147 INFO:tasks.workunit.client.1.smithi161.stdout:9/100: dwrite d1/d2/f10 [0,4194304] 0 2024-02-22T00:33:14.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/52: creat f11 x:0 0 0 2024-02-22T00:33:14.159 INFO:tasks.workunit.client.1.smithi161.stdout:1/53: symlink l12 0 2024-02-22T00:33:14.162 INFO:tasks.workunit.client.1.smithi161.stdout:3/31: dwrite f5 [0,4194304] 0 2024-02-22T00:33:14.164 INFO:tasks.workunit.client.1.smithi161.stdout:9/101: link d1/d5/l24 d1/d5/l26 0 2024-02-22T00:33:14.168 INFO:tasks.workunit.client.1.smithi161.stdout:9/102: dread d1/d5/d9/f18 [0,4194304] 0 2024-02-22T00:33:14.168 INFO:tasks.workunit.client.1.smithi161.stdout:9/103: fdatasync d1/d2/d4/d11/f1c 0 2024-02-22T00:33:14.168 INFO:tasks.workunit.client.1.smithi161.stdout:6/37: rename f2 to d3/f6 0 2024-02-22T00:33:14.168 INFO:tasks.workunit.client.1.smithi161.stdout:6/38: chown f0 1991 1 2024-02-22T00:33:14.169 INFO:tasks.workunit.client.1.smithi161.stdout:9/104: chown d1/d2/d7/f16 0 1 2024-02-22T00:33:14.171 INFO:tasks.workunit.client.1.smithi161.stdout:3/32: getdents da 0 2024-02-22T00:33:14.171 INFO:tasks.workunit.client.1.smithi161.stdout:3/33: chown da 2056 1 2024-02-22T00:33:14.172 INFO:tasks.workunit.client.1.smithi161.stdout:9/105: symlink d1/d2/d7/d1e/l27 0 2024-02-22T00:33:14.174 INFO:tasks.workunit.client.1.smithi161.stdout:3/34: mkdir da/dc 0 2024-02-22T00:33:14.174 INFO:tasks.workunit.client.1.smithi161.stdout:9/106: creat d1/d2/d4/d11/f28 x:0 0 0 2024-02-22T00:33:14.177 INFO:tasks.workunit.client.1.smithi161.stdout:9/107: mknod d1/d2/d7/c29 0 2024-02-22T00:33:14.180 INFO:tasks.workunit.client.1.smithi161.stdout:9/108: dread d1/d2/f1a [0,4194304] 0 2024-02-22T00:33:14.182 INFO:tasks.workunit.client.1.smithi161.stdout:9/109: creat d1/d2/d4/f2a x:0 0 0 2024-02-22T00:33:14.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/54: dwrite f1 [0,4194304] 0 2024-02-22T00:33:14.191 INFO:tasks.workunit.client.1.smithi161.stdout:7/119: write d3/f7 [68103,19890] 0 2024-02-22T00:33:14.191 INFO:tasks.workunit.client.1.smithi161.stdout:9/110: rmdir d1/d2 39 2024-02-22T00:33:14.192 INFO:tasks.workunit.client.1.smithi161.stdout:6/39: write d3/f6 [1138826,28846] 0 2024-02-22T00:33:14.193 INFO:tasks.workunit.client.1.smithi161.stdout:1/55: mknod c13 0 2024-02-22T00:33:14.194 INFO:tasks.workunit.client.1.smithi161.stdout:7/120: chown d3/df/l21 13348 1 2024-02-22T00:33:14.194 INFO:tasks.workunit.client.1.smithi161.stdout:9/111: symlink d1/d5/d9/l2b 0 2024-02-22T00:33:14.195 INFO:tasks.workunit.client.1.smithi161.stdout:6/40: symlink d3/d5/l7 0 2024-02-22T00:33:14.196 INFO:tasks.workunit.client.1.smithi161.stdout:7/121: symlink d3/dd/l32 0 2024-02-22T00:33:14.197 INFO:tasks.workunit.client.1.smithi161.stdout:6/41: write d3/f6 [317256,44457] 0 2024-02-22T00:33:14.199 INFO:tasks.workunit.client.1.smithi161.stdout:7/122: mkdir d3/df/d33 0 2024-02-22T00:33:14.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/56: dread f1 [0,4194304] 0 2024-02-22T00:33:14.200 INFO:tasks.workunit.client.1.smithi161.stdout:6/42: rename d3/c4 to d3/c8 0 2024-02-22T00:33:14.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/57: readlink l12 0 2024-02-22T00:33:14.201 INFO:tasks.workunit.client.1.smithi161.stdout:9/112: truncate d1/d2/d7/da/f13 3308374 0 2024-02-22T00:33:14.202 INFO:tasks.workunit.client.1.smithi161.stdout:1/58: symlink l14 0 2024-02-22T00:33:14.203 INFO:tasks.workunit.client.1.smithi161.stdout:6/43: creat d3/d5/f9 x:0 0 0 2024-02-22T00:33:14.205 INFO:tasks.workunit.client.1.smithi161.stdout:1/59: creat f15 x:0 0 0 2024-02-22T00:33:14.205 INFO:tasks.workunit.client.1.smithi161.stdout:6/44: rmdir d3 39 2024-02-22T00:33:14.208 INFO:tasks.workunit.client.1.smithi161.stdout:7/123: link d3/dd/l23 d3/df/l34 0 2024-02-22T00:33:14.209 INFO:tasks.workunit.client.1.smithi161.stdout:7/124: write d3/f2b [998939,66566] 0 2024-02-22T00:33:14.210 INFO:tasks.workunit.client.1.smithi161.stdout:6/45: creat d3/d5/fa x:0 0 0 2024-02-22T00:33:14.210 INFO:tasks.workunit.client.1.smithi161.stdout:6/46: chown d3 23557 1 2024-02-22T00:33:14.211 INFO:tasks.workunit.client.1.smithi161.stdout:9/113: getdents d1/d2/d4/d11 0 2024-02-22T00:33:14.213 INFO:tasks.workunit.client.1.smithi161.stdout:7/125: read d3/dd/d24/d26/f2d [3210800,92324] 0 2024-02-22T00:33:14.216 INFO:tasks.workunit.client.1.smithi161.stdout:6/47: dread f0 [0,4194304] 0 2024-02-22T00:33:14.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/48: write d3/d5/f9 [315718,62276] 0 2024-02-22T00:33:14.218 INFO:tasks.workunit.client.1.smithi161.stdout:7/126: read d3/dd/d24/d26/f2d [2151237,117453] 0 2024-02-22T00:33:14.219 INFO:tasks.workunit.client.1.smithi161.stdout:6/49: fdatasync d3/f6 0 2024-02-22T00:33:14.221 INFO:tasks.workunit.client.1.smithi161.stdout:1/60: dread f2 [0,4194304] 0 2024-02-22T00:33:14.222 INFO:tasks.workunit.client.1.smithi161.stdout:6/50: mknod d3/cb 0 2024-02-22T00:33:14.225 INFO:tasks.workunit.client.1.smithi161.stdout:1/61: rename fb to f16 0 2024-02-22T00:33:14.225 INFO:tasks.workunit.client.1.smithi161.stdout:1/62: chown fa 200 1 2024-02-22T00:33:14.226 INFO:tasks.workunit.client.1.smithi161.stdout:6/51: unlink d3/d5/f9 0 2024-02-22T00:33:14.232 INFO:tasks.workunit.client.1.smithi161.stdout:6/52: mkdir d3/dc 0 2024-02-22T00:33:14.234 INFO:tasks.workunit.client.1.smithi161.stdout:7/127: getdents d3/df 0 2024-02-22T00:33:14.235 INFO:tasks.workunit.client.1.smithi161.stdout:6/53: symlink d3/d5/ld 0 2024-02-22T00:33:14.236 INFO:tasks.workunit.client.1.smithi161.stdout:6/54: readlink d3/d5/l7 0 2024-02-22T00:33:14.237 INFO:tasks.workunit.client.1.smithi161.stdout:9/114: truncate d1/d2/fd 1337489 0 2024-02-22T00:33:14.237 INFO:tasks.workunit.client.1.smithi161.stdout:6/55: fsync d3/f6 0 2024-02-22T00:33:14.238 INFO:tasks.workunit.client.1.smithi161.stdout:1/63: dwrite f1 [0,4194304] 0 2024-02-22T00:33:14.239 INFO:tasks.workunit.client.1.smithi161.stdout:7/128: rename d3/dd/d25 to d3/df/d33/d35 0 2024-02-22T00:33:14.241 INFO:tasks.workunit.client.1.smithi161.stdout:6/56: write f0 [2343802,44936] 0 2024-02-22T00:33:14.242 INFO:tasks.workunit.client.1.smithi161.stdout:8/83: sync 2024-02-22T00:33:14.242 INFO:tasks.workunit.client.1.smithi161.stdout:6/57: dread - d3/d5/fa zero size 2024-02-22T00:33:14.243 INFO:tasks.workunit.client.1.smithi161.stdout:7/129: chown d3/dd/l23 5617325 1 2024-02-22T00:33:14.243 INFO:tasks.workunit.client.1.smithi161.stdout:8/84: stat d1/ff 0 2024-02-22T00:33:14.246 INFO:tasks.workunit.client.1.smithi161.stdout:7/130: read d3/f17 [4038006,33489] 0 2024-02-22T00:33:14.246 INFO:tasks.workunit.client.1.smithi161.stdout:9/115: dread d1/d2/d4/d11/f1c [0,4194304] 0 2024-02-22T00:33:14.247 INFO:tasks.workunit.client.1.smithi161.stdout:7/131: chown d3/dd/d24/d26/f2d 49775197 1 2024-02-22T00:33:14.247 INFO:tasks.workunit.client.1.smithi161.stdout:8/85: fsync f0 0 2024-02-22T00:33:14.248 INFO:tasks.workunit.client.1.smithi161.stdout:8/86: chown d1/l14 1619338 1 2024-02-22T00:33:14.248 INFO:tasks.workunit.client.1.smithi161.stdout:8/87: write d1/ff [442297,75532] 0 2024-02-22T00:33:14.270 INFO:tasks.workunit.client.1.smithi161.stdout:9/116: symlink d1/d2/d4/d1f/l2c 0 2024-02-22T00:33:14.270 INFO:tasks.workunit.client.1.smithi161.stdout:8/88: fdatasync d1/d19/f15 0 2024-02-22T00:33:14.272 INFO:tasks.workunit.client.1.smithi161.stdout:9/117: write d1/d2/d4/d11/f28 [1005679,100434] 0 2024-02-22T00:33:14.274 INFO:tasks.workunit.client.1.smithi161.stdout:8/89: mknod d1/c1a 0 2024-02-22T00:33:14.274 INFO:tasks.workunit.client.1.smithi161.stdout:9/118: write d1/d2/d4/d11/f28 [68033,73053] 0 2024-02-22T00:33:14.275 INFO:tasks.workunit.client.1.smithi161.stdout:8/90: write d1/d19/f15 [558976,55102] 0 2024-02-22T00:33:14.277 INFO:tasks.workunit.client.1.smithi161.stdout:9/119: symlink d1/d2/d4/d11/l2d 0 2024-02-22T00:33:14.278 INFO:tasks.workunit.client.1.smithi161.stdout:8/91: creat d1/d19/f1b x:0 0 0 2024-02-22T00:33:14.278 INFO:tasks.workunit.client.1.smithi161.stdout:9/120: read d1/d2/d7/f16 [67148,43024] 0 2024-02-22T00:33:14.280 INFO:tasks.workunit.client.1.smithi161.stdout:8/92: unlink f0 0 2024-02-22T00:33:14.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/64: truncate f1 1849918 0 2024-02-22T00:33:14.287 INFO:tasks.workunit.client.1.smithi161.stdout:9/121: fdatasync d1/d2/fd 0 2024-02-22T00:33:14.287 INFO:tasks.workunit.client.1.smithi161.stdout:8/93: dwrite d1/d19/f15 [0,4194304] 0 2024-02-22T00:33:14.288 INFO:tasks.workunit.client.1.smithi161.stdout:8/94: chown d1 558040 1 2024-02-22T00:33:14.289 INFO:tasks.workunit.client.1.smithi161.stdout:1/65: unlink ld 0 2024-02-22T00:33:14.291 INFO:tasks.workunit.client.1.smithi161.stdout:9/122: creat d1/d2/f2e x:0 0 0 2024-02-22T00:33:14.292 INFO:tasks.workunit.client.1.smithi161.stdout:8/95: mkdir d1/d1c 0 2024-02-22T00:33:14.295 INFO:tasks.workunit.client.1.smithi161.stdout:1/66: creat f17 x:0 0 0 2024-02-22T00:33:14.296 INFO:tasks.workunit.client.1.smithi161.stdout:9/123: mknod d1/d25/c2f 0 2024-02-22T00:33:14.300 INFO:tasks.workunit.client.1.smithi161.stdout:8/96: dwrite d1/d19/f11 [0,4194304] 0 2024-02-22T00:33:14.303 INFO:tasks.workunit.client.1.smithi161.stdout:8/97: mknod d1/c1d 0 2024-02-22T00:33:14.306 INFO:tasks.workunit.client.1.smithi161.stdout:8/98: chown d1/l3 1002117271 1 2024-02-22T00:33:14.309 INFO:tasks.workunit.client.1.smithi161.stdout:9/124: dwrite d1/d2/f1a [0,4194304] 0 2024-02-22T00:33:14.312 INFO:tasks.workunit.client.1.smithi161.stdout:8/99: mkdir d1/d19/d18/d1e 0 2024-02-22T00:33:14.312 INFO:tasks.workunit.client.1.smithi161.stdout:9/125: readlink d1/d5/l26 0 2024-02-22T00:33:14.313 INFO:tasks.workunit.client.1.smithi161.stdout:9/126: fsync d1/d2/d4/d11/f1c 0 2024-02-22T00:33:14.320 INFO:tasks.workunit.client.1.smithi161.stdout:8/100: dwrite d1/d19/f16 [0,4194304] 0 2024-02-22T00:33:14.323 INFO:tasks.workunit.client.1.smithi161.stdout:8/101: creat d1/d19/d18/d1e/f1f x:0 0 0 2024-02-22T00:33:14.323 INFO:tasks.workunit.client.1.smithi161.stdout:8/102: stat d1/d19/c13 0 2024-02-22T00:33:14.329 INFO:tasks.workunit.client.1.smithi161.stdout:8/103: dread d1/f6 [0,4194304] 0 2024-02-22T00:33:14.330 INFO:tasks.workunit.client.1.smithi161.stdout:9/127: write d1/d5/d9/f18 [912200,78939] 0 2024-02-22T00:33:14.332 INFO:tasks.workunit.client.1.smithi161.stdout:8/104: fsync d1/f12 0 2024-02-22T00:33:14.334 INFO:tasks.workunit.client.1.smithi161.stdout:8/105: readlink d1/l4 0 2024-02-22T00:33:14.338 INFO:tasks.workunit.client.1.smithi161.stdout:9/128: fsync d1/d2/d7/da/f13 0 2024-02-22T00:33:14.339 INFO:tasks.workunit.client.1.smithi161.stdout:8/106: dread d1/d19/f10 [0,4194304] 0 2024-02-22T00:33:14.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/129: dread - d1/d2/f2e zero size 2024-02-22T00:33:14.341 INFO:tasks.workunit.client.1.smithi161.stdout:8/107: chown d1/ff 0 1 2024-02-22T00:33:14.344 INFO:tasks.workunit.client.1.smithi161.stdout:9/130: truncate d1/d2/d7/da/f17 1472025 0 2024-02-22T00:33:14.346 INFO:tasks.workunit.client.1.smithi161.stdout:8/108: dwrite d1/d19/f16 [0,4194304] 0 2024-02-22T00:33:14.347 INFO:tasks.workunit.client.1.smithi161.stdout:9/131: mknod d1/c30 0 2024-02-22T00:33:14.347 INFO:tasks.workunit.client.1.smithi161.stdout:8/109: fdatasync d1/ff 0 2024-02-22T00:33:14.348 INFO:tasks.workunit.client.1.smithi161.stdout:9/132: chown d1/d5/l24 15 1 2024-02-22T00:33:14.349 INFO:tasks.workunit.client.1.smithi161.stdout:9/133: chown d1/d5/l26 247222 1 2024-02-22T00:33:14.351 INFO:tasks.workunit.client.1.smithi161.stdout:9/134: dread d1/d2/fd [0,4194304] 0 2024-02-22T00:33:14.358 INFO:tasks.workunit.client.1.smithi161.stdout:8/110: dwrite d1/d19/d18/d1e/f1f [0,4194304] 0 2024-02-22T00:33:14.361 INFO:tasks.workunit.client.1.smithi161.stdout:8/111: read d1/d19/f16 [3180422,2640] 0 2024-02-22T00:33:14.362 INFO:tasks.workunit.client.1.smithi161.stdout:8/112: readlink d1/l4 0 2024-02-22T00:33:14.362 INFO:tasks.workunit.client.1.smithi161.stdout:9/135: dwrite d1/d2/d4/f2a [0,4194304] 0 2024-02-22T00:33:14.366 INFO:tasks.workunit.client.1.smithi161.stdout:9/136: creat d1/d2/d4/d11/f31 x:0 0 0 2024-02-22T00:33:14.367 INFO:tasks.workunit.client.1.smithi161.stdout:8/113: dread d1/d19/f10 [0,4194304] 0 2024-02-22T00:33:14.370 INFO:tasks.workunit.client.1.smithi161.stdout:9/137: dread d1/d2/f1a [0,4194304] 0 2024-02-22T00:33:14.374 INFO:tasks.workunit.client.1.smithi161.stdout:9/138: rmdir d1/d2/d4/d11/d21 39 2024-02-22T00:33:14.375 INFO:tasks.workunit.client.1.smithi161.stdout:8/114: getdents d1/d19 0 2024-02-22T00:33:14.380 INFO:tasks.workunit.client.1.smithi161.stdout:9/139: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:14.381 INFO:tasks.workunit.client.1.smithi161.stdout:8/115: dread d1/ff [0,4194304] 0 2024-02-22T00:33:14.389 INFO:tasks.workunit.client.1.smithi161.stdout:9/140: truncate d1/d2/d7/da/f17 2211394 0 2024-02-22T00:33:14.392 INFO:tasks.workunit.client.1.smithi161.stdout:8/116: dwrite d1/d19/f1b [0,4194304] 0 2024-02-22T00:33:14.396 INFO:tasks.workunit.client.1.smithi161.stdout:8/117: chown d1/c1d 22849440 1 2024-02-22T00:33:14.398 INFO:tasks.workunit.client.1.smithi161.stdout:8/118: stat d1/c7 0 2024-02-22T00:33:14.398 INFO:tasks.workunit.client.1.smithi161.stdout:9/141: dwrite d1/d5/d9/f18 [0,4194304] 0 2024-02-22T00:33:14.401 INFO:tasks.workunit.client.1.smithi161.stdout:5/161: sync 2024-02-22T00:33:14.401 INFO:tasks.workunit.client.1.smithi161.stdout:4/100: sync 2024-02-22T00:33:14.404 INFO:tasks.workunit.client.1.smithi161.stdout:5/162: write d3/f1a [3040219,122191] 0 2024-02-22T00:33:14.407 INFO:tasks.workunit.client.1.smithi161.stdout:8/119: rmdir d1/d19/d18/d1e 39 2024-02-22T00:33:14.409 INFO:tasks.workunit.client.1.smithi161.stdout:4/101: dread d5/d10/f1f [0,4194304] 0 2024-02-22T00:33:14.410 INFO:tasks.workunit.client.1.smithi161.stdout:5/163: write d3/fe [2890178,104280] 0 2024-02-22T00:33:14.412 INFO:tasks.workunit.client.1.smithi161.stdout:8/120: mkdir d1/d1c/d20 0 2024-02-22T00:33:14.413 INFO:tasks.workunit.client.1.smithi161.stdout:4/102: creat d5/d10/f26 x:0 0 0 2024-02-22T00:33:14.414 INFO:tasks.workunit.client.1.smithi161.stdout:5/164: mknod d3/d1b/c2f 0 2024-02-22T00:33:14.416 INFO:tasks.workunit.client.1.smithi161.stdout:8/121: mknod d1/d19/c21 0 2024-02-22T00:33:14.418 INFO:tasks.workunit.client.1.smithi161.stdout:5/165: mknod d3/c30 0 2024-02-22T00:33:14.419 INFO:tasks.workunit.client.1.smithi161.stdout:8/122: truncate d1/f6 1961144 0 2024-02-22T00:33:14.420 INFO:tasks.workunit.client.1.smithi161.stdout:5/166: fsync d3/f5 0 2024-02-22T00:33:14.423 INFO:tasks.workunit.client.1.smithi161.stdout:4/103: dwrite d5/d10/d14/f20 [0,4194304] 0 2024-02-22T00:33:14.426 INFO:tasks.workunit.client.1.smithi161.stdout:9/142: dread d1/d2/d7/da/f17 [0,4194304] 0 2024-02-22T00:33:14.427 INFO:tasks.workunit.client.1.smithi161.stdout:8/123: rename d1/d19/d18/d1e to d1/d1c/d20/d22 0 2024-02-22T00:33:14.429 INFO:tasks.workunit.client.1.smithi161.stdout:5/167: dread d3/f17 [0,4194304] 0 2024-02-22T00:33:14.429 INFO:tasks.workunit.client.1.smithi161.stdout:8/124: truncate d1/ff 4404437 0 2024-02-22T00:33:14.431 INFO:tasks.workunit.client.1.smithi161.stdout:4/104: unlink d5/d10/c22 0 2024-02-22T00:33:14.434 INFO:tasks.workunit.client.1.smithi161.stdout:8/125: symlink d1/d1c/l23 0 2024-02-22T00:33:14.437 INFO:tasks.workunit.client.1.smithi161.stdout:9/143: link d1/d2/f2e d1/d2/d4/d11/d21/d23/f32 0 2024-02-22T00:33:14.437 INFO:tasks.workunit.client.1.smithi161.stdout:5/168: dwrite d3/fc [0,4194304] 0 2024-02-22T00:33:14.438 INFO:tasks.workunit.client.1.smithi161.stdout:8/126: creat d1/f24 x:0 0 0 2024-02-22T00:33:14.441 INFO:tasks.workunit.client.1.smithi161.stdout:4/105: dread d5/fe [0,4194304] 0 2024-02-22T00:33:14.445 INFO:tasks.workunit.client.1.smithi161.stdout:5/169: fdatasync d3/d1c/d20/f12 0 2024-02-22T00:33:14.449 INFO:tasks.workunit.client.1.smithi161.stdout:9/144: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:14.450 INFO:tasks.workunit.client.1.smithi161.stdout:8/127: dread d1/d19/f1b [0,4194304] 0 2024-02-22T00:33:14.453 INFO:tasks.workunit.client.1.smithi161.stdout:8/128: read d1/d1c/d20/d22/f1f [2189309,59305] 0 2024-02-22T00:33:14.453 INFO:tasks.workunit.client.1.smithi161.stdout:5/170: mknod d3/c31 0 2024-02-22T00:33:14.459 INFO:tasks.workunit.client.1.smithi161.stdout:5/171: rename d3/d29/l2e to d3/d1b/l32 0 2024-02-22T00:33:14.460 INFO:tasks.workunit.client.1.smithi161.stdout:9/145: getdents d1/d2 0 2024-02-22T00:33:14.462 INFO:tasks.workunit.client.1.smithi161.stdout:9/146: readlink d1/d2/d7/l19 0 2024-02-22T00:33:14.464 INFO:tasks.workunit.client.1.smithi161.stdout:9/147: fsync d1/d2/d4/d11/f1c 0 2024-02-22T00:33:14.465 INFO:tasks.workunit.client.1.smithi161.stdout:8/129: getdents d1/d1c 0 2024-02-22T00:33:14.468 INFO:tasks.workunit.client.1.smithi161.stdout:4/106: dwrite f0 [0,4194304] 0 2024-02-22T00:33:14.468 INFO:tasks.workunit.client.1.smithi161.stdout:5/172: dread d3/fe [0,4194304] 0 2024-02-22T00:33:14.472 INFO:tasks.workunit.client.1.smithi161.stdout:8/130: creat d1/d19/d18/f25 x:0 0 0 2024-02-22T00:33:14.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/173: mknod d3/d1b/c33 0 2024-02-22T00:33:14.473 INFO:tasks.workunit.client.1.smithi161.stdout:5/174: chown d3/d1b/d25/f23 480006306 1 2024-02-22T00:33:14.473 INFO:tasks.workunit.client.1.smithi161.stdout:4/107: truncate d5/fe 2614078 0 2024-02-22T00:33:14.474 INFO:tasks.workunit.client.1.smithi161.stdout:5/175: rmdir d3/d1b 39 2024-02-22T00:33:14.474 INFO:tasks.workunit.client.1.smithi161.stdout:9/148: dread d1/d2/f1a [0,4194304] 0 2024-02-22T00:33:14.476 INFO:tasks.workunit.client.1.smithi161.stdout:0/157: sync 2024-02-22T00:33:14.477 INFO:tasks.workunit.client.1.smithi161.stdout:8/131: creat d1/d19/d18/f26 x:0 0 0 2024-02-22T00:33:14.477 INFO:tasks.workunit.client.1.smithi161.stdout:2/41: sync 2024-02-22T00:33:14.477 INFO:tasks.workunit.client.1.smithi161.stdout:3/35: sync 2024-02-22T00:33:14.478 INFO:tasks.workunit.client.1.smithi161.stdout:2/42: dread - f8 zero size 2024-02-22T00:33:14.479 INFO:tasks.workunit.client.1.smithi161.stdout:9/149: dread d1/d2/fd [0,4194304] 0 2024-02-22T00:33:14.479 INFO:tasks.workunit.client.1.smithi161.stdout:5/176: unlink d3/f17 0 2024-02-22T00:33:14.479 INFO:tasks.workunit.client.1.smithi161.stdout:8/132: rmdir d1/d19 39 2024-02-22T00:33:14.480 INFO:tasks.workunit.client.1.smithi161.stdout:5/177: stat d3/c2a 0 2024-02-22T00:33:14.481 INFO:tasks.workunit.client.1.smithi161.stdout:0/158: mkdir d14/d1a/d3f 0 2024-02-22T00:33:14.481 INFO:tasks.workunit.client.1.smithi161.stdout:9/150: write d1/d2/d4/d11/f31 [184071,88982] 0 2024-02-22T00:33:14.483 INFO:tasks.workunit.client.1.smithi161.stdout:4/108: rename d5/d10/d14/f23 to d5/f27 0 2024-02-22T00:33:14.483 INFO:tasks.workunit.client.1.smithi161.stdout:2/43: truncate f3 952378 0 2024-02-22T00:33:14.490 INFO:tasks.workunit.client.1.smithi161.stdout:8/133: symlink d1/l27 0 2024-02-22T00:33:14.500 INFO:tasks.workunit.client.1.smithi161.stdout:8/134: write d1/d19/f1b [81460,109622] 0 2024-02-22T00:33:14.500 INFO:tasks.workunit.client.1.smithi161.stdout:5/178: write d3/f24 [836199,35080] 0 2024-02-22T00:33:14.501 INFO:tasks.workunit.client.1.smithi161.stdout:3/36: truncate f5 1990447 0 2024-02-22T00:33:14.502 INFO:tasks.workunit.client.1.smithi161.stdout:5/179: fsync d3/f19 0 2024-02-22T00:33:14.503 INFO:tasks.workunit.client.1.smithi161.stdout:9/151: truncate d1/d2/d7/da/f13 1739533 0 2024-02-22T00:33:14.504 INFO:tasks.workunit.client.1.smithi161.stdout:9/152: chown d1 975 1 2024-02-22T00:33:14.504 INFO:tasks.workunit.client.1.smithi161.stdout:8/135: mkdir d1/d1c/d20/d22/d28 0 2024-02-22T00:33:14.505 INFO:tasks.workunit.client.1.smithi161.stdout:4/109: write d5/f6 [1166072,89481] 0 2024-02-22T00:33:14.505 INFO:tasks.workunit.client.1.smithi161.stdout:5/180: read d3/d1c/d20/f12 [415385,106831] 0 2024-02-22T00:33:14.506 INFO:tasks.workunit.client.1.smithi161.stdout:4/110: fdatasync f0 0 2024-02-22T00:33:14.506 INFO:tasks.workunit.client.1.smithi161.stdout:2/44: write fd [341212,107642] 0 2024-02-22T00:33:14.507 INFO:tasks.workunit.client.1.smithi161.stdout:7/132: sync 2024-02-22T00:33:14.508 INFO:tasks.workunit.client.1.smithi161.stdout:1/67: sync 2024-02-22T00:33:14.508 INFO:tasks.workunit.client.1.smithi161.stdout:6/58: sync 2024-02-22T00:33:14.508 INFO:tasks.workunit.client.1.smithi161.stdout:3/37: creat da/dc/fd x:0 0 0 2024-02-22T00:33:14.509 INFO:tasks.workunit.client.1.smithi161.stdout:8/136: write d1/f12 [895401,73116] 0 2024-02-22T00:33:14.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/68: readlink l3 0 2024-02-22T00:33:14.511 INFO:tasks.workunit.client.1.smithi161.stdout:3/38: readlink l8 0 2024-02-22T00:33:14.511 INFO:tasks.workunit.client.1.smithi161.stdout:6/59: fdatasync d3/f6 0 2024-02-22T00:33:14.513 INFO:tasks.workunit.client.1.smithi161.stdout:2/45: mknod de/cf 0 2024-02-22T00:33:14.514 INFO:tasks.workunit.client.1.smithi161.stdout:0/159: dwrite fb [0,4194304] 0 2024-02-22T00:33:14.516 INFO:tasks.workunit.client.1.smithi161.stdout:1/69: symlink l18 0 2024-02-22T00:33:14.517 INFO:tasks.workunit.client.1.smithi161.stdout:4/111: chown d5/d10/d14/l25 249038 1 2024-02-22T00:33:14.521 INFO:tasks.workunit.client.1.smithi161.stdout:1/70: truncate f10 1232153 0 2024-02-22T00:33:14.530 INFO:tasks.workunit.client.1.smithi161.stdout:6/60: truncate d3/f6 431813 0 2024-02-22T00:33:14.533 INFO:tasks.workunit.client.1.smithi161.stdout:3/39: truncate f2 3460148 0 2024-02-22T00:33:14.533 INFO:tasks.workunit.client.1.smithi161.stdout:1/71: dread f1 [0,4194304] 0 2024-02-22T00:33:14.535 INFO:tasks.workunit.client.1.smithi161.stdout:2/46: dwrite fa [0,4194304] 0 2024-02-22T00:33:14.536 INFO:tasks.workunit.client.1.smithi161.stdout:5/181: write d3/d1c/d20/f12 [67149,45670] 0 2024-02-22T00:33:14.537 INFO:tasks.workunit.client.1.smithi161.stdout:6/61: creat d3/fe x:0 0 0 2024-02-22T00:33:14.542 INFO:tasks.workunit.client.1.smithi161.stdout:3/40: truncate f7 2026481 0 2024-02-22T00:33:14.542 INFO:tasks.workunit.client.1.smithi161.stdout:0/160: dread d14/f17 [0,4194304] 0 2024-02-22T00:33:14.542 INFO:tasks.workunit.client.1.smithi161.stdout:2/47: stat fc 0 2024-02-22T00:33:14.542 INFO:tasks.workunit.client.1.smithi161.stdout:6/62: stat d3/cb 0 2024-02-22T00:33:14.544 INFO:tasks.workunit.client.1.smithi161.stdout:1/72: write f5 [402775,65620] 0 2024-02-22T00:33:14.546 INFO:tasks.workunit.client.1.smithi161.stdout:7/133: dwrite d3/df/d33/d35/f2c [0,4194304] 0 2024-02-22T00:33:14.548 INFO:tasks.workunit.client.1.smithi161.stdout:4/112: dread f0 [0,4194304] 0 2024-02-22T00:33:14.551 INFO:tasks.workunit.client.1.smithi161.stdout:9/153: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:14.553 INFO:tasks.workunit.client.1.smithi161.stdout:2/48: dread fd [0,4194304] 0 2024-02-22T00:33:14.554 INFO:tasks.workunit.client.1.smithi161.stdout:3/41: creat da/dc/fe x:0 0 0 2024-02-22T00:33:14.555 INFO:tasks.workunit.client.1.smithi161.stdout:7/134: fsync d3/f9 0 2024-02-22T00:33:14.556 INFO:tasks.workunit.client.1.smithi161.stdout:6/63: dread d3/f6 [0,4194304] 0 2024-02-22T00:33:14.557 INFO:tasks.workunit.client.1.smithi161.stdout:5/182: rename d3/l8 to d3/d1b/l34 0 2024-02-22T00:33:14.559 INFO:tasks.workunit.client.1.smithi161.stdout:6/64: dread - d3/fe zero size 2024-02-22T00:33:14.559 INFO:tasks.workunit.client.1.smithi161.stdout:7/135: chown c0 79952 1 2024-02-22T00:33:14.560 INFO:tasks.workunit.client.1.smithi161.stdout:3/42: symlink da/lf 0 2024-02-22T00:33:14.568 INFO:tasks.workunit.client.1.smithi161.stdout:2/49: rename c7 to de/c10 0 2024-02-22T00:33:14.574 INFO:tasks.workunit.client.1.smithi161.stdout:1/73: dwrite f7 [4194304,4194304] 0 2024-02-22T00:33:14.574 INFO:tasks.workunit.client.1.smithi161.stdout:6/65: dread d3/f6 [0,4194304] 0 2024-02-22T00:33:14.575 INFO:tasks.workunit.client.1.smithi161.stdout:7/136: write d3/dd/d24/f28 [1389113,54338] 0 2024-02-22T00:33:14.575 INFO:tasks.workunit.client.1.smithi161.stdout:2/50: mkdir de/d11 0 2024-02-22T00:33:14.577 INFO:tasks.workunit.client.1.smithi161.stdout:3/43: dread f5 [0,4194304] 0 2024-02-22T00:33:14.583 INFO:tasks.workunit.client.1.smithi161.stdout:0/161: dwrite f11 [0,4194304] 0 2024-02-22T00:33:14.587 INFO:tasks.workunit.client.1.smithi161.stdout:7/137: readlink d3/lb 0 2024-02-22T00:33:14.593 INFO:tasks.workunit.client.1.smithi161.stdout:5/183: dwrite d3/f1a [0,4194304] 0 2024-02-22T00:33:14.594 INFO:tasks.workunit.client.1.smithi161.stdout:4/113: write d5/f7 [819138,101045] 0 2024-02-22T00:33:14.594 INFO:tasks.workunit.client.1.smithi161.stdout:1/74: write f15 [1017361,92474] 0 2024-02-22T00:33:14.597 INFO:tasks.workunit.client.1.smithi161.stdout:5/184: stat d3/ca 0 2024-02-22T00:33:14.597 INFO:tasks.workunit.client.1.smithi161.stdout:9/154: dread d1/d5/d9/f18 [0,4194304] 0 2024-02-22T00:33:14.597 INFO:tasks.workunit.client.1.smithi161.stdout:4/114: read d5/f6 [1455064,60618] 0 2024-02-22T00:33:14.600 INFO:tasks.workunit.client.1.smithi161.stdout:9/155: dread - d1/d2/f2e zero size 2024-02-22T00:33:14.600 INFO:tasks.workunit.client.1.smithi161.stdout:2/51: link fa de/f12 0 2024-02-22T00:33:14.603 INFO:tasks.workunit.client.1.smithi161.stdout:7/138: creat d3/f36 x:0 0 0 2024-02-22T00:33:14.603 INFO:tasks.workunit.client.1.smithi161.stdout:2/52: chown de/f12 94365786 1 2024-02-22T00:33:14.605 INFO:tasks.workunit.client.1.smithi161.stdout:7/139: readlink d3/df/l21 0 2024-02-22T00:33:14.606 INFO:tasks.workunit.client.1.smithi161.stdout:1/75: dread f1 [0,4194304] 0 2024-02-22T00:33:14.607 INFO:tasks.workunit.client.1.smithi161.stdout:6/66: dwrite f0 [4194304,4194304] 0 2024-02-22T00:33:14.607 INFO:tasks.workunit.client.1.smithi161.stdout:4/115: write d5/d10/f1f [3694112,62173] 0 2024-02-22T00:33:14.608 INFO:tasks.workunit.client.1.smithi161.stdout:9/156: readlink d1/d5/l8 0 2024-02-22T00:33:14.613 INFO:tasks.workunit.client.1.smithi161.stdout:3/44: dread f2 [0,4194304] 0 2024-02-22T00:33:14.613 INFO:tasks.workunit.client.1.smithi161.stdout:6/67: write d3/d5/fa [679848,56641] 0 2024-02-22T00:33:14.613 INFO:tasks.workunit.client.1.smithi161.stdout:2/53: link fa de/d11/f13 0 2024-02-22T00:33:14.614 INFO:tasks.workunit.client.1.smithi161.stdout:7/140: creat d3/f37 x:0 0 0 2024-02-22T00:33:14.616 INFO:tasks.workunit.client.1.smithi161.stdout:9/157: write d1/d2/d4/d11/f31 [230040,47149] 0 2024-02-22T00:33:14.620 INFO:tasks.workunit.client.1.smithi161.stdout:4/116: dread d5/f7 [0,4194304] 0 2024-02-22T00:33:14.620 INFO:tasks.workunit.client.1.smithi161.stdout:6/68: mkdir d3/dc/df 0 2024-02-22T00:33:14.621 INFO:tasks.workunit.client.1.smithi161.stdout:9/158: dread - d1/d2/d4/d11/d21/d23/f32 zero size 2024-02-22T00:33:14.623 INFO:tasks.workunit.client.1.smithi161.stdout:7/141: creat d3/df/f38 x:0 0 0 2024-02-22T00:33:14.623 INFO:tasks.workunit.client.1.smithi161.stdout:5/185: write d3/f7 [4591150,126724] 0 2024-02-22T00:33:14.625 INFO:tasks.workunit.client.1.smithi161.stdout:7/142: chown d3/dd/d24/d26/d30 0 1 2024-02-22T00:33:14.627 INFO:tasks.workunit.client.1.smithi161.stdout:7/143: write d3/dd/d24/f28 [1436222,103692] 0 2024-02-22T00:33:14.630 INFO:tasks.workunit.client.1.smithi161.stdout:6/69: rename d3/d5 to d3/d10 0 2024-02-22T00:33:14.631 INFO:tasks.workunit.client.1.smithi161.stdout:9/159: rename d1/d2/d4/d11/d21/d23 to d1/d5/d9/d33 0 2024-02-22T00:33:14.631 INFO:tasks.workunit.client.1.smithi161.stdout:4/117: mkdir d5/d10/d14/d24/d28 0 2024-02-22T00:33:14.633 INFO:tasks.workunit.client.1.smithi161.stdout:5/186: creat d3/d1c/d20/f35 x:0 0 0 2024-02-22T00:33:14.634 INFO:tasks.workunit.client.1.smithi161.stdout:3/45: write f5 [2865030,123774] 0 2024-02-22T00:33:14.635 INFO:tasks.workunit.client.1.smithi161.stdout:3/46: dread - da/dc/fd zero size 2024-02-22T00:33:14.636 INFO:tasks.workunit.client.1.smithi161.stdout:7/144: rename d3/dd/l32 to d3/df/d33/d35/l39 0 2024-02-22T00:33:14.636 INFO:tasks.workunit.client.1.smithi161.stdout:2/54: write de/d11/f13 [3491526,60415] 0 2024-02-22T00:33:14.637 INFO:tasks.workunit.client.1.smithi161.stdout:7/145: fdatasync f2 0 2024-02-22T00:33:14.637 INFO:tasks.workunit.client.1.smithi161.stdout:9/160: rmdir d1/d2/d7/d1e 39 2024-02-22T00:33:14.639 INFO:tasks.workunit.client.1.smithi161.stdout:4/118: fdatasync d5/d10/d14/f1c 0 2024-02-22T00:33:14.641 INFO:tasks.workunit.client.1.smithi161.stdout:5/187: mkdir d3/d1b/d36 0 2024-02-22T00:33:14.641 INFO:tasks.workunit.client.1.smithi161.stdout:6/70: symlink d3/dc/df/l11 0 2024-02-22T00:33:14.642 INFO:tasks.workunit.client.1.smithi161.stdout:7/146: dread d3/fa [0,4194304] 0 2024-02-22T00:33:14.642 INFO:tasks.workunit.client.1.smithi161.stdout:5/188: write d3/fc [1440993,51554] 0 2024-02-22T00:33:14.644 INFO:tasks.workunit.client.1.smithi161.stdout:3/47: creat da/f10 x:0 0 0 2024-02-22T00:33:14.644 INFO:tasks.workunit.client.1.smithi161.stdout:3/48: readlink da/lb 0 2024-02-22T00:33:14.649 INFO:tasks.workunit.client.1.smithi161.stdout:9/161: write d1/d2/d7/f16 [134740,126705] 0 2024-02-22T00:33:14.654 INFO:tasks.workunit.client.1.smithi161.stdout:5/189: truncate d3/f15 622281 0 2024-02-22T00:33:14.656 INFO:tasks.workunit.client.1.smithi161.stdout:2/55: mkdir de/d11/d14 0 2024-02-22T00:33:14.657 INFO:tasks.workunit.client.1.smithi161.stdout:2/56: stat de/d11/d14 0 2024-02-22T00:33:14.660 INFO:tasks.workunit.client.1.smithi161.stdout:5/190: mknod d3/d1c/d20/c37 0 2024-02-22T00:33:14.662 INFO:tasks.workunit.client.1.smithi161.stdout:3/49: unlink da/f10 0 2024-02-22T00:33:14.663 INFO:tasks.workunit.client.1.smithi161.stdout:3/50: read - da/dc/fd zero size 2024-02-22T00:33:14.663 INFO:tasks.workunit.client.1.smithi161.stdout:9/162: mknod d1/d2/d7/c34 0 2024-02-22T00:33:14.664 INFO:tasks.workunit.client.1.smithi161.stdout:3/51: fsync f5 0 2024-02-22T00:33:14.665 INFO:tasks.workunit.client.1.smithi161.stdout:5/191: creat d3/d1b/f38 x:0 0 0 2024-02-22T00:33:14.667 INFO:tasks.workunit.client.1.smithi161.stdout:7/147: getdents d3/dd/d24 0 2024-02-22T00:33:14.672 INFO:tasks.workunit.client.1.smithi161.stdout:2/57: link de/c10 de/c15 0 2024-02-22T00:33:14.672 INFO:tasks.workunit.client.1.smithi161.stdout:2/58: chown f1 7697 1 2024-02-22T00:33:14.676 INFO:tasks.workunit.client.1.smithi161.stdout:9/163: truncate d1/d2/fd 1047406 0 2024-02-22T00:33:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:13.497455+0000 mgr.smithi161.sazlam (mgr.24369) 23 : audit [DBG] from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:13.755422+0000 mgr.smithi161.sazlam (mgr.24369) 24 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 296 KiB/s rd, 19 MiB/s wr, 315 op/s 2024-02-22T00:33:14.678 INFO:tasks.workunit.client.1.smithi161.stdout:5/192: link d3/f1a d3/d1b/d25/f39 0 2024-02-22T00:33:14.679 INFO:tasks.workunit.client.1.smithi161.stdout:9/164: dread d1/d2/d7/f16 [0,4194304] 0 2024-02-22T00:33:14.680 INFO:tasks.workunit.client.1.smithi161.stdout:7/148: symlink d3/l3a 0 2024-02-22T00:33:14.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/149: rename d3/dd/d24/d26/f2d to d3/dd/d24/d26/d30/f3b 0 2024-02-22T00:33:14.686 INFO:tasks.workunit.client.1.smithi161.stdout:9/165: dread d1/d5/d9/f18 [0,4194304] 0 2024-02-22T00:33:14.689 INFO:tasks.workunit.client.1.smithi161.stdout:7/150: mkdir d3/df/d3c 0 2024-02-22T00:33:14.691 INFO:tasks.workunit.client.1.smithi161.stdout:3/52: dwrite f0 [0,4194304] 0 2024-02-22T00:33:14.693 INFO:tasks.workunit.client.1.smithi161.stdout:3/53: write f2 [410592,58754] 0 2024-02-22T00:33:14.693 INFO:tasks.workunit.client.1.smithi161.stdout:9/166: creat d1/d2/d4/d1f/f35 x:0 0 0 2024-02-22T00:33:14.696 INFO:tasks.workunit.client.1.smithi161.stdout:2/59: dwrite fc [0,4194304] 0 2024-02-22T00:33:14.698 INFO:tasks.workunit.client.1.smithi161.stdout:3/54: mkdir da/dc/d11 0 2024-02-22T00:33:14.700 INFO:tasks.workunit.client.1.smithi161.stdout:2/60: mknod de/d11/c16 0 2024-02-22T00:33:14.703 INFO:tasks.workunit.client.1.smithi161.stdout:9/167: creat d1/d5/f36 x:0 0 0 2024-02-22T00:33:14.706 INFO:tasks.workunit.client.1.smithi161.stdout:2/61: mknod de/c17 0 2024-02-22T00:33:14.707 INFO:tasks.workunit.client.1.smithi161.stdout:3/55: dwrite da/dc/fd [0,4194304] 0 2024-02-22T00:33:14.715 INFO:tasks.workunit.client.1.smithi161.stdout:9/168: unlink d1/d5/d9/f18 0 2024-02-22T00:33:14.715 INFO:tasks.workunit.client.1.smithi161.stdout:3/56: mknod da/c12 0 2024-02-22T00:33:14.725 INFO:tasks.workunit.client.1.smithi161.stdout:9/169: dwrite d1/d2/d7/da/f13 [4194304,4194304] 0 2024-02-22T00:33:14.726 INFO:tasks.workunit.client.1.smithi161.stdout:9/170: readlink d1/l3 0 2024-02-22T00:33:14.726 INFO:tasks.workunit.client.1.smithi161.stdout:3/57: dwrite f0 [0,4194304] 0 2024-02-22T00:33:14.727 INFO:tasks.workunit.client.1.smithi161.stdout:9/171: chown d1/d25 9733 1 2024-02-22T00:33:14.729 INFO:tasks.workunit.client.1.smithi161.stdout:7/151: truncate d3/df/d33/d35/f2c 3068332 0 2024-02-22T00:33:14.730 INFO:tasks.workunit.client.1.smithi161.stdout:9/172: mknod d1/d2/d4/c37 0 2024-02-22T00:33:14.734 INFO:tasks.workunit.client.1.smithi161.stdout:7/152: rename d3/l3a to d3/dd/d24/l3d 0 2024-02-22T00:33:14.735 INFO:tasks.workunit.client.1.smithi161.stdout:7/153: read f2 [1235851,20109] 0 2024-02-22T00:33:14.738 INFO:tasks.workunit.client.1.smithi161.stdout:2/62: truncate f4 455653 0 2024-02-22T00:33:14.738 INFO:tasks.workunit.client.1.smithi161.stdout:9/173: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:14.748 INFO:tasks.workunit.client.1.smithi161.stdout:2/63: write fd [4786349,36890] 0 2024-02-22T00:33:14.749 INFO:tasks.workunit.client.1.smithi161.stdout:2/64: stat de/f12 0 2024-02-22T00:33:14.750 INFO:tasks.workunit.client.1.smithi161.stdout:3/58: truncate da/dc/fd 1014695 0 2024-02-22T00:33:14.750 INFO:tasks.workunit.client.1.smithi161.stdout:3/59: chown da/lb 0 1 2024-02-22T00:33:14.751 INFO:tasks.workunit.client.1.smithi161.stdout:9/174: link d1/d2/f1a d1/d2/d7/f38 0 2024-02-22T00:33:14.752 INFO:tasks.workunit.client.1.smithi161.stdout:9/175: chown d1/d2/cf 0 1 2024-02-22T00:33:14.754 INFO:tasks.workunit.client.1.smithi161.stdout:2/65: creat de/d11/d14/f18 x:0 0 0 2024-02-22T00:33:14.755 INFO:tasks.workunit.client.1.smithi161.stdout:2/66: chown de/d11/d14/f18 10790 1 2024-02-22T00:33:14.756 INFO:tasks.workunit.client.1.smithi161.stdout:9/176: mknod d1/d2/d4/d11/d21/c39 0 2024-02-22T00:33:14.756 INFO:tasks.workunit.client.1.smithi161.stdout:9/177: chown d1/d2/d4/d1f 1518281630 1 2024-02-22T00:33:14.761 INFO:tasks.workunit.client.1.smithi161.stdout:9/178: symlink d1/l3a 0 2024-02-22T00:33:14.761 INFO:tasks.workunit.client.1.smithi161.stdout:3/60: getdents da/dc 0 2024-02-22T00:33:14.762 INFO:tasks.workunit.client.1.smithi161.stdout:9/179: readlink d1/d2/d4/d1f/l2c 0 2024-02-22T00:33:14.763 INFO:tasks.workunit.client.1.smithi161.stdout:3/61: readlink l9 0 2024-02-22T00:33:14.765 INFO:tasks.workunit.client.1.smithi161.stdout:3/62: truncate da/dc/fe 449425 0 2024-02-22T00:33:14.767 INFO:tasks.workunit.client.1.smithi161.stdout:9/180: rename d1/d2/d7/f38 to d1/d2/d4/f3b 0 2024-02-22T00:33:14.770 INFO:tasks.workunit.client.1.smithi161.stdout:9/181: creat d1/d2/d7/da/f3c x:0 0 0 2024-02-22T00:33:14.771 INFO:tasks.workunit.client.1.smithi161.stdout:2/67: write f1 [2452035,120471] 0 2024-02-22T00:33:14.772 INFO:tasks.workunit.client.1.smithi161.stdout:3/63: dwrite f5 [0,4194304] 0 2024-02-22T00:33:14.778 INFO:tasks.workunit.client.1.smithi161.stdout:3/64: getdents da/dc/d11 0 2024-02-22T00:33:14.781 INFO:tasks.workunit.client.1.smithi161.stdout:2/68: dwrite fa [0,4194304] 0 2024-02-22T00:33:14.783 INFO:tasks.workunit.client.1.smithi161.stdout:3/65: rename f5 to da/f13 0 2024-02-22T00:33:14.783 INFO:tasks.workunit.client.1.smithi161.stdout:3/66: chown da/dc 10182 1 2024-02-22T00:33:14.785 INFO:tasks.workunit.client.1.smithi161.stdout:2/69: mknod de/d11/c19 0 2024-02-22T00:33:14.786 INFO:tasks.workunit.client.1.smithi161.stdout:2/70: readlink lb 0 2024-02-22T00:33:14.787 INFO:tasks.workunit.client.1.smithi161.stdout:3/67: write da/f13 [389798,101891] 0 2024-02-22T00:33:14.787 INFO:tasks.workunit.client.1.smithi161.stdout:3/68: chown da/dc 0 1 2024-02-22T00:33:14.794 INFO:tasks.workunit.client.1.smithi161.stdout:9/182: dwrite d1/d2/d7/da/f17 [0,4194304] 0 2024-02-22T00:33:14.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:13.497455+0000 mgr.smithi161.sazlam (mgr.24369) 23 : audit [DBG] from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:14.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:13.755422+0000 mgr.smithi161.sazlam (mgr.24369) 24 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 318 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 296 KiB/s rd, 19 MiB/s wr, 315 op/s 2024-02-22T00:33:14.794 INFO:tasks.workunit.client.1.smithi161.stdout:3/69: symlink da/dc/d11/l14 0 2024-02-22T00:33:14.796 INFO:tasks.workunit.client.1.smithi161.stdout:2/71: getdents de/d11/d14 0 2024-02-22T00:33:14.797 INFO:tasks.workunit.client.1.smithi161.stdout:9/183: write d1/d2/d4/d11/f28 [240704,108684] 0 2024-02-22T00:33:14.798 INFO:tasks.workunit.client.1.smithi161.stdout:2/72: truncate fa 4253938 0 2024-02-22T00:33:14.803 INFO:tasks.workunit.client.1.smithi161.stdout:9/184: rmdir d1/d2/d4 39 2024-02-22T00:33:14.805 INFO:tasks.workunit.client.1.smithi161.stdout:2/73: link f1 de/d11/f1a 0 2024-02-22T00:33:14.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/70: dwrite f7 [0,4194304] 0 2024-02-22T00:33:14.809 INFO:tasks.workunit.client.1.smithi161.stdout:3/71: mknod da/dc/d11/c15 0 2024-02-22T00:33:14.812 INFO:tasks.workunit.client.1.smithi161.stdout:3/72: mkdir da/dc/d16 0 2024-02-22T00:33:14.814 INFO:tasks.workunit.client.1.smithi161.stdout:3/73: creat da/dc/f17 x:0 0 0 2024-02-22T00:33:14.815 INFO:tasks.workunit.client.1.smithi161.stdout:3/74: readlink l9 0 2024-02-22T00:33:14.815 INFO:tasks.workunit.client.1.smithi161.stdout:3/75: write da/f13 [2329180,77021] 0 2024-02-22T00:33:14.816 INFO:tasks.workunit.client.1.smithi161.stdout:3/76: rename da/dc/d16 to da/dc/d16/d18 22 2024-02-22T00:33:14.816 INFO:tasks.workunit.client.1.smithi161.stdout:3/77: stat da/f13 0 2024-02-22T00:33:14.834 INFO:tasks.workunit.client.1.smithi161.stdout:2/74: dread f1 [0,4194304] 0 2024-02-22T00:33:14.834 INFO:tasks.workunit.client.1.smithi161.stdout:2/75: chown fc 122952740 1 2024-02-22T00:33:14.836 INFO:tasks.workunit.client.1.smithi161.stdout:2/76: dread fa [4194304,4194304] 0 2024-02-22T00:33:14.839 INFO:tasks.workunit.client.1.smithi161.stdout:2/77: getdents de 0 2024-02-22T00:33:14.844 INFO:tasks.workunit.client.1.smithi161.stdout:2/78: fsync f4 0 2024-02-22T00:33:14.847 INFO:tasks.workunit.client.1.smithi161.stdout:2/79: creat de/f1b x:0 0 0 2024-02-22T00:33:14.848 INFO:tasks.workunit.client.1.smithi161.stdout:3/78: write f7 [5053141,63244] 0 2024-02-22T00:33:14.849 INFO:tasks.workunit.client.1.smithi161.stdout:2/80: creat de/f1c x:0 0 0 2024-02-22T00:33:14.850 INFO:tasks.workunit.client.1.smithi161.stdout:2/81: truncate f8 294681 0 2024-02-22T00:33:14.851 INFO:tasks.workunit.client.1.smithi161.stdout:3/79: fsync f7 0 2024-02-22T00:33:14.852 INFO:tasks.workunit.client.1.smithi161.stdout:3/80: chown c4 6786 1 2024-02-22T00:33:14.854 INFO:tasks.workunit.client.1.smithi161.stdout:3/81: write da/f13 [4501721,105587] 0 2024-02-22T00:33:14.854 INFO:tasks.workunit.client.1.smithi161.stdout:2/82: dread de/d11/f1a [0,4194304] 0 2024-02-22T00:33:14.855 INFO:tasks.workunit.client.1.smithi161.stdout:3/82: stat da/c12 0 2024-02-22T00:33:14.857 INFO:tasks.workunit.client.1.smithi161.stdout:3/83: truncate da/dc/fe 1316611 0 2024-02-22T00:33:14.857 INFO:tasks.workunit.client.1.smithi161.stdout:2/83: rmdir de 39 2024-02-22T00:33:14.859 INFO:tasks.workunit.client.1.smithi161.stdout:3/84: write da/dc/fe [1361018,90904] 0 2024-02-22T00:33:14.860 INFO:tasks.workunit.client.1.smithi161.stdout:2/84: chown de/d11/d14 2 1 2024-02-22T00:33:14.864 INFO:tasks.workunit.client.1.smithi161.stdout:3/85: getdents da/dc 0 2024-02-22T00:33:14.868 INFO:tasks.workunit.client.1.smithi161.stdout:3/86: creat da/dc/d16/f19 x:0 0 0 2024-02-22T00:33:14.869 INFO:tasks.workunit.client.1.smithi161.stdout:2/85: dwrite de/f1b [0,4194304] 0 2024-02-22T00:33:14.869 INFO:tasks.workunit.client.1.smithi161.stdout:3/87: dread - da/dc/f17 zero size 2024-02-22T00:33:14.873 INFO:tasks.workunit.client.1.smithi161.stdout:2/86: mknod de/c1d 0 2024-02-22T00:33:14.874 INFO:tasks.workunit.client.1.smithi161.stdout:3/88: creat da/f1a x:0 0 0 2024-02-22T00:33:14.875 INFO:tasks.workunit.client.1.smithi161.stdout:3/89: dread - da/f1a zero size 2024-02-22T00:33:14.878 INFO:tasks.workunit.client.1.smithi161.stdout:2/87: dread de/d11/f1a [4194304,4194304] 0 2024-02-22T00:33:14.880 INFO:tasks.workunit.client.1.smithi161.stdout:2/88: mkdir de/d1e 0 2024-02-22T00:33:14.881 INFO:tasks.workunit.client.1.smithi161.stdout:2/89: chown de/f1b 1 1 2024-02-22T00:33:14.881 INFO:tasks.workunit.client.1.smithi161.stdout:2/90: readlink lb 0 2024-02-22T00:33:14.881 INFO:tasks.workunit.client.1.smithi161.stdout:2/91: readlink lb 0 2024-02-22T00:33:14.883 INFO:tasks.workunit.client.1.smithi161.stdout:2/92: mkdir de/d11/d14/d1f 0 2024-02-22T00:33:14.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/90: write da/dc/fd [37450,93821] 0 2024-02-22T00:33:14.885 INFO:tasks.workunit.client.1.smithi161.stdout:3/91: write f7 [2280509,117750] 0 2024-02-22T00:33:14.886 INFO:tasks.workunit.client.1.smithi161.stdout:2/93: rename f2 to de/f20 0 2024-02-22T00:33:14.889 INFO:tasks.workunit.client.1.smithi161.stdout:3/92: rename da/lf to da/dc/l1b 0 2024-02-22T00:33:14.890 INFO:tasks.workunit.client.1.smithi161.stdout:3/93: stat da/dc/f17 0 2024-02-22T00:33:14.891 INFO:tasks.workunit.client.1.smithi161.stdout:3/94: read da/f13 [3937474,126410] 0 2024-02-22T00:33:14.900 INFO:tasks.workunit.client.1.smithi161.stdout:3/95: dwrite da/dc/d16/f19 [0,4194304] 0 2024-02-22T00:33:14.903 INFO:tasks.workunit.client.1.smithi161.stdout:2/94: dwrite de/d11/f1a [4194304,4194304] 0 2024-02-22T00:33:14.903 INFO:tasks.workunit.client.1.smithi161.stdout:3/96: rename da/lb to da/l1c 0 2024-02-22T00:33:14.904 INFO:tasks.workunit.client.1.smithi161.stdout:3/97: fdatasync f2 0 2024-02-22T00:33:14.907 INFO:tasks.workunit.client.1.smithi161.stdout:2/95: rename de/f12 to de/f21 0 2024-02-22T00:33:14.908 INFO:tasks.workunit.client.1.smithi161.stdout:3/98: symlink da/l1d 0 2024-02-22T00:33:14.910 INFO:tasks.workunit.client.1.smithi161.stdout:3/99: rmdir da/dc 39 2024-02-22T00:33:14.912 INFO:tasks.workunit.client.1.smithi161.stdout:2/96: rename de/f20 to de/d11/d14/f22 0 2024-02-22T00:33:14.917 INFO:tasks.workunit.client.1.smithi161.stdout:2/97: read de/d11/f13 [78830,44342] 0 2024-02-22T00:33:14.919 INFO:tasks.workunit.client.1.smithi161.stdout:3/100: dwrite da/f1a [0,4194304] 0 2024-02-22T00:33:14.922 INFO:tasks.workunit.client.1.smithi161.stdout:3/101: read - da/dc/f17 zero size 2024-02-22T00:33:14.922 INFO:tasks.workunit.client.1.smithi161.stdout:2/98: symlink de/d11/d14/d1f/l23 0 2024-02-22T00:33:14.925 INFO:tasks.workunit.client.1.smithi161.stdout:3/102: fdatasync da/f13 0 2024-02-22T00:33:14.925 INFO:tasks.workunit.client.1.smithi161.stdout:3/103: fsync f7 0 2024-02-22T00:33:14.926 INFO:tasks.workunit.client.1.smithi161.stdout:2/99: write de/d11/d14/f22 [7804545,101037] 0 2024-02-22T00:33:14.933 INFO:tasks.workunit.client.1.smithi161.stdout:3/104: write da/f13 [1317193,121657] 0 2024-02-22T00:33:14.935 INFO:tasks.workunit.client.1.smithi161.stdout:2/100: creat de/d1e/f24 x:0 0 0 2024-02-22T00:33:14.939 INFO:tasks.workunit.client.1.smithi161.stdout:3/105: symlink da/dc/l1e 0 2024-02-22T00:33:14.939 INFO:tasks.workunit.client.1.smithi161.stdout:2/101: rename fd to de/d1e/f25 0 2024-02-22T00:33:14.940 INFO:tasks.workunit.client.1.smithi161.stdout:3/106: write da/dc/fe [54814,74730] 0 2024-02-22T00:33:14.941 INFO:tasks.workunit.client.1.smithi161.stdout:2/102: unlink f4 0 2024-02-22T00:33:14.943 INFO:tasks.workunit.client.1.smithi161.stdout:2/103: unlink de/c17 0 2024-02-22T00:33:14.944 INFO:tasks.workunit.client.1.smithi161.stdout:2/104: write fc [4669414,91864] 0 2024-02-22T00:33:14.948 INFO:tasks.workunit.client.1.smithi161.stdout:2/105: rename de/d11/d14/d1f/l23 to de/d11/l26 0 2024-02-22T00:33:14.954 INFO:tasks.workunit.client.1.smithi161.stdout:2/106: dwrite de/d1e/f25 [0,4194304] 0 2024-02-22T00:33:14.966 INFO:tasks.workunit.client.1.smithi161.stdout:2/107: write de/f21 [1496318,37788] 0 2024-02-22T00:33:14.968 INFO:tasks.workunit.client.1.smithi161.stdout:2/108: mknod de/d11/d14/d1f/c27 0 2024-02-22T00:33:14.970 INFO:tasks.workunit.client.1.smithi161.stdout:2/109: read f3 [713864,41132] 0 2024-02-22T00:33:14.978 INFO:tasks.workunit.client.1.smithi161.stdout:2/110: truncate de/d1e/f25 2528060 0 2024-02-22T00:33:14.983 INFO:tasks.workunit.client.1.smithi161.stdout:2/111: dwrite de/d11/f13 [0,4194304] 0 2024-02-22T00:33:14.984 INFO:tasks.workunit.client.1.smithi161.stdout:2/112: chown de/f1c 580042 1 2024-02-22T00:33:14.990 INFO:tasks.workunit.client.1.smithi161.stdout:2/113: dwrite de/d11/f1a [0,4194304] 0 2024-02-22T00:33:14.991 INFO:tasks.workunit.client.1.smithi161.stdout:2/114: chown f1 42706094 1 2024-02-22T00:33:14.993 INFO:tasks.workunit.client.1.smithi161.stdout:2/115: mknod de/d1e/c28 0 2024-02-22T00:33:14.996 INFO:tasks.workunit.client.1.smithi161.stdout:2/116: creat de/d11/f29 x:0 0 0 2024-02-22T00:33:14.998 INFO:tasks.workunit.client.1.smithi161.stdout:2/117: mknod de/c2a 0 2024-02-22T00:33:14.998 INFO:tasks.workunit.client.1.smithi161.stdout:2/118: chown de/d11 5233 1 2024-02-22T00:33:15.000 INFO:tasks.workunit.client.1.smithi161.stdout:2/119: mkdir de/d2b 0 2024-02-22T00:33:15.014 INFO:tasks.workunit.client.1.smithi161.stdout:8/137: sync 2024-02-22T00:33:15.014 INFO:tasks.workunit.client.1.smithi161.stdout:2/120: dwrite fc [0,4194304] 0 2024-02-22T00:33:15.014 INFO:tasks.workunit.client.1.smithi161.stdout:8/138: readlink d1/l14 0 2024-02-22T00:33:15.015 INFO:tasks.workunit.client.1.smithi161.stdout:8/139: truncate d1/d19/d18/f26 304465 0 2024-02-22T00:33:15.016 INFO:tasks.workunit.client.1.smithi161.stdout:2/121: mknod de/d2b/c2c 0 2024-02-22T00:33:15.016 INFO:tasks.workunit.client.1.smithi161.stdout:8/140: dread - d1/d19/d18/f25 zero size 2024-02-22T00:33:15.018 INFO:tasks.workunit.client.1.smithi161.stdout:8/141: truncate d1/d19/d18/f25 608029 0 2024-02-22T00:33:15.019 INFO:tasks.workunit.client.1.smithi161.stdout:2/122: link de/d11/f1a de/d2b/f2d 0 2024-02-22T00:33:15.021 INFO:tasks.workunit.client.1.smithi161.stdout:2/123: mknod de/c2e 0 2024-02-22T00:33:15.022 INFO:tasks.workunit.client.1.smithi161.stdout:8/142: rename d1/d19/f1b to d1/f29 0 2024-02-22T00:33:15.024 INFO:tasks.workunit.client.1.smithi161.stdout:2/124: write de/d11/f1a [4466546,99426] 0 2024-02-22T00:33:15.026 INFO:tasks.workunit.client.1.smithi161.stdout:8/143: link d1/c17 d1/d1c/d20/c2a 0 2024-02-22T00:33:15.030 INFO:tasks.workunit.client.1.smithi161.stdout:8/144: creat d1/d1c/d20/f2b x:0 0 0 2024-02-22T00:33:15.034 INFO:tasks.workunit.client.1.smithi161.stdout:8/145: rename d1/l27 to d1/d1c/d20/l2c 0 2024-02-22T00:33:15.038 INFO:tasks.workunit.client.1.smithi161.stdout:8/146: dread d1/ff [0,4194304] 0 2024-02-22T00:33:15.038 INFO:tasks.workunit.client.1.smithi161.stdout:2/125: truncate de/d11/d14/f22 12131 0 2024-02-22T00:33:15.040 INFO:tasks.workunit.client.1.smithi161.stdout:2/126: mknod de/d11/c2f 0 2024-02-22T00:33:15.041 INFO:tasks.workunit.client.1.smithi161.stdout:8/147: creat d1/f2d x:0 0 0 2024-02-22T00:33:15.044 INFO:tasks.workunit.client.1.smithi161.stdout:8/148: rename d1/ff to d1/d1c/d20/d22/d28/f2e 0 2024-02-22T00:33:15.049 INFO:tasks.workunit.client.1.smithi161.stdout:8/149: mkdir d1/d2f 0 2024-02-22T00:33:15.053 INFO:tasks.workunit.client.1.smithi161.stdout:8/150: unlink d1/d1c/d20/c2a 0 2024-02-22T00:33:15.056 INFO:tasks.workunit.client.1.smithi161.stdout:8/151: fdatasync d1/d19/d18/f25 0 2024-02-22T00:33:15.058 INFO:tasks.workunit.client.1.smithi161.stdout:2/127: dwrite de/d2b/f2d [0,4194304] 0 2024-02-22T00:33:15.060 INFO:tasks.workunit.client.1.smithi161.stdout:8/152: mkdir d1/d2f/d30 0 2024-02-22T00:33:15.062 INFO:tasks.workunit.client.1.smithi161.stdout:8/153: mkdir d1/d1c/d20/d31 0 2024-02-22T00:33:15.063 INFO:tasks.workunit.client.1.smithi161.stdout:2/128: dread fa [0,4194304] 0 2024-02-22T00:33:15.063 INFO:tasks.workunit.client.1.smithi161.stdout:8/154: rmdir d1/d19 39 2024-02-22T00:33:15.067 INFO:tasks.workunit.client.1.smithi161.stdout:2/129: getdents de/d11 0 2024-02-22T00:33:15.070 INFO:tasks.workunit.client.1.smithi161.stdout:2/130: creat de/d11/d14/d1f/f30 x:0 0 0 2024-02-22T00:33:15.073 INFO:tasks.workunit.client.1.smithi161.stdout:8/155: dwrite d1/d19/d18/f26 [0,4194304] 0 2024-02-22T00:33:15.075 INFO:tasks.workunit.client.1.smithi161.stdout:2/131: rename f1 to de/d1e/f31 0 2024-02-22T00:33:15.076 INFO:tasks.workunit.client.1.smithi161.stdout:8/156: fdatasync d1/d1c/d20/d22/d28/f2e 0 2024-02-22T00:33:15.080 INFO:tasks.workunit.client.1.smithi161.stdout:8/157: symlink d1/d2f/l32 0 2024-02-22T00:33:15.081 INFO:tasks.workunit.client.1.smithi161.stdout:8/158: write d1/f24 [411497,74801] 0 2024-02-22T00:33:15.082 INFO:tasks.workunit.client.1.smithi161.stdout:2/132: dread de/d2b/f2d [0,4194304] 0 2024-02-22T00:33:15.084 INFO:tasks.workunit.client.1.smithi161.stdout:2/133: chown de/d11/d14/d1f/c27 270 1 2024-02-22T00:33:15.085 INFO:tasks.workunit.client.1.smithi161.stdout:2/134: write fc [2526926,51981] 0 2024-02-22T00:33:15.088 INFO:tasks.workunit.client.1.smithi161.stdout:2/135: mkdir de/d11/d32 0 2024-02-22T00:33:15.089 INFO:tasks.workunit.client.1.smithi161.stdout:8/159: dwrite d1/d19/d18/f25 [0,4194304] 0 2024-02-22T00:33:15.093 INFO:tasks.workunit.client.1.smithi161.stdout:8/160: getdents d1/d1c/d20/d31 0 2024-02-22T00:33:15.095 INFO:tasks.workunit.client.1.smithi161.stdout:8/161: read d1/f12 [111728,81666] 0 2024-02-22T00:33:15.098 INFO:tasks.workunit.client.1.smithi161.stdout:8/162: creat d1/d2f/d30/f33 x:0 0 0 2024-02-22T00:33:15.100 INFO:tasks.workunit.client.1.smithi161.stdout:8/163: mknod d1/d1c/c34 0 2024-02-22T00:33:15.101 INFO:tasks.workunit.client.1.smithi161.stdout:8/164: creat d1/d1c/d20/d22/f35 x:0 0 0 2024-02-22T00:33:15.109 INFO:tasks.workunit.client.1.smithi161.stdout:8/165: dwrite d1/d2f/d30/f33 [0,4194304] 0 2024-02-22T00:33:15.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/166: dread d1/d19/f15 [0,4194304] 0 2024-02-22T00:33:15.117 INFO:tasks.workunit.client.1.smithi161.stdout:8/167: unlink d1/l3 0 2024-02-22T00:33:15.119 INFO:tasks.workunit.client.1.smithi161.stdout:8/168: fdatasync d1/d1c/d20/d22/f1f 0 2024-02-22T00:33:15.121 INFO:tasks.workunit.client.1.smithi161.stdout:8/169: chown d1/d1c/d20/d22/f35 769 1 2024-02-22T00:33:15.123 INFO:tasks.workunit.client.1.smithi161.stdout:8/170: mkdir d1/d1c/d20/d22/d28/d36 0 2024-02-22T00:33:15.125 INFO:tasks.workunit.client.1.smithi161.stdout:8/171: chown d1/d1c/d20/l2c 114103 1 2024-02-22T00:33:15.126 INFO:tasks.workunit.client.1.smithi161.stdout:8/172: write d1/d19/f16 [2726459,104377] 0 2024-02-22T00:33:15.129 INFO:tasks.workunit.client.1.smithi161.stdout:8/173: mkdir d1/d2f/d37 0 2024-02-22T00:33:15.129 INFO:tasks.workunit.client.1.smithi161.stdout:8/174: chown d1/c5 192567 1 2024-02-22T00:33:15.282 INFO:tasks.workunit.client.1.smithi161.stdout:0/162: sync 2024-02-22T00:33:15.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/76: sync 2024-02-22T00:33:15.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/77: rmdir - no directory 2024-02-22T00:33:15.283 INFO:tasks.workunit.client.1.smithi161.stdout:1/78: readlink lf 0 2024-02-22T00:33:15.285 INFO:tasks.workunit.client.1.smithi161.stdout:1/79: mkdir d19 0 2024-02-22T00:33:15.286 INFO:tasks.workunit.client.1.smithi161.stdout:1/80: write f11 [100161,80175] 0 2024-02-22T00:33:15.288 INFO:tasks.workunit.client.1.smithi161.stdout:1/81: creat d19/f1a x:0 0 0 2024-02-22T00:33:15.294 INFO:tasks.workunit.client.1.smithi161.stdout:0/163: dwrite d14/d1a/f2d [0,4194304] 0 2024-02-22T00:33:15.298 INFO:tasks.workunit.client.1.smithi161.stdout:0/164: dread fb [0,4194304] 0 2024-02-22T00:33:15.301 INFO:tasks.workunit.client.1.smithi161.stdout:0/165: unlink d14/d1a/f26 0 2024-02-22T00:33:15.302 INFO:tasks.workunit.client.1.smithi161.stdout:0/166: write d14/d1a/f28 [2378744,47265] 0 2024-02-22T00:33:15.303 INFO:tasks.workunit.client.1.smithi161.stdout:1/82: dread fa [0,4194304] 0 2024-02-22T00:33:15.308 INFO:tasks.workunit.client.1.smithi161.stdout:1/83: getdents d19 0 2024-02-22T00:33:15.308 INFO:tasks.workunit.client.1.smithi161.stdout:0/167: write d14/f2c [2185313,130663] 0 2024-02-22T00:33:15.310 INFO:tasks.workunit.client.1.smithi161.stdout:1/84: creat d19/f1b x:0 0 0 2024-02-22T00:33:15.312 INFO:tasks.workunit.client.1.smithi161.stdout:0/168: creat d14/d1a/d3f/f40 x:0 0 0 2024-02-22T00:33:15.313 INFO:tasks.workunit.client.1.smithi161.stdout:1/85: unlink f16 0 2024-02-22T00:33:15.314 INFO:tasks.workunit.client.1.smithi161.stdout:0/169: mknod d14/d1a/d3f/c41 0 2024-02-22T00:33:15.314 INFO:tasks.workunit.client.1.smithi161.stdout:0/170: stat d14/l20 0 2024-02-22T00:33:15.314 INFO:tasks.workunit.client.1.smithi161.stdout:1/86: symlink d19/l1c 0 2024-02-22T00:33:15.315 INFO:tasks.workunit.client.1.smithi161.stdout:0/171: chown c10 0 1 2024-02-22T00:33:15.315 INFO:tasks.workunit.client.1.smithi161.stdout:0/172: truncate d14/f35 675016 0 2024-02-22T00:33:15.316 INFO:tasks.workunit.client.1.smithi161.stdout:1/87: mkdir d19/d1d 0 2024-02-22T00:33:15.317 INFO:tasks.workunit.client.1.smithi161.stdout:0/173: fdatasync d14/f1f 0 2024-02-22T00:33:15.318 INFO:tasks.workunit.client.1.smithi161.stdout:1/88: symlink d19/d1d/l1e 0 2024-02-22T00:33:15.320 INFO:tasks.workunit.client.1.smithi161.stdout:1/89: creat d19/f1f x:0 0 0 2024-02-22T00:33:15.320 INFO:tasks.workunit.client.1.smithi161.stdout:0/174: mkdir d14/d37/d42 0 2024-02-22T00:33:15.321 INFO:tasks.workunit.client.1.smithi161.stdout:1/90: rename d19 to d19/d1d/d20 22 2024-02-22T00:33:15.322 INFO:tasks.workunit.client.1.smithi161.stdout:0/175: mknod d14/d1a/c43 0 2024-02-22T00:33:15.327 INFO:tasks.workunit.client.1.smithi161.stdout:0/176: mkdir d14/d44 0 2024-02-22T00:33:15.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/91: dwrite d19/f1b [0,4194304] 0 2024-02-22T00:33:15.329 INFO:tasks.workunit.client.1.smithi161.stdout:0/177: dread - d14/d1a/f24 zero size 2024-02-22T00:33:15.334 INFO:tasks.workunit.client.1.smithi161.stdout:0/178: chown l13 70569 1 2024-02-22T00:33:15.335 INFO:tasks.workunit.client.1.smithi161.stdout:1/92: symlink d19/d1d/l21 0 2024-02-22T00:33:15.339 INFO:tasks.workunit.client.1.smithi161.stdout:0/179: rename fa to d14/d37/f45 0 2024-02-22T00:33:15.341 INFO:tasks.workunit.client.1.smithi161.stdout:1/93: creat d19/d1d/f22 x:0 0 0 2024-02-22T00:33:15.342 INFO:tasks.workunit.client.1.smithi161.stdout:0/180: symlink d14/d37/d42/l46 0 2024-02-22T00:33:15.342 INFO:tasks.workunit.client.1.smithi161.stdout:1/94: write d19/f1a [506316,52744] 0 2024-02-22T00:33:15.342 INFO:tasks.workunit.client.1.smithi161.stdout:1/95: chown d19/d1d 410 1 2024-02-22T00:33:15.342 INFO:tasks.workunit.client.1.smithi161.stdout:0/181: readlink d14/d37/l39 0 2024-02-22T00:33:15.344 INFO:tasks.workunit.client.1.smithi161.stdout:0/182: symlink d14/d37/d42/l47 0 2024-02-22T00:33:15.345 INFO:tasks.workunit.client.1.smithi161.stdout:0/183: fsync d14/d1a/f3d 0 2024-02-22T00:33:15.349 INFO:tasks.workunit.client.1.smithi161.stdout:0/184: getdents d14/d29 0 2024-02-22T00:33:15.351 INFO:tasks.workunit.client.1.smithi161.stdout:1/96: truncate f7 228542 0 2024-02-22T00:33:15.352 INFO:tasks.workunit.client.1.smithi161.stdout:1/97: creat d19/f23 x:0 0 0 2024-02-22T00:33:15.353 INFO:tasks.workunit.client.1.smithi161.stdout:0/185: dread fb [0,4194304] 0 2024-02-22T00:33:15.353 INFO:tasks.workunit.client.1.smithi161.stdout:1/98: dread - d19/f23 zero size 2024-02-22T00:33:15.355 INFO:tasks.workunit.client.1.smithi161.stdout:1/99: symlink d19/l24 0 2024-02-22T00:33:15.355 INFO:tasks.workunit.client.1.smithi161.stdout:0/186: symlink d14/l48 0 2024-02-22T00:33:15.356 INFO:tasks.workunit.client.1.smithi161.stdout:0/187: chown d14/l15 14 1 2024-02-22T00:33:15.357 INFO:tasks.workunit.client.1.smithi161.stdout:1/100: fsync fa 0 2024-02-22T00:33:15.359 INFO:tasks.workunit.client.1.smithi161.stdout:1/101: truncate f15 1638021 0 2024-02-22T00:33:15.360 INFO:tasks.workunit.client.1.smithi161.stdout:0/188: rename d14/d1a/d3f/c41 to d14/c49 0 2024-02-22T00:33:15.361 INFO:tasks.workunit.client.1.smithi161.stdout:1/102: mknod d19/c25 0 2024-02-22T00:33:15.361 INFO:tasks.workunit.client.1.smithi161.stdout:0/189: truncate d14/f17 5179958 0 2024-02-22T00:33:15.362 INFO:tasks.workunit.client.1.smithi161.stdout:0/190: write d14/d1a/f2d [4260246,37657] 0 2024-02-22T00:33:15.362 INFO:tasks.workunit.client.1.smithi161.stdout:1/103: creat d19/f26 x:0 0 0 2024-02-22T00:33:15.364 INFO:tasks.workunit.client.1.smithi161.stdout:0/191: creat d14/f4a x:0 0 0 2024-02-22T00:33:15.367 INFO:tasks.workunit.client.1.smithi161.stdout:0/192: creat d14/f4b x:0 0 0 2024-02-22T00:33:15.368 INFO:tasks.workunit.client.1.smithi161.stdout:0/193: dread - d14/f25 zero size 2024-02-22T00:33:15.369 INFO:tasks.workunit.client.1.smithi161.stdout:1/104: rename f17 to d19/d1d/f27 0 2024-02-22T00:33:15.371 INFO:tasks.workunit.client.1.smithi161.stdout:0/194: creat d14/d1a/d3f/f4c x:0 0 0 2024-02-22T00:33:15.373 INFO:tasks.workunit.client.1.smithi161.stdout:1/105: truncate f11 302706 0 2024-02-22T00:33:15.377 INFO:tasks.workunit.client.1.smithi161.stdout:1/106: creat d19/d1d/f28 x:0 0 0 2024-02-22T00:33:15.380 INFO:tasks.workunit.client.1.smithi161.stdout:0/195: truncate f11 3601804 0 2024-02-22T00:33:15.381 INFO:tasks.workunit.client.1.smithi161.stdout:0/196: chown d14/d1a/l30 186555 1 2024-02-22T00:33:15.383 INFO:tasks.workunit.client.1.smithi161.stdout:0/197: truncate f8 2615162 0 2024-02-22T00:33:15.384 INFO:tasks.workunit.client.1.smithi161.stdout:1/107: dwrite f5 [0,4194304] 0 2024-02-22T00:33:15.386 INFO:tasks.workunit.client.1.smithi161.stdout:0/198: unlink fc 0 2024-02-22T00:33:15.390 INFO:tasks.workunit.client.1.smithi161.stdout:0/199: chown d14/d1a/l3c 18239 1 2024-02-22T00:33:15.393 INFO:tasks.workunit.client.1.smithi161.stdout:0/200: symlink d14/d1a/d3f/l4d 0 2024-02-22T00:33:15.395 INFO:tasks.workunit.client.1.smithi161.stdout:1/108: dwrite d19/f26 [0,4194304] 0 2024-02-22T00:33:15.397 INFO:tasks.workunit.client.1.smithi161.stdout:1/109: mknod d19/c29 0 2024-02-22T00:33:15.399 INFO:tasks.workunit.client.1.smithi161.stdout:1/110: write d19/f26 [2619510,50303] 0 2024-02-22T00:33:15.407 INFO:tasks.workunit.client.1.smithi161.stdout:0/201: truncate fb 1110130 0 2024-02-22T00:33:15.409 INFO:tasks.workunit.client.1.smithi161.stdout:0/202: write d14/f17 [2648964,23589] 0 2024-02-22T00:33:15.410 INFO:tasks.workunit.client.1.smithi161.stdout:1/111: rmdir d19 39 2024-02-22T00:33:15.412 INFO:tasks.workunit.client.1.smithi161.stdout:1/112: read d19/f26 [2141239,17318] 0 2024-02-22T00:33:15.414 INFO:tasks.workunit.client.1.smithi161.stdout:1/113: fsync d19/d1d/f27 0 2024-02-22T00:33:15.416 INFO:tasks.workunit.client.1.smithi161.stdout:1/114: truncate d19/f23 475830 0 2024-02-22T00:33:15.417 INFO:tasks.workunit.client.1.smithi161.stdout:1/115: read d19/f23 [416765,16740] 0 2024-02-22T00:33:15.418 INFO:tasks.workunit.client.1.smithi161.stdout:0/203: write fb [1609921,20837] 0 2024-02-22T00:33:15.420 INFO:tasks.workunit.client.1.smithi161.stdout:1/116: symlink d19/l2a 0 2024-02-22T00:33:15.422 INFO:tasks.workunit.client.1.smithi161.stdout:1/117: symlink d19/d1d/l2b 0 2024-02-22T00:33:15.428 INFO:tasks.workunit.client.1.smithi161.stdout:0/204: dwrite d14/d37/f45 [4194304,4194304] 0 2024-02-22T00:33:15.436 INFO:tasks.workunit.client.1.smithi161.stdout:0/205: fdatasync fd 0 2024-02-22T00:33:15.436 INFO:tasks.workunit.client.1.smithi161.stdout:1/118: dwrite d19/d1d/f27 [0,4194304] 0 2024-02-22T00:33:15.436 INFO:tasks.workunit.client.1.smithi161.stdout:0/206: dread - d14/f4b zero size 2024-02-22T00:33:15.436 INFO:tasks.workunit.client.1.smithi161.stdout:0/207: creat d14/d1a/f4e x:0 0 0 2024-02-22T00:33:15.439 INFO:tasks.workunit.client.1.smithi161.stdout:0/208: symlink d14/d37/d42/l4f 0 2024-02-22T00:33:15.440 INFO:tasks.workunit.client.1.smithi161.stdout:1/119: dread d19/f1a [0,4194304] 0 2024-02-22T00:33:15.444 INFO:tasks.workunit.client.1.smithi161.stdout:4/119: sync 2024-02-22T00:33:15.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/120: creat d5/d10/d14/f29 x:0 0 0 2024-02-22T00:33:15.448 INFO:tasks.workunit.client.1.smithi161.stdout:4/121: dread - d5/d10/f1b zero size 2024-02-22T00:33:15.452 INFO:tasks.workunit.client.1.smithi161.stdout:4/122: mknod d5/c2a 0 2024-02-22T00:33:15.453 INFO:tasks.workunit.client.1.smithi161.stdout:0/209: dwrite f3 [0,4194304] 0 2024-02-22T00:33:15.455 INFO:tasks.workunit.client.1.smithi161.stdout:4/123: mknod d5/d10/d14/d24/d28/c2b 0 2024-02-22T00:33:15.455 INFO:tasks.workunit.client.1.smithi161.stdout:4/124: dread - d5/f27 zero size 2024-02-22T00:33:15.456 INFO:tasks.workunit.client.1.smithi161.stdout:0/210: symlink d14/d44/l50 0 2024-02-22T00:33:15.459 INFO:tasks.workunit.client.1.smithi161.stdout:4/125: truncate d5/f6 1511181 0 2024-02-22T00:33:15.461 INFO:tasks.workunit.client.1.smithi161.stdout:0/211: rename d14/d1a/f4e to d14/f51 0 2024-02-22T00:33:15.463 INFO:tasks.workunit.client.1.smithi161.stdout:4/126: symlink d5/d10/d14/d24/l2c 0 2024-02-22T00:33:15.466 INFO:tasks.workunit.client.1.smithi161.stdout:4/127: creat d5/d10/d14/d24/d28/f2d x:0 0 0 2024-02-22T00:33:15.467 INFO:tasks.workunit.client.1.smithi161.stdout:0/212: getdents d14/d37 0 2024-02-22T00:33:15.467 INFO:tasks.workunit.client.1.smithi161.stdout:0/213: dread - d14/f25 zero size 2024-02-22T00:33:15.469 INFO:tasks.workunit.client.1.smithi161.stdout:4/128: symlink d5/d10/l2e 0 2024-02-22T00:33:15.470 INFO:tasks.workunit.client.1.smithi161.stdout:4/129: truncate d5/d10/f26 649698 0 2024-02-22T00:33:15.471 INFO:tasks.workunit.client.1.smithi161.stdout:0/214: dread f3 [0,4194304] 0 2024-02-22T00:33:15.473 INFO:tasks.workunit.client.1.smithi161.stdout:0/215: mknod d14/d1a/d3f/c52 0 2024-02-22T00:33:15.475 INFO:tasks.workunit.client.1.smithi161.stdout:4/130: dread f3 [0,4194304] 0 2024-02-22T00:33:15.476 INFO:tasks.workunit.client.1.smithi161.stdout:4/131: chown d5/d10/d14/f29 56 1 2024-02-22T00:33:15.484 INFO:tasks.workunit.client.1.smithi161.stdout:4/132: write d5/d10/f1b [689403,40559] 0 2024-02-22T00:33:15.488 INFO:tasks.workunit.client.1.smithi161.stdout:4/133: dread d5/d10/f1f [0,4194304] 0 2024-02-22T00:33:15.492 INFO:tasks.workunit.client.1.smithi161.stdout:4/134: link d5/d17/f1e d5/d8/f2f 0 2024-02-22T00:33:15.493 INFO:tasks.workunit.client.1.smithi161.stdout:4/135: mknod d5/d8/c30 0 2024-02-22T00:33:15.495 INFO:tasks.workunit.client.1.smithi161.stdout:4/136: creat d5/d17/f31 x:0 0 0 2024-02-22T00:33:15.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/137: mknod d5/d17/c32 0 2024-02-22T00:33:15.497 INFO:tasks.workunit.client.1.smithi161.stdout:4/138: rename d5/d10/d14/d24 to d5/d10/d14/d24/d33 22 2024-02-22T00:33:15.498 INFO:tasks.workunit.client.1.smithi161.stdout:4/139: write d5/d10/f1b [1659024,120249] 0 2024-02-22T00:33:15.501 INFO:tasks.workunit.client.1.smithi161.stdout:4/140: symlink d5/d10/l34 0 2024-02-22T00:33:15.503 INFO:tasks.workunit.client.1.smithi161.stdout:4/141: creat d5/d10/d14/d24/f35 x:0 0 0 2024-02-22T00:33:15.504 INFO:tasks.workunit.client.1.smithi161.stdout:4/142: fdatasync d5/d10/f26 0 2024-02-22T00:33:15.504 INFO:tasks.workunit.client.1.smithi161.stdout:4/143: chown d5/d17 0 1 2024-02-22T00:33:15.506 INFO:tasks.workunit.client.1.smithi161.stdout:4/144: rmdir d5/d10/d14/d24/d28 39 2024-02-22T00:33:15.696 INFO:tasks.workunit.client.1.smithi161.stdout:6/71: sync 2024-02-22T00:33:15.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/72: mkdir d3/d10/d12 0 2024-02-22T00:33:15.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/73: read - d3/fe zero size 2024-02-22T00:33:15.699 INFO:tasks.workunit.client.1.smithi161.stdout:6/74: dread - d3/fe zero size 2024-02-22T00:33:15.700 INFO:tasks.workunit.client.1.smithi161.stdout:6/75: readlink d3/dc/df/l11 0 2024-02-22T00:33:15.702 INFO:tasks.workunit.client.1.smithi161.stdout:6/76: creat d3/d10/f13 x:0 0 0 2024-02-22T00:33:15.703 INFO:tasks.workunit.client.1.smithi161.stdout:6/77: truncate d3/d10/fa 1765561 0 2024-02-22T00:33:15.706 INFO:tasks.workunit.client.1.smithi161.stdout:6/78: rename d3/d10/ld to d3/d10/d12/l14 0 2024-02-22T00:33:15.708 INFO:tasks.workunit.client.1.smithi161.stdout:6/79: creat d3/f15 x:0 0 0 2024-02-22T00:33:15.708 INFO:tasks.workunit.client.1.smithi161.stdout:6/80: write d3/d10/f13 [170688,64826] 0 2024-02-22T00:33:15.711 INFO:tasks.workunit.client.1.smithi161.stdout:6/81: mknod d3/dc/c16 0 2024-02-22T00:33:15.712 INFO:tasks.workunit.client.1.smithi161.stdout:6/82: symlink d3/dc/df/l17 0 2024-02-22T00:33:15.714 INFO:tasks.workunit.client.1.smithi161.stdout:6/83: mknod d3/d10/d12/c18 0 2024-02-22T00:33:15.714 INFO:tasks.workunit.client.1.smithi161.stdout:6/84: dread - d3/f15 zero size 2024-02-22T00:33:15.715 INFO:tasks.workunit.client.1.smithi161.stdout:6/85: chown d3/dc/c16 267222920 1 2024-02-22T00:33:15.716 INFO:tasks.workunit.client.1.smithi161.stdout:6/86: mknod d3/d10/d12/c19 0 2024-02-22T00:33:15.717 INFO:tasks.workunit.client.1.smithi161.stdout:6/87: write d3/d10/fa [585258,20155] 0 2024-02-22T00:33:15.718 INFO:tasks.workunit.client.1.smithi161.stdout:6/88: truncate d3/d10/fa 2736631 0 2024-02-22T00:33:15.719 INFO:tasks.workunit.client.1.smithi161.stdout:6/89: dread - d3/f15 zero size 2024-02-22T00:33:15.726 INFO:tasks.workunit.client.1.smithi161.stdout:6/90: write d3/f6 [766473,89687] 0 2024-02-22T00:33:15.728 INFO:tasks.workunit.client.1.smithi161.stdout:6/91: chown d3/c8 7226884 1 2024-02-22T00:33:15.766 INFO:tasks.workunit.client.1.smithi161.stdout:6/92: fsync d3/f6 0 2024-02-22T00:33:15.766 INFO:tasks.workunit.client.1.smithi161.stdout:6/93: read f0 [4993064,37866] 0 2024-02-22T00:33:15.768 INFO:tasks.workunit.client.1.smithi161.stdout:6/94: mknod d3/d10/c1a 0 2024-02-22T00:33:15.770 INFO:tasks.workunit.client.1.smithi161.stdout:6/95: mkdir d3/d10/d1b 0 2024-02-22T00:33:15.799 INFO:tasks.workunit.client.1.smithi161.stdout:5/193: sync 2024-02-22T00:33:15.812 INFO:tasks.workunit.client.1.smithi161.stdout:5/194: dread d3/d1c/d20/f12 [0,4194304] 0 2024-02-22T00:33:15.816 INFO:tasks.workunit.client.1.smithi161.stdout:5/195: creat d3/f3a x:0 0 0 2024-02-22T00:33:15.821 INFO:tasks.workunit.client.1.smithi161.stdout:5/196: dwrite d3/d1b/d25/f27 [0,4194304] 0 2024-02-22T00:33:15.825 INFO:tasks.workunit.client.1.smithi161.stdout:5/197: fdatasync d3/d1b/f1d 0 2024-02-22T00:33:15.904 INFO:tasks.workunit.client.1.smithi161.stdout:5/198: dwrite d3/f19 [0,4194304] 0 2024-02-22T00:33:15.907 INFO:tasks.workunit.client.1.smithi161.stdout:5/199: link d3/f3a d3/d1b/d36/f3b 0 2024-02-22T00:33:15.909 INFO:tasks.workunit.client.1.smithi161.stdout:5/200: symlink d3/d29/l3c 0 2024-02-22T00:33:15.910 INFO:tasks.workunit.client.1.smithi161.stdout:5/201: write d3/fc [4832051,47924] 0 2024-02-22T00:33:15.918 INFO:tasks.workunit.client.1.smithi161.stdout:5/202: write d3/f1a [4948493,38213] 0 2024-02-22T00:33:15.922 INFO:tasks.workunit.client.1.smithi161.stdout:5/203: dread d3/d1b/d25/f23 [0,4194304] 0 2024-02-22T00:33:15.925 INFO:tasks.workunit.client.1.smithi161.stdout:5/204: dread d3/d1b/d25/f27 [0,4194304] 0 2024-02-22T00:33:15.937 INFO:tasks.workunit.client.1.smithi161.stdout:5/205: dread d3/f5 [4194304,4194304] 0 2024-02-22T00:33:15.942 INFO:tasks.workunit.client.1.smithi161.stdout:5/206: dread d3/f24 [0,4194304] 0 2024-02-22T00:33:15.943 INFO:tasks.workunit.client.1.smithi161.stdout:7/154: sync 2024-02-22T00:33:15.944 INFO:tasks.workunit.client.1.smithi161.stdout:5/207: creat d3/d1b/d25/f3d x:0 0 0 2024-02-22T00:33:15.944 INFO:tasks.workunit.client.1.smithi161.stdout:7/155: fsync d3/f1b 0 2024-02-22T00:33:15.945 INFO:tasks.workunit.client.1.smithi161.stdout:5/208: dread - d3/d1b/f1d zero size 2024-02-22T00:33:15.947 INFO:tasks.workunit.client.1.smithi161.stdout:5/209: symlink d3/d1c/l3e 0 2024-02-22T00:33:15.949 INFO:tasks.workunit.client.1.smithi161.stdout:7/156: dread d3/df/d33/d35/f27 [0,4194304] 0 2024-02-22T00:33:15.950 INFO:tasks.workunit.client.1.smithi161.stdout:5/210: mknod d3/d1b/d36/c3f 0 2024-02-22T00:33:15.954 INFO:tasks.workunit.client.1.smithi161.stdout:5/211: dread d3/d1c/d20/f12 [0,4194304] 0 2024-02-22T00:33:15.955 INFO:tasks.workunit.client.1.smithi161.stdout:5/212: fsync d3/f7 0 2024-02-22T00:33:15.955 INFO:tasks.workunit.client.1.smithi161.stdout:7/157: link d3/dd/d24/f28 d3/dd/d24/d26/f3e 0 2024-02-22T00:33:15.959 INFO:tasks.workunit.client.1.smithi161.stdout:5/213: symlink d3/l40 0 2024-02-22T00:33:15.959 INFO:tasks.workunit.client.1.smithi161.stdout:5/214: fdatasync d3/d1b/f38 0 2024-02-22T00:33:15.961 INFO:tasks.workunit.client.1.smithi161.stdout:7/158: rename d3/df/d33/d35/f2c to d3/df/d33/d35/f3f 0 2024-02-22T00:33:15.964 INFO:tasks.workunit.client.1.smithi161.stdout:5/215: rename d3/c2a to d3/d1c/d20/c41 0 2024-02-22T00:33:15.964 INFO:tasks.workunit.client.1.smithi161.stdout:5/216: dread - d3/f3a zero size 2024-02-22T00:33:15.965 INFO:tasks.workunit.client.1.smithi161.stdout:7/159: creat d3/df/d33/f40 x:0 0 0 2024-02-22T00:33:15.966 INFO:tasks.workunit.client.1.smithi161.stdout:7/160: dread - d3/df/d33/f40 zero size 2024-02-22T00:33:15.969 INFO:tasks.workunit.client.1.smithi161.stdout:7/161: symlink d3/l41 0 2024-02-22T00:33:15.975 INFO:tasks.workunit.client.1.smithi161.stdout:7/162: stat d3/df/d33/d35/f3f 0 2024-02-22T00:33:15.979 INFO:tasks.workunit.client.1.smithi161.stdout:5/217: dread d3/f5 [0,4194304] 0 2024-02-22T00:33:15.980 INFO:tasks.workunit.client.1.smithi161.stdout:7/163: mknod d3/df/d33/d35/c42 0 2024-02-22T00:33:15.980 INFO:tasks.workunit.client.1.smithi161.stdout:7/164: readlink d3/dd/l15 0 2024-02-22T00:33:15.982 INFO:tasks.workunit.client.1.smithi161.stdout:7/165: mkdir d3/df/d43 0 2024-02-22T00:33:15.983 INFO:tasks.workunit.client.1.smithi161.stdout:5/218: write d3/d1b/f1d [275084,82186] 0 2024-02-22T00:33:15.985 INFO:tasks.workunit.client.1.smithi161.stdout:5/219: creat d3/d1c/d20/f42 x:0 0 0 2024-02-22T00:33:15.987 INFO:tasks.workunit.client.1.smithi161.stdout:5/220: mknod d3/d1b/d25/c43 0 2024-02-22T00:33:15.990 INFO:tasks.workunit.client.1.smithi161.stdout:7/166: dwrite d3/dd/fe [0,4194304] 0 2024-02-22T00:33:15.991 INFO:tasks.workunit.client.1.smithi161.stdout:5/221: rename d3/d1c/d20/f42 to d3/d1c/f44 0 2024-02-22T00:33:16.001 INFO:tasks.workunit.client.1.smithi161.stdout:5/222: dwrite d3/d1b/d25/f27 [0,4194304] 0 2024-02-22T00:33:16.007 INFO:tasks.workunit.client.1.smithi161.stdout:5/223: creat d3/d29/f45 x:0 0 0 2024-02-22T00:33:16.008 INFO:tasks.workunit.client.1.smithi161.stdout:5/224: symlink d3/l46 0 2024-02-22T00:33:16.011 INFO:tasks.workunit.client.1.smithi161.stdout:7/167: dread d3/dd/d24/f28 [0,4194304] 0 2024-02-22T00:33:16.013 INFO:tasks.workunit.client.1.smithi161.stdout:5/225: dread d3/d1c/d20/f12 [0,4194304] 0 2024-02-22T00:33:16.014 INFO:tasks.workunit.client.1.smithi161.stdout:7/168: mkdir d3/dd/d24/d26/d30/d44 0 2024-02-22T00:33:16.014 INFO:tasks.workunit.client.1.smithi161.stdout:5/226: read d3/d1b/d25/f39 [1702668,130100] 0 2024-02-22T00:33:16.016 INFO:tasks.workunit.client.1.smithi161.stdout:7/169: creat d3/df/d33/f45 x:0 0 0 2024-02-22T00:33:16.016 INFO:tasks.workunit.client.1.smithi161.stdout:7/170: chown d3/df/c1e 554 1 2024-02-22T00:33:16.017 INFO:tasks.workunit.client.1.smithi161.stdout:5/227: mkdir d3/d1c/d47 0 2024-02-22T00:33:16.017 INFO:tasks.workunit.client.1.smithi161.stdout:7/171: symlink d3/df/d33/l46 0 2024-02-22T00:33:16.020 INFO:tasks.workunit.client.1.smithi161.stdout:7/172: fsync d3/df/d33/d35/f27 0 2024-02-22T00:33:16.023 INFO:tasks.workunit.client.1.smithi161.stdout:7/173: write d3/dd/fe [4385089,130380] 0 2024-02-22T00:33:16.024 INFO:tasks.workunit.client.1.smithi161.stdout:7/174: chown f2 2 1 2024-02-22T00:33:16.027 INFO:tasks.workunit.client.1.smithi161.stdout:7/175: truncate d3/dd/d24/d26/f29 1398209 0 2024-02-22T00:33:16.028 INFO:tasks.workunit.client.1.smithi161.stdout:7/176: chown d3/dd/l23 1 1 2024-02-22T00:33:16.029 INFO:tasks.workunit.client.1.smithi161.stdout:5/228: dwrite d3/f26 [4194304,4194304] 0 2024-02-22T00:33:16.031 INFO:tasks.workunit.client.1.smithi161.stdout:7/177: unlink d3/df/l12 0 2024-02-22T00:33:16.034 INFO:tasks.workunit.client.1.smithi161.stdout:5/229: rmdir d3/d1c/d47 0 2024-02-22T00:33:16.037 INFO:tasks.workunit.client.1.smithi161.stdout:7/178: unlink d3/df/l16 0 2024-02-22T00:33:16.042 INFO:tasks.workunit.client.1.smithi161.stdout:5/230: dwrite d3/d1b/f1d [0,4194304] 0 2024-02-22T00:33:16.046 INFO:tasks.workunit.client.1.smithi161.stdout:5/231: creat d3/d1c/f48 x:0 0 0 2024-02-22T00:33:16.047 INFO:tasks.workunit.client.1.smithi161.stdout:7/179: dwrite f2 [4194304,4194304] 0 2024-02-22T00:33:16.051 INFO:tasks.workunit.client.1.smithi161.stdout:5/232: mknod d3/d1b/c49 0 2024-02-22T00:33:16.052 INFO:tasks.workunit.client.1.smithi161.stdout:5/233: creat d3/d29/f4a x:0 0 0 2024-02-22T00:33:16.055 INFO:tasks.workunit.client.1.smithi161.stdout:5/234: mknod d3/d1c/d20/c4b 0 2024-02-22T00:33:16.056 INFO:tasks.workunit.client.1.smithi161.stdout:5/235: write d3/fc [2430488,114668] 0 2024-02-22T00:33:16.056 INFO:tasks.workunit.client.1.smithi161.stdout:7/180: symlink d3/df/d33/l47 0 2024-02-22T00:33:16.058 INFO:tasks.workunit.client.1.smithi161.stdout:5/236: chown d3/f15 56769 1 2024-02-22T00:33:16.062 INFO:tasks.workunit.client.1.smithi161.stdout:7/181: dread f2 [0,4194304] 0 2024-02-22T00:33:16.065 INFO:tasks.workunit.client.1.smithi161.stdout:7/182: symlink d3/df/d43/l48 0 2024-02-22T00:33:16.067 INFO:tasks.workunit.client.1.smithi161.stdout:5/237: dwrite d3/f19 [0,4194304] 0 2024-02-22T00:33:16.068 INFO:tasks.workunit.client.1.smithi161.stdout:5/238: read - d3/f3a zero size 2024-02-22T00:33:16.068 INFO:tasks.workunit.client.1.smithi161.stdout:5/239: chown d3/d29/f4a 220077994 1 2024-02-22T00:33:16.069 INFO:tasks.workunit.client.1.smithi161.stdout:7/183: mknod d3/df/d3c/c49 0 2024-02-22T00:33:16.070 INFO:tasks.workunit.client.1.smithi161.stdout:9/185: sync 2024-02-22T00:33:16.071 INFO:tasks.workunit.client.1.smithi161.stdout:5/240: rmdir d3/d1c 39 2024-02-22T00:33:16.072 INFO:tasks.workunit.client.1.smithi161.stdout:7/184: fsync d3/f7 0 2024-02-22T00:33:16.074 INFO:tasks.workunit.client.1.smithi161.stdout:5/241: mkdir d3/d1b/d25/d4c 0 2024-02-22T00:33:16.074 INFO:tasks.workunit.client.1.smithi161.stdout:7/185: read d3/df/d33/d35/f3f [1835113,39633] 0 2024-02-22T00:33:16.075 INFO:tasks.workunit.client.1.smithi161.stdout:5/242: dread - d3/d1b/f38 zero size 2024-02-22T00:33:16.076 INFO:tasks.workunit.client.1.smithi161.stdout:9/186: dread d1/d2/d7/f16 [0,4194304] 0 2024-02-22T00:33:16.077 INFO:tasks.workunit.client.1.smithi161.stdout:5/243: chown d3/f5 1926517090 1 2024-02-22T00:33:16.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/186: write d3/df/d33/f40 [312047,14847] 0 2024-02-22T00:33:16.078 INFO:tasks.workunit.client.1.smithi161.stdout:5/244: chown d3/d29/f4a 3 1 2024-02-22T00:33:16.078 INFO:tasks.workunit.client.1.smithi161.stdout:9/187: write d1/d2/d7/da/f13 [780702,35764] 0 2024-02-22T00:33:16.081 INFO:tasks.workunit.client.1.smithi161.stdout:7/187: creat d3/df/f4a x:0 0 0 2024-02-22T00:33:16.083 INFO:tasks.workunit.client.1.smithi161.stdout:9/188: creat d1/d2/f3d x:0 0 0 2024-02-22T00:33:16.085 INFO:tasks.workunit.client.1.smithi161.stdout:5/245: link d3/fc d3/d1b/d36/f4d 0 2024-02-22T00:33:16.085 INFO:tasks.workunit.client.1.smithi161.stdout:7/188: creat d3/df/d33/f4b x:0 0 0 2024-02-22T00:33:16.086 INFO:tasks.workunit.client.1.smithi161.stdout:5/246: dread - d3/d1b/f38 zero size 2024-02-22T00:33:16.087 INFO:tasks.workunit.client.1.smithi161.stdout:5/247: fdatasync d3/d29/f4a 0 2024-02-22T00:33:16.089 INFO:tasks.workunit.client.1.smithi161.stdout:5/248: fsync d3/d1c/d20/f12 0 2024-02-22T00:33:16.092 INFO:tasks.workunit.client.1.smithi161.stdout:5/249: symlink d3/d1c/d20/l4e 0 2024-02-22T00:33:16.092 INFO:tasks.workunit.client.1.smithi161.stdout:9/189: dwrite d1/d2/d4/d11/f28 [0,4194304] 0 2024-02-22T00:33:16.092 INFO:tasks.workunit.client.1.smithi161.stdout:5/250: read d3/fc [3526454,14344] 0 2024-02-22T00:33:16.093 INFO:tasks.workunit.client.1.smithi161.stdout:5/251: write d3/d29/f4a [995132,34683] 0 2024-02-22T00:33:16.095 INFO:tasks.workunit.client.1.smithi161.stdout:2/136: sync 2024-02-22T00:33:16.095 INFO:tasks.workunit.client.1.smithi161.stdout:3/107: sync 2024-02-22T00:33:16.095 INFO:tasks.workunit.client.1.smithi161.stdout:8/175: sync 2024-02-22T00:33:16.095 INFO:tasks.workunit.client.1.smithi161.stdout:4/145: sync 2024-02-22T00:33:16.095 INFO:tasks.workunit.client.1.smithi161.stdout:0/216: sync 2024-02-22T00:33:16.095 INFO:tasks.workunit.client.1.smithi161.stdout:6/96: sync 2024-02-22T00:33:16.097 INFO:tasks.workunit.client.1.smithi161.stdout:1/120: sync 2024-02-22T00:33:16.097 INFO:tasks.workunit.client.1.smithi161.stdout:9/190: creat d1/d5/f3e x:0 0 0 2024-02-22T00:33:16.101 INFO:tasks.workunit.client.1.smithi161.stdout:5/252: rename d3/l1e to d3/d1b/d25/l4f 0 2024-02-22T00:33:16.101 INFO:tasks.workunit.client.1.smithi161.stdout:0/217: rename d14 to d14/d53 22 2024-02-22T00:33:16.149 INFO:tasks.workunit.client.1.smithi161.stdout:2/137: mkdir de/d11/d14/d1f/d33 0 2024-02-22T00:33:16.149 INFO:tasks.workunit.client.1.smithi161.stdout:0/218: readlink d14/d37/d42/l4f 0 2024-02-22T00:33:16.151 INFO:tasks.workunit.client.1.smithi161.stdout:5/253: mkdir d3/d1c/d50 0 2024-02-22T00:33:16.153 INFO:tasks.workunit.client.1.smithi161.stdout:9/191: mkdir d1/d2/d7/d3f 0 2024-02-22T00:33:16.154 INFO:tasks.workunit.client.1.smithi161.stdout:3/108: dwrite da/f1a [0,4194304] 0 2024-02-22T00:33:16.155 INFO:tasks.workunit.client.1.smithi161.stdout:5/254: write d3/d29/f4a [360974,16281] 0 2024-02-22T00:33:16.159 INFO:tasks.workunit.client.1.smithi161.stdout:0/219: write d14/f51 [142223,117015] 0 2024-02-22T00:33:16.160 INFO:tasks.workunit.client.1.smithi161.stdout:2/138: rename de/d11/d14/f22 to de/d11/d14/f34 0 2024-02-22T00:33:16.161 INFO:tasks.workunit.client.1.smithi161.stdout:5/255: chown d3 423115 1 2024-02-22T00:33:16.162 INFO:tasks.workunit.client.1.smithi161.stdout:1/121: dwrite f5 [0,4194304] 0 2024-02-22T00:33:16.162 INFO:tasks.workunit.client.1.smithi161.stdout:0/220: fdatasync d14/d1a/f3d 0 2024-02-22T00:33:16.163 INFO:tasks.workunit.client.1.smithi161.stdout:2/139: dread - de/f1c zero size 2024-02-22T00:33:16.164 INFO:tasks.workunit.client.1.smithi161.stdout:4/146: write d5/fe [1659489,88132] 0 2024-02-22T00:33:16.168 INFO:tasks.workunit.client.1.smithi161.stdout:1/122: truncate f11 1072220 0 2024-02-22T00:33:16.168 INFO:tasks.workunit.client.1.smithi161.stdout:6/97: truncate d3/d10/fa 1239197 0 2024-02-22T00:33:16.168 INFO:tasks.workunit.client.1.smithi161.stdout:9/192: symlink d1/d2/d4/l40 0 2024-02-22T00:33:16.168 INFO:tasks.workunit.client.1.smithi161.stdout:3/109: creat da/dc/f1f x:0 0 0 2024-02-22T00:33:16.168 INFO:tasks.workunit.client.1.smithi161.stdout:1/123: mkdir d19/d1d/d2c 0 2024-02-22T00:33:16.170 INFO:tasks.workunit.client.1.smithi161.stdout:6/98: symlink d3/l1c 0 2024-02-22T00:33:16.172 INFO:tasks.workunit.client.1.smithi161.stdout:4/147: symlink d5/l36 0 2024-02-22T00:33:16.172 INFO:tasks.workunit.client.1.smithi161.stdout:6/99: write d3/fe [633707,126449] 0 2024-02-22T00:33:16.173 INFO:tasks.workunit.client.1.smithi161.stdout:6/100: chown d3/dc 26520 1 2024-02-22T00:33:16.173 INFO:tasks.workunit.client.1.smithi161.stdout:0/221: rename cf to d14/d44/c54 0 2024-02-22T00:33:16.174 INFO:tasks.workunit.client.1.smithi161.stdout:3/110: unlink da/l1d 0 2024-02-22T00:33:16.176 INFO:tasks.workunit.client.1.smithi161.stdout:3/111: write da/dc/fe [2448854,116116] 0 2024-02-22T00:33:16.177 INFO:tasks.workunit.client.1.smithi161.stdout:5/256: creat d3/d1b/d25/d4c/f51 x:0 0 0 2024-02-22T00:33:16.178 INFO:tasks.workunit.client.1.smithi161.stdout:2/140: mkdir de/d11/d14/d1f/d33/d35 0 2024-02-22T00:33:16.179 INFO:tasks.workunit.client.1.smithi161.stdout:5/257: fdatasync d3/f5 0 2024-02-22T00:33:16.180 INFO:tasks.workunit.client.1.smithi161.stdout:6/101: dread d3/d10/f13 [0,4194304] 0 2024-02-22T00:33:16.180 INFO:tasks.workunit.client.1.smithi161.stdout:1/124: write f1 [1511648,87440] 0 2024-02-22T00:33:16.181 INFO:tasks.workunit.client.1.smithi161.stdout:2/141: chown de/c2e 86246 1 2024-02-22T00:33:16.185 INFO:tasks.workunit.client.1.smithi161.stdout:4/148: getdents d5/d10/d14 0 2024-02-22T00:33:16.187 INFO:tasks.workunit.client.1.smithi161.stdout:6/102: write d3/f15 [316423,14307] 0 2024-02-22T00:33:16.188 INFO:tasks.workunit.client.1.smithi161.stdout:5/258: creat d3/d1b/d36/f52 x:0 0 0 2024-02-22T00:33:16.190 INFO:tasks.workunit.client.1.smithi161.stdout:2/142: creat de/d11/d14/d1f/f36 x:0 0 0 2024-02-22T00:33:16.191 INFO:tasks.workunit.client.1.smithi161.stdout:1/125: mkdir d19/d1d/d2c/d2d 0 2024-02-22T00:33:16.193 INFO:tasks.workunit.client.1.smithi161.stdout:3/112: dread f7 [0,4194304] 0 2024-02-22T00:33:16.194 INFO:tasks.workunit.client.1.smithi161.stdout:5/259: creat d3/d1b/d25/f53 x:0 0 0 2024-02-22T00:33:16.195 INFO:tasks.workunit.client.1.smithi161.stdout:0/222: dwrite d14/f4b [0,4194304] 0 2024-02-22T00:33:16.196 INFO:tasks.workunit.client.1.smithi161.stdout:2/143: dread - de/d11/d14/d1f/f36 zero size 2024-02-22T00:33:16.196 INFO:tasks.workunit.client.1.smithi161.stdout:3/113: fsync f7 0 2024-02-22T00:33:16.197 INFO:tasks.workunit.client.1.smithi161.stdout:4/149: symlink d5/d10/d14/d24/l37 0 2024-02-22T00:33:16.199 INFO:tasks.workunit.client.1.smithi161.stdout:6/103: rename d3/d10/d12/c18 to d3/d10/d12/c1d 0 2024-02-22T00:33:16.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/126: creat d19/d1d/d2c/f2e x:0 0 0 2024-02-22T00:33:16.200 INFO:tasks.workunit.client.1.smithi161.stdout:0/223: write d14/d1a/f38 [1153319,105002] 0 2024-02-22T00:33:16.202 INFO:tasks.workunit.client.1.smithi161.stdout:5/260: rename d3/fc to d3/d1c/d20/f54 0 2024-02-22T00:33:16.202 INFO:tasks.workunit.client.1.smithi161.stdout:2/144: write de/d11/f13 [2719036,689] 0 2024-02-22T00:33:16.203 INFO:tasks.workunit.client.1.smithi161.stdout:9/193: dwrite d1/d2/d4/f3b [4194304,4194304] 0 2024-02-22T00:33:16.203 INFO:tasks.workunit.client.1.smithi161.stdout:0/224: stat d14/d1a/f2d 0 2024-02-22T00:33:16.206 INFO:tasks.workunit.client.1.smithi161.stdout:3/114: unlink da/dc/l1b 0 2024-02-22T00:33:16.208 INFO:tasks.workunit.client.1.smithi161.stdout:5/261: chown d3/d1b/d36/f3b 21 1 2024-02-22T00:33:16.208 INFO:tasks.workunit.client.1.smithi161.stdout:1/127: truncate d19/f26 4103062 0 2024-02-22T00:33:16.208 INFO:tasks.workunit.client.1.smithi161.stdout:0/225: mknod d14/d37/c55 0 2024-02-22T00:33:16.210 INFO:tasks.workunit.client.1.smithi161.stdout:2/145: mkdir de/d37 0 2024-02-22T00:33:16.211 INFO:tasks.workunit.client.1.smithi161.stdout:4/150: mkdir d5/d10/d14/d24/d28/d38 0 2024-02-22T00:33:16.212 INFO:tasks.workunit.client.1.smithi161.stdout:2/146: chown de/d11/d14/d1f/d33 1463875 1 2024-02-22T00:33:16.214 INFO:tasks.workunit.client.1.smithi161.stdout:3/115: creat da/dc/d11/f20 x:0 0 0 2024-02-22T00:33:16.215 INFO:tasks.workunit.client.1.smithi161.stdout:2/147: fdatasync de/f1c 0 2024-02-22T00:33:16.215 INFO:tasks.workunit.client.1.smithi161.stdout:1/128: mkdir d19/d2f 0 2024-02-22T00:33:16.215 INFO:tasks.workunit.client.1.smithi161.stdout:3/116: readlink l9 0 2024-02-22T00:33:16.218 INFO:tasks.workunit.client.1.smithi161.stdout:9/194: dread d1/d2/fd [0,4194304] 0 2024-02-22T00:33:16.219 INFO:tasks.workunit.client.1.smithi161.stdout:0/226: link d14/f4a d14/f56 0 2024-02-22T00:33:16.219 INFO:tasks.workunit.client.1.smithi161.stdout:4/151: symlink d5/d10/d14/d24/l39 0 2024-02-22T00:33:16.220 INFO:tasks.workunit.client.1.smithi161.stdout:3/117: creat da/dc/d16/f21 x:0 0 0 2024-02-22T00:33:16.221 INFO:tasks.workunit.client.1.smithi161.stdout:2/148: mknod de/c38 0 2024-02-22T00:33:16.222 INFO:tasks.workunit.client.1.smithi161.stdout:5/262: dwrite d3/d1b/f38 [0,4194304] 0 2024-02-22T00:33:16.223 INFO:tasks.workunit.client.1.smithi161.stdout:9/195: write d1/d2/f1a [6324428,7993] 0 2024-02-22T00:33:16.224 INFO:tasks.workunit.client.1.smithi161.stdout:1/129: rename l18 to d19/d1d/d2c/l30 0 2024-02-22T00:33:16.226 INFO:tasks.workunit.client.1.smithi161.stdout:0/227: write d14/d1a/f38 [2056855,90168] 0 2024-02-22T00:33:16.226 INFO:tasks.workunit.client.1.smithi161.stdout:2/149: rename de to de/d1e/d39 22 2024-02-22T00:33:16.228 INFO:tasks.workunit.client.1.smithi161.stdout:6/104: getdents d3/d10/d12 0 2024-02-22T00:33:16.229 INFO:tasks.workunit.client.1.smithi161.stdout:2/150: chown de/d1e/f24 40 1 2024-02-22T00:33:16.235 INFO:tasks.workunit.client.1.smithi161.stdout:6/105: mknod d3/d10/d12/c1e 0 2024-02-22T00:33:16.235 INFO:tasks.workunit.client.1.smithi161.stdout:0/228: symlink d14/d1a/l57 0 2024-02-22T00:33:16.237 INFO:tasks.workunit.client.1.smithi161.stdout:1/130: getdents d19/d2f 0 2024-02-22T00:33:16.238 INFO:tasks.workunit.client.1.smithi161.stdout:3/118: dwrite da/dc/d11/f20 [0,4194304] 0 2024-02-22T00:33:16.242 INFO:tasks.workunit.client.1.smithi161.stdout:6/106: write d3/d10/f13 [782801,28365] 0 2024-02-22T00:33:16.242 INFO:tasks.workunit.client.1.smithi161.stdout:3/119: readlink l9 0 2024-02-22T00:33:16.242 INFO:tasks.workunit.client.1.smithi161.stdout:0/229: rename d14/d1a/l3a to d14/l58 0 2024-02-22T00:33:16.246 INFO:tasks.workunit.client.1.smithi161.stdout:4/152: write d5/d8/f2f [348795,100748] 0 2024-02-22T00:33:16.246 INFO:tasks.workunit.client.1.smithi161.stdout:9/196: write d1/d2/fd [289287,29562] 0 2024-02-22T00:33:16.248 INFO:tasks.workunit.client.1.smithi161.stdout:2/151: write f3 [1407918,75888] 0 2024-02-22T00:33:16.252 INFO:tasks.workunit.client.1.smithi161.stdout:5/263: truncate d3/fe 4184790 0 2024-02-22T00:33:16.257 INFO:tasks.workunit.client.1.smithi161.stdout:6/107: link d3/d10/fa d3/dc/df/f1f 0 2024-02-22T00:33:16.258 INFO:tasks.workunit.client.1.smithi161.stdout:2/152: mkdir de/d1e/d3a 0 2024-02-22T00:33:16.258 INFO:tasks.workunit.client.1.smithi161.stdout:1/131: dwrite d19/d1d/f22 [0,4194304] 0 2024-02-22T00:33:16.259 INFO:tasks.workunit.client.1.smithi161.stdout:4/153: mknod d5/d10/d14/c3a 0 2024-02-22T00:33:16.260 INFO:tasks.workunit.client.1.smithi161.stdout:5/264: creat d3/d1b/d36/f55 x:0 0 0 2024-02-22T00:33:16.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/197: truncate d1/d2/d4/d1f/f35 827959 0 2024-02-22T00:33:16.266 INFO:tasks.workunit.client.1.smithi161.stdout:6/108: chown d3/d10/l7 2337 1 2024-02-22T00:33:16.266 INFO:tasks.workunit.client.1.smithi161.stdout:0/230: dwrite d14/f4b [4194304,4194304] 0 2024-02-22T00:33:16.266 INFO:tasks.workunit.client.1.smithi161.stdout:2/153: symlink de/d2b/l3b 0 2024-02-22T00:33:16.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/198: chown d1/d25 545182 1 2024-02-22T00:33:16.266 INFO:tasks.workunit.client.1.smithi161.stdout:3/120: dread da/dc/d16/f19 [0,4194304] 0 2024-02-22T00:33:16.267 INFO:tasks.workunit.client.1.smithi161.stdout:4/154: mknod d5/d10/c3b 0 2024-02-22T00:33:16.268 INFO:tasks.workunit.client.1.smithi161.stdout:1/132: mknod d19/d1d/d2c/c31 0 2024-02-22T00:33:16.268 INFO:tasks.workunit.client.1.smithi161.stdout:9/199: chown d1/d5/d9/d33 0 1 2024-02-22T00:33:16.270 INFO:tasks.workunit.client.1.smithi161.stdout:4/155: stat d5/d10/d14/f29 0 2024-02-22T00:33:16.270 INFO:tasks.workunit.client.1.smithi161.stdout:9/200: dread - d1/d2/f2e zero size 2024-02-22T00:33:16.274 INFO:tasks.workunit.client.1.smithi161.stdout:3/121: dread f7 [0,4194304] 0 2024-02-22T00:33:16.276 INFO:tasks.workunit.client.1.smithi161.stdout:1/133: dread f10 [0,4194304] 0 2024-02-22T00:33:16.276 INFO:tasks.workunit.client.1.smithi161.stdout:3/122: fsync da/dc/fd 0 2024-02-22T00:33:16.282 INFO:tasks.workunit.client.1.smithi161.stdout:2/154: symlink de/d11/d32/l3c 0 2024-02-22T00:33:16.282 INFO:tasks.workunit.client.1.smithi161.stdout:5/265: write d3/d1b/d36/f3b [298809,53945] 0 2024-02-22T00:33:16.283 INFO:tasks.workunit.client.1.smithi161.stdout:6/109: write d3/dc/df/f1f [1423750,51104] 0 2024-02-22T00:33:16.283 INFO:tasks.workunit.client.1.smithi161.stdout:1/134: symlink d19/l32 0 2024-02-22T00:33:16.284 INFO:tasks.workunit.client.1.smithi161.stdout:6/110: readlink d3/dc/df/l11 0 2024-02-22T00:33:16.286 INFO:tasks.workunit.client.1.smithi161.stdout:4/156: creat d5/d10/d14/d24/f3c x:0 0 0 2024-02-22T00:33:16.287 INFO:tasks.workunit.client.1.smithi161.stdout:0/231: getdents d14 0 2024-02-22T00:33:16.288 INFO:tasks.workunit.client.1.smithi161.stdout:4/157: fsync d5/d10/d14/f20 0 2024-02-22T00:33:16.288 INFO:tasks.workunit.client.1.smithi161.stdout:2/155: creat de/f3d x:0 0 0 2024-02-22T00:33:16.290 INFO:tasks.workunit.client.1.smithi161.stdout:2/156: chown de/d1e/f31 281 1 2024-02-22T00:33:16.291 INFO:tasks.workunit.client.1.smithi161.stdout:6/111: mknod d3/dc/c20 0 2024-02-22T00:33:16.291 INFO:tasks.workunit.client.1.smithi161.stdout:1/135: read f2 [2155410,13893] 0 2024-02-22T00:33:16.291 INFO:tasks.workunit.client.1.smithi161.stdout:3/123: link da/dc/d11/c15 da/dc/d16/c22 0 2024-02-22T00:33:16.293 INFO:tasks.workunit.client.1.smithi161.stdout:0/232: unlink d14/l2f 0 2024-02-22T00:33:16.294 INFO:tasks.workunit.client.1.smithi161.stdout:0/233: write d14/d1a/f28 [3899081,80780] 0 2024-02-22T00:33:16.295 INFO:tasks.workunit.client.1.smithi161.stdout:4/158: creat d5/d10/d14/f3d x:0 0 0 2024-02-22T00:33:16.295 INFO:tasks.workunit.client.1.smithi161.stdout:4/159: read - d5/d17/f31 zero size 2024-02-22T00:33:16.297 INFO:tasks.workunit.client.1.smithi161.stdout:5/266: rename d3/d1b/c2c to d3/d1b/c56 0 2024-02-22T00:33:16.298 INFO:tasks.workunit.client.1.smithi161.stdout:5/267: chown d3/d1b/d25/f53 139 1 2024-02-22T00:33:16.301 INFO:tasks.workunit.client.1.smithi161.stdout:3/124: mknod da/dc/d11/c23 0 2024-02-22T00:33:16.301 INFO:tasks.workunit.client.1.smithi161.stdout:3/125: chown f7 456 1 2024-02-22T00:33:16.302 INFO:tasks.workunit.client.1.smithi161.stdout:4/160: mknod d5/d10/c3e 0 2024-02-22T00:33:16.303 INFO:tasks.workunit.client.1.smithi161.stdout:2/157: creat de/d1e/d3a/f3e x:0 0 0 2024-02-22T00:33:16.303 INFO:tasks.workunit.client.1.smithi161.stdout:4/161: chown d5/d10/d14/f20 1760 1 2024-02-22T00:33:16.304 INFO:tasks.workunit.client.1.smithi161.stdout:1/136: mknod d19/d1d/d2c/d2d/c33 0 2024-02-22T00:33:16.304 INFO:tasks.workunit.client.1.smithi161.stdout:4/162: dread - d5/f27 zero size 2024-02-22T00:33:16.304 INFO:tasks.workunit.client.1.smithi161.stdout:5/268: creat d3/d1b/f57 x:0 0 0 2024-02-22T00:33:16.307 INFO:tasks.workunit.client.1.smithi161.stdout:3/126: mknod da/dc/d16/c24 0 2024-02-22T00:33:16.307 INFO:tasks.workunit.client.1.smithi161.stdout:3/127: readlink l8 0 2024-02-22T00:33:16.313 INFO:tasks.workunit.client.1.smithi161.stdout:5/269: dwrite d3/f26 [8388608,4194304] 0 2024-02-22T00:33:16.313 INFO:tasks.workunit.client.1.smithi161.stdout:4/163: symlink d5/l3f 0 2024-02-22T00:33:16.317 INFO:tasks.workunit.client.1.smithi161.stdout:3/128: dread da/f13 [0,4194304] 0 2024-02-22T00:33:16.317 INFO:tasks.workunit.client.1.smithi161.stdout:3/129: write f2 [3975112,103655] 0 2024-02-22T00:33:16.318 INFO:tasks.workunit.client.1.smithi161.stdout:2/158: getdents de/d1e 0 2024-02-22T00:33:16.320 INFO:tasks.workunit.client.1.smithi161.stdout:6/112: truncate d3/f15 137943 0 2024-02-22T00:33:16.320 INFO:tasks.workunit.client.1.smithi161.stdout:5/270: mknod d3/d1b/c58 0 2024-02-22T00:33:16.321 INFO:tasks.workunit.client.1.smithi161.stdout:1/137: getdents d19/d1d 0 2024-02-22T00:33:16.323 INFO:tasks.workunit.client.1.smithi161.stdout:5/271: write d3/d29/f45 [464084,105201] 0 2024-02-22T00:33:16.323 INFO:tasks.workunit.client.1.smithi161.stdout:3/130: readlink da/l1c 0 2024-02-22T00:33:16.324 INFO:tasks.workunit.client.1.smithi161.stdout:2/159: rename de/f1b to de/d1e/f3f 0 2024-02-22T00:33:16.325 INFO:tasks.workunit.client.1.smithi161.stdout:6/113: unlink d3/d10/d12/c19 0 2024-02-22T00:33:16.327 INFO:tasks.workunit.client.1.smithi161.stdout:6/114: readlink d3/d10/d12/l14 0 2024-02-22T00:33:16.329 INFO:tasks.workunit.client.1.smithi161.stdout:1/138: dread d19/f1b [0,4194304] 0 2024-02-22T00:33:16.330 INFO:tasks.workunit.client.1.smithi161.stdout:3/131: rename l8 to da/dc/l25 0 2024-02-22T00:33:16.330 INFO:tasks.workunit.client.1.smithi161.stdout:2/160: creat de/d1e/d3a/f40 x:0 0 0 2024-02-22T00:33:16.334 INFO:tasks.workunit.client.1.smithi161.stdout:2/161: fdatasync de/d11/d14/f18 0 2024-02-22T00:33:16.334 INFO:tasks.workunit.client.1.smithi161.stdout:6/115: dread d3/dc/df/f1f [0,4194304] 0 2024-02-22T00:33:16.335 INFO:tasks.workunit.client.1.smithi161.stdout:4/164: getdents d5/d10 0 2024-02-22T00:33:16.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/272: rename d3/f7 to d3/d1c/d20/f59 0 2024-02-22T00:33:16.340 INFO:tasks.workunit.client.1.smithi161.stdout:1/139: symlink d19/d1d/l34 0 2024-02-22T00:33:16.342 INFO:tasks.workunit.client.1.smithi161.stdout:1/140: chown d19/d1d/f27 143114797 1 2024-02-22T00:33:16.343 INFO:tasks.workunit.client.1.smithi161.stdout:4/165: dwrite d5/d10/d14/f3d [0,4194304] 0 2024-02-22T00:33:16.348 INFO:tasks.workunit.client.1.smithi161.stdout:3/132: rename da/dc/d16 to da/dc/d11/d26 0 2024-02-22T00:33:16.350 INFO:tasks.workunit.client.1.smithi161.stdout:2/162: link de/d1e/f31 de/d1e/d3a/f41 0 2024-02-22T00:33:16.351 INFO:tasks.workunit.client.1.smithi161.stdout:4/166: rmdir d5/d8 39 2024-02-22T00:33:16.353 INFO:tasks.workunit.client.1.smithi161.stdout:6/116: link d3/d10/fa d3/d10/f21 0 2024-02-22T00:33:16.356 INFO:tasks.workunit.client.1.smithi161.stdout:6/117: dread d3/d10/f21 [0,4194304] 0 2024-02-22T00:33:16.357 INFO:tasks.workunit.client.1.smithi161.stdout:5/273: mknod d3/c5a 0 2024-02-22T00:33:16.358 INFO:tasks.workunit.client.1.smithi161.stdout:5/274: truncate d3/d1c/f48 663406 0 2024-02-22T00:33:16.359 INFO:tasks.workunit.client.1.smithi161.stdout:5/275: fdatasync d3/d1c/d20/f35 0 2024-02-22T00:33:16.361 INFO:tasks.workunit.client.1.smithi161.stdout:2/163: unlink de/d1e/f25 0 2024-02-22T00:33:16.363 INFO:tasks.workunit.client.1.smithi161.stdout:4/167: truncate d5/d8/f2f 976537 0 2024-02-22T00:33:16.363 INFO:tasks.workunit.client.1.smithi161.stdout:5/276: dread d3/d1b/f1d [0,4194304] 0 2024-02-22T00:33:16.365 INFO:tasks.workunit.client.1.smithi161.stdout:1/141: rename c4 to d19/d2f/c35 0 2024-02-22T00:33:16.368 INFO:tasks.workunit.client.1.smithi161.stdout:4/168: symlink d5/d10/d14/l40 0 2024-02-22T00:33:16.370 INFO:tasks.workunit.client.1.smithi161.stdout:5/277: creat d3/d1c/d20/f5b x:0 0 0 2024-02-22T00:33:16.371 INFO:tasks.workunit.client.1.smithi161.stdout:3/133: creat da/f27 x:0 0 0 2024-02-22T00:33:16.373 INFO:tasks.workunit.client.1.smithi161.stdout:6/118: rename f0 to d3/d10/d12/f22 0 2024-02-22T00:33:16.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/164: fsync de/d1e/f31 0 2024-02-22T00:33:16.373 INFO:tasks.workunit.client.1.smithi161.stdout:1/142: dwrite f10 [0,4194304] 0 2024-02-22T00:33:16.374 INFO:tasks.workunit.client.1.smithi161.stdout:3/134: chown da/dc/d11/l14 1095706 1 2024-02-22T00:33:16.378 INFO:tasks.workunit.client.1.smithi161.stdout:5/278: rename d3/f1a to d3/d1b/d25/f5c 0 2024-02-22T00:33:16.382 INFO:tasks.workunit.client.1.smithi161.stdout:6/119: creat d3/d10/d12/f23 x:0 0 0 2024-02-22T00:33:16.383 INFO:tasks.workunit.client.1.smithi161.stdout:6/120: dread - d3/d10/d12/f23 zero size 2024-02-22T00:33:16.384 INFO:tasks.workunit.client.1.smithi161.stdout:1/143: creat d19/d1d/f36 x:0 0 0 2024-02-22T00:33:16.384 INFO:tasks.workunit.client.1.smithi161.stdout:1/144: chown d19/c29 291885 1 2024-02-22T00:33:16.385 INFO:tasks.workunit.client.1.smithi161.stdout:3/135: creat da/dc/d11/f28 x:0 0 0 2024-02-22T00:33:16.390 INFO:tasks.workunit.client.1.smithi161.stdout:3/136: dread da/dc/d11/f20 [0,4194304] 0 2024-02-22T00:33:16.390 INFO:tasks.workunit.client.1.smithi161.stdout:2/165: rename de/d1e/d3a/f41 to de/d11/d14/f42 0 2024-02-22T00:33:16.392 INFO:tasks.workunit.client.1.smithi161.stdout:4/169: truncate d5/d10/d14/f20 795579 0 2024-02-22T00:33:16.396 INFO:tasks.workunit.client.1.smithi161.stdout:1/145: fdatasync fa 0 2024-02-22T00:33:16.397 INFO:tasks.workunit.client.1.smithi161.stdout:5/279: mknod d3/c5d 0 2024-02-22T00:33:16.398 INFO:tasks.workunit.client.1.smithi161.stdout:2/166: symlink de/d2b/l43 0 2024-02-22T00:33:16.398 INFO:tasks.workunit.client.1.smithi161.stdout:5/280: read d3/f3a [149648,28821] 0 2024-02-22T00:33:16.400 INFO:tasks.workunit.client.1.smithi161.stdout:2/167: truncate de/d1e/f24 584274 0 2024-02-22T00:33:16.401 INFO:tasks.workunit.client.1.smithi161.stdout:4/170: mkdir d5/d8/d41 0 2024-02-22T00:33:16.401 INFO:tasks.workunit.client.1.smithi161.stdout:4/171: fdatasync d5/d10/f1d 0 2024-02-22T00:33:16.405 INFO:tasks.workunit.client.1.smithi161.stdout:1/146: creat d19/f37 x:0 0 0 2024-02-22T00:33:16.408 INFO:tasks.workunit.client.1.smithi161.stdout:6/121: write d3/d10/fa [1708191,108317] 0 2024-02-22T00:33:16.409 INFO:tasks.workunit.client.1.smithi161.stdout:4/172: dwrite d5/d10/f26 [0,4194304] 0 2024-02-22T00:33:16.409 INFO:tasks.workunit.client.1.smithi161.stdout:5/281: rmdir d3/d29 39 2024-02-22T00:33:16.410 INFO:tasks.workunit.client.1.smithi161.stdout:6/122: chown d3/d10/f21 2786935 1 2024-02-22T00:33:16.411 INFO:tasks.workunit.client.1.smithi161.stdout:6/123: readlink d3/d10/l7 0 2024-02-22T00:33:16.413 INFO:tasks.workunit.client.1.smithi161.stdout:6/124: write d3/d10/f21 [2633032,79220] 0 2024-02-22T00:33:16.413 INFO:tasks.workunit.client.1.smithi161.stdout:2/168: rename de/d2b/l43 to de/d11/d14/d1f/l44 0 2024-02-22T00:33:16.420 INFO:tasks.workunit.client.1.smithi161.stdout:5/282: write d3/d1c/d20/f35 [229707,100396] 0 2024-02-22T00:33:16.420 INFO:tasks.workunit.client.1.smithi161.stdout:1/147: symlink d19/d1d/d2c/l38 0 2024-02-22T00:33:16.420 INFO:tasks.workunit.client.1.smithi161.stdout:1/148: chown d19/l1c 610421243 1 2024-02-22T00:33:16.420 INFO:tasks.workunit.client.1.smithi161.stdout:1/149: fdatasync d19/d1d/f22 0 2024-02-22T00:33:16.420 INFO:tasks.workunit.client.1.smithi161.stdout:1/150: read f10 [315586,14753] 0 2024-02-22T00:33:16.421 INFO:tasks.workunit.client.1.smithi161.stdout:1/151: rename d19/d1d to d19/d1d/d2c/d39 22 2024-02-22T00:33:16.422 INFO:tasks.workunit.client.1.smithi161.stdout:2/169: symlink de/d11/d14/d1f/d33/l45 0 2024-02-22T00:33:16.424 INFO:tasks.workunit.client.1.smithi161.stdout:5/283: chown d3/d1c/d20/c16 1 1 2024-02-22T00:33:16.426 INFO:tasks.workunit.client.1.smithi161.stdout:2/170: creat de/d2b/f46 x:0 0 0 2024-02-22T00:33:16.429 INFO:tasks.workunit.client.1.smithi161.stdout:6/125: getdents d3/dc/df 0 2024-02-22T00:33:16.429 INFO:tasks.workunit.client.1.smithi161.stdout:2/171: stat de/d11/c16 0 2024-02-22T00:33:16.430 INFO:tasks.workunit.client.1.smithi161.stdout:1/152: dwrite d19/f1f [0,4194304] 0 2024-02-22T00:33:16.430 INFO:tasks.workunit.client.1.smithi161.stdout:3/137: truncate da/f1a 2790766 0 2024-02-22T00:33:16.434 INFO:tasks.workunit.client.1.smithi161.stdout:1/153: fdatasync d19/d1d/f27 0 2024-02-22T00:33:16.438 INFO:tasks.workunit.client.1.smithi161.stdout:5/284: dwrite d3/f5 [4194304,4194304] 0 2024-02-22T00:33:16.439 INFO:tasks.workunit.client.1.smithi161.stdout:1/154: fsync d19/d1d/f22 0 2024-02-22T00:33:16.441 INFO:tasks.workunit.client.1.smithi161.stdout:2/172: rename de/d1e/f3f to de/d11/d14/d1f/d33/f47 0 2024-02-22T00:33:16.451 INFO:tasks.workunit.client.1.smithi161.stdout:1/155: mknod d19/d2f/c3a 0 2024-02-22T00:33:16.451 INFO:tasks.workunit.client.1.smithi161.stdout:6/126: dread d3/dc/df/f1f [0,4194304] 0 2024-02-22T00:33:16.451 INFO:tasks.workunit.client.1.smithi161.stdout:1/156: chown d19/f1a 9837984 1 2024-02-22T00:33:16.452 INFO:tasks.workunit.client.1.smithi161.stdout:3/138: dwrite da/dc/fd [0,4194304] 0 2024-02-22T00:33:16.454 INFO:tasks.workunit.client.1.smithi161.stdout:4/173: dwrite d5/d10/d14/f1c [0,4194304] 0 2024-02-22T00:33:16.460 INFO:tasks.workunit.client.1.smithi161.stdout:6/127: symlink d3/dc/df/l24 0 2024-02-22T00:33:16.461 INFO:tasks.workunit.client.1.smithi161.stdout:5/285: dread d3/f19 [0,4194304] 0 2024-02-22T00:33:16.462 INFO:tasks.workunit.client.1.smithi161.stdout:1/157: creat d19/f3b x:0 0 0 2024-02-22T00:33:16.463 INFO:tasks.workunit.client.1.smithi161.stdout:3/139: rmdir da/dc 39 2024-02-22T00:33:16.463 INFO:tasks.workunit.client.1.smithi161.stdout:6/128: chown d3/dc/df 655622 1 2024-02-22T00:33:16.464 INFO:tasks.workunit.client.1.smithi161.stdout:4/174: creat d5/d10/d14/d24/f42 x:0 0 0 2024-02-22T00:33:16.468 INFO:tasks.workunit.client.1.smithi161.stdout:1/158: truncate d19/f3b 32275 0 2024-02-22T00:33:16.468 INFO:tasks.workunit.client.1.smithi161.stdout:2/173: dwrite de/d11/d14/d1f/f30 [0,4194304] 0 2024-02-22T00:33:16.469 INFO:tasks.workunit.client.1.smithi161.stdout:6/129: unlink d3/fe 0 2024-02-22T00:33:16.474 INFO:tasks.workunit.client.1.smithi161.stdout:1/159: chown d19/d1d/l21 1784 1 2024-02-22T00:33:16.474 INFO:tasks.workunit.client.1.smithi161.stdout:6/130: stat d3/d10/f13 0 2024-02-22T00:33:16.474 INFO:tasks.workunit.client.1.smithi161.stdout:3/140: mkdir da/d29 0 2024-02-22T00:33:16.481 INFO:tasks.workunit.client.1.smithi161.stdout:7/189: sync 2024-02-22T00:33:16.481 INFO:tasks.workunit.client.1.smithi161.stdout:8/176: sync 2024-02-22T00:33:16.482 INFO:tasks.workunit.client.1.smithi161.stdout:5/286: dwrite d3/d1b/d25/d4c/f51 [0,4194304] 0 2024-02-22T00:33:16.486 INFO:tasks.workunit.client.1.smithi161.stdout:1/160: rename lf to d19/l3c 0 2024-02-22T00:33:16.491 INFO:tasks.workunit.client.1.smithi161.stdout:2/174: dwrite f3 [0,4194304] 0 2024-02-22T00:33:16.492 INFO:tasks.workunit.client.1.smithi161.stdout:8/177: write d1/f29 [2710595,93890] 0 2024-02-22T00:33:16.496 INFO:tasks.workunit.client.1.smithi161.stdout:7/190: dread d3/df/d33/d35/f27 [0,4194304] 0 2024-02-22T00:33:16.498 INFO:tasks.workunit.client.1.smithi161.stdout:3/141: write da/dc/d11/d26/f19 [2696597,100362] 0 2024-02-22T00:33:16.499 INFO:tasks.workunit.client.1.smithi161.stdout:7/191: stat d3/l20 0 2024-02-22T00:33:16.504 INFO:tasks.workunit.client.1.smithi161.stdout:6/131: write d3/d10/d12/f22 [2593775,32831] 0 2024-02-22T00:33:16.508 INFO:tasks.workunit.client.1.smithi161.stdout:2/175: truncate de/f3d 384391 0 2024-02-22T00:33:16.509 INFO:tasks.workunit.client.1.smithi161.stdout:7/192: mknod d3/dd/d24/d26/d30/c4c 0 2024-02-22T00:33:16.511 INFO:tasks.workunit.client.1.smithi161.stdout:8/178: rename d1/d1c/c34 to d1/c38 0 2024-02-22T00:33:16.514 INFO:tasks.workunit.client.1.smithi161.stdout:2/176: chown f3 13234960 1 2024-02-22T00:33:16.517 INFO:tasks.workunit.client.1.smithi161.stdout:6/132: creat d3/d10/d12/f25 x:0 0 0 2024-02-22T00:33:16.517 INFO:tasks.workunit.client.1.smithi161.stdout:7/193: unlink d3/dd/l15 0 2024-02-22T00:33:16.521 INFO:tasks.workunit.client.1.smithi161.stdout:4/175: dwrite d5/d10/d14/f20 [0,4194304] 0 2024-02-22T00:33:16.522 INFO:tasks.workunit.client.1.smithi161.stdout:6/133: chown d3/d10/c1a 0 1 2024-02-22T00:33:16.523 INFO:tasks.workunit.client.1.smithi161.stdout:5/287: dwrite d3/f26 [12582912,4194304] 0 2024-02-22T00:33:16.525 INFO:tasks.workunit.client.1.smithi161.stdout:6/134: dread - d3/d10/d12/f25 zero size 2024-02-22T00:33:16.525 INFO:tasks.workunit.client.1.smithi161.stdout:7/194: symlink d3/df/d3c/l4d 0 2024-02-22T00:33:16.525 INFO:tasks.workunit.client.1.smithi161.stdout:3/142: dwrite f2 [0,4194304] 0 2024-02-22T00:33:16.527 INFO:tasks.workunit.client.1.smithi161.stdout:1/161: dwrite f10 [0,4194304] 0 2024-02-22T00:33:16.527 INFO:tasks.workunit.client.1.smithi161.stdout:8/179: read d1/d1c/d20/d22/f1f [1354389,85311] 0 2024-02-22T00:33:16.528 INFO:tasks.workunit.client.1.smithi161.stdout:7/195: write d3/f2b [500051,62724] 0 2024-02-22T00:33:16.530 INFO:tasks.workunit.client.1.smithi161.stdout:4/176: dread d5/d8/f2f [0,4194304] 0 2024-02-22T00:33:16.532 INFO:tasks.workunit.client.1.smithi161.stdout:4/177: write d5/d10/f26 [582793,123242] 0 2024-02-22T00:33:16.541 INFO:tasks.workunit.client.1.smithi161.stdout:6/135: creat d3/d10/f26 x:0 0 0 2024-02-22T00:33:16.542 INFO:tasks.workunit.client.1.smithi161.stdout:3/143: mknod da/dc/d11/c2a 0 2024-02-22T00:33:16.546 INFO:tasks.workunit.client.1.smithi161.stdout:7/196: creat d3/dd/d24/f4e x:0 0 0 2024-02-22T00:33:16.552 INFO:tasks.workunit.client.1.smithi161.stdout:5/288: link d3/d1b/d36/f3b d3/d1b/d36/f5e 0 2024-02-22T00:33:16.555 INFO:tasks.workunit.client.1.smithi161.stdout:3/144: dwrite da/dc/d11/f28 [0,4194304] 0 2024-02-22T00:33:16.561 INFO:tasks.workunit.client.1.smithi161.stdout:3/145: dread f0 [0,4194304] 0 2024-02-22T00:33:16.563 INFO:tasks.workunit.client.1.smithi161.stdout:5/289: mknod d3/d1c/d20/c5f 0 2024-02-22T00:33:16.565 INFO:tasks.workunit.client.1.smithi161.stdout:7/197: write d3/dd/d24/d26/f3e [5119320,106204] 0 2024-02-22T00:33:16.567 INFO:tasks.workunit.client.1.smithi161.stdout:8/180: creat d1/f39 x:0 0 0 2024-02-22T00:33:16.568 INFO:tasks.workunit.client.1.smithi161.stdout:3/146: creat da/dc/f2b x:0 0 0 2024-02-22T00:33:16.570 INFO:tasks.workunit.client.1.smithi161.stdout:4/178: dwrite d5/d8/f2f [0,4194304] 0 2024-02-22T00:33:16.570 INFO:tasks.workunit.client.1.smithi161.stdout:7/198: read d3/f7 [2067099,31790] 0 2024-02-22T00:33:16.571 INFO:tasks.workunit.client.1.smithi161.stdout:8/181: truncate d1/d19/f10 1467592 0 2024-02-22T00:33:16.572 INFO:tasks.workunit.client.1.smithi161.stdout:5/290: mknod d3/d1c/c60 0 2024-02-22T00:33:16.586 INFO:tasks.workunit.client.1.smithi161.stdout:5/291: dwrite d3/d1b/d36/f55 [0,4194304] 0 2024-02-22T00:33:16.588 INFO:tasks.workunit.client.1.smithi161.stdout:3/147: getdents da/dc/d11 0 2024-02-22T00:33:16.588 INFO:tasks.workunit.client.1.smithi161.stdout:4/179: getdents d5/d17 0 2024-02-22T00:33:16.592 INFO:tasks.workunit.client.1.smithi161.stdout:3/148: mknod da/c2c 0 2024-02-22T00:33:16.599 INFO:tasks.workunit.client.1.smithi161.stdout:5/292: dwrite d3/d1c/f44 [0,4194304] 0 2024-02-22T00:33:16.601 INFO:tasks.workunit.client.1.smithi161.stdout:8/182: write d1/d19/f10 [1505317,39376] 0 2024-02-22T00:33:16.601 INFO:tasks.workunit.client.1.smithi161.stdout:3/149: chown da/dc/d11/d26/c22 46 1 2024-02-22T00:33:16.603 INFO:tasks.workunit.client.1.smithi161.stdout:4/180: dwrite d5/f27 [0,4194304] 0 2024-02-22T00:33:16.608 INFO:tasks.workunit.client.1.smithi161.stdout:4/181: truncate d5/fe 3199336 0 2024-02-22T00:33:16.608 INFO:tasks.workunit.client.1.smithi161.stdout:7/199: creat d3/df/d33/f4f x:0 0 0 2024-02-22T00:33:16.611 INFO:tasks.workunit.client.1.smithi161.stdout:7/200: chown f2 222239344 1 2024-02-22T00:33:16.611 INFO:tasks.workunit.client.1.smithi161.stdout:3/150: mknod da/d29/c2d 0 2024-02-22T00:33:16.615 INFO:tasks.workunit.client.1.smithi161.stdout:7/201: mkdir d3/dd/d24/d26/d50 0 2024-02-22T00:33:16.615 INFO:tasks.workunit.client.1.smithi161.stdout:5/293: dread d3/d1b/f38 [0,4194304] 0 2024-02-22T00:33:16.619 INFO:tasks.workunit.client.1.smithi161.stdout:3/151: rename f7 to da/dc/d11/f2e 0 2024-02-22T00:33:16.620 INFO:tasks.workunit.client.1.smithi161.stdout:8/183: dwrite d1/d1c/d20/d22/f1f [4194304,4194304] 0 2024-02-22T00:33:16.624 INFO:tasks.workunit.client.1.smithi161.stdout:3/152: readlink da/dc/d11/l14 0 2024-02-22T00:33:16.624 INFO:tasks.workunit.client.1.smithi161.stdout:5/294: symlink d3/d1c/d20/l61 0 2024-02-22T00:33:16.629 INFO:tasks.workunit.client.1.smithi161.stdout:7/202: rmdir d3/dd/d24 39 2024-02-22T00:33:16.629 INFO:tasks.workunit.client.1.smithi161.stdout:8/184: creat d1/d19/f3a x:0 0 0 2024-02-22T00:33:16.630 INFO:tasks.workunit.client.1.smithi161.stdout:3/153: mkdir da/dc/d11/d26/d2f 0 2024-02-22T00:33:16.632 INFO:tasks.workunit.client.1.smithi161.stdout:4/182: truncate d5/d10/f26 633558 0 2024-02-22T00:33:16.640 INFO:tasks.workunit.client.1.smithi161.stdout:4/183: unlink d5/d8/f2f 0 2024-02-22T00:33:16.641 INFO:tasks.workunit.client.1.smithi161.stdout:9/201: sync 2024-02-22T00:33:16.641 INFO:tasks.workunit.client.1.smithi161.stdout:0/234: sync 2024-02-22T00:33:16.642 INFO:tasks.workunit.client.1.smithi161.stdout:3/154: symlink da/dc/d11/d26/d2f/l30 0 2024-02-22T00:33:16.643 INFO:tasks.workunit.client.1.smithi161.stdout:3/155: dread - da/dc/d11/d26/f21 zero size 2024-02-22T00:33:16.645 INFO:tasks.workunit.client.1.smithi161.stdout:9/202: unlink d1/d2/fd 0 2024-02-22T00:33:16.649 INFO:tasks.workunit.client.1.smithi161.stdout:7/203: write d3/df/d33/d35/f3f [3875721,11721] 0 2024-02-22T00:33:16.651 INFO:tasks.workunit.client.1.smithi161.stdout:5/295: truncate d3/d1b/d25/f5c 16645185 0 2024-02-22T00:33:16.652 INFO:tasks.workunit.client.1.smithi161.stdout:3/156: creat da/dc/f31 x:0 0 0 2024-02-22T00:33:16.658 INFO:tasks.workunit.client.1.smithi161.stdout:4/184: write d5/f6 [968609,79694] 0 2024-02-22T00:33:16.660 INFO:tasks.workunit.client.1.smithi161.stdout:3/157: creat da/d29/f32 x:0 0 0 2024-02-22T00:33:16.660 INFO:tasks.workunit.client.1.smithi161.stdout:0/235: link d14/f56 d14/d37/f59 0 2024-02-22T00:33:16.663 INFO:tasks.workunit.client.1.smithi161.stdout:8/185: dread d1/d19/f16 [0,4194304] 0 2024-02-22T00:33:16.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/203: truncate d1/d2/d7/da/f13 3318921 0 2024-02-22T00:33:16.670 INFO:tasks.workunit.client.1.smithi161.stdout:4/185: mknod d5/d10/d14/d24/d28/d38/c43 0 2024-02-22T00:33:16.672 INFO:tasks.workunit.client.1.smithi161.stdout:5/296: write d3/fe [346444,113523] 0 2024-02-22T00:33:16.678 INFO:tasks.workunit.client.1.smithi161.stdout:0/236: dwrite d14/f51 [0,4194304] 0 2024-02-22T00:33:16.681 INFO:tasks.workunit.client.1.smithi161.stdout:9/204: write d1/d2/d4/d11/f28 [1855690,11192] 0 2024-02-22T00:33:16.684 INFO:tasks.workunit.client.1.smithi161.stdout:7/204: dwrite d3/f9 [0,4194304] 0 2024-02-22T00:33:16.684 INFO:tasks.workunit.client.1.smithi161.stdout:5/297: rename d3/d1c/d50 to d3/d1c/d62 0 2024-02-22T00:33:16.684 INFO:tasks.workunit.client.1.smithi161.stdout:3/158: dwrite da/f13 [0,4194304] 0 2024-02-22T00:33:16.685 INFO:tasks.workunit.client.1.smithi161.stdout:9/205: chown d1/d2/ce 6410 1 2024-02-22T00:33:16.686 INFO:tasks.workunit.client.1.smithi161.stdout:3/159: chown da/f13 19796 1 2024-02-22T00:33:16.687 INFO:tasks.workunit.client.1.smithi161.stdout:4/186: rename d5/d10/c3b to d5/d10/d14/d24/d28/c44 0 2024-02-22T00:33:16.694 INFO:tasks.workunit.client.1.smithi161.stdout:9/206: chown d1/d2/d4/l40 16394 1 2024-02-22T00:33:16.695 INFO:tasks.workunit.client.1.smithi161.stdout:9/207: dread - d1/d2/d7/da/f3c zero size 2024-02-22T00:33:16.696 INFO:tasks.workunit.client.1.smithi161.stdout:7/205: creat d3/dd/d24/f51 x:0 0 0 2024-02-22T00:33:16.700 INFO:tasks.workunit.client.1.smithi161.stdout:8/186: dread d1/d19/d18/f25 [0,4194304] 0 2024-02-22T00:33:16.700 INFO:tasks.workunit.client.1.smithi161.stdout:3/160: dwrite da/dc/f17 [0,4194304] 0 2024-02-22T00:33:16.701 INFO:tasks.workunit.client.1.smithi161.stdout:7/206: chown d3/dd/d24/d26/d50 7887 1 2024-02-22T00:33:16.702 INFO:tasks.workunit.client.1.smithi161.stdout:3/161: chown da/dc/d11/d26/f19 28829164 1 2024-02-22T00:33:16.703 INFO:tasks.workunit.client.1.smithi161.stdout:9/208: symlink d1/d2/d4/d1f/l41 0 2024-02-22T00:33:16.708 INFO:tasks.workunit.client.1.smithi161.stdout:3/162: rename da/dc/d11/c23 to da/dc/d11/d26/d2f/c33 0 2024-02-22T00:33:16.710 INFO:tasks.workunit.client.1.smithi161.stdout:3/163: write da/dc/fd [2783476,75716] 0 2024-02-22T00:33:16.712 INFO:tasks.workunit.client.1.smithi161.stdout:3/164: stat da/dc/d11/d26/f19 0 2024-02-22T00:33:16.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/187: dread d1/f6 [0,4194304] 0 2024-02-22T00:33:16.713 INFO:tasks.workunit.client.1.smithi161.stdout:9/209: getdents d1/d25 0 2024-02-22T00:33:16.714 INFO:tasks.workunit.client.1.smithi161.stdout:3/165: creat da/dc/d11/d26/f34 x:0 0 0 2024-02-22T00:33:16.715 INFO:tasks.workunit.client.1.smithi161.stdout:0/237: write d14/d37/f59 [331817,26792] 0 2024-02-22T00:33:16.717 INFO:tasks.workunit.client.1.smithi161.stdout:9/210: creat d1/d2/d7/da/f42 x:0 0 0 2024-02-22T00:33:16.718 INFO:tasks.workunit.client.1.smithi161.stdout:3/166: write da/dc/fe [1548000,109337] 0 2024-02-22T00:33:16.718 INFO:tasks.workunit.client.1.smithi161.stdout:0/238: mknod d14/d44/c5a 0 2024-02-22T00:33:16.722 INFO:tasks.workunit.client.1.smithi161.stdout:4/187: truncate d5/d10/d14/f1c 2358827 0 2024-02-22T00:33:16.724 INFO:tasks.workunit.client.1.smithi161.stdout:5/298: dwrite d3/f26 [0,4194304] 0 2024-02-22T00:33:16.724 INFO:tasks.workunit.client.1.smithi161.stdout:9/211: write d1/d2/d4/d11/f28 [1728055,68551] 0 2024-02-22T00:33:16.725 INFO:tasks.workunit.client.1.smithi161.stdout:3/167: read da/dc/d11/f20 [2244613,33723] 0 2024-02-22T00:33:16.729 INFO:tasks.workunit.client.1.smithi161.stdout:4/188: creat d5/d10/d14/f45 x:0 0 0 2024-02-22T00:33:16.731 INFO:tasks.workunit.client.1.smithi161.stdout:3/168: symlink da/d29/l35 0 2024-02-22T00:33:16.733 INFO:tasks.workunit.client.1.smithi161.stdout:8/188: dwrite d1/f6 [0,4194304] 0 2024-02-22T00:33:16.736 INFO:tasks.workunit.client.1.smithi161.stdout:5/299: creat d3/d1b/d25/d4c/f63 x:0 0 0 2024-02-22T00:33:16.737 INFO:tasks.workunit.client.1.smithi161.stdout:9/212: creat d1/d25/f43 x:0 0 0 2024-02-22T00:33:16.741 INFO:tasks.workunit.client.1.smithi161.stdout:7/207: dwrite d3/f7 [0,4194304] 0 2024-02-22T00:33:16.748 INFO:tasks.workunit.client.1.smithi161.stdout:0/239: dwrite d14/d37/f59 [0,4194304] 0 2024-02-22T00:33:16.754 INFO:tasks.workunit.client.1.smithi161.stdout:3/169: getdents da/dc 0 2024-02-22T00:33:16.755 INFO:tasks.workunit.client.1.smithi161.stdout:7/208: mknod d3/df/c52 0 2024-02-22T00:33:16.756 INFO:tasks.workunit.client.1.smithi161.stdout:0/240: creat d14/d1a/d3f/f5b x:0 0 0 2024-02-22T00:33:16.760 INFO:tasks.workunit.client.1.smithi161.stdout:4/189: dwrite d5/d10/d14/f29 [0,4194304] 0 2024-02-22T00:33:16.763 INFO:tasks.workunit.client.1.smithi161.stdout:3/170: write da/dc/fd [4298191,8428] 0 2024-02-22T00:33:16.765 INFO:tasks.workunit.client.1.smithi161.stdout:9/213: dwrite d1/d2/f1a [4194304,4194304] 0 2024-02-22T00:33:16.766 INFO:tasks.workunit.client.1.smithi161.stdout:5/300: dwrite d3/d1b/d25/f5c [16777216,4194304] 0 2024-02-22T00:33:16.767 INFO:tasks.workunit.client.1.smithi161.stdout:7/209: getdents d3/dd/d24/d26/d50 0 2024-02-22T00:33:16.776 INFO:tasks.workunit.client.1.smithi161.stdout:5/301: mknod d3/d1c/d62/c64 0 2024-02-22T00:33:16.776 INFO:tasks.workunit.client.1.smithi161.stdout:9/214: symlink d1/d5/l44 0 2024-02-22T00:33:16.779 INFO:tasks.workunit.client.1.smithi161.stdout:7/210: unlink d3/df/f4a 0 2024-02-22T00:33:16.781 INFO:tasks.workunit.client.1.smithi161.stdout:5/302: creat d3/d1b/d25/f65 x:0 0 0 2024-02-22T00:33:16.781 INFO:tasks.workunit.client.1.smithi161.stdout:9/215: write d1/d2/d7/da/f3c [38802,40586] 0 2024-02-22T00:33:16.781 INFO:tasks.workunit.client.1.smithi161.stdout:8/189: dwrite d1/d1c/d20/d22/d28/f2e [0,4194304] 0 2024-02-22T00:33:16.784 INFO:tasks.workunit.client.1.smithi161.stdout:4/190: link f0 d5/d8/d41/f46 0 2024-02-22T00:33:16.784 INFO:tasks.workunit.client.1.smithi161.stdout:9/216: stat d1/d2/d4/d1f/l2c 0 2024-02-22T00:33:16.785 INFO:tasks.workunit.client.1.smithi161.stdout:8/190: readlink d1/l14 0 2024-02-22T00:33:16.785 INFO:tasks.workunit.client.1.smithi161.stdout:4/191: fdatasync d5/d10/d14/f3d 0 2024-02-22T00:33:16.786 INFO:tasks.workunit.client.1.smithi161.stdout:7/211: mkdir d3/df/d33/d53 0 2024-02-22T00:33:16.790 INFO:tasks.workunit.client.1.smithi161.stdout:3/171: dwrite da/dc/fe [0,4194304] 0 2024-02-22T00:33:16.790 INFO:tasks.workunit.client.1.smithi161.stdout:7/212: readlink d3/df/l34 0 2024-02-22T00:33:16.792 INFO:tasks.workunit.client.1.smithi161.stdout:8/191: rmdir d1/d19 39 2024-02-22T00:33:16.796 INFO:tasks.workunit.client.1.smithi161.stdout:8/192: write d1/d2f/d30/f33 [4319936,75751] 0 2024-02-22T00:33:16.798 INFO:tasks.workunit.client.1.smithi161.stdout:4/192: creat d5/d8/f47 x:0 0 0 2024-02-22T00:33:16.798 INFO:tasks.workunit.client.1.smithi161.stdout:5/303: dwrite d3/d1b/d25/f39 [8388608,4194304] 0 2024-02-22T00:33:16.803 INFO:tasks.workunit.client.1.smithi161.stdout:3/172: write f2 [3717338,111204] 0 2024-02-22T00:33:16.805 INFO:tasks.workunit.client.1.smithi161.stdout:4/193: fdatasync f3 0 2024-02-22T00:33:16.809 INFO:tasks.workunit.client.1.smithi161.stdout:5/304: unlink d3/d1c/f44 0 2024-02-22T00:33:16.811 INFO:tasks.workunit.client.1.smithi161.stdout:0/241: getdents d14/d1a/d3f 0 2024-02-22T00:33:16.813 INFO:tasks.workunit.client.1.smithi161.stdout:7/213: dwrite f2 [4194304,4194304] 0 2024-02-22T00:33:16.814 INFO:tasks.workunit.client.1.smithi161.stdout:9/217: rename d1/d2/d7/d1e/l27 to d1/d2/d7/l45 0 2024-02-22T00:33:16.816 INFO:tasks.workunit.client.1.smithi161.stdout:8/193: write d1/d19/f15 [258361,44933] 0 2024-02-22T00:33:16.819 INFO:tasks.workunit.client.1.smithi161.stdout:0/242: fdatasync d14/f19 0 2024-02-22T00:33:16.824 INFO:tasks.workunit.client.1.smithi161.stdout:8/194: read d1/d1c/d20/d22/f1f [424209,69642] 0 2024-02-22T00:33:16.825 INFO:tasks.workunit.client.1.smithi161.stdout:5/305: creat d3/d29/f66 x:0 0 0 2024-02-22T00:33:16.826 INFO:tasks.workunit.client.1.smithi161.stdout:0/243: chown d14/d1a/l30 21358 1 2024-02-22T00:33:16.826 INFO:tasks.workunit.client.1.smithi161.stdout:3/173: dwrite da/dc/f2b [0,4194304] 0 2024-02-22T00:33:16.827 INFO:tasks.workunit.client.1.smithi161.stdout:8/195: unlink d1/c1d 0 2024-02-22T00:33:16.827 INFO:tasks.workunit.client.1.smithi161.stdout:4/194: dread d5/f27 [0,4194304] 0 2024-02-22T00:33:16.827 INFO:tasks.workunit.client.1.smithi161.stdout:0/244: stat fd 0 2024-02-22T00:33:16.828 INFO:tasks.workunit.client.1.smithi161.stdout:9/218: creat d1/d2/d4/d11/d21/f46 x:0 0 0 2024-02-22T00:33:16.828 INFO:tasks.workunit.client.1.smithi161.stdout:7/214: truncate d3/dd/d24/f4e 945342 0 2024-02-22T00:33:16.830 INFO:tasks.workunit.client.1.smithi161.stdout:3/174: fdatasync da/dc/f1f 0 2024-02-22T00:33:16.830 INFO:tasks.workunit.client.1.smithi161.stdout:5/306: mkdir d3/d1c/d67 0 2024-02-22T00:33:16.832 INFO:tasks.workunit.client.1.smithi161.stdout:0/245: truncate d14/d37/f59 4198540 0 2024-02-22T00:33:16.834 INFO:tasks.workunit.client.1.smithi161.stdout:3/175: stat da/dc/d11/d26/f19 0 2024-02-22T00:33:16.835 INFO:tasks.workunit.client.1.smithi161.stdout:7/215: mknod d3/df/d3c/c54 0 2024-02-22T00:33:16.838 INFO:tasks.workunit.client.1.smithi161.stdout:0/246: creat d14/d29/f5c x:0 0 0 2024-02-22T00:33:16.839 INFO:tasks.workunit.client.1.smithi161.stdout:7/216: chown d3/dd/d24/d26/d30/f3b 30 1 2024-02-22T00:33:16.840 INFO:tasks.workunit.client.1.smithi161.stdout:3/176: mknod da/dc/d11/d26/c36 0 2024-02-22T00:33:16.840 INFO:tasks.workunit.client.1.smithi161.stdout:4/195: dwrite d5/d10/d14/f20 [0,4194304] 0 2024-02-22T00:33:16.843 INFO:tasks.workunit.client.1.smithi161.stdout:3/177: read - da/d29/f32 zero size 2024-02-22T00:33:16.843 INFO:tasks.workunit.client.1.smithi161.stdout:7/217: truncate d3/dd/d24/f51 948966 0 2024-02-22T00:33:16.844 INFO:tasks.workunit.client.1.smithi161.stdout:2/177: sync 2024-02-22T00:33:16.845 INFO:tasks.workunit.client.1.smithi161.stdout:2/178: chown de/f21 387442 1 2024-02-22T00:33:16.846 INFO:tasks.workunit.client.1.smithi161.stdout:9/219: link d1/d2/d4/d1f/f35 d1/d2/d7/f47 0 2024-02-22T00:33:16.849 INFO:tasks.workunit.client.1.smithi161.stdout:3/178: mkdir da/dc/d11/d26/d2f/d37 0 2024-02-22T00:33:16.849 INFO:tasks.workunit.client.1.smithi161.stdout:3/179: readlink da/dc/d11/l14 0 2024-02-22T00:33:16.854 INFO:tasks.workunit.client.1.smithi161.stdout:3/180: dread da/dc/f17 [0,4194304] 0 2024-02-22T00:33:16.855 INFO:tasks.workunit.client.1.smithi161.stdout:0/247: getdents d14/d37 0 2024-02-22T00:33:16.857 INFO:tasks.workunit.client.1.smithi161.stdout:0/248: chown d14/f18 37549 1 2024-02-22T00:33:16.857 INFO:tasks.workunit.client.1.smithi161.stdout:7/218: rename d3/df/d3c to d3/df/d33/d35/d55 0 2024-02-22T00:33:16.858 INFO:tasks.workunit.client.1.smithi161.stdout:9/220: mknod d1/d2/c48 0 2024-02-22T00:33:16.860 INFO:tasks.workunit.client.1.smithi161.stdout:7/219: rename d3/dd/d24/d26/d30 to d3/dd/d24/d26/d30/d56 22 2024-02-22T00:33:16.866 INFO:tasks.workunit.client.1.smithi161.stdout:5/307: dwrite d3/f3a [0,4194304] 0 2024-02-22T00:33:16.870 INFO:tasks.workunit.client.1.smithi161.stdout:3/181: link da/dc/d11/c15 da/d29/c38 0 2024-02-22T00:33:16.872 INFO:tasks.workunit.client.1.smithi161.stdout:9/221: creat d1/d2/d7/f49 x:0 0 0 2024-02-22T00:33:16.875 INFO:tasks.workunit.client.1.smithi161.stdout:0/249: write f11 [1450740,81653] 0 2024-02-22T00:33:16.877 INFO:tasks.workunit.client.1.smithi161.stdout:7/220: dread d3/dd/d24/d26/d30/f3b [0,4194304] 0 2024-02-22T00:33:16.878 INFO:tasks.workunit.client.1.smithi161.stdout:3/182: mkdir da/dc/d11/d26/d2f/d37/d39 0 2024-02-22T00:33:16.878 INFO:tasks.workunit.client.1.smithi161.stdout:4/196: dread d5/d8/d41/f46 [0,4194304] 0 2024-02-22T00:33:16.878 INFO:tasks.workunit.client.1.smithi161.stdout:0/250: read d14/d37/f59 [3981151,22833] 0 2024-02-22T00:33:16.880 INFO:tasks.workunit.client.1.smithi161.stdout:2/179: dwrite de/d1e/f31 [0,4194304] 0 2024-02-22T00:33:16.882 INFO:tasks.workunit.client.1.smithi161.stdout:7/221: write d3/f7 [3949295,69400] 0 2024-02-22T00:33:16.882 INFO:tasks.workunit.client.1.smithi161.stdout:9/222: truncate d1/d2/d7/f47 1164928 0 2024-02-22T00:33:16.883 INFO:tasks.workunit.client.1.smithi161.stdout:5/308: dwrite d3/d1b/d36/f5e [0,4194304] 0 2024-02-22T00:33:16.884 INFO:tasks.workunit.client.1.smithi161.stdout:4/197: write d5/d10/d14/f29 [1022319,110704] 0 2024-02-22T00:33:16.884 INFO:tasks.workunit.client.1.smithi161.stdout:2/180: chown de/d1e/d3a/f3e 1866 1 2024-02-22T00:33:16.888 INFO:tasks.workunit.client.1.smithi161.stdout:3/183: chown da/dc/d11/c15 1991 1 2024-02-22T00:33:16.888 INFO:tasks.workunit.client.1.smithi161.stdout:2/181: write de/d11/d14/f18 [191308,55164] 0 2024-02-22T00:33:16.889 INFO:tasks.workunit.client.1.smithi161.stdout:0/251: truncate f8 222071 0 2024-02-22T00:33:16.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/182: unlink de/f3d 0 2024-02-22T00:33:16.894 INFO:tasks.workunit.client.1.smithi161.stdout:0/252: mkdir d14/d1a/d3f/d5d 0 2024-02-22T00:33:16.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/309: dread d3/d29/f4a [0,4194304] 0 2024-02-22T00:33:16.897 INFO:tasks.workunit.client.1.smithi161.stdout:7/222: dwrite d3/dd/fe [0,4194304] 0 2024-02-22T00:33:16.899 INFO:tasks.workunit.client.1.smithi161.stdout:7/223: readlink d3/df/l34 0 2024-02-22T00:33:16.900 INFO:tasks.workunit.client.1.smithi161.stdout:3/184: chown da/dc/d11/d26/d2f/c33 1 1 2024-02-22T00:33:16.902 INFO:tasks.workunit.client.1.smithi161.stdout:7/224: stat d3/dd/d24/d26/d30/c4c 0 2024-02-22T00:33:16.903 INFO:tasks.workunit.client.1.smithi161.stdout:2/183: unlink de/d1e/d3a/f3e 0 2024-02-22T00:33:16.905 INFO:tasks.workunit.client.1.smithi161.stdout:2/184: chown lb 435074 1 2024-02-22T00:33:16.908 INFO:tasks.workunit.client.1.smithi161.stdout:5/310: dwrite d3/d1b/d25/f27 [4194304,4194304] 0 2024-02-22T00:33:16.908 INFO:tasks.workunit.client.1.smithi161.stdout:2/185: dread - de/d11/f29 zero size 2024-02-22T00:33:16.909 INFO:tasks.workunit.client.1.smithi161.stdout:9/223: getdents d1/d5/d9 0 2024-02-22T00:33:16.910 INFO:tasks.workunit.client.1.smithi161.stdout:2/186: read - de/d11/f29 zero size 2024-02-22T00:33:16.911 INFO:tasks.workunit.client.1.smithi161.stdout:7/225: write d3/dd/d24/d26/d30/f3b [4581659,32634] 0 2024-02-22T00:33:16.912 INFO:tasks.workunit.client.1.smithi161.stdout:4/198: write d5/d10/d14/f1c [719050,9080] 0 2024-02-22T00:33:16.912 INFO:tasks.workunit.client.1.smithi161.stdout:9/224: chown d1/d5/f3e 1843440 1 2024-02-22T00:33:16.913 INFO:tasks.workunit.client.1.smithi161.stdout:9/225: chown d1/d2/f2e 49 1 2024-02-22T00:33:16.914 INFO:tasks.workunit.client.1.smithi161.stdout:3/185: write da/dc/d11/f28 [2263800,102388] 0 2024-02-22T00:33:16.920 INFO:tasks.workunit.client.1.smithi161.stdout:0/253: getdents d14/d29 0 2024-02-22T00:33:16.921 INFO:tasks.workunit.client.1.smithi161.stdout:2/187: dwrite f3 [4194304,4194304] 0 2024-02-22T00:33:16.921 INFO:tasks.workunit.client.1.smithi161.stdout:3/186: mknod da/dc/d11/c3a 0 2024-02-22T00:33:16.922 INFO:tasks.workunit.client.1.smithi161.stdout:3/187: chown da 5 1 2024-02-22T00:33:16.923 INFO:tasks.workunit.client.1.smithi161.stdout:9/226: creat d1/d5/d9/f4a x:0 0 0 2024-02-22T00:33:16.927 INFO:tasks.workunit.client.1.smithi161.stdout:2/188: fdatasync de/d11/f1a 0 2024-02-22T00:33:16.927 INFO:tasks.workunit.client.1.smithi161.stdout:9/227: fsync d1/d2/d4/d11/d21/f46 0 2024-02-22T00:33:16.928 INFO:tasks.workunit.client.1.smithi161.stdout:4/199: rename d5/d10/c3e to d5/c48 0 2024-02-22T00:33:16.931 INFO:tasks.workunit.client.1.smithi161.stdout:3/188: symlink da/dc/d11/d26/d2f/d37/l3b 0 2024-02-22T00:33:16.932 INFO:tasks.workunit.client.1.smithi161.stdout:2/189: creat de/f48 x:0 0 0 2024-02-22T00:33:16.934 INFO:tasks.workunit.client.1.smithi161.stdout:2/190: stat de/d11/d14/d1f 0 2024-02-22T00:33:16.937 INFO:tasks.workunit.client.1.smithi161.stdout:4/200: symlink d5/d10/d14/d24/d28/d38/l49 0 2024-02-22T00:33:16.938 INFO:tasks.workunit.client.1.smithi161.stdout:3/189: dwrite da/dc/fd [0,4194304] 0 2024-02-22T00:33:16.938 INFO:tasks.workunit.client.1.smithi161.stdout:4/201: stat d5/d17/c32 0 2024-02-22T00:33:16.938 INFO:tasks.workunit.client.1.smithi161.stdout:9/228: mkdir d1/d4b 0 2024-02-22T00:33:16.941 INFO:tasks.workunit.client.1.smithi161.stdout:3/190: fsync da/dc/d11/f28 0 2024-02-22T00:33:16.941 INFO:tasks.workunit.client.1.smithi161.stdout:0/254: link d14/d37/d42/l4f d14/d44/l5e 0 2024-02-22T00:33:16.941 INFO:tasks.workunit.client.1.smithi161.stdout:2/191: dread f3 [0,4194304] 0 2024-02-22T00:33:16.942 INFO:tasks.workunit.client.1.smithi161.stdout:9/229: mknod d1/d2/d4/d1f/c4c 0 2024-02-22T00:33:16.943 INFO:tasks.workunit.client.1.smithi161.stdout:2/192: chown de/d2b/f46 313 1 2024-02-22T00:33:16.943 INFO:tasks.workunit.client.1.smithi161.stdout:3/191: dread - da/dc/d11/d26/f34 zero size 2024-02-22T00:33:16.944 INFO:tasks.workunit.client.1.smithi161.stdout:4/202: link d5/d10/f1b d5/d17/f4a 0 2024-02-22T00:33:16.944 INFO:tasks.workunit.client.1.smithi161.stdout:2/193: readlink de/d11/d14/d1f/d33/l45 0 2024-02-22T00:33:16.946 INFO:tasks.workunit.client.1.smithi161.stdout:2/194: chown de/cf 195 1 2024-02-22T00:33:16.947 INFO:tasks.workunit.client.1.smithi161.stdout:0/255: fsync d14/f4a 0 2024-02-22T00:33:16.948 INFO:tasks.workunit.client.1.smithi161.stdout:4/203: mknod d5/d10/d14/d24/d28/d38/c4b 0 2024-02-22T00:33:16.951 INFO:tasks.workunit.client.1.smithi161.stdout:0/256: write d14/d29/f5c [291266,21085] 0 2024-02-22T00:33:16.951 INFO:tasks.workunit.client.1.smithi161.stdout:4/204: rmdir d5 39 2024-02-22T00:33:16.952 INFO:tasks.workunit.client.1.smithi161.stdout:0/257: chown d14/d1a/l3c 236 1 2024-02-22T00:33:16.954 INFO:tasks.workunit.client.1.smithi161.stdout:2/195: dwrite de/d1e/f31 [0,4194304] 0 2024-02-22T00:33:16.954 INFO:tasks.workunit.client.1.smithi161.stdout:4/205: readlink d5/d10/l2e 0 2024-02-22T00:33:16.957 INFO:tasks.workunit.client.1.smithi161.stdout:0/258: creat d14/d37/f5f x:0 0 0 2024-02-22T00:33:16.958 INFO:tasks.workunit.client.1.smithi161.stdout:0/259: readlink d14/d29/l3e 0 2024-02-22T00:33:16.960 INFO:tasks.workunit.client.1.smithi161.stdout:2/196: dwrite de/d1e/f31 [0,4194304] 0 2024-02-22T00:33:16.960 INFO:tasks.workunit.client.1.smithi161.stdout:4/206: write d5/d10/f1b [646585,105986] 0 2024-02-22T00:33:16.962 INFO:tasks.workunit.client.1.smithi161.stdout:4/207: fsync d5/fe 0 2024-02-22T00:33:16.963 INFO:tasks.workunit.client.1.smithi161.stdout:0/260: creat d14/d1a/f60 x:0 0 0 2024-02-22T00:33:16.964 INFO:tasks.workunit.client.1.smithi161.stdout:4/208: truncate d5/f6 1808832 0 2024-02-22T00:33:16.967 INFO:tasks.workunit.client.1.smithi161.stdout:2/197: dread de/d2b/f2d [0,4194304] 0 2024-02-22T00:33:16.968 INFO:tasks.workunit.client.1.smithi161.stdout:0/261: mknod d14/c61 0 2024-02-22T00:33:16.969 INFO:tasks.workunit.client.1.smithi161.stdout:9/230: write d1/d2/f2e [332165,79789] 0 2024-02-22T00:33:16.972 INFO:tasks.workunit.client.1.smithi161.stdout:2/198: rename de/d2b/c2c to de/d2b/c49 0 2024-02-22T00:33:16.972 INFO:tasks.workunit.client.1.smithi161.stdout:0/262: write d14/d37/f45 [5301677,33120] 0 2024-02-22T00:33:16.975 INFO:tasks.workunit.client.1.smithi161.stdout:0/263: fsync d14/d1a/f23 0 2024-02-22T00:33:16.976 INFO:tasks.workunit.client.1.smithi161.stdout:2/199: read de/d11/d14/f34 [702270,40225] 0 2024-02-22T00:33:16.977 INFO:tasks.workunit.client.1.smithi161.stdout:3/192: write da/f1a [3306792,22028] 0 2024-02-22T00:33:16.978 INFO:tasks.workunit.client.1.smithi161.stdout:4/209: dwrite d5/d10/d14/d24/d28/f2d [0,4194304] 0 2024-02-22T00:33:16.989 INFO:tasks.workunit.client.1.smithi161.stdout:4/210: symlink d5/l4c 0 2024-02-22T00:33:16.991 INFO:tasks.workunit.client.1.smithi161.stdout:9/231: dwrite d1/d2/d4/d11/d21/f46 [0,4194304] 0 2024-02-22T00:33:16.992 INFO:tasks.workunit.client.1.smithi161.stdout:9/232: chown d1/d2/d4/d1f/c4c 2 1 2024-02-22T00:33:16.992 INFO:tasks.workunit.client.1.smithi161.stdout:2/200: rename de/d11/d14/d1f/d33/l45 to de/d1e/d3a/l4a 0 2024-02-22T00:33:16.993 INFO:tasks.workunit.client.1.smithi161.stdout:4/211: chown d5/d10/d14/d24/l39 366 1 2024-02-22T00:33:16.994 INFO:tasks.workunit.client.1.smithi161.stdout:0/264: link d14/l20 d14/d37/l62 0 2024-02-22T00:33:16.995 INFO:tasks.workunit.client.1.smithi161.stdout:2/201: write de/d1e/f24 [695092,86010] 0 2024-02-22T00:33:16.996 INFO:tasks.workunit.client.1.smithi161.stdout:3/193: dwrite da/dc/d11/f28 [0,4194304] 0 2024-02-22T00:33:16.999 INFO:tasks.workunit.client.1.smithi161.stdout:4/212: write d5/f27 [2066836,68122] 0 2024-02-22T00:33:17.003 INFO:tasks.workunit.client.1.smithi161.stdout:3/194: creat da/dc/d11/d26/f3c x:0 0 0 2024-02-22T00:33:17.004 INFO:tasks.workunit.client.1.smithi161.stdout:0/265: link d14/d1a/d3f/f40 d14/d1a/f63 0 2024-02-22T00:33:17.004 INFO:tasks.workunit.client.1.smithi161.stdout:4/213: chown d5/d10/d14/d24/l2c 13 1 2024-02-22T00:33:17.004 INFO:tasks.workunit.client.1.smithi161.stdout:9/233: link d1/d5/d9/c14 d1/c4d 0 2024-02-22T00:33:17.004 INFO:tasks.workunit.client.1.smithi161.stdout:3/195: write da/f1a [2173449,109490] 0 2024-02-22T00:33:17.006 INFO:tasks.workunit.client.1.smithi161.stdout:2/202: write de/d11/d14/d1f/d33/f47 [1178994,13513] 0 2024-02-22T00:33:17.009 INFO:tasks.workunit.client.1.smithi161.stdout:0/266: write d14/f51 [4623548,57933] 0 2024-02-22T00:33:17.011 INFO:tasks.workunit.client.1.smithi161.stdout:2/203: dread de/d11/d14/f18 [0,4194304] 0 2024-02-22T00:33:17.016 INFO:tasks.workunit.client.1.smithi161.stdout:9/234: rename d1/d2/d7/l45 to d1/d2/d4/l4e 0 2024-02-22T00:33:17.017 INFO:tasks.workunit.client.1.smithi161.stdout:4/214: dwrite d5/d17/f31 [0,4194304] 0 2024-02-22T00:33:17.019 INFO:tasks.workunit.client.1.smithi161.stdout:2/204: rmdir de/d1e/d3a 39 2024-02-22T00:33:17.020 INFO:tasks.workunit.client.1.smithi161.stdout:9/235: chown d1/d5/d9/l2b 287574 1 2024-02-22T00:33:17.020 INFO:tasks.workunit.client.1.smithi161.stdout:4/215: stat d5/d10/d14/l16 0 2024-02-22T00:33:17.022 INFO:tasks.workunit.client.1.smithi161.stdout:0/267: rename d14/f17 to d14/d1a/d3f/f64 0 2024-02-22T00:33:17.022 INFO:tasks.workunit.client.1.smithi161.stdout:3/196: getdents da/d29 0 2024-02-22T00:33:17.025 INFO:tasks.workunit.client.1.smithi161.stdout:9/236: mkdir d1/d5/d9/d33/d4f 0 2024-02-22T00:33:17.030 INFO:tasks.workunit.client.1.smithi161.stdout:0/268: dread d14/f4a [0,4194304] 0 2024-02-22T00:33:17.031 INFO:tasks.workunit.client.1.smithi161.stdout:2/205: rename de/d11/d14/f34 to de/d1e/f4b 0 2024-02-22T00:33:17.033 INFO:tasks.workunit.client.1.smithi161.stdout:9/237: symlink d1/d25/l50 0 2024-02-22T00:33:17.033 INFO:tasks.workunit.client.1.smithi161.stdout:4/216: dread d5/d17/f1e [0,4194304] 0 2024-02-22T00:33:17.034 INFO:tasks.workunit.client.1.smithi161.stdout:3/197: dwrite da/dc/d11/d26/f19 [4194304,4194304] 0 2024-02-22T00:33:17.034 INFO:tasks.workunit.client.1.smithi161.stdout:0/269: symlink d14/d1a/l65 0 2024-02-22T00:33:17.040 INFO:tasks.workunit.client.1.smithi161.stdout:3/198: chown da/dc/d11/d26/f3c 534437254 1 2024-02-22T00:33:17.045 INFO:tasks.workunit.client.1.smithi161.stdout:2/206: dwrite de/f1c [0,4194304] 0 2024-02-22T00:33:17.053 INFO:tasks.workunit.client.1.smithi161.stdout:0/270: creat d14/d1a/f66 x:0 0 0 2024-02-22T00:33:17.055 INFO:tasks.workunit.client.1.smithi161.stdout:2/207: mknod de/d11/d14/d1f/d33/c4c 0 2024-02-22T00:33:17.060 INFO:tasks.workunit.client.1.smithi161.stdout:0/271: dread d14/f1f [0,4194304] 0 2024-02-22T00:33:17.066 INFO:tasks.workunit.client.1.smithi161.stdout:0/272: creat d14/d44/f67 x:0 0 0 2024-02-22T00:33:17.067 INFO:tasks.workunit.client.1.smithi161.stdout:2/208: readlink de/d1e/d3a/l4a 0 2024-02-22T00:33:17.070 INFO:tasks.workunit.client.1.smithi161.stdout:0/273: rename d14/d1a/d3f/f40 to d14/d29/f68 0 2024-02-22T00:33:17.075 INFO:tasks.workunit.client.1.smithi161.stdout:0/274: creat d14/d1a/d3f/d5d/f69 x:0 0 0 2024-02-22T00:33:17.077 INFO:tasks.workunit.client.1.smithi161.stdout:0/275: dread d14/f1f [0,4194304] 0 2024-02-22T00:33:17.079 INFO:tasks.workunit.client.1.smithi161.stdout:0/276: symlink d14/d1a/l6a 0 2024-02-22T00:33:17.081 INFO:tasks.workunit.client.1.smithi161.stdout:4/217: write d5/d10/f26 [42125,6821] 0 2024-02-22T00:33:17.083 INFO:tasks.workunit.client.1.smithi161.stdout:3/199: dwrite da/dc/f17 [0,4194304] 0 2024-02-22T00:33:17.096 INFO:tasks.workunit.client.1.smithi161.stdout:0/277: rmdir d14/d44 39 2024-02-22T00:33:17.096 INFO:tasks.workunit.client.1.smithi161.stdout:1/162: sync 2024-02-22T00:33:17.102 INFO:tasks.workunit.client.1.smithi161.stdout:3/200: chown da/dc/fd 117940 1 2024-02-22T00:33:17.104 INFO:tasks.workunit.client.1.smithi161.stdout:2/209: dread de/d11/f13 [0,4194304] 0 2024-02-22T00:33:17.104 INFO:tasks.workunit.client.1.smithi161.stdout:1/163: creat d19/d1d/d2c/f3d x:0 0 0 2024-02-22T00:33:17.105 INFO:tasks.workunit.client.1.smithi161.stdout:9/238: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:17.111 INFO:tasks.workunit.client.1.smithi161.stdout:4/218: dwrite d5/d10/d14/f45 [0,4194304] 0 2024-02-22T00:33:17.114 INFO:tasks.workunit.client.1.smithi161.stdout:4/219: creat d5/d10/f4d x:0 0 0 2024-02-22T00:33:17.114 INFO:tasks.workunit.client.1.smithi161.stdout:2/210: dread de/d1e/f24 [0,4194304] 0 2024-02-22T00:33:17.116 INFO:tasks.workunit.client.1.smithi161.stdout:2/211: stat de/d1e/c28 0 2024-02-22T00:33:17.116 INFO:tasks.workunit.client.1.smithi161.stdout:1/164: write d19/f23 [402177,114589] 0 2024-02-22T00:33:17.117 INFO:tasks.workunit.client.1.smithi161.stdout:3/201: truncate da/f1a 1835338 0 2024-02-22T00:33:17.120 INFO:tasks.workunit.client.1.smithi161.stdout:4/220: fdatasync f0 0 2024-02-22T00:33:17.120 INFO:tasks.workunit.client.1.smithi161.stdout:2/212: write f8 [403116,55688] 0 2024-02-22T00:33:17.120 INFO:tasks.workunit.client.1.smithi161.stdout:4/221: chown d5/d10/d14/d24/f35 3645 1 2024-02-22T00:33:17.121 INFO:tasks.workunit.client.1.smithi161.stdout:1/165: mknod d19/d1d/d2c/d2d/c3e 0 2024-02-22T00:33:17.122 INFO:tasks.workunit.client.1.smithi161.stdout:0/278: dread d14/f18 [0,4194304] 0 2024-02-22T00:33:17.125 INFO:tasks.workunit.client.1.smithi161.stdout:2/213: truncate de/d11/d14/d1f/f36 996849 0 2024-02-22T00:33:17.126 INFO:tasks.workunit.client.1.smithi161.stdout:4/222: unlink d5/d8/f47 0 2024-02-22T00:33:17.126 INFO:tasks.workunit.client.1.smithi161.stdout:3/202: creat da/dc/d11/d26/d2f/d37/d39/f3d x:0 0 0 2024-02-22T00:33:17.128 INFO:tasks.workunit.client.1.smithi161.stdout:4/223: symlink d5/d17/l4e 0 2024-02-22T00:33:17.129 INFO:tasks.workunit.client.1.smithi161.stdout:0/279: chown d14/d1a/f1b 128849 1 2024-02-22T00:33:17.131 INFO:tasks.workunit.client.1.smithi161.stdout:2/214: write de/d1e/d3a/f40 [964791,120427] 0 2024-02-22T00:33:17.131 INFO:tasks.workunit.client.1.smithi161.stdout:4/224: dread - d5/d10/f4d zero size 2024-02-22T00:33:17.131 INFO:tasks.workunit.client.1.smithi161.stdout:3/203: creat da/dc/d11/f3e x:0 0 0 2024-02-22T00:33:17.133 INFO:tasks.workunit.client.1.smithi161.stdout:3/204: fdatasync da/f13 0 2024-02-22T00:33:17.134 INFO:tasks.workunit.client.1.smithi161.stdout:4/225: mkdir d5/d10/d14/d4f 0 2024-02-22T00:33:17.135 INFO:tasks.workunit.client.1.smithi161.stdout:2/215: rename de/d11/d14/d1f/l44 to de/d1e/d3a/l4d 0 2024-02-22T00:33:17.136 INFO:tasks.workunit.client.1.smithi161.stdout:3/205: creat da/dc/d11/d26/d2f/d37/d39/f3f x:0 0 0 2024-02-22T00:33:17.141 INFO:tasks.workunit.client.1.smithi161.stdout:9/239: fsync d1/d2/d7/da/f13 0 2024-02-22T00:33:17.144 INFO:tasks.workunit.client.1.smithi161.stdout:9/240: chown d1/d2/d7/da 5342978 1 2024-02-22T00:33:17.146 INFO:tasks.workunit.client.1.smithi161.stdout:9/241: chown d1/c30 412548257 1 2024-02-22T00:33:17.147 INFO:tasks.workunit.client.1.smithi161.stdout:1/166: truncate f1 1616235 0 2024-02-22T00:33:17.149 INFO:tasks.workunit.client.1.smithi161.stdout:3/206: dwrite da/dc/d11/d26/f34 [0,4194304] 0 2024-02-22T00:33:17.149 INFO:tasks.workunit.client.1.smithi161.stdout:4/226: rmdir d5/d10 39 2024-02-22T00:33:17.149 INFO:tasks.workunit.client.1.smithi161.stdout:2/216: dwrite de/d1e/f31 [0,4194304] 0 2024-02-22T00:33:17.154 INFO:tasks.workunit.client.1.smithi161.stdout:2/217: creat de/d11/f4e x:0 0 0 2024-02-22T00:33:17.157 INFO:tasks.workunit.client.1.smithi161.stdout:1/167: unlink d19/d1d/d2c/l30 0 2024-02-22T00:33:17.159 INFO:tasks.workunit.client.1.smithi161.stdout:0/280: dread d14/d37/f45 [4194304,4194304] 0 2024-02-22T00:33:17.160 INFO:tasks.workunit.client.1.smithi161.stdout:2/218: unlink de/d11/l26 0 2024-02-22T00:33:17.163 INFO:tasks.workunit.client.1.smithi161.stdout:0/281: dread d14/f18 [0,4194304] 0 2024-02-22T00:33:17.163 INFO:tasks.workunit.client.1.smithi161.stdout:4/227: mkdir d5/d10/d14/d24/d28/d50 0 2024-02-22T00:33:17.164 INFO:tasks.workunit.client.1.smithi161.stdout:0/282: readlink d14/l48 0 2024-02-22T00:33:17.164 INFO:tasks.workunit.client.1.smithi161.stdout:1/168: mkdir d19/d1d/d2c/d2d/d3f 0 2024-02-22T00:33:17.165 INFO:tasks.workunit.client.1.smithi161.stdout:0/283: readlink d14/d29/l32 0 2024-02-22T00:33:17.165 INFO:tasks.workunit.client.1.smithi161.stdout:2/219: chown fc 1940430 1 2024-02-22T00:33:17.166 INFO:tasks.workunit.client.1.smithi161.stdout:0/284: chown d14/d37 742 1 2024-02-22T00:33:17.166 INFO:tasks.workunit.client.1.smithi161.stdout:4/228: unlink d5/d10/d14/f3d 0 2024-02-22T00:33:17.168 INFO:tasks.workunit.client.1.smithi161.stdout:4/229: readlink d5/d8/ld 0 2024-02-22T00:33:17.170 INFO:tasks.workunit.client.1.smithi161.stdout:1/169: creat d19/d1d/d2c/d2d/f40 x:0 0 0 2024-02-22T00:33:17.170 INFO:tasks.workunit.client.1.smithi161.stdout:2/220: rmdir de/d11/d14/d1f/d33 39 2024-02-22T00:33:17.172 INFO:tasks.workunit.client.1.smithi161.stdout:0/285: truncate d14/f16 453711 0 2024-02-22T00:33:17.173 INFO:tasks.workunit.client.1.smithi161.stdout:0/286: truncate d14/d29/f5c 1281087 0 2024-02-22T00:33:17.173 INFO:tasks.workunit.client.1.smithi161.stdout:0/287: chown d14/f51 32588 1 2024-02-22T00:33:17.174 INFO:tasks.workunit.client.1.smithi161.stdout:9/242: truncate d1/d2/d4/f2a 3335580 0 2024-02-22T00:33:17.177 INFO:tasks.workunit.client.1.smithi161.stdout:1/170: rename d19/d1d/d2c/f2e to d19/d2f/f41 0 2024-02-22T00:33:17.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:15.755744+0000 mgr.smithi161.sazlam (mgr.24369) 25 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 369 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 723 KiB/s rd, 27 MiB/s wr, 331 op/s 2024-02-22T00:33:17.178 INFO:tasks.workunit.client.1.smithi161.stdout:1/171: write f5 [2573352,95530] 0 2024-02-22T00:33:17.179 INFO:tasks.workunit.client.1.smithi161.stdout:4/230: symlink d5/l51 0 2024-02-22T00:33:17.180 INFO:tasks.workunit.client.1.smithi161.stdout:4/231: dread - d5/d10/f4d zero size 2024-02-22T00:33:17.183 INFO:tasks.workunit.client.1.smithi161.stdout:9/243: mknod d1/d2/d4/d1f/c51 0 2024-02-22T00:33:17.185 INFO:tasks.workunit.client.1.smithi161.stdout:4/232: creat d5/d10/f52 x:0 0 0 2024-02-22T00:33:17.185 INFO:tasks.workunit.client.1.smithi161.stdout:2/221: mkdir de/d11/d14/d1f/d33/d35/d4f 0 2024-02-22T00:33:17.187 INFO:tasks.workunit.client.1.smithi161.stdout:9/244: mknod d1/d2/d7/d3f/c52 0 2024-02-22T00:33:17.188 INFO:tasks.workunit.client.1.smithi161.stdout:0/288: dwrite d14/d44/f67 [0,4194304] 0 2024-02-22T00:33:17.191 INFO:tasks.workunit.client.1.smithi161.stdout:9/245: rmdir d1/d2 39 2024-02-22T00:33:17.194 INFO:tasks.workunit.client.1.smithi161.stdout:0/289: symlink d14/d37/l6b 0 2024-02-22T00:33:17.197 INFO:tasks.workunit.client.1.smithi161.stdout:4/233: rename d5/d10/d14/d24/d28/d50 to d5/d8/d41/d53 0 2024-02-22T00:33:17.198 INFO:tasks.workunit.client.1.smithi161.stdout:4/234: fsync f0 0 2024-02-22T00:33:17.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/222: dwrite de/f21 [0,4194304] 0 2024-02-22T00:33:17.201 INFO:tasks.workunit.client.1.smithi161.stdout:2/223: chown de/c1d 345231336 1 2024-02-22T00:33:17.202 INFO:tasks.workunit.client.1.smithi161.stdout:4/235: creat d5/d8/d41/f54 x:0 0 0 2024-02-22T00:33:17.203 INFO:tasks.workunit.client.1.smithi161.stdout:9/246: dread d1/d2/d7/f47 [0,4194304] 0 2024-02-22T00:33:17.203 INFO:tasks.workunit.client.1.smithi161.stdout:2/224: write de/d1e/f4b [3296977,23134] 0 2024-02-22T00:33:17.209 INFO:tasks.workunit.client.1.smithi161.stdout:2/225: rename de/d1e/f4b to de/f50 0 2024-02-22T00:33:17.214 INFO:tasks.workunit.client.1.smithi161.stdout:2/226: truncate de/d1e/f24 1480579 0 2024-02-22T00:33:17.216 INFO:tasks.workunit.client.1.smithi161.stdout:4/236: dwrite d5/d10/f52 [0,4194304] 0 2024-02-22T00:33:17.218 INFO:tasks.workunit.client.1.smithi161.stdout:1/172: dread f9 [0,4194304] 0 2024-02-22T00:33:17.219 INFO:tasks.workunit.client.1.smithi161.stdout:9/247: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:17.223 INFO:tasks.workunit.client.1.smithi161.stdout:4/237: mknod d5/d8/d41/c55 0 2024-02-22T00:33:17.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/248: symlink d1/d2/d4/l53 0 2024-02-22T00:33:17.224 INFO:tasks.workunit.client.1.smithi161.stdout:1/173: truncate d19/d1d/d2c/d2d/f40 523851 0 2024-02-22T00:33:17.227 INFO:tasks.workunit.client.1.smithi161.stdout:0/290: dread d14/d1a/d3f/f64 [0,4194304] 0 2024-02-22T00:33:17.227 INFO:tasks.workunit.client.1.smithi161.stdout:1/174: write d19/d1d/d2c/f3d [121876,41089] 0 2024-02-22T00:33:17.228 INFO:tasks.workunit.client.1.smithi161.stdout:1/175: chown d19/d1d/d2c/f3d 36757 1 2024-02-22T00:33:17.230 INFO:tasks.workunit.client.1.smithi161.stdout:0/291: symlink d14/d1a/d3f/l6c 0 2024-02-22T00:33:17.230 INFO:tasks.workunit.client.1.smithi161.stdout:1/176: stat l14 0 2024-02-22T00:33:17.231 INFO:tasks.workunit.client.1.smithi161.stdout:0/292: dread - d14/d29/f68 zero size 2024-02-22T00:33:17.232 INFO:tasks.workunit.client.1.smithi161.stdout:1/177: read f2 [863904,42087] 0 2024-02-22T00:33:17.233 INFO:tasks.workunit.client.1.smithi161.stdout:4/238: rename d5/d10/d14/l16 to d5/d17/l56 0 2024-02-22T00:33:17.233 INFO:tasks.workunit.client.1.smithi161.stdout:4/239: readlink d5/l36 0 2024-02-22T00:33:17.239 INFO:tasks.workunit.client.1.smithi161.stdout:4/240: dread d5/f27 [0,4194304] 0 2024-02-22T00:33:17.241 INFO:tasks.workunit.client.1.smithi161.stdout:2/227: truncate de/d11/d14/d1f/f36 502752 0 2024-02-22T00:33:17.243 INFO:tasks.workunit.client.1.smithi161.stdout:1/178: dread f15 [0,4194304] 0 2024-02-22T00:33:17.244 INFO:tasks.workunit.client.1.smithi161.stdout:2/228: mknod de/c51 0 2024-02-22T00:33:17.244 INFO:tasks.workunit.client.1.smithi161.stdout:4/241: dread d5/d10/f52 [0,4194304] 0 2024-02-22T00:33:17.249 INFO:tasks.workunit.client.1.smithi161.stdout:0/293: dread d14/d1a/f2d [0,4194304] 0 2024-02-22T00:33:17.250 INFO:tasks.workunit.client.1.smithi161.stdout:2/229: mknod de/d11/d14/d1f/d33/d35/d4f/c52 0 2024-02-22T00:33:17.251 INFO:tasks.workunit.client.1.smithi161.stdout:2/230: write f8 [1116030,88070] 0 2024-02-22T00:33:17.251 INFO:tasks.workunit.client.1.smithi161.stdout:1/179: link d19/d1d/d2c/d2d/c3e d19/d2f/c42 0 2024-02-22T00:33:17.252 INFO:tasks.workunit.client.1.smithi161.stdout:0/294: symlink d14/d1a/l6d 0 2024-02-22T00:33:17.253 INFO:tasks.workunit.client.1.smithi161.stdout:1/180: creat d19/f43 x:0 0 0 2024-02-22T00:33:17.254 INFO:tasks.workunit.client.1.smithi161.stdout:0/295: write d14/d29/f5c [1255833,129588] 0 2024-02-22T00:33:17.254 INFO:tasks.workunit.client.1.smithi161.stdout:2/231: creat de/f53 x:0 0 0 2024-02-22T00:33:17.256 INFO:tasks.workunit.client.1.smithi161.stdout:1/181: creat d19/d1d/d2c/f44 x:0 0 0 2024-02-22T00:33:17.256 INFO:tasks.workunit.client.1.smithi161.stdout:0/296: symlink d14/d37/l6e 0 2024-02-22T00:33:17.258 INFO:tasks.workunit.client.1.smithi161.stdout:2/232: creat de/d11/d14/d1f/d33/d35/d4f/f54 x:0 0 0 2024-02-22T00:33:17.260 INFO:tasks.workunit.client.1.smithi161.stdout:2/233: dread - de/f53 zero size 2024-02-22T00:33:17.263 INFO:tasks.workunit.client.1.smithi161.stdout:2/234: mknod de/d11/d14/c55 0 2024-02-22T00:33:17.263 INFO:tasks.workunit.client.1.smithi161.stdout:1/182: dwrite d19/d1d/f28 [0,4194304] 0 2024-02-22T00:33:17.267 INFO:tasks.workunit.client.1.smithi161.stdout:1/183: creat d19/d1d/d2c/d2d/f45 x:0 0 0 2024-02-22T00:33:17.272 INFO:tasks.workunit.client.1.smithi161.stdout:2/235: link de/d2b/f46 de/d11/d14/d1f/d33/d35/d4f/f56 0 2024-02-22T00:33:17.274 INFO:tasks.workunit.client.1.smithi161.stdout:1/184: fsync f7 0 2024-02-22T00:33:17.275 INFO:tasks.workunit.client.1.smithi161.stdout:1/185: write d19/f23 [412559,2509] 0 2024-02-22T00:33:17.276 INFO:tasks.workunit.client.1.smithi161.stdout:2/236: unlink de/cf 0 2024-02-22T00:33:17.280 INFO:tasks.workunit.client.1.smithi161.stdout:2/237: mknod de/d11/d14/c57 0 2024-02-22T00:33:17.283 INFO:tasks.workunit.client.1.smithi161.stdout:0/297: write d14/f16 [1368647,108160] 0 2024-02-22T00:33:17.285 INFO:tasks.workunit.client.1.smithi161.stdout:0/298: creat d14/d1a/d3f/d5d/f6f x:0 0 0 2024-02-22T00:33:17.286 INFO:tasks.workunit.client.1.smithi161.stdout:0/299: dread - d14/d1a/f3d zero size 2024-02-22T00:33:17.288 INFO:tasks.workunit.client.1.smithi161.stdout:2/238: rmdir de/d2b 39 2024-02-22T00:33:17.288 INFO:tasks.workunit.client.1.smithi161.stdout:2/239: readlink lb 0 2024-02-22T00:33:17.289 INFO:tasks.workunit.client.1.smithi161.stdout:2/240: write de/f1c [121625,66982] 0 2024-02-22T00:33:17.290 INFO:tasks.workunit.client.1.smithi161.stdout:0/300: unlink d14/d1a/d3f/d5d/f6f 0 2024-02-22T00:33:17.290 INFO:tasks.workunit.client.1.smithi161.stdout:0/301: fsync fb 0 2024-02-22T00:33:17.291 INFO:tasks.workunit.client.1.smithi161.stdout:2/241: write de/d1e/d3a/f40 [1980171,130705] 0 2024-02-22T00:33:17.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:15.755744+0000 mgr.smithi161.sazlam (mgr.24369) 25 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 369 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 723 KiB/s rd, 27 MiB/s wr, 331 op/s 2024-02-22T00:33:17.295 INFO:tasks.workunit.client.1.smithi161.stdout:0/302: dread d14/d1a/d3f/f64 [0,4194304] 0 2024-02-22T00:33:17.296 INFO:tasks.workunit.client.1.smithi161.stdout:2/242: dread - de/d2b/f46 zero size 2024-02-22T00:33:17.298 INFO:tasks.workunit.client.1.smithi161.stdout:0/303: symlink d14/d29/l70 0 2024-02-22T00:33:17.302 INFO:tasks.workunit.client.1.smithi161.stdout:1/186: dwrite d19/f26 [4194304,4194304] 0 2024-02-22T00:33:17.303 INFO:tasks.workunit.client.1.smithi161.stdout:0/304: unlink d14/d37/l39 0 2024-02-22T00:33:17.304 INFO:tasks.workunit.client.1.smithi161.stdout:2/243: rename de/d1e/d3a/l4d to de/d11/l58 0 2024-02-22T00:33:17.304 INFO:tasks.workunit.client.1.smithi161.stdout:2/244: dread - de/f53 zero size 2024-02-22T00:33:17.305 INFO:tasks.workunit.client.1.smithi161.stdout:1/187: write d19/d2f/f41 [267707,128857] 0 2024-02-22T00:33:17.306 INFO:tasks.workunit.client.1.smithi161.stdout:1/188: write d19/d1d/d2c/f44 [678221,43476] 0 2024-02-22T00:33:17.308 INFO:tasks.workunit.client.1.smithi161.stdout:0/305: rmdir d14/d1a/d3f/d5d 39 2024-02-22T00:33:17.309 INFO:tasks.workunit.client.1.smithi161.stdout:0/306: chown d14/d1a/l6d 2 1 2024-02-22T00:33:17.310 INFO:tasks.workunit.client.1.smithi161.stdout:2/245: rmdir de/d11/d14/d1f/d33/d35 39 2024-02-22T00:33:17.311 INFO:tasks.workunit.client.1.smithi161.stdout:1/189: unlink d19/d2f/c3a 0 2024-02-22T00:33:17.312 INFO:tasks.workunit.client.1.smithi161.stdout:1/190: write f10 [793136,25521] 0 2024-02-22T00:33:17.313 INFO:tasks.workunit.client.1.smithi161.stdout:0/307: creat d14/d1a/f71 x:0 0 0 2024-02-22T00:33:17.315 INFO:tasks.workunit.client.1.smithi161.stdout:2/246: link de/d11/d14/d1f/f30 de/d11/f59 0 2024-02-22T00:33:17.317 INFO:tasks.workunit.client.1.smithi161.stdout:0/308: fsync d14/d1a/f63 0 2024-02-22T00:33:17.318 INFO:tasks.workunit.client.1.smithi161.stdout:1/191: rename d19/d1d/d2c/d2d/f45 to d19/f46 0 2024-02-22T00:33:17.319 INFO:tasks.workunit.client.1.smithi161.stdout:2/247: chown de/d11/d14/d1f/d33/d35/d4f/f56 151608 1 2024-02-22T00:33:17.320 INFO:tasks.workunit.client.1.smithi161.stdout:2/248: dread - de/d11/f4e zero size 2024-02-22T00:33:17.321 INFO:tasks.workunit.client.1.smithi161.stdout:2/249: stat de/d11/d14/d1f/d33 0 2024-02-22T00:33:17.322 INFO:tasks.workunit.client.1.smithi161.stdout:1/192: symlink d19/d1d/l47 0 2024-02-22T00:33:17.325 INFO:tasks.workunit.client.1.smithi161.stdout:1/193: mkdir d19/d48 0 2024-02-22T00:33:17.327 INFO:tasks.workunit.client.1.smithi161.stdout:2/250: symlink de/l5a 0 2024-02-22T00:33:17.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/194: dread d19/d2f/f41 [0,4194304] 0 2024-02-22T00:33:17.329 INFO:tasks.workunit.client.1.smithi161.stdout:1/195: chown d19/f37 67067962 1 2024-02-22T00:33:17.329 INFO:tasks.workunit.client.1.smithi161.stdout:1/196: chown l14 16838043 1 2024-02-22T00:33:17.330 INFO:tasks.workunit.client.1.smithi161.stdout:2/251: creat de/d2b/f5b x:0 0 0 2024-02-22T00:33:17.333 INFO:tasks.workunit.client.1.smithi161.stdout:1/197: unlink f2 0 2024-02-22T00:33:17.338 INFO:tasks.workunit.client.1.smithi161.stdout:0/309: dwrite d14/f56 [0,4194304] 0 2024-02-22T00:33:17.342 INFO:tasks.workunit.client.1.smithi161.stdout:0/310: symlink d14/d37/l72 0 2024-02-22T00:33:17.345 INFO:tasks.workunit.client.1.smithi161.stdout:1/198: dwrite f11 [0,4194304] 0 2024-02-22T00:33:17.345 INFO:tasks.workunit.client.1.smithi161.stdout:2/252: dwrite de/d11/f1a [4194304,4194304] 0 2024-02-22T00:33:17.348 INFO:tasks.workunit.client.1.smithi161.stdout:0/311: mkdir d14/d37/d42/d73 0 2024-02-22T00:33:17.351 INFO:tasks.workunit.client.1.smithi161.stdout:0/312: read - d14/d1a/f60 zero size 2024-02-22T00:33:17.353 INFO:tasks.workunit.client.1.smithi161.stdout:2/253: rename de/d11/d14/d1f to de/d11/d5c 0 2024-02-22T00:33:17.359 INFO:tasks.workunit.client.1.smithi161.stdout:0/313: creat d14/d37/d42/d73/f74 x:0 0 0 2024-02-22T00:33:17.359 INFO:tasks.workunit.client.1.smithi161.stdout:0/314: read d14/f56 [1425463,68759] 0 2024-02-22T00:33:17.359 INFO:tasks.workunit.client.1.smithi161.stdout:1/199: truncate d19/d1d/f22 1189185 0 2024-02-22T00:33:17.362 INFO:tasks.workunit.client.1.smithi161.stdout:1/200: unlink d19/d1d/l47 0 2024-02-22T00:33:17.362 INFO:tasks.workunit.client.1.smithi161.stdout:2/254: dwrite de/f48 [0,4194304] 0 2024-02-22T00:33:17.363 INFO:tasks.workunit.client.1.smithi161.stdout:1/201: write d19/f23 [1055638,128307] 0 2024-02-22T00:33:17.364 INFO:tasks.workunit.client.1.smithi161.stdout:0/315: dread d14/d1a/f2d [0,4194304] 0 2024-02-22T00:33:17.365 INFO:tasks.workunit.client.1.smithi161.stdout:2/255: read de/d1e/d3a/f40 [916136,38871] 0 2024-02-22T00:33:17.371 INFO:tasks.workunit.client.1.smithi161.stdout:0/316: mknod d14/d1a/c75 0 2024-02-22T00:33:17.373 INFO:tasks.workunit.client.1.smithi161.stdout:0/317: dread - d14/d1a/d3f/f4c zero size 2024-02-22T00:33:17.373 INFO:tasks.workunit.client.1.smithi161.stdout:1/202: link d19/d1d/d2c/d2d/f40 d19/f49 0 2024-02-22T00:33:17.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/256: dwrite de/f50 [0,4194304] 0 2024-02-22T00:33:17.375 INFO:tasks.workunit.client.1.smithi161.stdout:2/257: chown de/d1e/f24 6 1 2024-02-22T00:33:17.376 INFO:tasks.workunit.client.1.smithi161.stdout:0/318: rmdir d14 39 2024-02-22T00:33:17.377 INFO:tasks.workunit.client.1.smithi161.stdout:1/203: chown d19/d2f/c35 3 1 2024-02-22T00:33:17.378 INFO:tasks.workunit.client.1.smithi161.stdout:0/319: truncate fd 1599956 0 2024-02-22T00:33:17.378 INFO:tasks.workunit.client.1.smithi161.stdout:1/204: write d19/d1d/f27 [3928154,9910] 0 2024-02-22T00:33:17.385 INFO:tasks.workunit.client.1.smithi161.stdout:0/320: write d14/f56 [2677197,127594] 0 2024-02-22T00:33:17.387 INFO:tasks.workunit.client.1.smithi161.stdout:2/258: getdents de 0 2024-02-22T00:33:17.387 INFO:tasks.workunit.client.1.smithi161.stdout:2/259: read - de/d2b/f46 zero size 2024-02-22T00:33:17.387 INFO:tasks.workunit.client.1.smithi161.stdout:0/321: creat d14/d37/f76 x:0 0 0 2024-02-22T00:33:17.390 INFO:tasks.workunit.client.1.smithi161.stdout:0/322: creat d14/d44/f77 x:0 0 0 2024-02-22T00:33:17.391 INFO:tasks.workunit.client.1.smithi161.stdout:2/260: creat de/d11/d5c/d33/d35/f5d x:0 0 0 2024-02-22T00:33:17.392 INFO:tasks.workunit.client.1.smithi161.stdout:0/323: symlink d14/d29/l78 0 2024-02-22T00:33:17.401 INFO:tasks.workunit.client.1.smithi161.stdout:1/205: rmdir d19/d1d/d2c/d2d 39 2024-02-22T00:33:17.405 INFO:tasks.workunit.client.1.smithi161.stdout:1/206: rename d19/l3c to d19/l4a 0 2024-02-22T00:33:17.407 INFO:tasks.workunit.client.1.smithi161.stdout:2/261: dread fc [0,4194304] 0 2024-02-22T00:33:17.407 INFO:tasks.workunit.client.1.smithi161.stdout:6/136: sync 2024-02-22T00:33:17.417 INFO:tasks.workunit.client.1.smithi161.stdout:0/324: truncate d14/f56 2943273 0 2024-02-22T00:33:17.418 INFO:tasks.workunit.client.1.smithi161.stdout:1/207: write d19/d1d/f22 [877034,65635] 0 2024-02-22T00:33:17.420 INFO:tasks.workunit.client.1.smithi161.stdout:1/208: dread - d19/f46 zero size 2024-02-22T00:33:17.421 INFO:tasks.workunit.client.1.smithi161.stdout:0/325: fdatasync d14/f1f 0 2024-02-22T00:33:17.422 INFO:tasks.workunit.client.1.smithi161.stdout:6/137: dwrite d3/d10/f21 [0,4194304] 0 2024-02-22T00:33:17.424 INFO:tasks.workunit.client.1.smithi161.stdout:0/326: chown d14/d1a/c75 214966873 1 2024-02-22T00:33:17.425 INFO:tasks.workunit.client.1.smithi161.stdout:2/262: dwrite de/d1e/f24 [0,4194304] 0 2024-02-22T00:33:17.427 INFO:tasks.workunit.client.1.smithi161.stdout:1/209: unlink d19/l2a 0 2024-02-22T00:33:17.427 INFO:tasks.workunit.client.1.smithi161.stdout:0/327: write d14/f4b [7665432,22726] 0 2024-02-22T00:33:17.432 INFO:tasks.workunit.client.1.smithi161.stdout:1/210: fsync f1 0 2024-02-22T00:33:17.434 INFO:tasks.workunit.client.1.smithi161.stdout:6/138: dwrite d3/d10/d12/f22 [0,4194304] 0 2024-02-22T00:33:17.435 INFO:tasks.workunit.client.1.smithi161.stdout:0/328: read f11 [3132324,26606] 0 2024-02-22T00:33:17.438 INFO:tasks.workunit.client.1.smithi161.stdout:6/139: creat d3/dc/f27 x:0 0 0 2024-02-22T00:33:17.440 INFO:tasks.workunit.client.1.smithi161.stdout:0/329: unlink d14/d1a/l1d 0 2024-02-22T00:33:17.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/140: mknod d3/c28 0 2024-02-22T00:33:17.444 INFO:tasks.workunit.client.1.smithi161.stdout:0/330: write d14/d1a/f28 [4080613,21714] 0 2024-02-22T00:33:17.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/141: dread - d3/d10/f26 zero size 2024-02-22T00:33:17.445 INFO:tasks.workunit.client.1.smithi161.stdout:2/263: truncate de/d11/f1a 7541156 0 2024-02-22T00:33:17.446 INFO:tasks.workunit.client.1.smithi161.stdout:2/264: chown fc 3253 1 2024-02-22T00:33:17.448 INFO:tasks.workunit.client.1.smithi161.stdout:2/265: rmdir de 39 2024-02-22T00:33:17.451 INFO:tasks.workunit.client.1.smithi161.stdout:0/331: dwrite d14/d1a/d3f/f4c [0,4194304] 0 2024-02-22T00:33:17.453 INFO:tasks.workunit.client.1.smithi161.stdout:0/332: creat d14/d1a/f79 x:0 0 0 2024-02-22T00:33:17.454 INFO:tasks.workunit.client.1.smithi161.stdout:1/211: dread f1 [0,4194304] 0 2024-02-22T00:33:17.455 INFO:tasks.workunit.client.1.smithi161.stdout:2/266: creat de/d11/d5c/d33/f5e x:0 0 0 2024-02-22T00:33:17.456 INFO:tasks.workunit.client.1.smithi161.stdout:0/333: chown d14/d1a/f24 10 1 2024-02-22T00:33:17.457 INFO:tasks.workunit.client.1.smithi161.stdout:0/334: readlink d14/d1a/d3f/l4d 0 2024-02-22T00:33:17.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/335: dread d14/d1a/d3f/f4c [0,4194304] 0 2024-02-22T00:33:17.463 INFO:tasks.workunit.client.1.smithi161.stdout:6/142: truncate d3/d10/d12/f22 2990354 0 2024-02-22T00:33:17.464 INFO:tasks.workunit.client.1.smithi161.stdout:6/143: read - d3/dc/f27 zero size 2024-02-22T00:33:17.465 INFO:tasks.workunit.client.1.smithi161.stdout:1/212: mknod d19/d1d/d2c/d2d/d3f/c4b 0 2024-02-22T00:33:17.467 INFO:tasks.workunit.client.1.smithi161.stdout:1/213: chown d19/d1d/l34 1864264 1 2024-02-22T00:33:17.468 INFO:tasks.workunit.client.1.smithi161.stdout:6/144: creat d3/d10/d12/f29 x:0 0 0 2024-02-22T00:33:17.470 INFO:tasks.workunit.client.1.smithi161.stdout:1/214: dread d19/f3b [0,4194304] 0 2024-02-22T00:33:17.471 INFO:tasks.workunit.client.1.smithi161.stdout:6/145: chown d3/dc/df/l11 0 1 2024-02-22T00:33:17.473 INFO:tasks.workunit.client.1.smithi161.stdout:0/336: dwrite f11 [0,4194304] 0 2024-02-22T00:33:17.475 INFO:tasks.workunit.client.1.smithi161.stdout:1/215: creat d19/d2f/f4c x:0 0 0 2024-02-22T00:33:17.477 INFO:tasks.workunit.client.1.smithi161.stdout:1/216: write d19/f23 [2217920,118952] 0 2024-02-22T00:33:17.477 INFO:tasks.workunit.client.1.smithi161.stdout:6/146: creat d3/dc/f2a x:0 0 0 2024-02-22T00:33:17.478 INFO:tasks.workunit.client.1.smithi161.stdout:1/217: write d19/f23 [724459,48150] 0 2024-02-22T00:33:17.488 INFO:tasks.workunit.client.1.smithi161.stdout:2/267: truncate de/d11/d14/f42 6635747 0 2024-02-22T00:33:17.490 INFO:tasks.workunit.client.1.smithi161.stdout:1/218: creat d19/d1d/d2c/f4d x:0 0 0 2024-02-22T00:33:17.491 INFO:tasks.workunit.client.1.smithi161.stdout:1/219: read d19/f49 [227920,58330] 0 2024-02-22T00:33:17.492 INFO:tasks.workunit.client.1.smithi161.stdout:6/147: getdents d3 0 2024-02-22T00:33:17.493 INFO:tasks.workunit.client.1.smithi161.stdout:1/220: write d19/f1f [3684203,18994] 0 2024-02-22T00:33:17.495 INFO:tasks.workunit.client.1.smithi161.stdout:1/221: creat d19/d2f/f4e x:0 0 0 2024-02-22T00:33:17.496 INFO:tasks.workunit.client.1.smithi161.stdout:1/222: read - d19/f46 zero size 2024-02-22T00:33:17.497 INFO:tasks.workunit.client.1.smithi161.stdout:1/223: write fa [1955660,19341] 0 2024-02-22T00:33:17.497 INFO:tasks.workunit.client.1.smithi161.stdout:2/268: write fc [1507027,98820] 0 2024-02-22T00:33:17.503 INFO:tasks.workunit.client.1.smithi161.stdout:6/148: truncate d3/d10/f21 4044657 0 2024-02-22T00:33:17.509 INFO:tasks.workunit.client.1.smithi161.stdout:6/149: write d3/f15 [1113892,104738] 0 2024-02-22T00:33:17.512 INFO:tasks.workunit.client.1.smithi161.stdout:6/150: dread - d3/dc/f2a zero size 2024-02-22T00:33:17.513 INFO:tasks.workunit.client.1.smithi161.stdout:1/224: dread f5 [0,4194304] 0 2024-02-22T00:33:17.516 INFO:tasks.workunit.client.1.smithi161.stdout:2/269: dwrite de/d11/d5c/f36 [0,4194304] 0 2024-02-22T00:33:17.517 INFO:tasks.workunit.client.1.smithi161.stdout:6/151: unlink d3/dc/df/l17 0 2024-02-22T00:33:17.520 INFO:tasks.workunit.client.1.smithi161.stdout:1/225: unlink d19/d2f/c42 0 2024-02-22T00:33:17.521 INFO:tasks.workunit.client.1.smithi161.stdout:2/270: mknod de/d2b/c5f 0 2024-02-22T00:33:17.523 INFO:tasks.workunit.client.1.smithi161.stdout:6/152: creat d3/dc/f2b x:0 0 0 2024-02-22T00:33:17.523 INFO:tasks.workunit.client.1.smithi161.stdout:2/271: dread - de/d2b/f5b zero size 2024-02-22T00:33:17.525 INFO:tasks.workunit.client.1.smithi161.stdout:1/226: dread d19/d1d/d2c/f44 [0,4194304] 0 2024-02-22T00:33:17.526 INFO:tasks.workunit.client.1.smithi161.stdout:2/272: mkdir de/d1e/d60 0 2024-02-22T00:33:17.527 INFO:tasks.workunit.client.1.smithi161.stdout:2/273: chown de/f21 13427 1 2024-02-22T00:33:17.531 INFO:tasks.workunit.client.1.smithi161.stdout:2/274: symlink de/d11/d14/l61 0 2024-02-22T00:33:17.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/153: dwrite d3/dc/f2a [0,4194304] 0 2024-02-22T00:33:17.536 INFO:tasks.workunit.client.1.smithi161.stdout:6/154: symlink d3/l2c 0 2024-02-22T00:33:17.539 INFO:tasks.workunit.client.1.smithi161.stdout:6/155: truncate d3/d10/f26 786640 0 2024-02-22T00:33:17.540 INFO:tasks.workunit.client.1.smithi161.stdout:6/156: chown d3/d10/d1b 3037049 1 2024-02-22T00:33:17.541 INFO:tasks.workunit.client.1.smithi161.stdout:1/227: dwrite f1 [0,4194304] 0 2024-02-22T00:33:17.543 INFO:tasks.workunit.client.1.smithi161.stdout:2/275: link de/d11/d5c/d33/d35/d4f/f54 de/d11/d5c/d33/f62 0 2024-02-22T00:33:17.548 INFO:tasks.workunit.client.1.smithi161.stdout:8/196: sync 2024-02-22T00:33:17.548 INFO:tasks.workunit.client.1.smithi161.stdout:5/311: sync 2024-02-22T00:33:17.548 INFO:tasks.workunit.client.1.smithi161.stdout:8/197: readlink d1/l4 0 2024-02-22T00:33:17.549 INFO:tasks.workunit.client.1.smithi161.stdout:5/312: fdatasync d3/d1b/d36/f55 0 2024-02-22T00:33:17.550 INFO:tasks.workunit.client.1.smithi161.stdout:6/157: rename d3/dc/df/f1f to d3/d10/d12/f2d 0 2024-02-22T00:33:17.551 INFO:tasks.workunit.client.1.smithi161.stdout:6/158: read - d3/d10/d12/f25 zero size 2024-02-22T00:33:17.551 INFO:tasks.workunit.client.1.smithi161.stdout:1/228: mkdir d19/d1d/d2c/d4f 0 2024-02-22T00:33:17.553 INFO:tasks.workunit.client.1.smithi161.stdout:5/313: creat d3/d1b/f68 x:0 0 0 2024-02-22T00:33:17.554 INFO:tasks.workunit.client.1.smithi161.stdout:1/229: stat d19/l4a 0 2024-02-22T00:33:17.556 INFO:tasks.workunit.client.1.smithi161.stdout:5/314: fdatasync d3/f24 0 2024-02-22T00:33:17.556 INFO:tasks.workunit.client.1.smithi161.stdout:5/315: fdatasync d3/d1b/d36/f52 0 2024-02-22T00:33:17.557 INFO:tasks.workunit.client.1.smithi161.stdout:5/316: dread - d3/d1b/d36/f52 zero size 2024-02-22T00:33:17.558 INFO:tasks.workunit.client.1.smithi161.stdout:8/198: link d1/f39 d1/d1c/d20/d31/f3b 0 2024-02-22T00:33:17.560 INFO:tasks.workunit.client.1.smithi161.stdout:5/317: mkdir d3/d1c/d69 0 2024-02-22T00:33:17.560 INFO:tasks.workunit.client.1.smithi161.stdout:1/230: creat d19/d48/f50 x:0 0 0 2024-02-22T00:33:17.561 INFO:tasks.workunit.client.1.smithi161.stdout:2/276: write de/d11/d5c/f30 [2539548,89501] 0 2024-02-22T00:33:17.655 INFO:tasks.workunit.client.1.smithi161.stdout:6/159: rmdir d3/dc 39 2024-02-22T00:33:17.660 INFO:tasks.workunit.client.1.smithi161.stdout:8/199: dwrite d1/f24 [0,4194304] 0 2024-02-22T00:33:17.662 INFO:tasks.workunit.client.1.smithi161.stdout:2/277: write f3 [3726084,72015] 0 2024-02-22T00:33:17.664 INFO:tasks.workunit.client.1.smithi161.stdout:5/318: rename d3/d1c/d20/l14 to d3/l6a 0 2024-02-22T00:33:17.667 INFO:tasks.workunit.client.1.smithi161.stdout:5/319: fsync d3/fe 0 2024-02-22T00:33:17.672 INFO:tasks.workunit.client.1.smithi161.stdout:2/278: getdents de/d37 0 2024-02-22T00:33:17.672 INFO:tasks.workunit.client.1.smithi161.stdout:1/231: dwrite d19/f49 [0,4194304] 0 2024-02-22T00:33:17.674 INFO:tasks.workunit.client.1.smithi161.stdout:6/160: dwrite d3/d10/f13 [0,4194304] 0 2024-02-22T00:33:17.681 INFO:tasks.workunit.client.1.smithi161.stdout:5/320: getdents d3/d1c/d20 0 2024-02-22T00:33:17.685 INFO:tasks.workunit.client.1.smithi161.stdout:5/321: creat d3/d1b/d25/f6b x:0 0 0 2024-02-22T00:33:17.686 INFO:tasks.workunit.client.1.smithi161.stdout:5/322: read d3/d1b/d36/f3b [2238114,53510] 0 2024-02-22T00:33:17.687 INFO:tasks.workunit.client.1.smithi161.stdout:5/323: dread - d3/d1b/d25/f53 zero size 2024-02-22T00:33:17.688 INFO:tasks.workunit.client.1.smithi161.stdout:6/161: link d3/dc/f27 d3/d10/d1b/f2e 0 2024-02-22T00:33:17.689 INFO:tasks.workunit.client.1.smithi161.stdout:5/324: write d3/d1b/d25/f39 [11287489,32500] 0 2024-02-22T00:33:17.691 INFO:tasks.workunit.client.1.smithi161.stdout:6/162: mkdir d3/d10/d12/d2f 0 2024-02-22T00:33:17.691 INFO:tasks.workunit.client.1.smithi161.stdout:5/325: read d3/f24 [90498,63601] 0 2024-02-22T00:33:17.692 INFO:tasks.workunit.client.1.smithi161.stdout:6/163: fdatasync d3/d10/d12/f23 0 2024-02-22T00:33:17.693 INFO:tasks.workunit.client.1.smithi161.stdout:6/164: stat d3/dc 0 2024-02-22T00:33:17.695 INFO:tasks.workunit.client.1.smithi161.stdout:5/326: creat d3/d1b/d25/f6c x:0 0 0 2024-02-22T00:33:17.695 INFO:tasks.workunit.client.1.smithi161.stdout:8/200: dread d1/f29 [0,4194304] 0 2024-02-22T00:33:17.696 INFO:tasks.workunit.client.1.smithi161.stdout:6/165: write d3/d10/d12/f23 [672888,3126] 0 2024-02-22T00:33:17.696 INFO:tasks.workunit.client.1.smithi161.stdout:5/327: mknod d3/d29/c6d 0 2024-02-22T00:33:17.698 INFO:tasks.workunit.client.1.smithi161.stdout:1/232: dread d19/f1b [0,4194304] 0 2024-02-22T00:33:17.698 INFO:tasks.workunit.client.1.smithi161.stdout:8/201: truncate d1/d1c/d20/d31/f3b 966425 0 2024-02-22T00:33:17.699 INFO:tasks.workunit.client.1.smithi161.stdout:5/328: truncate d3/d1b/d25/f3d 551126 0 2024-02-22T00:33:17.699 INFO:tasks.workunit.client.1.smithi161.stdout:1/233: chown d19/l24 0 1 2024-02-22T00:33:17.699 INFO:tasks.workunit.client.1.smithi161.stdout:5/329: readlink l0 0 2024-02-22T00:33:17.701 INFO:tasks.workunit.client.1.smithi161.stdout:6/166: dread d3/f15 [0,4194304] 0 2024-02-22T00:33:17.702 INFO:tasks.workunit.client.1.smithi161.stdout:5/330: symlink d3/d1b/d25/l6e 0 2024-02-22T00:33:17.704 INFO:tasks.workunit.client.1.smithi161.stdout:5/331: dread - d3/d1b/f57 zero size 2024-02-22T00:33:17.704 INFO:tasks.workunit.client.1.smithi161.stdout:6/167: rmdir d3/d10/d1b 39 2024-02-22T00:33:17.705 INFO:tasks.workunit.client.1.smithi161.stdout:6/168: readlink d3/l2c 0 2024-02-22T00:33:17.707 INFO:tasks.workunit.client.1.smithi161.stdout:1/234: dwrite d19/d1d/d2c/f4d [0,4194304] 0 2024-02-22T00:33:17.708 INFO:tasks.workunit.client.1.smithi161.stdout:6/169: write d3/d10/f26 [653475,54853] 0 2024-02-22T00:33:17.710 INFO:tasks.workunit.client.1.smithi161.stdout:1/235: truncate f5 4495493 0 2024-02-22T00:33:17.711 INFO:tasks.workunit.client.1.smithi161.stdout:1/236: mkdir d19/d51 0 2024-02-22T00:33:17.713 INFO:tasks.workunit.client.1.smithi161.stdout:6/170: mkdir d3/d30 0 2024-02-22T00:33:17.717 INFO:tasks.workunit.client.1.smithi161.stdout:1/237: unlink d19/f23 0 2024-02-22T00:33:17.719 INFO:tasks.workunit.client.1.smithi161.stdout:6/171: mknod d3/d30/c31 0 2024-02-22T00:33:17.720 INFO:tasks.workunit.client.1.smithi161.stdout:1/238: creat d19/f52 x:0 0 0 2024-02-22T00:33:17.726 INFO:tasks.workunit.client.1.smithi161.stdout:1/239: dread d19/d1d/d2c/d2d/f40 [0,4194304] 0 2024-02-22T00:33:17.727 INFO:tasks.workunit.client.1.smithi161.stdout:6/172: dread d3/d10/f21 [0,4194304] 0 2024-02-22T00:33:17.727 INFO:tasks.workunit.client.1.smithi161.stdout:5/332: dread d3/d1b/d36/f4d [0,4194304] 0 2024-02-22T00:33:17.729 INFO:tasks.workunit.client.1.smithi161.stdout:5/333: fsync d3/d1b/d25/f53 0 2024-02-22T00:33:17.731 INFO:tasks.workunit.client.1.smithi161.stdout:1/240: creat d19/d1d/d2c/d2d/f53 x:0 0 0 2024-02-22T00:33:17.732 INFO:tasks.workunit.client.1.smithi161.stdout:7/226: sync 2024-02-22T00:33:17.732 INFO:tasks.workunit.client.1.smithi161.stdout:3/207: sync 2024-02-22T00:33:17.732 INFO:tasks.workunit.client.1.smithi161.stdout:1/241: fsync d19/f26 0 2024-02-22T00:33:17.733 INFO:tasks.workunit.client.1.smithi161.stdout:5/334: rename d3/d1c/l3e to d3/d1c/d69/l6f 0 2024-02-22T00:33:17.734 INFO:tasks.workunit.client.1.smithi161.stdout:7/227: dread - d3/df/d33/f4f zero size 2024-02-22T00:33:17.736 INFO:tasks.workunit.client.1.smithi161.stdout:1/242: creat d19/d2f/f54 x:0 0 0 2024-02-22T00:33:17.736 INFO:tasks.workunit.client.1.smithi161.stdout:3/208: write da/dc/d11/d26/f34 [2619809,45390] 0 2024-02-22T00:33:17.740 INFO:tasks.workunit.client.1.smithi161.stdout:6/173: dwrite d3/dc/f27 [0,4194304] 0 2024-02-22T00:33:17.742 INFO:tasks.workunit.client.1.smithi161.stdout:5/335: creat d3/f70 x:0 0 0 2024-02-22T00:33:17.743 INFO:tasks.workunit.client.1.smithi161.stdout:7/228: dread d3/f2b [0,4194304] 0 2024-02-22T00:33:17.746 INFO:tasks.workunit.client.1.smithi161.stdout:6/174: rmdir d3/d10 39 2024-02-22T00:33:17.747 INFO:tasks.workunit.client.1.smithi161.stdout:1/243: symlink d19/d1d/d2c/d4f/l55 0 2024-02-22T00:33:17.748 INFO:tasks.workunit.client.1.smithi161.stdout:5/336: creat d3/d1c/d20/f71 x:0 0 0 2024-02-22T00:33:17.750 INFO:tasks.workunit.client.1.smithi161.stdout:3/209: dread da/dc/f17 [0,4194304] 0 2024-02-22T00:33:17.752 INFO:tasks.workunit.client.1.smithi161.stdout:7/229: dread d3/dd/d24/d26/f29 [0,4194304] 0 2024-02-22T00:33:17.753 INFO:tasks.workunit.client.1.smithi161.stdout:5/337: rmdir d3/d1b/d25/d4c 39 2024-02-22T00:33:17.753 INFO:tasks.workunit.client.1.smithi161.stdout:6/175: chown d3/d10/d12/c1e 100531593 1 2024-02-22T00:33:17.754 INFO:tasks.workunit.client.1.smithi161.stdout:5/338: stat d3/d1b/f57 0 2024-02-22T00:33:17.755 INFO:tasks.workunit.client.1.smithi161.stdout:1/244: dread d19/f1b [0,4194304] 0 2024-02-22T00:33:17.759 INFO:tasks.workunit.client.1.smithi161.stdout:3/210: read da/dc/fe [2674443,128847] 0 2024-02-22T00:33:17.760 INFO:tasks.workunit.client.1.smithi161.stdout:1/245: mkdir d19/d1d/d56 0 2024-02-22T00:33:17.762 INFO:tasks.workunit.client.1.smithi161.stdout:5/339: creat d3/f72 x:0 0 0 2024-02-22T00:33:17.763 INFO:tasks.workunit.client.1.smithi161.stdout:3/211: mkdir da/dc/d11/d40 0 2024-02-22T00:33:17.764 INFO:tasks.workunit.client.1.smithi161.stdout:1/246: creat d19/d1d/f57 x:0 0 0 2024-02-22T00:33:17.765 INFO:tasks.workunit.client.1.smithi161.stdout:6/176: write d3/d10/fa [1902447,29478] 0 2024-02-22T00:33:17.767 INFO:tasks.workunit.client.1.smithi161.stdout:7/230: truncate d3/dd/fe 1635325 0 2024-02-22T00:33:17.768 INFO:tasks.workunit.client.1.smithi161.stdout:5/340: rename d3/f70 to d3/d1c/d20/f73 0 2024-02-22T00:33:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:7/231: stat d3/dd/d24/f4e 0 2024-02-22T00:33:17.769 INFO:tasks.workunit.client.1.smithi161.stdout:3/212: dread da/dc/d11/d26/f34 [0,4194304] 0 2024-02-22T00:33:17.770 INFO:tasks.workunit.client.1.smithi161.stdout:1/247: symlink d19/d1d/d2c/d2d/d3f/l58 0 2024-02-22T00:33:17.770 INFO:tasks.workunit.client.1.smithi161.stdout:5/341: write d3/f24 [966981,102666] 0 2024-02-22T00:33:17.772 INFO:tasks.workunit.client.1.smithi161.stdout:6/177: dread d3/dc/f27 [0,4194304] 0 2024-02-22T00:33:17.773 INFO:tasks.workunit.client.1.smithi161.stdout:7/232: write d3/df/d33/f45 [331721,106616] 0 2024-02-22T00:33:17.774 INFO:tasks.workunit.client.1.smithi161.stdout:6/178: stat d3/d10/c1a 0 2024-02-22T00:33:17.775 INFO:tasks.workunit.client.1.smithi161.stdout:1/248: creat d19/d1d/d2c/d2d/f59 x:0 0 0 2024-02-22T00:33:17.776 INFO:tasks.workunit.client.1.smithi161.stdout:7/233: chown d3/f14 2561 1 2024-02-22T00:33:17.776 INFO:tasks.workunit.client.1.smithi161.stdout:1/249: write f10 [3877899,15305] 0 2024-02-22T00:33:17.776 INFO:tasks.workunit.client.1.smithi161.stdout:5/342: mkdir d3/d1c/d20/d74 0 2024-02-22T00:33:17.777 INFO:tasks.workunit.client.1.smithi161.stdout:7/234: truncate d3/dd/d24/f4e 1814098 0 2024-02-22T00:33:17.778 INFO:tasks.workunit.client.1.smithi161.stdout:3/213: creat da/dc/d11/d26/d2f/f41 x:0 0 0 2024-02-22T00:33:17.779 INFO:tasks.workunit.client.1.smithi161.stdout:7/235: chown d3/df/d33/f45 8 1 2024-02-22T00:33:17.780 INFO:tasks.workunit.client.1.smithi161.stdout:6/179: mkdir d3/dc/df/d32 0 2024-02-22T00:33:17.782 INFO:tasks.workunit.client.1.smithi161.stdout:5/343: creat d3/d29/f75 x:0 0 0 2024-02-22T00:33:17.785 INFO:tasks.workunit.client.1.smithi161.stdout:3/214: getdents da/dc/d11/d40 0 2024-02-22T00:33:17.786 INFO:tasks.workunit.client.1.smithi161.stdout:1/250: dwrite d19/d1d/f57 [0,4194304] 0 2024-02-22T00:33:17.787 INFO:tasks.workunit.client.1.smithi161.stdout:5/344: creat d3/d1c/f76 x:0 0 0 2024-02-22T00:33:17.790 INFO:tasks.workunit.client.1.smithi161.stdout:6/180: creat d3/d10/d12/d2f/f33 x:0 0 0 2024-02-22T00:33:17.792 INFO:tasks.workunit.client.1.smithi161.stdout:5/345: mknod d3/d29/c77 0 2024-02-22T00:33:17.793 INFO:tasks.workunit.client.1.smithi161.stdout:6/181: dread - d3/d10/d12/f29 zero size 2024-02-22T00:33:17.796 INFO:tasks.workunit.client.1.smithi161.stdout:1/251: getdents d19/d48 0 2024-02-22T00:33:17.797 INFO:tasks.workunit.client.1.smithi161.stdout:5/346: mkdir d3/d1c/d20/d74/d78 0 2024-02-22T00:33:17.798 INFO:tasks.workunit.client.1.smithi161.stdout:7/236: dread d3/dd/d24/d26/f3e [0,4194304] 0 2024-02-22T00:33:17.801 INFO:tasks.workunit.client.1.smithi161.stdout:5/347: creat d3/d1c/f79 x:0 0 0 2024-02-22T00:33:17.802 INFO:tasks.workunit.client.1.smithi161.stdout:1/252: readlink d19/d1d/d2c/d2d/d3f/l58 0 2024-02-22T00:33:17.802 INFO:tasks.workunit.client.1.smithi161.stdout:3/215: dwrite da/dc/d11/d26/f3c [0,4194304] 0 2024-02-22T00:33:17.804 INFO:tasks.workunit.client.1.smithi161.stdout:7/237: symlink d3/dd/d24/d26/d50/l57 0 2024-02-22T00:33:17.805 INFO:tasks.workunit.client.1.smithi161.stdout:1/253: truncate d19/d2f/f41 1042896 0 2024-02-22T00:33:17.808 INFO:tasks.workunit.client.1.smithi161.stdout:3/216: rmdir da/dc/d11/d26/d2f/d37 39 2024-02-22T00:33:17.809 INFO:tasks.workunit.client.1.smithi161.stdout:1/254: write d19/d1d/f22 [59351,48038] 0 2024-02-22T00:33:17.812 INFO:tasks.workunit.client.1.smithi161.stdout:6/182: dread d3/d10/f13 [0,4194304] 0 2024-02-22T00:33:17.814 INFO:tasks.workunit.client.1.smithi161.stdout:3/217: unlink da/dc/d11/d26/f34 0 2024-02-22T00:33:17.816 INFO:tasks.workunit.client.1.smithi161.stdout:5/348: dwrite d3/d1b/d36/f4d [0,4194304] 0 2024-02-22T00:33:17.817 INFO:tasks.workunit.client.1.smithi161.stdout:1/255: link d19/f46 d19/d48/f5a 0 2024-02-22T00:33:17.818 INFO:tasks.workunit.client.1.smithi161.stdout:6/183: creat d3/d10/d1b/f34 x:0 0 0 2024-02-22T00:33:17.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/238: dwrite d3/df/d33/f45 [0,4194304] 0 2024-02-22T00:33:17.822 INFO:tasks.workunit.client.1.smithi161.stdout:5/349: chown d3/d1b/l34 515335 1 2024-02-22T00:33:17.822 INFO:tasks.workunit.client.1.smithi161.stdout:1/256: dread - d19/d1d/f36 zero size 2024-02-22T00:33:17.822 INFO:tasks.workunit.client.1.smithi161.stdout:5/350: dread - d3/f72 zero size 2024-02-22T00:33:17.822 INFO:tasks.workunit.client.1.smithi161.stdout:7/239: dread - d3/df/d33/f4f zero size 2024-02-22T00:33:17.822 INFO:tasks.workunit.client.1.smithi161.stdout:3/218: read da/dc/fe [1392698,28594] 0 2024-02-22T00:33:17.824 INFO:tasks.workunit.client.1.smithi161.stdout:1/257: creat d19/d1d/d2c/d2d/f5b x:0 0 0 2024-02-22T00:33:17.824 INFO:tasks.workunit.client.1.smithi161.stdout:6/184: mknod d3/d10/d12/c35 0 2024-02-22T00:33:17.826 INFO:tasks.workunit.client.1.smithi161.stdout:5/351: mknod d3/d1c/d69/c7a 0 2024-02-22T00:33:17.826 INFO:tasks.workunit.client.1.smithi161.stdout:7/240: dread d3/dd/d24/f51 [0,4194304] 0 2024-02-22T00:33:17.827 INFO:tasks.workunit.client.1.smithi161.stdout:1/258: creat d19/d48/f5c x:0 0 0 2024-02-22T00:33:17.832 INFO:tasks.workunit.client.1.smithi161.stdout:3/219: creat da/dc/d11/d26/d2f/d37/d39/f42 x:0 0 0 2024-02-22T00:33:17.833 INFO:tasks.workunit.client.1.smithi161.stdout:5/352: mkdir d3/d1b/d25/d4c/d7b 0 2024-02-22T00:33:17.835 INFO:tasks.workunit.client.1.smithi161.stdout:5/353: read d3/d1c/d20/f54 [2892896,11735] 0 2024-02-22T00:33:17.837 INFO:tasks.workunit.client.1.smithi161.stdout:7/241: dwrite d3/dd/d24/f51 [0,4194304] 0 2024-02-22T00:33:17.837 INFO:tasks.workunit.client.1.smithi161.stdout:3/220: symlink da/l43 0 2024-02-22T00:33:17.840 INFO:tasks.workunit.client.1.smithi161.stdout:3/221: dread - da/dc/d11/d26/d2f/d37/d39/f42 zero size 2024-02-22T00:33:17.840 INFO:tasks.workunit.client.1.smithi161.stdout:5/354: getdents d3/d1b/d25/d4c/d7b 0 2024-02-22T00:33:17.841 INFO:tasks.workunit.client.1.smithi161.stdout:5/355: dread - d3/d1c/f79 zero size 2024-02-22T00:33:17.842 INFO:tasks.workunit.client.1.smithi161.stdout:5/356: dread - d3/d29/f66 zero size 2024-02-22T00:33:17.842 INFO:tasks.workunit.client.1.smithi161.stdout:5/357: chown d3/d1b/d25/c21 8 1 2024-02-22T00:33:17.844 INFO:tasks.workunit.client.1.smithi161.stdout:5/358: write d3/d1c/f2d [188935,46489] 0 2024-02-22T00:33:17.846 INFO:tasks.workunit.client.1.smithi161.stdout:7/242: mknod d3/dd/c58 0 2024-02-22T00:33:17.846 INFO:tasks.workunit.client.1.smithi161.stdout:7/243: write d3/f36 [878417,40627] 0 2024-02-22T00:33:17.852 INFO:tasks.workunit.client.1.smithi161.stdout:5/359: mknod d3/d1c/d62/c7c 0 2024-02-22T00:33:17.852 INFO:tasks.workunit.client.1.smithi161.stdout:7/244: fdatasync d3/dd/d24/d26/f3e 0 2024-02-22T00:33:17.857 INFO:tasks.workunit.client.1.smithi161.stdout:6/185: truncate d3/d10/f21 3689660 0 2024-02-22T00:33:17.860 INFO:tasks.workunit.client.1.smithi161.stdout:6/186: creat d3/d10/d12/f36 x:0 0 0 2024-02-22T00:33:17.861 INFO:tasks.workunit.client.1.smithi161.stdout:3/222: write da/f1a [1120946,1100] 0 2024-02-22T00:33:17.865 INFO:tasks.workunit.client.1.smithi161.stdout:3/223: getdents da/dc/d11/d26/d2f/d37/d39 0 2024-02-22T00:33:17.868 INFO:tasks.workunit.client.1.smithi161.stdout:7/245: dread d3/f7 [0,4194304] 0 2024-02-22T00:33:17.876 INFO:tasks.workunit.client.1.smithi161.stdout:7/246: dread d3/dd/fe [0,4194304] 0 2024-02-22T00:33:17.974 INFO:tasks.workunit.client.1.smithi161.stdout:4/242: sync 2024-02-22T00:33:17.974 INFO:tasks.workunit.client.1.smithi161.stdout:9/249: sync 2024-02-22T00:33:17.976 INFO:tasks.workunit.client.1.smithi161.stdout:4/243: mkdir d5/d8/d41/d57 0 2024-02-22T00:33:17.977 INFO:tasks.workunit.client.1.smithi161.stdout:9/250: creat d1/d2/d7/d3f/f54 x:0 0 0 2024-02-22T00:33:17.978 INFO:tasks.workunit.client.1.smithi161.stdout:4/244: symlink d5/d8/d41/d57/l58 0 2024-02-22T00:33:17.981 INFO:tasks.workunit.client.1.smithi161.stdout:4/245: unlink d5/c2a 0 2024-02-22T00:33:17.981 INFO:tasks.workunit.client.1.smithi161.stdout:9/251: symlink d1/d5/d9/d33/d4f/l55 0 2024-02-22T00:33:17.981 INFO:tasks.workunit.client.1.smithi161.stdout:4/246: fsync d5/d10/d14/f45 0 2024-02-22T00:33:17.982 INFO:tasks.workunit.client.1.smithi161.stdout:4/247: chown d5/d8 568660172 1 2024-02-22T00:33:17.987 INFO:tasks.workunit.client.1.smithi161.stdout:9/252: write d1/d2/d7/da/f17 [4251189,34961] 0 2024-02-22T00:33:17.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/253: dwrite d1/d2/d7/da/f3c [0,4194304] 0 2024-02-22T00:33:17.999 INFO:tasks.workunit.client.1.smithi161.stdout:9/254: rmdir d1/d5/d9 39 2024-02-22T00:33:18.001 INFO:tasks.workunit.client.1.smithi161.stdout:9/255: write d1/d5/f36 [594489,23980] 0 2024-02-22T00:33:18.003 INFO:tasks.workunit.client.1.smithi161.stdout:9/256: write d1/d2/f1a [5389039,96529] 0 2024-02-22T00:33:18.006 INFO:tasks.workunit.client.1.smithi161.stdout:9/257: write d1/d2/d7/da/f17 [5118977,127755] 0 2024-02-22T00:33:18.007 INFO:tasks.workunit.client.1.smithi161.stdout:4/248: dread d5/d8/f9 [0,4194304] 0 2024-02-22T00:33:18.008 INFO:tasks.workunit.client.1.smithi161.stdout:4/249: write d5/f13 [257880,16932] 0 2024-02-22T00:33:18.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/250: link d5/d10/f1d d5/d10/d14/d24/f59 0 2024-02-22T00:33:18.016 INFO:tasks.workunit.client.1.smithi161.stdout:9/258: read d1/d5/f36 [495981,18714] 0 2024-02-22T00:33:18.016 INFO:tasks.workunit.client.1.smithi161.stdout:4/251: getdents d5/d17 0 2024-02-22T00:33:18.017 INFO:tasks.workunit.client.1.smithi161.stdout:9/259: fdatasync d1/d5/f36 0 2024-02-22T00:33:18.021 INFO:tasks.workunit.client.1.smithi161.stdout:4/252: rename d5/d10/d14/d24/d28/c2b to d5/c5a 0 2024-02-22T00:33:18.024 INFO:tasks.workunit.client.1.smithi161.stdout:4/253: creat d5/f5b x:0 0 0 2024-02-22T00:33:18.026 INFO:tasks.workunit.client.1.smithi161.stdout:4/254: mkdir d5/d17/d5c 0 2024-02-22T00:33:18.028 INFO:tasks.workunit.client.1.smithi161.stdout:4/255: creat d5/d10/d14/f5d x:0 0 0 2024-02-22T00:33:18.030 INFO:tasks.workunit.client.1.smithi161.stdout:9/260: truncate d1/d2/d7/da/f3c 4117070 0 2024-02-22T00:33:18.030 INFO:tasks.workunit.client.1.smithi161.stdout:9/261: stat d1/d2/f3d 0 2024-02-22T00:33:18.030 INFO:tasks.workunit.client.1.smithi161.stdout:4/256: mknod d5/d8/d41/d57/c5e 0 2024-02-22T00:33:18.033 INFO:tasks.workunit.client.1.smithi161.stdout:4/257: rename d5/l3f to d5/d17/d5c/l5f 0 2024-02-22T00:33:18.035 INFO:tasks.workunit.client.1.smithi161.stdout:4/258: chown d5/d10/d14/f45 46 1 2024-02-22T00:33:18.037 INFO:tasks.workunit.client.1.smithi161.stdout:9/262: dwrite d1/d2/d7/d3f/f54 [0,4194304] 0 2024-02-22T00:33:18.045 INFO:tasks.workunit.client.1.smithi161.stdout:4/259: dwrite d5/d10/d14/f1c [0,4194304] 0 2024-02-22T00:33:18.056 INFO:tasks.workunit.client.1.smithi161.stdout:9/263: dwrite d1/d2/d4/d1f/f35 [0,4194304] 0 2024-02-22T00:33:18.063 INFO:tasks.workunit.client.1.smithi161.stdout:9/264: getdents d1/d2/d7/d3f 0 2024-02-22T00:33:18.064 INFO:tasks.workunit.client.1.smithi161.stdout:4/260: truncate d5/d17/f4a 1115758 0 2024-02-22T00:33:18.066 INFO:tasks.workunit.client.1.smithi161.stdout:4/261: truncate d5/d10/d14/d24/f59 901586 0 2024-02-22T00:33:18.066 INFO:tasks.workunit.client.1.smithi161.stdout:9/265: rename d1/d2/d4/d1f/c51 to d1/d2/d4/d1f/c56 0 2024-02-22T00:33:18.071 INFO:tasks.workunit.client.1.smithi161.stdout:9/266: dread d1/d2/d7/f47 [0,4194304] 0 2024-02-22T00:33:18.072 INFO:tasks.workunit.client.1.smithi161.stdout:9/267: chown d1/d5/l44 3754 1 2024-02-22T00:33:18.072 INFO:tasks.workunit.client.1.smithi161.stdout:4/262: link d5/d10/d14/d24/f42 d5/d8/d41/d57/f60 0 2024-02-22T00:33:18.074 INFO:tasks.workunit.client.1.smithi161.stdout:4/263: rename d5 to d5/d8/d41/d61 22 2024-02-22T00:33:18.075 INFO:tasks.workunit.client.1.smithi161.stdout:9/268: dread - d1/d2/d7/da/f42 zero size 2024-02-22T00:33:18.075 INFO:tasks.workunit.client.1.smithi161.stdout:0/337: sync 2024-02-22T00:33:18.075 INFO:tasks.workunit.client.1.smithi161.stdout:2/279: sync 2024-02-22T00:33:18.075 INFO:tasks.workunit.client.1.smithi161.stdout:8/202: sync 2024-02-22T00:33:18.077 INFO:tasks.workunit.client.1.smithi161.stdout:9/269: chown d1/d25/c2f 7 1 2024-02-22T00:33:18.079 INFO:tasks.workunit.client.1.smithi161.stdout:2/280: creat de/d11/f63 x:0 0 0 2024-02-22T00:33:18.084 INFO:tasks.workunit.client.1.smithi161.stdout:8/203: creat d1/d1c/d20/d31/f3c x:0 0 0 2024-02-22T00:33:18.085 INFO:tasks.workunit.client.1.smithi161.stdout:8/204: read - d1/d19/f3a zero size 2024-02-22T00:33:18.085 INFO:tasks.workunit.client.1.smithi161.stdout:2/281: symlink de/d11/d14/l64 0 2024-02-22T00:33:18.086 INFO:tasks.workunit.client.1.smithi161.stdout:4/264: getdents d5/d10/d14/d4f 0 2024-02-22T00:33:18.087 INFO:tasks.workunit.client.1.smithi161.stdout:9/270: symlink d1/l57 0 2024-02-22T00:33:18.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/205: rename d1/d1c/d20/d22/f1f to d1/d1c/f3d 0 2024-02-22T00:33:18.095 INFO:tasks.workunit.client.1.smithi161.stdout:0/338: getdents d14/d1a/d3f/d5d 0 2024-02-22T00:33:18.098 INFO:tasks.workunit.client.1.smithi161.stdout:0/339: stat d14/l58 0 2024-02-22T00:33:18.098 INFO:tasks.workunit.client.1.smithi161.stdout:4/265: dwrite d5/d17/f31 [4194304,4194304] 0 2024-02-22T00:33:18.100 INFO:tasks.workunit.client.1.smithi161.stdout:8/206: truncate d1/d1c/d20/d31/f3b 979131 0 2024-02-22T00:33:18.102 INFO:tasks.workunit.client.1.smithi161.stdout:8/207: write d1/d1c/d20/d31/f3c [721563,25690] 0 2024-02-22T00:33:18.102 INFO:tasks.workunit.client.1.smithi161.stdout:2/282: dread f3 [4194304,4194304] 0 2024-02-22T00:33:18.103 INFO:tasks.workunit.client.1.smithi161.stdout:4/266: unlink d5/l51 0 2024-02-22T00:33:18.103 INFO:tasks.workunit.client.1.smithi161.stdout:4/267: fsync f0 0 2024-02-22T00:33:18.105 INFO:tasks.workunit.client.1.smithi161.stdout:4/268: write f2 [1703221,63251] 0 2024-02-22T00:33:18.107 INFO:tasks.workunit.client.1.smithi161.stdout:9/271: dread d1/d2/d7/da/f17 [0,4194304] 0 2024-02-22T00:33:18.107 INFO:tasks.workunit.client.1.smithi161.stdout:8/208: dread d1/d1c/d20/d31/f3b [0,4194304] 0 2024-02-22T00:33:18.109 INFO:tasks.workunit.client.1.smithi161.stdout:4/269: write d5/d17/f31 [7921437,86059] 0 2024-02-22T00:33:18.109 INFO:tasks.workunit.client.1.smithi161.stdout:2/283: rename de/d1e to de/d2b/d65 0 2024-02-22T00:33:18.110 INFO:tasks.workunit.client.1.smithi161.stdout:6/187: sync 2024-02-22T00:33:18.110 INFO:tasks.workunit.client.1.smithi161.stdout:1/259: sync 2024-02-22T00:33:18.110 INFO:tasks.workunit.client.1.smithi161.stdout:3/224: sync 2024-02-22T00:33:18.110 INFO:tasks.workunit.client.1.smithi161.stdout:7/247: sync 2024-02-22T00:33:18.110 INFO:tasks.workunit.client.1.smithi161.stdout:5/360: sync 2024-02-22T00:33:18.111 INFO:tasks.workunit.client.1.smithi161.stdout:8/209: chown d1/d19/d18/f26 7674166 1 2024-02-22T00:33:18.111 INFO:tasks.workunit.client.1.smithi161.stdout:2/284: stat de/c2a 0 2024-02-22T00:33:18.113 INFO:tasks.workunit.client.1.smithi161.stdout:9/272: creat d1/d25/f58 x:0 0 0 2024-02-22T00:33:18.113 INFO:tasks.workunit.client.1.smithi161.stdout:7/248: dread - d3/df/d33/f4f zero size 2024-02-22T00:33:18.114 INFO:tasks.workunit.client.1.smithi161.stdout:3/225: dread - da/dc/d11/d26/d2f/d37/d39/f3f zero size 2024-02-22T00:33:18.114 INFO:tasks.workunit.client.1.smithi161.stdout:2/285: rename de/d11 to de/d11/d66 22 2024-02-22T00:33:18.115 INFO:tasks.workunit.client.1.smithi161.stdout:8/210: chown d1/d2f/d30/f33 5 1 2024-02-22T00:33:18.115 INFO:tasks.workunit.client.1.smithi161.stdout:1/260: readlink lc 0 2024-02-22T00:33:18.116 INFO:tasks.workunit.client.1.smithi161.stdout:5/361: creat d3/d1c/f7d x:0 0 0 2024-02-22T00:33:18.117 INFO:tasks.workunit.client.1.smithi161.stdout:6/188: symlink d3/l37 0 2024-02-22T00:33:18.118 INFO:tasks.workunit.client.1.smithi161.stdout:0/340: truncate d14/f51 2789108 0 2024-02-22T00:33:18.121 INFO:tasks.workunit.client.1.smithi161.stdout:3/226: mknod da/d29/c44 0 2024-02-22T00:33:18.123 INFO:tasks.workunit.client.1.smithi161.stdout:2/286: creat de/f67 x:0 0 0 2024-02-22T00:33:18.126 INFO:tasks.workunit.client.1.smithi161.stdout:8/211: fdatasync d1/d19/f16 0 2024-02-22T00:33:18.131 INFO:tasks.workunit.client.1.smithi161.stdout:0/341: rmdir d14/d44 39 2024-02-22T00:33:18.131 INFO:tasks.workunit.client.1.smithi161.stdout:7/249: mkdir d3/dd/d59 0 2024-02-22T00:33:18.132 INFO:tasks.workunit.client.1.smithi161.stdout:2/287: unlink fc 0 2024-02-22T00:33:18.132 INFO:tasks.workunit.client.1.smithi161.stdout:9/273: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:18.133 INFO:tasks.workunit.client.1.smithi161.stdout:4/270: fsync d5/d10/f1d 0 2024-02-22T00:33:18.138 INFO:tasks.workunit.client.1.smithi161.stdout:3/227: write da/dc/fe [4221441,24531] 0 2024-02-22T00:33:18.139 INFO:tasks.workunit.client.1.smithi161.stdout:1/261: dwrite d19/d2f/f4e [0,4194304] 0 2024-02-22T00:33:18.139 INFO:tasks.workunit.client.1.smithi161.stdout:5/362: dwrite d3/d1b/d25/f5c [8388608,4194304] 0 2024-02-22T00:33:18.146 INFO:tasks.workunit.client.1.smithi161.stdout:8/212: creat d1/d2f/f3e x:0 0 0 2024-02-22T00:33:18.147 INFO:tasks.workunit.client.1.smithi161.stdout:5/363: readlink d3/d1b/d25/l6e 0 2024-02-22T00:33:18.147 INFO:tasks.workunit.client.1.smithi161.stdout:7/250: fsync d3/df/f38 0 2024-02-22T00:33:18.147 INFO:tasks.workunit.client.1.smithi161.stdout:0/342: write f3 [884791,42154] 0 2024-02-22T00:33:18.151 INFO:tasks.workunit.client.1.smithi161.stdout:8/213: read d1/d19/f10 [433600,82790] 0 2024-02-22T00:33:18.152 INFO:tasks.workunit.client.1.smithi161.stdout:0/343: readlink d14/d1a/l3c 0 2024-02-22T00:33:18.156 INFO:tasks.workunit.client.1.smithi161.stdout:6/189: creat d3/d10/f38 x:0 0 0 2024-02-22T00:33:18.157 INFO:tasks.workunit.client.1.smithi161.stdout:8/214: chown d1/l4 10017 1 2024-02-22T00:33:18.159 INFO:tasks.workunit.client.1.smithi161.stdout:1/262: mknod d19/d1d/d2c/d2d/c5d 0 2024-02-22T00:33:18.159 INFO:tasks.workunit.client.1.smithi161.stdout:4/271: creat d5/d8/d41/d53/f62 x:0 0 0 2024-02-22T00:33:18.160 INFO:tasks.workunit.client.1.smithi161.stdout:6/190: chown d3/d10/d12/f29 26447892 1 2024-02-22T00:33:18.160 INFO:tasks.workunit.client.1.smithi161.stdout:3/228: dwrite da/dc/d11/d26/f21 [0,4194304] 0 2024-02-22T00:33:18.162 INFO:tasks.workunit.client.1.smithi161.stdout:5/364: rename d3/l46 to d3/d29/l7e 0 2024-02-22T00:33:18.164 INFO:tasks.workunit.client.1.smithi161.stdout:0/344: creat d14/d29/f7a x:0 0 0 2024-02-22T00:33:18.166 INFO:tasks.workunit.client.1.smithi161.stdout:6/191: read - d3/d10/f38 zero size 2024-02-22T00:33:18.172 INFO:tasks.workunit.client.1.smithi161.stdout:9/274: creat d1/d5/f59 x:0 0 0 2024-02-22T00:33:18.172 INFO:tasks.workunit.client.1.smithi161.stdout:8/215: mkdir d1/d1c/d20/d22/d3f 0 2024-02-22T00:33:18.172 INFO:tasks.workunit.client.1.smithi161.stdout:2/288: dwrite f3 [0,4194304] 0 2024-02-22T00:33:18.172 INFO:tasks.workunit.client.1.smithi161.stdout:8/216: chown d1/d1c/l23 31859 1 2024-02-22T00:33:18.172 INFO:tasks.workunit.client.1.smithi161.stdout:4/272: mkdir d5/d10/d14/d24/d28/d63 0 2024-02-22T00:33:18.174 INFO:tasks.workunit.client.1.smithi161.stdout:1/263: symlink d19/d1d/d2c/l5e 0 2024-02-22T00:33:18.180 INFO:tasks.workunit.client.1.smithi161.stdout:8/217: write d1/f29 [1001737,45209] 0 2024-02-22T00:33:18.184 INFO:tasks.workunit.client.1.smithi161.stdout:3/229: dread da/dc/d11/d26/f3c [0,4194304] 0 2024-02-22T00:33:18.188 INFO:tasks.workunit.client.1.smithi161.stdout:0/345: link d14/d37/l6e d14/d37/l7b 0 2024-02-22T00:33:18.189 INFO:tasks.workunit.client.1.smithi161.stdout:8/218: write d1/d2f/f3e [630913,116102] 0 2024-02-22T00:33:18.192 INFO:tasks.workunit.client.1.smithi161.stdout:2/289: dwrite de/f67 [0,4194304] 0 2024-02-22T00:33:18.193 INFO:tasks.workunit.client.1.smithi161.stdout:7/251: truncate d3/dd/d24/d26/d30/f3b 3212252 0 2024-02-22T00:33:18.195 INFO:tasks.workunit.client.1.smithi161.stdout:4/273: dwrite d5/d10/d14/d24/f3c [0,4194304] 0 2024-02-22T00:33:18.196 INFO:tasks.workunit.client.1.smithi161.stdout:6/192: dread d3/d10/fa [0,4194304] 0 2024-02-22T00:33:18.197 INFO:tasks.workunit.client.1.smithi161.stdout:2/290: chown de/d11/d5c/d33/c4c 7 1 2024-02-22T00:33:18.199 INFO:tasks.workunit.client.1.smithi161.stdout:2/291: readlink de/l5a 0 2024-02-22T00:33:18.199 INFO:tasks.workunit.client.1.smithi161.stdout:5/365: truncate d3/d1b/f38 2955946 0 2024-02-22T00:33:18.201 INFO:tasks.workunit.client.1.smithi161.stdout:1/264: write f7 [1224154,17391] 0 2024-02-22T00:33:18.201 INFO:tasks.workunit.client.1.smithi161.stdout:7/252: dread d3/f2b [0,4194304] 0 2024-02-22T00:33:18.203 INFO:tasks.workunit.client.1.smithi161.stdout:8/219: write d1/f12 [1449940,99879] 0 2024-02-22T00:33:18.205 INFO:tasks.workunit.client.1.smithi161.stdout:5/366: stat d3/d1c/d69/l6f 0 2024-02-22T00:33:18.205 INFO:tasks.workunit.client.1.smithi161.stdout:3/230: rename da/dc/d11/f20 to da/dc/d11/d26/f45 0 2024-02-22T00:33:18.206 INFO:tasks.workunit.client.1.smithi161.stdout:5/367: fdatasync d3/d1b/d25/f65 0 2024-02-22T00:33:18.208 INFO:tasks.workunit.client.1.smithi161.stdout:7/253: rmdir d3/dd 39 2024-02-22T00:33:18.210 INFO:tasks.workunit.client.1.smithi161.stdout:4/274: mkdir d5/d10/d14/d24/d28/d63/d64 0 2024-02-22T00:33:18.211 INFO:tasks.workunit.client.1.smithi161.stdout:6/193: creat d3/dc/df/d32/f39 x:0 0 0 2024-02-22T00:33:18.212 INFO:tasks.workunit.client.1.smithi161.stdout:2/292: mkdir de/d2b/d65/d60/d68 0 2024-02-22T00:33:18.212 INFO:tasks.workunit.client.1.smithi161.stdout:6/194: chown d3/d10/f21 3181 1 2024-02-22T00:33:18.213 INFO:tasks.workunit.client.1.smithi161.stdout:0/346: creat d14/d1a/d3f/f7c x:0 0 0 2024-02-22T00:33:18.214 INFO:tasks.workunit.client.1.smithi161.stdout:1/265: write d19/d1d/d2c/d2d/f40 [4277867,103868] 0 2024-02-22T00:33:18.215 INFO:tasks.workunit.client.1.smithi161.stdout:5/368: mknod d3/d1b/c7f 0 2024-02-22T00:33:18.216 INFO:tasks.workunit.client.1.smithi161.stdout:4/275: rmdir d5/d8/d41 39 2024-02-22T00:33:18.219 INFO:tasks.workunit.client.1.smithi161.stdout:6/195: mkdir d3/d10/d12/d3a 0 2024-02-22T00:33:18.219 INFO:tasks.workunit.client.1.smithi161.stdout:1/266: chown d19/d1d/d2c/d2d/f5b 3192167 1 2024-02-22T00:33:18.223 INFO:tasks.workunit.client.1.smithi161.stdout:0/347: mknod d14/d1a/d3f/c7d 0 2024-02-22T00:33:18.226 INFO:tasks.workunit.client.1.smithi161.stdout:2/293: creat de/d11/d5c/f69 x:0 0 0 2024-02-22T00:33:18.227 INFO:tasks.workunit.client.1.smithi161.stdout:4/276: mkdir d5/d10/d14/d24/d28/d63/d65 0 2024-02-22T00:33:18.234 INFO:tasks.workunit.client.1.smithi161.stdout:5/369: dwrite d3/d1b/d25/f3d [0,4194304] 0 2024-02-22T00:33:18.235 INFO:tasks.workunit.client.1.smithi161.stdout:8/220: truncate d1/d19/d18/f26 2556211 0 2024-02-22T00:33:18.236 INFO:tasks.workunit.client.1.smithi161.stdout:3/231: dwrite da/dc/d11/d26/f3c [0,4194304] 0 2024-02-22T00:33:18.236 INFO:tasks.workunit.client.1.smithi161.stdout:7/254: dread d3/df/d33/d35/f3f [0,4194304] 0 2024-02-22T00:33:18.237 INFO:tasks.workunit.client.1.smithi161.stdout:2/294: rmdir de/d37 0 2024-02-22T00:33:18.240 INFO:tasks.workunit.client.1.smithi161.stdout:5/370: read d3/f24 [600009,53677] 0 2024-02-22T00:33:18.241 INFO:tasks.workunit.client.1.smithi161.stdout:0/348: getdents d14/d1a/d3f/d5d 0 2024-02-22T00:33:18.242 INFO:tasks.workunit.client.1.smithi161.stdout:8/221: fsync d1/d1c/d20/d22/f35 0 2024-02-22T00:33:18.243 INFO:tasks.workunit.client.1.smithi161.stdout:1/267: dread d19/d1d/f57 [0,4194304] 0 2024-02-22T00:33:18.243 INFO:tasks.workunit.client.1.smithi161.stdout:4/277: rename d5/d8/c18 to d5/d10/d14/d24/d28/d63/d65/c66 0 2024-02-22T00:33:18.243 INFO:tasks.workunit.client.1.smithi161.stdout:2/295: readlink de/d11/d14/l61 0 2024-02-22T00:33:18.246 INFO:tasks.workunit.client.1.smithi161.stdout:5/371: fdatasync d3/d1c/d20/f12 0 2024-02-22T00:33:18.248 INFO:tasks.workunit.client.1.smithi161.stdout:6/196: link d3/d10/d12/c1e d3/d10/d12/c3b 0 2024-02-22T00:33:18.249 INFO:tasks.workunit.client.1.smithi161.stdout:0/349: symlink d14/d37/l7e 0 2024-02-22T00:33:18.250 INFO:tasks.workunit.client.1.smithi161.stdout:5/372: mkdir d3/d29/d80 0 2024-02-22T00:33:18.256 INFO:tasks.workunit.client.1.smithi161.stdout:2/296: rmdir de/d2b/d65/d3a 39 2024-02-22T00:33:18.257 INFO:tasks.workunit.client.1.smithi161.stdout:0/350: write d14/f16 [279887,109243] 0 2024-02-22T00:33:18.258 INFO:tasks.workunit.client.1.smithi161.stdout:4/278: symlink d5/d10/d14/d24/d28/d63/l67 0 2024-02-22T00:33:18.261 INFO:tasks.workunit.client.1.smithi161.stdout:3/232: creat da/f46 x:0 0 0 2024-02-22T00:33:18.262 INFO:tasks.workunit.client.1.smithi161.stdout:8/222: symlink d1/d1c/d20/d22/d3f/l40 0 2024-02-22T00:33:18.262 INFO:tasks.workunit.client.1.smithi161.stdout:5/373: creat d3/d1b/d36/f81 x:0 0 0 2024-02-22T00:33:18.266 INFO:tasks.workunit.client.1.smithi161.stdout:8/223: stat d1/d1c 0 2024-02-22T00:33:18.273 INFO:tasks.workunit.client.1.smithi161.stdout:1/268: dwrite d19/d2f/f4e [0,4194304] 0 2024-02-22T00:33:18.273 INFO:tasks.workunit.client.1.smithi161.stdout:0/351: rmdir d14/d37 39 2024-02-22T00:33:18.273 INFO:tasks.workunit.client.1.smithi161.stdout:7/255: dwrite d3/f2b [0,4194304] 0 2024-02-22T00:33:18.273 INFO:tasks.workunit.client.1.smithi161.stdout:5/374: symlink d3/d1b/d36/l82 0 2024-02-22T00:33:18.273 INFO:tasks.workunit.client.1.smithi161.stdout:8/224: unlink d1/f39 0 2024-02-22T00:33:18.274 INFO:tasks.workunit.client.1.smithi161.stdout:6/197: dwrite d3/d10/d1b/f34 [0,4194304] 0 2024-02-22T00:33:18.275 INFO:tasks.workunit.client.1.smithi161.stdout:4/279: symlink d5/d8/d41/d57/l68 0 2024-02-22T00:33:18.356 INFO:tasks.workunit.client.1.smithi161.stdout:7/256: write d3/f1b [27343,74441] 0 2024-02-22T00:33:18.357 INFO:tasks.workunit.client.1.smithi161.stdout:5/375: fsync d3/d1c/f79 0 2024-02-22T00:33:18.357 INFO:tasks.workunit.client.1.smithi161.stdout:3/233: write da/dc/d11/d26/d2f/f41 [311092,93136] 0 2024-02-22T00:33:18.358 INFO:tasks.workunit.client.1.smithi161.stdout:1/269: fsync d19/d1d/d2c/d2d/f59 0 2024-02-22T00:33:18.361 INFO:tasks.workunit.client.1.smithi161.stdout:8/225: write d1/d2f/d30/f33 [3912108,3293] 0 2024-02-22T00:33:18.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/198: creat d3/d10/d12/d2f/f3c x:0 0 0 2024-02-22T00:33:18.368 INFO:tasks.workunit.client.1.smithi161.stdout:3/234: truncate da/dc/d11/f2e 5241441 0 2024-02-22T00:33:18.368 INFO:tasks.workunit.client.1.smithi161.stdout:7/257: mknod d3/df/c5a 0 2024-02-22T00:33:18.369 INFO:tasks.workunit.client.1.smithi161.stdout:4/280: getdents d5/d10/d14/d24/d28/d63/d64 0 2024-02-22T00:33:18.371 INFO:tasks.workunit.client.1.smithi161.stdout:8/226: creat d1/d1c/d20/d22/d28/d36/f41 x:0 0 0 2024-02-22T00:33:18.371 INFO:tasks.workunit.client.1.smithi161.stdout:6/199: unlink d3/d10/d12/c1d 0 2024-02-22T00:33:18.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/297: dread de/d11/f59 [0,4194304] 0 2024-02-22T00:33:18.376 INFO:tasks.workunit.client.1.smithi161.stdout:7/258: chown d3/df/d43/l48 424760 1 2024-02-22T00:33:18.378 INFO:tasks.workunit.client.1.smithi161.stdout:4/281: unlink d5/d8/d41/d53/f62 0 2024-02-22T00:33:18.379 INFO:tasks.workunit.client.1.smithi161.stdout:4/282: fsync d5/f5b 0 2024-02-22T00:33:18.380 INFO:tasks.workunit.client.1.smithi161.stdout:5/376: dwrite d3/d1b/d36/f4d [0,4194304] 0 2024-02-22T00:33:18.381 INFO:tasks.workunit.client.1.smithi161.stdout:2/298: write de/d11/f59 [2535674,57813] 0 2024-02-22T00:33:18.386 INFO:tasks.workunit.client.1.smithi161.stdout:8/227: rename d1/c9 to d1/d1c/d20/d22/d3f/c42 0 2024-02-22T00:33:18.391 INFO:tasks.workunit.client.1.smithi161.stdout:5/377: creat d3/d1b/d36/f83 x:0 0 0 2024-02-22T00:33:18.391 INFO:tasks.workunit.client.1.smithi161.stdout:6/200: dread d3/d10/f21 [0,4194304] 0 2024-02-22T00:33:18.391 INFO:tasks.workunit.client.1.smithi161.stdout:7/259: rename d3/dd/d24 to d3/dd/d59/d5b 0 2024-02-22T00:33:18.395 INFO:tasks.workunit.client.1.smithi161.stdout:4/283: creat d5/d10/d14/d24/d28/d63/f69 x:0 0 0 2024-02-22T00:33:18.396 INFO:tasks.workunit.client.1.smithi161.stdout:8/228: fsync d1/d1c/d20/d22/f35 0 2024-02-22T00:33:18.400 INFO:tasks.workunit.client.1.smithi161.stdout:5/378: mkdir d3/d1b/d25/d84 0 2024-02-22T00:33:18.400 INFO:tasks.workunit.client.1.smithi161.stdout:7/260: write d3/dd/d59/d5b/f4e [231193,68152] 0 2024-02-22T00:33:18.400 INFO:tasks.workunit.client.1.smithi161.stdout:0/352: dwrite f8 [0,4194304] 0 2024-02-22T00:33:18.401 INFO:tasks.workunit.client.1.smithi161.stdout:1/270: dwrite d19/f3b [0,4194304] 0 2024-02-22T00:33:18.402 INFO:tasks.workunit.client.1.smithi161.stdout:6/201: mkdir d3/d10/d12/d2f/d3d 0 2024-02-22T00:33:18.407 INFO:tasks.workunit.client.1.smithi161.stdout:4/284: unlink d5/d8/cc 0 2024-02-22T00:33:18.407 INFO:tasks.workunit.client.1.smithi161.stdout:0/353: write d14/d1a/f28 [4455576,35592] 0 2024-02-22T00:33:18.409 INFO:tasks.workunit.client.1.smithi161.stdout:3/235: dread da/dc/d11/f28 [0,4194304] 0 2024-02-22T00:33:18.410 INFO:tasks.workunit.client.1.smithi161.stdout:6/202: read - d3/d10/d12/d2f/f3c zero size 2024-02-22T00:33:18.412 INFO:tasks.workunit.client.1.smithi161.stdout:8/229: mknod d1/d19/c43 0 2024-02-22T00:33:18.413 INFO:tasks.workunit.client.1.smithi161.stdout:4/285: write d5/d17/f31 [7914590,96674] 0 2024-02-22T00:33:18.414 INFO:tasks.workunit.client.1.smithi161.stdout:8/230: chown d1/d1c/d20/f2b 1034234 1 2024-02-22T00:33:18.415 INFO:tasks.workunit.client.1.smithi161.stdout:7/261: write d3/dd/f1d [2371236,116576] 0 2024-02-22T00:33:18.417 INFO:tasks.workunit.client.1.smithi161.stdout:5/379: creat d3/d1c/d62/f85 x:0 0 0 2024-02-22T00:33:18.418 INFO:tasks.workunit.client.1.smithi161.stdout:1/271: rename f11 to d19/f5f 0 2024-02-22T00:33:18.418 INFO:tasks.workunit.client.1.smithi161.stdout:7/262: write d3/df/d33/f4b [147523,103978] 0 2024-02-22T00:33:18.421 INFO:tasks.workunit.client.1.smithi161.stdout:5/380: chown d3/d1b/f57 8 1 2024-02-22T00:33:18.421 INFO:tasks.workunit.client.1.smithi161.stdout:7/263: write d3/df/d33/f4b [799213,106932] 0 2024-02-22T00:33:18.421 INFO:tasks.workunit.client.1.smithi161.stdout:6/203: write d3/d10/d1b/f2e [428853,117293] 0 2024-02-22T00:33:18.423 INFO:tasks.workunit.client.1.smithi161.stdout:0/354: creat d14/d44/f7f x:0 0 0 2024-02-22T00:33:18.424 INFO:tasks.workunit.client.1.smithi161.stdout:4/286: creat d5/d8/d41/d53/f6a x:0 0 0 2024-02-22T00:33:18.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/381: stat d3/d1b/d36/f55 0 2024-02-22T00:33:18.427 INFO:tasks.workunit.client.1.smithi161.stdout:6/204: fsync d3/d10/f38 0 2024-02-22T00:33:18.427 INFO:tasks.workunit.client.1.smithi161.stdout:3/236: rename da/dc/l25 to da/dc/d11/d26/d2f/d37/l47 0 2024-02-22T00:33:18.428 INFO:tasks.workunit.client.1.smithi161.stdout:1/272: dread d19/d1d/d2c/f3d [0,4194304] 0 2024-02-22T00:33:18.430 INFO:tasks.workunit.client.1.smithi161.stdout:3/237: dread - da/dc/f1f zero size 2024-02-22T00:33:18.431 INFO:tasks.workunit.client.1.smithi161.stdout:4/287: write d5/d10/f4d [829646,47390] 0 2024-02-22T00:33:18.431 INFO:tasks.workunit.client.1.smithi161.stdout:5/382: dread - d3/d1c/d20/f5b zero size 2024-02-22T00:33:18.435 INFO:tasks.workunit.client.1.smithi161.stdout:8/231: getdents d1/d1c 0 2024-02-22T00:33:18.436 INFO:tasks.workunit.client.1.smithi161.stdout:1/273: dread d19/d1d/d2c/f3d [0,4194304] 0 2024-02-22T00:33:18.437 INFO:tasks.workunit.client.1.smithi161.stdout:0/355: creat d14/d1a/d3f/f80 x:0 0 0 2024-02-22T00:33:18.437 INFO:tasks.workunit.client.1.smithi161.stdout:6/205: symlink d3/d10/l3e 0 2024-02-22T00:33:18.439 INFO:tasks.workunit.client.1.smithi161.stdout:0/356: chown d14/c1e 1077009 1 2024-02-22T00:33:18.439 INFO:tasks.workunit.client.1.smithi161.stdout:3/238: mknod da/dc/d11/c48 0 2024-02-22T00:33:18.440 INFO:tasks.workunit.client.1.smithi161.stdout:4/288: mkdir d5/d10/d14/d24/d28/d63/d6b 0 2024-02-22T00:33:18.440 INFO:tasks.workunit.client.1.smithi161.stdout:8/232: fdatasync d1/d1c/d20/d22/d28/f2e 0 2024-02-22T00:33:18.441 INFO:tasks.workunit.client.1.smithi161.stdout:7/264: dwrite d3/f14 [8388608,4194304] 0 2024-02-22T00:33:18.441 INFO:tasks.workunit.client.1.smithi161.stdout:5/383: rename d3/d1c/d20/c5f to d3/d1c/d69/c86 0 2024-02-22T00:33:18.441 INFO:tasks.workunit.client.1.smithi161.stdout:1/274: symlink d19/d48/l60 0 2024-02-22T00:33:18.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/206: write d3/d10/d12/f23 [610370,51679] 0 2024-02-22T00:33:18.447 INFO:tasks.workunit.client.1.smithi161.stdout:6/207: chown d3/dc/c20 224213343 1 2024-02-22T00:33:18.447 INFO:tasks.workunit.client.1.smithi161.stdout:7/265: chown d3/f7 28 1 2024-02-22T00:33:18.448 INFO:tasks.workunit.client.1.smithi161.stdout:4/289: mkdir d5/d8/d41/d53/d6c 0 2024-02-22T00:33:18.449 INFO:tasks.workunit.client.1.smithi161.stdout:4/290: chown d5/f7 12 1 2024-02-22T00:33:18.450 INFO:tasks.workunit.client.1.smithi161.stdout:1/275: creat d19/d1d/d2c/d2d/f61 x:0 0 0 2024-02-22T00:33:18.450 INFO:tasks.workunit.client.1.smithi161.stdout:5/384: unlink d3/d1b/d25/f27 0 2024-02-22T00:33:18.453 INFO:tasks.workunit.client.1.smithi161.stdout:1/276: write f1 [1486746,77628] 0 2024-02-22T00:33:18.453 INFO:tasks.workunit.client.1.smithi161.stdout:3/239: creat da/dc/d11/d26/d2f/d37/f49 x:0 0 0 2024-02-22T00:33:18.453 INFO:tasks.workunit.client.1.smithi161.stdout:8/233: unlink d1/d19/f16 0 2024-02-22T00:33:18.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/240: readlink da/l43 0 2024-02-22T00:33:18.459 INFO:tasks.workunit.client.1.smithi161.stdout:4/291: mkdir d5/d10/d14/d24/d28/d38/d6d 0 2024-02-22T00:33:18.462 INFO:tasks.workunit.client.1.smithi161.stdout:7/266: dwrite d3/f9 [0,4194304] 0 2024-02-22T00:33:18.463 INFO:tasks.workunit.client.1.smithi161.stdout:4/292: dread - d5/d8/d41/d57/f60 zero size 2024-02-22T00:33:18.464 INFO:tasks.workunit.client.1.smithi161.stdout:6/208: symlink d3/d10/l3f 0 2024-02-22T00:33:18.466 INFO:tasks.workunit.client.1.smithi161.stdout:5/385: dwrite d3/f5 [4194304,4194304] 0 2024-02-22T00:33:18.467 INFO:tasks.workunit.client.1.smithi161.stdout:8/234: rename d1/f24 to d1/d2f/d30/f44 0 2024-02-22T00:33:18.471 INFO:tasks.workunit.client.1.smithi161.stdout:3/241: symlink da/dc/d11/d26/d2f/d37/l4a 0 2024-02-22T00:33:18.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/209: rename d3/dc/df/l11 to d3/dc/l40 0 2024-02-22T00:33:18.480 INFO:tasks.workunit.client.1.smithi161.stdout:1/277: dwrite d19/d2f/f41 [0,4194304] 0 2024-02-22T00:33:18.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/386: dwrite d3/d1b/f68 [0,4194304] 0 2024-02-22T00:33:18.486 INFO:tasks.workunit.client.1.smithi161.stdout:0/357: dwrite fd [0,4194304] 0 2024-02-22T00:33:18.521 INFO:tasks.workunit.client.1.smithi161.stdout:3/242: creat da/dc/d11/d26/d2f/d37/d39/f4b x:0 0 0 2024-02-22T00:33:18.521 INFO:tasks.workunit.client.1.smithi161.stdout:6/210: creat d3/dc/f41 x:0 0 0 2024-02-22T00:33:18.522 INFO:tasks.workunit.client.1.smithi161.stdout:8/235: creat d1/d19/d18/f45 x:0 0 0 2024-02-22T00:33:18.523 INFO:tasks.workunit.client.1.smithi161.stdout:7/267: dread d3/f36 [0,4194304] 0 2024-02-22T00:33:18.524 INFO:tasks.workunit.client.1.smithi161.stdout:5/387: creat d3/d1b/d25/d4c/f87 x:0 0 0 2024-02-22T00:33:18.524 INFO:tasks.workunit.client.1.smithi161.stdout:3/243: chown da/f46 3 1 2024-02-22T00:33:18.527 INFO:tasks.workunit.client.1.smithi161.stdout:1/278: symlink d19/d1d/d2c/l62 0 2024-02-22T00:33:18.527 INFO:tasks.workunit.client.1.smithi161.stdout:0/358: truncate d14/f51 2449685 0 2024-02-22T00:33:18.528 INFO:tasks.workunit.client.1.smithi161.stdout:8/236: creat d1/d1c/d20/d22/d28/d36/f46 x:0 0 0 2024-02-22T00:33:18.529 INFO:tasks.workunit.client.1.smithi161.stdout:7/268: mknod d3/dd/d59/d5b/d26/d50/c5c 0 2024-02-22T00:33:18.529 INFO:tasks.workunit.client.1.smithi161.stdout:6/211: symlink d3/d10/l42 0 2024-02-22T00:33:18.530 INFO:tasks.workunit.client.1.smithi161.stdout:5/388: write d3/d1b/d25/f23 [37062,68096] 0 2024-02-22T00:33:18.530 INFO:tasks.workunit.client.1.smithi161.stdout:9/275: sync 2024-02-22T00:33:18.531 INFO:tasks.workunit.client.1.smithi161.stdout:8/237: chown d1/l2 0 1 2024-02-22T00:33:18.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/212: chown d3/d10 20 1 2024-02-22T00:33:18.536 INFO:tasks.workunit.client.1.smithi161.stdout:1/279: creat d19/d1d/d2c/d2d/f63 x:0 0 0 2024-02-22T00:33:18.536 INFO:tasks.workunit.client.1.smithi161.stdout:4/293: dwrite d5/d8/d41/d57/f60 [0,4194304] 0 2024-02-22T00:33:18.536 INFO:tasks.workunit.client.1.smithi161.stdout:8/238: dread - d1/d1c/d20/f2b zero size 2024-02-22T00:33:18.538 INFO:tasks.workunit.client.1.smithi161.stdout:1/280: fdatasync d19/d1d/f28 0 2024-02-22T00:33:18.538 INFO:tasks.workunit.client.1.smithi161.stdout:9/276: mkdir d1/d2/d4/d5a 0 2024-02-22T00:33:18.541 INFO:tasks.workunit.client.1.smithi161.stdout:5/389: fdatasync d3/d1c/d20/f73 0 2024-02-22T00:33:18.544 INFO:tasks.workunit.client.1.smithi161.stdout:7/269: dread d3/df/d33/d35/f3f [0,4194304] 0 2024-02-22T00:33:18.550 INFO:tasks.workunit.client.1.smithi161.stdout:6/213: dwrite d3/d10/d1b/f34 [0,4194304] 0 2024-02-22T00:33:18.552 INFO:tasks.workunit.client.1.smithi161.stdout:3/244: link da/d29/l35 da/dc/d11/d26/d2f/l4c 0 2024-02-22T00:33:18.554 INFO:tasks.workunit.client.1.smithi161.stdout:5/390: readlink d3/d1b/l32 0 2024-02-22T00:33:18.554 INFO:tasks.workunit.client.1.smithi161.stdout:6/214: chown d3/f15 8080345 1 2024-02-22T00:33:18.554 INFO:tasks.workunit.client.1.smithi161.stdout:8/239: dwrite d1/f6 [0,4194304] 0 2024-02-22T00:33:18.560 INFO:tasks.workunit.client.1.smithi161.stdout:8/240: chown d1/c7 307539718 1 2024-02-22T00:33:18.561 INFO:tasks.workunit.client.1.smithi161.stdout:3/245: chown da/dc/d11/d26/d2f/d37/d39 1366 1 2024-02-22T00:33:18.564 INFO:tasks.workunit.client.1.smithi161.stdout:3/246: write da/f13 [4567821,35841] 0 2024-02-22T00:33:18.565 INFO:tasks.workunit.client.1.smithi161.stdout:6/215: dread d3/f15 [0,4194304] 0 2024-02-22T00:33:18.568 INFO:tasks.workunit.client.1.smithi161.stdout:5/391: unlink d3/d1b/d25/f3d 0 2024-02-22T00:33:18.570 INFO:tasks.workunit.client.1.smithi161.stdout:8/241: mknod d1/d1c/d20/c47 0 2024-02-22T00:33:18.571 INFO:tasks.workunit.client.1.smithi161.stdout:7/270: dwrite d3/dd/d59/d5b/f28 [0,4194304] 0 2024-02-22T00:33:18.574 INFO:tasks.workunit.client.1.smithi161.stdout:5/392: write d3/d29/f4a [1779528,57162] 0 2024-02-22T00:33:18.577 INFO:tasks.workunit.client.1.smithi161.stdout:1/281: truncate d19/d1d/d2c/d2d/f40 3670685 0 2024-02-22T00:33:18.578 INFO:tasks.workunit.client.1.smithi161.stdout:9/277: truncate d1/d2/d4/d11/f28 568624 0 2024-02-22T00:33:18.581 INFO:tasks.workunit.client.1.smithi161.stdout:5/393: truncate d3/d1c/d20/f35 1046046 0 2024-02-22T00:33:18.581 INFO:tasks.workunit.client.1.smithi161.stdout:4/294: dread f0 [0,4194304] 0 2024-02-22T00:33:18.582 INFO:tasks.workunit.client.1.smithi161.stdout:1/282: fdatasync d19/d1d/d2c/f4d 0 2024-02-22T00:33:18.582 INFO:tasks.workunit.client.1.smithi161.stdout:6/216: rename d3/dc/f2a to d3/d10/d12/d3a/f43 0 2024-02-22T00:33:18.587 INFO:tasks.workunit.client.1.smithi161.stdout:8/242: dread d1/d2f/f3e [0,4194304] 0 2024-02-22T00:33:18.587 INFO:tasks.workunit.client.1.smithi161.stdout:6/217: chown d3/d10/d12/d2f/d3d 52104 1 2024-02-22T00:33:18.591 INFO:tasks.workunit.client.1.smithi161.stdout:5/394: rename d3/d1c/d20/d74/d78 to d3/d1b/d36/d88 0 2024-02-22T00:33:18.594 INFO:tasks.workunit.client.1.smithi161.stdout:0/359: dread d14/f51 [0,4194304] 0 2024-02-22T00:33:18.595 INFO:tasks.workunit.client.1.smithi161.stdout:6/218: rmdir d3/d10/d12/d2f 39 2024-02-22T00:33:18.595 INFO:tasks.workunit.client.1.smithi161.stdout:1/283: dwrite f10 [0,4194304] 0 2024-02-22T00:33:18.596 INFO:tasks.workunit.client.1.smithi161.stdout:6/219: chown d3/d10/d12 7 1 2024-02-22T00:33:18.597 INFO:tasks.workunit.client.1.smithi161.stdout:1/284: write fa [4450553,38386] 0 2024-02-22T00:33:18.598 INFO:tasks.workunit.client.1.smithi161.stdout:9/278: link d1/d2/f1a d1/d25/f5b 0 2024-02-22T00:33:18.600 INFO:tasks.workunit.client.1.smithi161.stdout:9/279: chown d1/d2/d7/da 10252354 1 2024-02-22T00:33:18.602 INFO:tasks.workunit.client.1.smithi161.stdout:9/280: stat d1/d2/d4/d1f/c15 0 2024-02-22T00:33:18.603 INFO:tasks.workunit.client.1.smithi161.stdout:6/220: write d3/d10/d12/f29 [505794,54481] 0 2024-02-22T00:33:18.605 INFO:tasks.workunit.client.1.smithi161.stdout:4/295: dread d5/d17/f31 [0,4194304] 0 2024-02-22T00:33:18.606 INFO:tasks.workunit.client.1.smithi161.stdout:0/360: creat d14/d44/f81 x:0 0 0 2024-02-22T00:33:18.607 INFO:tasks.workunit.client.1.smithi161.stdout:6/221: write d3/d10/d12/f29 [406813,7653] 0 2024-02-22T00:33:18.608 INFO:tasks.workunit.client.1.smithi161.stdout:8/243: truncate d1/d1c/d20/d31/f3c 840273 0 2024-02-22T00:33:18.610 INFO:tasks.workunit.client.1.smithi161.stdout:3/247: truncate da/dc/fd 1523164 0 2024-02-22T00:33:18.612 INFO:tasks.workunit.client.1.smithi161.stdout:9/281: symlink d1/d5/d9/l5c 0 2024-02-22T00:33:18.612 INFO:tasks.workunit.client.1.smithi161.stdout:0/361: truncate d14/d1a/d3f/f80 859916 0 2024-02-22T00:33:18.613 INFO:tasks.workunit.client.1.smithi161.stdout:8/244: write d1/d2f/d30/f33 [530622,86809] 0 2024-02-22T00:33:18.613 INFO:tasks.workunit.client.1.smithi161.stdout:3/248: fdatasync da/dc/d11/f3e 0 2024-02-22T00:33:18.615 INFO:tasks.workunit.client.1.smithi161.stdout:1/285: dread d19/d1d/d2c/f4d [0,4194304] 0 2024-02-22T00:33:18.616 INFO:tasks.workunit.client.1.smithi161.stdout:8/245: dread - d1/d19/f3a zero size 2024-02-22T00:33:18.617 INFO:tasks.workunit.client.1.smithi161.stdout:4/296: mknod d5/d10/d14/d4f/c6e 0 2024-02-22T00:33:18.620 INFO:tasks.workunit.client.1.smithi161.stdout:5/395: write d3/d1c/f2d [1701466,35888] 0 2024-02-22T00:33:18.620 INFO:tasks.workunit.client.1.smithi161.stdout:0/362: truncate d14/d1a/d3f/f5b 682777 0 2024-02-22T00:33:18.621 INFO:tasks.workunit.client.1.smithi161.stdout:6/222: symlink d3/d10/d12/d2f/d3d/l44 0 2024-02-22T00:33:18.622 INFO:tasks.workunit.client.1.smithi161.stdout:1/286: mkdir d19/d51/d64 0 2024-02-22T00:33:18.623 INFO:tasks.workunit.client.1.smithi161.stdout:8/246: creat d1/d2f/d37/f48 x:0 0 0 2024-02-22T00:33:18.627 INFO:tasks.workunit.client.1.smithi161.stdout:1/287: creat d19/d1d/f65 x:0 0 0 2024-02-22T00:33:18.631 INFO:tasks.workunit.client.1.smithi161.stdout:3/249: dwrite da/dc/d11/d26/d2f/d37/d39/f42 [0,4194304] 0 2024-02-22T00:33:18.634 INFO:tasks.workunit.client.1.smithi161.stdout:5/396: mknod d3/d1b/d25/c89 0 2024-02-22T00:33:18.634 INFO:tasks.workunit.client.1.smithi161.stdout:1/288: dread d19/d1d/f57 [0,4194304] 0 2024-02-22T00:33:18.635 INFO:tasks.workunit.client.1.smithi161.stdout:5/397: read - d3/f72 zero size 2024-02-22T00:33:18.636 INFO:tasks.workunit.client.1.smithi161.stdout:8/247: rename d1/l4 to d1/d2f/d37/l49 0 2024-02-22T00:33:18.637 INFO:tasks.workunit.client.1.smithi161.stdout:5/398: readlink d3/d1b/d25/l6e 0 2024-02-22T00:33:18.638 INFO:tasks.workunit.client.1.smithi161.stdout:8/248: dread - d1/d2f/d37/f48 zero size 2024-02-22T00:33:18.639 INFO:tasks.workunit.client.1.smithi161.stdout:1/289: mknod d19/c66 0 2024-02-22T00:33:18.641 INFO:tasks.workunit.client.1.smithi161.stdout:1/290: stat d19/d2f/f4c 0 2024-02-22T00:33:18.642 INFO:tasks.workunit.client.1.smithi161.stdout:0/363: dwrite d14/d37/f59 [0,4194304] 0 2024-02-22T00:33:18.642 INFO:tasks.workunit.client.1.smithi161.stdout:8/249: dread d1/d2f/f3e [0,4194304] 0 2024-02-22T00:33:18.644 INFO:tasks.workunit.client.1.smithi161.stdout:3/250: link da/dc/d11/d26/d2f/d37/d39/f3f da/dc/d11/d26/f4d 0 2024-02-22T00:33:18.647 INFO:tasks.workunit.client.1.smithi161.stdout:8/250: unlink d1/f12 0 2024-02-22T00:33:18.648 INFO:tasks.workunit.client.1.smithi161.stdout:1/291: creat d19/d1d/d2c/d2d/d3f/f67 x:0 0 0 2024-02-22T00:33:18.648 INFO:tasks.workunit.client.1.smithi161.stdout:8/251: read - d1/d19/d18/f45 zero size 2024-02-22T00:33:18.649 INFO:tasks.workunit.client.1.smithi161.stdout:6/223: write d3/d10/d12/f2d [1471984,93699] 0 2024-02-22T00:33:18.651 INFO:tasks.workunit.client.1.smithi161.stdout:4/297: write d5/d17/f4a [1863133,94117] 0 2024-02-22T00:33:18.652 INFO:tasks.workunit.client.1.smithi161.stdout:5/399: getdents d3/d29 0 2024-02-22T00:33:18.653 INFO:tasks.workunit.client.1.smithi161.stdout:9/282: truncate d1/d2/d7/da/f13 835908 0 2024-02-22T00:33:18.653 INFO:tasks.workunit.client.1.smithi161.stdout:4/298: write d5/fe [2823165,35116] 0 2024-02-22T00:33:18.655 INFO:tasks.workunit.client.1.smithi161.stdout:1/292: mkdir d19/d48/d68 0 2024-02-22T00:33:18.655 INFO:tasks.workunit.client.1.smithi161.stdout:5/400: dread - d3/d1b/d25/d4c/f87 zero size 2024-02-22T00:33:18.655 INFO:tasks.workunit.client.1.smithi161.stdout:9/283: fsync d1/d2/d7/f49 0 2024-02-22T00:33:18.656 INFO:tasks.workunit.client.1.smithi161.stdout:4/299: stat d5/d10/d14/d24/d28/d38/d6d 0 2024-02-22T00:33:18.657 INFO:tasks.workunit.client.1.smithi161.stdout:0/364: creat d14/f82 x:0 0 0 2024-02-22T00:33:18.658 INFO:tasks.workunit.client.1.smithi161.stdout:1/293: chown l12 837207 1 2024-02-22T00:33:18.659 INFO:tasks.workunit.client.1.smithi161.stdout:1/294: chown lc 1987 1 2024-02-22T00:33:18.660 INFO:tasks.workunit.client.1.smithi161.stdout:5/401: mkdir d3/d1c/d62/d8a 0 2024-02-22T00:33:18.661 INFO:tasks.workunit.client.1.smithi161.stdout:6/224: creat d3/f45 x:0 0 0 2024-02-22T00:33:18.663 INFO:tasks.workunit.client.1.smithi161.stdout:0/365: mknod d14/d37/c83 0 2024-02-22T00:33:18.663 INFO:tasks.workunit.client.1.smithi161.stdout:6/225: read d3/d10/d12/f23 [386447,40891] 0 2024-02-22T00:33:18.665 INFO:tasks.workunit.client.1.smithi161.stdout:4/300: unlink d5/d10/d14/d24/f59 0 2024-02-22T00:33:18.667 INFO:tasks.workunit.client.1.smithi161.stdout:9/284: rename d1/d5/d9/l2b to d1/d5/d9/d33/d4f/l5d 0 2024-02-22T00:33:18.667 INFO:tasks.workunit.client.1.smithi161.stdout:5/402: dwrite d3/d1b/d25/d4c/f51 [0,4194304] 0 2024-02-22T00:33:18.671 INFO:tasks.workunit.client.1.smithi161.stdout:1/295: mkdir d19/d1d/d2c/d2d/d3f/d69 0 2024-02-22T00:33:18.675 INFO:tasks.workunit.client.1.smithi161.stdout:5/403: mkdir d3/d1c/d20/d74/d8b 0 2024-02-22T00:33:18.678 INFO:tasks.workunit.client.1.smithi161.stdout:5/404: chown d3/d1b/d36/f3b 7 1 2024-02-22T00:33:18.679 INFO:tasks.workunit.client.1.smithi161.stdout:1/296: dwrite d19/d1d/f36 [0,4194304] 0 2024-02-22T00:33:18.679 INFO:tasks.workunit.client.1.smithi161.stdout:8/252: dread d1/d1c/d20/d22/d28/f2e [0,4194304] 0 2024-02-22T00:33:18.680 INFO:tasks.workunit.client.1.smithi161.stdout:5/405: chown d3/d1b/c56 32282 1 2024-02-22T00:33:18.681 INFO:tasks.workunit.client.1.smithi161.stdout:0/366: link f3 d14/f84 0 2024-02-22T00:33:18.682 INFO:tasks.workunit.client.1.smithi161.stdout:5/406: write d3/d1b/d36/f4d [2631475,74415] 0 2024-02-22T00:33:18.682 INFO:tasks.workunit.client.1.smithi161.stdout:8/253: dread d1/d2f/f3e [0,4194304] 0 2024-02-22T00:33:18.684 INFO:tasks.workunit.client.1.smithi161.stdout:5/407: write d3/d1c/d62/f85 [694640,108129] 0 2024-02-22T00:33:18.686 INFO:tasks.workunit.client.1.smithi161.stdout:1/297: mknod d19/d1d/d2c/d2d/d3f/c6a 0 2024-02-22T00:33:18.688 INFO:tasks.workunit.client.1.smithi161.stdout:6/226: getdents d3/d10 0 2024-02-22T00:33:18.688 INFO:tasks.workunit.client.1.smithi161.stdout:1/298: truncate d19/f46 836846 0 2024-02-22T00:33:18.688 INFO:tasks.workunit.client.1.smithi161.stdout:0/367: chown d14/d37/l7b 52 1 2024-02-22T00:33:18.689 INFO:tasks.workunit.client.1.smithi161.stdout:4/301: getdents d5/d17 0 2024-02-22T00:33:18.693 INFO:tasks.workunit.client.1.smithi161.stdout:6/227: fsync d3/d10/d12/d2f/f3c 0 2024-02-22T00:33:18.693 INFO:tasks.workunit.client.1.smithi161.stdout:8/254: write d1/d2f/f3e [533910,117408] 0 2024-02-22T00:33:18.693 INFO:tasks.workunit.client.1.smithi161.stdout:0/368: write f3 [2315858,78941] 0 2024-02-22T00:33:18.693 INFO:tasks.workunit.client.1.smithi161.stdout:8/255: stat d1/d1c/d20/d22 0 2024-02-22T00:33:18.695 INFO:tasks.workunit.client.1.smithi161.stdout:0/369: chown d14/f4b 235814172 1 2024-02-22T00:33:18.696 INFO:tasks.workunit.client.1.smithi161.stdout:1/299: creat d19/d51/d64/f6b x:0 0 0 2024-02-22T00:33:18.697 INFO:tasks.workunit.client.1.smithi161.stdout:0/370: chown d14/f16 305226 1 2024-02-22T00:33:18.698 INFO:tasks.workunit.client.1.smithi161.stdout:6/228: link d3/d10/d12/f36 d3/d10/d1b/f46 0 2024-02-22T00:33:18.699 INFO:tasks.workunit.client.1.smithi161.stdout:5/408: dwrite d3/f19 [0,4194304] 0 2024-02-22T00:33:18.700 INFO:tasks.workunit.client.1.smithi161.stdout:1/300: mkdir d19/d51/d6c 0 2024-02-22T00:33:18.700 INFO:tasks.workunit.client.1.smithi161.stdout:5/409: dread - d3/d1c/d20/f73 zero size 2024-02-22T00:33:18.701 INFO:tasks.workunit.client.1.smithi161.stdout:0/371: creat d14/d44/f85 x:0 0 0 2024-02-22T00:33:18.701 INFO:tasks.workunit.client.1.smithi161.stdout:4/302: getdents d5/d10/d14/d4f 0 2024-02-22T00:33:18.701 INFO:tasks.workunit.client.1.smithi161.stdout:1/301: write f7 [762359,42541] 0 2024-02-22T00:33:18.704 INFO:tasks.workunit.client.1.smithi161.stdout:8/256: getdents d1/d1c/d20/d22/d28 0 2024-02-22T00:33:18.706 INFO:tasks.workunit.client.1.smithi161.stdout:0/372: creat d14/d37/d42/f86 x:0 0 0 2024-02-22T00:33:18.708 INFO:tasks.workunit.client.1.smithi161.stdout:8/257: creat d1/d19/f4a x:0 0 0 2024-02-22T00:33:18.710 INFO:tasks.workunit.client.1.smithi161.stdout:0/373: mknod d14/d44/c87 0 2024-02-22T00:33:18.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/258: mknod d1/c4b 0 2024-02-22T00:33:18.713 INFO:tasks.workunit.client.1.smithi161.stdout:6/229: dwrite d3/d10/d12/f29 [0,4194304] 0 2024-02-22T00:33:18.717 INFO:tasks.workunit.client.1.smithi161.stdout:8/259: symlink d1/d1c/l4c 0 2024-02-22T00:33:18.722 INFO:tasks.workunit.client.1.smithi161.stdout:6/230: fsync d3/d10/d12/d2f/f3c 0 2024-02-22T00:33:18.722 INFO:tasks.workunit.client.1.smithi161.stdout:8/260: mknod d1/c4d 0 2024-02-22T00:33:18.722 INFO:tasks.workunit.client.1.smithi161.stdout:1/302: write d19/d1d/d2c/d2d/f40 [2725146,118685] 0 2024-02-22T00:33:18.723 INFO:tasks.workunit.client.1.smithi161.stdout:4/303: truncate d5/d10/d14/d24/f3c 2488158 0 2024-02-22T00:33:18.723 INFO:tasks.workunit.client.1.smithi161.stdout:6/231: fsync d3/f45 0 2024-02-22T00:33:18.723 INFO:tasks.workunit.client.1.smithi161.stdout:0/374: dwrite d14/d37/f59 [4194304,4194304] 0 2024-02-22T00:33:18.731 INFO:tasks.workunit.client.1.smithi161.stdout:1/303: dread - d19/d1d/d2c/d2d/f5b zero size 2024-02-22T00:33:18.733 INFO:tasks.workunit.client.1.smithi161.stdout:8/261: symlink d1/d2f/l4e 0 2024-02-22T00:33:18.734 INFO:tasks.workunit.client.1.smithi161.stdout:6/232: fsync d3/d10/f13 0 2024-02-22T00:33:18.735 INFO:tasks.workunit.client.1.smithi161.stdout:1/304: symlink d19/d51/d64/l6d 0 2024-02-22T00:33:18.735 INFO:tasks.workunit.client.1.smithi161.stdout:8/262: chown d1/d2f 24 1 2024-02-22T00:33:18.736 INFO:tasks.workunit.client.1.smithi161.stdout:1/305: truncate f1 4681712 0 2024-02-22T00:33:18.736 INFO:tasks.workunit.client.1.smithi161.stdout:4/304: mknod d5/d10/d14/d24/d28/d38/d6d/c6f 0 2024-02-22T00:33:18.736 INFO:tasks.workunit.client.1.smithi161.stdout:8/263: fdatasync d1/f29 0 2024-02-22T00:33:18.742 INFO:tasks.workunit.client.1.smithi161.stdout:5/410: dread d3/d1b/d25/f5c [0,4194304] 0 2024-02-22T00:33:18.743 INFO:tasks.workunit.client.1.smithi161.stdout:6/233: write d3/dc/f27 [1154690,106716] 0 2024-02-22T00:33:18.743 INFO:tasks.workunit.client.1.smithi161.stdout:0/375: dwrite d14/f4b [4194304,4194304] 0 2024-02-22T00:33:18.748 INFO:tasks.workunit.client.1.smithi161.stdout:8/264: write d1/d2f/d30/f33 [307783,41835] 0 2024-02-22T00:33:18.753 INFO:tasks.workunit.client.1.smithi161.stdout:4/305: dwrite d5/d10/f1f [4194304,4194304] 0 2024-02-22T00:33:18.753 INFO:tasks.workunit.client.1.smithi161.stdout:0/376: chown d14/d1a/d3f/f64 411329 1 2024-02-22T00:33:18.753 INFO:tasks.workunit.client.1.smithi161.stdout:1/306: mknod d19/d48/c6e 0 2024-02-22T00:33:18.755 INFO:tasks.workunit.client.1.smithi161.stdout:8/265: chown d1/d1c/d20 759 1 2024-02-22T00:33:18.755 INFO:tasks.workunit.client.1.smithi161.stdout:6/234: creat d3/d10/d1b/f47 x:0 0 0 2024-02-22T00:33:18.756 INFO:tasks.workunit.client.1.smithi161.stdout:5/411: mknod d3/d1c/d62/c8c 0 2024-02-22T00:33:18.756 INFO:tasks.workunit.client.1.smithi161.stdout:1/307: fsync d19/d51/d64/f6b 0 2024-02-22T00:33:18.757 INFO:tasks.workunit.client.1.smithi161.stdout:0/377: mknod d14/d1a/c88 0 2024-02-22T00:33:18.758 INFO:tasks.workunit.client.1.smithi161.stdout:5/412: chown d3/d1b/d36 2 1 2024-02-22T00:33:18.760 INFO:tasks.workunit.client.1.smithi161.stdout:0/378: chown l13 2963 1 2024-02-22T00:33:18.761 INFO:tasks.workunit.client.1.smithi161.stdout:0/379: read - d14/d1a/d3f/f7c zero size 2024-02-22T00:33:18.762 INFO:tasks.workunit.client.1.smithi161.stdout:6/235: rename d3/d10/d12/d2f/d3d to d3/d48 0 2024-02-22T00:33:18.764 INFO:tasks.workunit.client.1.smithi161.stdout:6/236: stat d3/d10/d12/f23 0 2024-02-22T00:33:18.767 INFO:tasks.workunit.client.1.smithi161.stdout:6/237: dread - d3/d10/d12/d2f/f3c zero size 2024-02-22T00:33:18.770 INFO:tasks.workunit.client.1.smithi161.stdout:5/413: rename d3/d1b/d25/f65 to d3/d1c/f8d 0 2024-02-22T00:33:18.775 INFO:tasks.workunit.client.1.smithi161.stdout:5/414: read - d3/d1b/d25/f6c zero size 2024-02-22T00:33:18.776 INFO:tasks.workunit.client.1.smithi161.stdout:0/380: dwrite d14/d1a/f60 [0,4194304] 0 2024-02-22T00:33:18.776 INFO:tasks.workunit.client.1.smithi161.stdout:1/308: dwrite d19/f43 [0,4194304] 0 2024-02-22T00:33:18.781 INFO:tasks.workunit.client.1.smithi161.stdout:0/381: chown d14/d37/d42 3550311 1 2024-02-22T00:33:18.781 INFO:tasks.workunit.client.1.smithi161.stdout:6/238: truncate d3/d10/f13 2437892 0 2024-02-22T00:33:18.782 INFO:tasks.workunit.client.1.smithi161.stdout:0/382: readlink d14/d44/l50 0 2024-02-22T00:33:18.783 INFO:tasks.workunit.client.1.smithi161.stdout:5/415: write d3/d1c/d20/f59 [4242990,31099] 0 2024-02-22T00:33:18.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/383: chown d14/d37/f59 1601 1 2024-02-22T00:33:18.786 INFO:tasks.workunit.client.1.smithi161.stdout:8/266: dwrite d1/d19/f10 [0,4194304] 0 2024-02-22T00:33:18.787 INFO:tasks.workunit.client.1.smithi161.stdout:6/239: symlink d3/dc/df/d32/l49 0 2024-02-22T00:33:18.789 INFO:tasks.workunit.client.1.smithi161.stdout:8/267: chown d1/d1c/d20 2510547 1 2024-02-22T00:33:18.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/384: creat d14/d37/f89 x:0 0 0 2024-02-22T00:33:18.793 INFO:tasks.workunit.client.1.smithi161.stdout:0/385: chown d14/d1a/f66 19 1 2024-02-22T00:33:18.793 INFO:tasks.workunit.client.1.smithi161.stdout:1/309: dwrite d19/d1d/d2c/d2d/f61 [0,4194304] 0 2024-02-22T00:33:18.793 INFO:tasks.workunit.client.1.smithi161.stdout:0/386: stat d14/d44/f81 0 2024-02-22T00:33:18.795 INFO:tasks.workunit.client.1.smithi161.stdout:6/240: rename d3/c8 to d3/d30/c4a 0 2024-02-22T00:33:18.801 INFO:tasks.workunit.client.1.smithi161.stdout:8/268: mkdir d1/d1c/d20/d22/d28/d36/d4f 0 2024-02-22T00:33:18.803 INFO:tasks.workunit.client.1.smithi161.stdout:5/416: truncate d3/d1b/d36/f55 455135 0 2024-02-22T00:33:18.803 INFO:tasks.workunit.client.1.smithi161.stdout:8/269: chown d1/d1c/d20/d22/d3f/l40 0 1 2024-02-22T00:33:18.805 INFO:tasks.workunit.client.1.smithi161.stdout:1/310: rename d19/d1d/d2c/f3d to d19/d48/d68/f6f 0 2024-02-22T00:33:18.811 INFO:tasks.workunit.client.1.smithi161.stdout:0/387: rename d14/f4a to d14/d1a/d3f/d5d/f8a 0 2024-02-22T00:33:18.816 INFO:tasks.workunit.client.1.smithi161.stdout:8/270: creat d1/d1c/d20/d31/f50 x:0 0 0 2024-02-22T00:33:18.818 INFO:tasks.workunit.client.1.smithi161.stdout:5/417: dwrite d3/d1b/d25/d4c/f87 [0,4194304] 0 2024-02-22T00:33:18.821 INFO:tasks.workunit.client.1.smithi161.stdout:1/311: dwrite d19/f1a [0,4194304] 0 2024-02-22T00:33:18.829 INFO:tasks.workunit.client.1.smithi161.stdout:8/271: write d1/d1c/d20/d22/d28/d36/f46 [124425,46987] 0 2024-02-22T00:33:18.829 INFO:tasks.workunit.client.1.smithi161.stdout:5/418: dread d3/d1c/f48 [0,4194304] 0 2024-02-22T00:33:18.833 INFO:tasks.workunit.client.1.smithi161.stdout:8/272: write d1/d1c/d20/d22/d28/f2e [1543505,92256] 0 2024-02-22T00:33:18.833 INFO:tasks.workunit.client.1.smithi161.stdout:0/388: dwrite d14/d1a/f3d [0,4194304] 0 2024-02-22T00:33:18.835 INFO:tasks.workunit.client.1.smithi161.stdout:0/389: truncate d14/d37/f89 343368 0 2024-02-22T00:33:18.839 INFO:tasks.workunit.client.1.smithi161.stdout:0/390: symlink d14/d37/l8b 0 2024-02-22T00:33:18.840 INFO:tasks.workunit.client.1.smithi161.stdout:1/312: dwrite d19/f1b [0,4194304] 0 2024-02-22T00:33:18.841 INFO:tasks.workunit.client.1.smithi161.stdout:5/419: creat d3/d1c/d20/d74/d8b/f8e x:0 0 0 2024-02-22T00:33:18.844 INFO:tasks.workunit.client.1.smithi161.stdout:8/273: rename d1/d19/f11 to d1/d1c/d20/d22/d3f/f51 0 2024-02-22T00:33:18.844 INFO:tasks.workunit.client.1.smithi161.stdout:8/274: dread - d1/d19/d18/f45 zero size 2024-02-22T00:33:18.845 INFO:tasks.workunit.client.1.smithi161.stdout:5/420: mkdir d3/d1b/d8f 0 2024-02-22T00:33:18.846 INFO:tasks.workunit.client.1.smithi161.stdout:6/241: dread d3/d10/f13 [0,4194304] 0 2024-02-22T00:33:18.847 INFO:tasks.workunit.client.1.smithi161.stdout:8/275: fsync d1/d19/f3a 0 2024-02-22T00:33:18.847 INFO:tasks.workunit.client.1.smithi161.stdout:5/421: dread - d3/d29/f66 zero size 2024-02-22T00:33:18.847 INFO:tasks.workunit.client.1.smithi161.stdout:0/391: fsync d14/f56 0 2024-02-22T00:33:18.850 INFO:tasks.workunit.client.1.smithi161.stdout:6/242: rmdir d3/d48 39 2024-02-22T00:33:18.851 INFO:tasks.workunit.client.1.smithi161.stdout:1/313: creat d19/d1d/d2c/d2d/d3f/d69/f70 x:0 0 0 2024-02-22T00:33:18.852 INFO:tasks.workunit.client.1.smithi161.stdout:0/392: creat d14/d29/f8c x:0 0 0 2024-02-22T00:33:18.853 INFO:tasks.workunit.client.1.smithi161.stdout:5/422: fdatasync d3/d1b/d25/f39 0 2024-02-22T00:33:18.855 INFO:tasks.workunit.client.1.smithi161.stdout:1/314: rename f15 to d19/d48/d68/f71 0 2024-02-22T00:33:18.857 INFO:tasks.workunit.client.1.smithi161.stdout:8/276: getdents d1/d1c/d20/d22/d28 0 2024-02-22T00:33:18.857 INFO:tasks.workunit.client.1.smithi161.stdout:8/277: dread - d1/f2d zero size 2024-02-22T00:33:18.858 INFO:tasks.workunit.client.1.smithi161.stdout:0/393: creat d14/d1a/f8d x:0 0 0 2024-02-22T00:33:18.860 INFO:tasks.workunit.client.1.smithi161.stdout:5/423: creat d3/d1c/d20/f90 x:0 0 0 2024-02-22T00:33:18.862 INFO:tasks.workunit.client.1.smithi161.stdout:1/315: creat d19/d1d/d2c/d4f/f72 x:0 0 0 2024-02-22T00:33:18.865 INFO:tasks.workunit.client.1.smithi161.stdout:8/278: rename d1/d2f/l32 to d1/d1c/d20/d22/d28/d36/l52 0 2024-02-22T00:33:18.865 INFO:tasks.workunit.client.1.smithi161.stdout:5/424: mkdir d3/d1b/d91 0 2024-02-22T00:33:18.866 INFO:tasks.workunit.client.1.smithi161.stdout:0/394: dwrite d14/d29/f8c [0,4194304] 0 2024-02-22T00:33:18.868 INFO:tasks.workunit.client.1.smithi161.stdout:8/279: read - d1/d1c/d20/d22/d28/d36/f41 zero size 2024-02-22T00:33:18.868 INFO:tasks.workunit.client.1.smithi161.stdout:5/425: mkdir d3/d29/d80/d92 0 2024-02-22T00:33:18.870 INFO:tasks.workunit.client.1.smithi161.stdout:5/426: chown d3/d1c/d20/f5b 85064 1 2024-02-22T00:33:18.870 INFO:tasks.workunit.client.1.smithi161.stdout:0/395: fdatasync d14/f1f 0 2024-02-22T00:33:18.877 INFO:tasks.workunit.client.1.smithi161.stdout:0/396: write d14/d1a/f66 [643415,71267] 0 2024-02-22T00:33:18.877 INFO:tasks.workunit.client.1.smithi161.stdout:8/280: symlink d1/d2f/l53 0 2024-02-22T00:33:18.877 INFO:tasks.workunit.client.1.smithi161.stdout:6/243: truncate d3/d10/d12/d3a/f43 173471 0 2024-02-22T00:33:18.880 INFO:tasks.workunit.client.1.smithi161.stdout:2/299: sync 2024-02-22T00:33:18.880 INFO:tasks.workunit.client.1.smithi161.stdout:5/427: dwrite d3/d1b/f68 [0,4194304] 0 2024-02-22T00:33:18.880 INFO:tasks.workunit.client.1.smithi161.stdout:8/281: unlink d1/d2f/d30/f44 0 2024-02-22T00:33:18.883 INFO:tasks.workunit.client.1.smithi161.stdout:8/282: fdatasync d1/d1c/d20/f2b 0 2024-02-22T00:33:18.884 INFO:tasks.workunit.client.1.smithi161.stdout:1/316: dread d19/d48/d68/f71 [0,4194304] 0 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:6/244: readlink d3/d48/l44 0 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:5/428: truncate d3/d1b/d25/f6b 628121 0 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:0/397: dread d14/d29/f5c [0,4194304] 0 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/300: mknod de/d2b/d65/c6a 0 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:6/245: chown d3/d10/fa 11611888 1 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:5/429: fdatasync d3/d1b/f57 0 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:0/398: truncate d14/d29/f7a 693791 0 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:6/246: stat d3/d10/f21 0 2024-02-22T00:33:18.892 INFO:tasks.workunit.client.1.smithi161.stdout:5/430: read - d3/d1c/d20/f71 zero size 2024-02-22T00:33:18.893 INFO:tasks.workunit.client.1.smithi161.stdout:1/317: getdents d19/d51/d64 0 2024-02-22T00:33:18.893 INFO:tasks.workunit.client.1.smithi161.stdout:5/431: mknod d3/d29/d80/c93 0 2024-02-22T00:33:18.895 INFO:tasks.workunit.client.1.smithi161.stdout:1/318: write d19/d1d/d2c/d2d/f40 [4456223,21099] 0 2024-02-22T00:33:18.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/432: write d3/f72 [514386,47783] 0 2024-02-22T00:33:18.898 INFO:tasks.workunit.client.1.smithi161.stdout:6/247: unlink d3/d10/f13 0 2024-02-22T00:33:18.904 INFO:tasks.workunit.client.1.smithi161.stdout:5/433: dwrite d3/d1b/d36/f52 [0,4194304] 0 2024-02-22T00:33:18.910 INFO:tasks.workunit.client.1.smithi161.stdout:6/248: link d3/dc/f2b d3/dc/df/d32/f4b 0 2024-02-22T00:33:18.910 INFO:tasks.workunit.client.1.smithi161.stdout:5/434: rename d3/fe to d3/d1c/d62/f94 0 2024-02-22T00:33:18.913 INFO:tasks.workunit.client.1.smithi161.stdout:1/319: write d19/d48/d68/f71 [795453,62941] 0 2024-02-22T00:33:18.918 INFO:tasks.workunit.client.1.smithi161.stdout:2/301: dwrite de/d2b/d65/f31 [0,4194304] 0 2024-02-22T00:33:18.920 INFO:tasks.workunit.client.1.smithi161.stdout:2/302: write de/f1c [1138151,18473] 0 2024-02-22T00:33:18.922 INFO:tasks.workunit.client.1.smithi161.stdout:2/303: dread - de/d2b/f5b zero size 2024-02-22T00:33:18.925 INFO:tasks.workunit.client.1.smithi161.stdout:1/320: dwrite d19/d1d/d2c/d2d/d3f/d69/f70 [0,4194304] 0 2024-02-22T00:33:18.926 INFO:tasks.workunit.client.1.smithi161.stdout:0/399: dread d14/d1a/f23 [0,4194304] 0 2024-02-22T00:33:18.932 INFO:tasks.workunit.client.1.smithi161.stdout:0/400: mkdir d14/d37/d42/d8e 0 2024-02-22T00:33:18.935 INFO:tasks.workunit.client.1.smithi161.stdout:1/321: mknod d19/d1d/d2c/c73 0 2024-02-22T00:33:18.935 INFO:tasks.workunit.client.1.smithi161.stdout:2/304: creat de/d11/d5c/d33/f6b x:0 0 0 2024-02-22T00:33:18.936 INFO:tasks.workunit.client.1.smithi161.stdout:2/305: stat de/d2b/c49 0 2024-02-22T00:33:18.940 INFO:tasks.workunit.client.1.smithi161.stdout:1/322: link d19/d2f/f4e d19/d1d/d56/f74 0 2024-02-22T00:33:18.942 INFO:tasks.workunit.client.1.smithi161.stdout:1/323: creat d19/d1d/d2c/d2d/f75 x:0 0 0 2024-02-22T00:33:18.942 INFO:tasks.workunit.client.1.smithi161.stdout:1/324: readlink d19/d1d/l1e 0 2024-02-22T00:33:18.946 INFO:tasks.workunit.client.1.smithi161.stdout:1/325: rename d19/f3b to d19/d51/f76 0 2024-02-22T00:33:18.950 INFO:tasks.workunit.client.1.smithi161.stdout:1/326: rename d19/d1d/d2c/d2d/f61 to d19/d51/d6c/f77 0 2024-02-22T00:33:18.950 INFO:tasks.workunit.client.1.smithi161.stdout:0/401: write d14/f18 [8337699,26994] 0 2024-02-22T00:33:18.951 INFO:tasks.workunit.client.1.smithi161.stdout:1/327: chown d19/d2f 46931 1 2024-02-22T00:33:18.952 INFO:tasks.workunit.client.1.smithi161.stdout:1/328: chown d19/d48/d68 11636 1 2024-02-22T00:33:18.954 INFO:tasks.workunit.client.1.smithi161.stdout:2/306: truncate de/f67 1973499 0 2024-02-22T00:33:18.961 INFO:tasks.workunit.client.1.smithi161.stdout:2/307: creat de/d2b/d65/d60/d68/f6c x:0 0 0 2024-02-22T00:33:18.963 INFO:tasks.workunit.client.1.smithi161.stdout:1/329: rmdir d19 39 2024-02-22T00:33:18.964 INFO:tasks.workunit.client.1.smithi161.stdout:2/308: creat de/d2b/d65/d60/d68/f6d x:0 0 0 2024-02-22T00:33:18.965 INFO:tasks.workunit.client.1.smithi161.stdout:0/402: dread d14/d44/f67 [0,4194304] 0 2024-02-22T00:33:18.966 INFO:tasks.workunit.client.1.smithi161.stdout:2/309: rename de to de/d11/d5c/d33/d6e 22 2024-02-22T00:33:18.969 INFO:tasks.workunit.client.1.smithi161.stdout:2/310: creat de/d11/f6f x:0 0 0 2024-02-22T00:33:18.970 INFO:tasks.workunit.client.1.smithi161.stdout:0/403: mknod d14/d37/d42/d8e/c8f 0 2024-02-22T00:33:18.972 INFO:tasks.workunit.client.1.smithi161.stdout:0/404: write d14/f4b [6890615,62780] 0 2024-02-22T00:33:18.973 INFO:tasks.workunit.client.1.smithi161.stdout:1/330: dwrite d19/d48/f50 [0,4194304] 0 2024-02-22T00:33:18.973 INFO:tasks.workunit.client.1.smithi161.stdout:2/311: creat de/d11/d5c/d33/d35/f70 x:0 0 0 2024-02-22T00:33:18.974 INFO:tasks.workunit.client.1.smithi161.stdout:0/405: dread - d14/d1a/f79 zero size 2024-02-22T00:33:18.975 INFO:tasks.workunit.client.1.smithi161.stdout:2/312: chown de/d11/c19 1516020606 1 2024-02-22T00:33:18.976 INFO:tasks.workunit.client.1.smithi161.stdout:1/331: fdatasync f5 0 2024-02-22T00:33:18.977 INFO:tasks.workunit.client.1.smithi161.stdout:0/406: dread - d14/d44/f85 zero size 2024-02-22T00:33:18.977 INFO:tasks.workunit.client.1.smithi161.stdout:0/407: write d14/d44/f81 [128012,32308] 0 2024-02-22T00:33:18.978 INFO:tasks.workunit.client.1.smithi161.stdout:2/313: mkdir de/d2b/d65/d3a/d71 0 2024-02-22T00:33:18.979 INFO:tasks.workunit.client.1.smithi161.stdout:1/332: mknod d19/d51/c78 0 2024-02-22T00:33:18.981 INFO:tasks.workunit.client.1.smithi161.stdout:0/408: unlink d14/d29/l34 0 2024-02-22T00:33:18.981 INFO:tasks.workunit.client.1.smithi161.stdout:2/314: dread de/d11/d14/f18 [0,4194304] 0 2024-02-22T00:33:18.982 INFO:tasks.workunit.client.1.smithi161.stdout:1/333: creat d19/d1d/d2c/d4f/f79 x:0 0 0 2024-02-22T00:33:18.983 INFO:tasks.workunit.client.1.smithi161.stdout:2/315: write de/d11/d14/f18 [1062734,21747] 0 2024-02-22T00:33:18.984 INFO:tasks.workunit.client.1.smithi161.stdout:1/334: fsync d19/d1d/d2c/d2d/d3f/f67 0 2024-02-22T00:33:18.984 INFO:tasks.workunit.client.1.smithi161.stdout:0/409: creat d14/f90 x:0 0 0 2024-02-22T00:33:18.987 INFO:tasks.workunit.client.1.smithi161.stdout:2/316: mkdir de/d2b/d65/d3a/d72 0 2024-02-22T00:33:18.992 INFO:tasks.workunit.client.1.smithi161.stdout:1/335: rename d19/c66 to d19/d1d/d2c/d2d/d3f/d69/c7a 0 2024-02-22T00:33:18.992 INFO:tasks.workunit.client.1.smithi161.stdout:0/410: write d14/d29/f5c [2326314,116006] 0 2024-02-22T00:33:18.994 INFO:tasks.workunit.client.1.smithi161.stdout:2/317: symlink de/d11/l73 0 2024-02-22T00:33:18.998 INFO:tasks.workunit.client.1.smithi161.stdout:0/411: rename d14/d44/f7f to d14/d37/d42/d73/f91 0 2024-02-22T00:33:19.002 INFO:tasks.workunit.client.1.smithi161.stdout:1/336: link d19/d1d/d2c/d2d/d3f/f67 d19/d51/d64/f7b 0 2024-02-22T00:33:19.002 INFO:tasks.workunit.client.1.smithi161.stdout:1/337: fsync d19/f49 0 2024-02-22T00:33:19.003 INFO:tasks.workunit.client.1.smithi161.stdout:0/412: mkdir d14/d37/d42/d8e/d92 0 2024-02-22T00:33:19.010 INFO:tasks.workunit.client.1.smithi161.stdout:2/318: rmdir de/d11 39 2024-02-22T00:33:19.015 INFO:tasks.workunit.client.1.smithi161.stdout:2/319: creat de/d2b/d65/d3a/d72/f74 x:0 0 0 2024-02-22T00:33:19.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/413: truncate d14/f51 2395584 0 2024-02-22T00:33:19.018 INFO:tasks.workunit.client.1.smithi161.stdout:2/320: creat de/d2b/d65/d3a/f75 x:0 0 0 2024-02-22T00:33:19.022 INFO:tasks.workunit.client.1.smithi161.stdout:1/338: dwrite d19/d1d/d56/f74 [0,4194304] 0 2024-02-22T00:33:19.022 INFO:tasks.workunit.client.1.smithi161.stdout:2/321: write de/d11/f6f [783900,56540] 0 2024-02-22T00:33:19.025 INFO:tasks.workunit.client.1.smithi161.stdout:0/414: rename d14/d1a/l3c to d14/d44/l93 0 2024-02-22T00:33:19.026 INFO:tasks.workunit.client.1.smithi161.stdout:2/322: creat de/d11/d32/f76 x:0 0 0 2024-02-22T00:33:19.028 INFO:tasks.workunit.client.1.smithi161.stdout:0/415: write d14/f82 [882570,19089] 0 2024-02-22T00:33:19.028 INFO:tasks.workunit.client.1.smithi161.stdout:2/323: write de/d11/f1a [3028755,90603] 0 2024-02-22T00:33:19.032 INFO:tasks.workunit.client.1.smithi161.stdout:2/324: symlink de/d11/d14/l77 0 2024-02-22T00:33:19.033 INFO:tasks.workunit.client.1.smithi161.stdout:2/325: fdatasync de/d11/f29 0 2024-02-22T00:33:19.036 INFO:tasks.workunit.client.1.smithi161.stdout:0/416: dwrite f8 [0,4194304] 0 2024-02-22T00:33:19.038 INFO:tasks.workunit.client.1.smithi161.stdout:1/339: truncate d19/f1b 4103156 0 2024-02-22T00:33:19.042 INFO:tasks.workunit.client.1.smithi161.stdout:1/340: symlink d19/d51/l7c 0 2024-02-22T00:33:19.046 INFO:tasks.workunit.client.1.smithi161.stdout:2/326: getdents de/d11/d5c/d33/d35/d4f 0 2024-02-22T00:33:19.048 INFO:tasks.workunit.client.1.smithi161.stdout:9/285: sync 2024-02-22T00:33:19.049 INFO:tasks.workunit.client.1.smithi161.stdout:9/286: chown d1/d5/c20 7 1 2024-02-22T00:33:19.049 INFO:tasks.workunit.client.1.smithi161.stdout:1/341: mkdir d19/d1d/d2c/d7d 0 2024-02-22T00:33:19.051 INFO:tasks.workunit.client.1.smithi161.stdout:2/327: rename de/d2b/d65/d60/d68/f6d to de/d2b/d65/d60/f78 0 2024-02-22T00:33:19.052 INFO:tasks.workunit.client.1.smithi161.stdout:7/271: sync 2024-02-22T00:33:19.052 INFO:tasks.workunit.client.1.smithi161.stdout:3/251: sync 2024-02-22T00:33:19.053 INFO:tasks.workunit.client.1.smithi161.stdout:1/342: symlink d19/d1d/d2c/d2d/d3f/l7e 0 2024-02-22T00:33:19.055 INFO:tasks.workunit.client.1.smithi161.stdout:9/287: creat d1/d5/d9/d33/d4f/f5e x:0 0 0 2024-02-22T00:33:19.056 INFO:tasks.workunit.client.1.smithi161.stdout:9/288: dread - d1/d2/d7/f49 zero size 2024-02-22T00:33:19.058 INFO:tasks.workunit.client.1.smithi161.stdout:3/252: chown da/dc/fd 8668848 1 2024-02-22T00:33:19.060 INFO:tasks.workunit.client.1.smithi161.stdout:2/328: creat de/d2b/d65/f79 x:0 0 0 2024-02-22T00:33:19.063 INFO:tasks.workunit.client.1.smithi161.stdout:1/343: dwrite d19/f26 [0,4194304] 0 2024-02-22T00:33:19.066 INFO:tasks.workunit.client.1.smithi161.stdout:9/289: getdents d1/d2/d4/d11/d21 0 2024-02-22T00:33:19.073 INFO:tasks.workunit.client.1.smithi161.stdout:1/344: creat d19/d1d/d2c/d7d/f7f x:0 0 0 2024-02-22T00:33:19.074 INFO:tasks.workunit.client.1.smithi161.stdout:3/253: dread da/dc/fd [0,4194304] 0 2024-02-22T00:33:19.080 INFO:tasks.workunit.client.1.smithi161.stdout:7/272: dread d3/df/d33/d35/f27 [0,4194304] 0 2024-02-22T00:33:19.080 INFO:tasks.workunit.client.1.smithi161.stdout:1/345: readlink d19/d1d/d2c/l38 0 2024-02-22T00:33:19.082 INFO:tasks.workunit.client.1.smithi161.stdout:2/329: dwrite de/f53 [0,4194304] 0 2024-02-22T00:33:19.082 INFO:tasks.workunit.client.1.smithi161.stdout:0/417: dwrite d14/f51 [0,4194304] 0 2024-02-22T00:33:19.084 INFO:tasks.workunit.client.1.smithi161.stdout:7/273: mkdir d3/d5d 0 2024-02-22T00:33:19.085 INFO:tasks.workunit.client.1.smithi161.stdout:3/254: read - da/dc/d11/d26/d2f/d37/f49 zero size 2024-02-22T00:33:19.085 INFO:tasks.workunit.client.1.smithi161.stdout:1/346: mknod d19/d48/d68/c80 0 2024-02-22T00:33:19.088 INFO:tasks.workunit.client.1.smithi161.stdout:0/418: creat d14/d44/f94 x:0 0 0 2024-02-22T00:33:19.089 INFO:tasks.workunit.client.1.smithi161.stdout:1/347: fdatasync d19/d2f/f4e 0 2024-02-22T00:33:19.092 INFO:tasks.workunit.client.1.smithi161.stdout:2/330: unlink de/d11/d14/l61 0 2024-02-22T00:33:19.092 INFO:tasks.workunit.client.1.smithi161.stdout:9/290: dwrite d1/d2/d7/d3f/f54 [0,4194304] 0 2024-02-22T00:33:19.093 INFO:tasks.workunit.client.1.smithi161.stdout:0/419: chown d14/d1a/l31 1901 1 2024-02-22T00:33:19.095 INFO:tasks.workunit.client.1.smithi161.stdout:3/255: symlink da/l4e 0 2024-02-22T00:33:19.098 INFO:tasks.workunit.client.1.smithi161.stdout:0/420: chown d14/f2c 1375327086 1 2024-02-22T00:33:19.105 INFO:tasks.workunit.client.1.smithi161.stdout:0/421: creat d14/d37/d42/d8e/f95 x:0 0 0 2024-02-22T00:33:19.107 INFO:tasks.workunit.client.1.smithi161.stdout:1/348: dwrite d19/f26 [0,4194304] 0 2024-02-22T00:33:19.107 INFO:tasks.workunit.client.1.smithi161.stdout:2/331: dwrite de/d2b/f5b [0,4194304] 0 2024-02-22T00:33:19.109 INFO:tasks.workunit.client.1.smithi161.stdout:1/349: chown d19/d48 2417 1 2024-02-22T00:33:19.109 INFO:tasks.workunit.client.1.smithi161.stdout:0/422: fdatasync d14/d1a/f79 0 2024-02-22T00:33:19.111 INFO:tasks.workunit.client.1.smithi161.stdout:3/256: unlink da/dc/d11/d26/d2f/d37/l3b 0 2024-02-22T00:33:19.113 INFO:tasks.workunit.client.1.smithi161.stdout:1/350: write d19/d2f/f4c [293629,16146] 0 2024-02-22T00:33:19.113 INFO:tasks.workunit.client.1.smithi161.stdout:9/291: write d1/d2/f1a [9231941,92097] 0 2024-02-22T00:33:19.124 INFO:tasks.workunit.client.1.smithi161.stdout:7/274: dwrite d3/dd/fe [0,4194304] 0 2024-02-22T00:33:19.126 INFO:tasks.workunit.client.1.smithi161.stdout:1/351: truncate d19/d1d/f65 557843 0 2024-02-22T00:33:19.127 INFO:tasks.workunit.client.1.smithi161.stdout:9/292: write d1/d2/d7/da/f42 [33823,124963] 0 2024-02-22T00:33:19.133 INFO:tasks.workunit.client.1.smithi161.stdout:2/332: dwrite de/d11/f63 [0,4194304] 0 2024-02-22T00:33:19.138 INFO:tasks.workunit.client.1.smithi161.stdout:7/275: mknod d3/dd/d59/c5e 0 2024-02-22T00:33:19.138 INFO:tasks.workunit.client.1.smithi161.stdout:0/423: dwrite d14/d29/f5c [0,4194304] 0 2024-02-22T00:33:19.139 INFO:tasks.workunit.client.1.smithi161.stdout:2/333: write de/d11/d5c/d33/d35/f70 [770609,81281] 0 2024-02-22T00:33:19.139 INFO:tasks.workunit.client.1.smithi161.stdout:3/257: dwrite da/dc/f31 [0,4194304] 0 2024-02-22T00:33:19.144 INFO:tasks.workunit.client.1.smithi161.stdout:0/424: chown d14/l20 301 1 2024-02-22T00:33:19.145 INFO:tasks.workunit.client.1.smithi161.stdout:2/334: write de/d11/d5c/d33/d35/f5d [209402,105490] 0 2024-02-22T00:33:19.147 INFO:tasks.workunit.client.1.smithi161.stdout:9/293: mknod d1/d2/d4/d11/c5f 0 2024-02-22T00:33:19.150 INFO:tasks.workunit.client.1.smithi161.stdout:3/258: mkdir da/d4f 0 2024-02-22T00:33:19.150 INFO:tasks.workunit.client.1.smithi161.stdout:0/425: write d14/d37/d42/f86 [169649,31389] 0 2024-02-22T00:33:19.150 INFO:tasks.workunit.client.1.smithi161.stdout:2/335: rmdir de/d11/d5c 39 2024-02-22T00:33:19.153 INFO:tasks.workunit.client.1.smithi161.stdout:9/294: write d1/d2/d7/da/f42 [965144,93562] 0 2024-02-22T00:33:19.154 INFO:tasks.workunit.client.1.smithi161.stdout:2/336: chown de/d2b/d65/c28 164602215 1 2024-02-22T00:33:19.154 INFO:tasks.workunit.client.1.smithi161.stdout:9/295: chown d1/d2/f1a 30 1 2024-02-22T00:33:19.159 INFO:tasks.workunit.client.1.smithi161.stdout:9/296: mkdir d1/d2/d7/d1e/d60 0 2024-02-22T00:33:19.159 INFO:tasks.workunit.client.1.smithi161.stdout:1/352: dwrite d19/d1d/d2c/d4f/f72 [0,4194304] 0 2024-02-22T00:33:19.161 INFO:tasks.workunit.client.1.smithi161.stdout:0/426: mkdir d14/d1a/d3f/d96 0 2024-02-22T00:33:19.162 INFO:tasks.workunit.client.1.smithi161.stdout:1/353: fsync d19/d1d/f57 0 2024-02-22T00:33:19.168 INFO:tasks.workunit.client.1.smithi161.stdout:0/427: write d14/f90 [767249,66556] 0 2024-02-22T00:33:19.171 INFO:tasks.workunit.client.1.smithi161.stdout:0/428: chown l13 72271666 1 2024-02-22T00:33:19.172 INFO:tasks.workunit.client.1.smithi161.stdout:3/259: link da/dc/d11/d26/d2f/d37/l47 da/dc/d11/d26/d2f/d37/l50 0 2024-02-22T00:33:19.174 INFO:tasks.workunit.client.1.smithi161.stdout:1/354: link d19/f46 d19/d48/f81 0 2024-02-22T00:33:19.175 INFO:tasks.workunit.client.1.smithi161.stdout:9/297: dwrite d1/d2/d7/f47 [0,4194304] 0 2024-02-22T00:33:19.176 INFO:tasks.workunit.client.1.smithi161.stdout:3/260: write da/dc/d11/d26/f19 [2054937,13484] 0 2024-02-22T00:33:19.176 INFO:tasks.workunit.client.1.smithi161.stdout:0/429: unlink d14/d1a/d3f/f7c 0 2024-02-22T00:33:19.178 INFO:tasks.workunit.client.1.smithi161.stdout:9/298: fdatasync d1/d5/d9/d33/f32 0 2024-02-22T00:33:19.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:17.756281+0000 mgr.smithi161.sazlam (mgr.24369) 26 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 531 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.0 MiB/s rd, 53 MiB/s wr, 370 op/s 2024-02-22T00:33:19.179 INFO:tasks.workunit.client.1.smithi161.stdout:1/355: symlink d19/d48/l82 0 2024-02-22T00:33:19.182 INFO:tasks.workunit.client.1.smithi161.stdout:3/261: write da/dc/d11/f2e [4320237,90084] 0 2024-02-22T00:33:19.182 INFO:tasks.workunit.client.1.smithi161.stdout:7/276: dread d3/f14 [8388608,4194304] 0 2024-02-22T00:33:19.183 INFO:tasks.workunit.client.1.smithi161.stdout:1/356: creat d19/d1d/d2c/d2d/f83 x:0 0 0 2024-02-22T00:33:19.187 INFO:tasks.workunit.client.1.smithi161.stdout:8/283: sync 2024-02-22T00:33:19.187 INFO:tasks.workunit.client.1.smithi161.stdout:4/306: sync 2024-02-22T00:33:19.188 INFO:tasks.workunit.client.1.smithi161.stdout:1/357: fdatasync f9 0 2024-02-22T00:33:19.194 INFO:tasks.workunit.client.1.smithi161.stdout:1/358: write f5 [2507419,123210] 0 2024-02-22T00:33:19.194 INFO:tasks.workunit.client.1.smithi161.stdout:8/284: creat d1/d1c/f54 x:0 0 0 2024-02-22T00:33:19.196 INFO:tasks.workunit.client.1.smithi161.stdout:9/299: dread d1/d2/d4/d1f/f35 [0,4194304] 0 2024-02-22T00:33:19.204 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:17.756281+0000 mgr.smithi161.sazlam (mgr.24369) 26 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 531 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.0 MiB/s rd, 53 MiB/s wr, 370 op/s 2024-02-22T00:33:19.208 INFO:tasks.workunit.client.1.smithi161.stdout:8/285: mknod d1/d1c/d20/d22/d3f/c55 0 2024-02-22T00:33:19.209 INFO:tasks.workunit.client.1.smithi161.stdout:0/430: dwrite d14/d29/f68 [0,4194304] 0 2024-02-22T00:33:19.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/277: dwrite d3/f37 [0,4194304] 0 2024-02-22T00:33:19.212 INFO:tasks.workunit.client.1.smithi161.stdout:9/300: write d1/d5/d9/f4a [696160,88982] 0 2024-02-22T00:33:19.219 INFO:tasks.workunit.client.1.smithi161.stdout:8/286: creat d1/d2f/f56 x:0 0 0 2024-02-22T00:33:19.220 INFO:tasks.workunit.client.1.smithi161.stdout:3/262: dwrite da/d29/f32 [0,4194304] 0 2024-02-22T00:33:19.221 INFO:tasks.workunit.client.1.smithi161.stdout:0/431: readlink d14/d37/d42/l46 0 2024-02-22T00:33:19.224 INFO:tasks.workunit.client.1.smithi161.stdout:4/307: dwrite d5/d17/f31 [8388608,4194304] 0 2024-02-22T00:33:19.224 INFO:tasks.workunit.client.1.smithi161.stdout:7/278: write d3/f17 [586519,118045] 0 2024-02-22T00:33:19.229 INFO:tasks.workunit.client.1.smithi161.stdout:8/287: truncate d1/f29 2671132 0 2024-02-22T00:33:19.230 INFO:tasks.workunit.client.1.smithi161.stdout:4/308: mknod d5/d10/c70 0 2024-02-22T00:33:19.230 INFO:tasks.workunit.client.1.smithi161.stdout:0/432: rename d14/f90 to d14/d37/f97 0 2024-02-22T00:33:19.234 INFO:tasks.workunit.client.1.smithi161.stdout:1/359: dread d19/d1d/d2c/d2d/d3f/d69/f70 [0,4194304] 0 2024-02-22T00:33:19.236 INFO:tasks.workunit.client.1.smithi161.stdout:7/279: symlink d3/dd/d59/d5b/d26/l5f 0 2024-02-22T00:33:19.236 INFO:tasks.workunit.client.1.smithi161.stdout:0/433: fsync d14/f35 0 2024-02-22T00:33:19.238 INFO:tasks.workunit.client.1.smithi161.stdout:3/263: link da/dc/d11/d26/d2f/d37/d39/f3d da/dc/f51 0 2024-02-22T00:33:19.241 INFO:tasks.workunit.client.1.smithi161.stdout:4/309: symlink d5/d10/d14/d24/d28/d63/l71 0 2024-02-22T00:33:19.242 INFO:tasks.workunit.client.1.smithi161.stdout:9/301: dwrite d1/d5/d9/d33/d4f/f5e [0,4194304] 0 2024-02-22T00:33:19.242 INFO:tasks.workunit.client.1.smithi161.stdout:1/360: mkdir d19/d1d/d2c/d4f/d84 0 2024-02-22T00:33:19.245 INFO:tasks.workunit.client.1.smithi161.stdout:7/280: mkdir d3/dd/d60 0 2024-02-22T00:33:19.251 INFO:tasks.workunit.client.1.smithi161.stdout:1/361: unlink d19/d51/f76 0 2024-02-22T00:33:19.253 INFO:tasks.workunit.client.1.smithi161.stdout:1/362: write d19/d1d/d2c/d2d/f40 [4145772,79632] 0 2024-02-22T00:33:19.253 INFO:tasks.workunit.client.1.smithi161.stdout:8/288: rename d1/d19/d18/f26 to d1/d1c/d20/d31/f57 0 2024-02-22T00:33:19.254 INFO:tasks.workunit.client.1.smithi161.stdout:1/363: chown d19/d1d/d2c/d2d/d3f/c4b 117851 1 2024-02-22T00:33:19.261 INFO:tasks.workunit.client.1.smithi161.stdout:4/310: dread d5/d8/f9 [0,4194304] 0 2024-02-22T00:33:19.261 INFO:tasks.workunit.client.1.smithi161.stdout:3/264: rename da/dc/fd to da/dc/d11/d26/f52 0 2024-02-22T00:33:19.263 INFO:tasks.workunit.client.1.smithi161.stdout:3/265: write da/dc/d11/d26/d2f/d37/f49 [282573,77049] 0 2024-02-22T00:33:19.263 INFO:tasks.workunit.client.1.smithi161.stdout:9/302: creat d1/d2/d7/d1e/d60/f61 x:0 0 0 2024-02-22T00:33:19.264 INFO:tasks.workunit.client.1.smithi161.stdout:1/364: mkdir d19/d85 0 2024-02-22T00:33:19.267 INFO:tasks.workunit.client.1.smithi161.stdout:3/266: mkdir da/d29/d53 0 2024-02-22T00:33:19.269 INFO:tasks.workunit.client.1.smithi161.stdout:0/434: truncate d14/d29/f68 288607 0 2024-02-22T00:33:19.270 INFO:tasks.workunit.client.1.smithi161.stdout:4/311: mkdir d5/d8/d41/d53/d6c/d72 0 2024-02-22T00:33:19.271 INFO:tasks.workunit.client.1.smithi161.stdout:1/365: symlink d19/d51/d6c/l86 0 2024-02-22T00:33:19.272 INFO:tasks.workunit.client.1.smithi161.stdout:9/303: dwrite d1/d2/d7/d3f/f54 [0,4194304] 0 2024-02-22T00:33:19.272 INFO:tasks.workunit.client.1.smithi161.stdout:3/267: creat da/d29/f54 x:0 0 0 2024-02-22T00:33:19.276 INFO:tasks.workunit.client.1.smithi161.stdout:3/268: creat da/dc/d11/f55 x:0 0 0 2024-02-22T00:33:19.276 INFO:tasks.workunit.client.1.smithi161.stdout:0/435: dread d14/d1a/f1b [0,4194304] 0 2024-02-22T00:33:19.277 INFO:tasks.workunit.client.1.smithi161.stdout:3/269: readlink da/dc/d11/d26/d2f/d37/l4a 0 2024-02-22T00:33:19.279 INFO:tasks.workunit.client.1.smithi161.stdout:4/312: mknod d5/d10/d14/d24/c73 0 2024-02-22T00:33:19.279 INFO:tasks.workunit.client.1.smithi161.stdout:1/366: mkdir d19/d85/d87 0 2024-02-22T00:33:19.285 INFO:tasks.workunit.client.1.smithi161.stdout:9/304: dread d1/d2/d4/d11/f28 [0,4194304] 0 2024-02-22T00:33:19.285 INFO:tasks.workunit.client.1.smithi161.stdout:0/436: rename d14/d37/d42/f86 to d14/d37/d42/d8e/f98 0 2024-02-22T00:33:19.285 INFO:tasks.workunit.client.1.smithi161.stdout:9/305: read d1/d2/d4/d11/f28 [102545,122580] 0 2024-02-22T00:33:19.285 INFO:tasks.workunit.client.1.smithi161.stdout:3/270: mkdir da/d56 0 2024-02-22T00:33:19.285 INFO:tasks.workunit.client.1.smithi161.stdout:9/306: chown d1/d5/d9/f4a 51311471 1 2024-02-22T00:33:19.285 INFO:tasks.workunit.client.1.smithi161.stdout:1/367: symlink d19/d51/d6c/l88 0 2024-02-22T00:33:19.286 INFO:tasks.workunit.client.1.smithi161.stdout:4/313: mknod d5/d10/d14/d24/c74 0 2024-02-22T00:33:19.287 INFO:tasks.workunit.client.1.smithi161.stdout:0/437: getdents d14/d37/d42/d8e/d92 0 2024-02-22T00:33:19.287 INFO:tasks.workunit.client.1.smithi161.stdout:0/438: readlink d14/d1a/l3b 0 2024-02-22T00:33:19.288 INFO:tasks.workunit.client.1.smithi161.stdout:4/314: mkdir d5/d10/d75 0 2024-02-22T00:33:19.290 INFO:tasks.workunit.client.1.smithi161.stdout:9/307: creat d1/d5/f62 x:0 0 0 2024-02-22T00:33:19.293 INFO:tasks.workunit.client.1.smithi161.stdout:9/308: unlink d1/d2/d7/f49 0 2024-02-22T00:33:19.295 INFO:tasks.workunit.client.1.smithi161.stdout:4/315: creat d5/d8/f76 x:0 0 0 2024-02-22T00:33:19.303 INFO:tasks.workunit.client.1.smithi161.stdout:4/316: dwrite d5/d10/d14/d24/d28/d63/f69 [0,4194304] 0 2024-02-22T00:33:19.304 INFO:tasks.workunit.client.1.smithi161.stdout:9/309: dread d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:19.305 INFO:tasks.workunit.client.1.smithi161.stdout:9/310: rename d1/d25 to d1/d25/d63 22 2024-02-22T00:33:19.306 INFO:tasks.workunit.client.1.smithi161.stdout:1/368: truncate f5 727879 0 2024-02-22T00:33:19.308 INFO:tasks.workunit.client.1.smithi161.stdout:9/311: stat d1/d2/d4/l4e 0 2024-02-22T00:33:19.309 INFO:tasks.workunit.client.1.smithi161.stdout:1/369: read d19/f26 [6326572,87225] 0 2024-02-22T00:33:19.313 INFO:tasks.workunit.client.1.smithi161.stdout:9/312: write d1/d2/d4/d1f/f35 [1976445,61752] 0 2024-02-22T00:33:19.315 INFO:tasks.workunit.client.1.smithi161.stdout:9/313: write d1/d5/d9/f4a [1276281,117215] 0 2024-02-22T00:33:19.315 INFO:tasks.workunit.client.1.smithi161.stdout:1/370: mknod d19/d51/d6c/c89 0 2024-02-22T00:33:19.316 INFO:tasks.workunit.client.1.smithi161.stdout:9/314: chown d1/l57 1 1 2024-02-22T00:33:19.317 INFO:tasks.workunit.client.1.smithi161.stdout:4/317: link d5/d10/f4d d5/d10/d14/d24/f77 0 2024-02-22T00:33:19.319 INFO:tasks.workunit.client.1.smithi161.stdout:9/315: mknod d1/d5/d9/d33/c64 0 2024-02-22T00:33:19.321 INFO:tasks.workunit.client.1.smithi161.stdout:1/371: link d19/d2f/f54 d19/f8a 0 2024-02-22T00:33:19.322 INFO:tasks.workunit.client.1.smithi161.stdout:4/318: creat d5/d10/d14/d24/d28/d63/d6b/f78 x:0 0 0 2024-02-22T00:33:19.324 INFO:tasks.workunit.client.1.smithi161.stdout:9/316: creat d1/d2/f65 x:0 0 0 2024-02-22T00:33:19.326 INFO:tasks.workunit.client.1.smithi161.stdout:4/319: creat d5/d10/d14/d4f/f79 x:0 0 0 2024-02-22T00:33:19.328 INFO:tasks.workunit.client.1.smithi161.stdout:4/320: creat d5/d10/d14/f7a x:0 0 0 2024-02-22T00:33:19.328 INFO:tasks.workunit.client.1.smithi161.stdout:9/317: dread d1/d2/d4/d11/f31 [0,4194304] 0 2024-02-22T00:33:19.329 INFO:tasks.workunit.client.1.smithi161.stdout:9/318: chown d1/c4d 146 1 2024-02-22T00:33:19.330 INFO:tasks.workunit.client.1.smithi161.stdout:4/321: creat d5/d17/d5c/f7b x:0 0 0 2024-02-22T00:33:19.335 INFO:tasks.workunit.client.1.smithi161.stdout:4/322: link f0 d5/d10/d14/d24/d28/f7c 0 2024-02-22T00:33:19.336 INFO:tasks.workunit.client.1.smithi161.stdout:9/319: link d1/c4d d1/d2/d4/d11/d21/c66 0 2024-02-22T00:33:19.339 INFO:tasks.workunit.client.1.smithi161.stdout:9/320: creat d1/d4b/f67 x:0 0 0 2024-02-22T00:33:19.340 INFO:tasks.workunit.client.1.smithi161.stdout:4/323: dread f2 [0,4194304] 0 2024-02-22T00:33:19.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/321: fdatasync d1/d2/d7/f16 0 2024-02-22T00:33:19.342 INFO:tasks.workunit.client.1.smithi161.stdout:9/322: write d1/d25/f5b [8893607,34272] 0 2024-02-22T00:33:19.346 INFO:tasks.workunit.client.1.smithi161.stdout:6/249: sync 2024-02-22T00:33:19.346 INFO:tasks.workunit.client.1.smithi161.stdout:5/435: sync 2024-02-22T00:33:19.347 INFO:tasks.workunit.client.1.smithi161.stdout:9/323: mkdir d1/d2/d7/d3f/d68 0 2024-02-22T00:33:19.347 INFO:tasks.workunit.client.1.smithi161.stdout:4/324: creat d5/f7d x:0 0 0 2024-02-22T00:33:19.353 INFO:tasks.workunit.client.1.smithi161.stdout:4/325: fdatasync d5/d8/f9 0 2024-02-22T00:33:19.358 INFO:tasks.workunit.client.1.smithi161.stdout:9/324: dwrite d1/d2/d4/d11/f31 [0,4194304] 0 2024-02-22T00:33:19.359 INFO:tasks.workunit.client.1.smithi161.stdout:9/325: stat d1/d5/d9/f4a 0 2024-02-22T00:33:19.360 INFO:tasks.workunit.client.1.smithi161.stdout:4/326: symlink d5/d17/d5c/l7e 0 2024-02-22T00:33:19.361 INFO:tasks.workunit.client.1.smithi161.stdout:5/436: creat d3/f95 x:0 0 0 2024-02-22T00:33:19.363 INFO:tasks.workunit.client.1.smithi161.stdout:9/326: mknod d1/d2/d4/c69 0 2024-02-22T00:33:19.363 INFO:tasks.workunit.client.1.smithi161.stdout:6/250: dwrite d3/d10/d12/f2d [0,4194304] 0 2024-02-22T00:33:19.367 INFO:tasks.workunit.client.1.smithi161.stdout:4/327: symlink d5/d10/d75/l7f 0 2024-02-22T00:33:19.369 INFO:tasks.workunit.client.1.smithi161.stdout:5/437: mkdir d3/d1b/d91/d96 0 2024-02-22T00:33:19.372 INFO:tasks.workunit.client.1.smithi161.stdout:4/328: fsync d5/d10/d14/d24/d28/f7c 0 2024-02-22T00:33:19.373 INFO:tasks.workunit.client.1.smithi161.stdout:6/251: mknod d3/d10/d1b/c4c 0 2024-02-22T00:33:19.374 INFO:tasks.workunit.client.1.smithi161.stdout:6/252: readlink d3/dc/df/d32/l49 0 2024-02-22T00:33:19.375 INFO:tasks.workunit.client.1.smithi161.stdout:5/438: dread d3/d1b/d36/f52 [0,4194304] 0 2024-02-22T00:33:19.376 INFO:tasks.workunit.client.1.smithi161.stdout:9/327: creat d1/d2/d7/f6a x:0 0 0 2024-02-22T00:33:19.377 INFO:tasks.workunit.client.1.smithi161.stdout:9/328: stat d1/d2/d4/d11/d21/c39 0 2024-02-22T00:33:19.378 INFO:tasks.workunit.client.1.smithi161.stdout:5/439: creat d3/d1b/d36/d88/f97 x:0 0 0 2024-02-22T00:33:19.383 INFO:tasks.workunit.client.1.smithi161.stdout:5/440: symlink d3/d1b/d25/d84/l98 0 2024-02-22T00:33:19.383 INFO:tasks.workunit.client.1.smithi161.stdout:9/329: link d1/d2/c48 d1/d2/d7/d1e/d60/c6b 0 2024-02-22T00:33:19.386 INFO:tasks.workunit.client.1.smithi161.stdout:9/330: write d1/d2/d4/d11/d21/f46 [58865,97897] 0 2024-02-22T00:33:19.392 INFO:tasks.workunit.client.1.smithi161.stdout:9/331: creat d1/d5/d9/d33/d4f/f6c x:0 0 0 2024-02-22T00:33:19.394 INFO:tasks.workunit.client.1.smithi161.stdout:5/441: dwrite d3/d1c/d20/f35 [0,4194304] 0 2024-02-22T00:33:19.394 INFO:tasks.workunit.client.1.smithi161.stdout:4/329: dread d5/d10/d14/d24/d28/f7c [0,4194304] 0 2024-02-22T00:33:19.396 INFO:tasks.workunit.client.1.smithi161.stdout:5/442: readlink d3/d1b/d36/l82 0 2024-02-22T00:33:19.400 INFO:tasks.workunit.client.1.smithi161.stdout:5/443: rmdir d3/d1c 39 2024-02-22T00:33:19.403 INFO:tasks.workunit.client.1.smithi161.stdout:6/253: dwrite d3/dc/f2b [0,4194304] 0 2024-02-22T00:33:19.408 INFO:tasks.workunit.client.1.smithi161.stdout:5/444: rename d3/d29/c77 to d3/d29/d80/c99 0 2024-02-22T00:33:19.408 INFO:tasks.workunit.client.1.smithi161.stdout:9/332: dwrite d1/d2/f65 [0,4194304] 0 2024-02-22T00:33:19.408 INFO:tasks.workunit.client.1.smithi161.stdout:6/254: symlink d3/d10/d12/d3a/l4d 0 2024-02-22T00:33:19.409 INFO:tasks.workunit.client.1.smithi161.stdout:9/333: readlink d1/d2/d7/l19 0 2024-02-22T00:33:19.410 INFO:tasks.workunit.client.1.smithi161.stdout:4/330: dread d5/d10/d14/d24/d28/d63/f69 [0,4194304] 0 2024-02-22T00:33:19.410 INFO:tasks.workunit.client.1.smithi161.stdout:6/255: write d3/dc/f2b [3016297,125849] 0 2024-02-22T00:33:19.412 INFO:tasks.workunit.client.1.smithi161.stdout:4/331: fdatasync d5/d10/d14/d24/d28/d63/d6b/f78 0 2024-02-22T00:33:19.417 INFO:tasks.workunit.client.1.smithi161.stdout:5/445: dwrite d3/d1c/d20/f12 [0,4194304] 0 2024-02-22T00:33:19.418 INFO:tasks.workunit.client.1.smithi161.stdout:9/334: creat d1/d2/f6d x:0 0 0 2024-02-22T00:33:19.419 INFO:tasks.workunit.client.1.smithi161.stdout:4/332: creat d5/d8/f80 x:0 0 0 2024-02-22T00:33:19.419 INFO:tasks.workunit.client.1.smithi161.stdout:6/256: dread d3/d10/fa [0,4194304] 0 2024-02-22T00:33:19.420 INFO:tasks.workunit.client.1.smithi161.stdout:5/446: read d3/d1c/d20/f54 [4816176,63694] 0 2024-02-22T00:33:19.421 INFO:tasks.workunit.client.1.smithi161.stdout:9/335: truncate d1/d5/f59 315420 0 2024-02-22T00:33:19.421 INFO:tasks.workunit.client.1.smithi161.stdout:5/447: stat d3/d1c/f79 0 2024-02-22T00:33:19.422 INFO:tasks.workunit.client.1.smithi161.stdout:6/257: mknod d3/dc/df/c4e 0 2024-02-22T00:33:19.424 INFO:tasks.workunit.client.1.smithi161.stdout:5/448: creat d3/d1c/d20/d74/f9a x:0 0 0 2024-02-22T00:33:19.425 INFO:tasks.workunit.client.1.smithi161.stdout:4/333: creat d5/d8/f81 x:0 0 0 2024-02-22T00:33:19.427 INFO:tasks.workunit.client.1.smithi161.stdout:4/334: fsync d5/d10/d14/d24/d28/d63/d6b/f78 0 2024-02-22T00:33:19.428 INFO:tasks.workunit.client.1.smithi161.stdout:4/335: truncate d5/d8/f81 768408 0 2024-02-22T00:33:19.429 INFO:tasks.workunit.client.1.smithi161.stdout:6/258: getdents d3/d48 0 2024-02-22T00:33:19.431 INFO:tasks.workunit.client.1.smithi161.stdout:4/336: rename d5/d10/d14 to d5/d10/d14/d24/d82 22 2024-02-22T00:33:19.432 INFO:tasks.workunit.client.1.smithi161.stdout:6/259: stat d3/d10/d12/c3b 0 2024-02-22T00:33:19.433 INFO:tasks.workunit.client.1.smithi161.stdout:5/449: link d3/d1b/d36/c3f d3/d29/d80/c9b 0 2024-02-22T00:33:19.433 INFO:tasks.workunit.client.1.smithi161.stdout:6/260: fdatasync d3/dc/f41 0 2024-02-22T00:33:19.434 INFO:tasks.workunit.client.1.smithi161.stdout:6/261: fdatasync d3/f6 0 2024-02-22T00:33:19.435 INFO:tasks.workunit.client.1.smithi161.stdout:5/450: write d3/d1c/d20/f71 [695717,79572] 0 2024-02-22T00:33:19.435 INFO:tasks.workunit.client.1.smithi161.stdout:4/337: rename d5/d10/d14/d24/d28/d38/d6d/c6f to d5/d17/c83 0 2024-02-22T00:33:19.436 INFO:tasks.workunit.client.1.smithi161.stdout:5/451: truncate d3/d1c/f7d 196711 0 2024-02-22T00:33:19.437 INFO:tasks.workunit.client.1.smithi161.stdout:6/262: mknod d3/d30/c4f 0 2024-02-22T00:33:19.439 INFO:tasks.workunit.client.1.smithi161.stdout:6/263: read - d3/d10/d1b/f47 zero size 2024-02-22T00:33:19.445 INFO:tasks.workunit.client.1.smithi161.stdout:4/338: dwrite d5/d8/d41/f54 [0,4194304] 0 2024-02-22T00:33:19.447 INFO:tasks.workunit.client.1.smithi161.stdout:5/452: dwrite d3/d1b/d25/f6c [0,4194304] 0 2024-02-22T00:33:19.449 INFO:tasks.workunit.client.1.smithi161.stdout:4/339: mknod d5/d17/c84 0 2024-02-22T00:33:19.452 INFO:tasks.workunit.client.1.smithi161.stdout:4/340: truncate d5/d8/f76 860691 0 2024-02-22T00:33:19.457 INFO:tasks.workunit.client.1.smithi161.stdout:5/453: dwrite d3/d1b/d25/f5c [8388608,4194304] 0 2024-02-22T00:33:19.459 INFO:tasks.workunit.client.1.smithi161.stdout:4/341: dread d5/d10/f1f [4194304,4194304] 0 2024-02-22T00:33:19.465 INFO:tasks.workunit.client.1.smithi161.stdout:4/342: dread d5/d10/f26 [0,4194304] 0 2024-02-22T00:33:19.466 INFO:tasks.workunit.client.1.smithi161.stdout:4/343: chown d5/d17/f1e 464196544 1 2024-02-22T00:33:19.470 INFO:tasks.workunit.client.1.smithi161.stdout:4/344: rename d5/d10/d14/d24/d28/d63/f69 to d5/d10/d14/d24/d28/d38/f85 0 2024-02-22T00:33:19.470 INFO:tasks.workunit.client.1.smithi161.stdout:4/345: chown f3 15690461 1 2024-02-22T00:33:19.472 INFO:tasks.workunit.client.1.smithi161.stdout:4/346: creat d5/d10/d14/d24/d28/d63/f86 x:0 0 0 2024-02-22T00:33:19.478 INFO:tasks.workunit.client.1.smithi161.stdout:5/454: dread d3/d1b/d36/f5e [0,4194304] 0 2024-02-22T00:33:19.479 INFO:tasks.workunit.client.1.smithi161.stdout:5/455: write d3/d1c/d20/f73 [767299,79226] 0 2024-02-22T00:33:19.482 INFO:tasks.workunit.client.1.smithi161.stdout:5/456: mkdir d3/d9c 0 2024-02-22T00:33:19.485 INFO:tasks.workunit.client.1.smithi161.stdout:4/347: dwrite d5/d10/d14/d24/f3c [0,4194304] 0 2024-02-22T00:33:19.492 INFO:tasks.workunit.client.1.smithi161.stdout:5/457: dread d3/d1c/d20/f12 [0,4194304] 0 2024-02-22T00:33:19.492 INFO:tasks.workunit.client.1.smithi161.stdout:4/348: rename d5/d10/d14/d24/f3c to d5/d10/d14/d24/d28/f87 0 2024-02-22T00:33:19.501 INFO:tasks.workunit.client.1.smithi161.stdout:5/458: dwrite d3/d1c/f7d [0,4194304] 0 2024-02-22T00:33:19.506 INFO:tasks.workunit.client.1.smithi161.stdout:5/459: link d3/f72 d3/d29/d80/d92/f9d 0 2024-02-22T00:33:19.510 INFO:tasks.workunit.client.1.smithi161.stdout:5/460: mknod d3/d1b/d25/c9e 0 2024-02-22T00:33:19.510 INFO:tasks.workunit.client.1.smithi161.stdout:5/461: rename d3/d1c/d20 to d3/d1c/d20/d9f 22 2024-02-22T00:33:19.513 INFO:tasks.workunit.client.1.smithi161.stdout:5/462: rename d3/d1b/c2f to d3/d1c/d20/ca0 0 2024-02-22T00:33:19.514 INFO:tasks.workunit.client.1.smithi161.stdout:5/463: write d3/d1c/d20/d74/d8b/f8e [94493,85799] 0 2024-02-22T00:33:19.518 INFO:tasks.workunit.client.1.smithi161.stdout:5/464: rmdir d3/d1c/d62/d8a 0 2024-02-22T00:33:19.521 INFO:tasks.workunit.client.1.smithi161.stdout:4/349: truncate d5/d8/d41/d57/f60 2125279 0 2024-02-22T00:33:19.522 INFO:tasks.workunit.client.1.smithi161.stdout:5/465: write d3/d1b/d36/f4d [3556307,112169] 0 2024-02-22T00:33:19.522 INFO:tasks.workunit.client.1.smithi161.stdout:5/466: chown l0 39639 1 2024-02-22T00:33:19.523 INFO:tasks.workunit.client.1.smithi161.stdout:5/467: write d3/f95 [27197,39925] 0 2024-02-22T00:33:19.527 INFO:tasks.workunit.client.1.smithi161.stdout:5/468: dread d3/d1c/d20/d74/d8b/f8e [0,4194304] 0 2024-02-22T00:33:19.529 INFO:tasks.workunit.client.1.smithi161.stdout:4/350: dwrite d5/d8/d41/f54 [0,4194304] 0 2024-02-22T00:33:19.529 INFO:tasks.workunit.client.1.smithi161.stdout:4/351: chown f3 730070 1 2024-02-22T00:33:19.531 INFO:tasks.workunit.client.1.smithi161.stdout:5/469: creat d3/d1b/d25/d4c/d7b/fa1 x:0 0 0 2024-02-22T00:33:19.532 INFO:tasks.workunit.client.1.smithi161.stdout:5/470: write d3/d1c/d20/f54 [5283046,96103] 0 2024-02-22T00:33:19.537 INFO:tasks.workunit.client.1.smithi161.stdout:5/471: rename d3/d1b/d25/d4c/f51 to d3/d1c/d67/fa2 0 2024-02-22T00:33:19.540 INFO:tasks.workunit.client.1.smithi161.stdout:4/352: creat d5/d10/d14/d24/f88 x:0 0 0 2024-02-22T00:33:19.541 INFO:tasks.workunit.client.1.smithi161.stdout:4/353: read d5/d8/f76 [64835,24148] 0 2024-02-22T00:33:19.544 INFO:tasks.workunit.client.1.smithi161.stdout:4/354: dread d5/d8/f81 [0,4194304] 0 2024-02-22T00:33:19.550 INFO:tasks.workunit.client.1.smithi161.stdout:4/355: rename d5/d10/d14/l40 to d5/d8/d41/d53/l89 0 2024-02-22T00:33:19.550 INFO:tasks.workunit.client.1.smithi161.stdout:5/472: dwrite d3/d1b/d36/f52 [4194304,4194304] 0 2024-02-22T00:33:19.560 INFO:tasks.workunit.client.1.smithi161.stdout:4/356: dwrite d5/d10/d14/d24/d28/f2d [4194304,4194304] 0 2024-02-22T00:33:19.561 INFO:tasks.workunit.client.1.smithi161.stdout:4/357: chown d5/l21 254590 1 2024-02-22T00:33:19.563 INFO:tasks.workunit.client.1.smithi161.stdout:4/358: dread - d5/f5b zero size 2024-02-22T00:33:19.565 INFO:tasks.workunit.client.1.smithi161.stdout:5/473: write d3/f72 [474865,125692] 0 2024-02-22T00:33:19.570 INFO:tasks.workunit.client.1.smithi161.stdout:5/474: rename d3/d1c/f2d to d3/d29/fa3 0 2024-02-22T00:33:19.572 INFO:tasks.workunit.client.1.smithi161.stdout:4/359: getdents d5/d10/d14/d24/d28/d63/d65 0 2024-02-22T00:33:19.573 INFO:tasks.workunit.client.1.smithi161.stdout:5/475: creat d3/d1c/d20/d74/fa4 x:0 0 0 2024-02-22T00:33:19.589 INFO:tasks.workunit.client.1.smithi161.stdout:4/360: dread d5/f27 [0,4194304] 0 2024-02-22T00:33:19.591 INFO:tasks.workunit.client.1.smithi161.stdout:4/361: creat d5/d10/d14/d24/d28/f8a x:0 0 0 2024-02-22T00:33:19.596 INFO:tasks.workunit.client.1.smithi161.stdout:4/362: rename d5/d10/d14/d24/f42 to d5/d8/d41/f8b 0 2024-02-22T00:33:19.604 INFO:tasks.workunit.client.1.smithi161.stdout:4/363: truncate d5/d10/f1b 1725251 0 2024-02-22T00:33:19.606 INFO:tasks.workunit.client.1.smithi161.stdout:4/364: mknod d5/d10/d14/d24/d28/d63/d65/c8c 0 2024-02-22T00:33:19.609 INFO:tasks.workunit.client.1.smithi161.stdout:4/365: rename d5/d10/d75/l7f to d5/d10/d14/d24/d28/d38/l8d 0 2024-02-22T00:33:19.619 INFO:tasks.workunit.client.1.smithi161.stdout:4/366: dread d5/d8/d41/d57/f60 [0,4194304] 0 2024-02-22T00:33:19.630 INFO:tasks.workunit.client.1.smithi161.stdout:4/367: dwrite d5/d10/f1d [0,4194304] 0 2024-02-22T00:33:19.635 INFO:tasks.workunit.client.1.smithi161.stdout:4/368: rename d5/f6 to d5/d8/d41/d53/d6c/d72/f8e 0 2024-02-22T00:33:19.638 INFO:tasks.workunit.client.1.smithi161.stdout:4/369: truncate f3 1628628 0 2024-02-22T00:33:19.639 INFO:tasks.workunit.client.1.smithi161.stdout:4/370: chown d5/d8/d41/d57/c5e 0 1 2024-02-22T00:33:19.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/371: fdatasync d5/d10/f4d 0 2024-02-22T00:33:19.645 INFO:tasks.workunit.client.1.smithi161.stdout:4/372: dread d5/f7 [0,4194304] 0 2024-02-22T00:33:19.646 INFO:tasks.workunit.client.1.smithi161.stdout:4/373: chown d5/f7d 649 1 2024-02-22T00:33:19.654 INFO:tasks.workunit.client.1.smithi161.stdout:4/374: dwrite d5/d10/d14/d24/d28/f7c [0,4194304] 0 2024-02-22T00:33:19.656 INFO:tasks.workunit.client.1.smithi161.stdout:4/375: fsync d5/d10/d14/d24/d28/d63/f86 0 2024-02-22T00:33:19.657 INFO:tasks.workunit.client.1.smithi161.stdout:4/376: chown d5/d17/d5c/l7e 10 1 2024-02-22T00:33:19.667 INFO:tasks.workunit.client.1.smithi161.stdout:7/281: sync 2024-02-22T00:33:19.668 INFO:tasks.workunit.client.1.smithi161.stdout:2/337: sync 2024-02-22T00:33:19.669 INFO:tasks.workunit.client.1.smithi161.stdout:2/338: write de/d2b/d65/d60/d68/f6c [970606,12643] 0 2024-02-22T00:33:19.671 INFO:tasks.workunit.client.1.smithi161.stdout:7/282: creat d3/dd/d59/d5b/d26/d50/f61 x:0 0 0 2024-02-22T00:33:19.671 INFO:tasks.workunit.client.1.smithi161.stdout:2/339: readlink de/d11/l58 0 2024-02-22T00:33:19.672 INFO:tasks.workunit.client.1.smithi161.stdout:2/340: readlink de/d2b/l3b 0 2024-02-22T00:33:19.676 INFO:tasks.workunit.client.1.smithi161.stdout:2/341: getdents de/d2b/d65/d60/d68 0 2024-02-22T00:33:19.683 INFO:tasks.workunit.client.1.smithi161.stdout:2/342: dwrite de/d2b/f2d [0,4194304] 0 2024-02-22T00:33:19.685 INFO:tasks.workunit.client.1.smithi161.stdout:7/283: dread d3/dd/d59/d5b/d26/d30/f3b [0,4194304] 0 2024-02-22T00:33:19.687 INFO:tasks.workunit.client.1.smithi161.stdout:2/343: unlink de/d11/f6f 0 2024-02-22T00:33:19.687 INFO:tasks.workunit.client.1.smithi161.stdout:7/284: fsync f2 0 2024-02-22T00:33:19.693 INFO:tasks.workunit.client.1.smithi161.stdout:2/344: dwrite f8 [0,4194304] 0 2024-02-22T00:33:19.699 INFO:tasks.workunit.client.1.smithi161.stdout:2/345: rename de/d11/d14/f42 to de/d2b/d65/d60/d68/f7a 0 2024-02-22T00:33:19.705 INFO:tasks.workunit.client.1.smithi161.stdout:2/346: link de/d11/d5c/d33/c4c de/d2b/d65/d60/d68/c7b 0 2024-02-22T00:33:19.711 INFO:tasks.workunit.client.1.smithi161.stdout:2/347: dwrite de/d11/f59 [0,4194304] 0 2024-02-22T00:33:19.712 INFO:tasks.workunit.client.1.smithi161.stdout:2/348: write de/d11/d5c/f30 [99751,87314] 0 2024-02-22T00:33:19.714 INFO:tasks.workunit.client.1.smithi161.stdout:2/349: chown de/c10 3035800 1 2024-02-22T00:33:19.716 INFO:tasks.workunit.client.1.smithi161.stdout:2/350: creat de/d2b/d65/d3a/f7c x:0 0 0 2024-02-22T00:33:19.717 INFO:tasks.workunit.client.1.smithi161.stdout:2/351: write f3 [6919468,26055] 0 2024-02-22T00:33:19.720 INFO:tasks.workunit.client.1.smithi161.stdout:2/352: dread de/d11/d5c/d33/d35/f5d [0,4194304] 0 2024-02-22T00:33:19.721 INFO:tasks.workunit.client.1.smithi161.stdout:2/353: dread - de/d2b/d65/d3a/f7c zero size 2024-02-22T00:33:19.723 INFO:tasks.workunit.client.1.smithi161.stdout:2/354: write de/d11/d5c/d33/f6b [314378,42219] 0 2024-02-22T00:33:19.726 INFO:tasks.workunit.client.1.smithi161.stdout:2/355: chown de/d11/d5c/d33/c4c 52 1 2024-02-22T00:33:19.827 INFO:tasks.workunit.client.1.smithi161.stdout:3/271: sync 2024-02-22T00:33:19.827 INFO:tasks.workunit.client.1.smithi161.stdout:8/289: sync 2024-02-22T00:33:19.829 INFO:tasks.workunit.client.1.smithi161.stdout:8/290: mknod d1/d1c/d20/d22/d28/c58 0 2024-02-22T00:33:19.832 INFO:tasks.workunit.client.1.smithi161.stdout:8/291: unlink d1/d2f/f56 0 2024-02-22T00:33:19.845 INFO:tasks.workunit.client.1.smithi161.stdout:3/272: dread da/dc/d11/d26/f19 [0,4194304] 0 2024-02-22T00:33:19.849 INFO:tasks.workunit.client.1.smithi161.stdout:3/273: rename da/l4e to da/l57 0 2024-02-22T00:33:19.852 INFO:tasks.workunit.client.1.smithi161.stdout:8/292: dwrite d1/d1c/d20/d31/f57 [0,4194304] 0 2024-02-22T00:33:19.856 INFO:tasks.workunit.client.1.smithi161.stdout:3/274: creat da/dc/d11/d26/d2f/f58 x:0 0 0 2024-02-22T00:33:19.856 INFO:tasks.workunit.client.1.smithi161.stdout:8/293: write d1/d1c/d20/d22/d3f/f51 [25031,43386] 0 2024-02-22T00:33:19.861 INFO:tasks.workunit.client.1.smithi161.stdout:3/275: rename da/d4f to da/dc/d11/d40/d59 0 2024-02-22T00:33:19.862 INFO:tasks.workunit.client.1.smithi161.stdout:3/276: dread - da/dc/f1f zero size 2024-02-22T00:33:19.863 INFO:tasks.workunit.client.1.smithi161.stdout:8/294: creat d1/d1c/d20/d22/d28/f59 x:0 0 0 2024-02-22T00:33:19.863 INFO:tasks.workunit.client.1.smithi161.stdout:8/295: stat d1/d2f 0 2024-02-22T00:33:19.864 INFO:tasks.workunit.client.1.smithi161.stdout:3/277: mknod da/dc/d11/d26/c5a 0 2024-02-22T00:33:19.865 INFO:tasks.workunit.client.1.smithi161.stdout:8/296: mkdir d1/d1c/d20/d5a 0 2024-02-22T00:33:19.866 INFO:tasks.workunit.client.1.smithi161.stdout:3/278: mknod da/dc/c5b 0 2024-02-22T00:33:19.867 INFO:tasks.workunit.client.1.smithi161.stdout:8/297: fsync d1/d1c/d20/d22/d28/f2e 0 2024-02-22T00:33:19.869 INFO:tasks.workunit.client.1.smithi161.stdout:3/279: rename da/dc/d11/d26/c5a to da/d29/c5c 0 2024-02-22T00:33:19.870 INFO:tasks.workunit.client.1.smithi161.stdout:8/298: symlink d1/d1c/d20/d22/d3f/l5b 0 2024-02-22T00:33:19.870 INFO:tasks.workunit.client.1.smithi161.stdout:3/280: write da/f13 [4146255,8541] 0 2024-02-22T00:33:19.872 INFO:tasks.workunit.client.1.smithi161.stdout:3/281: truncate da/dc/d11/f3e 407859 0 2024-02-22T00:33:19.872 INFO:tasks.workunit.client.1.smithi161.stdout:8/299: truncate d1/d19/d18/f45 995570 0 2024-02-22T00:33:19.873 INFO:tasks.workunit.client.1.smithi161.stdout:8/300: chown d1/d1c/d20/f2b 2376 1 2024-02-22T00:33:19.874 INFO:tasks.workunit.client.1.smithi161.stdout:8/301: dread - d1/d1c/d20/d22/d28/f59 zero size 2024-02-22T00:33:19.875 INFO:tasks.workunit.client.1.smithi161.stdout:3/282: symlink da/d56/l5d 0 2024-02-22T00:33:19.875 INFO:tasks.workunit.client.1.smithi161.stdout:8/302: dread - d1/d1c/d20/d31/f50 zero size 2024-02-22T00:33:19.875 INFO:tasks.workunit.client.1.smithi161.stdout:3/283: chown da/dc/f2b 468986667 1 2024-02-22T00:33:19.876 INFO:tasks.workunit.client.1.smithi161.stdout:8/303: mknod d1/d2f/d30/c5c 0 2024-02-22T00:33:19.877 INFO:tasks.workunit.client.1.smithi161.stdout:8/304: dread - d1/d19/f4a zero size 2024-02-22T00:33:19.878 INFO:tasks.workunit.client.1.smithi161.stdout:8/305: chown d1/d19/d18 59668426 1 2024-02-22T00:33:19.881 INFO:tasks.workunit.client.1.smithi161.stdout:3/284: dwrite da/d29/f32 [0,4194304] 0 2024-02-22T00:33:19.884 INFO:tasks.workunit.client.1.smithi161.stdout:3/285: read da/dc/d11/f28 [1258557,78227] 0 2024-02-22T00:33:19.886 INFO:tasks.workunit.client.1.smithi161.stdout:3/286: chown da/dc/f31 1 1 2024-02-22T00:33:19.887 INFO:tasks.workunit.client.1.smithi161.stdout:8/306: dwrite d1/d1c/d20/d31/f3c [0,4194304] 0 2024-02-22T00:33:19.889 INFO:tasks.workunit.client.1.smithi161.stdout:3/287: rename da/dc/d11/d26/d2f to da/dc/d11/d26/d2f/d37/d5e 22 2024-02-22T00:33:19.889 INFO:tasks.workunit.client.1.smithi161.stdout:8/307: write d1/d1c/d20/d31/f57 [2651644,4529] 0 2024-02-22T00:33:19.894 INFO:tasks.workunit.client.1.smithi161.stdout:8/308: unlink d1/d1c/f54 0 2024-02-22T00:33:19.900 INFO:tasks.workunit.client.1.smithi161.stdout:8/309: truncate d1/d1c/d20/d22/d28/f59 780731 0 2024-02-22T00:33:19.901 INFO:tasks.workunit.client.1.smithi161.stdout:8/310: creat d1/d1c/d20/d5a/f5d x:0 0 0 2024-02-22T00:33:19.906 INFO:tasks.workunit.client.1.smithi161.stdout:8/311: rmdir d1/d1c/d20/d22/d28/d36/d4f 0 2024-02-22T00:33:19.906 INFO:tasks.workunit.client.1.smithi161.stdout:8/312: read d1/d1c/d20/d31/f3c [3894222,22308] 0 2024-02-22T00:33:19.912 INFO:tasks.workunit.client.1.smithi161.stdout:8/313: rmdir d1/d1c 39 2024-02-22T00:33:19.914 INFO:tasks.workunit.client.1.smithi161.stdout:3/288: dread da/dc/d11/d26/f21 [0,4194304] 0 2024-02-22T00:33:19.915 INFO:tasks.workunit.client.1.smithi161.stdout:8/314: readlink d1/d1c/d20/d22/d28/d36/l52 0 2024-02-22T00:33:19.920 INFO:tasks.workunit.client.1.smithi161.stdout:3/289: dwrite da/dc/d11/d26/f3c [0,4194304] 0 2024-02-22T00:33:19.920 INFO:tasks.workunit.client.1.smithi161.stdout:8/315: link d1/d1c/d20/d31/f3b d1/d2f/f5e 0 2024-02-22T00:33:19.921 INFO:tasks.workunit.client.1.smithi161.stdout:3/290: truncate da/f27 178159 0 2024-02-22T00:33:19.923 INFO:tasks.workunit.client.1.smithi161.stdout:8/316: mknod d1/d1c/d20/d22/c5f 0 2024-02-22T00:33:19.924 INFO:tasks.workunit.client.1.smithi161.stdout:8/317: dread - d1/f2d zero size 2024-02-22T00:33:19.928 INFO:tasks.workunit.client.1.smithi161.stdout:3/291: write da/dc/d11/d26/d2f/d37/d39/f3f [270178,110624] 0 2024-02-22T00:33:19.929 INFO:tasks.workunit.client.1.smithi161.stdout:3/292: stat da/dc/d11/d26/f3c 0 2024-02-22T00:33:19.930 INFO:tasks.workunit.client.1.smithi161.stdout:3/293: mkdir da/dc/d5f 0 2024-02-22T00:33:19.935 INFO:tasks.workunit.client.1.smithi161.stdout:3/294: dwrite da/f1a [0,4194304] 0 2024-02-22T00:33:19.938 INFO:tasks.workunit.client.1.smithi161.stdout:3/295: mkdir da/dc/d11/d40/d60 0 2024-02-22T00:33:19.940 INFO:tasks.workunit.client.1.smithi161.stdout:3/296: symlink da/dc/l61 0 2024-02-22T00:33:19.944 INFO:tasks.workunit.client.1.smithi161.stdout:3/297: fsync da/dc/d11/d26/f45 0 2024-02-22T00:33:19.945 INFO:tasks.workunit.client.1.smithi161.stdout:3/298: write da/f13 [2473173,128662] 0 2024-02-22T00:33:19.987 INFO:tasks.workunit.client.1.smithi161.stdout:8/318: dread d1/d1c/d20/d22/d28/f2e [0,4194304] 0 2024-02-22T00:33:19.995 INFO:tasks.workunit.client.1.smithi161.stdout:8/319: rename d1/d1c/d20/l2c to d1/l60 0 2024-02-22T00:33:19.996 INFO:tasks.workunit.client.1.smithi161.stdout:8/320: fsync d1/d2f/d37/f48 0 2024-02-22T00:33:19.999 INFO:tasks.workunit.client.1.smithi161.stdout:8/321: rename d1/l14 to d1/d1c/d20/d22/d3f/l61 0 2024-02-22T00:33:20.001 INFO:tasks.workunit.client.1.smithi161.stdout:8/322: creat d1/d1c/d20/d22/f62 x:0 0 0 2024-02-22T00:33:20.008 INFO:tasks.workunit.client.1.smithi161.stdout:8/323: dwrite d1/d1c/d20/d31/f57 [4194304,4194304] 0 2024-02-22T00:33:20.009 INFO:tasks.workunit.client.1.smithi161.stdout:8/324: chown d1/d19/d18/f45 0 1 2024-02-22T00:33:20.019 INFO:tasks.workunit.client.1.smithi161.stdout:8/325: write d1/d1c/f3d [8063550,100071] 0 2024-02-22T00:33:20.022 INFO:tasks.workunit.client.1.smithi161.stdout:8/326: dread d1/d1c/d20/d31/f3b [0,4194304] 0 2024-02-22T00:33:20.024 INFO:tasks.workunit.client.1.smithi161.stdout:8/327: truncate d1/d1c/d20/d22/f35 401100 0 2024-02-22T00:33:20.028 INFO:tasks.workunit.client.1.smithi161.stdout:8/328: rename d1/d1c/d20/d22/d28/f59 to d1/d1c/d20/d22/d3f/f63 0 2024-02-22T00:33:20.029 INFO:tasks.workunit.client.1.smithi161.stdout:8/329: chown d1/d1c/d20/d22 3117082 1 2024-02-22T00:33:20.030 INFO:tasks.workunit.client.1.smithi161.stdout:8/330: write d1/d1c/d20/f2b [991274,37614] 0 2024-02-22T00:33:20.031 INFO:tasks.workunit.client.1.smithi161.stdout:8/331: truncate d1/d1c/d20/d22/d3f/f63 1072688 0 2024-02-22T00:33:20.034 INFO:tasks.workunit.client.1.smithi161.stdout:8/332: mkdir d1/d2f/d37/d64 0 2024-02-22T00:33:20.035 INFO:tasks.workunit.client.1.smithi161.stdout:8/333: write d1/d1c/d20/d5a/f5d [591809,52397] 0 2024-02-22T00:33:20.038 INFO:tasks.workunit.client.1.smithi161.stdout:8/334: creat d1/d1c/d20/d5a/f65 x:0 0 0 2024-02-22T00:33:20.039 INFO:tasks.workunit.client.1.smithi161.stdout:8/335: write d1/f6 [1352070,60345] 0 2024-02-22T00:33:20.041 INFO:tasks.workunit.client.1.smithi161.stdout:8/336: rmdir d1/d1c/d20/d22/d3f 39 2024-02-22T00:33:20.042 INFO:tasks.workunit.client.1.smithi161.stdout:8/337: fsync d1/d1c/d20/d22/d28/f2e 0 2024-02-22T00:33:20.047 INFO:tasks.workunit.client.1.smithi161.stdout:8/338: write d1/f29 [2106483,24656] 0 2024-02-22T00:33:20.053 INFO:tasks.workunit.client.1.smithi161.stdout:8/339: truncate d1/d1c/d20/d22/d3f/f63 343505 0 2024-02-22T00:33:20.059 INFO:tasks.workunit.client.1.smithi161.stdout:8/340: truncate d1/d1c/d20/d31/f3c 700581 0 2024-02-22T00:33:20.061 INFO:tasks.workunit.client.1.smithi161.stdout:8/341: mknod d1/d2f/c66 0 2024-02-22T00:33:20.066 INFO:tasks.workunit.client.1.smithi161.stdout:8/342: dwrite d1/d2f/d30/f33 [0,4194304] 0 2024-02-22T00:33:20.069 INFO:tasks.workunit.client.1.smithi161.stdout:8/343: symlink d1/d1c/d20/d31/l67 0 2024-02-22T00:33:20.081 INFO:tasks.workunit.client.1.smithi161.stdout:8/344: read d1/d1c/d20/d31/f3c [478949,100908] 0 2024-02-22T00:33:20.083 INFO:tasks.workunit.client.1.smithi161.stdout:8/345: fsync d1/d1c/d20/d22/d28/d36/f46 0 2024-02-22T00:33:20.086 INFO:tasks.workunit.client.1.smithi161.stdout:8/346: creat d1/d19/d18/f68 x:0 0 0 2024-02-22T00:33:20.092 INFO:tasks.workunit.client.1.smithi161.stdout:8/347: truncate d1/f29 579176 0 2024-02-22T00:33:20.097 INFO:tasks.workunit.client.1.smithi161.stdout:8/348: truncate d1/d19/d18/f25 2978199 0 2024-02-22T00:33:20.099 INFO:tasks.workunit.client.1.smithi161.stdout:8/349: rename d1/c7 to d1/d1c/d20/d22/d28/d36/c69 0 2024-02-22T00:33:20.100 INFO:tasks.workunit.client.1.smithi161.stdout:8/350: chown d1/c5 3141 1 2024-02-22T00:33:20.103 INFO:tasks.workunit.client.1.smithi161.stdout:8/351: rename d1/d1c/d20/d22/c5f to d1/d1c/d20/c6a 0 2024-02-22T00:33:20.104 INFO:tasks.workunit.client.1.smithi161.stdout:8/352: symlink d1/d1c/d20/l6b 0 2024-02-22T00:33:20.106 INFO:tasks.workunit.client.1.smithi161.stdout:8/353: mkdir d1/d1c/d20/d22/d28/d36/d6c 0 2024-02-22T00:33:20.108 INFO:tasks.workunit.client.1.smithi161.stdout:8/354: mknod d1/d1c/d20/d22/d28/c6d 0 2024-02-22T00:33:20.111 INFO:tasks.workunit.client.1.smithi161.stdout:8/355: link d1/d2f/d37/f48 d1/d1c/d20/d22/d3f/f6e 0 2024-02-22T00:33:20.226 INFO:tasks.workunit.client.1.smithi161.stdout:0/439: sync 2024-02-22T00:33:20.226 INFO:tasks.workunit.client.1.smithi161.stdout:1/372: sync 2024-02-22T00:33:20.228 INFO:tasks.workunit.client.1.smithi161.stdout:0/440: write d14/f84 [3561742,36068] 0 2024-02-22T00:33:20.231 INFO:tasks.workunit.client.1.smithi161.stdout:0/441: dread d14/d37/f97 [0,4194304] 0 2024-02-22T00:33:20.243 INFO:tasks.workunit.client.1.smithi161.stdout:1/373: truncate d19/d1d/f22 612827 0 2024-02-22T00:33:20.244 INFO:tasks.workunit.client.1.smithi161.stdout:1/374: symlink d19/d51/d6c/l8b 0 2024-02-22T00:33:20.245 INFO:tasks.workunit.client.1.smithi161.stdout:1/375: dread - d19/d2f/f54 zero size 2024-02-22T00:33:20.245 INFO:tasks.workunit.client.1.smithi161.stdout:0/442: truncate d14/f84 642074 0 2024-02-22T00:33:20.249 INFO:tasks.workunit.client.1.smithi161.stdout:1/376: creat d19/d1d/f8c x:0 0 0 2024-02-22T00:33:20.251 INFO:tasks.workunit.client.1.smithi161.stdout:1/377: chown d19/d1d/d2c/d2d/d3f/d69 4532788 1 2024-02-22T00:33:20.252 INFO:tasks.workunit.client.1.smithi161.stdout:0/443: dwrite d14/d1a/d3f/f80 [0,4194304] 0 2024-02-22T00:33:20.253 INFO:tasks.workunit.client.1.smithi161.stdout:1/378: fsync d19/d1d/d2c/d2d/f83 0 2024-02-22T00:33:20.256 INFO:tasks.workunit.client.1.smithi161.stdout:1/379: rmdir d19/d2f 39 2024-02-22T00:33:20.256 INFO:tasks.workunit.client.1.smithi161.stdout:1/380: read - d19/f8a zero size 2024-02-22T00:33:20.264 INFO:tasks.workunit.client.1.smithi161.stdout:1/381: rename d19/d2f/f4e to d19/d1d/d2c/d2d/d3f/d69/f8d 0 2024-02-22T00:33:20.275 INFO:tasks.workunit.client.1.smithi161.stdout:0/444: dread d14/f2c [0,4194304] 0 2024-02-22T00:33:20.277 INFO:tasks.workunit.client.1.smithi161.stdout:0/445: write d14/d1a/f2d [4068318,117142] 0 2024-02-22T00:33:20.278 INFO:tasks.workunit.client.1.smithi161.stdout:0/446: readlink d14/d1a/l6d 0 2024-02-22T00:33:20.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/382: dread d19/f43 [0,4194304] 0 2024-02-22T00:33:20.282 INFO:tasks.workunit.client.1.smithi161.stdout:0/447: write d14/f25 [300862,114511] 0 2024-02-22T00:33:20.282 INFO:tasks.workunit.client.1.smithi161.stdout:1/383: chown d19/d1d/d2c/d4f 15250 1 2024-02-22T00:33:20.283 INFO:tasks.workunit.client.1.smithi161.stdout:0/448: fsync d14/d1a/f79 0 2024-02-22T00:33:20.285 INFO:tasks.workunit.client.1.smithi161.stdout:0/449: creat d14/d37/d42/d73/f99 x:0 0 0 2024-02-22T00:33:20.286 INFO:tasks.workunit.client.1.smithi161.stdout:0/450: stat d14/d44/f81 0 2024-02-22T00:33:20.293 INFO:tasks.workunit.client.1.smithi161.stdout:0/451: dwrite d14/d37/f97 [0,4194304] 0 2024-02-22T00:33:20.298 INFO:tasks.workunit.client.1.smithi161.stdout:0/452: mkdir d14/d1a/d3f/d9a 0 2024-02-22T00:33:20.300 INFO:tasks.workunit.client.1.smithi161.stdout:1/384: dread d19/f1f [0,4194304] 0 2024-02-22T00:33:20.301 INFO:tasks.workunit.client.1.smithi161.stdout:0/453: mkdir d14/d9b 0 2024-02-22T00:33:20.302 INFO:tasks.workunit.client.1.smithi161.stdout:1/385: chown c13 17222131 1 2024-02-22T00:33:20.302 INFO:tasks.workunit.client.1.smithi161.stdout:0/454: truncate d14/d1a/f1b 4328770 0 2024-02-22T00:33:20.303 INFO:tasks.workunit.client.1.smithi161.stdout:0/455: dread - d14/d1a/f8d zero size 2024-02-22T00:33:20.305 INFO:tasks.workunit.client.1.smithi161.stdout:0/456: mknod d14/d37/d42/c9c 0 2024-02-22T00:33:20.307 INFO:tasks.workunit.client.1.smithi161.stdout:0/457: mkdir d14/d1a/d9d 0 2024-02-22T00:33:20.314 INFO:tasks.workunit.client.1.smithi161.stdout:0/458: dwrite d14/f16 [0,4194304] 0 2024-02-22T00:33:20.315 INFO:tasks.workunit.client.1.smithi161.stdout:0/459: chown d14/d1a/d3f/f5b 29238 1 2024-02-22T00:33:20.316 INFO:tasks.workunit.client.1.smithi161.stdout:0/460: write d14/d44/f94 [65371,80669] 0 2024-02-22T00:33:20.319 INFO:tasks.workunit.client.1.smithi161.stdout:0/461: read d14/d1a/f2d [2428654,46140] 0 2024-02-22T00:33:20.323 INFO:tasks.workunit.client.1.smithi161.stdout:0/462: creat d14/f9e x:0 0 0 2024-02-22T00:33:20.324 INFO:tasks.workunit.client.1.smithi161.stdout:1/386: dread d19/d1d/d2c/d2d/d3f/d69/f8d [0,4194304] 0 2024-02-22T00:33:20.325 INFO:tasks.workunit.client.1.smithi161.stdout:0/463: getdents d14/d9b 0 2024-02-22T00:33:20.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/387: rename d19/l32 to d19/d85/d87/l8e 0 2024-02-22T00:33:20.331 INFO:tasks.workunit.client.1.smithi161.stdout:0/464: getdents d14/d37/d42/d8e/d92 0 2024-02-22T00:33:20.332 INFO:tasks.workunit.client.1.smithi161.stdout:0/465: write d14/f19 [5294100,97632] 0 2024-02-22T00:33:20.336 INFO:tasks.workunit.client.1.smithi161.stdout:6/264: sync 2024-02-22T00:33:20.336 INFO:tasks.workunit.client.1.smithi161.stdout:9/336: sync 2024-02-22T00:33:20.339 INFO:tasks.workunit.client.1.smithi161.stdout:9/337: write d1/d5/d9/d33/f32 [753500,111312] 0 2024-02-22T00:33:20.340 INFO:tasks.workunit.client.1.smithi161.stdout:0/466: dwrite d14/d1a/f60 [0,4194304] 0 2024-02-22T00:33:20.341 INFO:tasks.workunit.client.1.smithi161.stdout:0/467: readlink d14/d44/l50 0 2024-02-22T00:33:20.342 INFO:tasks.workunit.client.1.smithi161.stdout:9/338: fdatasync d1/d5/f62 0 2024-02-22T00:33:20.346 INFO:tasks.workunit.client.1.smithi161.stdout:0/468: rename d14/d37/c83 to d14/d9b/c9f 0 2024-02-22T00:33:20.347 INFO:tasks.workunit.client.1.smithi161.stdout:1/388: dread d19/f49 [0,4194304] 0 2024-02-22T00:33:20.347 INFO:tasks.workunit.client.1.smithi161.stdout:6/265: truncate d3/d10/d1b/f34 1936643 0 2024-02-22T00:33:20.351 INFO:tasks.workunit.client.1.smithi161.stdout:0/469: rename d14/d37/f97 to d14/d29/fa0 0 2024-02-22T00:33:20.352 INFO:tasks.workunit.client.1.smithi161.stdout:0/470: readlink d14/d37/d42/l47 0 2024-02-22T00:33:20.354 INFO:tasks.workunit.client.1.smithi161.stdout:0/471: dread d14/d44/f94 [0,4194304] 0 2024-02-22T00:33:20.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/266: unlink d3/d10/fa 0 2024-02-22T00:33:20.356 INFO:tasks.workunit.client.1.smithi161.stdout:9/339: symlink d1/l6e 0 2024-02-22T00:33:20.356 INFO:tasks.workunit.client.1.smithi161.stdout:1/389: fdatasync d19/d1d/d2c/d2d/d3f/d69/f8d 0 2024-02-22T00:33:20.357 INFO:tasks.workunit.client.1.smithi161.stdout:0/472: dread - d14/d1a/d3f/d5d/f69 zero size 2024-02-22T00:33:20.358 INFO:tasks.workunit.client.1.smithi161.stdout:6/267: readlink d3/d10/l3f 0 2024-02-22T00:33:20.360 INFO:tasks.workunit.client.1.smithi161.stdout:9/340: creat d1/d5/d9/d33/f6f x:0 0 0 2024-02-22T00:33:20.365 INFO:tasks.workunit.client.1.smithi161.stdout:0/473: dread d14/f16 [0,4194304] 0 2024-02-22T00:33:20.365 INFO:tasks.workunit.client.1.smithi161.stdout:1/390: dwrite d19/d1d/d2c/d2d/f59 [0,4194304] 0 2024-02-22T00:33:20.366 INFO:tasks.workunit.client.1.smithi161.stdout:0/474: chown d14/d44/f67 131 1 2024-02-22T00:33:20.368 INFO:tasks.workunit.client.1.smithi161.stdout:9/341: mknod d1/d2/d7/d1e/c70 0 2024-02-22T00:33:20.371 INFO:tasks.workunit.client.1.smithi161.stdout:6/268: fdatasync d3/d10/d12/f23 0 2024-02-22T00:33:20.373 INFO:tasks.workunit.client.1.smithi161.stdout:1/391: creat d19/d1d/d2c/d4f/f8f x:0 0 0 2024-02-22T00:33:20.374 INFO:tasks.workunit.client.1.smithi161.stdout:0/475: write d14/f4b [6911472,16415] 0 2024-02-22T00:33:20.375 INFO:tasks.workunit.client.1.smithi161.stdout:0/476: write d14/d1a/f28 [3234713,20856] 0 2024-02-22T00:33:20.381 INFO:tasks.workunit.client.1.smithi161.stdout:1/392: dwrite d19/d48/f5c [0,4194304] 0 2024-02-22T00:33:20.382 INFO:tasks.workunit.client.1.smithi161.stdout:1/393: read d19/f46 [804236,128828] 0 2024-02-22T00:33:20.383 INFO:tasks.workunit.client.1.smithi161.stdout:1/394: readlink d19/d48/l60 0 2024-02-22T00:33:20.385 INFO:tasks.workunit.client.1.smithi161.stdout:1/395: chown d19/d1d/d2c/f44 240 1 2024-02-22T00:33:20.391 INFO:tasks.workunit.client.1.smithi161.stdout:0/477: mkdir d14/d1a/d3f/d96/da1 0 2024-02-22T00:33:20.394 INFO:tasks.workunit.client.1.smithi161.stdout:9/342: creat d1/d2/d4/d11/f71 x:0 0 0 2024-02-22T00:33:20.395 INFO:tasks.workunit.client.1.smithi161.stdout:1/396: mkdir d19/d90 0 2024-02-22T00:33:20.396 INFO:tasks.workunit.client.1.smithi161.stdout:0/478: mkdir d14/d37/d42/da2 0 2024-02-22T00:33:20.398 INFO:tasks.workunit.client.1.smithi161.stdout:9/343: rename d1/d5/l44 to d1/d2/d4/l72 0 2024-02-22T00:33:20.401 INFO:tasks.workunit.client.1.smithi161.stdout:6/269: dwrite d3/d10/d12/f22 [0,4194304] 0 2024-02-22T00:33:20.402 INFO:tasks.workunit.client.1.smithi161.stdout:1/397: link d19/d1d/d2c/d2d/c5d d19/d1d/d2c/d7d/c91 0 2024-02-22T00:33:20.406 INFO:tasks.workunit.client.1.smithi161.stdout:9/344: rename d1/d2/d7/d1e to d1/d25/d73 0 2024-02-22T00:33:20.406 INFO:tasks.workunit.client.1.smithi161.stdout:6/270: mkdir d3/d48/d50 0 2024-02-22T00:33:20.407 INFO:tasks.workunit.client.1.smithi161.stdout:1/398: read - d19/d1d/d2c/d2d/f75 zero size 2024-02-22T00:33:20.408 INFO:tasks.workunit.client.1.smithi161.stdout:6/271: fdatasync d3/f45 0 2024-02-22T00:33:20.409 INFO:tasks.workunit.client.1.smithi161.stdout:0/479: dwrite d14/d37/d42/d8e/f98 [0,4194304] 0 2024-02-22T00:33:20.412 INFO:tasks.workunit.client.1.smithi161.stdout:6/272: stat d3/d10/d12/c35 0 2024-02-22T00:33:20.412 INFO:tasks.workunit.client.1.smithi161.stdout:9/345: truncate d1/d5/d9/d33/d4f/f5e 4910935 0 2024-02-22T00:33:20.412 INFO:tasks.workunit.client.1.smithi161.stdout:1/399: truncate d19/d1d/f28 5020743 0 2024-02-22T00:33:20.413 INFO:tasks.workunit.client.1.smithi161.stdout:0/480: truncate d14/d1a/d3f/f5b 1221695 0 2024-02-22T00:33:20.414 INFO:tasks.workunit.client.1.smithi161.stdout:6/273: write d3/d10/d12/f22 [1711481,78457] 0 2024-02-22T00:33:20.415 INFO:tasks.workunit.client.1.smithi161.stdout:1/400: creat d19/d48/f92 x:0 0 0 2024-02-22T00:33:20.416 INFO:tasks.workunit.client.1.smithi161.stdout:9/346: mknod d1/d25/d73/c74 0 2024-02-22T00:33:20.416 INFO:tasks.workunit.client.1.smithi161.stdout:0/481: truncate d14/d37/d42/d8e/f98 4336821 0 2024-02-22T00:33:20.417 INFO:tasks.workunit.client.1.smithi161.stdout:0/482: chown d14/f19 13625 1 2024-02-22T00:33:20.419 INFO:tasks.workunit.client.1.smithi161.stdout:1/401: creat d19/d1d/d2c/d7d/f93 x:0 0 0 2024-02-22T00:33:20.424 INFO:tasks.workunit.client.1.smithi161.stdout:1/402: fsync d19/d1d/d2c/d2d/f40 0 2024-02-22T00:33:20.424 INFO:tasks.workunit.client.1.smithi161.stdout:5/476: sync 2024-02-22T00:33:20.425 INFO:tasks.workunit.client.1.smithi161.stdout:7/285: sync 2024-02-22T00:33:20.425 INFO:tasks.workunit.client.1.smithi161.stdout:2/356: sync 2024-02-22T00:33:20.427 INFO:tasks.workunit.client.1.smithi161.stdout:6/274: truncate d3/d10/f21 796944 0 2024-02-22T00:33:20.427 INFO:tasks.workunit.client.1.smithi161.stdout:4/377: sync 2024-02-22T00:33:20.428 INFO:tasks.workunit.client.1.smithi161.stdout:0/483: dwrite d14/d29/f8c [4194304,4194304] 0 2024-02-22T00:33:20.428 INFO:tasks.workunit.client.1.smithi161.stdout:5/477: chown d3/d1c/d20/l61 13500375 1 2024-02-22T00:33:20.434 INFO:tasks.workunit.client.1.smithi161.stdout:7/286: mkdir d3/dd/d59/d5b/d26/d50/d62 0 2024-02-22T00:33:20.435 INFO:tasks.workunit.client.1.smithi161.stdout:2/357: mknod de/d2b/d65/d60/d68/c7d 0 2024-02-22T00:33:20.436 INFO:tasks.workunit.client.1.smithi161.stdout:5/478: rmdir d3 39 2024-02-22T00:33:20.438 INFO:tasks.workunit.client.1.smithi161.stdout:1/403: dwrite d19/f1a [0,4194304] 0 2024-02-22T00:33:20.440 INFO:tasks.workunit.client.1.smithi161.stdout:4/378: dread f0 [0,4194304] 0 2024-02-22T00:33:20.441 INFO:tasks.workunit.client.1.smithi161.stdout:0/484: rename d14/d1a/c75 to d14/d37/d42/d8e/ca3 0 2024-02-22T00:33:20.447 INFO:tasks.workunit.client.1.smithi161.stdout:7/287: rename d3/d5d to d3/df/d33/d35/d55/d63 0 2024-02-22T00:33:20.448 INFO:tasks.workunit.client.1.smithi161.stdout:6/275: symlink d3/d10/d1b/l51 0 2024-02-22T00:33:20.448 INFO:tasks.workunit.client.1.smithi161.stdout:2/358: write de/d11/d5c/d33/d35/f5d [4935,85749] 0 2024-02-22T00:33:20.451 INFO:tasks.workunit.client.1.smithi161.stdout:0/485: creat d14/d37/d42/d8e/fa4 x:0 0 0 2024-02-22T00:33:20.451 INFO:tasks.workunit.client.1.smithi161.stdout:0/486: truncate d14/f51 4630565 0 2024-02-22T00:33:20.452 INFO:tasks.workunit.client.1.smithi161.stdout:0/487: chown c5 7054 1 2024-02-22T00:33:20.453 INFO:tasks.workunit.client.1.smithi161.stdout:4/379: rename d5/d10/d14/d24/d28/d63/f86 to d5/d10/d14/d24/d28/f8f 0 2024-02-22T00:33:20.454 INFO:tasks.workunit.client.1.smithi161.stdout:7/288: dread d3/f1b [0,4194304] 0 2024-02-22T00:33:20.456 INFO:tasks.workunit.client.1.smithi161.stdout:6/276: fsync d3/d10/d12/d2f/f3c 0 2024-02-22T00:33:20.456 INFO:tasks.workunit.client.1.smithi161.stdout:2/359: unlink de/d11/d5c/d33/f5e 0 2024-02-22T00:33:20.458 INFO:tasks.workunit.client.1.smithi161.stdout:4/380: write d5/d10/d14/d24/d28/f8a [41176,130706] 0 2024-02-22T00:33:20.459 INFO:tasks.workunit.client.1.smithi161.stdout:2/360: stat fa 0 2024-02-22T00:33:20.460 INFO:tasks.workunit.client.1.smithi161.stdout:4/381: truncate d5/fe 3233000 0 2024-02-22T00:33:20.461 INFO:tasks.workunit.client.1.smithi161.stdout:1/404: getdents d19/d1d 0 2024-02-22T00:33:20.462 INFO:tasks.workunit.client.1.smithi161.stdout:2/361: readlink de/d2b/d65/d3a/l4a 0 2024-02-22T00:33:20.462 INFO:tasks.workunit.client.1.smithi161.stdout:2/362: readlink de/d11/d14/l77 0 2024-02-22T00:33:20.462 INFO:tasks.workunit.client.1.smithi161.stdout:5/479: dread d3/f26 [4194304,4194304] 0 2024-02-22T00:33:20.465 INFO:tasks.workunit.client.1.smithi161.stdout:5/480: read d3/d1c/d62/f85 [338613,89486] 0 2024-02-22T00:33:20.465 INFO:tasks.workunit.client.1.smithi161.stdout:7/289: mkdir d3/dd/d60/d64 0 2024-02-22T00:33:20.466 INFO:tasks.workunit.client.1.smithi161.stdout:1/405: creat d19/d85/f94 x:0 0 0 2024-02-22T00:33:20.466 INFO:tasks.workunit.client.1.smithi161.stdout:1/406: dread - d19/d1d/f8c zero size 2024-02-22T00:33:20.468 INFO:tasks.workunit.client.1.smithi161.stdout:2/363: chown de/f67 11 1 2024-02-22T00:33:20.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/481: creat d3/d1c/d20/d74/fa5 x:0 0 0 2024-02-22T00:33:20.472 INFO:tasks.workunit.client.1.smithi161.stdout:7/290: dwrite d3/dd/d59/d5b/d26/f3e [0,4194304] 0 2024-02-22T00:33:20.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/482: chown d3/f5 10675428 1 2024-02-22T00:33:20.473 INFO:tasks.workunit.client.1.smithi161.stdout:0/488: truncate d14/d37/f45 3090250 0 2024-02-22T00:33:20.476 INFO:tasks.workunit.client.1.smithi161.stdout:1/407: mknod d19/d51/c95 0 2024-02-22T00:33:20.476 INFO:tasks.workunit.client.1.smithi161.stdout:1/408: chown d19/d2f 87564403 1 2024-02-22T00:33:20.477 INFO:tasks.workunit.client.1.smithi161.stdout:0/489: chown d14/d1a/d3f/c52 2041191 1 2024-02-22T00:33:20.478 INFO:tasks.workunit.client.1.smithi161.stdout:2/364: mknod de/d2b/d65/d60/c7e 0 2024-02-22T00:33:20.481 INFO:tasks.workunit.client.1.smithi161.stdout:5/483: creat d3/d1b/d36/d88/fa6 x:0 0 0 2024-02-22T00:33:20.482 INFO:tasks.workunit.client.1.smithi161.stdout:1/409: symlink d19/d51/d64/l96 0 2024-02-22T00:33:20.483 INFO:tasks.workunit.client.1.smithi161.stdout:5/484: write d3/d1b/f57 [231254,29966] 0 2024-02-22T00:33:20.490 INFO:tasks.workunit.client.1.smithi161.stdout:0/490: mkdir d14/d37/d42/d8e/d92/da5 0 2024-02-22T00:33:20.492 INFO:tasks.workunit.client.1.smithi161.stdout:7/291: write d3/f7 [3425418,29433] 0 2024-02-22T00:33:20.497 INFO:tasks.workunit.client.1.smithi161.stdout:7/292: read d3/dd/d59/d5b/f4e [1647941,84448] 0 2024-02-22T00:33:20.499 INFO:tasks.workunit.client.1.smithi161.stdout:5/485: dwrite d3/d1c/d20/f35 [4194304,4194304] 0 2024-02-22T00:33:20.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/277: dwrite d3/d10/d12/d3a/f43 [0,4194304] 0 2024-02-22T00:33:20.516 INFO:tasks.workunit.client.1.smithi161.stdout:2/365: dread de/f48 [0,4194304] 0 2024-02-22T00:33:20.516 INFO:tasks.workunit.client.1.smithi161.stdout:0/491: dwrite d14/d37/d42/d73/f91 [0,4194304] 0 2024-02-22T00:33:20.516 INFO:tasks.workunit.client.1.smithi161.stdout:5/486: getdents d3/d29 0 2024-02-22T00:33:20.523 INFO:tasks.workunit.client.1.smithi161.stdout:2/366: truncate de/d11/f4e 736332 0 2024-02-22T00:33:20.525 INFO:tasks.workunit.client.1.smithi161.stdout:6/278: creat d3/d48/d50/f52 x:0 0 0 2024-02-22T00:33:20.526 INFO:tasks.workunit.client.1.smithi161.stdout:0/492: mkdir d14/da6 0 2024-02-22T00:33:20.527 INFO:tasks.workunit.client.1.smithi161.stdout:2/367: mknod de/d2b/d65/d3a/d72/c7f 0 2024-02-22T00:33:20.529 INFO:tasks.workunit.client.1.smithi161.stdout:7/293: dread d3/df/d33/d35/f27 [0,4194304] 0 2024-02-22T00:33:20.533 INFO:tasks.workunit.client.1.smithi161.stdout:6/279: readlink d3/dc/df/d32/l49 0 2024-02-22T00:33:20.534 INFO:tasks.workunit.client.1.smithi161.stdout:5/487: dwrite d3/d1c/d20/f5b [0,4194304] 0 2024-02-22T00:33:20.536 INFO:tasks.workunit.client.1.smithi161.stdout:2/368: creat de/d11/d5c/f80 x:0 0 0 2024-02-22T00:33:20.537 INFO:tasks.workunit.client.1.smithi161.stdout:5/488: mkdir d3/d1c/da7 0 2024-02-22T00:33:20.543 INFO:tasks.workunit.client.1.smithi161.stdout:5/489: chown d3/d1b/d36/f5e 12 1 2024-02-22T00:33:20.544 INFO:tasks.workunit.client.1.smithi161.stdout:2/369: dread de/d11/f4e [0,4194304] 0 2024-02-22T00:33:20.545 INFO:tasks.workunit.client.1.smithi161.stdout:0/493: dwrite d14/d44/f85 [0,4194304] 0 2024-02-22T00:33:20.551 INFO:tasks.workunit.client.1.smithi161.stdout:7/294: dwrite d3/f37 [0,4194304] 0 2024-02-22T00:33:20.555 INFO:tasks.workunit.client.1.smithi161.stdout:0/494: write d14/f25 [1447740,15864] 0 2024-02-22T00:33:20.555 INFO:tasks.workunit.client.1.smithi161.stdout:0/495: fdatasync d14/d1a/f60 0 2024-02-22T00:33:20.557 INFO:tasks.workunit.client.1.smithi161.stdout:6/280: dwrite d3/d10/d12/d2f/f33 [0,4194304] 0 2024-02-22T00:33:20.564 INFO:tasks.workunit.client.1.smithi161.stdout:3/299: sync 2024-02-22T00:33:20.564 INFO:tasks.workunit.client.1.smithi161.stdout:8/356: sync 2024-02-22T00:33:20.564 INFO:tasks.workunit.client.1.smithi161.stdout:7/295: creat d3/df/d43/f65 x:0 0 0 2024-02-22T00:33:20.564 INFO:tasks.workunit.client.1.smithi161.stdout:0/496: readlink d14/d44/l5e 0 2024-02-22T00:33:20.565 INFO:tasks.workunit.client.1.smithi161.stdout:3/300: creat da/d29/f62 x:0 0 0 2024-02-22T00:33:20.565 INFO:tasks.workunit.client.1.smithi161.stdout:6/281: symlink d3/d10/d12/d3a/l53 0 2024-02-22T00:33:20.566 INFO:tasks.workunit.client.1.smithi161.stdout:0/497: write fb [563845,111082] 0 2024-02-22T00:33:20.567 INFO:tasks.workunit.client.1.smithi161.stdout:8/357: mknod d1/d1c/d20/d31/c6f 0 2024-02-22T00:33:20.567 INFO:tasks.workunit.client.1.smithi161.stdout:2/370: rename de/d11/d14/l64 to de/d2b/d65/d3a/d72/l81 0 2024-02-22T00:33:20.572 INFO:tasks.workunit.client.1.smithi161.stdout:5/490: dwrite d3/d29/d80/d92/f9d [0,4194304] 0 2024-02-22T00:33:20.573 INFO:tasks.workunit.client.1.smithi161.stdout:3/301: read - da/f46 zero size 2024-02-22T00:33:20.575 INFO:tasks.workunit.client.1.smithi161.stdout:7/296: creat d3/df/d33/d35/d55/d63/f66 x:0 0 0 2024-02-22T00:33:20.576 INFO:tasks.workunit.client.1.smithi161.stdout:8/358: chown d1/d2f/d37/d64 505 1 2024-02-22T00:33:20.578 INFO:tasks.workunit.client.1.smithi161.stdout:6/282: rename d3/d10/d12/f25 to d3/d48/f54 0 2024-02-22T00:33:20.581 INFO:tasks.workunit.client.1.smithi161.stdout:0/498: creat d14/d37/d42/d73/fa7 x:0 0 0 2024-02-22T00:33:20.592 INFO:tasks.workunit.client.1.smithi161.stdout:7/297: truncate d3/df/d43/f65 147014 0 2024-02-22T00:33:20.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/371: dwrite de/f1c [0,4194304] 0 2024-02-22T00:33:20.598 INFO:tasks.workunit.client.1.smithi161.stdout:5/491: dwrite d3/d1c/d20/f90 [0,4194304] 0 2024-02-22T00:33:20.603 INFO:tasks.workunit.client.1.smithi161.stdout:0/499: dwrite d14/f16 [0,4194304] 0 2024-02-22T00:33:20.609 INFO:tasks.workunit.client.1.smithi161.stdout:7/298: dwrite d3/f17 [0,4194304] 0 2024-02-22T00:33:20.610 INFO:tasks.workunit.client.1.smithi161.stdout:5/492: creat d3/d1c/d69/fa8 x:0 0 0 2024-02-22T00:33:20.611 INFO:tasks.workunit.client.1.smithi161.stdout:3/302: truncate da/dc/d11/d26/f19 5637911 0 2024-02-22T00:33:20.617 INFO:tasks.workunit.client.1.smithi161.stdout:2/372: dwrite f3 [0,4194304] 0 2024-02-22T00:33:20.621 INFO:tasks.workunit.client.1.smithi161.stdout:7/299: stat d3/df/f38 0 2024-02-22T00:33:20.626 INFO:tasks.workunit.client.1.smithi161.stdout:6/283: chown d3/d10/d12/d3a/l4d 15256551 1 2024-02-22T00:33:20.626 INFO:tasks.workunit.client.1.smithi161.stdout:5/493: chown d3/c31 314084797 1 2024-02-22T00:33:20.628 INFO:tasks.workunit.client.1.smithi161.stdout:2/373: write de/d2b/d65/d60/d68/f6c [442324,46981] 0 2024-02-22T00:33:20.631 INFO:tasks.workunit.client.1.smithi161.stdout:3/303: creat da/dc/d11/d26/f63 x:0 0 0 2024-02-22T00:33:20.631 INFO:tasks.workunit.client.1.smithi161.stdout:7/300: symlink d3/dd/l67 0 2024-02-22T00:33:20.631 INFO:tasks.workunit.client.1.smithi161.stdout:6/284: readlink d3/dc/df/d32/l49 0 2024-02-22T00:33:20.636 INFO:tasks.workunit.client.1.smithi161.stdout:2/374: creat de/d11/d32/f82 x:0 0 0 2024-02-22T00:33:20.636 INFO:tasks.workunit.client.1.smithi161.stdout:3/304: creat da/d56/f64 x:0 0 0 2024-02-22T00:33:20.637 INFO:tasks.workunit.client.1.smithi161.stdout:7/301: unlink d3/dd/c2a 0 2024-02-22T00:33:20.637 INFO:tasks.workunit.client.1.smithi161.stdout:0/500: dwrite d14/f18 [4194304,4194304] 0 2024-02-22T00:33:20.642 INFO:tasks.workunit.client.1.smithi161.stdout:2/375: fsync de/f1c 0 2024-02-22T00:33:20.648 INFO:tasks.workunit.client.1.smithi161.stdout:8/359: dread d1/d1c/d20/d22/d3f/f51 [0,4194304] 0 2024-02-22T00:33:20.648 INFO:tasks.workunit.client.1.smithi161.stdout:6/285: getdents d3/d10/d1b 0 2024-02-22T00:33:20.648 INFO:tasks.workunit.client.1.smithi161.stdout:7/302: chown d3/df/d33 697079 1 2024-02-22T00:33:20.648 INFO:tasks.workunit.client.1.smithi161.stdout:3/305: truncate da/dc/f1f 185606 0 2024-02-22T00:33:20.649 INFO:tasks.workunit.client.1.smithi161.stdout:5/494: dread d3/d1c/d62/f85 [0,4194304] 0 2024-02-22T00:33:20.650 INFO:tasks.workunit.client.1.smithi161.stdout:7/303: write d3/f2b [1808313,112306] 0 2024-02-22T00:33:20.652 INFO:tasks.workunit.client.1.smithi161.stdout:8/360: mkdir d1/d1c/d20/d22/d28/d36/d70 0 2024-02-22T00:33:20.657 INFO:tasks.workunit.client.1.smithi161.stdout:7/304: fsync d3/f9 0 2024-02-22T00:33:20.657 INFO:tasks.workunit.client.1.smithi161.stdout:2/376: truncate de/d11/d5c/f80 505244 0 2024-02-22T00:33:20.657 INFO:tasks.workunit.client.1.smithi161.stdout:3/306: creat da/dc/d11/d26/d2f/d37/d39/f65 x:0 0 0 2024-02-22T00:33:20.657 INFO:tasks.workunit.client.1.smithi161.stdout:8/361: dread - d1/d1c/d20/d22/d3f/f6e zero size 2024-02-22T00:33:20.657 INFO:tasks.workunit.client.1.smithi161.stdout:0/501: dread d14/d44/f85 [0,4194304] 0 2024-02-22T00:33:20.657 INFO:tasks.workunit.client.1.smithi161.stdout:9/347: sync 2024-02-22T00:33:20.658 INFO:tasks.workunit.client.1.smithi161.stdout:5/495: symlink d3/d9c/la9 0 2024-02-22T00:33:20.664 INFO:tasks.workunit.client.1.smithi161.stdout:7/305: symlink d3/df/d33/d35/l68 0 2024-02-22T00:33:20.664 INFO:tasks.workunit.client.1.smithi161.stdout:3/307: mkdir da/dc/d5f/d66 0 2024-02-22T00:33:20.664 INFO:tasks.workunit.client.1.smithi161.stdout:2/377: rename de/d11/d5c/d33/d35 to de/d2b/d83 0 2024-02-22T00:33:20.665 INFO:tasks.workunit.client.1.smithi161.stdout:0/502: creat d14/d37/d42/d73/fa8 x:0 0 0 2024-02-22T00:33:20.667 INFO:tasks.workunit.client.1.smithi161.stdout:5/496: mknod d3/d29/caa 0 2024-02-22T00:33:20.668 INFO:tasks.workunit.client.1.smithi161.stdout:3/308: fdatasync da/dc/d11/d26/f3c 0 2024-02-22T00:33:20.669 INFO:tasks.workunit.client.1.smithi161.stdout:3/309: chown da/d56/l5d 0 1 2024-02-22T00:33:20.670 INFO:tasks.workunit.client.1.smithi161.stdout:3/310: fsync da/dc/f1f 0 2024-02-22T00:33:20.671 INFO:tasks.workunit.client.1.smithi161.stdout:8/362: rename d1/d19 to d1/d1c/d71 0 2024-02-22T00:33:20.678 INFO:tasks.workunit.client.1.smithi161.stdout:2/378: symlink de/d11/d5c/l84 0 2024-02-22T00:33:20.680 INFO:tasks.workunit.client.1.smithi161.stdout:8/363: unlink d1/d1c/d20/d22/d3f/l40 0 2024-02-22T00:33:20.680 INFO:tasks.workunit.client.1.smithi161.stdout:6/286: dread d3/d10/d1b/f2e [0,4194304] 0 2024-02-22T00:33:20.681 INFO:tasks.workunit.client.1.smithi161.stdout:0/503: dwrite d14/d1a/d3f/d5d/f8a [4194304,4194304] 0 2024-02-22T00:33:20.681 INFO:tasks.workunit.client.1.smithi161.stdout:9/348: getdents d1/d5 0 2024-02-22T00:33:20.683 INFO:tasks.workunit.client.1.smithi161.stdout:5/497: fdatasync d3/d1b/d36/f55 0 2024-02-22T00:33:20.685 INFO:tasks.workunit.client.1.smithi161.stdout:2/379: unlink de/d2b/d65/d3a/f40 0 2024-02-22T00:33:20.686 INFO:tasks.workunit.client.1.smithi161.stdout:3/311: write da/dc/d11/d26/d2f/d37/d39/f3d [776839,11496] 0 2024-02-22T00:33:20.686 INFO:tasks.workunit.client.1.smithi161.stdout:9/349: write d1/d2/f1a [7245815,41046] 0 2024-02-22T00:33:20.687 INFO:tasks.workunit.client.1.smithi161.stdout:0/504: write d14/d37/f76 [347313,105046] 0 2024-02-22T00:33:20.690 INFO:tasks.workunit.client.1.smithi161.stdout:8/364: mknod d1/d1c/d20/d5a/c72 0 2024-02-22T00:33:20.692 INFO:tasks.workunit.client.1.smithi161.stdout:7/306: dread f2 [4194304,4194304] 0 2024-02-22T00:33:20.693 INFO:tasks.workunit.client.1.smithi161.stdout:0/505: write d14/d37/f76 [365441,44858] 0 2024-02-22T00:33:20.696 INFO:tasks.workunit.client.1.smithi161.stdout:6/287: truncate d3/f6 341190 0 2024-02-22T00:33:20.697 INFO:tasks.workunit.client.1.smithi161.stdout:1/410: sync 2024-02-22T00:33:20.698 INFO:tasks.workunit.client.1.smithi161.stdout:4/382: sync 2024-02-22T00:33:20.698 INFO:tasks.workunit.client.1.smithi161.stdout:9/350: creat d1/d2/d7/da/f75 x:0 0 0 2024-02-22T00:33:20.700 INFO:tasks.workunit.client.1.smithi161.stdout:7/307: truncate d3/fa 4913072 0 2024-02-22T00:33:20.700 INFO:tasks.workunit.client.1.smithi161.stdout:8/365: readlink d1/d1c/d20/d22/d3f/l61 0 2024-02-22T00:33:20.701 INFO:tasks.workunit.client.1.smithi161.stdout:0/506: dread - d14/d37/d42/d8e/f95 zero size 2024-02-22T00:33:20.705 INFO:tasks.workunit.client.1.smithi161.stdout:4/383: symlink d5/d17/d5c/l90 0 2024-02-22T00:33:20.705 INFO:tasks.workunit.client.1.smithi161.stdout:1/411: symlink d19/d51/d6c/l97 0 2024-02-22T00:33:20.705 INFO:tasks.workunit.client.1.smithi161.stdout:9/351: truncate d1/d5/f3e 335599 0 2024-02-22T00:33:20.707 INFO:tasks.workunit.client.1.smithi161.stdout:0/507: chown d14/d37/d42/d8e/d92 2 1 2024-02-22T00:33:20.709 INFO:tasks.workunit.client.1.smithi161.stdout:2/380: getdents de/d2b/d83 0 2024-02-22T00:33:20.709 INFO:tasks.workunit.client.1.smithi161.stdout:6/288: link d3/dc/f27 d3/d10/f55 0 2024-02-22T00:33:20.712 INFO:tasks.workunit.client.1.smithi161.stdout:7/308: dread d3/df/d33/f40 [0,4194304] 0 2024-02-22T00:33:20.713 INFO:tasks.workunit.client.1.smithi161.stdout:3/312: dwrite da/dc/f17 [0,4194304] 0 2024-02-22T00:33:20.715 INFO:tasks.workunit.client.1.smithi161.stdout:7/309: write d3/dd/f1d [709282,6314] 0 2024-02-22T00:33:20.720 INFO:tasks.workunit.client.1.smithi161.stdout:5/498: truncate d3/d1b/d36/f52 7639699 0 2024-02-22T00:33:20.720 INFO:tasks.workunit.client.1.smithi161.stdout:7/310: fsync d3/f2b 0 2024-02-22T00:33:20.720 INFO:tasks.workunit.client.1.smithi161.stdout:4/384: mkdir d5/d8/d41/d53/d6c/d91 0 2024-02-22T00:33:20.720 INFO:tasks.workunit.client.1.smithi161.stdout:6/289: mknod d3/d10/d1b/c56 0 2024-02-22T00:33:20.721 INFO:tasks.workunit.client.1.smithi161.stdout:8/366: link d1/d1c/d71/c13 d1/d2f/d37/c73 0 2024-02-22T00:33:20.722 INFO:tasks.workunit.client.1.smithi161.stdout:1/412: unlink d19/f1b 0 2024-02-22T00:33:20.723 INFO:tasks.workunit.client.1.smithi161.stdout:0/508: creat d14/d37/d42/d8e/fa9 x:0 0 0 2024-02-22T00:33:20.724 INFO:tasks.workunit.client.1.smithi161.stdout:5/499: write d3/d1c/d20/d74/fa5 [167463,74498] 0 2024-02-22T00:33:20.724 INFO:tasks.workunit.client.1.smithi161.stdout:8/367: fdatasync d1/d1c/d20/f2b 0 2024-02-22T00:33:20.724 INFO:tasks.workunit.client.1.smithi161.stdout:3/313: symlink da/dc/d11/d40/d59/l67 0 2024-02-22T00:33:20.727 INFO:tasks.workunit.client.1.smithi161.stdout:6/290: mknod d3/dc/c57 0 2024-02-22T00:33:20.728 INFO:tasks.workunit.client.1.smithi161.stdout:3/314: readlink da/l43 0 2024-02-22T00:33:20.728 INFO:tasks.workunit.client.1.smithi161.stdout:6/291: stat d3/d30 0 2024-02-22T00:33:20.731 INFO:tasks.workunit.client.1.smithi161.stdout:7/311: mknod d3/dd/d59/d5b/d26/c69 0 2024-02-22T00:33:20.731 INFO:tasks.workunit.client.1.smithi161.stdout:6/292: write d3/dc/df/d32/f4b [2484443,102824] 0 2024-02-22T00:33:20.733 INFO:tasks.workunit.client.1.smithi161.stdout:2/381: creat de/f85 x:0 0 0 2024-02-22T00:33:20.740 INFO:tasks.workunit.client.1.smithi161.stdout:9/352: link d1/d2/d4/f2a d1/d5/d9/f76 0 2024-02-22T00:33:20.745 INFO:tasks.workunit.client.1.smithi161.stdout:6/293: rmdir d3/d10/d12 39 2024-02-22T00:33:20.746 INFO:tasks.workunit.client.1.smithi161.stdout:0/509: mknod d14/d1a/d3f/caa 0 2024-02-22T00:33:20.748 INFO:tasks.workunit.client.1.smithi161.stdout:0/510: chown d14/d29/l32 15 1 2024-02-22T00:33:20.748 INFO:tasks.workunit.client.1.smithi161.stdout:8/368: truncate d1/d1c/d20/d22/d3f/f63 960827 0 2024-02-22T00:33:20.748 INFO:tasks.workunit.client.1.smithi161.stdout:4/385: write d5/d17/f1e [3404484,64344] 0 2024-02-22T00:33:20.748 INFO:tasks.workunit.client.1.smithi161.stdout:7/312: dread d3/fa [0,4194304] 0 2024-02-22T00:33:20.750 INFO:tasks.workunit.client.1.smithi161.stdout:5/500: symlink d3/d29/d80/d92/lab 0 2024-02-22T00:33:20.752 INFO:tasks.workunit.client.1.smithi161.stdout:9/353: rename d1/d2/d4/d5a to d1/d25/d73/d60/d77 0 2024-02-22T00:33:20.753 INFO:tasks.workunit.client.1.smithi161.stdout:9/354: fsync d1/d2/d4/d11/f31 0 2024-02-22T00:33:20.754 INFO:tasks.workunit.client.1.smithi161.stdout:1/413: write f5 [454474,21712] 0 2024-02-22T00:33:20.756 INFO:tasks.workunit.client.1.smithi161.stdout:6/294: rmdir d3/d10/d1b 39 2024-02-22T00:33:20.758 INFO:tasks.workunit.client.1.smithi161.stdout:6/295: truncate d3/f15 2011070 0 2024-02-22T00:33:20.761 INFO:tasks.workunit.client.1.smithi161.stdout:6/296: chown d3/d48/d50/f52 123392748 1 2024-02-22T00:33:20.763 INFO:tasks.workunit.client.1.smithi161.stdout:6/297: read d3/dc/f27 [733591,128552] 0 2024-02-22T00:33:20.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/355: dwrite d1/d2/f6d [0,4194304] 0 2024-02-22T00:33:20.765 INFO:tasks.workunit.client.1.smithi161.stdout:9/356: readlink d1/d5/l8 0 2024-02-22T00:33:20.766 INFO:tasks.workunit.client.1.smithi161.stdout:3/315: truncate da/dc/d11/d26/d2f/d37/f49 307606 0 2024-02-22T00:33:20.769 INFO:tasks.workunit.client.1.smithi161.stdout:2/382: truncate de/f50 2573700 0 2024-02-22T00:33:20.769 INFO:tasks.workunit.client.1.smithi161.stdout:9/357: fsync d1/d5/d9/d33/f32 0 2024-02-22T00:33:20.769 INFO:tasks.workunit.client.1.smithi161.stdout:7/313: dread d3/f7 [0,4194304] 0 2024-02-22T00:33:20.769 INFO:tasks.workunit.client.1.smithi161.stdout:1/414: mkdir d19/d1d/d2c/d4f/d98 0 2024-02-22T00:33:20.769 INFO:tasks.workunit.client.1.smithi161.stdout:4/386: write d5/d10/f4d [1156341,6082] 0 2024-02-22T00:33:20.774 INFO:tasks.workunit.client.1.smithi161.stdout:0/511: rename d14/d29/f68 to d14/d37/d42/d73/fab 0 2024-02-22T00:33:20.777 INFO:tasks.workunit.client.1.smithi161.stdout:3/316: unlink da/dc/l1e 0 2024-02-22T00:33:20.778 INFO:tasks.workunit.client.1.smithi161.stdout:3/317: fsync da/d29/f62 0 2024-02-22T00:33:20.779 INFO:tasks.workunit.client.1.smithi161.stdout:2/383: unlink de/d2b/d83/f5d 0 2024-02-22T00:33:20.780 INFO:tasks.workunit.client.1.smithi161.stdout:7/314: dread d3/f36 [0,4194304] 0 2024-02-22T00:33:20.781 INFO:tasks.workunit.client.1.smithi161.stdout:1/415: mkdir d19/d51/d64/d99 0 2024-02-22T00:33:20.781 INFO:tasks.workunit.client.1.smithi161.stdout:2/384: dread - de/d11/d5c/f69 zero size 2024-02-22T00:33:20.783 INFO:tasks.workunit.client.1.smithi161.stdout:2/385: chown de/d2b/d65/d3a 338122660 1 2024-02-22T00:33:20.784 INFO:tasks.workunit.client.1.smithi161.stdout:4/387: creat d5/d17/f92 x:0 0 0 2024-02-22T00:33:20.788 INFO:tasks.workunit.client.1.smithi161.stdout:2/386: write de/f1c [680084,105285] 0 2024-02-22T00:33:20.791 INFO:tasks.workunit.client.1.smithi161.stdout:3/318: mkdir da/dc/d5f/d68 0 2024-02-22T00:33:20.792 INFO:tasks.workunit.client.1.smithi161.stdout:8/369: truncate d1/d1c/d20/d22/d3f/f51 3381148 0 2024-02-22T00:33:20.795 INFO:tasks.workunit.client.1.smithi161.stdout:6/298: dread d3/dc/df/d32/f4b [0,4194304] 0 2024-02-22T00:33:20.795 INFO:tasks.workunit.client.1.smithi161.stdout:1/416: dwrite d19/d48/f50 [0,4194304] 0 2024-02-22T00:33:20.798 INFO:tasks.workunit.client.1.smithi161.stdout:7/315: symlink d3/df/d33/d53/l6a 0 2024-02-22T00:33:20.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/512: dread d14/d29/f5c [0,4194304] 0 2024-02-22T00:33:20.800 INFO:tasks.workunit.client.1.smithi161.stdout:5/501: rename d3/d1c/d20/d74 to d3/dac 0 2024-02-22T00:33:20.800 INFO:tasks.workunit.client.1.smithi161.stdout:7/316: chown d3/fa 0 1 2024-02-22T00:33:20.802 INFO:tasks.workunit.client.1.smithi161.stdout:8/370: creat d1/d2f/d30/f74 x:0 0 0 2024-02-22T00:33:20.803 INFO:tasks.workunit.client.1.smithi161.stdout:0/513: chown d14/f35 51206 1 2024-02-22T00:33:20.804 INFO:tasks.workunit.client.1.smithi161.stdout:2/387: dwrite de/d11/d5c/f69 [0,4194304] 0 2024-02-22T00:33:20.805 INFO:tasks.workunit.client.1.smithi161.stdout:4/388: link d5/d10/d14/f5d d5/d17/f93 0 2024-02-22T00:33:20.811 INFO:tasks.workunit.client.1.smithi161.stdout:9/358: rename d1/d2/d4/c69 to d1/d5/d9/d33/d4f/c78 0 2024-02-22T00:33:20.811 INFO:tasks.workunit.client.1.smithi161.stdout:5/502: rmdir d3/d1b/d25/d4c/d7b 39 2024-02-22T00:33:20.812 INFO:tasks.workunit.client.1.smithi161.stdout:9/359: read - d1/d25/d73/d60/f61 zero size 2024-02-22T00:33:20.812 INFO:tasks.workunit.client.1.smithi161.stdout:7/317: symlink d3/dd/d59/d5b/l6b 0 2024-02-22T00:33:20.816 INFO:tasks.workunit.client.1.smithi161.stdout:8/371: rename d1/d1c/d71 to d1/d1c/d75 0 2024-02-22T00:33:20.817 INFO:tasks.workunit.client.1.smithi161.stdout:8/372: truncate d1/d1c/d75/f3a 826929 0 2024-02-22T00:33:20.818 INFO:tasks.workunit.client.1.smithi161.stdout:5/503: dread d3/d1c/d20/f71 [0,4194304] 0 2024-02-22T00:33:20.819 INFO:tasks.workunit.client.1.smithi161.stdout:2/388: mknod de/d2b/d83/d4f/c86 0 2024-02-22T00:33:20.820 INFO:tasks.workunit.client.1.smithi161.stdout:5/504: truncate d3/d1b/d36/f83 585010 0 2024-02-22T00:33:20.821 INFO:tasks.workunit.client.1.smithi161.stdout:3/319: link da/f1a da/dc/d11/d40/f69 0 2024-02-22T00:33:20.824 INFO:tasks.workunit.client.1.smithi161.stdout:1/417: symlink d19/l9a 0 2024-02-22T00:33:20.824 INFO:tasks.workunit.client.1.smithi161.stdout:3/320: write da/dc/d11/f3e [1358937,56026] 0 2024-02-22T00:33:20.826 INFO:tasks.workunit.client.1.smithi161.stdout:4/389: creat d5/d10/d14/d24/d28/d63/d65/f94 x:0 0 0 2024-02-22T00:33:20.829 INFO:tasks.workunit.client.1.smithi161.stdout:9/360: creat d1/d2/d4/f79 x:0 0 0 2024-02-22T00:33:20.832 INFO:tasks.workunit.client.1.smithi161.stdout:7/318: creat d3/dd/d60/f6c x:0 0 0 2024-02-22T00:33:20.833 INFO:tasks.workunit.client.1.smithi161.stdout:4/390: dwrite d5/d10/f4d [0,4194304] 0 2024-02-22T00:33:20.835 INFO:tasks.workunit.client.1.smithi161.stdout:7/319: read d3/f9 [627208,62020] 0 2024-02-22T00:33:20.837 INFO:tasks.workunit.client.1.smithi161.stdout:5/505: creat d3/d1b/d91/fad x:0 0 0 2024-02-22T00:33:20.838 INFO:tasks.workunit.client.1.smithi161.stdout:5/506: chown d3/d29/d80/d92 33811 1 2024-02-22T00:33:20.840 INFO:tasks.workunit.client.1.smithi161.stdout:1/418: mkdir d19/d51/d64/d9b 0 2024-02-22T00:33:20.842 INFO:tasks.workunit.client.1.smithi161.stdout:3/321: creat da/dc/d11/d40/f6a x:0 0 0 2024-02-22T00:33:20.846 INFO:tasks.workunit.client.1.smithi161.stdout:4/391: dread d5/d8/f9 [0,4194304] 0 2024-02-22T00:33:20.847 INFO:tasks.workunit.client.1.smithi161.stdout:8/373: link d1/d1c/d20/d31/f50 d1/d1c/f76 0 2024-02-22T00:33:20.849 INFO:tasks.workunit.client.1.smithi161.stdout:2/389: link de/d11/f63 de/d2b/d83/f87 0 2024-02-22T00:33:20.851 INFO:tasks.workunit.client.1.smithi161.stdout:2/390: readlink de/d2b/d65/d3a/l4a 0 2024-02-22T00:33:20.852 INFO:tasks.workunit.client.1.smithi161.stdout:1/419: readlink le 0 2024-02-22T00:33:20.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/361: truncate d1/d2/d4/f2a 2088396 0 2024-02-22T00:33:20.854 INFO:tasks.workunit.client.1.smithi161.stdout:2/391: write f3 [7600566,29566] 0 2024-02-22T00:33:20.855 INFO:tasks.workunit.client.1.smithi161.stdout:7/320: mkdir d3/df/d6d 0 2024-02-22T00:33:20.858 INFO:tasks.workunit.client.1.smithi161.stdout:5/507: mkdir d3/d1c/da7/dae 0 2024-02-22T00:33:20.860 INFO:tasks.workunit.client.1.smithi161.stdout:3/322: mknod da/dc/d5f/d68/c6b 0 2024-02-22T00:33:20.860 INFO:tasks.workunit.client.1.smithi161.stdout:8/374: dwrite d1/d1c/d75/d18/f45 [0,4194304] 0 2024-02-22T00:33:20.864 INFO:tasks.workunit.client.1.smithi161.stdout:4/392: truncate f3 2415502 0 2024-02-22T00:33:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:8/375: chown d1/d1c/d20/d22/d28/d36 2 1 2024-02-22T00:33:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:9/362: creat d1/d5/d9/d33/f7a x:0 0 0 2024-02-22T00:33:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:0/514: dwrite d14/d1a/f63 [0,4194304] 0 2024-02-22T00:33:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:7/321: creat d3/dd/d59/d5b/d26/d30/d44/f6e x:0 0 0 2024-02-22T00:33:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:4/393: symlink d5/d8/d41/l95 0 2024-02-22T00:33:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:0/515: write d14/d1a/f1b [3152525,100826] 0 2024-02-22T00:33:20.880 INFO:tasks.workunit.client.1.smithi161.stdout:1/420: dread d19/f43 [0,4194304] 0 2024-02-22T00:33:20.881 INFO:tasks.workunit.client.1.smithi161.stdout:2/392: rename de/d11/d5c/f36 to de/d2b/d65/d3a/f88 0 2024-02-22T00:33:20.881 INFO:tasks.workunit.client.1.smithi161.stdout:3/323: creat da/f6c x:0 0 0 2024-02-22T00:33:20.881 INFO:tasks.workunit.client.1.smithi161.stdout:4/394: stat d5/d10/d14/d24/d28/d63/l67 0 2024-02-22T00:33:20.881 INFO:tasks.workunit.client.1.smithi161.stdout:1/421: chown d19/f49 3 1 2024-02-22T00:33:20.881 INFO:tasks.workunit.client.1.smithi161.stdout:9/363: unlink d1/d2/d4/l4e 0 2024-02-22T00:33:20.881 INFO:tasks.workunit.client.1.smithi161.stdout:1/422: write d19/d1d/d2c/d2d/f75 [13957,100436] 0 2024-02-22T00:33:20.882 INFO:tasks.workunit.client.1.smithi161.stdout:8/376: truncate d1/d2f/f5e 1015778 0 2024-02-22T00:33:20.882 INFO:tasks.workunit.client.1.smithi161.stdout:0/516: dread d14/f16 [0,4194304] 0 2024-02-22T00:33:20.887 INFO:tasks.workunit.client.1.smithi161.stdout:7/322: mkdir d3/df/d33/d35/d55/d6f 0 2024-02-22T00:33:20.889 INFO:tasks.workunit.client.1.smithi161.stdout:3/324: creat da/dc/d5f/d68/f6d x:0 0 0 2024-02-22T00:33:20.890 INFO:tasks.workunit.client.1.smithi161.stdout:9/364: creat d1/d5/f7b x:0 0 0 2024-02-22T00:33:20.890 INFO:tasks.workunit.client.1.smithi161.stdout:7/323: dread d3/f14 [4194304,4194304] 0 2024-02-22T00:33:20.891 INFO:tasks.workunit.client.1.smithi161.stdout:9/365: write d1/d2/f2e [1592325,40874] 0 2024-02-22T00:33:20.892 INFO:tasks.workunit.client.1.smithi161.stdout:2/393: truncate de/d11/f4e 126929 0 2024-02-22T00:33:20.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/394: stat de/d11/d5c/l84 0 2024-02-22T00:33:20.894 INFO:tasks.workunit.client.1.smithi161.stdout:1/423: unlink d19/d1d/d2c/d2d/f59 0 2024-02-22T00:33:20.895 INFO:tasks.workunit.client.1.smithi161.stdout:1/424: chown d19/d48 210030 1 2024-02-22T00:33:20.896 INFO:tasks.workunit.client.1.smithi161.stdout:8/377: creat d1/d1c/f77 x:0 0 0 2024-02-22T00:33:20.898 INFO:tasks.workunit.client.1.smithi161.stdout:0/517: rename d14/d1a/l3b to d14/d37/d42/lac 0 2024-02-22T00:33:20.900 INFO:tasks.workunit.client.1.smithi161.stdout:3/325: creat da/dc/d5f/f6e x:0 0 0 2024-02-22T00:33:20.902 INFO:tasks.workunit.client.1.smithi161.stdout:1/425: dwrite d19/d48/d68/f71 [0,4194304] 0 2024-02-22T00:33:20.905 INFO:tasks.workunit.client.1.smithi161.stdout:7/324: unlink d3/df/d33/l47 0 2024-02-22T00:33:20.906 INFO:tasks.workunit.client.1.smithi161.stdout:0/518: dwrite f11 [0,4194304] 0 2024-02-22T00:33:20.909 INFO:tasks.workunit.client.1.smithi161.stdout:9/366: creat d1/d25/d73/d60/d77/f7c x:0 0 0 2024-02-22T00:33:20.913 INFO:tasks.workunit.client.1.smithi161.stdout:8/378: mknod d1/d1c/d20/d5a/c78 0 2024-02-22T00:33:20.914 INFO:tasks.workunit.client.1.smithi161.stdout:4/395: link d5/d17/l56 d5/d17/l96 0 2024-02-22T00:33:20.919 INFO:tasks.workunit.client.1.smithi161.stdout:8/379: rmdir d1/d2f/d37 39 2024-02-22T00:33:20.920 INFO:tasks.workunit.client.1.smithi161.stdout:8/380: dread - d1/d1c/d20/d31/f50 zero size 2024-02-22T00:33:20.921 INFO:tasks.workunit.client.1.smithi161.stdout:1/426: getdents d19/d1d/d2c/d4f/d98 0 2024-02-22T00:33:20.922 INFO:tasks.workunit.client.1.smithi161.stdout:1/427: chown d19/d1d/f57 1035118 1 2024-02-22T00:33:20.928 INFO:tasks.workunit.client.1.smithi161.stdout:8/381: creat d1/d1c/d20/d5a/f79 x:0 0 0 2024-02-22T00:33:20.929 INFO:tasks.workunit.client.1.smithi161.stdout:7/325: link d3/dd/d59/d5b/d26/f29 d3/dd/d59/d5b/d26/f70 0 2024-02-22T00:33:20.929 INFO:tasks.workunit.client.1.smithi161.stdout:4/396: link d5/d8/ld d5/d8/d41/d57/l97 0 2024-02-22T00:33:20.931 INFO:tasks.workunit.client.1.smithi161.stdout:3/326: getdents da 0 2024-02-22T00:33:20.933 INFO:tasks.workunit.client.1.smithi161.stdout:7/326: fsync d3/df/d33/f45 0 2024-02-22T00:33:20.933 INFO:tasks.workunit.client.1.smithi161.stdout:0/519: getdents d14/d44 0 2024-02-22T00:33:20.933 INFO:tasks.workunit.client.1.smithi161.stdout:1/428: dwrite d19/f37 [0,4194304] 0 2024-02-22T00:33:20.935 INFO:tasks.workunit.client.1.smithi161.stdout:1/429: chown d19/d48/f5c 201260926 1 2024-02-22T00:33:20.937 INFO:tasks.workunit.client.1.smithi161.stdout:3/327: write da/dc/d11/d40/f6a [280430,46577] 0 2024-02-22T00:33:20.938 INFO:tasks.workunit.client.1.smithi161.stdout:0/520: readlink d14/d44/l50 0 2024-02-22T00:33:20.938 INFO:tasks.workunit.client.1.smithi161.stdout:1/430: truncate f5 1077124 0 2024-02-22T00:33:20.939 INFO:tasks.workunit.client.1.smithi161.stdout:8/382: creat d1/d1c/d20/d22/d28/d36/f7a x:0 0 0 2024-02-22T00:33:20.940 INFO:tasks.workunit.client.1.smithi161.stdout:0/521: chown d14/d37/d42/l4f 17 1 2024-02-22T00:33:20.943 INFO:tasks.workunit.client.1.smithi161.stdout:4/397: rename d5/f5b to d5/d10/d14/d24/d28/d63/f98 0 2024-02-22T00:33:20.945 INFO:tasks.workunit.client.1.smithi161.stdout:0/522: dread d14/d29/f5c [0,4194304] 0 2024-02-22T00:33:20.946 INFO:tasks.workunit.client.1.smithi161.stdout:1/431: creat d19/d51/d6c/f9c x:0 0 0 2024-02-22T00:33:20.948 INFO:tasks.workunit.client.1.smithi161.stdout:3/328: creat da/dc/d5f/d66/f6f x:0 0 0 2024-02-22T00:33:20.949 INFO:tasks.workunit.client.1.smithi161.stdout:4/398: mknod d5/d17/c99 0 2024-02-22T00:33:20.961 INFO:tasks.workunit.client.1.smithi161.stdout:8/383: getdents d1/d1c/d20/d31 0 2024-02-22T00:33:20.968 INFO:tasks.workunit.client.1.smithi161.stdout:2/395: dwrite de/d2b/d83/f87 [4194304,4194304] 0 2024-02-22T00:33:20.971 INFO:tasks.workunit.client.1.smithi161.stdout:0/523: dread d14/d1a/f23 [0,4194304] 0 2024-02-22T00:33:20.973 INFO:tasks.workunit.client.1.smithi161.stdout:4/399: dread d5/d8/d41/f46 [0,4194304] 0 2024-02-22T00:33:20.975 INFO:tasks.workunit.client.1.smithi161.stdout:3/329: dwrite da/dc/d11/f55 [0,4194304] 0 2024-02-22T00:33:20.977 INFO:tasks.workunit.client.1.smithi161.stdout:1/432: dwrite d19/d51/d6c/f77 [0,4194304] 0 2024-02-22T00:33:20.986 INFO:tasks.workunit.client.1.smithi161.stdout:8/384: dwrite d1/d1c/d20/d22/f62 [0,4194304] 0 2024-02-22T00:33:20.988 INFO:tasks.workunit.client.1.smithi161.stdout:2/396: dwrite de/f21 [0,4194304] 0 2024-02-22T00:33:20.991 INFO:tasks.workunit.client.1.smithi161.stdout:4/400: rename d5/d10/d14/d24/d28/f8f to d5/d10/d75/f9a 0 2024-02-22T00:33:20.994 INFO:tasks.workunit.client.1.smithi161.stdout:3/330: fsync da/dc/d11/d26/d2f/d37/f49 0 2024-02-22T00:33:21.000 INFO:tasks.workunit.client.1.smithi161.stdout:4/401: symlink d5/d10/l9b 0 2024-02-22T00:33:21.000 INFO:tasks.workunit.client.1.smithi161.stdout:3/331: symlink da/dc/d11/d26/l70 0 2024-02-22T00:33:21.005 INFO:tasks.workunit.client.1.smithi161.stdout:4/402: readlink d5/d17/l96 0 2024-02-22T00:33:21.006 INFO:tasks.workunit.client.1.smithi161.stdout:4/403: chown f2 324607 1 2024-02-22T00:33:21.006 INFO:tasks.workunit.client.1.smithi161.stdout:0/524: truncate d14/f18 4878196 0 2024-02-22T00:33:21.007 INFO:tasks.workunit.client.1.smithi161.stdout:3/332: fsync da/dc/d11/d26/f19 0 2024-02-22T00:33:21.011 INFO:tasks.workunit.client.1.smithi161.stdout:0/525: write d14/d1a/d3f/f4c [1472028,54459] 0 2024-02-22T00:33:21.012 INFO:tasks.workunit.client.1.smithi161.stdout:4/404: mknod d5/d10/d14/d24/d28/c9c 0 2024-02-22T00:33:21.014 INFO:tasks.workunit.client.1.smithi161.stdout:0/526: mkdir d14/d1a/d3f/d96/dad 0 2024-02-22T00:33:21.017 INFO:tasks.workunit.client.1.smithi161.stdout:0/527: write d14/f9e [150890,34994] 0 2024-02-22T00:33:21.019 INFO:tasks.workunit.client.1.smithi161.stdout:0/528: stat d14/d1a/d3f/d5d 0 2024-02-22T00:33:21.023 INFO:tasks.workunit.client.1.smithi161.stdout:4/405: truncate d5/f13 162786 0 2024-02-22T00:33:21.026 INFO:tasks.workunit.client.1.smithi161.stdout:8/385: dwrite d1/d1c/d20/d22/d3f/f6e [0,4194304] 0 2024-02-22T00:33:21.032 INFO:tasks.workunit.client.1.smithi161.stdout:4/406: mkdir d5/d10/d14/d24/d28/d63/d65/d9d 0 2024-02-22T00:33:21.033 INFO:tasks.workunit.client.1.smithi161.stdout:8/386: write d1/d1c/d20/d22/d28/d36/f7a [125343,16054] 0 2024-02-22T00:33:21.037 INFO:tasks.workunit.client.1.smithi161.stdout:3/333: dread da/dc/d11/d26/f45 [0,4194304] 0 2024-02-22T00:33:21.041 INFO:tasks.workunit.client.1.smithi161.stdout:3/334: creat da/dc/d11/f71 x:0 0 0 2024-02-22T00:33:21.043 INFO:tasks.workunit.client.1.smithi161.stdout:8/387: rename d1/d1c/d20/d5a to d1/d2f/d37/d64/d7b 0 2024-02-22T00:33:21.044 INFO:tasks.workunit.client.1.smithi161.stdout:8/388: fdatasync d1/d1c/d75/f15 0 2024-02-22T00:33:21.045 INFO:tasks.workunit.client.1.smithi161.stdout:8/389: readlink d1/d2f/l4e 0 2024-02-22T00:33:21.045 INFO:tasks.workunit.client.1.smithi161.stdout:3/335: creat da/d29/f72 x:0 0 0 2024-02-22T00:33:21.048 INFO:tasks.workunit.client.1.smithi161.stdout:8/390: mknod d1/d1c/d20/c7c 0 2024-02-22T00:33:21.058 INFO:tasks.workunit.client.1.smithi161.stdout:3/336: dwrite da/dc/f51 [0,4194304] 0 2024-02-22T00:33:21.063 INFO:tasks.workunit.client.1.smithi161.stdout:8/391: truncate d1/d1c/d20/d22/d28/d36/f46 958658 0 2024-02-22T00:33:21.063 INFO:tasks.workunit.client.1.smithi161.stdout:4/407: dwrite d5/d10/d14/f5d [0,4194304] 0 2024-02-22T00:33:21.068 INFO:tasks.workunit.client.1.smithi161.stdout:3/337: rename f2 to da/dc/d5f/f73 0 2024-02-22T00:33:21.069 INFO:tasks.workunit.client.1.smithi161.stdout:0/529: dwrite d14/f18 [4194304,4194304] 0 2024-02-22T00:33:21.077 INFO:tasks.workunit.client.1.smithi161.stdout:4/408: unlink d5/d17/c99 0 2024-02-22T00:33:21.077 INFO:tasks.workunit.client.1.smithi161.stdout:3/338: mkdir da/dc/d11/d40/d74 0 2024-02-22T00:33:21.086 INFO:tasks.workunit.client.1.smithi161.stdout:3/339: truncate da/dc/d11/d26/f3c 700156 0 2024-02-22T00:33:21.089 INFO:tasks.workunit.client.1.smithi161.stdout:8/392: dwrite d1/d1c/d20/d31/f50 [0,4194304] 0 2024-02-22T00:33:21.091 INFO:tasks.workunit.client.1.smithi161.stdout:3/340: mknod da/dc/d11/d26/d2f/c75 0 2024-02-22T00:33:21.092 INFO:tasks.workunit.client.1.smithi161.stdout:8/393: creat d1/d2f/d37/f7d x:0 0 0 2024-02-22T00:33:21.093 INFO:tasks.workunit.client.1.smithi161.stdout:3/341: fsync da/dc/d11/d26/d2f/f41 0 2024-02-22T00:33:21.096 INFO:tasks.workunit.client.1.smithi161.stdout:8/394: mkdir d1/d2f/d37/d64/d7b/d7e 0 2024-02-22T00:33:21.097 INFO:tasks.workunit.client.1.smithi161.stdout:3/342: mknod da/dc/d11/d26/c76 0 2024-02-22T00:33:21.097 INFO:tasks.workunit.client.1.smithi161.stdout:8/395: write d1/d1c/d20/d22/d28/f2e [65831,116934] 0 2024-02-22T00:33:21.100 INFO:tasks.workunit.client.1.smithi161.stdout:4/409: truncate d5/d10/d14/d24/d28/f7c 2674568 0 2024-02-22T00:33:21.104 INFO:tasks.workunit.client.1.smithi161.stdout:8/396: mkdir d1/d1c/d20/d22/d28/d7f 0 2024-02-22T00:33:21.106 INFO:tasks.workunit.client.1.smithi161.stdout:3/343: link da/dc/d11/d26/d2f/d37/l4a da/dc/d11/d26/d2f/l77 0 2024-02-22T00:33:21.107 INFO:tasks.workunit.client.1.smithi161.stdout:8/397: write d1/d2f/d37/d64/d7b/f79 [198922,103804] 0 2024-02-22T00:33:21.109 INFO:tasks.workunit.client.1.smithi161.stdout:3/344: fdatasync da/dc/d11/d26/d2f/d37/d39/f3f 0 2024-02-22T00:33:21.110 INFO:tasks.workunit.client.1.smithi161.stdout:3/345: write da/dc/d11/f3e [1285328,60986] 0 2024-02-22T00:33:21.111 INFO:tasks.workunit.client.1.smithi161.stdout:8/398: creat d1/d2f/d37/d64/d7b/d7e/f80 x:0 0 0 2024-02-22T00:33:21.114 INFO:tasks.workunit.client.1.smithi161.stdout:8/399: write d1/d2f/d37/d64/d7b/f79 [1234594,41974] 0 2024-02-22T00:33:21.115 INFO:tasks.workunit.client.1.smithi161.stdout:8/400: dread - d1/d2f/d37/d64/d7b/d7e/f80 zero size 2024-02-22T00:33:21.116 INFO:tasks.workunit.client.1.smithi161.stdout:3/346: link da/dc/d11/d26/d2f/c75 da/dc/d11/d26/d2f/d37/d39/c78 0 2024-02-22T00:33:21.117 INFO:tasks.workunit.client.1.smithi161.stdout:8/401: chown d1/d2f/d30/f74 39231777 1 2024-02-22T00:33:21.119 INFO:tasks.workunit.client.1.smithi161.stdout:8/402: mknod d1/d2f/d37/c81 0 2024-02-22T00:33:21.121 INFO:tasks.workunit.client.1.smithi161.stdout:4/410: dread d5/d8/d41/d53/d6c/d72/f8e [0,4194304] 0 2024-02-22T00:33:21.122 INFO:tasks.workunit.client.1.smithi161.stdout:8/403: creat d1/d1c/d20/d22/d3f/f82 x:0 0 0 2024-02-22T00:33:21.131 INFO:tasks.workunit.client.1.smithi161.stdout:4/411: mknod d5/d10/d14/d24/d28/d63/d65/d9d/c9e 0 2024-02-22T00:33:21.132 INFO:tasks.workunit.client.1.smithi161.stdout:8/404: rename d1/c17 to d1/d1c/d20/d22/d28/d7f/c83 0 2024-02-22T00:33:21.132 INFO:tasks.workunit.client.1.smithi161.stdout:3/347: write da/dc/d11/d26/f45 [4784707,36779] 0 2024-02-22T00:33:21.133 INFO:tasks.workunit.client.1.smithi161.stdout:4/412: write d5/d10/d14/d24/d28/d63/f98 [938910,40045] 0 2024-02-22T00:33:21.135 INFO:tasks.workunit.client.1.smithi161.stdout:8/405: creat d1/d2f/f84 x:0 0 0 2024-02-22T00:33:21.136 INFO:tasks.workunit.client.1.smithi161.stdout:4/413: stat d5/d10/d14/d24/d28/c44 0 2024-02-22T00:33:21.137 INFO:tasks.workunit.client.1.smithi161.stdout:8/406: write d1/d1c/d75/d18/f45 [62081,28411] 0 2024-02-22T00:33:21.140 INFO:tasks.workunit.client.1.smithi161.stdout:4/414: unlink d5/c11 0 2024-02-22T00:33:21.140 INFO:tasks.workunit.client.1.smithi161.stdout:3/348: dread da/dc/d11/d26/f45 [0,4194304] 0 2024-02-22T00:33:21.141 INFO:tasks.workunit.client.1.smithi161.stdout:8/407: creat d1/d1c/d75/f85 x:0 0 0 2024-02-22T00:33:21.144 INFO:tasks.workunit.client.1.smithi161.stdout:4/415: mknod d5/d8/c9f 0 2024-02-22T00:33:21.145 INFO:tasks.workunit.client.1.smithi161.stdout:3/349: truncate da/dc/d11/d26/f3c 1188576 0 2024-02-22T00:33:21.148 INFO:tasks.workunit.client.1.smithi161.stdout:8/408: symlink d1/d1c/d75/d18/l86 0 2024-02-22T00:33:21.148 INFO:tasks.workunit.client.1.smithi161.stdout:4/416: rmdir d5/d10/d75 39 2024-02-22T00:33:21.151 INFO:tasks.workunit.client.1.smithi161.stdout:8/409: truncate d1/d2f/d37/d64/d7b/f65 667528 0 2024-02-22T00:33:21.151 INFO:tasks.workunit.client.1.smithi161.stdout:4/417: unlink d5/d10/d14/c3a 0 2024-02-22T00:33:21.153 INFO:tasks.workunit.client.1.smithi161.stdout:4/418: fsync d5/fe 0 2024-02-22T00:33:21.153 INFO:tasks.workunit.client.1.smithi161.stdout:3/350: getdents da/dc/d5f/d66 0 2024-02-22T00:33:21.153 INFO:tasks.workunit.client.1.smithi161.stdout:8/410: truncate d1/d1c/f77 855418 0 2024-02-22T00:33:21.154 INFO:tasks.workunit.client.1.smithi161.stdout:3/351: fsync da/dc/d11/f2e 0 2024-02-22T00:33:21.155 INFO:tasks.workunit.client.1.smithi161.stdout:4/419: stat d5/d10/d14/d24/d28/d63/d6b/f78 0 2024-02-22T00:33:21.155 INFO:tasks.workunit.client.1.smithi161.stdout:3/352: fsync da/d56/f64 0 2024-02-22T00:33:21.157 INFO:tasks.workunit.client.1.smithi161.stdout:3/353: dread - da/dc/d5f/f6e zero size 2024-02-22T00:33:21.158 INFO:tasks.workunit.client.1.smithi161.stdout:3/354: dread - da/dc/d11/f71 zero size 2024-02-22T00:33:21.159 INFO:tasks.workunit.client.1.smithi161.stdout:3/355: rename da/dc/d11/d26 to da/dc/d11/d26/d79 22 2024-02-22T00:33:21.160 INFO:tasks.workunit.client.1.smithi161.stdout:3/356: stat da/f27 0 2024-02-22T00:33:21.160 INFO:tasks.workunit.client.1.smithi161.stdout:4/420: creat d5/d10/d75/fa0 x:0 0 0 2024-02-22T00:33:21.162 INFO:tasks.workunit.client.1.smithi161.stdout:3/357: mknod da/dc/d5f/d66/c7a 0 2024-02-22T00:33:21.163 INFO:tasks.workunit.client.1.smithi161.stdout:8/411: truncate d1/d2f/d30/f33 2179791 0 2024-02-22T00:33:21.164 INFO:tasks.workunit.client.1.smithi161.stdout:3/358: truncate da/dc/d11/d40/f6a 778731 0 2024-02-22T00:33:21.165 INFO:tasks.workunit.client.1.smithi161.stdout:4/421: rename d5/d8/c9f to d5/d8/d41/d53/d6c/d72/ca1 0 2024-02-22T00:33:21.165 INFO:tasks.workunit.client.1.smithi161.stdout:4/422: readlink d5/l4c 0 2024-02-22T00:33:21.166 INFO:tasks.workunit.client.1.smithi161.stdout:8/412: chown d1/d2f/f5e 1 1 2024-02-22T00:33:21.167 INFO:tasks.workunit.client.1.smithi161.stdout:3/359: creat da/d56/f7b x:0 0 0 2024-02-22T00:33:21.168 INFO:tasks.workunit.client.1.smithi161.stdout:8/413: write d1/d1c/d75/f4a [179550,87138] 0 2024-02-22T00:33:21.168 INFO:tasks.workunit.client.1.smithi161.stdout:4/423: creat d5/d10/d14/d24/d28/fa2 x:0 0 0 2024-02-22T00:33:21.169 INFO:tasks.workunit.client.1.smithi161.stdout:3/360: write da/f6c [804477,76523] 0 2024-02-22T00:33:21.174 INFO:tasks.workunit.client.1.smithi161.stdout:4/424: unlink d5/d10/d14/d24/d28/d63/l67 0 2024-02-22T00:33:21.175 INFO:tasks.workunit.client.1.smithi161.stdout:8/414: mknod d1/d1c/d20/d22/d28/d36/d70/c87 0 2024-02-22T00:33:21.177 INFO:tasks.workunit.client.1.smithi161.stdout:3/361: creat da/dc/d11/d26/d2f/f7c x:0 0 0 2024-02-22T00:33:21.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:19.756599+0000 mgr.smithi161.sazlam (mgr.24369) 27 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 531 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.0 MiB/s rd, 52 MiB/s wr, 258 op/s 2024-02-22T00:33:21.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:19.840219+0000 mon.smithi161 (mon.1) 57 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:33:21.178 INFO:tasks.workunit.client.1.smithi161.stdout:8/415: stat d1/d1c/d20/d22/d3f/f51 0 2024-02-22T00:33:21.181 INFO:tasks.workunit.client.1.smithi161.stdout:4/425: link d5/d10/d14/d24/d28/d38/f85 d5/d8/d41/fa3 0 2024-02-22T00:33:21.181 INFO:tasks.workunit.client.1.smithi161.stdout:4/426: readlink d5/d17/l4e 0 2024-02-22T00:33:21.182 INFO:tasks.workunit.client.1.smithi161.stdout:4/427: chown d5/d10/f26 2 1 2024-02-22T00:33:21.216 INFO:tasks.workunit.client.1.smithi161.stdout:6/299: sync 2024-02-22T00:33:21.216 INFO:tasks.workunit.client.1.smithi161.stdout:9/367: sync 2024-02-22T00:33:21.216 INFO:tasks.workunit.client.1.smithi161.stdout:5/508: sync 2024-02-22T00:33:21.217 INFO:tasks.workunit.client.1.smithi161.stdout:5/509: chown d3/d1c/d69 84390411 1 2024-02-22T00:33:21.219 INFO:tasks.workunit.client.1.smithi161.stdout:9/368: rmdir d1/d2/d7 39 2024-02-22T00:33:21.221 INFO:tasks.workunit.client.1.smithi161.stdout:9/369: dread - d1/d25/d73/d60/f61 zero size 2024-02-22T00:33:21.230 INFO:tasks.workunit.client.1.smithi161.stdout:9/370: truncate d1/d5/d9/d33/d4f/f6c 684579 0 2024-02-22T00:33:21.233 INFO:tasks.workunit.client.1.smithi161.stdout:6/300: write d3/d10/d12/f36 [486596,124109] 0 2024-02-22T00:33:21.235 INFO:tasks.workunit.client.1.smithi161.stdout:9/371: creat d1/d2/d7/d3f/f7d x:0 0 0 2024-02-22T00:33:21.235 INFO:tasks.workunit.client.1.smithi161.stdout:5/510: dread d3/d1c/d20/f59 [0,4194304] 0 2024-02-22T00:33:21.237 INFO:tasks.workunit.client.1.smithi161.stdout:9/372: write d1/d5/d9/d33/f7a [121609,13481] 0 2024-02-22T00:33:21.240 INFO:tasks.workunit.client.1.smithi161.stdout:6/301: dread d3/d10/d1b/f46 [0,4194304] 0 2024-02-22T00:33:21.245 INFO:tasks.workunit.client.1.smithi161.stdout:5/511: truncate d3/d1c/d20/f35 3647608 0 2024-02-22T00:33:21.249 INFO:tasks.workunit.client.1.smithi161.stdout:6/302: dwrite d3/d10/f26 [0,4194304] 0 2024-02-22T00:33:21.252 INFO:tasks.workunit.client.1.smithi161.stdout:6/303: mknod d3/d48/d50/c58 0 2024-02-22T00:33:21.259 INFO:tasks.workunit.client.1.smithi161.stdout:6/304: link d3/f15 d3/d10/d1b/f59 0 2024-02-22T00:33:21.259 INFO:tasks.workunit.client.1.smithi161.stdout:9/373: dread d1/d2/d4/f3b [4194304,4194304] 0 2024-02-22T00:33:21.260 INFO:tasks.workunit.client.1.smithi161.stdout:9/374: readlink d1/d2/d4/d11/l2d 0 2024-02-22T00:33:21.261 INFO:tasks.workunit.client.1.smithi161.stdout:6/305: stat d3/d10/l3e 0 2024-02-22T00:33:21.263 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:19.756599+0000 mgr.smithi161.sazlam (mgr.24369) 27 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 531 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.0 MiB/s rd, 52 MiB/s wr, 258 op/s 2024-02-22T00:33:21.263 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:19.840219+0000 mon.smithi161 (mon.1) 57 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:33:21.264 INFO:tasks.workunit.client.1.smithi161.stdout:6/306: symlink d3/d10/l5a 0 2024-02-22T00:33:21.266 INFO:tasks.workunit.client.1.smithi161.stdout:9/375: rename d1/d5/d9/d33/d4f/l55 to d1/d2/d4/d11/l7e 0 2024-02-22T00:33:21.268 INFO:tasks.workunit.client.1.smithi161.stdout:9/376: stat d1/d2/d4/d1f/c15 0 2024-02-22T00:33:21.268 INFO:tasks.workunit.client.1.smithi161.stdout:6/307: unlink d3/f6 0 2024-02-22T00:33:21.270 INFO:tasks.workunit.client.1.smithi161.stdout:9/377: fdatasync d1/d2/d7/da/f13 0 2024-02-22T00:33:21.273 INFO:tasks.workunit.client.1.smithi161.stdout:5/512: dread d3/d1b/f68 [0,4194304] 0 2024-02-22T00:33:21.275 INFO:tasks.workunit.client.1.smithi161.stdout:5/513: fdatasync d3/d1c/d20/f73 0 2024-02-22T00:33:21.276 INFO:tasks.workunit.client.1.smithi161.stdout:9/378: creat d1/d2/f7f x:0 0 0 2024-02-22T00:33:21.277 INFO:tasks.workunit.client.1.smithi161.stdout:9/379: stat d1/d2/d7/da/f42 0 2024-02-22T00:33:21.279 INFO:tasks.workunit.client.1.smithi161.stdout:6/308: dwrite d3/dc/df/d32/f4b [0,4194304] 0 2024-02-22T00:33:21.285 INFO:tasks.workunit.client.1.smithi161.stdout:5/514: dwrite d3/dac/fa4 [0,4194304] 0 2024-02-22T00:33:21.287 INFO:tasks.workunit.client.1.smithi161.stdout:6/309: dread d3/d10/d1b/f2e [0,4194304] 0 2024-02-22T00:33:21.288 INFO:tasks.workunit.client.1.smithi161.stdout:9/380: rename d1/d5/f62 to d1/d2/d7/da/f80 0 2024-02-22T00:33:21.290 INFO:tasks.workunit.client.1.smithi161.stdout:5/515: write d3/d1c/d20/f59 [5003468,79796] 0 2024-02-22T00:33:21.291 INFO:tasks.workunit.client.1.smithi161.stdout:9/381: mkdir d1/d4b/d81 0 2024-02-22T00:33:21.293 INFO:tasks.workunit.client.1.smithi161.stdout:6/310: rename d3/dc/df/d32/f39 to d3/d30/f5b 0 2024-02-22T00:33:21.298 INFO:tasks.workunit.client.1.smithi161.stdout:9/382: mknod d1/d2/d4/d11/c82 0 2024-02-22T00:33:21.299 INFO:tasks.workunit.client.1.smithi161.stdout:5/516: getdents d3/d1c/d62 0 2024-02-22T00:33:21.299 INFO:tasks.workunit.client.1.smithi161.stdout:5/517: chown d3/d29/c6d 14451150 1 2024-02-22T00:33:21.303 INFO:tasks.workunit.client.1.smithi161.stdout:5/518: rename d3/d1b/f1d to d3/d1c/d69/faf 0 2024-02-22T00:33:21.309 INFO:tasks.workunit.client.1.smithi161.stdout:6/311: write d3/d10/d1b/f59 [127624,98252] 0 2024-02-22T00:33:21.309 INFO:tasks.workunit.client.1.smithi161.stdout:5/519: dwrite d3/f19 [0,4194304] 0 2024-02-22T00:33:21.314 INFO:tasks.workunit.client.1.smithi161.stdout:7/327: sync 2024-02-22T00:33:21.315 INFO:tasks.workunit.client.1.smithi161.stdout:6/312: rename d3/d48/f54 to d3/d48/f5c 0 2024-02-22T00:33:21.317 INFO:tasks.workunit.client.1.smithi161.stdout:9/383: dwrite d1/d5/f59 [0,4194304] 0 2024-02-22T00:33:21.317 INFO:tasks.workunit.client.1.smithi161.stdout:7/328: write d3/dd/f1d [3052999,114807] 0 2024-02-22T00:33:21.320 INFO:tasks.workunit.client.1.smithi161.stdout:7/329: read d3/df/d33/f40 [131674,15516] 0 2024-02-22T00:33:21.320 INFO:tasks.workunit.client.1.smithi161.stdout:9/384: write d1/d2/d7/d3f/f54 [263421,115481] 0 2024-02-22T00:33:21.321 INFO:tasks.workunit.client.1.smithi161.stdout:9/385: stat d1/d2/d4/d1f 0 2024-02-22T00:33:21.322 INFO:tasks.workunit.client.1.smithi161.stdout:6/313: creat d3/f5d x:0 0 0 2024-02-22T00:33:21.322 INFO:tasks.workunit.client.1.smithi161.stdout:7/330: dread d3/df/d43/f65 [0,4194304] 0 2024-02-22T00:33:21.326 INFO:tasks.workunit.client.1.smithi161.stdout:6/314: mkdir d3/d10/d1b/d5e 0 2024-02-22T00:33:21.328 INFO:tasks.workunit.client.1.smithi161.stdout:7/331: fsync d3/fa 0 2024-02-22T00:33:21.336 INFO:tasks.workunit.client.1.smithi161.stdout:9/386: dwrite d1/d5/f36 [0,4194304] 0 2024-02-22T00:33:21.339 INFO:tasks.workunit.client.1.smithi161.stdout:7/332: dread - d3/dd/d60/f6c zero size 2024-02-22T00:33:21.344 INFO:tasks.workunit.client.1.smithi161.stdout:9/387: read d1/d2/d4/d11/f31 [3371461,10956] 0 2024-02-22T00:33:21.345 INFO:tasks.workunit.client.1.smithi161.stdout:7/333: symlink d3/dd/d59/l71 0 2024-02-22T00:33:21.347 INFO:tasks.workunit.client.1.smithi161.stdout:6/315: dwrite d3/d10/d1b/f34 [0,4194304] 0 2024-02-22T00:33:21.349 INFO:tasks.workunit.client.1.smithi161.stdout:5/520: dread d3/d1c/d20/f54 [0,4194304] 0 2024-02-22T00:33:21.349 INFO:tasks.workunit.client.1.smithi161.stdout:9/388: mknod d1/d2/d7/da/c83 0 2024-02-22T00:33:21.350 INFO:tasks.workunit.client.1.smithi161.stdout:7/334: readlink d3/dd/d59/d5b/l3d 0 2024-02-22T00:33:21.351 INFO:tasks.workunit.client.1.smithi161.stdout:6/316: mkdir d3/d48/d50/d5f 0 2024-02-22T00:33:21.351 INFO:tasks.workunit.client.1.smithi161.stdout:7/335: write d3/f37 [4136320,49060] 0 2024-02-22T00:33:21.353 INFO:tasks.workunit.client.1.smithi161.stdout:7/336: dread - d3/df/d33/f4f zero size 2024-02-22T00:33:21.353 INFO:tasks.workunit.client.1.smithi161.stdout:7/337: chown c0 73 1 2024-02-22T00:33:21.353 INFO:tasks.workunit.client.1.smithi161.stdout:5/521: mknod d3/d1c/cb0 0 2024-02-22T00:33:21.354 INFO:tasks.workunit.client.1.smithi161.stdout:7/338: fdatasync d3/dd/fe 0 2024-02-22T00:33:21.355 INFO:tasks.workunit.client.1.smithi161.stdout:6/317: write d3/d10/d12/f22 [1504490,119946] 0 2024-02-22T00:33:21.356 INFO:tasks.workunit.client.1.smithi161.stdout:9/389: creat d1/d5/d9/d33/d4f/f84 x:0 0 0 2024-02-22T00:33:21.360 INFO:tasks.workunit.client.1.smithi161.stdout:6/318: fsync d3/d30/f5b 0 2024-02-22T00:33:21.362 INFO:tasks.workunit.client.1.smithi161.stdout:7/339: dwrite d3/dd/d59/d5b/f28 [0,4194304] 0 2024-02-22T00:33:21.363 INFO:tasks.workunit.client.1.smithi161.stdout:7/340: fsync d3/df/d33/f45 0 2024-02-22T00:33:21.368 INFO:tasks.workunit.client.1.smithi161.stdout:9/390: link d1/d2/ce d1/d2/d4/d11/c85 0 2024-02-22T00:33:21.370 INFO:tasks.workunit.client.1.smithi161.stdout:7/341: dwrite d3/df/f38 [0,4194304] 0 2024-02-22T00:33:21.370 INFO:tasks.workunit.client.1.smithi161.stdout:9/391: chown d1/d5/d9/d33/c64 435021 1 2024-02-22T00:33:21.373 INFO:tasks.workunit.client.1.smithi161.stdout:9/392: symlink d1/d5/l86 0 2024-02-22T00:33:21.374 INFO:tasks.workunit.client.1.smithi161.stdout:7/342: creat d3/f72 x:0 0 0 2024-02-22T00:33:21.376 INFO:tasks.workunit.client.1.smithi161.stdout:7/343: fdatasync d3/dd/d59/d5b/f51 0 2024-02-22T00:33:21.380 INFO:tasks.workunit.client.1.smithi161.stdout:9/393: rename d1/d5/d9/d33/f7a to d1/d25/d73/d60/d77/f87 0 2024-02-22T00:33:21.382 INFO:tasks.workunit.client.1.smithi161.stdout:7/344: dwrite d3/df/f38 [0,4194304] 0 2024-02-22T00:33:21.391 INFO:tasks.workunit.client.1.smithi161.stdout:7/345: dwrite d3/df/d33/f4f [0,4194304] 0 2024-02-22T00:33:21.426 INFO:tasks.workunit.client.1.smithi161.stdout:5/522: write d3/d1c/d69/faf [5065356,74038] 0 2024-02-22T00:33:21.431 INFO:tasks.workunit.client.1.smithi161.stdout:9/394: truncate d1/d2/d7/f47 3434139 0 2024-02-22T00:33:21.432 INFO:tasks.workunit.client.1.smithi161.stdout:6/319: dwrite d3/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:21.433 INFO:tasks.workunit.client.1.smithi161.stdout:7/346: truncate d3/f36 35851 0 2024-02-22T00:33:21.434 INFO:tasks.workunit.client.1.smithi161.stdout:9/395: mknod d1/d25/c88 0 2024-02-22T00:33:21.437 INFO:tasks.workunit.client.1.smithi161.stdout:9/396: dread - d1/d5/d9/d33/d4f/f84 zero size 2024-02-22T00:33:21.438 INFO:tasks.workunit.client.1.smithi161.stdout:6/320: write d3/d10/d12/d2f/f3c [544196,101364] 0 2024-02-22T00:33:21.443 INFO:tasks.workunit.client.1.smithi161.stdout:6/321: mknod d3/d10/d12/d2f/c60 0 2024-02-22T00:33:21.447 INFO:tasks.workunit.client.1.smithi161.stdout:7/347: link d3/df/d33/d35/f27 d3/f73 0 2024-02-22T00:33:21.448 INFO:tasks.workunit.client.1.smithi161.stdout:7/348: fdatasync d3/f17 0 2024-02-22T00:33:21.449 INFO:tasks.workunit.client.1.smithi161.stdout:9/397: creat d1/d2/f89 x:0 0 0 2024-02-22T00:33:21.450 INFO:tasks.workunit.client.1.smithi161.stdout:6/322: dread d3/d10/d1b/f59 [0,4194304] 0 2024-02-22T00:33:21.451 INFO:tasks.workunit.client.1.smithi161.stdout:7/349: write d3/df/d33/f40 [1174956,124616] 0 2024-02-22T00:33:21.452 INFO:tasks.workunit.client.1.smithi161.stdout:9/398: truncate d1/d2/d4/f3b 10106806 0 2024-02-22T00:33:21.454 INFO:tasks.workunit.client.1.smithi161.stdout:7/350: mkdir d3/df/d33/d74 0 2024-02-22T00:33:21.455 INFO:tasks.workunit.client.1.smithi161.stdout:9/399: mknod d1/d25/d73/d60/c8a 0 2024-02-22T00:33:21.457 INFO:tasks.workunit.client.1.smithi161.stdout:9/400: truncate d1/d25/d73/d60/d77/f87 284407 0 2024-02-22T00:33:21.458 INFO:tasks.workunit.client.1.smithi161.stdout:7/351: unlink d3/f2b 0 2024-02-22T00:33:21.460 INFO:tasks.workunit.client.1.smithi161.stdout:6/323: dwrite d3/d10/d1b/f46 [0,4194304] 0 2024-02-22T00:33:21.461 INFO:tasks.workunit.client.1.smithi161.stdout:6/324: dread - d3/d10/d1b/f47 zero size 2024-02-22T00:33:21.462 INFO:tasks.workunit.client.1.smithi161.stdout:9/401: symlink d1/d2/d7/d3f/d68/l8b 0 2024-02-22T00:33:21.463 INFO:tasks.workunit.client.1.smithi161.stdout:7/352: mknod d3/df/d33/d74/c75 0 2024-02-22T00:33:21.463 INFO:tasks.workunit.client.1.smithi161.stdout:9/402: dread - d1/d25/d73/d60/f61 zero size 2024-02-22T00:33:21.464 INFO:tasks.workunit.client.1.smithi161.stdout:7/353: write d3/df/d33/f40 [1225701,121320] 0 2024-02-22T00:33:21.465 INFO:tasks.workunit.client.1.smithi161.stdout:6/325: mknod d3/d48/d50/c61 0 2024-02-22T00:33:21.466 INFO:tasks.workunit.client.1.smithi161.stdout:7/354: dread - d3/df/d33/d35/d55/d63/f66 zero size 2024-02-22T00:33:21.466 INFO:tasks.workunit.client.1.smithi161.stdout:1/433: sync 2024-02-22T00:33:21.467 INFO:tasks.workunit.client.1.smithi161.stdout:6/326: chown d3/f15 3788758 1 2024-02-22T00:33:21.474 INFO:tasks.workunit.client.1.smithi161.stdout:9/403: dwrite d1/d5/d9/d33/d4f/f84 [0,4194304] 0 2024-02-22T00:33:21.475 INFO:tasks.workunit.client.1.smithi161.stdout:7/355: rename d3/df/f38 to d3/df/d43/f76 0 2024-02-22T00:33:21.480 INFO:tasks.workunit.client.1.smithi161.stdout:6/327: mknod d3/d10/c62 0 2024-02-22T00:33:21.480 INFO:tasks.workunit.client.1.smithi161.stdout:1/434: creat d19/f9d x:0 0 0 2024-02-22T00:33:21.486 INFO:tasks.workunit.client.1.smithi161.stdout:7/356: mkdir d3/d77 0 2024-02-22T00:33:21.490 INFO:tasks.workunit.client.1.smithi161.stdout:6/328: mknod d3/d48/d50/d5f/c63 0 2024-02-22T00:33:21.490 INFO:tasks.workunit.client.1.smithi161.stdout:7/357: getdents d3/dd/d60/d64 0 2024-02-22T00:33:21.499 INFO:tasks.workunit.client.1.smithi161.stdout:1/435: dwrite d19/d2f/f54 [0,4194304] 0 2024-02-22T00:33:21.499 INFO:tasks.workunit.client.1.smithi161.stdout:6/329: dread d3/d10/f55 [0,4194304] 0 2024-02-22T00:33:21.500 INFO:tasks.workunit.client.1.smithi161.stdout:1/436: dread - d19/f52 zero size 2024-02-22T00:33:21.501 INFO:tasks.workunit.client.1.smithi161.stdout:7/358: dread d3/f1b [0,4194304] 0 2024-02-22T00:33:21.501 INFO:tasks.workunit.client.1.smithi161.stdout:9/404: dread d1/d2/d7/f47 [0,4194304] 0 2024-02-22T00:33:21.502 INFO:tasks.workunit.client.1.smithi161.stdout:6/330: chown d3/d10/d12/c35 2 1 2024-02-22T00:33:21.503 INFO:tasks.workunit.client.1.smithi161.stdout:7/359: rmdir d3/dd/d60 39 2024-02-22T00:33:21.504 INFO:tasks.workunit.client.1.smithi161.stdout:9/405: read d1/d2/f65 [313835,105258] 0 2024-02-22T00:33:21.505 INFO:tasks.workunit.client.1.smithi161.stdout:9/406: readlink d1/d2/d4/d1f/l41 0 2024-02-22T00:33:21.506 INFO:tasks.workunit.client.1.smithi161.stdout:7/360: truncate d3/dd/d59/d5b/d26/d30/f3b 4387500 0 2024-02-22T00:33:21.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/331: symlink d3/dc/l64 0 2024-02-22T00:33:21.508 INFO:tasks.workunit.client.1.smithi161.stdout:1/437: getdents d19/d1d/d2c/d4f/d84 0 2024-02-22T00:33:21.514 INFO:tasks.workunit.client.1.smithi161.stdout:6/332: dread d3/dc/f27 [0,4194304] 0 2024-02-22T00:33:21.515 INFO:tasks.workunit.client.1.smithi161.stdout:1/438: read f1 [1414869,4660] 0 2024-02-22T00:33:21.515 INFO:tasks.workunit.client.1.smithi161.stdout:7/361: creat d3/dd/d60/d64/f78 x:0 0 0 2024-02-22T00:33:21.517 INFO:tasks.workunit.client.1.smithi161.stdout:7/362: readlink d3/lc 0 2024-02-22T00:33:21.517 INFO:tasks.workunit.client.1.smithi161.stdout:9/407: dwrite d1/d2/d7/f6a [0,4194304] 0 2024-02-22T00:33:21.519 INFO:tasks.workunit.client.1.smithi161.stdout:7/363: readlink d3/dd/d59/d5b/d26/l2e 0 2024-02-22T00:33:21.521 INFO:tasks.workunit.client.1.smithi161.stdout:9/408: write d1/d2/d7/da/f80 [351049,3308] 0 2024-02-22T00:33:21.523 INFO:tasks.workunit.client.1.smithi161.stdout:1/439: unlink d19/d1d/d2c/d2d/c5d 0 2024-02-22T00:33:21.527 INFO:tasks.workunit.client.1.smithi161.stdout:6/333: rename d3/d10/f21 to d3/d10/f65 0 2024-02-22T00:33:21.529 INFO:tasks.workunit.client.1.smithi161.stdout:1/440: unlink d19/d1d/d2c/d2d/f53 0 2024-02-22T00:33:21.530 INFO:tasks.workunit.client.1.smithi161.stdout:7/364: dwrite d3/dd/d60/f6c [0,4194304] 0 2024-02-22T00:33:21.537 INFO:tasks.workunit.client.1.smithi161.stdout:9/409: dwrite d1/d5/d9/f4a [0,4194304] 0 2024-02-22T00:33:21.539 INFO:tasks.workunit.client.1.smithi161.stdout:9/410: readlink d1/d2/d4/l40 0 2024-02-22T00:33:21.545 INFO:tasks.workunit.client.1.smithi161.stdout:1/441: truncate f1 228418 0 2024-02-22T00:33:21.550 INFO:tasks.workunit.client.1.smithi161.stdout:7/365: dwrite d3/dd/d59/d5b/f4e [0,4194304] 0 2024-02-22T00:33:21.551 INFO:tasks.workunit.client.1.smithi161.stdout:9/411: dread d1/d5/f36 [0,4194304] 0 2024-02-22T00:33:21.552 INFO:tasks.workunit.client.1.smithi161.stdout:6/334: rename d3/d10/d12/f29 to d3/f66 0 2024-02-22T00:33:21.565 INFO:tasks.workunit.client.1.smithi161.stdout:7/366: fdatasync d3/f7 0 2024-02-22T00:33:21.567 INFO:tasks.workunit.client.1.smithi161.stdout:9/412: mkdir d1/d2/d4/d1f/d8c 0 2024-02-22T00:33:21.568 INFO:tasks.workunit.client.1.smithi161.stdout:9/413: dread - d1/d25/f43 zero size 2024-02-22T00:33:21.569 INFO:tasks.workunit.client.1.smithi161.stdout:6/335: rmdir d3/dc/df/d32 39 2024-02-22T00:33:21.572 INFO:tasks.workunit.client.1.smithi161.stdout:1/442: rmdir d19/d51/d64/d99 0 2024-02-22T00:33:21.578 INFO:tasks.workunit.client.1.smithi161.stdout:1/443: rename d19/l4a to d19/d51/d64/l9e 0 2024-02-22T00:33:21.580 INFO:tasks.workunit.client.1.smithi161.stdout:6/336: dread d3/d10/d12/f2d [0,4194304] 0 2024-02-22T00:33:21.581 INFO:tasks.workunit.client.1.smithi161.stdout:6/337: chown d3/d10/d1b/f46 100597 1 2024-02-22T00:33:21.583 INFO:tasks.workunit.client.1.smithi161.stdout:9/414: link d1/d2/d4/d11/d21/c66 d1/d2/d7/da/c8d 0 2024-02-22T00:33:21.585 INFO:tasks.workunit.client.1.smithi161.stdout:1/444: link d19/d51/d6c/f9c d19/d1d/d2c/d2d/d3f/f9f 0 2024-02-22T00:33:21.586 INFO:tasks.workunit.client.1.smithi161.stdout:6/338: creat d3/d10/d1b/d5e/f67 x:0 0 0 2024-02-22T00:33:21.587 INFO:tasks.workunit.client.1.smithi161.stdout:9/415: creat d1/d2/d7/da/f8e x:0 0 0 2024-02-22T00:33:21.587 INFO:tasks.workunit.client.1.smithi161.stdout:9/416: chown d1/d4b/f67 2 1 2024-02-22T00:33:21.588 INFO:tasks.workunit.client.1.smithi161.stdout:6/339: chown d3/dc/df/d32/f4b 32257 1 2024-02-22T00:33:21.588 INFO:tasks.workunit.client.1.smithi161.stdout:1/445: mknod d19/d1d/d2c/d4f/d84/ca0 0 2024-02-22T00:33:21.589 INFO:tasks.workunit.client.1.smithi161.stdout:1/446: write d19/d1d/d2c/d4f/f8f [231938,23403] 0 2024-02-22T00:33:21.591 INFO:tasks.workunit.client.1.smithi161.stdout:6/340: creat d3/d10/d12/d3a/f68 x:0 0 0 2024-02-22T00:33:21.592 INFO:tasks.workunit.client.1.smithi161.stdout:1/447: mkdir d19/d51/da1 0 2024-02-22T00:33:21.594 INFO:tasks.workunit.client.1.smithi161.stdout:6/341: fdatasync d3/d10/d12/f2d 0 2024-02-22T00:33:21.596 INFO:tasks.workunit.client.1.smithi161.stdout:6/342: write d3/d10/d12/f22 [4036852,102890] 0 2024-02-22T00:33:21.599 INFO:tasks.workunit.client.1.smithi161.stdout:1/448: dwrite d19/d51/d64/f6b [0,4194304] 0 2024-02-22T00:33:21.601 INFO:tasks.workunit.client.1.smithi161.stdout:6/343: creat d3/dc/df/f69 x:0 0 0 2024-02-22T00:33:21.608 INFO:tasks.workunit.client.1.smithi161.stdout:6/344: creat d3/dc/df/f6a x:0 0 0 2024-02-22T00:33:21.610 INFO:tasks.workunit.client.1.smithi161.stdout:1/449: rename d19/d2f to d19/d1d/d2c/d7d/da2 0 2024-02-22T00:33:21.611 INFO:tasks.workunit.client.1.smithi161.stdout:9/417: dwrite d1/d5/d9/f4a [4194304,4194304] 0 2024-02-22T00:33:21.612 INFO:tasks.workunit.client.1.smithi161.stdout:6/345: read d3/dc/f27 [3753995,101153] 0 2024-02-22T00:33:21.612 INFO:tasks.workunit.client.1.smithi161.stdout:6/346: read - d3/f45 zero size 2024-02-22T00:33:21.614 INFO:tasks.workunit.client.1.smithi161.stdout:9/418: read - d1/d2/d4/f79 zero size 2024-02-22T00:33:21.615 INFO:tasks.workunit.client.1.smithi161.stdout:6/347: dread - d3/d10/d1b/f47 zero size 2024-02-22T00:33:21.618 INFO:tasks.workunit.client.1.smithi161.stdout:6/348: write d3/d10/d12/f23 [538771,122742] 0 2024-02-22T00:33:21.620 INFO:tasks.workunit.client.1.smithi161.stdout:1/450: dwrite d19/f1a [0,4194304] 0 2024-02-22T00:33:21.623 INFO:tasks.workunit.client.1.smithi161.stdout:1/451: symlink d19/d51/da1/la3 0 2024-02-22T00:33:21.624 INFO:tasks.workunit.client.1.smithi161.stdout:1/452: fsync d19/f37 0 2024-02-22T00:33:21.627 INFO:tasks.workunit.client.1.smithi161.stdout:1/453: dread - d19/d1d/d2c/d2d/d3f/f67 zero size 2024-02-22T00:33:21.628 INFO:tasks.workunit.client.1.smithi161.stdout:1/454: fdatasync f10 0 2024-02-22T00:33:21.629 INFO:tasks.workunit.client.1.smithi161.stdout:6/349: dwrite d3/d48/f5c [0,4194304] 0 2024-02-22T00:33:21.632 INFO:tasks.workunit.client.1.smithi161.stdout:1/455: creat d19/d1d/d56/fa4 x:0 0 0 2024-02-22T00:33:21.635 INFO:tasks.workunit.client.1.smithi161.stdout:6/350: rename d3/f45 to d3/d48/f6b 0 2024-02-22T00:33:21.640 INFO:tasks.workunit.client.1.smithi161.stdout:1/456: mkdir d19/d51/d64/d9b/da5 0 2024-02-22T00:33:21.644 INFO:tasks.workunit.client.1.smithi161.stdout:9/419: dwrite d1/d2/d4/d11/f28 [0,4194304] 0 2024-02-22T00:33:21.644 INFO:tasks.workunit.client.1.smithi161.stdout:1/457: creat d19/d1d/d2c/d2d/fa6 x:0 0 0 2024-02-22T00:33:21.645 INFO:tasks.workunit.client.1.smithi161.stdout:6/351: dwrite d3/d10/d12/d3a/f43 [0,4194304] 0 2024-02-22T00:33:21.647 INFO:tasks.workunit.client.1.smithi161.stdout:9/420: write d1/d2/d7/da/f75 [18206,54500] 0 2024-02-22T00:33:21.651 INFO:tasks.workunit.client.1.smithi161.stdout:1/458: mknod d19/d51/d64/d9b/ca7 0 2024-02-22T00:33:21.652 INFO:tasks.workunit.client.1.smithi161.stdout:9/421: symlink d1/d2/d4/d11/d21/l8f 0 2024-02-22T00:33:21.652 INFO:tasks.workunit.client.1.smithi161.stdout:9/422: stat d1/d25 0 2024-02-22T00:33:21.655 INFO:tasks.workunit.client.1.smithi161.stdout:9/423: write d1/d5/f59 [476065,900] 0 2024-02-22T00:33:21.657 INFO:tasks.workunit.client.1.smithi161.stdout:1/459: dread d19/d1d/d2c/f44 [0,4194304] 0 2024-02-22T00:33:21.659 INFO:tasks.workunit.client.1.smithi161.stdout:9/424: creat d1/d2/d4/d1f/f90 x:0 0 0 2024-02-22T00:33:21.659 INFO:tasks.workunit.client.1.smithi161.stdout:1/460: fdatasync d19/d51/d64/f6b 0 2024-02-22T00:33:21.660 INFO:tasks.workunit.client.1.smithi161.stdout:1/461: write f10 [2443052,4147] 0 2024-02-22T00:33:21.664 INFO:tasks.workunit.client.1.smithi161.stdout:9/425: dread d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:21.665 INFO:tasks.workunit.client.1.smithi161.stdout:9/426: write d1/d25/f43 [839298,53722] 0 2024-02-22T00:33:21.670 INFO:tasks.workunit.client.1.smithi161.stdout:6/352: fsync d3/d10/d12/d3a/f43 0 2024-02-22T00:33:21.670 INFO:tasks.workunit.client.1.smithi161.stdout:1/462: write d19/d48/f81 [896934,47130] 0 2024-02-22T00:33:21.673 INFO:tasks.workunit.client.1.smithi161.stdout:1/463: mkdir d19/d48/d68/da8 0 2024-02-22T00:33:21.673 INFO:tasks.workunit.client.1.smithi161.stdout:6/353: creat d3/d10/d12/d3a/f6c x:0 0 0 2024-02-22T00:33:21.674 INFO:tasks.workunit.client.1.smithi161.stdout:6/354: chown d3/dc/c20 0 1 2024-02-22T00:33:21.676 INFO:tasks.workunit.client.1.smithi161.stdout:1/464: rename d19/d51/c95 to d19/d1d/d2c/d4f/ca9 0 2024-02-22T00:33:21.678 INFO:tasks.workunit.client.1.smithi161.stdout:6/355: symlink d3/d10/l6d 0 2024-02-22T00:33:21.680 INFO:tasks.workunit.client.1.smithi161.stdout:6/356: chown d3/d48/d50/c58 222558 1 2024-02-22T00:33:21.680 INFO:tasks.workunit.client.1.smithi161.stdout:1/465: dread f5 [0,4194304] 0 2024-02-22T00:33:21.681 INFO:tasks.workunit.client.1.smithi161.stdout:1/466: truncate d19/f52 721803 0 2024-02-22T00:33:21.682 INFO:tasks.workunit.client.1.smithi161.stdout:9/427: dread d1/d2/f65 [0,4194304] 0 2024-02-22T00:33:21.683 INFO:tasks.workunit.client.1.smithi161.stdout:6/357: creat d3/d10/f6e x:0 0 0 2024-02-22T00:33:21.684 INFO:tasks.workunit.client.1.smithi161.stdout:9/428: truncate d1/d2/d7/da/f8e 521837 0 2024-02-22T00:33:21.684 INFO:tasks.workunit.client.1.smithi161.stdout:1/467: mkdir d19/d51/d64/d9b/da5/daa 0 2024-02-22T00:33:21.689 INFO:tasks.workunit.client.1.smithi161.stdout:6/358: dread d3/d10/d1b/f46 [0,4194304] 0 2024-02-22T00:33:21.690 INFO:tasks.workunit.client.1.smithi161.stdout:9/429: creat d1/d2/d7/f91 x:0 0 0 2024-02-22T00:33:21.691 INFO:tasks.workunit.client.1.smithi161.stdout:2/397: sync 2024-02-22T00:33:21.693 INFO:tasks.workunit.client.1.smithi161.stdout:9/430: write d1/d5/f7b [559969,42049] 0 2024-02-22T00:33:21.693 INFO:tasks.workunit.client.1.smithi161.stdout:1/468: dwrite d19/d1d/f65 [0,4194304] 0 2024-02-22T00:33:21.694 INFO:tasks.workunit.client.1.smithi161.stdout:2/398: dread - de/d11/d32/f76 zero size 2024-02-22T00:33:21.694 INFO:tasks.workunit.client.1.smithi161.stdout:9/431: read - d1/d2/d4/f79 zero size 2024-02-22T00:33:21.695 INFO:tasks.workunit.client.1.smithi161.stdout:6/359: rename d3/d10/l3f to d3/d48/l6f 0 2024-02-22T00:33:21.700 INFO:tasks.workunit.client.1.smithi161.stdout:6/360: creat d3/d48/d50/d5f/f70 x:0 0 0 2024-02-22T00:33:21.702 INFO:tasks.workunit.client.1.smithi161.stdout:1/469: creat d19/d51/d64/d9b/da5/daa/fab x:0 0 0 2024-02-22T00:33:21.702 INFO:tasks.workunit.client.1.smithi161.stdout:2/399: dwrite de/d2b/d83/f87 [0,4194304] 0 2024-02-22T00:33:21.704 INFO:tasks.workunit.client.1.smithi161.stdout:9/432: link d1/d5/f59 d1/d25/d73/d60/f92 0 2024-02-22T00:33:21.705 INFO:tasks.workunit.client.1.smithi161.stdout:6/361: symlink d3/d48/d50/d5f/l71 0 2024-02-22T00:33:21.707 INFO:tasks.workunit.client.1.smithi161.stdout:6/362: truncate d3/d10/d12/f36 4668585 0 2024-02-22T00:33:21.707 INFO:tasks.workunit.client.1.smithi161.stdout:2/400: mknod de/d2b/d65/d3a/d71/c89 0 2024-02-22T00:33:21.711 INFO:tasks.workunit.client.1.smithi161.stdout:9/433: rename d1/d2/d7/d3f/d68 to d1/d25/d73/d60/d77/d93 0 2024-02-22T00:33:21.714 INFO:tasks.workunit.client.1.smithi161.stdout:6/363: mkdir d3/d10/d72 0 2024-02-22T00:33:21.714 INFO:tasks.workunit.client.1.smithi161.stdout:9/434: symlink d1/d25/l94 0 2024-02-22T00:33:21.716 INFO:tasks.workunit.client.1.smithi161.stdout:9/435: chown d1/d2/d7/d3f/f54 6781334 1 2024-02-22T00:33:21.717 INFO:tasks.workunit.client.1.smithi161.stdout:2/401: creat de/d11/f8a x:0 0 0 2024-02-22T00:33:21.720 INFO:tasks.workunit.client.1.smithi161.stdout:2/402: mkdir de/d2b/d8b 0 2024-02-22T00:33:21.721 INFO:tasks.workunit.client.1.smithi161.stdout:9/436: rename d1/d2/d4/d1f/d8c to d1/d2/d4/d95 0 2024-02-22T00:33:21.722 INFO:tasks.workunit.client.1.smithi161.stdout:1/470: dread d19/d1d/f27 [0,4194304] 0 2024-02-22T00:33:21.724 INFO:tasks.workunit.client.1.smithi161.stdout:2/403: chown de/d2b/d65/d3a/d72/c7f 328 1 2024-02-22T00:33:21.724 INFO:tasks.workunit.client.1.smithi161.stdout:6/364: dwrite d3/d10/f38 [0,4194304] 0 2024-02-22T00:33:21.726 INFO:tasks.workunit.client.1.smithi161.stdout:1/471: mknod d19/d1d/d56/cac 0 2024-02-22T00:33:21.729 INFO:tasks.workunit.client.1.smithi161.stdout:2/404: mknod de/d11/d14/c8c 0 2024-02-22T00:33:21.730 INFO:tasks.workunit.client.1.smithi161.stdout:1/472: dread d19/f8a [0,4194304] 0 2024-02-22T00:33:21.734 INFO:tasks.workunit.client.1.smithi161.stdout:6/365: mknod d3/dc/df/c73 0 2024-02-22T00:33:21.739 INFO:tasks.workunit.client.1.smithi161.stdout:6/366: dread d3/d10/f38 [0,4194304] 0 2024-02-22T00:33:21.739 INFO:tasks.workunit.client.1.smithi161.stdout:9/437: rename d1/d2/d4/d1f/c4c to d1/d2/c96 0 2024-02-22T00:33:21.747 INFO:tasks.workunit.client.1.smithi161.stdout:6/367: unlink d3/d10/d12/d2f/f33 0 2024-02-22T00:33:21.749 INFO:tasks.workunit.client.1.smithi161.stdout:2/405: link de/d2b/d65/d3a/f75 de/d11/d5c/d33/f8d 0 2024-02-22T00:33:21.750 INFO:tasks.workunit.client.1.smithi161.stdout:2/406: dread - de/f85 zero size 2024-02-22T00:33:21.750 INFO:tasks.workunit.client.1.smithi161.stdout:1/473: link d19/d1d/d2c/d2d/d3f/f9f d19/d48/d68/da8/fad 0 2024-02-22T00:33:21.751 INFO:tasks.workunit.client.1.smithi161.stdout:2/407: fsync de/d2b/d65/d60/d68/f6c 0 2024-02-22T00:33:21.753 INFO:tasks.workunit.client.1.smithi161.stdout:8/416: sync 2024-02-22T00:33:21.753 INFO:tasks.workunit.client.1.smithi161.stdout:0/530: sync 2024-02-22T00:33:21.753 INFO:tasks.workunit.client.1.smithi161.stdout:5/523: sync 2024-02-22T00:33:21.753 INFO:tasks.workunit.client.1.smithi161.stdout:3/362: sync 2024-02-22T00:33:21.753 INFO:tasks.workunit.client.1.smithi161.stdout:4/428: sync 2024-02-22T00:33:21.755 INFO:tasks.workunit.client.1.smithi161.stdout:6/368: write d3/d10/f38 [455070,92733] 0 2024-02-22T00:33:21.756 INFO:tasks.workunit.client.1.smithi161.stdout:9/438: creat d1/d5/f97 x:0 0 0 2024-02-22T00:33:21.758 INFO:tasks.workunit.client.1.smithi161.stdout:8/417: mknod d1/d1c/c88 0 2024-02-22T00:33:21.758 INFO:tasks.workunit.client.1.smithi161.stdout:2/408: write de/f48 [130842,47627] 0 2024-02-22T00:33:21.758 INFO:tasks.workunit.client.1.smithi161.stdout:6/369: fsync d3/d10/d1b/f47 0 2024-02-22T00:33:21.761 INFO:tasks.workunit.client.1.smithi161.stdout:9/439: chown d1/d25/d73/d60/d77/f87 2 1 2024-02-22T00:33:21.761 INFO:tasks.workunit.client.1.smithi161.stdout:0/531: creat d14/d1a/d3f/d96/fae x:0 0 0 2024-02-22T00:33:21.761 INFO:tasks.workunit.client.1.smithi161.stdout:8/418: write d1/d1c/d20/d22/d3f/f82 [150975,126737] 0 2024-02-22T00:33:21.761 INFO:tasks.workunit.client.1.smithi161.stdout:9/440: read d1/d2/d7/f6a [1335943,51108] 0 2024-02-22T00:33:21.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/429: unlink d5/d8/d41/d53/f6a 0 2024-02-22T00:33:21.765 INFO:tasks.workunit.client.1.smithi161.stdout:5/524: creat d3/d1b/d91/d96/fb1 x:0 0 0 2024-02-22T00:33:21.768 INFO:tasks.workunit.client.1.smithi161.stdout:5/525: chown d3/d29/f66 252861357 1 2024-02-22T00:33:21.769 INFO:tasks.workunit.client.1.smithi161.stdout:6/370: creat d3/d30/f74 x:0 0 0 2024-02-22T00:33:21.774 INFO:tasks.workunit.client.1.smithi161.stdout:9/441: rmdir d1/d2/d4/d1f 39 2024-02-22T00:33:21.774 INFO:tasks.workunit.client.1.smithi161.stdout:4/430: dwrite d5/fe [0,4194304] 0 2024-02-22T00:33:21.775 INFO:tasks.workunit.client.1.smithi161.stdout:8/419: dwrite d1/d2f/d37/f48 [0,4194304] 0 2024-02-22T00:33:21.776 INFO:tasks.workunit.client.1.smithi161.stdout:9/442: chown d1/d2/cf 2406162 1 2024-02-22T00:33:21.777 INFO:tasks.workunit.client.1.smithi161.stdout:2/409: fsync de/d11/f4e 0 2024-02-22T00:33:21.779 INFO:tasks.workunit.client.1.smithi161.stdout:8/420: write d1/d1c/d20/d22/d28/d36/f41 [917760,72294] 0 2024-02-22T00:33:21.784 INFO:tasks.workunit.client.1.smithi161.stdout:3/363: link da/dc/d11/d26/d2f/f7c da/dc/d11/d26/d2f/f7d 0 2024-02-22T00:33:21.784 INFO:tasks.workunit.client.1.smithi161.stdout:1/474: dread d19/d1d/d2c/d7d/da2/f54 [0,4194304] 0 2024-02-22T00:33:21.785 INFO:tasks.workunit.client.1.smithi161.stdout:3/364: readlink da/dc/l61 0 2024-02-22T00:33:21.785 INFO:tasks.workunit.client.1.smithi161.stdout:2/410: read de/d11/d5c/f30 [1663003,84880] 0 2024-02-22T00:33:21.787 INFO:tasks.workunit.client.1.smithi161.stdout:9/443: dread d1/d25/d73/d60/f92 [0,4194304] 0 2024-02-22T00:33:21.787 INFO:tasks.workunit.client.1.smithi161.stdout:1/475: write d19/d1d/d2c/d2d/f63 [668930,78752] 0 2024-02-22T00:33:21.789 INFO:tasks.workunit.client.1.smithi161.stdout:1/476: dread - d19/d1d/d56/fa4 zero size 2024-02-22T00:33:21.793 INFO:tasks.workunit.client.1.smithi161.stdout:3/365: fsync da/f1a 0 2024-02-22T00:33:21.794 INFO:tasks.workunit.client.1.smithi161.stdout:3/366: readlink l9 0 2024-02-22T00:33:21.796 INFO:tasks.workunit.client.1.smithi161.stdout:2/411: fsync de/d2b/d65/d3a/f75 0 2024-02-22T00:33:21.797 INFO:tasks.workunit.client.1.smithi161.stdout:2/412: dread - de/d2b/d65/d3a/f7c zero size 2024-02-22T00:33:21.798 INFO:tasks.workunit.client.1.smithi161.stdout:9/444: mkdir d1/d25/d73/d98 0 2024-02-22T00:33:21.799 INFO:tasks.workunit.client.1.smithi161.stdout:6/371: write d3/d10/d1b/f2e [1626967,2535] 0 2024-02-22T00:33:21.799 INFO:tasks.workunit.client.1.smithi161.stdout:9/445: stat d1/d2/f89 0 2024-02-22T00:33:21.800 INFO:tasks.workunit.client.1.smithi161.stdout:6/372: fsync d3/d10/d12/d2f/f3c 0 2024-02-22T00:33:21.801 INFO:tasks.workunit.client.1.smithi161.stdout:6/373: chown d3/d48/d50/d5f/f70 391526 1 2024-02-22T00:33:21.802 INFO:tasks.workunit.client.1.smithi161.stdout:6/374: readlink d3/d10/l5a 0 2024-02-22T00:33:21.803 INFO:tasks.workunit.client.1.smithi161.stdout:8/421: link d1/d1c/d75/f15 d1/d1c/f89 0 2024-02-22T00:33:21.804 INFO:tasks.workunit.client.1.smithi161.stdout:4/431: dread d5/d10/d14/d24/d28/f87 [0,4194304] 0 2024-02-22T00:33:21.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/367: creat da/dc/d11/d26/f7e x:0 0 0 2024-02-22T00:33:21.806 INFO:tasks.workunit.client.1.smithi161.stdout:5/526: getdents d3/d1b/d25/d84 0 2024-02-22T00:33:21.808 INFO:tasks.workunit.client.1.smithi161.stdout:9/446: mkdir d1/d25/d73/d60/d77/d99 0 2024-02-22T00:33:21.814 INFO:tasks.workunit.client.1.smithi161.stdout:5/527: symlink d3/d1b/d8f/lb2 0 2024-02-22T00:33:21.815 INFO:tasks.workunit.client.1.smithi161.stdout:1/477: getdents d19/d1d/d2c 0 2024-02-22T00:33:21.815 INFO:tasks.workunit.client.1.smithi161.stdout:5/528: fdatasync d3/d29/f4a 0 2024-02-22T00:33:21.816 INFO:tasks.workunit.client.1.smithi161.stdout:6/375: dwrite d3/d48/f6b [0,4194304] 0 2024-02-22T00:33:21.816 INFO:tasks.workunit.client.1.smithi161.stdout:8/422: creat d1/d1c/d75/d18/f8a x:0 0 0 2024-02-22T00:33:21.817 INFO:tasks.workunit.client.1.smithi161.stdout:9/447: mknod d1/d25/d73/d60/d77/d99/c9a 0 2024-02-22T00:33:21.817 INFO:tasks.workunit.client.1.smithi161.stdout:1/478: readlink d19/d51/d6c/l8b 0 2024-02-22T00:33:21.819 INFO:tasks.workunit.client.1.smithi161.stdout:8/423: stat d1/d2f/d37/d64/d7b/f79 0 2024-02-22T00:33:21.819 INFO:tasks.workunit.client.1.smithi161.stdout:6/376: write d3/d10/d1b/f2e [1022432,43833] 0 2024-02-22T00:33:21.822 INFO:tasks.workunit.client.1.smithi161.stdout:8/424: write d1/d1c/d20/d22/d28/d36/f7a [462441,33130] 0 2024-02-22T00:33:21.824 INFO:tasks.workunit.client.1.smithi161.stdout:8/425: chown d1/d2f/f5e 0 1 2024-02-22T00:33:21.824 INFO:tasks.workunit.client.1.smithi161.stdout:1/479: dread d19/f8a [0,4194304] 0 2024-02-22T00:33:21.824 INFO:tasks.workunit.client.1.smithi161.stdout:8/426: dread - d1/f2d zero size 2024-02-22T00:33:21.827 INFO:tasks.workunit.client.1.smithi161.stdout:8/427: truncate d1/d2f/d30/f74 639629 0 2024-02-22T00:33:21.829 INFO:tasks.workunit.client.1.smithi161.stdout:4/432: truncate d5/d10/d14/f5d 1194559 0 2024-02-22T00:33:21.833 INFO:tasks.workunit.client.1.smithi161.stdout:1/480: creat d19/d1d/d2c/d2d/d3f/fae x:0 0 0 2024-02-22T00:33:21.833 INFO:tasks.workunit.client.1.smithi161.stdout:3/368: getdents da 0 2024-02-22T00:33:21.834 INFO:tasks.workunit.client.1.smithi161.stdout:9/448: rename d1/d5/d9/d33/d4f/c78 to d1/d25/d73/c9b 0 2024-02-22T00:33:21.837 INFO:tasks.workunit.client.1.smithi161.stdout:8/428: dread d1/d1c/d20/d22/d28/f2e [0,4194304] 0 2024-02-22T00:33:21.839 INFO:tasks.workunit.client.1.smithi161.stdout:8/429: dread - d1/d2f/d37/f7d zero size 2024-02-22T00:33:21.840 INFO:tasks.workunit.client.1.smithi161.stdout:6/377: rename d3/d30/c4f to d3/d10/d1b/c75 0 2024-02-22T00:33:21.841 INFO:tasks.workunit.client.1.smithi161.stdout:6/378: chown d3 4 1 2024-02-22T00:33:21.842 INFO:tasks.workunit.client.1.smithi161.stdout:9/449: rmdir d1/d4b 39 2024-02-22T00:33:21.846 INFO:tasks.workunit.client.1.smithi161.stdout:5/529: dwrite d3/f15 [0,4194304] 0 2024-02-22T00:33:21.846 INFO:tasks.workunit.client.1.smithi161.stdout:4/433: dread d5/d8/d41/f8b [0,4194304] 0 2024-02-22T00:33:21.847 INFO:tasks.workunit.client.1.smithi161.stdout:8/430: symlink d1/d1c/d20/d22/d3f/l8b 0 2024-02-22T00:33:21.849 INFO:tasks.workunit.client.1.smithi161.stdout:6/379: creat d3/d30/f76 x:0 0 0 2024-02-22T00:33:21.850 INFO:tasks.workunit.client.1.smithi161.stdout:6/380: readlink d3/d10/l5a 0 2024-02-22T00:33:21.851 INFO:tasks.workunit.client.1.smithi161.stdout:6/381: write d3/d10/d1b/f34 [4278445,41614] 0 2024-02-22T00:33:21.853 INFO:tasks.workunit.client.1.smithi161.stdout:9/450: mkdir d1/d5/d9/d9c 0 2024-02-22T00:33:21.853 INFO:tasks.workunit.client.1.smithi161.stdout:3/369: dread da/dc/f31 [0,4194304] 0 2024-02-22T00:33:21.855 INFO:tasks.workunit.client.1.smithi161.stdout:5/530: rmdir d3 39 2024-02-22T00:33:21.858 INFO:tasks.workunit.client.1.smithi161.stdout:1/481: truncate d19/d1d/f27 422612 0 2024-02-22T00:33:21.863 INFO:tasks.workunit.client.1.smithi161.stdout:3/370: rename da/d29/f62 to da/d29/f7f 0 2024-02-22T00:33:21.868 INFO:tasks.workunit.client.1.smithi161.stdout:8/431: link d1/d1c/d75/f10 d1/d1c/d20/d22/d28/d36/d70/f8c 0 2024-02-22T00:33:21.870 INFO:tasks.workunit.client.1.smithi161.stdout:1/482: dread - d19/d48/d68/da8/fad zero size 2024-02-22T00:33:21.870 INFO:tasks.workunit.client.1.smithi161.stdout:9/451: rename d1/d4b/f67 to d1/d25/d73/d60/f9d 0 2024-02-22T00:33:21.872 INFO:tasks.workunit.client.1.smithi161.stdout:4/434: dwrite d5/d8/d41/d57/f60 [0,4194304] 0 2024-02-22T00:33:21.873 INFO:tasks.workunit.client.1.smithi161.stdout:5/531: symlink d3/d1b/d91/lb3 0 2024-02-22T00:33:21.874 INFO:tasks.workunit.client.1.smithi161.stdout:3/371: write da/dc/d11/d26/d2f/d37/d39/f3d [2394927,28234] 0 2024-02-22T00:33:21.878 INFO:tasks.workunit.client.1.smithi161.stdout:9/452: chown d1/d2/ce 731190 1 2024-02-22T00:33:21.880 INFO:tasks.workunit.client.1.smithi161.stdout:1/483: rename d19/d1d/d2c/d4f/f8f to d19/d48/faf 0 2024-02-22T00:33:21.882 INFO:tasks.workunit.client.1.smithi161.stdout:9/453: fsync d1/d5/f97 0 2024-02-22T00:33:21.883 INFO:tasks.workunit.client.1.smithi161.stdout:3/372: dwrite da/dc/d5f/f6e [0,4194304] 0 2024-02-22T00:33:21.884 INFO:tasks.workunit.client.1.smithi161.stdout:8/432: creat d1/d1c/d20/d22/d28/d36/d6c/f8d x:0 0 0 2024-02-22T00:33:21.890 INFO:tasks.workunit.client.1.smithi161.stdout:4/435: rename d5/d10/d14/d4f/f79 to d5/d10/d14/d24/fa4 0 2024-02-22T00:33:21.892 INFO:tasks.workunit.client.1.smithi161.stdout:1/484: dwrite d19/d48/f81 [0,4194304] 0 2024-02-22T00:33:21.893 INFO:tasks.workunit.client.1.smithi161.stdout:1/485: write d19/d1d/d2c/f4d [4324660,117657] 0 2024-02-22T00:33:21.895 INFO:tasks.workunit.client.1.smithi161.stdout:5/532: write d3/f3a [3101038,130345] 0 2024-02-22T00:33:21.897 INFO:tasks.workunit.client.1.smithi161.stdout:8/433: fsync d1/d1c/d20/d22/d28/d36/d6c/f8d 0 2024-02-22T00:33:21.900 INFO:tasks.workunit.client.1.smithi161.stdout:9/454: creat d1/f9e x:0 0 0 2024-02-22T00:33:21.900 INFO:tasks.workunit.client.1.smithi161.stdout:9/455: dread - d1/d2/f3d zero size 2024-02-22T00:33:21.901 INFO:tasks.workunit.client.1.smithi161.stdout:1/486: creat d19/d48/fb0 x:0 0 0 2024-02-22T00:33:21.903 INFO:tasks.workunit.client.1.smithi161.stdout:3/373: write da/dc/d5f/f6e [5041327,68428] 0 2024-02-22T00:33:21.905 INFO:tasks.workunit.client.1.smithi161.stdout:5/533: dread d3/d1b/d25/f23 [0,4194304] 0 2024-02-22T00:33:21.905 INFO:tasks.workunit.client.1.smithi161.stdout:3/374: fdatasync da/dc/f1f 0 2024-02-22T00:33:21.905 INFO:tasks.workunit.client.1.smithi161.stdout:8/434: dread d1/d1c/d20/d22/d3f/f6e [0,4194304] 0 2024-02-22T00:33:21.907 INFO:tasks.workunit.client.1.smithi161.stdout:9/456: mknod d1/d2/d4/c9f 0 2024-02-22T00:33:21.910 INFO:tasks.workunit.client.1.smithi161.stdout:7/367: sync 2024-02-22T00:33:21.911 INFO:tasks.workunit.client.1.smithi161.stdout:5/534: creat d3/d1b/d36/fb4 x:0 0 0 2024-02-22T00:33:21.912 INFO:tasks.workunit.client.1.smithi161.stdout:3/375: mkdir da/dc/d11/d26/d80 0 2024-02-22T00:33:21.913 INFO:tasks.workunit.client.1.smithi161.stdout:9/457: creat d1/d2/d7/da/fa0 x:0 0 0 2024-02-22T00:33:21.913 INFO:tasks.workunit.client.1.smithi161.stdout:7/368: fdatasync d3/dd/d59/d5b/f28 0 2024-02-22T00:33:21.913 INFO:tasks.workunit.client.1.smithi161.stdout:8/435: symlink d1/d1c/d20/d22/d28/d36/d70/l8e 0 2024-02-22T00:33:21.914 INFO:tasks.workunit.client.1.smithi161.stdout:5/535: fsync d3/d1c/d20/f90 0 2024-02-22T00:33:21.916 INFO:tasks.workunit.client.1.smithi161.stdout:1/487: dwrite d19/d85/f94 [0,4194304] 0 2024-02-22T00:33:21.916 INFO:tasks.workunit.client.1.smithi161.stdout:7/369: chown d3/dd/d59 56449 1 2024-02-22T00:33:21.917 INFO:tasks.workunit.client.1.smithi161.stdout:8/436: stat d1/d1c/d20/d22/d28/d36/d6c/f8d 0 2024-02-22T00:33:21.920 INFO:tasks.workunit.client.1.smithi161.stdout:4/436: dread d5/d10/f1d [0,4194304] 0 2024-02-22T00:33:21.922 INFO:tasks.workunit.client.1.smithi161.stdout:1/488: dread f1 [0,4194304] 0 2024-02-22T00:33:21.927 INFO:tasks.workunit.client.1.smithi161.stdout:8/437: dwrite d1/d1c/d75/d18/f8a [0,4194304] 0 2024-02-22T00:33:21.929 INFO:tasks.workunit.client.1.smithi161.stdout:4/437: chown d5/d8/d41/d53/d6c/d72/ca1 2399391 1 2024-02-22T00:33:21.931 INFO:tasks.workunit.client.1.smithi161.stdout:1/489: rename d19/d1d/d2c/d2d/f5b to d19/d85/d87/fb1 0 2024-02-22T00:33:21.931 INFO:tasks.workunit.client.1.smithi161.stdout:1/490: fdatasync d19/f9d 0 2024-02-22T00:33:21.934 INFO:tasks.workunit.client.1.smithi161.stdout:8/438: mknod d1/d1c/d75/d18/c8f 0 2024-02-22T00:33:21.937 INFO:tasks.workunit.client.1.smithi161.stdout:5/536: truncate d3/f72 2320146 0 2024-02-22T00:33:21.940 INFO:tasks.workunit.client.1.smithi161.stdout:4/438: getdents d5/d8/d41 0 2024-02-22T00:33:21.941 INFO:tasks.workunit.client.1.smithi161.stdout:7/370: dwrite d3/f36 [0,4194304] 0 2024-02-22T00:33:21.948 INFO:tasks.workunit.client.1.smithi161.stdout:4/439: mkdir d5/d10/d14/d24/d28/d38/d6d/da5 0 2024-02-22T00:33:21.949 INFO:tasks.workunit.client.1.smithi161.stdout:5/537: getdents d3/d1b 0 2024-02-22T00:33:21.953 INFO:tasks.workunit.client.1.smithi161.stdout:7/371: dwrite d3/f7 [4194304,4194304] 0 2024-02-22T00:33:21.955 INFO:tasks.workunit.client.1.smithi161.stdout:5/538: mkdir d3/d1b/d25/db5 0 2024-02-22T00:33:21.957 INFO:tasks.workunit.client.1.smithi161.stdout:4/440: link d5/d8/d41/f8b d5/d10/d14/d24/d28/d63/fa6 0 2024-02-22T00:33:21.958 INFO:tasks.workunit.client.1.smithi161.stdout:4/441: readlink d5/d17/l96 0 2024-02-22T00:33:21.958 INFO:tasks.workunit.client.1.smithi161.stdout:5/539: creat d3/d1b/d36/fb6 x:0 0 0 2024-02-22T00:33:21.960 INFO:tasks.workunit.client.1.smithi161.stdout:7/372: creat d3/df/d33/d35/d55/f79 x:0 0 0 2024-02-22T00:33:21.963 INFO:tasks.workunit.client.1.smithi161.stdout:8/439: dread d1/d1c/f89 [0,4194304] 0 2024-02-22T00:33:21.966 INFO:tasks.workunit.client.1.smithi161.stdout:5/540: dwrite d3/d1b/d36/d88/f97 [0,4194304] 0 2024-02-22T00:33:21.969 INFO:tasks.workunit.client.1.smithi161.stdout:5/541: dread d3/d1b/d36/f83 [0,4194304] 0 2024-02-22T00:33:21.972 INFO:tasks.workunit.client.1.smithi161.stdout:5/542: symlink d3/d1c/d67/lb7 0 2024-02-22T00:33:21.973 INFO:tasks.workunit.client.1.smithi161.stdout:7/373: link d3/l41 d3/dd/d59/d5b/d26/d50/d62/l7a 0 2024-02-22T00:33:21.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/440: creat d1/d1c/d20/d22/f90 x:0 0 0 2024-02-22T00:33:21.975 INFO:tasks.workunit.client.1.smithi161.stdout:8/441: stat d1/d1c/d20/d22/d3f/f51 0 2024-02-22T00:33:21.976 INFO:tasks.workunit.client.1.smithi161.stdout:8/442: read d1/d1c/f77 [61808,47648] 0 2024-02-22T00:33:21.980 INFO:tasks.workunit.client.1.smithi161.stdout:8/443: rmdir d1/d1c/d20 39 2024-02-22T00:33:21.982 INFO:tasks.workunit.client.1.smithi161.stdout:5/543: dwrite d3/d1c/d20/f54 [0,4194304] 0 2024-02-22T00:33:21.984 INFO:tasks.workunit.client.1.smithi161.stdout:8/444: creat d1/d2f/d37/d64/f91 x:0 0 0 2024-02-22T00:33:21.986 INFO:tasks.workunit.client.1.smithi161.stdout:5/544: write d3/d1b/d25/f5c [6494888,121090] 0 2024-02-22T00:33:21.987 INFO:tasks.workunit.client.1.smithi161.stdout:7/374: write d3/df/d43/f65 [762656,82164] 0 2024-02-22T00:33:21.990 INFO:tasks.workunit.client.1.smithi161.stdout:5/545: chown d3/f95 0 1 2024-02-22T00:33:21.990 INFO:tasks.workunit.client.1.smithi161.stdout:7/375: fdatasync d3/f17 0 2024-02-22T00:33:21.991 INFO:tasks.workunit.client.1.smithi161.stdout:4/442: dwrite d5/d17/f93 [0,4194304] 0 2024-02-22T00:33:21.993 INFO:tasks.workunit.client.1.smithi161.stdout:8/445: mkdir d1/d1c/d20/d22/d28/d7f/d92 0 2024-02-22T00:33:21.994 INFO:tasks.workunit.client.1.smithi161.stdout:4/443: fsync d5/d10/f52 0 2024-02-22T00:33:21.996 INFO:tasks.workunit.client.1.smithi161.stdout:4/444: write d5/d10/d14/d24/f77 [3151064,24742] 0 2024-02-22T00:33:21.998 INFO:tasks.workunit.client.1.smithi161.stdout:7/376: truncate d3/f17 2435416 0 2024-02-22T00:33:22.005 INFO:tasks.workunit.client.1.smithi161.stdout:7/377: chown d3/l41 1543 1 2024-02-22T00:33:22.008 INFO:tasks.workunit.client.1.smithi161.stdout:8/446: dwrite d1/d1c/d75/f85 [0,4194304] 0 2024-02-22T00:33:22.016 INFO:tasks.workunit.client.1.smithi161.stdout:5/546: dwrite d3/d1b/d36/f52 [4194304,4194304] 0 2024-02-22T00:33:22.017 INFO:tasks.workunit.client.1.smithi161.stdout:7/378: rename d3/dd/d59/d5b/d26 to d3/df/d33/d35/d55/d63/d7b 0 2024-02-22T00:33:22.023 INFO:tasks.workunit.client.1.smithi161.stdout:8/447: dwrite d1/d2f/d37/f7d [0,4194304] 0 2024-02-22T00:33:22.025 INFO:tasks.workunit.client.1.smithi161.stdout:7/379: rename d3/df/d33/d35/f3f to d3/dd/d59/f7c 0 2024-02-22T00:33:22.026 INFO:tasks.workunit.client.1.smithi161.stdout:7/380: chown d3/df/d33/d35/c42 1505 1 2024-02-22T00:33:22.027 INFO:tasks.workunit.client.1.smithi161.stdout:4/445: write d5/d8/d41/f46 [1663052,126843] 0 2024-02-22T00:33:22.030 INFO:tasks.workunit.client.1.smithi161.stdout:5/547: dwrite d3/f26 [4194304,4194304] 0 2024-02-22T00:33:22.032 INFO:tasks.workunit.client.1.smithi161.stdout:4/446: creat d5/d8/d41/d53/fa7 x:0 0 0 2024-02-22T00:33:22.032 INFO:tasks.workunit.client.1.smithi161.stdout:7/381: readlink d3/df/d33/d35/d55/d63/d7b/d50/l57 0 2024-02-22T00:33:22.033 INFO:tasks.workunit.client.1.smithi161.stdout:5/548: chown d3/d1b/d25/d4c/d7b 164495990 1 2024-02-22T00:33:22.035 INFO:tasks.workunit.client.1.smithi161.stdout:4/447: write d5/d8/d41/f54 [2565429,50075] 0 2024-02-22T00:33:22.035 INFO:tasks.workunit.client.1.smithi161.stdout:7/382: chown d3/df/d33/f4f 975119 1 2024-02-22T00:33:22.036 INFO:tasks.workunit.client.1.smithi161.stdout:5/549: write d3/d1b/d25/f53 [251129,93806] 0 2024-02-22T00:33:22.052 INFO:tasks.workunit.client.1.smithi161.stdout:8/448: dread d1/d1c/d75/d18/f25 [0,4194304] 0 2024-02-22T00:33:22.081 INFO:tasks.workunit.client.1.smithi161.stdout:5/550: symlink d3/d1c/d62/lb8 0 2024-02-22T00:33:22.089 INFO:tasks.workunit.client.1.smithi161.stdout:5/551: rename d3/dac/f9a to d3/dac/fb9 0 2024-02-22T00:33:22.090 INFO:tasks.workunit.client.1.smithi161.stdout:8/449: mkdir d1/d1c/d20/d22/d28/d7f/d92/d93 0 2024-02-22T00:33:22.090 INFO:tasks.workunit.client.1.smithi161.stdout:8/450: dread - d1/d1c/d75/d18/f68 zero size 2024-02-22T00:33:22.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/451: write d1/d1c/d75/d18/f8a [2536468,139] 0 2024-02-22T00:33:22.092 INFO:tasks.workunit.client.1.smithi161.stdout:8/452: chown d1/c1a 0 1 2024-02-22T00:33:22.092 INFO:tasks.workunit.client.1.smithi161.stdout:5/552: creat d3/d29/d80/d92/fba x:0 0 0 2024-02-22T00:33:22.095 INFO:tasks.workunit.client.1.smithi161.stdout:8/453: readlink d1/d2f/d37/l49 0 2024-02-22T00:33:22.101 INFO:tasks.workunit.client.1.smithi161.stdout:8/454: rename d1/d1c/d20/d22/d28/d36/l52 to d1/d1c/d20/d22/d28/d7f/d92/l94 0 2024-02-22T00:33:22.102 INFO:tasks.workunit.client.1.smithi161.stdout:8/455: write d1/d1c/d20/d22/d28/d36/f41 [1908377,6423] 0 2024-02-22T00:33:22.104 INFO:tasks.workunit.client.1.smithi161.stdout:5/553: getdents d3/d1b/d25 0 2024-02-22T00:33:22.106 INFO:tasks.workunit.client.1.smithi161.stdout:5/554: rmdir d3/d1c 39 2024-02-22T00:33:22.115 INFO:tasks.workunit.client.1.smithi161.stdout:5/555: dwrite d3/d1c/d69/faf [0,4194304] 0 2024-02-22T00:33:22.121 INFO:tasks.workunit.client.1.smithi161.stdout:5/556: getdents d3/d1b/d36/d88 0 2024-02-22T00:33:22.128 INFO:tasks.workunit.client.1.smithi161.stdout:5/557: dwrite d3/d1b/d36/f52 [4194304,4194304] 0 2024-02-22T00:33:22.133 INFO:tasks.workunit.client.1.smithi161.stdout:5/558: mknod d3/d1b/d25/d4c/cbb 0 2024-02-22T00:33:22.134 INFO:tasks.workunit.client.1.smithi161.stdout:5/559: write d3/d1c/d20/f5b [735788,10171] 0 2024-02-22T00:33:22.135 INFO:tasks.workunit.client.1.smithi161.stdout:5/560: readlink d3/d1c/d20/l4e 0 2024-02-22T00:33:22.139 INFO:tasks.workunit.client.1.smithi161.stdout:5/561: creat d3/d1c/fbc x:0 0 0 2024-02-22T00:33:22.141 INFO:tasks.workunit.client.1.smithi161.stdout:5/562: symlink d3/d1b/d91/lbd 0 2024-02-22T00:33:22.144 INFO:tasks.workunit.client.1.smithi161.stdout:5/563: mkdir d3/d1c/da7/dae/dbe 0 2024-02-22T00:33:22.146 INFO:tasks.workunit.client.1.smithi161.stdout:7/383: link d3/f9 d3/f7d 0 2024-02-22T00:33:22.147 INFO:tasks.workunit.client.1.smithi161.stdout:7/384: chown d3/df/d43 389136 1 2024-02-22T00:33:22.151 INFO:tasks.workunit.client.1.smithi161.stdout:5/564: truncate d3/d29/f4a 1091021 0 2024-02-22T00:33:22.152 INFO:tasks.workunit.client.1.smithi161.stdout:8/456: dwrite d1/d1c/d75/d18/f25 [0,4194304] 0 2024-02-22T00:33:22.154 INFO:tasks.workunit.client.1.smithi161.stdout:8/457: readlink d1/d1c/d75/d18/l86 0 2024-02-22T00:33:22.154 INFO:tasks.workunit.client.1.smithi161.stdout:7/385: truncate d3/f14 11124255 0 2024-02-22T00:33:22.155 INFO:tasks.workunit.client.1.smithi161.stdout:5/565: creat d3/d1c/fbf x:0 0 0 2024-02-22T00:33:22.163 INFO:tasks.workunit.client.1.smithi161.stdout:8/458: dread d1/d1c/d20/d22/d28/f2e [0,4194304] 0 2024-02-22T00:33:22.166 INFO:tasks.workunit.client.1.smithi161.stdout:7/386: dwrite d3/df/d33/d35/d55/d63/d7b/d50/f61 [0,4194304] 0 2024-02-22T00:33:22.168 INFO:tasks.workunit.client.1.smithi161.stdout:8/459: truncate d1/d2f/d37/d64/d7b/f65 1526216 0 2024-02-22T00:33:22.169 INFO:tasks.workunit.client.1.smithi161.stdout:7/387: symlink d3/df/d33/l7e 0 2024-02-22T00:33:22.172 INFO:tasks.workunit.client.1.smithi161.stdout:8/460: fdatasync d1/d1c/d20/d22/d3f/f63 0 2024-02-22T00:33:22.174 INFO:tasks.workunit.client.1.smithi161.stdout:7/388: mknod d3/df/d33/d53/c7f 0 2024-02-22T00:33:22.176 INFO:tasks.workunit.client.1.smithi161.stdout:7/389: truncate d3/dd/d60/d64/f78 383638 0 2024-02-22T00:33:22.176 INFO:tasks.workunit.client.1.smithi161.stdout:8/461: rename d1/d1c/d20/d31 to d1/d1c/d20/d22/d28/d7f/d92/d95 0 2024-02-22T00:33:22.177 INFO:tasks.workunit.client.1.smithi161.stdout:7/390: readlink d3/df/d43/l48 0 2024-02-22T00:33:22.177 INFO:tasks.workunit.client.1.smithi161.stdout:8/462: chown d1/d1c/d75/f3a 7945178 1 2024-02-22T00:33:22.179 INFO:tasks.workunit.client.1.smithi161.stdout:5/566: getdents d3/d1c 0 2024-02-22T00:33:22.181 INFO:tasks.workunit.client.1.smithi161.stdout:8/463: dread d1/d1c/d75/f4a [0,4194304] 0 2024-02-22T00:33:22.182 INFO:tasks.workunit.client.1.smithi161.stdout:5/567: truncate d3/d1b/d25/d4c/d7b/fa1 434745 0 2024-02-22T00:33:22.184 INFO:tasks.workunit.client.1.smithi161.stdout:8/464: dread d1/d1c/d20/d22/f35 [0,4194304] 0 2024-02-22T00:33:22.189 INFO:tasks.workunit.client.1.smithi161.stdout:7/391: truncate d3/df/d33/f4b 443205 0 2024-02-22T00:33:22.191 INFO:tasks.workunit.client.1.smithi161.stdout:8/465: mkdir d1/d1c/d96 0 2024-02-22T00:33:22.193 INFO:tasks.workunit.client.1.smithi161.stdout:5/568: truncate d3/d1c/d20/f59 2440241 0 2024-02-22T00:33:22.199 INFO:tasks.workunit.client.1.smithi161.stdout:8/466: rename d1/d1c/d75/f10 to d1/d2f/f97 0 2024-02-22T00:33:22.202 INFO:tasks.workunit.client.1.smithi161.stdout:8/467: readlink d1/l60 0 2024-02-22T00:33:22.202 INFO:tasks.workunit.client.1.smithi161.stdout:7/392: write d3/f17 [146150,108667] 0 2024-02-22T00:33:22.203 INFO:tasks.workunit.client.1.smithi161.stdout:7/393: dread - d3/f72 zero size 2024-02-22T00:33:22.204 INFO:tasks.workunit.client.1.smithi161.stdout:5/569: rename d3/d1b/d25/f5c to d3/d1b/d91/fc0 0 2024-02-22T00:33:22.207 INFO:tasks.workunit.client.1.smithi161.stdout:7/394: mkdir d3/df/d33/d35/d80 0 2024-02-22T00:33:22.209 INFO:tasks.workunit.client.1.smithi161.stdout:8/468: rmdir d1/d2f/d37/d64/d7b/d7e 39 2024-02-22T00:33:22.211 INFO:tasks.workunit.client.1.smithi161.stdout:5/570: mkdir d3/d1b/d36/dc1 0 2024-02-22T00:33:22.212 INFO:tasks.workunit.client.1.smithi161.stdout:5/571: read d3/d1c/f7d [1664213,57961] 0 2024-02-22T00:33:22.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/395: creat d3/df/d33/d35/d55/d63/d7b/d50/f81 x:0 0 0 2024-02-22T00:33:22.217 INFO:tasks.workunit.client.1.smithi161.stdout:5/572: dread d3/d1b/d36/f55 [0,4194304] 0 2024-02-22T00:33:22.219 INFO:tasks.workunit.client.1.smithi161.stdout:7/396: mknod d3/dd/d60/c82 0 2024-02-22T00:33:22.221 INFO:tasks.workunit.client.1.smithi161.stdout:8/469: rename d1/d1c/d20/d22/d28/d7f/d92/l94 to d1/d1c/d96/l98 0 2024-02-22T00:33:22.221 INFO:tasks.workunit.client.1.smithi161.stdout:8/470: chown d1/d1c/d96 624080 1 2024-02-22T00:33:22.222 INFO:tasks.workunit.client.1.smithi161.stdout:8/471: fdatasync d1/d1c/d75/f85 0 2024-02-22T00:33:22.223 INFO:tasks.workunit.client.1.smithi161.stdout:5/573: creat d3/d1c/da7/dae/fc2 x:0 0 0 2024-02-22T00:33:22.224 INFO:tasks.workunit.client.1.smithi161.stdout:5/574: chown d3/d1c/d20/c16 15329155 1 2024-02-22T00:33:22.224 INFO:tasks.workunit.client.1.smithi161.stdout:0/532: sync 2024-02-22T00:33:22.225 INFO:tasks.workunit.client.1.smithi161.stdout:7/397: creat d3/df/d33/d35/d55/d63/d7b/d50/f83 x:0 0 0 2024-02-22T00:33:22.225 INFO:tasks.workunit.client.1.smithi161.stdout:0/533: write d14/d37/d42/d73/f91 [3192103,65003] 0 2024-02-22T00:33:22.227 INFO:tasks.workunit.client.1.smithi161.stdout:7/398: dread - d3/df/d33/d35/d55/f79 zero size 2024-02-22T00:33:22.227 INFO:tasks.workunit.client.1.smithi161.stdout:5/575: creat d3/d1c/da7/dae/fc3 x:0 0 0 2024-02-22T00:33:22.231 INFO:tasks.workunit.client.1.smithi161.stdout:0/534: rename d14/da6 to d14/d1a/d3f/d96/da1/daf 0 2024-02-22T00:33:22.233 INFO:tasks.workunit.client.1.smithi161.stdout:8/472: creat d1/d2f/d37/d64/d7b/f99 x:0 0 0 2024-02-22T00:33:22.233 INFO:tasks.workunit.client.1.smithi161.stdout:7/399: mkdir d3/df/d33/d35/d84 0 2024-02-22T00:33:22.235 INFO:tasks.workunit.client.1.smithi161.stdout:8/473: chown d1/l2 12489 1 2024-02-22T00:33:22.236 INFO:tasks.workunit.client.1.smithi161.stdout:5/576: dwrite d3/d1c/d69/faf [4194304,4194304] 0 2024-02-22T00:33:22.239 INFO:tasks.workunit.client.1.smithi161.stdout:5/577: creat d3/d9c/fc4 x:0 0 0 2024-02-22T00:33:22.240 INFO:tasks.workunit.client.1.smithi161.stdout:8/474: mknod d1/d1c/c9a 0 2024-02-22T00:33:22.242 INFO:tasks.workunit.client.1.smithi161.stdout:7/400: truncate d3/fa 370302 0 2024-02-22T00:33:22.244 INFO:tasks.workunit.client.1.smithi161.stdout:5/578: creat d3/d1c/da7/fc5 x:0 0 0 2024-02-22T00:33:22.246 INFO:tasks.workunit.client.1.smithi161.stdout:5/579: truncate d3/dac/fb9 481904 0 2024-02-22T00:33:22.249 INFO:tasks.workunit.client.1.smithi161.stdout:5/580: dread d3/d1c/f48 [0,4194304] 0 2024-02-22T00:33:22.250 INFO:tasks.workunit.client.1.smithi161.stdout:8/475: link d1/d1c/d96/l98 d1/d1c/d20/d22/l9b 0 2024-02-22T00:33:22.253 INFO:tasks.workunit.client.1.smithi161.stdout:8/476: symlink d1/d1c/d20/d22/d28/d7f/d92/l9c 0 2024-02-22T00:33:22.256 INFO:tasks.workunit.client.1.smithi161.stdout:5/581: dwrite d3/d1c/d20/f90 [0,4194304] 0 2024-02-22T00:33:22.260 INFO:tasks.workunit.client.1.smithi161.stdout:8/477: creat d1/d2f/d37/d64/d7b/f9d x:0 0 0 2024-02-22T00:33:22.262 INFO:tasks.workunit.client.1.smithi161.stdout:5/582: dread d3/d1b/d25/d4c/d7b/fa1 [0,4194304] 0 2024-02-22T00:33:22.263 INFO:tasks.workunit.client.1.smithi161.stdout:7/401: write d3/f73 [973635,25014] 0 2024-02-22T00:33:22.263 INFO:tasks.workunit.client.1.smithi161.stdout:5/583: dread - d3/d1b/d91/fad zero size 2024-02-22T00:33:22.267 INFO:tasks.workunit.client.1.smithi161.stdout:8/478: dread d1/f29 [0,4194304] 0 2024-02-22T00:33:22.270 INFO:tasks.workunit.client.1.smithi161.stdout:8/479: truncate d1/d1c/f76 4405229 0 2024-02-22T00:33:22.272 INFO:tasks.workunit.client.1.smithi161.stdout:5/584: dwrite d3/d1b/d36/d88/fa6 [0,4194304] 0 2024-02-22T00:33:22.273 INFO:tasks.workunit.client.1.smithi161.stdout:7/402: rename d3/df/d33/d35/d55/d63/d7b/l5f to d3/df/d33/d35/d55/d63/d7b/d50/d62/l85 0 2024-02-22T00:33:22.275 INFO:tasks.workunit.client.1.smithi161.stdout:8/480: dread d1/d1c/d75/d18/f25 [0,4194304] 0 2024-02-22T00:33:22.277 INFO:tasks.workunit.client.1.smithi161.stdout:8/481: truncate d1/d1c/d75/f3a 1542085 0 2024-02-22T00:33:22.277 INFO:tasks.workunit.client.1.smithi161.stdout:7/403: mknod d3/df/d43/c86 0 2024-02-22T00:33:22.278 INFO:tasks.workunit.client.1.smithi161.stdout:8/482: rename d1 to d1/d1c/d20/d22/d28/d7f/d92/d95/d9e 22 2024-02-22T00:33:22.279 INFO:tasks.workunit.client.1.smithi161.stdout:8/483: write d1/d1c/d20/d22/d3f/f82 [693917,8117] 0 2024-02-22T00:33:22.284 INFO:tasks.workunit.client.1.smithi161.stdout:8/484: creat d1/d1c/d20/d22/d28/d7f/d92/d95/f9f x:0 0 0 2024-02-22T00:33:22.286 INFO:tasks.workunit.client.1.smithi161.stdout:5/585: getdents d3/dac 0 2024-02-22T00:33:22.290 INFO:tasks.workunit.client.1.smithi161.stdout:8/485: rename d1/d1c/d20/d22/d28/d7f/d92/d95/l67 to d1/d2f/d37/d64/la0 0 2024-02-22T00:33:22.290 INFO:tasks.workunit.client.1.smithi161.stdout:5/586: getdents d3/d1b/d25/db5 0 2024-02-22T00:33:22.291 INFO:tasks.workunit.client.1.smithi161.stdout:8/486: write d1/d1c/d20/f2b [1594678,102673] 0 2024-02-22T00:33:22.291 INFO:tasks.workunit.client.1.smithi161.stdout:7/404: write d3/f14 [7074713,113985] 0 2024-02-22T00:33:22.293 INFO:tasks.workunit.client.1.smithi161.stdout:7/405: write d3/fa [1997411,107591] 0 2024-02-22T00:33:22.294 INFO:tasks.workunit.client.1.smithi161.stdout:5/587: fdatasync d3/d29/d80/d92/f9d 0 2024-02-22T00:33:22.298 INFO:tasks.workunit.client.1.smithi161.stdout:5/588: creat d3/d1b/d8f/fc6 x:0 0 0 2024-02-22T00:33:22.298 INFO:tasks.workunit.client.1.smithi161.stdout:8/487: dwrite d1/d2f/d37/d64/d7b/f65 [0,4194304] 0 2024-02-22T00:33:22.303 INFO:tasks.workunit.client.1.smithi161.stdout:8/488: mkdir d1/d1c/d20/d22/d28/d36/d6c/da1 0 2024-02-22T00:33:22.309 INFO:tasks.workunit.client.1.smithi161.stdout:5/589: dwrite d3/d29/f45 [0,4194304] 0 2024-02-22T00:33:22.309 INFO:tasks.workunit.client.1.smithi161.stdout:5/590: fdatasync d3/f19 0 2024-02-22T00:33:22.312 INFO:tasks.workunit.client.1.smithi161.stdout:5/591: mknod d3/d1b/d25/db5/cc7 0 2024-02-22T00:33:22.316 INFO:tasks.workunit.client.1.smithi161.stdout:5/592: dread d3/d1c/d69/faf [0,4194304] 0 2024-02-22T00:33:22.318 INFO:tasks.workunit.client.1.smithi161.stdout:5/593: dread d3/dac/fb9 [0,4194304] 0 2024-02-22T00:33:22.319 INFO:tasks.workunit.client.1.smithi161.stdout:5/594: fsync d3/dac/fb9 0 2024-02-22T00:33:22.322 INFO:tasks.workunit.client.1.smithi161.stdout:5/595: rename d3/d29/caa to d3/d1b/d25/db5/cc8 0 2024-02-22T00:33:22.338 INFO:tasks.workunit.client.1.smithi161.stdout:5/596: dread d3/d1c/f7d [0,4194304] 0 2024-02-22T00:33:22.348 INFO:tasks.workunit.client.1.smithi161.stdout:5/597: dwrite d3/d1c/d20/f59 [0,4194304] 0 2024-02-22T00:33:22.352 INFO:tasks.workunit.client.1.smithi161.stdout:5/598: mknod d3/d1b/d36/cc9 0 2024-02-22T00:33:22.353 INFO:tasks.workunit.client.1.smithi161.stdout:5/599: write d3/d1b/d91/d96/fb1 [106695,12859] 0 2024-02-22T00:33:22.360 INFO:tasks.workunit.client.1.smithi161.stdout:5/600: mkdir d3/d1b/d25/db5/dca 0 2024-02-22T00:33:22.360 INFO:tasks.workunit.client.1.smithi161.stdout:5/601: readlink d3/d1b/d25/l4f 0 2024-02-22T00:33:22.361 INFO:tasks.workunit.client.1.smithi161.stdout:5/602: mkdir d3/d1b/d25/d4c/dcb 0 2024-02-22T00:33:22.363 INFO:tasks.workunit.client.1.smithi161.stdout:5/603: mkdir d3/d1b/d25/dcc 0 2024-02-22T00:33:22.406 INFO:tasks.workunit.client.1.smithi161.stdout:6/382: sync 2024-02-22T00:33:22.407 INFO:tasks.workunit.client.1.smithi161.stdout:2/413: sync 2024-02-22T00:33:22.407 INFO:tasks.workunit.client.1.smithi161.stdout:2/414: chown de/d2b/f46 20709 1 2024-02-22T00:33:22.408 INFO:tasks.workunit.client.1.smithi161.stdout:2/415: dread - de/d2b/f46 zero size 2024-02-22T00:33:22.408 INFO:tasks.workunit.client.1.smithi161.stdout:6/383: symlink d3/d48/d50/l77 0 2024-02-22T00:33:22.411 INFO:tasks.workunit.client.1.smithi161.stdout:6/384: creat d3/d10/d1b/f78 x:0 0 0 2024-02-22T00:33:22.412 INFO:tasks.workunit.client.1.smithi161.stdout:6/385: chown d3/d10/d12/f2d 12789 1 2024-02-22T00:33:22.413 INFO:tasks.workunit.client.1.smithi161.stdout:2/416: rename de/f50 to de/d2b/d83/f8e 0 2024-02-22T00:33:22.417 INFO:tasks.workunit.client.1.smithi161.stdout:2/417: rename de/d11/d5c/d33 to de/d2b/d65/d3a/d72/d8f 0 2024-02-22T00:33:22.418 INFO:tasks.workunit.client.1.smithi161.stdout:2/418: write de/f1c [2432443,4569] 0 2024-02-22T00:33:22.419 INFO:tasks.workunit.client.1.smithi161.stdout:2/419: chown de/d2b/d83/d4f/c52 0 1 2024-02-22T00:33:22.419 INFO:tasks.workunit.client.1.smithi161.stdout:2/420: chown de/d11/d5c/f80 1823297499 1 2024-02-22T00:33:22.423 INFO:tasks.workunit.client.1.smithi161.stdout:6/386: truncate d3/d10/d1b/f59 1936498 0 2024-02-22T00:33:22.424 INFO:tasks.workunit.client.1.smithi161.stdout:6/387: chown d3/d30/c4a 11439494 1 2024-02-22T00:33:22.426 INFO:tasks.workunit.client.1.smithi161.stdout:2/421: rename de/d2b/d65/d60/c7e to de/d2b/d65/d3a/d72/d8f/c90 0 2024-02-22T00:33:22.427 INFO:tasks.workunit.client.1.smithi161.stdout:6/388: symlink d3/d10/d1b/l79 0 2024-02-22T00:33:22.427 INFO:tasks.workunit.client.1.smithi161.stdout:2/422: rmdir de 39 2024-02-22T00:33:22.428 INFO:tasks.workunit.client.1.smithi161.stdout:6/389: write d3/d10/d12/d3a/f6c [686749,75971] 0 2024-02-22T00:33:22.430 INFO:tasks.workunit.client.1.smithi161.stdout:2/423: read de/d2b/f2d [61260,23624] 0 2024-02-22T00:33:22.431 INFO:tasks.workunit.client.1.smithi161.stdout:6/390: creat d3/d10/d1b/d5e/f7a x:0 0 0 2024-02-22T00:33:22.434 INFO:tasks.workunit.client.1.smithi161.stdout:6/391: mknod d3/d10/d1b/c7b 0 2024-02-22T00:33:22.434 INFO:tasks.workunit.client.1.smithi161.stdout:6/392: chown d3/d10/f65 6 1 2024-02-22T00:33:22.438 INFO:tasks.workunit.client.1.smithi161.stdout:6/393: unlink d3/d10/d1b/d5e/f67 0 2024-02-22T00:33:22.439 INFO:tasks.workunit.client.1.smithi161.stdout:6/394: dread d3/d10/d12/f2d [0,4194304] 0 2024-02-22T00:33:22.448 INFO:tasks.workunit.client.1.smithi161.stdout:6/395: dwrite d3/f5d [0,4194304] 0 2024-02-22T00:33:22.449 INFO:tasks.workunit.client.1.smithi161.stdout:2/424: dwrite de/d2b/d83/d4f/f56 [0,4194304] 0 2024-02-22T00:33:22.450 INFO:tasks.workunit.client.1.smithi161.stdout:2/425: write de/d11/f8a [1042756,13294] 0 2024-02-22T00:33:22.454 INFO:tasks.workunit.client.1.smithi161.stdout:6/396: mkdir d3/d7c 0 2024-02-22T00:33:22.457 INFO:tasks.workunit.client.1.smithi161.stdout:2/426: creat de/d2b/d65/d3a/d72/d8f/f91 x:0 0 0 2024-02-22T00:33:22.463 INFO:tasks.workunit.client.1.smithi161.stdout:6/397: rename d3/d48/d50 to d3/d10/d12/d2f/d7d 0 2024-02-22T00:33:22.463 INFO:tasks.workunit.client.1.smithi161.stdout:2/427: mknod de/d11/d14/c92 0 2024-02-22T00:33:22.467 INFO:tasks.workunit.client.1.smithi161.stdout:2/428: mkdir de/d2b/d83/d93 0 2024-02-22T00:33:22.469 INFO:tasks.workunit.client.1.smithi161.stdout:2/429: write de/d11/d14/f18 [1010593,81763] 0 2024-02-22T00:33:22.472 INFO:tasks.workunit.client.1.smithi161.stdout:6/398: dwrite d3/d10/d12/d3a/f6c [0,4194304] 0 2024-02-22T00:33:22.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/399: rename d3/d10/d12/d3a/l4d to d3/d10/d12/d3a/l7e 0 2024-02-22T00:33:22.488 INFO:tasks.workunit.client.1.smithi161.stdout:6/400: write d3/d10/d12/f2d [1836164,121989] 0 2024-02-22T00:33:22.490 INFO:tasks.workunit.client.1.smithi161.stdout:2/430: dread de/d11/d5c/f69 [0,4194304] 0 2024-02-22T00:33:22.491 INFO:tasks.workunit.client.1.smithi161.stdout:2/431: dread - de/d11/d32/f76 zero size 2024-02-22T00:33:22.491 INFO:tasks.workunit.client.1.smithi161.stdout:6/401: creat d3/f7f x:0 0 0 2024-02-22T00:33:22.492 INFO:tasks.workunit.client.1.smithi161.stdout:6/402: chown d3/dc/df/f6a 565 1 2024-02-22T00:33:22.501 INFO:tasks.workunit.client.1.smithi161.stdout:2/432: dwrite de/d2b/d83/d4f/f54 [0,4194304] 0 2024-02-22T00:33:22.502 INFO:tasks.workunit.client.1.smithi161.stdout:2/433: read - de/d11/d32/f76 zero size 2024-02-22T00:33:22.505 INFO:tasks.workunit.client.1.smithi161.stdout:0/535: sync 2024-02-22T00:33:22.505 INFO:tasks.workunit.client.1.smithi161.stdout:3/376: sync 2024-02-22T00:33:22.505 INFO:tasks.workunit.client.1.smithi161.stdout:9/458: sync 2024-02-22T00:33:22.505 INFO:tasks.workunit.client.1.smithi161.stdout:1/491: sync 2024-02-22T00:33:22.506 INFO:tasks.workunit.client.1.smithi161.stdout:4/448: sync 2024-02-22T00:33:22.507 INFO:tasks.workunit.client.1.smithi161.stdout:2/434: mknod de/d2b/d65/d60/c94 0 2024-02-22T00:33:22.509 INFO:tasks.workunit.client.1.smithi161.stdout:1/492: mkdir d19/d1d/d56/db2 0 2024-02-22T00:33:22.510 INFO:tasks.workunit.client.1.smithi161.stdout:0/536: unlink d14/d44/f77 0 2024-02-22T00:33:22.511 INFO:tasks.workunit.client.1.smithi161.stdout:6/403: dread d3/dc/df/d32/f4b [0,4194304] 0 2024-02-22T00:33:22.514 INFO:tasks.workunit.client.1.smithi161.stdout:3/377: unlink da/dc/d11/d26/d2f/d37/d39/f3d 0 2024-02-22T00:33:22.516 INFO:tasks.workunit.client.1.smithi161.stdout:1/493: creat d19/d51/d64/d9b/fb3 x:0 0 0 2024-02-22T00:33:22.517 INFO:tasks.workunit.client.1.smithi161.stdout:6/404: chown d3/d10/c1a 15378 1 2024-02-22T00:33:22.519 INFO:tasks.workunit.client.1.smithi161.stdout:1/494: write d19/f49 [1345704,41685] 0 2024-02-22T00:33:22.519 INFO:tasks.workunit.client.1.smithi161.stdout:2/435: dwrite de/f53 [0,4194304] 0 2024-02-22T00:33:22.519 INFO:tasks.workunit.client.1.smithi161.stdout:0/537: unlink d14/d1a/f2d 0 2024-02-22T00:33:22.519 INFO:tasks.workunit.client.1.smithi161.stdout:3/378: dread - da/dc/d11/d26/d2f/d37/d39/f4b zero size 2024-02-22T00:33:22.522 INFO:tasks.workunit.client.1.smithi161.stdout:3/379: write da/dc/fe [3476804,83121] 0 2024-02-22T00:33:22.522 INFO:tasks.workunit.client.1.smithi161.stdout:0/538: chown d14/d1a/d3f/f5b 100238 1 2024-02-22T00:33:22.524 INFO:tasks.workunit.client.1.smithi161.stdout:6/405: creat d3/d10/d12/d2f/d7d/f80 x:0 0 0 2024-02-22T00:33:22.525 INFO:tasks.workunit.client.1.smithi161.stdout:9/459: write d1/d2/d7/da/f13 [465842,130643] 0 2024-02-22T00:33:22.525 INFO:tasks.workunit.client.1.smithi161.stdout:6/406: chown d3/d48/f5c 916094 1 2024-02-22T00:33:22.528 INFO:tasks.workunit.client.1.smithi161.stdout:3/380: chown da/dc/d5f/d68/f6d 24603772 1 2024-02-22T00:33:22.528 INFO:tasks.workunit.client.1.smithi161.stdout:7/406: sync 2024-02-22T00:33:22.528 INFO:tasks.workunit.client.1.smithi161.stdout:8/489: sync 2024-02-22T00:33:22.528 INFO:tasks.workunit.client.1.smithi161.stdout:5/604: sync 2024-02-22T00:33:22.528 INFO:tasks.workunit.client.1.smithi161.stdout:2/436: symlink de/d2b/d65/d3a/l95 0 2024-02-22T00:33:22.531 INFO:tasks.workunit.client.1.smithi161.stdout:1/495: creat d19/fb4 x:0 0 0 2024-02-22T00:33:22.534 INFO:tasks.workunit.client.1.smithi161.stdout:3/381: rmdir da/dc/d5f/d68 39 2024-02-22T00:33:22.537 INFO:tasks.workunit.client.1.smithi161.stdout:2/437: chown de/d11/l58 3 1 2024-02-22T00:33:22.538 INFO:tasks.workunit.client.1.smithi161.stdout:4/449: dread d5/d10/d14/f29 [0,4194304] 0 2024-02-22T00:33:22.538 INFO:tasks.workunit.client.1.smithi161.stdout:9/460: creat d1/d25/d73/d60/d77/d99/fa1 x:0 0 0 2024-02-22T00:33:22.540 INFO:tasks.workunit.client.1.smithi161.stdout:5/605: mknod d3/d1b/d91/ccd 0 2024-02-22T00:33:22.540 INFO:tasks.workunit.client.1.smithi161.stdout:0/539: dwrite d14/f51 [0,4194304] 0 2024-02-22T00:33:22.541 INFO:tasks.workunit.client.1.smithi161.stdout:2/438: write de/f53 [3628333,125479] 0 2024-02-22T00:33:22.543 INFO:tasks.workunit.client.1.smithi161.stdout:9/461: dread - d1/d2/d7/d3f/f7d zero size 2024-02-22T00:33:22.543 INFO:tasks.workunit.client.0.smithi049.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-22T00:33:22.551 INFO:tasks.workunit.client.1.smithi161.stdout:2/439: dread de/d2b/d65/d60/d68/f6c [0,4194304] 0 2024-02-22T00:33:22.552 INFO:tasks.workunit.client.1.smithi161.stdout:2/440: write de/d11/d32/f76 [659985,6487] 0 2024-02-22T00:33:22.552 INFO:tasks.workunit.client.1.smithi161.stdout:7/407: symlink d3/df/d33/d35/d55/d63/d7b/l87 0 2024-02-22T00:33:22.553 INFO:tasks.workunit.client.1.smithi161.stdout:2/441: chown de/c1d 528896929 1 2024-02-22T00:33:22.554 INFO:tasks.workunit.client.1.smithi161.stdout:5/606: mknod d3/d29/d80/cce 0 2024-02-22T00:33:22.559 INFO:tasks.workunit.client.1.smithi161.stdout:9/462: chown d1/d5/c20 78 1 2024-02-22T00:33:22.559 INFO:tasks.workunit.client.1.smithi161.stdout:6/407: link d3/d10/d12/d2f/d7d/l77 d3/dc/df/d32/l81 0 2024-02-22T00:33:22.561 INFO:tasks.workunit.client.1.smithi161.stdout:5/607: creat d3/d1c/d67/fcf x:0 0 0 2024-02-22T00:33:22.561 INFO:tasks.workunit.client.1.smithi161.stdout:9/463: dread - d1/f9e zero size 2024-02-22T00:33:22.562 INFO:tasks.workunit.client.1.smithi161.stdout:2/442: rename de/d2b/d65/d3a/d72/d8f/f62 to de/d2b/f96 0 2024-02-22T00:33:22.562 INFO:tasks.workunit.client.1.smithi161.stdout:6/408: readlink d3/l1c 0 2024-02-22T00:33:22.568 INFO:tasks.workunit.client.1.smithi161.stdout:4/450: write d5/d8/f9 [1145214,77821] 0 2024-02-22T00:33:22.568 INFO:tasks.workunit.client.1.smithi161.stdout:8/490: dread d1/d1c/d20/d22/d28/d36/d70/f8c [0,4194304] 0 2024-02-22T00:33:22.568 INFO:tasks.workunit.client.1.smithi161.stdout:9/464: fsync d1/d2/d7/f91 0 2024-02-22T00:33:22.569 INFO:tasks.workunit.client.1.smithi161.stdout:7/408: dwrite d3/df/d33/d35/f27 [0,4194304] 0 2024-02-22T00:33:22.571 INFO:tasks.workunit.client.1.smithi161.stdout:3/382: fsync da/dc/d11/d26/f52 0 2024-02-22T00:33:22.573 INFO:tasks.workunit.client.1.smithi161.stdout:2/443: write de/d11/d5c/f80 [970706,109787] 0 2024-02-22T00:33:22.576 INFO:tasks.workunit.client.1.smithi161.stdout:4/451: mkdir d5/d17/da8 0 2024-02-22T00:33:22.576 INFO:tasks.workunit.client.1.smithi161.stdout:7/409: truncate d3/f73 5192048 0 2024-02-22T00:33:22.580 INFO:tasks.workunit.client.1.smithi161.stdout:9/465: rmdir d1/d5/d9/d33/d4f 39 2024-02-22T00:33:22.581 INFO:tasks.workunit.client.1.smithi161.stdout:8/491: symlink d1/d1c/d75/d18/la2 0 2024-02-22T00:33:22.581 INFO:tasks.workunit.client.1.smithi161.stdout:1/496: dread d19/d1d/f57 [0,4194304] 0 2024-02-22T00:33:22.583 INFO:tasks.workunit.client.1.smithi161.stdout:5/608: dwrite d3/f5 [4194304,4194304] 0 2024-02-22T00:33:22.584 INFO:tasks.workunit.client.1.smithi161.stdout:8/492: stat d1/d1c/f77 0 2024-02-22T00:33:22.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/444: creat de/d2b/d8b/f97 x:0 0 0 2024-02-22T00:33:22.586 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-22T00:33:22.586 INFO:tasks.workunit.client.0.smithi049.stderr:+ make 2024-02-22T00:33:22.587 INFO:tasks.workunit.client.1.smithi161.stdout:9/466: chown d1/d2/d4/d11/l2d 46 1 2024-02-22T00:33:22.587 INFO:tasks.workunit.client.1.smithi161.stdout:7/410: rename d3/dd/d59/l71 to d3/df/d33/l88 0 2024-02-22T00:33:22.587 INFO:tasks.workunit.client.1.smithi161.stdout:6/409: dwrite d3/d48/f6b [0,4194304] 0 2024-02-22T00:33:22.588 INFO:tasks.workunit.client.1.smithi161.stdout:4/452: rmdir d5/d17/da8 0 2024-02-22T00:33:22.589 INFO:tasks.workunit.client.1.smithi161.stdout:6/410: stat d3/l1c 0 2024-02-22T00:33:22.589 INFO:tasks.workunit.client.1.smithi161.stdout:1/497: symlink d19/d51/da1/lb5 0 2024-02-22T00:33:22.591 INFO:tasks.workunit.client.1.smithi161.stdout:9/467: symlink d1/d4b/la2 0 2024-02-22T00:33:22.591 INFO:tasks.workunit.client.1.smithi161.stdout:5/609: symlink d3/d1b/d25/d4c/d7b/ld0 0 2024-02-22T00:33:22.592 INFO:tasks.workunit.client.1.smithi161.stdout:6/411: write d3/d48/f5c [1656100,80862] 0 2024-02-22T00:33:22.593 INFO:tasks.workunit.client.1.smithi161.stdout:9/468: chown d1/d25/d73/c74 432 1 2024-02-22T00:33:22.594 INFO:tasks.workunit.client.1.smithi161.stdout:1/498: rmdir d19/d1d 39 2024-02-22T00:33:22.596 INFO:tasks.workunit.client.1.smithi161.stdout:7/411: creat d3/dd/d60/d64/f89 x:0 0 0 2024-02-22T00:33:22.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/445: truncate de/d11/d5c/f30 4939664 0 2024-02-22T00:33:22.598 INFO:tasks.workunit.client.1.smithi161.stdout:4/453: rmdir d5/d10/d14/d24/d28/d63/d65 39 2024-02-22T00:33:22.609 INFO:tasks.workunit.client.1.smithi161.stdout:6/412: dwrite d3/d48/f6b [4194304,4194304] 0 2024-02-22T00:33:22.612 INFO:tasks.workunit.client.1.smithi161.stdout:6/413: chown d3/d10/d72 482595603 1 2024-02-22T00:33:22.613 INFO:tasks.workunit.client.1.smithi161.stdout:1/499: write d19/f8a [2969463,96980] 0 2024-02-22T00:33:22.614 INFO:tasks.workunit.client.1.smithi161.stdout:2/446: write de/d2b/d65/f31 [3285535,3712] 0 2024-02-22T00:33:22.616 INFO:tasks.workunit.client.1.smithi161.stdout:4/454: mkdir d5/d10/da9 0 2024-02-22T00:33:22.622 INFO:tasks.workunit.client.1.smithi161.stdout:8/493: read d1/d1c/d20/d22/d28/d7f/d92/d95/f57 [1751777,109156] 0 2024-02-22T00:33:22.623 INFO:tasks.workunit.client.1.smithi161.stdout:1/500: fdatasync f9 0 2024-02-22T00:33:22.626 INFO:tasks.workunit.client.1.smithi161.stdout:7/412: dwrite d3/df/d33/d35/d55/d63/f66 [0,4194304] 0 2024-02-22T00:33:22.626 INFO:tasks.workunit.client.1.smithi161.stdout:2/447: write de/d2b/d65/f79 [30491,64121] 0 2024-02-22T00:33:22.628 INFO:tasks.workunit.client.1.smithi161.stdout:4/455: chown d5/d17/f4a 1750398 1 2024-02-22T00:33:22.633 INFO:tasks.workunit.client.1.smithi161.stdout:1/501: dread - d19/d48/f92 zero size 2024-02-22T00:33:22.636 INFO:tasks.workunit.client.1.smithi161.stdout:5/610: dwrite d3/d1b/d25/d4c/f63 [0,4194304] 0 2024-02-22T00:33:22.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/413: unlink d3/df/d33/d74/c75 0 2024-02-22T00:33:22.642 INFO:tasks.workunit.client.1.smithi161.stdout:2/448: creat de/d2b/f98 x:0 0 0 2024-02-22T00:33:22.643 INFO:tasks.workunit.client.1.smithi161.stdout:6/414: dwrite d3/d10/d1b/f78 [0,4194304] 0 2024-02-22T00:33:22.643 INFO:tasks.workunit.client.1.smithi161.stdout:8/494: unlink d1/d1c/d20/d22/d28/d36/d6c/f8d 0 2024-02-22T00:33:22.643 INFO:tasks.workunit.client.1.smithi161.stdout:5/611: mkdir d3/dac/dd1 0 2024-02-22T00:33:22.644 INFO:tasks.workunit.client.1.smithi161.stdout:9/469: dread d1/d2/d4/f3b [4194304,4194304] 0 2024-02-22T00:33:22.645 INFO:tasks.workunit.client.1.smithi161.stdout:3/383: dread da/dc/d11/f2e [0,4194304] 0 2024-02-22T00:33:22.645 INFO:tasks.workunit.client.1.smithi161.stdout:2/449: chown de/d2b/d83/d4f/c86 12530 1 2024-02-22T00:33:22.647 INFO:tasks.workunit.client.1.smithi161.stdout:1/502: mkdir d19/db6 0 2024-02-22T00:33:22.648 INFO:tasks.workunit.client.1.smithi161.stdout:4/456: mknod d5/d10/d14/d24/caa 0 2024-02-22T00:33:22.652 INFO:tasks.workunit.client.1.smithi161.stdout:1/503: chown d19/d51/d64/f6b 12 1 2024-02-22T00:33:22.652 INFO:tasks.workunit.client.1.smithi161.stdout:6/415: mkdir d3/d10/d12/d2f/d7d/d82 0 2024-02-22T00:33:22.652 INFO:tasks.workunit.client.1.smithi161.stdout:9/470: chown d1/d5/d9/c14 6052 1 2024-02-22T00:33:22.654 INFO:tasks.workunit.client.1.smithi161.stdout:8/495: mknod d1/d1c/d20/d22/d3f/ca3 0 2024-02-22T00:33:22.656 INFO:tasks.workunit.client.1.smithi161.stdout:6/416: chown d3/d10/c62 720454899 1 2024-02-22T00:33:22.657 INFO:tasks.workunit.client.1.smithi161.stdout:2/450: mknod de/d2b/d83/d93/c99 0 2024-02-22T00:33:22.659 INFO:tasks.workunit.client.1.smithi161.stdout:7/414: dwrite d3/dd/fe [0,4194304] 0 2024-02-22T00:33:22.659 INFO:tasks.workunit.client.1.smithi161.stdout:5/612: mkdir d3/d1b/d25/d4c/dd2 0 2024-02-22T00:33:22.661 INFO:tasks.workunit.client.1.smithi161.stdout:4/457: rename l4 to d5/d10/lab 0 2024-02-22T00:33:22.669 INFO:tasks.workunit.client.1.smithi161.stdout:9/471: mkdir d1/d5/d9/d33/d4f/da3 0 2024-02-22T00:33:22.671 INFO:tasks.workunit.client.1.smithi161.stdout:3/384: dwrite da/dc/d11/d26/f4d [0,4194304] 0 2024-02-22T00:33:22.671 INFO:tasks.workunit.client.1.smithi161.stdout:2/451: dread de/d11/d32/f76 [0,4194304] 0 2024-02-22T00:33:22.673 INFO:tasks.workunit.client.1.smithi161.stdout:7/415: symlink d3/df/d33/d35/d55/d6f/l8a 0 2024-02-22T00:33:22.675 INFO:tasks.workunit.client.1.smithi161.stdout:4/458: symlink d5/d8/d41/lac 0 2024-02-22T00:33:22.678 INFO:tasks.workunit.client.1.smithi161.stdout:6/417: rename d3/d10/l7 to d3/d10/d12/d3a/l83 0 2024-02-22T00:33:22.679 INFO:tasks.workunit.client.1.smithi161.stdout:6/418: read - d3/d10/d12/d3a/f68 zero size 2024-02-22T00:33:22.680 INFO:tasks.workunit.client.1.smithi161.stdout:8/496: link d1/d1c/f3d d1/d1c/fa4 0 2024-02-22T00:33:22.683 INFO:tasks.workunit.client.1.smithi161.stdout:3/385: symlink da/dc/d11/d40/d59/l81 0 2024-02-22T00:33:22.684 INFO:tasks.workunit.client.1.smithi161.stdout:3/386: chown f0 190695 1 2024-02-22T00:33:22.685 INFO:tasks.workunit.client.1.smithi161.stdout:3/387: chown da/dc/d11/d26/d2f/d37/d39/f4b 49917 1 2024-02-22T00:33:22.689 INFO:tasks.workunit.client.1.smithi161.stdout:5/613: rename d3/d1b/d36/d88/f97 to d3/d1c/d69/fd3 0 2024-02-22T00:33:22.689 INFO:tasks.workunit.client.1.smithi161.stdout:6/419: symlink d3/d10/d12/d2f/d7d/l84 0 2024-02-22T00:33:22.693 INFO:tasks.workunit.client.1.smithi161.stdout:4/459: link d5/fe d5/d10/d14/fad 0 2024-02-22T00:33:22.694 INFO:tasks.workunit.client.1.smithi161.stdout:4/460: chown d5/d8/d41/f54 0 1 2024-02-22T00:33:22.695 INFO:tasks.workunit.client.1.smithi161.stdout:9/472: creat d1/d2/d4/fa4 x:0 0 0 2024-02-22T00:33:22.695 INFO:tasks.workunit.client.1.smithi161.stdout:4/461: readlink d5/d17/l96 0 2024-02-22T00:33:22.696 INFO:tasks.workunit.client.1.smithi161.stdout:8/497: mknod d1/d1c/d75/d18/ca5 0 2024-02-22T00:33:22.698 INFO:tasks.workunit.client.1.smithi161.stdout:7/416: link d3/l20 d3/df/d43/l8b 0 2024-02-22T00:33:22.703 INFO:tasks.workunit.client.1.smithi161.stdout:5/614: mknod d3/d1b/d36/dc1/cd4 0 2024-02-22T00:33:22.709 INFO:tasks.workunit.client.1.smithi161.stdout:6/420: unlink d3/d10/d12/d3a/l83 0 2024-02-22T00:33:22.711 INFO:tasks.workunit.client.1.smithi161.stdout:2/452: truncate de/d2b/d83/f8e 1076149 0 2024-02-22T00:33:22.711 INFO:tasks.workunit.client.1.smithi161.stdout:2/453: read de/d2b/f46 [3441230,8770] 0 2024-02-22T00:33:22.713 INFO:tasks.workunit.client.1.smithi161.stdout:7/417: dread d3/df/d33/f45 [0,4194304] 0 2024-02-22T00:33:22.713 INFO:tasks.workunit.client.1.smithi161.stdout:5/615: symlink d3/d29/ld5 0 2024-02-22T00:33:22.715 INFO:tasks.workunit.client.1.smithi161.stdout:4/462: mknod d5/d8/d41/d53/d6c/d91/cae 0 2024-02-22T00:33:22.718 INFO:tasks.workunit.client.1.smithi161.stdout:3/388: rename da/dc/fe to da/dc/d11/d26/d2f/f82 0 2024-02-22T00:33:22.720 INFO:tasks.workunit.client.1.smithi161.stdout:9/473: write d1/d2/f10 [615008,122585] 0 2024-02-22T00:33:22.722 INFO:tasks.workunit.client.1.smithi161.stdout:2/454: mknod de/d11/d32/c9a 0 2024-02-22T00:33:22.724 INFO:tasks.workunit.client.1.smithi161.stdout:4/463: dwrite d5/f7d [0,4194304] 0 2024-02-22T00:33:22.726 INFO:tasks.workunit.client.1.smithi161.stdout:2/455: dread - de/d2b/d65/d3a/f75 zero size 2024-02-22T00:33:22.732 INFO:tasks.workunit.client.1.smithi161.stdout:4/464: truncate d5/d8/f9 4807657 0 2024-02-22T00:33:22.735 INFO:tasks.workunit.client.1.smithi161.stdout:4/465: chown d5/d8/f81 178719 1 2024-02-22T00:33:22.736 INFO:tasks.workunit.client.1.smithi161.stdout:8/498: dwrite d1/d2f/f5e [0,4194304] 0 2024-02-22T00:33:22.740 INFO:tasks.workunit.client.1.smithi161.stdout:5/616: dwrite d3/dac/d8b/f8e [0,4194304] 0 2024-02-22T00:33:22.749 INFO:tasks.workunit.client.1.smithi161.stdout:7/418: link d3/dd/d59/f7c d3/dd/f8c 0 2024-02-22T00:33:22.749 INFO:tasks.workunit.client.1.smithi161.stdout:6/421: getdents d3/dc/df/d32 0 2024-02-22T00:33:22.751 INFO:tasks.workunit.client.1.smithi161.stdout:8/499: readlink d1/d2f/d37/d64/la0 0 2024-02-22T00:33:22.752 INFO:tasks.workunit.client.1.smithi161.stdout:9/474: dread d1/d2/f10 [0,4194304] 0 2024-02-22T00:33:22.754 INFO:tasks.workunit.client.1.smithi161.stdout:4/466: creat d5/d10/d14/d24/d28/d63/d65/faf x:0 0 0 2024-02-22T00:33:22.754 INFO:tasks.workunit.client.1.smithi161.stdout:9/475: read d1/d2/f1a [5064187,121945] 0 2024-02-22T00:33:22.755 INFO:tasks.workunit.client.1.smithi161.stdout:5/617: creat d3/d1b/d25/db5/dca/fd6 x:0 0 0 2024-02-22T00:33:22.756 INFO:tasks.workunit.client.1.smithi161.stdout:9/476: dread - d1/d25/d73/d60/f9d zero size 2024-02-22T00:33:22.757 INFO:tasks.workunit.client.1.smithi161.stdout:8/500: mknod d1/d1c/d20/d22/d28/d36/ca6 0 2024-02-22T00:33:22.759 INFO:tasks.workunit.client.1.smithi161.stdout:3/389: rename da/dc/d11/d40/d59/l81 to da/dc/l83 0 2024-02-22T00:33:22.760 INFO:tasks.workunit.client.1.smithi161.stdout:5/618: rename d3/d1b/d25/dcc to d3/d1b/d25/dcc/dd7 22 2024-02-22T00:33:22.760 INFO:tasks.workunit.client.1.smithi161.stdout:8/501: write d1/d2f/d37/d64/f91 [895649,121640] 0 2024-02-22T00:33:22.760 INFO:tasks.workunit.client.1.smithi161.stdout:4/467: fdatasync d5/d10/d14/d24/f35 0 2024-02-22T00:33:22.761 INFO:tasks.workunit.client.1.smithi161.stdout:7/419: truncate d3/dd/f8c 2278585 0 2024-02-22T00:33:22.764 INFO:tasks.workunit.client.1.smithi161.stdout:9/477: mkdir d1/d5/d9/da5 0 2024-02-22T00:33:22.767 INFO:tasks.workunit.client.1.smithi161.stdout:2/456: dread de/d11/d5c/f30 [0,4194304] 0 2024-02-22T00:33:22.768 INFO:tasks.workunit.client.1.smithi161.stdout:4/468: dread d5/d8/d41/d53/d6c/d72/f8e [0,4194304] 0 2024-02-22T00:33:22.768 INFO:tasks.workunit.client.1.smithi161.stdout:5/619: symlink d3/d1c/da7/dae/ld8 0 2024-02-22T00:33:22.768 INFO:tasks.workunit.client.1.smithi161.stdout:6/422: write d3/d10/d1b/f59 [2540679,18001] 0 2024-02-22T00:33:22.771 INFO:tasks.workunit.client.1.smithi161.stdout:6/423: chown d3/d10/l3e 78 1 2024-02-22T00:33:22.771 INFO:tasks.workunit.client.1.smithi161.stdout:8/502: unlink d1/d2f/d37/f7d 0 2024-02-22T00:33:22.772 INFO:tasks.workunit.client.1.smithi161.stdout:9/478: rmdir d1/d5/d9 39 2024-02-22T00:33:22.776 INFO:tasks.workunit.client.1.smithi161.stdout:3/390: dwrite da/dc/d11/d26/d2f/d37/d39/f3f [0,4194304] 0 2024-02-22T00:33:22.777 INFO:tasks.workunit.client.1.smithi161.stdout:3/391: fdatasync da/f46 0 2024-02-22T00:33:22.777 INFO:tasks.workunit.client.1.smithi161.stdout:2/457: rename de/d2b/c5f to de/d2b/d65/d3a/d72/c9b 0 2024-02-22T00:33:22.779 INFO:tasks.workunit.client.1.smithi161.stdout:8/503: stat d1/d2f/d37/c73 0 2024-02-22T00:33:22.780 INFO:tasks.workunit.client.1.smithi161.stdout:7/420: creat d3/f8d x:0 0 0 2024-02-22T00:33:22.782 INFO:tasks.workunit.client.1.smithi161.stdout:9/479: write d1/d2/d4/f3b [10251424,98250] 0 2024-02-22T00:33:22.784 INFO:tasks.workunit.client.1.smithi161.stdout:4/469: mkdir d5/db0 0 2024-02-22T00:33:22.789 INFO:tasks.workunit.client.1.smithi161.stdout:2/458: truncate de/d11/f4e 56251 0 2024-02-22T00:33:22.791 INFO:tasks.workunit.client.1.smithi161.stdout:7/421: dwrite d3/fa [0,4194304] 0 2024-02-22T00:33:22.791 INFO:tasks.workunit.client.1.smithi161.stdout:3/392: rename da/dc/f17 to da/dc/d11/d40/d59/f84 0 2024-02-22T00:33:22.793 INFO:tasks.workunit.client.1.smithi161.stdout:5/620: getdents d3/d29/d80 0 2024-02-22T00:33:22.794 INFO:tasks.workunit.client.1.smithi161.stdout:3/393: chown da/dc/d11/c48 412 1 2024-02-22T00:33:22.794 INFO:tasks.workunit.client.1.smithi161.stdout:8/504: symlink d1/d1c/d20/d22/la7 0 2024-02-22T00:33:22.795 INFO:tasks.workunit.client.1.smithi161.stdout:4/470: truncate d5/d17/f4a 1911627 0 2024-02-22T00:33:22.799 INFO:tasks.workunit.client.1.smithi161.stdout:9/480: mknod d1/d2/d4/d11/ca6 0 2024-02-22T00:33:22.799 INFO:tasks.workunit.client.1.smithi161.stdout:7/422: read - d3/df/d33/d35/d55/d63/d7b/d50/f83 zero size 2024-02-22T00:33:22.800 INFO:tasks.workunit.client.1.smithi161.stdout:4/471: truncate d5/d17/f92 710755 0 2024-02-22T00:33:22.801 INFO:tasks.workunit.client.1.smithi161.stdout:6/424: dread d3/d10/d12/d3a/f43 [0,4194304] 0 2024-02-22T00:33:22.801 INFO:tasks.workunit.client.1.smithi161.stdout:8/505: fdatasync d1/d1c/f89 0 2024-02-22T00:33:22.802 INFO:tasks.workunit.client.1.smithi161.stdout:5/621: creat d3/d1b/d25/dcc/fd9 x:0 0 0 2024-02-22T00:33:22.802 INFO:tasks.workunit.client.1.smithi161.stdout:9/481: symlink d1/la7 0 2024-02-22T00:33:22.804 INFO:tasks.workunit.client.1.smithi161.stdout:3/394: creat da/dc/d11/d26/d2f/f85 x:0 0 0 2024-02-22T00:33:22.804 INFO:tasks.workunit.client.1.smithi161.stdout:7/423: rmdir d3/df/d33 39 2024-02-22T00:33:22.806 INFO:tasks.workunit.client.1.smithi161.stdout:7/424: fsync d3/f7 0 2024-02-22T00:33:22.807 INFO:tasks.workunit.client.1.smithi161.stdout:9/482: fsync d1/d2/d7/f16 0 2024-02-22T00:33:22.809 INFO:tasks.workunit.client.1.smithi161.stdout:8/506: creat d1/d2f/fa8 x:0 0 0 2024-02-22T00:33:22.811 INFO:tasks.workunit.client.1.smithi161.stdout:8/507: fdatasync d1/d2f/f84 0 2024-02-22T00:33:22.815 INFO:tasks.workunit.client.1.smithi161.stdout:5/622: dwrite d3/d1c/d20/f59 [0,4194304] 0 2024-02-22T00:33:22.816 INFO:tasks.workunit.client.1.smithi161.stdout:5/623: fsync d3/f95 0 2024-02-22T00:33:22.817 INFO:tasks.workunit.client.1.smithi161.stdout:9/483: read d1/d5/d9/d33/f32 [1116620,129224] 0 2024-02-22T00:33:22.819 INFO:tasks.workunit.client.1.smithi161.stdout:5/624: truncate d3/d1c/f8d 632853 0 2024-02-22T00:33:22.820 INFO:tasks.workunit.client.1.smithi161.stdout:6/425: rename d3/d10/d12/d3a/l53 to d3/d10/l85 0 2024-02-22T00:33:22.821 INFO:tasks.workunit.client.1.smithi161.stdout:6/426: dread - d3/dc/df/f6a zero size 2024-02-22T00:33:22.822 INFO:tasks.workunit.client.1.smithi161.stdout:2/459: write de/d2b/d65/d3a/f75 [772053,110642] 0 2024-02-22T00:33:22.830 INFO:tasks.workunit.client.1.smithi161.stdout:2/460: dread de/d2b/d65/d3a/f75 [0,4194304] 0 2024-02-22T00:33:22.835 INFO:tasks.workunit.client.1.smithi161.stdout:8/508: write d1/d1c/d20/d22/d3f/f51 [1168754,74433] 0 2024-02-22T00:33:22.839 INFO:tasks.workunit.client.1.smithi161.stdout:4/472: rename d5/d10/d14/d24/l37 to d5/d10/d14/d24/d28/d63/lb1 0 2024-02-22T00:33:22.839 INFO:tasks.workunit.client.1.smithi161.stdout:5/625: link d3/d1c/d62/lb8 d3/d1b/d25/d4c/d7b/lda 0 2024-02-22T00:33:22.842 INFO:tasks.workunit.client.1.smithi161.stdout:8/509: creat d1/d2f/d37/d64/fa9 x:0 0 0 2024-02-22T00:33:22.843 INFO:tasks.workunit.client.1.smithi161.stdout:2/461: dwrite de/d2b/d65/d3a/f7c [0,4194304] 0 2024-02-22T00:33:22.844 INFO:tasks.workunit.client.1.smithi161.stdout:4/473: chown d5/d8/l19 261038992 1 2024-02-22T00:33:22.847 INFO:tasks.workunit.client.1.smithi161.stdout:5/626: mkdir d3/d1b/d25/dcc/ddb 0 2024-02-22T00:33:22.850 INFO:tasks.workunit.client.1.smithi161.stdout:7/425: dwrite d3/df/d33/d35/d55/d63/d7b/f70 [0,4194304] 0 2024-02-22T00:33:22.853 INFO:tasks.workunit.client.1.smithi161.stdout:4/474: mknod d5/d10/d14/d24/d28/d63/d6b/cb2 0 2024-02-22T00:33:22.854 INFO:tasks.workunit.client.1.smithi161.stdout:2/462: creat de/d2b/d65/f9c x:0 0 0 2024-02-22T00:33:22.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/484: dread d1/d2/d4/d11/f1c [0,4194304] 0 2024-02-22T00:33:22.855 INFO:tasks.workunit.client.1.smithi161.stdout:7/426: stat d3/df/d33/d35/d55/d63/d7b/d50/f61 0 2024-02-22T00:33:22.859 INFO:tasks.workunit.client.1.smithi161.stdout:4/475: symlink d5/lb3 0 2024-02-22T00:33:22.859 INFO:tasks.workunit.client.1.smithi161.stdout:9/485: write d1/d2/d7/da/f75 [992107,82242] 0 2024-02-22T00:33:22.860 INFO:tasks.workunit.client.1.smithi161.stdout:8/510: rename d1/d2f/d37/d64/d7b/c72 to d1/d2f/d37/d64/d7b/caa 0 2024-02-22T00:33:22.863 INFO:tasks.workunit.client.1.smithi161.stdout:2/463: rename de/d2b/d83/d93 to de/d2b/d65/d3a/d9d 0 2024-02-22T00:33:22.865 INFO:tasks.workunit.client.1.smithi161.stdout:2/464: readlink de/l5a 0 2024-02-22T00:33:22.866 INFO:tasks.workunit.client.1.smithi161.stdout:7/427: creat d3/df/d33/d74/f8e x:0 0 0 2024-02-22T00:33:22.866 INFO:tasks.workunit.client.1.smithi161.stdout:5/627: dwrite d3/d1c/d62/f94 [4194304,4194304] 0 2024-02-22T00:33:22.866 INFO:tasks.workunit.client.1.smithi161.stdout:9/486: symlink d1/d2/d7/d3f/la8 0 2024-02-22T00:33:22.869 INFO:tasks.workunit.client.1.smithi161.stdout:4/476: truncate d5/d8/d41/d53/d6c/d72/f8e 2120423 0 2024-02-22T00:33:22.869 INFO:tasks.workunit.client.1.smithi161.stdout:2/465: fsync de/d11/d14/f18 0 2024-02-22T00:33:22.870 INFO:tasks.workunit.client.1.smithi161.stdout:9/487: read - d1/d2/d4/f79 zero size 2024-02-22T00:33:22.871 INFO:tasks.workunit.client.1.smithi161.stdout:8/511: write d1/d1c/d20/d22/d28/d7f/d92/d95/f50 [2135800,37421] 0 2024-02-22T00:33:22.873 INFO:tasks.workunit.client.1.smithi161.stdout:7/428: rmdir d3/df/d33/d35/d55/d63/d7b/d30 39 2024-02-22T00:33:22.875 INFO:tasks.workunit.client.1.smithi161.stdout:4/477: symlink d5/d10/d14/d24/d28/d63/d6b/lb4 0 2024-02-22T00:33:22.877 INFO:tasks.workunit.client.1.smithi161.stdout:8/512: readlink d1/d1c/d20/d22/l9b 0 2024-02-22T00:33:22.877 INFO:tasks.workunit.client.1.smithi161.stdout:2/466: chown de/d2b/d65/d3a/d72/d8f/f6b 1147 1 2024-02-22T00:33:22.879 INFO:tasks.workunit.client.1.smithi161.stdout:4/478: dread - d5/d17/d5c/f7b zero size 2024-02-22T00:33:22.880 INFO:tasks.workunit.client.1.smithi161.stdout:7/429: unlink d3/df/d33/d53/l6a 0 2024-02-22T00:33:22.880 INFO:tasks.workunit.client.1.smithi161.stdout:8/513: fsync d1/d2f/f3e 0 2024-02-22T00:33:22.882 INFO:tasks.workunit.client.1.smithi161.stdout:9/488: truncate d1/d2/d4/d1f/f90 124757 0 2024-02-22T00:33:22.883 INFO:tasks.workunit.client.1.smithi161.stdout:4/479: mknod d5/cb5 0 2024-02-22T00:33:22.884 INFO:tasks.workunit.client.1.smithi161.stdout:5/628: dwrite d3/d1b/d36/f3b [0,4194304] 0 2024-02-22T00:33:22.885 INFO:tasks.workunit.client.1.smithi161.stdout:2/467: write de/d2b/d65/d60/f78 [789122,35193] 0 2024-02-22T00:33:22.885 INFO:tasks.workunit.client.1.smithi161.stdout:9/489: fsync d1/d25/f43 0 2024-02-22T00:33:22.887 INFO:tasks.workunit.client.1.smithi161.stdout:8/514: unlink d1/d2f/d37/d64/d7b/f65 0 2024-02-22T00:33:22.888 INFO:tasks.workunit.client.1.smithi161.stdout:5/629: creat d3/d9c/fdc x:0 0 0 2024-02-22T00:33:22.891 INFO:tasks.workunit.client.1.smithi161.stdout:8/515: fdatasync d1/d1c/fa4 0 2024-02-22T00:33:22.896 INFO:tasks.workunit.client.1.smithi161.stdout:8/516: dread d1/d1c/d20/d22/d28/d36/f46 [0,4194304] 0 2024-02-22T00:33:22.897 INFO:tasks.workunit.client.1.smithi161.stdout:8/517: fdatasync d1/d2f/d37/d64/f91 0 2024-02-22T00:33:22.898 INFO:tasks.workunit.client.1.smithi161.stdout:8/518: write d1/d2f/f5e [1261219,45909] 0 2024-02-22T00:33:22.900 INFO:tasks.workunit.client.1.smithi161.stdout:7/430: rename d3/df/d33/d35/d84 to d3/df/d33/d35/d55/d63/d7b/d8f 0 2024-02-22T00:33:22.900 INFO:tasks.workunit.client.1.smithi161.stdout:5/630: mkdir d3/d1b/d25/d4c/dd2/ddd 0 2024-02-22T00:33:22.907 INFO:tasks.workunit.client.1.smithi161.stdout:7/431: dread d3/df/d33/f40 [0,4194304] 0 2024-02-22T00:33:22.907 INFO:tasks.workunit.client.1.smithi161.stdout:8/519: creat d1/d2f/fab x:0 0 0 2024-02-22T00:33:22.911 INFO:tasks.workunit.client.1.smithi161.stdout:4/480: dwrite d5/d10/d14/fad [0,4194304] 0 2024-02-22T00:33:22.914 INFO:tasks.workunit.client.1.smithi161.stdout:2/468: dwrite de/d2b/d65/d60/d68/f7a [0,4194304] 0 2024-02-22T00:33:22.918 INFO:tasks.workunit.client.1.smithi161.stdout:2/469: write de/d2b/d83/f87 [4583786,53242] 0 2024-02-22T00:33:22.920 INFO:tasks.workunit.client.1.smithi161.stdout:4/481: symlink d5/d10/d14/d24/d28/d63/d64/lb6 0 2024-02-22T00:33:22.922 INFO:tasks.workunit.client.1.smithi161.stdout:2/470: mknod de/d11/d32/c9e 0 2024-02-22T00:33:22.923 INFO:tasks.workunit.client.1.smithi161.stdout:4/482: creat d5/d10/d14/fb7 x:0 0 0 2024-02-22T00:33:22.924 INFO:tasks.workunit.client.1.smithi161.stdout:8/520: dwrite d1/d1c/d20/d22/d28/f2e [4194304,4194304] 0 2024-02-22T00:33:22.924 INFO:tasks.workunit.client.1.smithi161.stdout:2/471: write de/d2b/f5b [4911326,88774] 0 2024-02-22T00:33:22.926 INFO:tasks.workunit.client.1.smithi161.stdout:4/483: dread - d5/d10/d75/f9a zero size 2024-02-22T00:33:22.931 INFO:tasks.workunit.client.1.smithi161.stdout:4/484: rename d5/la to d5/d10/da9/lb8 0 2024-02-22T00:33:22.932 INFO:tasks.workunit.client.1.smithi161.stdout:2/472: symlink de/d2b/d65/l9f 0 2024-02-22T00:33:22.934 INFO:tasks.workunit.client.1.smithi161.stdout:2/473: write fa [4569333,41388] 0 2024-02-22T00:33:22.936 INFO:tasks.workunit.client.1.smithi161.stdout:8/521: dwrite d1/d1c/d20/d22/d28/d7f/d92/d95/f9f [0,4194304] 0 2024-02-22T00:33:22.937 INFO:tasks.workunit.client.1.smithi161.stdout:4/485: write d5/d8/d41/d53/d6c/d72/f8e [304474,56566] 0 2024-02-22T00:33:22.938 INFO:tasks.workunit.client.1.smithi161.stdout:2/474: creat de/d2b/d65/d3a/fa0 x:0 0 0 2024-02-22T00:33:22.940 INFO:tasks.workunit.client.1.smithi161.stdout:8/522: mknod d1/d2f/d30/cac 0 2024-02-22T00:33:22.941 INFO:tasks.workunit.client.1.smithi161.stdout:4/486: read d5/d8/f76 [605749,66506] 0 2024-02-22T00:33:22.945 INFO:tasks.workunit.client.1.smithi161.stdout:4/487: fsync d5/d8/d41/f8b 0 2024-02-22T00:33:22.948 INFO:tasks.workunit.client.1.smithi161.stdout:2/475: dwrite de/f85 [0,4194304] 0 2024-02-22T00:33:22.950 INFO:tasks.workunit.client.1.smithi161.stdout:8/523: dread d1/d1c/d20/d22/d28/d36/d70/f8c [0,4194304] 0 2024-02-22T00:33:22.951 INFO:tasks.workunit.client.1.smithi161.stdout:7/432: dread d3/df/d33/d35/d55/d63/d7b/d30/f3b [4194304,4194304] 0 2024-02-22T00:33:22.953 INFO:tasks.workunit.client.1.smithi161.stdout:4/488: symlink d5/d8/d41/d53/d6c/d91/lb9 0 2024-02-22T00:33:22.957 INFO:tasks.workunit.client.1.smithi161.stdout:7/433: chown d3/df/d33/d35/d55/d63/d7b/d30/c4c 0 1 2024-02-22T00:33:22.958 INFO:tasks.workunit.client.1.smithi161.stdout:2/476: write de/d11/d5c/f69 [1685270,110517] 0 2024-02-22T00:33:22.958 INFO:tasks.workunit.client.1.smithi161.stdout:0/540: sync 2024-02-22T00:33:22.958 INFO:tasks.workunit.client.1.smithi161.stdout:4/489: creat d5/d10/d14/d24/d28/fba x:0 0 0 2024-02-22T00:33:22.959 INFO:tasks.workunit.client.1.smithi161.stdout:0/541: write d14/d1a/f28 [4598957,52911] 0 2024-02-22T00:33:22.961 INFO:tasks.workunit.client.1.smithi161.stdout:7/434: rmdir d3/df/d33/d35/d55/d63/d7b/d30/d44 39 2024-02-22T00:33:22.961 INFO:tasks.workunit.client.1.smithi161.stdout:2/477: dread de/d2b/d65/d60/f78 [0,4194304] 0 2024-02-22T00:33:22.962 INFO:tasks.workunit.client.1.smithi161.stdout:4/490: rmdir d5/d10/d14/d4f 39 2024-02-22T00:33:22.963 INFO:tasks.workunit.client.1.smithi161.stdout:4/491: chown d5/d10/d14/d24/d28/fba 221369 1 2024-02-22T00:33:22.969 INFO:tasks.workunit.client.1.smithi161.stdout:0/542: creat d14/d1a/d3f/d5d/fb0 x:0 0 0 2024-02-22T00:33:22.969 INFO:tasks.workunit.client.1.smithi161.stdout:2/478: creat de/d2b/d65/d3a/d71/fa1 x:0 0 0 2024-02-22T00:33:22.969 INFO:tasks.workunit.client.1.smithi161.stdout:2/479: fsync fa 0 2024-02-22T00:33:22.969 INFO:tasks.workunit.client.1.smithi161.stdout:4/492: chown d5/c5a 1447353 1 2024-02-22T00:33:22.969 INFO:tasks.workunit.client.1.smithi161.stdout:7/435: creat d3/df/d33/d35/d55/d63/d7b/d30/d44/f90 x:0 0 0 2024-02-22T00:33:22.969 INFO:tasks.workunit.client.1.smithi161.stdout:2/480: mkdir de/d2b/d8b/da2 0 2024-02-22T00:33:22.970 INFO:tasks.workunit.client.1.smithi161.stdout:8/524: fdatasync d1/d1c/d20/d22/d28/d7f/d92/d95/f9f 0 2024-02-22T00:33:22.970 INFO:tasks.workunit.client.1.smithi161.stdout:2/481: stat de/d2b/d65/l9f 0 2024-02-22T00:33:22.970 INFO:tasks.workunit.client.1.smithi161.stdout:4/493: rename d5/d10/d14/d24/d28/f87 to d5/d10/d14/d24/d28/d63/d65/d9d/fbb 0 2024-02-22T00:33:22.973 INFO:tasks.workunit.client.1.smithi161.stdout:8/525: write d1/d2f/d37/d64/d7b/f99 [865279,56965] 0 2024-02-22T00:33:22.974 INFO:tasks.workunit.client.1.smithi161.stdout:8/526: stat d1/d1c/d75/d18/f25 0 2024-02-22T00:33:22.975 INFO:tasks.workunit.client.1.smithi161.stdout:4/494: rename d5/d17/f31 to d5/db0/fbc 0 2024-02-22T00:33:22.976 INFO:tasks.workunit.client.1.smithi161.stdout:2/482: creat de/d2b/d65/d60/d68/fa3 x:0 0 0 2024-02-22T00:33:22.977 INFO:tasks.workunit.client.1.smithi161.stdout:4/495: fsync d5/d10/d14/d24/d28/f7c 0 2024-02-22T00:33:22.979 INFO:tasks.workunit.client.1.smithi161.stdout:2/483: write de/d2b/d65/f31 [756074,67002] 0 2024-02-22T00:33:22.980 INFO:tasks.workunit.client.1.smithi161.stdout:8/527: mknod d1/d1c/d20/d22/d28/d36/d6c/cad 0 2024-02-22T00:33:22.980 INFO:tasks.workunit.client.1.smithi161.stdout:4/496: fdatasync d5/d10/d14/d24/d28/f7c 0 2024-02-22T00:33:22.982 INFO:tasks.workunit.client.1.smithi161.stdout:4/497: write f0 [119315,35141] 0 2024-02-22T00:33:22.982 INFO:tasks.workunit.client.1.smithi161.stdout:8/528: chown d1/d2f/fab 3658051 1 2024-02-22T00:33:22.984 INFO:tasks.workunit.client.1.smithi161.stdout:4/498: write d5/d8/d41/f46 [648040,1587] 0 2024-02-22T00:33:22.984 INFO:tasks.workunit.client.1.smithi161.stdout:2/484: symlink de/d2b/d65/d3a/la4 0 2024-02-22T00:33:22.985 INFO:tasks.workunit.client.1.smithi161.stdout:7/436: dread d3/f7d [0,4194304] 0 2024-02-22T00:33:22.985 INFO:tasks.workunit.client.1.smithi161.stdout:8/529: dread - d1/d2f/d37/d64/d7b/f9d zero size 2024-02-22T00:33:22.987 INFO:tasks.workunit.client.1.smithi161.stdout:4/499: write d5/d10/d14/d24/f77 [446472,53414] 0 2024-02-22T00:33:22.991 INFO:tasks.workunit.client.1.smithi161.stdout:4/500: read d5/d17/f1e [3606002,111669] 0 2024-02-22T00:33:22.994 INFO:tasks.workunit.client.1.smithi161.stdout:4/501: chown d5/d10/d75/fa0 837483 1 2024-02-22T00:33:22.995 INFO:tasks.workunit.client.1.smithi161.stdout:7/437: truncate d3/df/d33/d35/d55/d63/d7b/d30/f3b 5108474 0 2024-02-22T00:33:22.996 INFO:tasks.workunit.client.1.smithi161.stdout:2/485: dwrite de/d2b/f96 [0,4194304] 0 2024-02-22T00:33:22.998 INFO:tasks.workunit.client.1.smithi161.stdout:2/486: truncate de/d11/f29 422796 0 2024-02-22T00:33:23.003 INFO:tasks.workunit.client.1.smithi161.stdout:4/502: creat d5/d10/d14/d24/d28/fbd x:0 0 0 2024-02-22T00:33:23.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/503: write d5/d10/d14/fad [4330779,85588] 0 2024-02-22T00:33:23.014 INFO:tasks.workunit.client.1.smithi161.stdout:8/530: dread d1/d1c/d20/d22/d28/d7f/d92/d95/f57 [4194304,4194304] 0 2024-02-22T00:33:23.017 INFO:tasks.workunit.client.1.smithi161.stdout:2/487: dwrite de/d2b/f96 [4194304,4194304] 0 2024-02-22T00:33:23.019 INFO:tasks.workunit.client.1.smithi161.stdout:8/531: truncate d1/d1c/d75/d18/f68 112532 0 2024-02-22T00:33:23.022 INFO:tasks.workunit.client.1.smithi161.stdout:7/438: dread d3/df/d33/f4f [0,4194304] 0 2024-02-22T00:33:23.022 INFO:tasks.workunit.client.1.smithi161.stdout:4/504: rename d5/d10/d14/d24 to d5/d8/d41/d57/dbe 0 2024-02-22T00:33:23.024 INFO:tasks.workunit.client.1.smithi161.stdout:2/488: chown de/d2b/d65/d3a/d72/c9b 196 1 2024-02-22T00:33:23.026 INFO:tasks.workunit.client.1.smithi161.stdout:2/489: write de/d2b/d65/d3a/fa0 [1013338,24197] 0 2024-02-22T00:33:23.027 INFO:tasks.workunit.client.1.smithi161.stdout:7/439: symlink d3/dd/d60/d64/l91 0 2024-02-22T00:33:23.027 INFO:tasks.workunit.client.1.smithi161.stdout:2/490: dread - de/d2b/d65/d3a/d72/f74 zero size 2024-02-22T00:33:23.028 INFO:tasks.workunit.client.1.smithi161.stdout:4/505: rename d5/d8 to d5/d8/d41/d57/dbe/dbf 22 2024-02-22T00:33:23.029 INFO:tasks.workunit.client.1.smithi161.stdout:7/440: write d3/f17 [259393,9692] 0 2024-02-22T00:33:23.031 INFO:tasks.workunit.client.1.smithi161.stdout:2/491: mkdir de/d2b/d8b/da2/da5 0 2024-02-22T00:33:23.033 INFO:tasks.workunit.client.1.smithi161.stdout:7/441: symlink d3/df/d33/d53/l92 0 2024-02-22T00:33:23.034 INFO:tasks.workunit.client.1.smithi161.stdout:7/442: truncate d3/f72 82940 0 2024-02-22T00:33:23.035 INFO:tasks.workunit.client.1.smithi161.stdout:8/532: truncate d1/d2f/f5e 1460905 0 2024-02-22T00:33:23.036 INFO:tasks.workunit.client.1.smithi161.stdout:4/506: getdents d5/d8/d41/d57/dbe/d28/d38/d6d 0 2024-02-22T00:33:23.038 INFO:tasks.workunit.client.1.smithi161.stdout:2/492: creat de/d11/d5c/fa6 x:0 0 0 2024-02-22T00:33:23.041 INFO:tasks.workunit.client.1.smithi161.stdout:4/507: creat d5/d8/d41/d57/dbe/d28/d63/d64/fc0 x:0 0 0 2024-02-22T00:33:23.043 INFO:tasks.workunit.client.1.smithi161.stdout:7/443: dwrite d3/df/d33/d35/d55/d63/d7b/f3e [0,4194304] 0 2024-02-22T00:33:23.047 INFO:tasks.workunit.client.1.smithi161.stdout:4/508: symlink d5/d8/d41/d57/dbe/d28/d63/d6b/lc1 0 2024-02-22T00:33:23.047 INFO:tasks.workunit.client.1.smithi161.stdout:2/493: dread de/d2b/d83/d4f/f54 [0,4194304] 0 2024-02-22T00:33:23.047 INFO:tasks.workunit.client.1.smithi161.stdout:2/494: fdatasync f8 0 2024-02-22T00:33:23.048 INFO:tasks.workunit.client.1.smithi161.stdout:7/444: creat d3/d77/f93 x:0 0 0 2024-02-22T00:33:23.049 INFO:tasks.workunit.client.1.smithi161.stdout:7/445: write d3/fa [4742723,93715] 0 2024-02-22T00:33:23.057 INFO:tasks.workunit.client.1.smithi161.stdout:7/446: link d3/dd/d59/f7c d3/df/d33/d35/d55/d63/d7b/d8f/f94 0 2024-02-22T00:33:23.057 INFO:tasks.workunit.client.1.smithi161.stdout:7/447: chown d3/df/d33/d35/d55/d6f 239784 1 2024-02-22T00:33:23.063 INFO:tasks.workunit.client.1.smithi161.stdout:7/448: dwrite d3/dd/f1d [0,4194304] 0 2024-02-22T00:33:23.063 INFO:tasks.workunit.client.0.smithi049.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-22T00:33:23.068 INFO:tasks.workunit.client.1.smithi161.stdout:7/449: rmdir d3/df/d33/d35/d55/d63 39 2024-02-22T00:33:23.076 INFO:tasks.workunit.client.1.smithi161.stdout:7/450: rename d3/df/d33/d35/d55/d6f to d3/df/d33/d35/d55/d63/d7b/d30/d44/d95 0 2024-02-22T00:33:23.079 INFO:tasks.workunit.client.1.smithi161.stdout:7/451: creat d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/f96 x:0 0 0 2024-02-22T00:33:23.081 INFO:tasks.workunit.client.1.smithi161.stdout:7/452: mknod d3/dd/c97 0 2024-02-22T00:33:23.082 INFO:tasks.workunit.client.1.smithi161.stdout:7/453: stat d3/df/d33/d35/c42 0 2024-02-22T00:33:23.084 INFO:tasks.workunit.client.1.smithi161.stdout:7/454: creat d3/df/d33/d74/f98 x:0 0 0 2024-02-22T00:33:23.084 INFO:tasks.workunit.client.1.smithi161.stdout:7/455: chown d3/dd/l23 7 1 2024-02-22T00:33:23.086 INFO:tasks.workunit.client.1.smithi161.stdout:7/456: symlink d3/dd/d60/d64/l99 0 2024-02-22T00:33:23.089 INFO:tasks.workunit.client.1.smithi161.stdout:7/457: fdatasync d3/df/d33/d35/d55/d63/d7b/d30/f3b 0 2024-02-22T00:33:23.090 INFO:tasks.workunit.client.1.smithi161.stdout:7/458: chown d3/dd/fe 1 1 2024-02-22T00:33:23.091 INFO:tasks.workunit.client.1.smithi161.stdout:7/459: chown d3/dd/c58 2 1 2024-02-22T00:33:23.092 INFO:tasks.workunit.client.1.smithi161.stdout:7/460: fdatasync d3/df/d33/d35/d55/d63/d7b/d30/d44/f90 0 2024-02-22T00:33:23.097 INFO:tasks.workunit.client.1.smithi161.stdout:7/461: rename d3/dd/fe to d3/df/d33/d35/d55/d63/d7b/d30/f9a 0 2024-02-22T00:33:23.098 INFO:tasks.workunit.client.1.smithi161.stdout:7/462: write d3/df/d33/d35/d55/d63/d7b/d30/d44/f90 [34988,91178] 0 2024-02-22T00:33:23.101 INFO:tasks.workunit.client.1.smithi161.stdout:7/463: write d3/f7 [2277923,42497] 0 2024-02-22T00:33:23.102 INFO:tasks.workunit.client.1.smithi161.stdout:7/464: write d3/df/d43/f65 [369400,4190] 0 2024-02-22T00:33:23.135 INFO:tasks.workunit.client.1.smithi161.stdout:3/395: sync 2024-02-22T00:33:23.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/504: sync 2024-02-22T00:33:23.139 INFO:tasks.workunit.client.1.smithi161.stdout:1/505: fdatasync d19/d1d/d2c/d2d/d3f/f9f 0 2024-02-22T00:33:23.143 INFO:tasks.workunit.client.1.smithi161.stdout:1/506: write d19/d48/faf [612395,116655] 0 2024-02-22T00:33:23.145 INFO:tasks.workunit.client.1.smithi161.stdout:1/507: write d19/d48/d68/da8/fad [354936,39324] 0 2024-02-22T00:33:23.147 INFO:tasks.workunit.client.1.smithi161.stdout:1/508: truncate f1 1245051 0 2024-02-22T00:33:23.150 INFO:tasks.workunit.client.1.smithi161.stdout:1/509: mkdir d19/d1d/d2c/d2d/db7 0 2024-02-22T00:33:23.150 INFO:tasks.workunit.client.1.smithi161.stdout:3/396: dread da/dc/d11/d26/d2f/f82 [0,4194304] 0 2024-02-22T00:33:23.153 INFO:tasks.workunit.client.1.smithi161.stdout:1/510: creat d19/d1d/d2c/d4f/d98/fb8 x:0 0 0 2024-02-22T00:33:23.155 INFO:tasks.workunit.client.1.smithi161.stdout:3/397: link f0 da/d29/f86 0 2024-02-22T00:33:23.156 INFO:tasks.workunit.client.1.smithi161.stdout:1/511: symlink d19/d1d/d2c/d2d/d3f/d69/lb9 0 2024-02-22T00:33:23.157 INFO:tasks.workunit.client.1.smithi161.stdout:1/512: write d19/d1d/d2c/f4d [2063368,118930] 0 2024-02-22T00:33:23.160 INFO:tasks.workunit.client.1.smithi161.stdout:3/398: unlink da/dc/d11/d26/d2f/l4c 0 2024-02-22T00:33:23.164 INFO:tasks.workunit.client.1.smithi161.stdout:1/513: dwrite d19/f37 [0,4194304] 0 2024-02-22T00:33:23.166 INFO:tasks.workunit.client.1.smithi161.stdout:3/399: link da/dc/d11/d26/d2f/d37/d39/f4b da/dc/d11/d40/d60/f87 0 2024-02-22T00:33:23.167 INFO:tasks.workunit.client.1.smithi161.stdout:1/514: rmdir d19/d51/d64/d9b 39 2024-02-22T00:33:23.168 INFO:tasks.workunit.client.1.smithi161.stdout:3/400: mknod da/d29/c88 0 2024-02-22T00:33:23.170 INFO:tasks.workunit.client.1.smithi161.stdout:1/515: unlink c13 0 2024-02-22T00:33:23.176 INFO:tasks.workunit.client.1.smithi161.stdout:3/401: rename da/dc/d11/d26/d2f/f7d to da/dc/d11/d26/d2f/d37/d39/f89 0 2024-02-22T00:33:23.177 INFO:tasks.workunit.client.1.smithi161.stdout:3/402: chown da/dc/d11/d26/d2f/d37/l47 13 1 2024-02-22T00:33:23.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:21.757158+0000 mgr.smithi161.sazlam (mgr.24369) 28 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 1001 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 24 MiB/s rd, 132 MiB/s wr, 467 op/s 2024-02-22T00:33:23.192 INFO:tasks.workunit.client.1.smithi161.stdout:3/403: dread da/dc/f51 [0,4194304] 0 2024-02-22T00:33:23.193 INFO:tasks.workunit.client.1.smithi161.stdout:3/404: dread - da/dc/d11/d26/d2f/f7c zero size 2024-02-22T00:33:23.195 INFO:tasks.workunit.client.1.smithi161.stdout:3/405: fdatasync da/dc/d11/d40/d59/f84 0 2024-02-22T00:33:23.203 INFO:tasks.workunit.client.1.smithi161.stdout:3/406: dwrite da/d29/f86 [0,4194304] 0 2024-02-22T00:33:23.206 INFO:tasks.workunit.client.1.smithi161.stdout:3/407: rename da/dc/d11/d26/d2f/f41 to da/f8a 0 2024-02-22T00:33:23.209 INFO:tasks.workunit.client.1.smithi161.stdout:3/408: mknod da/dc/d11/d26/d2f/d37/d39/c8b 0 2024-02-22T00:33:23.212 INFO:tasks.workunit.client.1.smithi161.stdout:3/409: fsync da/dc/f2b 0 2024-02-22T00:33:23.215 INFO:tasks.workunit.client.1.smithi161.stdout:3/410: mknod da/dc/d11/d40/d60/c8c 0 2024-02-22T00:33:23.216 INFO:tasks.workunit.client.1.smithi161.stdout:3/411: write da/d29/f32 [941217,88049] 0 2024-02-22T00:33:23.219 INFO:tasks.workunit.client.1.smithi161.stdout:3/412: truncate da/dc/d11/d26/d2f/f7c 557522 0 2024-02-22T00:33:23.219 INFO:tasks.workunit.client.1.smithi161.stdout:3/413: stat da/dc/d11/d26/c22 0 2024-02-22T00:33:23.221 INFO:tasks.workunit.client.1.smithi161.stdout:3/414: rmdir da/dc/d11/d26 39 2024-02-22T00:33:23.225 INFO:tasks.workunit.client.1.smithi161.stdout:3/415: unlink da/dc/d5f/d68/c6b 0 2024-02-22T00:33:23.227 INFO:tasks.workunit.client.1.smithi161.stdout:3/416: getdents da/dc/d11/d26/d80 0 2024-02-22T00:33:23.228 INFO:tasks.workunit.client.1.smithi161.stdout:3/417: write da/dc/d5f/d66/f6f [754375,67510] 0 2024-02-22T00:33:23.230 INFO:tasks.workunit.client.1.smithi161.stdout:3/418: mknod da/c8d 0 2024-02-22T00:33:23.231 INFO:tasks.workunit.client.1.smithi161.stdout:3/419: write da/dc/d11/d26/d2f/f85 [219375,86680] 0 2024-02-22T00:33:23.232 INFO:tasks.workunit.client.1.smithi161.stdout:3/420: write da/d29/f54 [786825,57236] 0 2024-02-22T00:33:23.239 INFO:tasks.workunit.client.1.smithi161.stdout:3/421: rename da/dc/d11/d26/d2f to da/d29/d8e 0 2024-02-22T00:33:23.239 INFO:tasks.workunit.client.1.smithi161.stdout:3/422: chown da/d29/d8e 52090 1 2024-02-22T00:33:23.242 INFO:tasks.workunit.client.1.smithi161.stdout:3/423: link da/c12 da/dc/d5f/c8f 0 2024-02-22T00:33:23.248 INFO:tasks.workunit.client.1.smithi161.stdout:3/424: dwrite da/d56/f7b [0,4194304] 0 2024-02-22T00:33:23.248 INFO:tasks.workunit.client.1.smithi161.stdout:3/425: dread - da/d29/f7f zero size 2024-02-22T00:33:23.256 INFO:tasks.workunit.client.1.smithi161.stdout:3/426: dwrite da/d29/d8e/f58 [0,4194304] 0 2024-02-22T00:33:23.258 INFO:tasks.workunit.client.1.smithi161.stdout:3/427: write da/dc/d11/d40/f6a [1731718,19104] 0 2024-02-22T00:33:23.265 INFO:tasks.workunit.client.1.smithi161.stdout:3/428: dwrite da/dc/d11/d26/f7e [0,4194304] 0 2024-02-22T00:33:23.266 INFO:tasks.workunit.client.1.smithi161.stdout:3/429: truncate da/dc/d5f/d66/f6f 1838543 0 2024-02-22T00:33:23.280 INFO:tasks.workunit.client.1.smithi161.stdout:3/430: dwrite da/d29/d8e/d37/d39/f4b [0,4194304] 0 2024-02-22T00:33:23.284 INFO:tasks.workunit.client.1.smithi161.stdout:3/431: unlink da/d29/l35 0 2024-02-22T00:33:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:21.757158+0000 mgr.smithi161.sazlam (mgr.24369) 28 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 1001 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 24 MiB/s rd, 132 MiB/s wr, 467 op/s 2024-02-22T00:33:23.302 INFO:tasks.workunit.client.1.smithi161.stdout:3/432: dread da/d29/d8e/d37/d39/f42 [0,4194304] 0 2024-02-22T00:33:23.304 INFO:tasks.workunit.client.1.smithi161.stdout:3/433: creat da/dc/d11/d40/d59/f90 x:0 0 0 2024-02-22T00:33:23.306 INFO:tasks.workunit.client.1.smithi161.stdout:3/434: fdatasync da/dc/d11/d26/f21 0 2024-02-22T00:33:23.306 INFO:tasks.workunit.client.1.smithi161.stdout:3/435: stat da/dc 0 2024-02-22T00:33:23.307 INFO:tasks.workunit.client.1.smithi161.stdout:3/436: mkdir da/dc/d91 0 2024-02-22T00:33:23.308 INFO:tasks.workunit.client.1.smithi161.stdout:3/437: chown da/dc/d11/d26/f4d 2 1 2024-02-22T00:33:23.312 INFO:tasks.workunit.client.1.smithi161.stdout:3/438: rename da/dc/d11/d40/d74 to da/dc/d11/d26/d80/d92 0 2024-02-22T00:33:23.315 INFO:tasks.workunit.client.1.smithi161.stdout:3/439: dread da/dc/d11/d26/f52 [0,4194304] 0 2024-02-22T00:33:23.316 INFO:tasks.workunit.client.1.smithi161.stdout:3/440: fsync da/d29/d8e/f82 0 2024-02-22T00:33:23.317 INFO:tasks.workunit.client.1.smithi161.stdout:3/441: dread - da/dc/d11/d40/d59/f90 zero size 2024-02-22T00:33:23.323 INFO:tasks.workunit.client.1.smithi161.stdout:3/442: dwrite da/d29/d8e/d37/d39/f4b [0,4194304] 0 2024-02-22T00:33:23.335 INFO:tasks.workunit.client.1.smithi161.stdout:3/443: dread da/dc/d11/d40/d59/f84 [0,4194304] 0 2024-02-22T00:33:23.338 INFO:tasks.workunit.client.1.smithi161.stdout:3/444: rmdir da/dc/d11/d40 39 2024-02-22T00:33:23.338 INFO:tasks.workunit.client.1.smithi161.stdout:3/445: readlink da/l43 0 2024-02-22T00:33:23.341 INFO:tasks.workunit.client.1.smithi161.stdout:3/446: mkdir da/dc/d11/d40/d59/d93 0 2024-02-22T00:33:23.347 INFO:tasks.workunit.client.1.smithi161.stdout:6/427: sync 2024-02-22T00:33:23.347 INFO:tasks.workunit.client.1.smithi161.stdout:3/447: truncate da/d29/f32 1382384 0 2024-02-22T00:33:23.348 INFO:tasks.workunit.client.1.smithi161.stdout:3/448: write da/d29/d8e/f85 [34548,71011] 0 2024-02-22T00:33:23.349 INFO:tasks.workunit.client.1.smithi161.stdout:6/428: chown d3/d10/l85 29505558 1 2024-02-22T00:33:23.349 INFO:tasks.workunit.client.1.smithi161.stdout:6/429: fdatasync d3/f7f 0 2024-02-22T00:33:23.351 INFO:tasks.workunit.client.1.smithi161.stdout:3/449: symlink da/dc/l94 0 2024-02-22T00:33:23.352 INFO:tasks.workunit.client.1.smithi161.stdout:6/430: fdatasync d3/f66 0 2024-02-22T00:33:23.353 INFO:tasks.workunit.client.1.smithi161.stdout:6/431: truncate d3/d48/f5c 5160674 0 2024-02-22T00:33:23.353 INFO:tasks.workunit.client.1.smithi161.stdout:6/432: dread - d3/d10/d12/d3a/f68 zero size 2024-02-22T00:33:23.355 INFO:tasks.workunit.client.1.smithi161.stdout:3/450: unlink da/dc/l61 0 2024-02-22T00:33:23.356 INFO:tasks.workunit.client.1.smithi161.stdout:6/433: symlink d3/d10/d1b/l86 0 2024-02-22T00:33:23.360 INFO:tasks.workunit.client.1.smithi161.stdout:3/451: rename da/dc/d11/d40/f69 to da/dc/d5f/d66/f95 0 2024-02-22T00:33:23.361 INFO:tasks.workunit.client.1.smithi161.stdout:6/434: mkdir d3/d10/d1b/d5e/d87 0 2024-02-22T00:33:23.362 INFO:tasks.workunit.client.1.smithi161.stdout:3/452: write da/dc/d11/d26/f45 [226991,31132] 0 2024-02-22T00:33:23.364 INFO:tasks.workunit.client.1.smithi161.stdout:6/435: creat d3/d10/d1b/d5e/d87/f88 x:0 0 0 2024-02-22T00:33:23.364 INFO:tasks.workunit.client.1.smithi161.stdout:3/453: readlink da/dc/l83 0 2024-02-22T00:33:23.367 INFO:tasks.workunit.client.1.smithi161.stdout:6/436: dread d3/d48/f6b [0,4194304] 0 2024-02-22T00:33:23.372 INFO:tasks.workunit.client.1.smithi161.stdout:6/437: symlink d3/d7c/l89 0 2024-02-22T00:33:23.374 INFO:tasks.workunit.client.1.smithi161.stdout:6/438: mknod d3/d10/d1b/d5e/d87/c8a 0 2024-02-22T00:33:23.375 INFO:tasks.workunit.client.1.smithi161.stdout:6/439: write d3/f66 [59095,92109] 0 2024-02-22T00:33:23.376 INFO:tasks.workunit.client.1.smithi161.stdout:3/454: write da/d29/d8e/d37/d39/f89 [1565839,120279] 0 2024-02-22T00:33:23.427 INFO:tasks.workunit.client.1.smithi161.stdout:3/455: creat da/dc/d5f/f96 x:0 0 0 2024-02-22T00:33:23.428 INFO:tasks.workunit.client.1.smithi161.stdout:6/440: dwrite d3/d10/d12/f2d [0,4194304] 0 2024-02-22T00:33:23.430 INFO:tasks.workunit.client.1.smithi161.stdout:6/441: write d3/d10/d12/d3a/f68 [31093,76843] 0 2024-02-22T00:33:23.456 INFO:tasks.workunit.client.1.smithi161.stdout:9/490: sync 2024-02-22T00:33:23.460 INFO:tasks.workunit.client.1.smithi161.stdout:9/491: symlink d1/d2/d4/d11/d21/la9 0 2024-02-22T00:33:23.460 INFO:tasks.workunit.client.1.smithi161.stdout:9/492: fdatasync d1/d5/d9/f4a 0 2024-02-22T00:33:23.461 INFO:tasks.workunit.client.1.smithi161.stdout:6/442: rename d3/d10/l85 to d3/l8b 0 2024-02-22T00:33:23.464 INFO:tasks.workunit.client.1.smithi161.stdout:6/443: symlink d3/d10/d1b/l8c 0 2024-02-22T00:33:23.465 INFO:tasks.workunit.client.1.smithi161.stdout:3/456: truncate da/d29/d8e/d37/d39/f42 1410910 0 2024-02-22T00:33:23.465 INFO:tasks.workunit.client.1.smithi161.stdout:6/444: stat d3/d10/c62 0 2024-02-22T00:33:23.466 INFO:tasks.workunit.client.1.smithi161.stdout:9/493: dwrite d1/d2/d7/da/f13 [0,4194304] 0 2024-02-22T00:33:23.471 INFO:tasks.workunit.client.0.smithi049.stderr:++ readlink -f fsstress 2024-02-22T00:33:23.474 INFO:tasks.workunit.client.1.smithi161.stdout:9/494: creat d1/d2/d4/d11/faa x:0 0 0 2024-02-22T00:33:23.474 INFO:tasks.workunit.client.0.smithi049.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-22T00:33:23.474 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2024-02-22T00:33:23.475 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-22T00:33:23.476 INFO:tasks.workunit.client.0.smithi049.stderr:+ popd 2024-02-22T00:33:23.477 INFO:tasks.workunit.client.1.smithi161.stdout:6/445: dread d3/d10/d1b/f2e [0,4194304] 0 2024-02-22T00:33:23.477 INFO:tasks.workunit.client.0.smithi049.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-22T00:33:23.477 INFO:tasks.workunit.client.0.smithi049.stderr:++ mktemp -d -p . 2024-02-22T00:33:23.482 INFO:tasks.workunit.client.1.smithi161.stdout:6/446: dread d3/d10/f65 [0,4194304] 0 2024-02-22T00:33:23.482 INFO:tasks.workunit.client.0.smithi049.stderr:+ T=./tmp.S1GSSG7cOq 2024-02-22T00:33:23.483 INFO:tasks.workunit.client.0.smithi049.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.S1GSSG7cOq -l 1 -n 1000 -p 10 -v 2024-02-22T00:33:23.486 INFO:tasks.workunit.client.1.smithi161.stdout:6/447: write d3/d30/f74 [985663,13655] 0 2024-02-22T00:33:23.487 INFO:tasks.workunit.client.1.smithi161.stdout:3/457: dwrite da/d29/d8e/d37/f49 [0,4194304] 0 2024-02-22T00:33:23.487 INFO:tasks.workunit.client.0.smithi049.stdout:seed = 1708260148 2024-02-22T00:33:23.488 INFO:tasks.workunit.client.1.smithi161.stdout:6/448: creat d3/d48/f8d x:0 0 0 2024-02-22T00:33:23.491 INFO:tasks.workunit.client.1.smithi161.stdout:3/458: creat da/dc/d11/d40/f97 x:0 0 0 2024-02-22T00:33:23.492 INFO:tasks.workunit.client.1.smithi161.stdout:6/449: mknod d3/d10/d12/d3a/c8e 0 2024-02-22T00:33:23.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/0: rmdir - no directory 2024-02-22T00:33:23.494 INFO:tasks.workunit.client.1.smithi161.stdout:9/495: dread d1/d2/d7/f6a [0,4194304] 0 2024-02-22T00:33:23.495 INFO:tasks.workunit.client.1.smithi161.stdout:3/459: mknod da/d29/d8e/c98 0 2024-02-22T00:33:23.496 INFO:tasks.workunit.client.0.smithi049.stdout:0/1: mknod c0 0 2024-02-22T00:33:23.497 INFO:tasks.workunit.client.0.smithi049.stdout:0/2: chown c0 489513 1 2024-02-22T00:33:23.497 INFO:tasks.workunit.client.0.smithi049.stdout:0/3: dwrite - no filename 2024-02-22T00:33:23.497 INFO:tasks.workunit.client.0.smithi049.stdout:0/4: write - no filename 2024-02-22T00:33:23.497 INFO:tasks.workunit.client.0.smithi049.stdout:0/5: write - no filename 2024-02-22T00:33:23.497 INFO:tasks.workunit.client.0.smithi049.stdout:0/6: write - no filename 2024-02-22T00:33:23.497 INFO:tasks.workunit.client.0.smithi049.stdout:0/7: rmdir - no directory 2024-02-22T00:33:23.499 INFO:tasks.workunit.client.0.smithi049.stdout:1/0: creat f0 x:0 0 0 2024-02-22T00:33:23.499 INFO:tasks.workunit.client.1.smithi161.stdout:3/460: symlink da/d29/d53/l99 0 2024-02-22T00:33:23.499 INFO:tasks.workunit.client.0.smithi049.stdout:1/1: chown f0 1044630823 1 2024-02-22T00:33:23.500 INFO:tasks.workunit.client.0.smithi049.stdout:0/8: link c0 c1 0 2024-02-22T00:33:23.501 INFO:tasks.workunit.client.0.smithi049.stdout:3/0: dread - no filename 2024-02-22T00:33:23.501 INFO:tasks.workunit.client.1.smithi161.stdout:3/461: symlink da/dc/d5f/d66/l9a 0 2024-02-22T00:33:23.502 INFO:tasks.workunit.client.0.smithi049.stdout:1/2: unlink f0 0 2024-02-22T00:33:23.503 INFO:tasks.workunit.client.0.smithi049.stdout:4/0: chown . 1871876 1 2024-02-22T00:33:23.503 INFO:tasks.workunit.client.0.smithi049.stdout:4/1: dread - no filename 2024-02-22T00:33:23.504 INFO:tasks.workunit.client.0.smithi049.stdout:4/2: stat - no entries 2024-02-22T00:33:23.504 INFO:tasks.workunit.client.0.smithi049.stdout:0/9: symlink l2 0 2024-02-22T00:33:23.505 INFO:tasks.workunit.client.1.smithi161.stdout:3/462: creat da/dc/f9b x:0 0 0 2024-02-22T00:33:23.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/3: symlink l1 0 2024-02-22T00:33:23.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/4: dread - no filename 2024-02-22T00:33:23.506 INFO:tasks.workunit.client.1.smithi161.stdout:6/450: truncate d3/d10/f65 2213241 0 2024-02-22T00:33:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/1: getdents . 0 2024-02-22T00:33:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/0: unlink - no file 2024-02-22T00:33:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/1: readlink - no filename 2024-02-22T00:33:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/2: dwrite - no filename 2024-02-22T00:33:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/2: chown . 13146 1 2024-02-22T00:33:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/3: truncate - no filename 2024-02-22T00:33:23.507 INFO:tasks.workunit.client.0.smithi049.stdout:3/4: dread - no filename 2024-02-22T00:33:23.508 INFO:tasks.workunit.client.0.smithi049.stdout:0/10: mkdir d3 0 2024-02-22T00:33:23.508 INFO:tasks.workunit.client.1.smithi161.stdout:9/496: truncate d1/d5/d9/d33/d4f/f84 704759 0 2024-02-22T00:33:23.508 INFO:tasks.workunit.client.0.smithi049.stdout:1/5: mkdir d2 0 2024-02-22T00:33:23.508 INFO:tasks.workunit.client.0.smithi049.stdout:1/6: truncate - no filename 2024-02-22T00:33:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/3: symlink l0 0 2024-02-22T00:33:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/4: write - no filename 2024-02-22T00:33:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/5: rmdir - no directory 2024-02-22T00:33:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/6: rmdir - no directory 2024-02-22T00:33:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/7: write - no filename 2024-02-22T00:33:23.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/8: dread - no filename 2024-02-22T00:33:23.510 INFO:tasks.workunit.client.1.smithi161.stdout:3/463: link da/dc/d11/f3e da/dc/d91/f9c 0 2024-02-22T00:33:23.511 INFO:tasks.workunit.client.1.smithi161.stdout:6/451: mknod d3/c8f 0 2024-02-22T00:33:23.511 INFO:tasks.workunit.client.0.smithi049.stdout:4/9: creat f1 x:0 0 0 2024-02-22T00:33:23.512 INFO:tasks.workunit.client.1.smithi161.stdout:9/497: mkdir d1/d2/d4/d1f/dab 0 2024-02-22T00:33:23.512 INFO:tasks.workunit.client.0.smithi049.stdout:5/3: mkdir d0 0 2024-02-22T00:33:23.512 INFO:tasks.workunit.client.0.smithi049.stdout:0/11: getdents d3 0 2024-02-22T00:33:23.512 INFO:tasks.workunit.client.0.smithi049.stdout:0/12: write - no filename 2024-02-22T00:33:23.512 INFO:tasks.workunit.client.0.smithi049.stdout:0/13: fsync - no filename 2024-02-22T00:33:23.512 INFO:tasks.workunit.client.0.smithi049.stdout:5/4: chown d0 15807689 1 2024-02-22T00:33:23.513 INFO:tasks.workunit.client.0.smithi049.stdout:1/7: creat d2/f3 x:0 0 0 2024-02-22T00:33:23.513 INFO:tasks.workunit.client.1.smithi161.stdout:3/464: creat da/dc/d11/d40/d59/f9d x:0 0 0 2024-02-22T00:33:23.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/10: write f1 [39720,123110] 0 2024-02-22T00:33:23.514 INFO:tasks.workunit.client.1.smithi161.stdout:6/452: creat d3/d10/d12/d2f/d7d/d5f/f90 x:0 0 0 2024-02-22T00:33:23.515 INFO:tasks.workunit.client.1.smithi161.stdout:9/498: mknod d1/d4b/cac 0 2024-02-22T00:33:23.515 INFO:tasks.workunit.client.0.smithi049.stdout:8/0: creat f0 x:0 0 0 2024-02-22T00:33:23.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/1: readlink - no filename 2024-02-22T00:33:23.518 INFO:tasks.workunit.client.0.smithi049.stdout:1/8: creat d2/f4 x:0 0 0 2024-02-22T00:33:23.518 INFO:tasks.workunit.client.0.smithi049.stdout:0/14: stat c0 0 2024-02-22T00:33:23.518 INFO:tasks.workunit.client.0.smithi049.stdout:0/15: dwrite - no filename 2024-02-22T00:33:23.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/5: mkdir d0/d1 0 2024-02-22T00:33:23.520 INFO:tasks.workunit.client.0.smithi049.stdout:5/6: dread - no filename 2024-02-22T00:33:23.520 INFO:tasks.workunit.client.0.smithi049.stdout:8/2: mkdir d1 0 2024-02-22T00:33:23.522 INFO:tasks.workunit.client.0.smithi049.stdout:1/9: unlink l1 0 2024-02-22T00:33:23.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/10: chown d2/f4 30143 1 2024-02-22T00:33:23.524 INFO:tasks.workunit.client.0.smithi049.stdout:2/0: symlink l0 0 2024-02-22T00:33:23.525 INFO:tasks.workunit.client.0.smithi049.stdout:5/7: mknod d0/c2 0 2024-02-22T00:33:23.526 INFO:tasks.workunit.client.1.smithi161.stdout:3/465: dwrite da/f8a [0,4194304] 0 2024-02-22T00:33:23.526 INFO:tasks.workunit.client.1.smithi161.stdout:9/499: dwrite d1/d25/f58 [0,4194304] 0 2024-02-22T00:33:23.528 INFO:tasks.workunit.client.0.smithi049.stdout:4/11: dwrite f1 [0,4194304] 0 2024-02-22T00:33:23.530 INFO:tasks.workunit.client.0.smithi049.stdout:6/0: mknod c0 0 2024-02-22T00:33:23.530 INFO:tasks.workunit.client.0.smithi049.stdout:6/1: stat c0 0 2024-02-22T00:33:23.531 INFO:tasks.workunit.client.0.smithi049.stdout:6/2: stat c0 0 2024-02-22T00:33:23.531 INFO:tasks.workunit.client.0.smithi049.stdout:6/3: dwrite - no filename 2024-02-22T00:33:23.531 INFO:tasks.workunit.client.0.smithi049.stdout:6/4: truncate - no filename 2024-02-22T00:33:23.532 INFO:tasks.workunit.client.0.smithi049.stdout:6/5: stat c0 0 2024-02-22T00:33:23.532 INFO:tasks.workunit.client.0.smithi049.stdout:6/6: dread - no filename 2024-02-22T00:33:23.532 INFO:tasks.workunit.client.0.smithi049.stdout:6/7: read - no filename 2024-02-22T00:33:23.534 INFO:tasks.workunit.client.1.smithi161.stdout:9/500: read d1/d5/d9/d33/f32 [597489,6408] 0 2024-02-22T00:33:23.534 INFO:tasks.workunit.client.1.smithi161.stdout:3/466: fsync da/dc/d11/d26/f3c 0 2024-02-22T00:33:23.534 INFO:tasks.workunit.client.0.smithi049.stdout:1/11: mknod d2/c5 0 2024-02-22T00:33:23.535 INFO:tasks.workunit.client.1.smithi161.stdout:6/453: dread d3/d10/f38 [0,4194304] 0 2024-02-22T00:33:23.535 INFO:tasks.workunit.client.0.smithi049.stdout:0/16: getdents d3 0 2024-02-22T00:33:23.535 INFO:tasks.workunit.client.0.smithi049.stdout:8/3: mkdir d1/d2 0 2024-02-22T00:33:23.536 INFO:tasks.workunit.client.0.smithi049.stdout:1/12: rename d2 to d2/d6 22 2024-02-22T00:33:23.536 INFO:tasks.workunit.client.0.smithi049.stdout:2/1: symlink l1 0 2024-02-22T00:33:23.538 INFO:tasks.workunit.client.1.smithi161.stdout:8/533: sync 2024-02-22T00:33:23.538 INFO:tasks.workunit.client.1.smithi161.stdout:5/631: sync 2024-02-22T00:33:23.538 INFO:tasks.workunit.client.1.smithi161.stdout:4/509: sync 2024-02-22T00:33:23.538 INFO:tasks.workunit.client.1.smithi161.stdout:0/543: sync 2024-02-22T00:33:23.538 INFO:tasks.workunit.client.0.smithi049.stdout:5/8: mknod d0/c3 0 2024-02-22T00:33:23.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/12: creat f2 x:0 0 0 2024-02-22T00:33:23.540 INFO:tasks.workunit.client.1.smithi161.stdout:6/454: creat d3/dc/df/d32/f91 x:0 0 0 2024-02-22T00:33:23.541 INFO:tasks.workunit.client.0.smithi049.stdout:6/8: symlink l1 0 2024-02-22T00:33:23.541 INFO:tasks.workunit.client.0.smithi049.stdout:6/9: write - no filename 2024-02-22T00:33:23.541 INFO:tasks.workunit.client.0.smithi049.stdout:7/0: creat f0 x:0 0 0 2024-02-22T00:33:23.541 INFO:tasks.workunit.client.0.smithi049.stdout:8/4: dread - f0 zero size 2024-02-22T00:33:23.541 INFO:tasks.workunit.client.1.smithi161.stdout:5/632: stat d3/d1c/d20/c37 0 2024-02-22T00:33:23.542 INFO:tasks.workunit.client.0.smithi049.stdout:9/0: creat f0 x:0 0 0 2024-02-22T00:33:23.543 INFO:tasks.workunit.client.0.smithi049.stdout:2/2: mkdir d2 0 2024-02-22T00:33:23.543 INFO:tasks.workunit.client.0.smithi049.stdout:2/3: fdatasync - no filename 2024-02-22T00:33:23.543 INFO:tasks.workunit.client.0.smithi049.stdout:2/4: fdatasync - no filename 2024-02-22T00:33:23.543 INFO:tasks.workunit.client.0.smithi049.stdout:2/5: write - no filename 2024-02-22T00:33:23.544 INFO:tasks.workunit.client.1.smithi161.stdout:4/510: mknod d5/d8/d41/d53/cc2 0 2024-02-22T00:33:23.544 INFO:tasks.workunit.client.0.smithi049.stdout:5/9: creat d0/f4 x:0 0 0 2024-02-22T00:33:23.544 INFO:tasks.workunit.client.0.smithi049.stdout:4/13: mkdir d3 0 2024-02-22T00:33:23.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/10: unlink c0 0 2024-02-22T00:33:23.546 INFO:tasks.workunit.client.0.smithi049.stdout:6/11: rmdir - no directory 2024-02-22T00:33:23.546 INFO:tasks.workunit.client.0.smithi049.stdout:0/17: stat c1 0 2024-02-22T00:33:23.546 INFO:tasks.workunit.client.0.smithi049.stdout:0/18: dwrite - no filename 2024-02-22T00:33:23.546 INFO:tasks.workunit.client.0.smithi049.stdout:0/19: truncate - no filename 2024-02-22T00:33:23.547 INFO:tasks.workunit.client.0.smithi049.stdout:7/1: mkdir d1 0 2024-02-22T00:33:23.547 INFO:tasks.workunit.client.0.smithi049.stdout:0/20: chown l2 128126651 1 2024-02-22T00:33:23.549 INFO:tasks.workunit.client.1.smithi161.stdout:4/511: dread d5/d17/f92 [0,4194304] 0 2024-02-22T00:33:23.550 INFO:tasks.workunit.client.0.smithi049.stdout:7/2: write f0 [172112,59270] 0 2024-02-22T00:33:23.551 INFO:tasks.workunit.client.0.smithi049.stdout:2/6: rename l0 to d2/l3 0 2024-02-22T00:33:23.551 INFO:tasks.workunit.client.0.smithi049.stdout:2/7: write - no filename 2024-02-22T00:33:23.552 INFO:tasks.workunit.client.1.smithi161.stdout:6/455: mknod d3/d10/d1b/d5e/d87/c92 0 2024-02-22T00:33:23.552 INFO:tasks.workunit.client.0.smithi049.stdout:4/14: dread f1 [0,4194304] 0 2024-02-22T00:33:23.552 INFO:tasks.workunit.client.0.smithi049.stdout:6/12: creat f2 x:0 0 0 2024-02-22T00:33:23.553 INFO:tasks.workunit.client.1.smithi161.stdout:5/633: write d3/d1c/d20/f73 [350029,74843] 0 2024-02-22T00:33:23.553 INFO:tasks.workunit.client.0.smithi049.stdout:5/10: rename d0/d1 to d0/d1/d5 22 2024-02-22T00:33:23.553 INFO:tasks.workunit.client.0.smithi049.stdout:8/5: creat d1/d2/f3 x:0 0 0 2024-02-22T00:33:23.555 INFO:tasks.workunit.client.1.smithi161.stdout:9/501: dread d1/d2/d7/f16 [0,4194304] 0 2024-02-22T00:33:23.555 INFO:tasks.workunit.client.0.smithi049.stdout:0/21: mkdir d3/d4 0 2024-02-22T00:33:23.555 INFO:tasks.workunit.client.0.smithi049.stdout:0/22: truncate - no filename 2024-02-22T00:33:23.555 INFO:tasks.workunit.client.1.smithi161.stdout:0/544: link d14/d1a/d3f/c52 d14/d37/d42/d8e/cb1 0 2024-02-22T00:33:23.558 INFO:tasks.workunit.client.0.smithi049.stdout:7/3: link f0 d1/f2 0 2024-02-22T00:33:23.559 INFO:tasks.workunit.client.0.smithi049.stdout:8/6: symlink d1/d2/l4 0 2024-02-22T00:33:23.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/23: rmdir d3 39 2024-02-22T00:33:23.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/24: dread - no filename 2024-02-22T00:33:23.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/25: write - no filename 2024-02-22T00:33:23.560 INFO:tasks.workunit.client.1.smithi161.stdout:0/545: write d14/d37/f76 [1003686,100200] 0 2024-02-22T00:33:23.560 INFO:tasks.workunit.client.0.smithi049.stdout:4/15: symlink d3/l4 0 2024-02-22T00:33:23.561 INFO:tasks.workunit.client.0.smithi049.stdout:8/7: readlink d1/d2/l4 0 2024-02-22T00:33:23.562 INFO:tasks.workunit.client.1.smithi161.stdout:3/467: dwrite da/dc/d11/d26/f63 [0,4194304] 0 2024-02-22T00:33:23.562 INFO:tasks.workunit.client.0.smithi049.stdout:7/4: fdatasync f0 0 2024-02-22T00:33:23.562 INFO:tasks.workunit.client.0.smithi049.stdout:0/26: readlink l2 0 2024-02-22T00:33:23.562 INFO:tasks.workunit.client.1.smithi161.stdout:3/468: readlink da/d29/d53/l99 0 2024-02-22T00:33:23.564 INFO:tasks.workunit.client.0.smithi049.stdout:7/5: chown d1/f2 894 1 2024-02-22T00:33:23.566 INFO:tasks.workunit.client.1.smithi161.stdout:8/534: dread d1/d1c/d20/d22/d3f/f82 [0,4194304] 0 2024-02-22T00:33:23.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/6: mknod d1/c3 0 2024-02-22T00:33:23.573 INFO:tasks.workunit.client.1.smithi161.stdout:4/512: dread f3 [0,4194304] 0 2024-02-22T00:33:23.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/13: dwrite f2 [0,4194304] 0 2024-02-22T00:33:23.577 INFO:tasks.workunit.client.1.smithi161.stdout:9/502: creat d1/d2/d4/fad x:0 0 0 2024-02-22T00:33:23.584 INFO:tasks.workunit.client.0.smithi049.stdout:8/8: dwrite f0 [0,4194304] 0 2024-02-22T00:33:23.584 INFO:tasks.workunit.client.1.smithi161.stdout:3/469: dwrite da/dc/d11/d26/f45 [0,4194304] 0 2024-02-22T00:33:23.584 INFO:tasks.workunit.client.0.smithi049.stdout:4/16: dwrite f1 [0,4194304] 0 2024-02-22T00:33:23.589 INFO:tasks.workunit.client.0.smithi049.stdout:8/9: chown f0 226 1 2024-02-22T00:33:23.589 INFO:tasks.workunit.client.1.smithi161.stdout:0/546: dwrite d14/f82 [0,4194304] 0 2024-02-22T00:33:23.590 INFO:tasks.workunit.client.1.smithi161.stdout:5/634: write d3/d1b/d36/f83 [1114648,106223] 0 2024-02-22T00:33:23.593 INFO:tasks.workunit.client.0.smithi049.stdout:4/17: mknod d3/c5 0 2024-02-22T00:33:23.593 INFO:tasks.workunit.client.0.smithi049.stdout:4/18: stat f2 0 2024-02-22T00:33:23.593 INFO:tasks.workunit.client.0.smithi049.stdout:6/14: dwrite f2 [0,4194304] 0 2024-02-22T00:33:23.605 INFO:tasks.workunit.client.1.smithi161.stdout:6/456: dwrite d3/dc/df/f69 [0,4194304] 0 2024-02-22T00:33:23.606 INFO:tasks.workunit.client.1.smithi161.stdout:9/503: dread d1/d2/d7/f16 [0,4194304] 0 2024-02-22T00:33:23.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/10: dread f0 [0,4194304] 0 2024-02-22T00:33:23.611 INFO:tasks.workunit.client.1.smithi161.stdout:8/535: truncate d1/d1c/d20/d22/d28/d7f/d92/d95/f3b 1258185 0 2024-02-22T00:33:23.611 INFO:tasks.workunit.client.1.smithi161.stdout:9/504: mknod d1/d5/d9/cae 0 2024-02-22T00:33:23.611 INFO:tasks.workunit.client.1.smithi161.stdout:6/457: creat d3/dc/df/d32/f93 x:0 0 0 2024-02-22T00:33:23.611 INFO:tasks.workunit.client.0.smithi049.stdout:4/19: dwrite f2 [0,4194304] 0 2024-02-22T00:33:23.611 INFO:tasks.workunit.client.0.smithi049.stdout:4/20: stat f2 0 2024-02-22T00:33:23.611 INFO:tasks.workunit.client.0.smithi049.stdout:6/15: mkdir d3 0 2024-02-22T00:33:23.612 INFO:tasks.workunit.client.0.smithi049.stdout:4/21: write f1 [144635,8015] 0 2024-02-22T00:33:23.614 INFO:tasks.workunit.client.1.smithi161.stdout:4/513: dwrite d5/d8/d41/d57/f60 [0,4194304] 0 2024-02-22T00:33:23.616 INFO:tasks.workunit.client.0.smithi049.stdout:4/22: symlink d3/l6 0 2024-02-22T00:33:23.619 INFO:tasks.workunit.client.0.smithi049.stdout:6/16: mknod d3/c4 0 2024-02-22T00:33:23.620 INFO:tasks.workunit.client.1.smithi161.stdout:9/505: rename d1/d5/f7b to d1/d2/d4/d95/faf 0 2024-02-22T00:33:23.620 INFO:tasks.workunit.client.1.smithi161.stdout:7/465: sync 2024-02-22T00:33:23.620 INFO:tasks.workunit.client.1.smithi161.stdout:2/495: sync 2024-02-22T00:33:23.620 INFO:tasks.workunit.client.1.smithi161.stdout:1/516: sync 2024-02-22T00:33:23.621 INFO:tasks.workunit.client.1.smithi161.stdout:3/470: dwrite da/d29/d8e/f82 [4194304,4194304] 0 2024-02-22T00:33:23.626 INFO:tasks.workunit.client.1.smithi161.stdout:1/517: stat d19/d1d/f36 0 2024-02-22T00:33:23.627 INFO:tasks.workunit.client.1.smithi161.stdout:6/458: rename d3/dc/df/f6a to d3/d10/d1b/d5e/f94 0 2024-02-22T00:33:23.628 INFO:tasks.workunit.client.1.smithi161.stdout:9/506: write d1/d2/d7/da/f17 [3032116,29229] 0 2024-02-22T00:33:23.628 INFO:tasks.workunit.client.1.smithi161.stdout:7/466: chown d3/df/d33/l46 16412745 1 2024-02-22T00:33:23.629 INFO:tasks.workunit.client.1.smithi161.stdout:8/536: dread d1/d1c/d20/d22/d28/d7f/d92/d95/f9f [0,4194304] 0 2024-02-22T00:33:23.629 INFO:tasks.workunit.client.1.smithi161.stdout:0/547: truncate d14/d37/d42/d73/fab 1326854 0 2024-02-22T00:33:23.633 INFO:tasks.workunit.client.1.smithi161.stdout:1/518: unlink d19/d1d/f57 0 2024-02-22T00:33:23.634 INFO:tasks.workunit.client.1.smithi161.stdout:5/635: truncate d3/d1c/d20/f59 169536 0 2024-02-22T00:33:23.636 INFO:tasks.workunit.client.1.smithi161.stdout:2/496: mkdir de/d2b/d65/d3a/d72/da7 0 2024-02-22T00:33:23.636 INFO:tasks.workunit.client.1.smithi161.stdout:3/471: mknod da/d29/c9e 0 2024-02-22T00:33:23.637 INFO:tasks.workunit.client.1.smithi161.stdout:9/507: truncate d1/d25/d73/d60/d77/f7c 710858 0 2024-02-22T00:33:23.644 INFO:tasks.workunit.client.1.smithi161.stdout:4/514: creat d5/d8/d41/d57/dbe/d28/d38/d6d/da5/fc3 x:0 0 0 2024-02-22T00:33:23.644 INFO:tasks.workunit.client.1.smithi161.stdout:7/467: rename d3/dd/l67 to d3/dd/d59/l9b 0 2024-02-22T00:33:23.644 INFO:tasks.workunit.client.1.smithi161.stdout:5/636: stat d3/d1b/d25/c21 0 2024-02-22T00:33:23.645 INFO:tasks.workunit.client.1.smithi161.stdout:9/508: stat d1/d2/d4/d11/d21/f46 0 2024-02-22T00:33:23.646 INFO:tasks.workunit.client.1.smithi161.stdout:6/459: mkdir d3/d10/d12/d95 0 2024-02-22T00:33:23.646 INFO:tasks.workunit.client.1.smithi161.stdout:4/515: mknod d5/d8/d41/d53/d6c/d72/cc4 0 2024-02-22T00:33:23.647 INFO:tasks.workunit.client.1.smithi161.stdout:0/548: dwrite d14/d1a/d3f/f4c [0,4194304] 0 2024-02-22T00:33:23.648 INFO:tasks.workunit.client.1.smithi161.stdout:8/537: fdatasync d1/d2f/f5e 0 2024-02-22T00:33:23.651 INFO:tasks.workunit.client.1.smithi161.stdout:9/509: mkdir d1/d25/d73/d60/db0 0 2024-02-22T00:33:23.656 INFO:tasks.workunit.client.1.smithi161.stdout:5/637: creat d3/dac/fde x:0 0 0 2024-02-22T00:33:23.657 INFO:tasks.workunit.client.1.smithi161.stdout:0/549: read d14/f51 [1878398,16682] 0 2024-02-22T00:33:23.662 INFO:tasks.workunit.client.1.smithi161.stdout:5/638: fdatasync d3/d1b/d91/d96/fb1 0 2024-02-22T00:33:23.666 INFO:tasks.workunit.client.1.smithi161.stdout:9/510: rmdir d1/d5/d9/d33/d4f 39 2024-02-22T00:33:23.666 INFO:tasks.workunit.client.1.smithi161.stdout:3/472: dwrite da/dc/d11/d40/d59/f84 [0,4194304] 0 2024-02-22T00:33:23.675 INFO:tasks.workunit.client.1.smithi161.stdout:0/550: stat d14/l58 0 2024-02-22T00:33:23.675 INFO:tasks.workunit.client.1.smithi161.stdout:6/460: dwrite d3/d48/f5c [4194304,4194304] 0 2024-02-22T00:33:23.675 INFO:tasks.workunit.client.1.smithi161.stdout:7/468: getdents d3/df/d33/d53 0 2024-02-22T00:33:23.675 INFO:tasks.workunit.client.1.smithi161.stdout:8/538: rename d1/d1c/c9a to d1/d1c/d75/d18/cae 0 2024-02-22T00:33:23.676 INFO:tasks.workunit.client.1.smithi161.stdout:2/497: write de/d2b/d65/d3a/d72/d8f/f8d [1219784,52673] 0 2024-02-22T00:33:23.676 INFO:tasks.workunit.client.1.smithi161.stdout:9/511: write d1/d25/f43 [412882,8436] 0 2024-02-22T00:33:23.679 INFO:tasks.workunit.client.1.smithi161.stdout:3/473: write da/dc/d11/f28 [3848037,37628] 0 2024-02-22T00:33:23.679 INFO:tasks.workunit.client.1.smithi161.stdout:0/551: creat d14/d37/d42/fb2 x:0 0 0 2024-02-22T00:33:23.680 INFO:tasks.workunit.client.1.smithi161.stdout:9/512: chown d1/d2/d4/d95 5 1 2024-02-22T00:33:23.681 INFO:tasks.workunit.client.0.smithi049.stdout:0/27: symlink d3/l5 0 2024-02-22T00:33:23.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/28: dread - no filename 2024-02-22T00:33:23.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/29: dread - no filename 2024-02-22T00:33:23.682 INFO:tasks.workunit.client.0.smithi049.stdout:0/30: write - no filename 2024-02-22T00:33:23.684 INFO:tasks.workunit.client.0.smithi049.stdout:0/31: getdents d3/d4 0 2024-02-22T00:33:23.687 INFO:tasks.workunit.client.0.smithi049.stdout:0/32: rename d3/d4 to d3/d6 0 2024-02-22T00:33:23.687 INFO:tasks.workunit.client.0.smithi049.stdout:0/33: fdatasync - no filename 2024-02-22T00:33:23.687 INFO:tasks.workunit.client.0.smithi049.stdout:0/34: fsync - no filename 2024-02-22T00:33:23.688 INFO:tasks.workunit.client.1.smithi161.stdout:3/474: read da/dc/d11/d26/f3c [555552,27130] 0 2024-02-22T00:33:23.688 INFO:tasks.workunit.client.1.smithi161.stdout:6/461: link d3/d10/d12/f22 d3/d10/d12/d3a/f96 0 2024-02-22T00:33:23.689 INFO:tasks.workunit.client.0.smithi049.stdout:0/35: rename d3/l5 to d3/l7 0 2024-02-22T00:33:23.690 INFO:tasks.workunit.client.1.smithi161.stdout:5/639: link d3/d1c/fbf d3/d29/d80/d92/fdf 0 2024-02-22T00:33:23.692 INFO:tasks.workunit.client.0.smithi049.stdout:0/36: mkdir d3/d6/d8 0 2024-02-22T00:33:23.695 INFO:tasks.workunit.client.0.smithi049.stdout:8/11: getdents d1 0 2024-02-22T00:33:23.696 INFO:tasks.workunit.client.1.smithi161.stdout:2/498: dwrite de/d2b/d65/d60/d68/f6c [0,4194304] 0 2024-02-22T00:33:23.696 INFO:tasks.workunit.client.1.smithi161.stdout:0/552: link d14/d29/l32 d14/d1a/d9d/lb3 0 2024-02-22T00:33:23.697 INFO:tasks.workunit.client.1.smithi161.stdout:8/539: dread d1/d2f/f5e [0,4194304] 0 2024-02-22T00:33:23.697 INFO:tasks.workunit.client.1.smithi161.stdout:9/513: dread d1/d5/d9/d33/f32 [0,4194304] 0 2024-02-22T00:33:23.698 INFO:tasks.workunit.client.0.smithi049.stdout:8/12: mkdir d1/d2/d5 0 2024-02-22T00:33:23.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/13: mknod d1/d2/c6 0 2024-02-22T00:33:23.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/11: fsync d0/f4 0 2024-02-22T00:33:23.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/14: readlink d1/d2/l4 0 2024-02-22T00:33:23.702 INFO:tasks.workunit.client.1.smithi161.stdout:7/469: truncate d3/df/d33/f40 703182 0 2024-02-22T00:33:23.704 INFO:tasks.workunit.client.0.smithi049.stdout:2/8: getdents d2 0 2024-02-22T00:33:23.705 INFO:tasks.workunit.client.0.smithi049.stdout:2/9: dread - no filename 2024-02-22T00:33:23.705 INFO:tasks.workunit.client.0.smithi049.stdout:2/10: dread - no filename 2024-02-22T00:33:23.705 INFO:tasks.workunit.client.0.smithi049.stdout:2/11: dwrite - no filename 2024-02-22T00:33:23.705 INFO:tasks.workunit.client.1.smithi161.stdout:2/499: creat de/d11/d32/fa8 x:0 0 0 2024-02-22T00:33:23.706 INFO:tasks.workunit.client.0.smithi049.stdout:5/12: getdents d0/d1 0 2024-02-22T00:33:23.706 INFO:tasks.workunit.client.0.smithi049.stdout:6/17: fsync f2 0 2024-02-22T00:33:23.706 INFO:tasks.workunit.client.0.smithi049.stdout:6/18: readlink l1 0 2024-02-22T00:33:23.706 INFO:tasks.workunit.client.0.smithi049.stdout:8/15: dread f0 [0,4194304] 0 2024-02-22T00:33:23.710 INFO:tasks.workunit.client.1.smithi161.stdout:3/475: getdents da/dc 0 2024-02-22T00:33:23.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/16: symlink d1/d2/d5/l7 0 2024-02-22T00:33:23.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/7: getdents d1 0 2024-02-22T00:33:23.717 INFO:tasks.workunit.client.1.smithi161.stdout:4/516: dwrite d5/d17/f92 [0,4194304] 0 2024-02-22T00:33:23.718 INFO:tasks.workunit.client.0.smithi049.stdout:6/19: dwrite f2 [4194304,4194304] 0 2024-02-22T00:33:23.719 INFO:tasks.workunit.client.0.smithi049.stdout:7/8: unlink d1/c3 0 2024-02-22T00:33:23.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/9: stat f0 0 2024-02-22T00:33:23.721 INFO:tasks.workunit.client.0.smithi049.stdout:8/17: dwrite f0 [0,4194304] 0 2024-02-22T00:33:23.722 INFO:tasks.workunit.client.1.smithi161.stdout:5/640: dwrite d3/dac/fb9 [0,4194304] 0 2024-02-22T00:33:23.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/20: creat d3/f5 x:0 0 0 2024-02-22T00:33:23.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/10: dread f0 [0,4194304] 0 2024-02-22T00:33:23.729 INFO:tasks.workunit.client.0.smithi049.stdout:6/21: creat d3/f6 x:0 0 0 2024-02-22T00:33:23.730 INFO:tasks.workunit.client.0.smithi049.stdout:4/23: truncate f2 3866535 0 2024-02-22T00:33:23.732 INFO:tasks.workunit.client.0.smithi049.stdout:7/11: creat d1/f4 x:0 0 0 2024-02-22T00:33:23.732 INFO:tasks.workunit.client.0.smithi049.stdout:6/22: write d3/f6 [793402,1827] 0 2024-02-22T00:33:23.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/24: fdatasync f2 0 2024-02-22T00:33:23.736 INFO:tasks.workunit.client.0.smithi049.stdout:7/12: mknod d1/c5 0 2024-02-22T00:33:23.737 INFO:tasks.workunit.client.0.smithi049.stdout:6/23: mknod d3/c7 0 2024-02-22T00:33:23.737 INFO:tasks.workunit.client.1.smithi161.stdout:8/540: dwrite d1/f2d [0,4194304] 0 2024-02-22T00:33:23.739 INFO:tasks.workunit.client.0.smithi049.stdout:7/13: creat d1/f6 x:0 0 0 2024-02-22T00:33:23.740 INFO:tasks.workunit.client.0.smithi049.stdout:6/24: creat d3/f8 x:0 0 0 2024-02-22T00:33:23.740 INFO:tasks.workunit.client.1.smithi161.stdout:6/462: dwrite d3/d10/d1b/d5e/f94 [0,4194304] 0 2024-02-22T00:33:23.741 INFO:tasks.workunit.client.0.smithi049.stdout:6/25: read f2 [7804326,32256] 0 2024-02-22T00:33:23.742 INFO:tasks.workunit.client.1.smithi161.stdout:4/517: creat d5/d10/d14/d4f/fc5 x:0 0 0 2024-02-22T00:33:23.743 INFO:tasks.workunit.client.1.smithi161.stdout:5/641: rmdir d3/d29 39 2024-02-22T00:33:23.746 INFO:tasks.workunit.client.1.smithi161.stdout:0/553: dwrite d14/d1a/f38 [0,4194304] 0 2024-02-22T00:33:23.749 INFO:tasks.workunit.client.0.smithi049.stdout:6/26: symlink d3/l9 0 2024-02-22T00:33:23.749 INFO:tasks.workunit.client.1.smithi161.stdout:7/470: rename d3/df/d6d to d3/df/d33/d35/d55/d63/d7b/d9c 0 2024-02-22T00:33:23.750 INFO:tasks.workunit.client.0.smithi049.stdout:7/14: dwrite d1/f2 [0,4194304] 0 2024-02-22T00:33:23.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/15: chown d1/f4 2815361 1 2024-02-22T00:33:23.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/16: readlink - no filename 2024-02-22T00:33:23.752 INFO:tasks.workunit.client.0.smithi049.stdout:6/27: creat d3/fa x:0 0 0 2024-02-22T00:33:23.753 INFO:tasks.workunit.client.1.smithi161.stdout:3/476: dread da/dc/d5f/d66/f6f [0,4194304] 0 2024-02-22T00:33:23.753 INFO:tasks.workunit.client.1.smithi161.stdout:5/642: creat d3/d1b/d25/d4c/dd2/fe0 x:0 0 0 2024-02-22T00:33:23.753 INFO:tasks.workunit.client.0.smithi049.stdout:6/28: write d3/f8 [730176,69653] 0 2024-02-22T00:33:23.754 INFO:tasks.workunit.client.1.smithi161.stdout:7/471: unlink c0 0 2024-02-22T00:33:23.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/17: rename d1/f2 to d1/f7 0 2024-02-22T00:33:23.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/554: creat d14/fb4 x:0 0 0 2024-02-22T00:33:23.758 INFO:tasks.workunit.client.0.smithi049.stdout:6/29: creat d3/fb x:0 0 0 2024-02-22T00:33:23.760 INFO:tasks.workunit.client.0.smithi049.stdout:7/18: creat d1/f8 x:0 0 0 2024-02-22T00:33:23.760 INFO:tasks.workunit.client.1.smithi161.stdout:3/477: dread - da/dc/d11/d40/d59/f9d zero size 2024-02-22T00:33:23.762 INFO:tasks.workunit.client.0.smithi049.stdout:7/19: creat d1/f9 x:0 0 0 2024-02-22T00:33:23.764 INFO:tasks.workunit.client.1.smithi161.stdout:2/500: dwrite de/d11/f4e [0,4194304] 0 2024-02-22T00:33:23.765 INFO:tasks.workunit.client.0.smithi049.stdout:7/20: creat d1/fa x:0 0 0 2024-02-22T00:33:23.765 INFO:tasks.workunit.client.0.smithi049.stdout:7/21: dread - d1/fa zero size 2024-02-22T00:33:23.766 INFO:tasks.workunit.client.0.smithi049.stdout:7/22: dread - d1/f6 zero size 2024-02-22T00:33:23.768 INFO:tasks.workunit.client.1.smithi161.stdout:6/463: dwrite d3/f66 [0,4194304] 0 2024-02-22T00:33:23.769 INFO:tasks.workunit.client.1.smithi161.stdout:5/643: getdents d3/d1c/d69 0 2024-02-22T00:33:23.771 INFO:tasks.workunit.client.0.smithi049.stdout:7/23: mknod d1/cb 0 2024-02-22T00:33:23.772 INFO:tasks.workunit.client.1.smithi161.stdout:8/541: truncate d1/d2f/d37/f48 611143 0 2024-02-22T00:33:23.773 INFO:tasks.workunit.client.1.smithi161.stdout:0/555: mknod d14/d1a/d3f/cb5 0 2024-02-22T00:33:23.773 INFO:tasks.workunit.client.1.smithi161.stdout:2/501: stat de/d2b/d65/d3a/la4 0 2024-02-22T00:33:23.775 INFO:tasks.workunit.client.1.smithi161.stdout:3/478: mknod da/dc/d11/d26/d80/c9f 0 2024-02-22T00:33:23.777 INFO:tasks.workunit.client.0.smithi049.stdout:8/18: getdents d1/d2/d5 0 2024-02-22T00:33:23.778 INFO:tasks.workunit.client.1.smithi161.stdout:0/556: truncate d14/fb4 681671 0 2024-02-22T00:33:23.778 INFO:tasks.workunit.client.0.smithi049.stdout:8/19: rename d1/d2 to d1/d2/d5/d8 22 2024-02-22T00:33:23.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/20: rename d1/d2/c6 to d1/d2/d5/c9 0 2024-02-22T00:33:23.784 INFO:tasks.workunit.client.1.smithi161.stdout:2/502: creat de/d2b/d65/d3a/d9d/fa9 x:0 0 0 2024-02-22T00:33:23.784 INFO:tasks.workunit.client.1.smithi161.stdout:6/464: fdatasync d3/d30/f76 0 2024-02-22T00:33:23.784 INFO:tasks.workunit.client.1.smithi161.stdout:3/479: creat da/dc/d11/d40/d59/fa0 x:0 0 0 2024-02-22T00:33:23.784 INFO:tasks.workunit.client.1.smithi161.stdout:8/542: truncate d1/d2f/d30/f33 967069 0 2024-02-22T00:33:23.785 INFO:tasks.workunit.client.0.smithi049.stdout:8/21: truncate d1/d2/f3 442691 0 2024-02-22T00:33:23.785 INFO:tasks.workunit.client.1.smithi161.stdout:3/480: fsync da/dc/f51 0 2024-02-22T00:33:23.786 INFO:tasks.workunit.client.0.smithi049.stdout:6/30: truncate f2 2357520 0 2024-02-22T00:33:23.786 INFO:tasks.workunit.client.1.smithi161.stdout:2/503: truncate de/d2b/d65/d3a/f75 1983172 0 2024-02-22T00:33:23.786 INFO:tasks.workunit.client.1.smithi161.stdout:3/481: chown da/d29/d8e/d37/d39 17347 1 2024-02-22T00:33:23.787 INFO:tasks.workunit.client.1.smithi161.stdout:6/465: chown d3/d10/d12/d2f/d7d/c58 30608 1 2024-02-22T00:33:23.788 INFO:tasks.workunit.client.0.smithi049.stdout:8/22: creat d1/fa x:0 0 0 2024-02-22T00:33:23.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/23: dread - d1/fa zero size 2024-02-22T00:33:23.791 INFO:tasks.workunit.client.1.smithi161.stdout:0/557: rename d14/f84 to d14/d1a/d3f/d5d/fb6 0 2024-02-22T00:33:23.791 INFO:tasks.workunit.client.0.smithi049.stdout:8/24: mkdir d1/d2/db 0 2024-02-22T00:33:23.792 INFO:tasks.workunit.client.0.smithi049.stdout:8/25: read d1/d2/f3 [103219,23860] 0 2024-02-22T00:33:23.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/24: fsync f0 0 2024-02-22T00:33:23.793 INFO:tasks.workunit.client.0.smithi049.stdout:7/25: chown d1/fa 1118519197 1 2024-02-22T00:33:23.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/31: fsync d3/fb 0 2024-02-22T00:33:23.798 INFO:tasks.workunit.client.0.smithi049.stdout:8/26: dread d1/d2/f3 [0,4194304] 0 2024-02-22T00:33:23.804 INFO:tasks.workunit.client.1.smithi161.stdout:5/644: truncate d3/d1b/d25/f6c 564232 0 2024-02-22T00:33:23.807 INFO:tasks.workunit.client.0.smithi049.stdout:7/26: dwrite d1/f7 [4194304,4194304] 0 2024-02-22T00:33:23.809 INFO:tasks.workunit.client.0.smithi049.stdout:7/27: chown d1/f9 1655575366 1 2024-02-22T00:33:23.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/32: dwrite f2 [0,4194304] 0 2024-02-22T00:33:23.817 INFO:tasks.workunit.client.0.smithi049.stdout:8/27: symlink d1/lc 0 2024-02-22T00:33:23.818 INFO:tasks.workunit.client.0.smithi049.stdout:8/28: write f0 [14050,53145] 0 2024-02-22T00:33:23.820 INFO:tasks.workunit.client.1.smithi161.stdout:6/466: dwrite d3/d10/d1b/d5e/f7a [0,4194304] 0 2024-02-22T00:33:23.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/558: dwrite fb [0,4194304] 0 2024-02-22T00:33:23.823 INFO:tasks.workunit.client.0.smithi049.stdout:6/33: dread d3/f6 [0,4194304] 0 2024-02-22T00:33:23.826 INFO:tasks.workunit.client.1.smithi161.stdout:2/504: dwrite de/d11/f63 [4194304,4194304] 0 2024-02-22T00:33:23.826 INFO:tasks.workunit.client.0.smithi049.stdout:7/28: mknod d1/cc 0 2024-02-22T00:33:23.827 INFO:tasks.workunit.client.0.smithi049.stdout:4/25: truncate f2 871560 0 2024-02-22T00:33:23.830 INFO:tasks.workunit.client.0.smithi049.stdout:6/34: rmdir d3 39 2024-02-22T00:33:23.831 INFO:tasks.workunit.client.1.smithi161.stdout:3/482: truncate da/dc/d11/f28 2730884 0 2024-02-22T00:33:23.831 INFO:tasks.workunit.client.0.smithi049.stdout:7/29: dread d1/f7 [0,4194304] 0 2024-02-22T00:33:23.832 INFO:tasks.workunit.client.0.smithi049.stdout:7/30: truncate d1/f8 911717 0 2024-02-22T00:33:23.832 INFO:tasks.workunit.client.0.smithi049.stdout:7/31: chown d1 7 1 2024-02-22T00:33:23.834 INFO:tasks.workunit.client.0.smithi049.stdout:4/26: rmdir d3 39 2024-02-22T00:33:23.835 INFO:tasks.workunit.client.1.smithi161.stdout:2/505: readlink de/d11/l73 0 2024-02-22T00:33:23.836 INFO:tasks.workunit.client.0.smithi049.stdout:8/29: unlink d1/d2/d5/c9 0 2024-02-22T00:33:23.837 INFO:tasks.workunit.client.1.smithi161.stdout:8/543: dwrite d1/d1c/d20/d22/d3f/f82 [0,4194304] 0 2024-02-22T00:33:23.837 INFO:tasks.workunit.client.1.smithi161.stdout:3/483: readlink da/dc/d11/d40/d59/l67 0 2024-02-22T00:33:23.838 INFO:tasks.workunit.client.1.smithi161.stdout:7/472: dwrite d3/df/d33/f4b [0,4194304] 0 2024-02-22T00:33:23.841 INFO:tasks.workunit.client.1.smithi161.stdout:0/559: unlink fd 0 2024-02-22T00:33:23.842 INFO:tasks.workunit.client.0.smithi049.stdout:8/30: creat d1/d2/db/fd x:0 0 0 2024-02-22T00:33:23.845 INFO:tasks.workunit.client.1.smithi161.stdout:6/467: fsync d3/d10/f55 0 2024-02-22T00:33:23.847 INFO:tasks.workunit.client.0.smithi049.stdout:6/35: dwrite d3/fa [0,4194304] 0 2024-02-22T00:33:23.852 INFO:tasks.workunit.client.1.smithi161.stdout:7/473: creat d3/df/d33/d35/d55/d63/d7b/d8f/f9d x:0 0 0 2024-02-22T00:33:23.852 INFO:tasks.workunit.client.1.smithi161.stdout:8/544: rmdir d1/d1c/d20/d22/d28/d36/d70 39 2024-02-22T00:33:23.852 INFO:tasks.workunit.client.1.smithi161.stdout:7/474: stat d3/dd/c11 0 2024-02-22T00:33:23.852 INFO:tasks.workunit.client.1.smithi161.stdout:3/484: truncate da/d29/d8e/d37/d39/f42 1899112 0 2024-02-22T00:33:23.853 INFO:tasks.workunit.client.1.smithi161.stdout:7/475: chown d3/f9 2554489 1 2024-02-22T00:33:23.853 INFO:tasks.workunit.client.0.smithi049.stdout:6/36: rename d3/c7 to d3/cc 0 2024-02-22T00:33:23.853 INFO:tasks.workunit.client.0.smithi049.stdout:4/27: link d3/l4 d3/l7 0 2024-02-22T00:33:23.854 INFO:tasks.workunit.client.1.smithi161.stdout:7/476: stat d3/dd/l23 0 2024-02-22T00:33:23.854 INFO:tasks.workunit.client.1.smithi161.stdout:6/468: rmdir d3/d10/d12/d2f 39 2024-02-22T00:33:23.854 INFO:tasks.workunit.client.1.smithi161.stdout:7/477: chown d3/dd/d60 2079 1 2024-02-22T00:33:23.855 INFO:tasks.workunit.client.1.smithi161.stdout:6/469: stat d3/dc/c57 0 2024-02-22T00:33:23.855 INFO:tasks.workunit.client.0.smithi049.stdout:8/31: fsync f0 0 2024-02-22T00:33:23.856 INFO:tasks.workunit.client.1.smithi161.stdout:6/470: stat d3/cb 0 2024-02-22T00:33:23.857 INFO:tasks.workunit.client.1.smithi161.stdout:0/560: symlink d14/d37/d42/da2/lb7 0 2024-02-22T00:33:23.858 INFO:tasks.workunit.client.1.smithi161.stdout:8/545: symlink d1/d1c/d20/d22/d28/d7f/laf 0 2024-02-22T00:33:23.860 INFO:tasks.workunit.client.1.smithi161.stdout:0/561: mknod d14/d1a/cb8 0 2024-02-22T00:33:23.861 INFO:tasks.workunit.client.1.smithi161.stdout:0/562: chown d14/d1a/d9d 63 1 2024-02-22T00:33:23.861 INFO:tasks.workunit.client.1.smithi161.stdout:2/506: getdents de/d2b/d8b 0 2024-02-22T00:33:23.862 INFO:tasks.workunit.client.0.smithi049.stdout:8/32: creat d1/fe x:0 0 0 2024-02-22T00:33:23.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/28: dread f2 [0,4194304] 0 2024-02-22T00:33:23.862 INFO:tasks.workunit.client.1.smithi161.stdout:8/546: fsync d1/d1c/d20/d22/d3f/f51 0 2024-02-22T00:33:23.862 INFO:tasks.workunit.client.1.smithi161.stdout:0/563: readlink d14/d37/l62 0 2024-02-22T00:33:23.864 INFO:tasks.workunit.client.1.smithi161.stdout:7/478: truncate d3/dd/d59/d5b/f51 2432985 0 2024-02-22T00:33:23.864 INFO:tasks.workunit.client.0.smithi049.stdout:6/37: dwrite d3/fa [0,4194304] 0 2024-02-22T00:33:23.866 INFO:tasks.workunit.client.0.smithi049.stdout:8/33: mkdir d1/d2/df 0 2024-02-22T00:33:23.867 INFO:tasks.workunit.client.0.smithi049.stdout:8/34: readlink d1/d2/d5/l7 0 2024-02-22T00:33:23.868 INFO:tasks.workunit.client.0.smithi049.stdout:8/35: fsync f0 0 2024-02-22T00:33:23.868 INFO:tasks.workunit.client.0.smithi049.stdout:4/29: dread f1 [0,4194304] 0 2024-02-22T00:33:23.871 INFO:tasks.workunit.client.0.smithi049.stdout:7/32: truncate d1/f7 3777385 0 2024-02-22T00:33:23.872 INFO:tasks.workunit.client.0.smithi049.stdout:8/36: rmdir d1/d2/d5 39 2024-02-22T00:33:23.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/30: mkdir d3/d8 0 2024-02-22T00:33:23.874 INFO:tasks.workunit.client.1.smithi161.stdout:8/547: getdents d1/d1c/d20/d22/d28/d7f/d92/d93 0 2024-02-22T00:33:23.875 INFO:tasks.workunit.client.0.smithi049.stdout:7/33: symlink d1/ld 0 2024-02-22T00:33:23.877 INFO:tasks.workunit.client.1.smithi161.stdout:7/479: creat d3/dd/f9e x:0 0 0 2024-02-22T00:33:23.879 INFO:tasks.workunit.client.0.smithi049.stdout:8/37: creat d1/d2/df/f10 x:0 0 0 2024-02-22T00:33:23.879 INFO:tasks.workunit.client.0.smithi049.stdout:8/38: chown d1/lc 50485 1 2024-02-22T00:33:23.880 INFO:tasks.workunit.client.1.smithi161.stdout:7/480: chown d3/df/l21 2 1 2024-02-22T00:33:23.883 INFO:tasks.workunit.client.0.smithi049.stdout:7/34: truncate d1/f7 4641247 0 2024-02-22T00:33:23.883 INFO:tasks.workunit.client.0.smithi049.stdout:8/39: symlink d1/d2/df/l11 0 2024-02-22T00:33:23.884 INFO:tasks.workunit.client.0.smithi049.stdout:6/38: write d3/f6 [101846,71490] 0 2024-02-22T00:33:23.884 INFO:tasks.workunit.client.1.smithi161.stdout:8/548: link d1/d2f/l53 d1/d1c/d96/lb0 0 2024-02-22T00:33:23.884 INFO:tasks.workunit.client.1.smithi161.stdout:5/645: write d3/d1b/d25/f6c [1177133,66368] 0 2024-02-22T00:33:23.885 INFO:tasks.workunit.client.0.smithi049.stdout:8/40: readlink d1/d2/l4 0 2024-02-22T00:33:23.885 INFO:tasks.workunit.client.0.smithi049.stdout:7/35: creat d1/fe x:0 0 0 2024-02-22T00:33:23.886 INFO:tasks.workunit.client.0.smithi049.stdout:8/41: fsync f0 0 2024-02-22T00:33:23.886 INFO:tasks.workunit.client.1.smithi161.stdout:0/564: truncate d14/d1a/f38 1294996 0 2024-02-22T00:33:23.887 INFO:tasks.workunit.client.0.smithi049.stdout:8/42: chown d1/d2/l4 8 1 2024-02-22T00:33:23.888 INFO:tasks.workunit.client.0.smithi049.stdout:6/39: creat d3/fd x:0 0 0 2024-02-22T00:33:23.888 INFO:tasks.workunit.client.0.smithi049.stdout:4/31: write f2 [1376255,115325] 0 2024-02-22T00:33:23.890 INFO:tasks.workunit.client.0.smithi049.stdout:7/36: unlink d1/f9 0 2024-02-22T00:33:23.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/37: write d1/fa [778494,70943] 0 2024-02-22T00:33:23.892 INFO:tasks.workunit.client.1.smithi161.stdout:5/646: creat d3/d1b/d25/d4c/dcb/fe1 x:0 0 0 2024-02-22T00:33:23.892 INFO:tasks.workunit.client.0.smithi049.stdout:7/38: write d1/f6 [406472,99788] 0 2024-02-22T00:33:23.893 INFO:tasks.workunit.client.0.smithi049.stdout:8/43: truncate d1/d2/f3 903483 0 2024-02-22T00:33:23.894 INFO:tasks.workunit.client.1.smithi161.stdout:0/565: mknod d14/d1a/d3f/d96/dad/cb9 0 2024-02-22T00:33:23.894 INFO:tasks.workunit.client.1.smithi161.stdout:2/507: dread de/d2b/d83/d4f/f56 [0,4194304] 0 2024-02-22T00:33:23.895 INFO:tasks.workunit.client.0.smithi049.stdout:4/32: symlink d3/d8/l9 0 2024-02-22T00:33:23.895 INFO:tasks.workunit.client.1.smithi161.stdout:7/481: dwrite d3/dd/d60/d64/f78 [0,4194304] 0 2024-02-22T00:33:23.895 INFO:tasks.workunit.client.1.smithi161.stdout:8/549: dread d1/d2f/d37/d64/f91 [0,4194304] 0 2024-02-22T00:33:23.896 INFO:tasks.workunit.client.0.smithi049.stdout:7/39: mkdir d1/df 0 2024-02-22T00:33:23.900 INFO:tasks.workunit.client.0.smithi049.stdout:8/44: rename f0 to d1/f12 0 2024-02-22T00:33:23.901 INFO:tasks.workunit.client.1.smithi161.stdout:8/550: mknod d1/d1c/d20/d22/d3f/cb1 0 2024-02-22T00:33:23.901 INFO:tasks.workunit.client.1.smithi161.stdout:2/508: creat de/d11/d14/faa x:0 0 0 2024-02-22T00:33:23.904 INFO:tasks.workunit.client.1.smithi161.stdout:5/647: symlink d3/d29/d80/le2 0 2024-02-22T00:33:23.907 INFO:tasks.workunit.client.0.smithi049.stdout:6/40: getdents d3 0 2024-02-22T00:33:23.908 INFO:tasks.workunit.client.1.smithi161.stdout:8/551: write d1/d2f/f5e [198073,34794] 0 2024-02-22T00:33:23.910 INFO:tasks.workunit.client.0.smithi049.stdout:8/45: rmdir d1/d2/d5 39 2024-02-22T00:33:23.911 INFO:tasks.workunit.client.1.smithi161.stdout:7/482: rename d3/df/d33/f40 to d3/df/d33/d35/d55/d63/d7b/d30/d44/f9f 0 2024-02-22T00:33:23.911 INFO:tasks.workunit.client.0.smithi049.stdout:6/41: mknod d3/ce 0 2024-02-22T00:33:23.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/42: fdatasync d3/f6 0 2024-02-22T00:33:23.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/46: chown d1/d2/db/fd 20642 1 2024-02-22T00:33:23.913 INFO:tasks.workunit.client.1.smithi161.stdout:7/483: chown d3/df/d33/d35/d55/d63/d7b/d50/l57 428022 1 2024-02-22T00:33:23.913 INFO:tasks.workunit.client.1.smithi161.stdout:2/509: mknod de/d2b/d8b/da2/da5/cab 0 2024-02-22T00:33:23.914 INFO:tasks.workunit.client.0.smithi049.stdout:4/33: truncate f1 4130613 0 2024-02-22T00:33:23.915 INFO:tasks.workunit.client.1.smithi161.stdout:8/552: creat d1/d2f/d30/fb2 x:0 0 0 2024-02-22T00:33:23.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/43: dread d3/f6 [0,4194304] 0 2024-02-22T00:33:23.916 INFO:tasks.workunit.client.0.smithi049.stdout:7/40: dread f0 [0,4194304] 0 2024-02-22T00:33:23.917 INFO:tasks.workunit.client.0.smithi049.stdout:8/47: rmdir d1 39 2024-02-22T00:33:23.917 INFO:tasks.workunit.client.0.smithi049.stdout:4/34: symlink d3/d8/la 0 2024-02-22T00:33:23.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/44: creat d3/ff x:0 0 0 2024-02-22T00:33:23.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/45: chown f2 1 1 2024-02-22T00:33:23.920 INFO:tasks.workunit.client.1.smithi161.stdout:8/553: dread d1/f29 [0,4194304] 0 2024-02-22T00:33:23.920 INFO:tasks.workunit.client.1.smithi161.stdout:2/510: unlink de/d11/l73 0 2024-02-22T00:33:23.922 INFO:tasks.workunit.client.1.smithi161.stdout:5/648: getdents d3/d1b/d36 0 2024-02-22T00:33:23.926 INFO:tasks.workunit.client.1.smithi161.stdout:0/566: dwrite d14/d37/d42/d73/fab [0,4194304] 0 2024-02-22T00:33:23.926 INFO:tasks.workunit.client.0.smithi049.stdout:6/46: dwrite d3/fa [0,4194304] 0 2024-02-22T00:33:23.927 INFO:tasks.workunit.client.0.smithi049.stdout:6/47: chown d3/ff 96 1 2024-02-22T00:33:23.928 INFO:tasks.workunit.client.1.smithi161.stdout:5/649: dread - d3/d1b/d25/db5/dca/fd6 zero size 2024-02-22T00:33:23.928 INFO:tasks.workunit.client.0.smithi049.stdout:6/48: dread - d3/fb zero size 2024-02-22T00:33:23.928 INFO:tasks.workunit.client.0.smithi049.stdout:7/41: mkdir d1/df/d10 0 2024-02-22T00:33:23.929 INFO:tasks.workunit.client.1.smithi161.stdout:2/511: rename fa to de/d11/d32/fac 0 2024-02-22T00:33:23.930 INFO:tasks.workunit.client.1.smithi161.stdout:7/484: dwrite d3/df/d43/f76 [0,4194304] 0 2024-02-22T00:33:23.930 INFO:tasks.workunit.client.0.smithi049.stdout:7/42: chown d1/f8 353749 1 2024-02-22T00:33:23.930 INFO:tasks.workunit.client.0.smithi049.stdout:4/35: stat f1 0 2024-02-22T00:33:23.931 INFO:tasks.workunit.client.0.smithi049.stdout:4/36: stat l0 0 2024-02-22T00:33:23.931 INFO:tasks.workunit.client.1.smithi161.stdout:2/512: fdatasync de/d11/d5c/f80 0 2024-02-22T00:33:23.932 INFO:tasks.workunit.client.0.smithi049.stdout:4/37: chown d3/d8 26 1 2024-02-22T00:33:23.933 INFO:tasks.workunit.client.0.smithi049.stdout:6/49: write f2 [2541267,88867] 0 2024-02-22T00:33:23.934 INFO:tasks.workunit.client.0.smithi049.stdout:8/48: symlink d1/d2/d5/l13 0 2024-02-22T00:33:23.938 INFO:tasks.workunit.client.0.smithi049.stdout:7/43: creat d1/df/d10/f11 x:0 0 0 2024-02-22T00:33:23.940 INFO:tasks.workunit.client.1.smithi161.stdout:2/513: unlink de/d2b/d65/d3a/fa0 0 2024-02-22T00:33:23.941 INFO:tasks.workunit.client.1.smithi161.stdout:2/514: fsync de/d2b/d65/f31 0 2024-02-22T00:33:23.941 INFO:tasks.workunit.client.1.smithi161.stdout:0/567: mkdir d14/d1a/d9d/dba 0 2024-02-22T00:33:23.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/50: unlink l1 0 2024-02-22T00:33:23.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/38: dwrite f2 [0,4194304] 0 2024-02-22T00:33:23.943 INFO:tasks.workunit.client.1.smithi161.stdout:5/650: dread d3/d1b/f68 [0,4194304] 0 2024-02-22T00:33:23.943 INFO:tasks.workunit.client.0.smithi049.stdout:6/51: fdatasync d3/fb 0 2024-02-22T00:33:23.944 INFO:tasks.workunit.client.1.smithi161.stdout:5/651: write d3/dac/fa4 [428865,34808] 0 2024-02-22T00:33:23.945 INFO:tasks.workunit.client.0.smithi049.stdout:6/52: truncate d3/f5 11134 0 2024-02-22T00:33:23.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/53: readlink d3/l9 0 2024-02-22T00:33:23.948 INFO:tasks.workunit.client.0.smithi049.stdout:8/49: rename d1/d2/d5/l7 to d1/d2/d5/l14 0 2024-02-22T00:33:23.949 INFO:tasks.workunit.client.0.smithi049.stdout:7/44: dread d1/f7 [0,4194304] 0 2024-02-22T00:33:23.950 INFO:tasks.workunit.client.1.smithi161.stdout:0/568: rename d14/c49 to d14/d1a/d9d/dba/cbb 0 2024-02-22T00:33:23.950 INFO:tasks.workunit.client.1.smithi161.stdout:2/515: dwrite de/d2b/d65/d60/d68/f6c [0,4194304] 0 2024-02-22T00:33:23.952 INFO:tasks.workunit.client.1.smithi161.stdout:0/569: read d14/d1a/d3f/f5b [1220760,113955] 0 2024-02-22T00:33:23.959 INFO:tasks.workunit.client.1.smithi161.stdout:5/652: mknod d3/d1b/d25/d4c/dd2/ddd/ce3 0 2024-02-22T00:33:23.962 INFO:tasks.workunit.client.1.smithi161.stdout:7/485: dread d3/dd/d59/d5b/f4e [0,4194304] 0 2024-02-22T00:33:23.964 INFO:tasks.workunit.client.1.smithi161.stdout:2/516: dwrite de/d2b/d65/d3a/f7c [4194304,4194304] 0 2024-02-22T00:33:23.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/54: dwrite d3/f5 [0,4194304] 0 2024-02-22T00:33:23.965 INFO:tasks.workunit.client.0.smithi049.stdout:8/50: dwrite d1/f12 [0,4194304] 0 2024-02-22T00:33:23.967 INFO:tasks.workunit.client.1.smithi161.stdout:7/486: fsync d3/df/d33/d35/d55/d63/d7b/d30/d44/f90 0 2024-02-22T00:33:23.969 INFO:tasks.workunit.client.1.smithi161.stdout:1/519: sync 2024-02-22T00:33:23.970 INFO:tasks.workunit.client.1.smithi161.stdout:7/487: fsync d3/f14 0 2024-02-22T00:33:23.972 INFO:tasks.workunit.client.1.smithi161.stdout:1/520: write d19/d1d/f36 [1816195,110641] 0 2024-02-22T00:33:23.972 INFO:tasks.workunit.client.1.smithi161.stdout:7/488: stat d3/lb 0 2024-02-22T00:33:23.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/51: rename d1/d2/df to d1/d2/db/d15 0 2024-02-22T00:33:23.973 INFO:tasks.workunit.client.1.smithi161.stdout:7/489: chown d3/df/d33/d35/d55/c54 0 1 2024-02-22T00:33:23.976 INFO:tasks.workunit.client.0.smithi049.stdout:6/55: dread d3/f6 [0,4194304] 0 2024-02-22T00:33:23.976 INFO:tasks.workunit.client.1.smithi161.stdout:2/517: creat de/d11/fad x:0 0 0 2024-02-22T00:33:23.977 INFO:tasks.workunit.client.1.smithi161.stdout:1/521: symlink d19/d1d/d2c/d7d/da2/lba 0 2024-02-22T00:33:23.978 INFO:tasks.workunit.client.0.smithi049.stdout:8/52: creat d1/d2/db/f16 x:0 0 0 2024-02-22T00:33:23.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/45: dwrite d1/f4 [0,4194304] 0 2024-02-22T00:33:23.982 INFO:tasks.workunit.client.0.smithi049.stdout:7/46: dread d1/f7 [4194304,4194304] 0 2024-02-22T00:33:23.983 INFO:tasks.workunit.client.0.smithi049.stdout:7/47: write d1/fe [131179,122173] 0 2024-02-22T00:33:23.983 INFO:tasks.workunit.client.0.smithi049.stdout:6/56: link d3/fb d3/f10 0 2024-02-22T00:33:23.984 INFO:tasks.workunit.client.1.smithi161.stdout:1/522: mknod d19/d1d/d2c/d7d/cbb 0 2024-02-22T00:33:23.984 INFO:tasks.workunit.client.1.smithi161.stdout:2/518: creat de/d11/fae x:0 0 0 2024-02-22T00:33:23.984 INFO:tasks.workunit.client.1.smithi161.stdout:7/490: dwrite d3/df/d33/d35/d55/d63/d7b/d50/f61 [0,4194304] 0 2024-02-22T00:33:23.986 INFO:tasks.workunit.client.1.smithi161.stdout:7/491: chown d3/dd/d59/d5b/f4e 1906961 1 2024-02-22T00:33:23.987 INFO:tasks.workunit.client.0.smithi049.stdout:8/53: mknod d1/d2/d5/c17 0 2024-02-22T00:33:23.993 INFO:tasks.workunit.client.1.smithi161.stdout:7/492: stat d3/df/d43/l8b 0 2024-02-22T00:33:23.993 INFO:tasks.workunit.client.0.smithi049.stdout:7/48: rename d1/df/d10 to d1/df/d12 0 2024-02-22T00:33:23.994 INFO:tasks.workunit.client.1.smithi161.stdout:0/570: dread d14/f2c [0,4194304] 0 2024-02-22T00:33:23.996 INFO:tasks.workunit.client.0.smithi049.stdout:6/57: link f2 d3/f11 0 2024-02-22T00:33:23.996 INFO:tasks.workunit.client.1.smithi161.stdout:7/493: rmdir d3/df/d33/d74 39 2024-02-22T00:33:23.997 INFO:tasks.workunit.client.0.smithi049.stdout:6/58: fdatasync d3/f6 0 2024-02-22T00:33:23.999 INFO:tasks.workunit.client.1.smithi161.stdout:0/571: mkdir d14/d1a/d3f/d96/dbc 0 2024-02-22T00:33:23.999 INFO:tasks.workunit.client.1.smithi161.stdout:7/494: write d3/df/d33/d35/d55/d63/d7b/d50/f81 [910273,35227] 0 2024-02-22T00:33:24.000 INFO:tasks.workunit.client.0.smithi049.stdout:8/54: link d1/fe d1/d2/d5/f18 0 2024-02-22T00:33:24.001 INFO:tasks.workunit.client.0.smithi049.stdout:7/49: dread d1/f6 [0,4194304] 0 2024-02-22T00:33:24.001 INFO:tasks.workunit.client.1.smithi161.stdout:5/653: dread d3/f72 [0,4194304] 0 2024-02-22T00:33:24.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/523: write d19/d1d/f22 [936578,123210] 0 2024-02-22T00:33:24.003 INFO:tasks.workunit.client.1.smithi161.stdout:7/495: rmdir d3/d77 39 2024-02-22T00:33:24.005 INFO:tasks.workunit.client.0.smithi049.stdout:7/50: write d1/f6 [891553,39886] 0 2024-02-22T00:33:24.006 INFO:tasks.workunit.client.0.smithi049.stdout:7/51: chown d1/df 37843063 1 2024-02-22T00:33:24.007 INFO:tasks.workunit.client.0.smithi049.stdout:8/55: rename d1/d2/db/fd to d1/d2/db/f19 0 2024-02-22T00:33:24.007 INFO:tasks.workunit.client.1.smithi161.stdout:5/654: mknod d3/d1c/da7/ce4 0 2024-02-22T00:33:24.008 INFO:tasks.workunit.client.0.smithi049.stdout:8/56: dread - d1/fe zero size 2024-02-22T00:33:24.009 INFO:tasks.workunit.client.1.smithi161.stdout:7/496: write d3/f1b [664281,108768] 0 2024-02-22T00:33:24.009 INFO:tasks.workunit.client.0.smithi049.stdout:6/59: dwrite d3/ff [0,4194304] 0 2024-02-22T00:33:24.011 INFO:tasks.workunit.client.0.smithi049.stdout:6/60: readlink d3/l9 0 2024-02-22T00:33:24.011 INFO:tasks.workunit.client.0.smithi049.stdout:8/57: readlink d1/d2/d5/l13 0 2024-02-22T00:33:24.015 INFO:tasks.workunit.client.1.smithi161.stdout:0/572: rename d14/d9b/c9f to d14/d1a/d3f/d96/dad/cbd 0 2024-02-22T00:33:24.015 INFO:tasks.workunit.client.0.smithi049.stdout:6/61: creat d3/f12 x:0 0 0 2024-02-22T00:33:24.015 INFO:tasks.workunit.client.1.smithi161.stdout:5/655: creat d3/d1b/d25/d4c/dd2/fe5 x:0 0 0 2024-02-22T00:33:24.016 INFO:tasks.workunit.client.0.smithi049.stdout:8/58: symlink d1/d2/db/l1a 0 2024-02-22T00:33:24.018 INFO:tasks.workunit.client.0.smithi049.stdout:6/62: unlink f2 0 2024-02-22T00:33:24.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/52: dwrite d1/f7 [0,4194304] 0 2024-02-22T00:33:24.020 INFO:tasks.workunit.client.1.smithi161.stdout:1/524: dwrite f7 [0,4194304] 0 2024-02-22T00:33:24.020 INFO:tasks.workunit.client.0.smithi049.stdout:8/59: mkdir d1/d2/d5/d1b 0 2024-02-22T00:33:24.021 INFO:tasks.workunit.client.0.smithi049.stdout:7/53: chown d1/df/d12/f11 5 1 2024-02-22T00:33:24.021 INFO:tasks.workunit.client.0.smithi049.stdout:8/60: fsync d1/f12 0 2024-02-22T00:33:24.023 INFO:tasks.workunit.client.0.smithi049.stdout:6/63: dread d3/fa [0,4194304] 0 2024-02-22T00:33:24.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/54: creat d1/df/f13 x:0 0 0 2024-02-22T00:33:24.026 INFO:tasks.workunit.client.0.smithi049.stdout:8/61: mkdir d1/d2/db/d1c 0 2024-02-22T00:33:24.028 INFO:tasks.workunit.client.1.smithi161.stdout:0/573: mkdir d14/d44/dbe 0 2024-02-22T00:33:24.028 INFO:tasks.workunit.client.1.smithi161.stdout:2/519: dread de/d2b/d65/d3a/d72/d8f/f47 [0,4194304] 0 2024-02-22T00:33:24.028 INFO:tasks.workunit.client.1.smithi161.stdout:5/656: rmdir d3/dac/d8b 39 2024-02-22T00:33:24.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/64: unlink d3/fd 0 2024-02-22T00:33:24.029 INFO:tasks.workunit.client.0.smithi049.stdout:6/65: chown d3/f6 39090 1 2024-02-22T00:33:24.029 INFO:tasks.workunit.client.1.smithi161.stdout:2/520: write de/d2b/d83/f87 [7761294,98062] 0 2024-02-22T00:33:24.030 INFO:tasks.workunit.client.0.smithi049.stdout:7/55: symlink d1/df/l14 0 2024-02-22T00:33:24.033 INFO:tasks.workunit.client.0.smithi049.stdout:6/66: chown d3/f11 57 1 2024-02-22T00:33:24.035 INFO:tasks.workunit.client.0.smithi049.stdout:8/62: dread d1/d2/f3 [0,4194304] 0 2024-02-22T00:33:24.039 INFO:tasks.workunit.client.0.smithi049.stdout:6/67: dread d3/f8 [0,4194304] 0 2024-02-22T00:33:24.039 INFO:tasks.workunit.client.0.smithi049.stdout:8/63: write d1/fe [723457,104438] 0 2024-02-22T00:33:24.039 INFO:tasks.workunit.client.1.smithi161.stdout:2/521: mkdir de/d2b/d8b/da2/da5/daf 0 2024-02-22T00:33:24.040 INFO:tasks.workunit.client.1.smithi161.stdout:5/657: write d3/d1c/d20/f12 [4308081,29370] 0 2024-02-22T00:33:24.040 INFO:tasks.workunit.client.1.smithi161.stdout:5/658: truncate d3/f95 124833 0 2024-02-22T00:33:24.040 INFO:tasks.workunit.client.1.smithi161.stdout:2/522: write de/d2b/d65/d3a/f88 [3347106,122811] 0 2024-02-22T00:33:24.042 INFO:tasks.workunit.client.0.smithi049.stdout:8/64: truncate d1/d2/db/f19 838661 0 2024-02-22T00:33:24.042 INFO:tasks.workunit.client.0.smithi049.stdout:6/68: creat d3/f13 x:0 0 0 2024-02-22T00:33:24.043 INFO:tasks.workunit.client.1.smithi161.stdout:5/659: creat d3/d1b/d25/fe6 x:0 0 0 2024-02-22T00:33:24.044 INFO:tasks.workunit.client.1.smithi161.stdout:2/523: mknod de/cb0 0 2024-02-22T00:33:24.044 INFO:tasks.workunit.client.0.smithi049.stdout:8/65: mknod d1/d2/d5/c1d 0 2024-02-22T00:33:24.045 INFO:tasks.workunit.client.1.smithi161.stdout:2/524: chown de/d2b/d65/d3a/d71 91815 1 2024-02-22T00:33:24.045 INFO:tasks.workunit.client.1.smithi161.stdout:5/660: creat d3/d1c/fe7 x:0 0 0 2024-02-22T00:33:24.046 INFO:tasks.workunit.client.0.smithi049.stdout:6/69: creat d3/f14 x:0 0 0 2024-02-22T00:33:24.047 INFO:tasks.workunit.client.0.smithi049.stdout:8/66: creat d1/f1e x:0 0 0 2024-02-22T00:33:24.048 INFO:tasks.workunit.client.0.smithi049.stdout:8/67: write d1/f1e [806994,64909] 0 2024-02-22T00:33:24.049 INFO:tasks.workunit.client.1.smithi161.stdout:2/525: creat de/d2b/d65/d3a/d72/da7/fb1 x:0 0 0 2024-02-22T00:33:24.050 INFO:tasks.workunit.client.0.smithi049.stdout:8/68: chown d1/d2/db/l1a 15 1 2024-02-22T00:33:24.050 INFO:tasks.workunit.client.1.smithi161.stdout:7/497: dread d3/df/d33/d35/d55/d63/d7b/f3e [0,4194304] 0 2024-02-22T00:33:24.052 INFO:tasks.workunit.client.1.smithi161.stdout:2/526: mknod de/d2b/d83/cb2 0 2024-02-22T00:33:24.053 INFO:tasks.workunit.client.1.smithi161.stdout:7/498: mknod d3/dd/d60/d64/ca0 0 2024-02-22T00:33:24.053 INFO:tasks.workunit.client.1.smithi161.stdout:2/527: fdatasync de/d11/f8a 0 2024-02-22T00:33:24.055 INFO:tasks.workunit.client.1.smithi161.stdout:2/528: readlink de/d11/d32/l3c 0 2024-02-22T00:33:24.056 INFO:tasks.workunit.client.1.smithi161.stdout:5/661: dwrite d3/dac/fa4 [0,4194304] 0 2024-02-22T00:33:24.056 INFO:tasks.workunit.client.0.smithi049.stdout:7/56: getdents d1/df 0 2024-02-22T00:33:24.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/57: readlink d1/ld 0 2024-02-22T00:33:24.057 INFO:tasks.workunit.client.1.smithi161.stdout:2/529: write de/f1c [1841674,28800] 0 2024-02-22T00:33:24.057 INFO:tasks.workunit.client.1.smithi161.stdout:5/662: chown d3/f24 507 1 2024-02-22T00:33:24.058 INFO:tasks.workunit.client.0.smithi049.stdout:7/58: write d1/df/d12/f11 [415486,105915] 0 2024-02-22T00:33:24.059 INFO:tasks.workunit.client.1.smithi161.stdout:2/530: read - de/d11/d5c/fa6 zero size 2024-02-22T00:33:24.059 INFO:tasks.workunit.client.1.smithi161.stdout:7/499: rmdir d3/df/d33/d35/d55/d63/d7b/d8f 39 2024-02-22T00:33:24.060 INFO:tasks.workunit.client.1.smithi161.stdout:1/525: write f1 [325329,60723] 0 2024-02-22T00:33:24.063 INFO:tasks.workunit.client.1.smithi161.stdout:0/574: truncate d14/f56 7888585 0 2024-02-22T00:33:24.064 INFO:tasks.workunit.client.1.smithi161.stdout:2/531: symlink de/d2b/d8b/lb3 0 2024-02-22T00:33:24.065 INFO:tasks.workunit.client.0.smithi049.stdout:7/59: rmdir d1 39 2024-02-22T00:33:24.066 INFO:tasks.workunit.client.1.smithi161.stdout:7/500: mknod d3/df/d33/d35/d55/d63/d7b/d50/ca1 0 2024-02-22T00:33:24.066 INFO:tasks.workunit.client.1.smithi161.stdout:2/532: chown de/d2b/d83/d4f/c52 516 1 2024-02-22T00:33:24.068 INFO:tasks.workunit.client.1.smithi161.stdout:7/501: chown d3/df/d33/d35/d55/c54 1093 1 2024-02-22T00:33:24.068 INFO:tasks.workunit.client.1.smithi161.stdout:2/533: fdatasync de/d2b/d65/d60/d68/f7a 0 2024-02-22T00:33:24.069 INFO:tasks.workunit.client.0.smithi049.stdout:7/60: mknod d1/df/c15 0 2024-02-22T00:33:24.069 INFO:tasks.workunit.client.1.smithi161.stdout:2/534: chown de/d2b/f46 1244669532 1 2024-02-22T00:33:24.070 INFO:tasks.workunit.client.0.smithi049.stdout:7/61: chown d1/fe 105126304 1 2024-02-22T00:33:24.071 INFO:tasks.workunit.client.1.smithi161.stdout:0/575: getdents d14/d1a 0 2024-02-22T00:33:24.073 INFO:tasks.workunit.client.0.smithi049.stdout:7/62: rename d1/f4 to d1/df/f16 0 2024-02-22T00:33:24.077 INFO:tasks.workunit.client.0.smithi049.stdout:7/63: creat d1/f17 x:0 0 0 2024-02-22T00:33:24.078 INFO:tasks.workunit.client.1.smithi161.stdout:2/535: dread de/d2b/d83/f70 [0,4194304] 0 2024-02-22T00:33:24.080 INFO:tasks.workunit.client.1.smithi161.stdout:0/576: write f3 [12743,22596] 0 2024-02-22T00:33:24.080 INFO:tasks.workunit.client.1.smithi161.stdout:7/502: dread d3/dd/d59/d5b/f28 [0,4194304] 0 2024-02-22T00:33:24.081 INFO:tasks.workunit.client.0.smithi049.stdout:7/64: unlink d1/f7 0 2024-02-22T00:33:24.081 INFO:tasks.workunit.client.0.smithi049.stdout:7/65: read - d1/df/f13 zero size 2024-02-22T00:33:24.081 INFO:tasks.workunit.client.0.smithi049.stdout:7/66: fdatasync d1/df/f13 0 2024-02-22T00:33:24.083 INFO:tasks.workunit.client.1.smithi161.stdout:0/577: mkdir d14/d44/dbf 0 2024-02-22T00:33:24.083 INFO:tasks.workunit.client.1.smithi161.stdout:5/663: dwrite d3/d1b/d25/d4c/f87 [0,4194304] 0 2024-02-22T00:33:24.084 INFO:tasks.workunit.client.1.smithi161.stdout:7/503: read d3/dd/d59/d5b/f4e [568969,69817] 0 2024-02-22T00:33:24.085 INFO:tasks.workunit.client.0.smithi049.stdout:7/67: link d1/f17 d1/df/f18 0 2024-02-22T00:33:24.088 INFO:tasks.workunit.client.1.smithi161.stdout:0/578: dread - d14/d37/d42/d73/f99 zero size 2024-02-22T00:33:24.090 INFO:tasks.workunit.client.1.smithi161.stdout:5/664: fsync d3/d1c/f7d 0 2024-02-22T00:33:24.091 INFO:tasks.workunit.client.1.smithi161.stdout:1/526: dread d19/d1d/d2c/f4d [0,4194304] 0 2024-02-22T00:33:24.093 INFO:tasks.workunit.client.1.smithi161.stdout:1/527: write f10 [4780357,65483] 0 2024-02-22T00:33:24.098 INFO:tasks.workunit.client.1.smithi161.stdout:7/504: dwrite d3/dd/d60/d64/f78 [0,4194304] 0 2024-02-22T00:33:24.098 INFO:tasks.workunit.client.0.smithi049.stdout:7/68: rename d1/cb to d1/df/d12/c19 0 2024-02-22T00:33:24.100 INFO:tasks.workunit.client.1.smithi161.stdout:7/505: write d3/f7 [4020004,58633] 0 2024-02-22T00:33:24.102 INFO:tasks.workunit.client.1.smithi161.stdout:1/528: read d19/f37 [3349573,120653] 0 2024-02-22T00:33:24.104 INFO:tasks.workunit.client.1.smithi161.stdout:2/536: dwrite de/d11/fae [0,4194304] 0 2024-02-22T00:33:24.106 INFO:tasks.workunit.client.1.smithi161.stdout:0/579: write fb [5158587,99604] 0 2024-02-22T00:33:24.108 INFO:tasks.workunit.client.1.smithi161.stdout:5/665: dwrite d3/d29/f45 [0,4194304] 0 2024-02-22T00:33:24.117 INFO:tasks.workunit.client.1.smithi161.stdout:1/529: mkdir d19/d51/d64/d9b/da5/dbc 0 2024-02-22T00:33:24.120 INFO:tasks.workunit.client.1.smithi161.stdout:5/666: rename d3/d9c/fc4 to d3/d1b/d25/fe8 0 2024-02-22T00:33:24.122 INFO:tasks.workunit.client.1.smithi161.stdout:1/530: readlink d19/d1d/d2c/d2d/d3f/l7e 0 2024-02-22T00:33:24.123 INFO:tasks.workunit.client.1.smithi161.stdout:1/531: dread - d19/d48/fb0 zero size 2024-02-22T00:33:24.124 INFO:tasks.workunit.client.1.smithi161.stdout:7/506: dwrite d3/df/d43/f65 [0,4194304] 0 2024-02-22T00:33:24.126 INFO:tasks.workunit.client.1.smithi161.stdout:5/667: unlink d3/d1b/d36/f5e 0 2024-02-22T00:33:24.128 INFO:tasks.workunit.client.1.smithi161.stdout:4/518: sync 2024-02-22T00:33:24.128 INFO:tasks.workunit.client.1.smithi161.stdout:9/514: sync 2024-02-22T00:33:24.129 INFO:tasks.workunit.client.1.smithi161.stdout:7/507: unlink d3/df/d33/d35/d55/d63/d7b/d50/c5c 0 2024-02-22T00:33:24.130 INFO:tasks.workunit.client.1.smithi161.stdout:4/519: stat d5/d17/d5c/f7b 0 2024-02-22T00:33:24.131 INFO:tasks.workunit.client.1.smithi161.stdout:7/508: chown d3/df/d43/c86 14846 1 2024-02-22T00:33:24.132 INFO:tasks.workunit.client.1.smithi161.stdout:9/515: unlink d1/d25/c2f 0 2024-02-22T00:33:24.132 INFO:tasks.workunit.client.1.smithi161.stdout:4/520: write d5/d10/d14/f5d [124940,74033] 0 2024-02-22T00:33:24.135 INFO:tasks.workunit.client.1.smithi161.stdout:9/516: write d1/d2/f2e [2456340,28194] 0 2024-02-22T00:33:24.137 INFO:tasks.workunit.client.1.smithi161.stdout:2/537: truncate de/d11/d32/f76 416853 0 2024-02-22T00:33:24.138 INFO:tasks.workunit.client.1.smithi161.stdout:9/517: fsync d1/d5/d9/d33/f32 0 2024-02-22T00:33:24.142 INFO:tasks.workunit.client.1.smithi161.stdout:4/521: rename d5/d8/d41/d53/d6c/d72/cc4 to d5/d17/cc6 0 2024-02-22T00:33:24.143 INFO:tasks.workunit.client.1.smithi161.stdout:7/509: dwrite d3/dd/f1d [0,4194304] 0 2024-02-22T00:33:24.143 INFO:tasks.workunit.client.1.smithi161.stdout:2/538: symlink de/d2b/d83/d4f/lb4 0 2024-02-22T00:33:24.147 INFO:tasks.workunit.client.1.smithi161.stdout:9/518: symlink d1/lb1 0 2024-02-22T00:33:24.148 INFO:tasks.workunit.client.1.smithi161.stdout:2/539: stat de/d11/d32/c9e 0 2024-02-22T00:33:24.159 INFO:tasks.workunit.client.1.smithi161.stdout:1/532: dread d19/f5f [0,4194304] 0 2024-02-22T00:33:24.159 INFO:tasks.workunit.client.1.smithi161.stdout:5/668: dwrite d3/d1c/d20/f35 [0,4194304] 0 2024-02-22T00:33:24.159 INFO:tasks.workunit.client.1.smithi161.stdout:1/533: chown d19/d51/da1/la3 58547041 1 2024-02-22T00:33:24.159 INFO:tasks.workunit.client.1.smithi161.stdout:5/669: write d3/d1c/d20/f5b [2383857,84985] 0 2024-02-22T00:33:24.159 INFO:tasks.workunit.client.1.smithi161.stdout:1/534: fsync d19/f9d 0 2024-02-22T00:33:24.162 INFO:tasks.workunit.client.1.smithi161.stdout:0/580: dread d14/d37/d42/d8e/f98 [0,4194304] 0 2024-02-22T00:33:24.162 INFO:tasks.workunit.client.1.smithi161.stdout:9/519: symlink d1/d25/d73/d60/db0/lb2 0 2024-02-22T00:33:24.167 INFO:tasks.workunit.client.1.smithi161.stdout:1/535: write d19/d51/d64/f6b [3432281,79645] 0 2024-02-22T00:33:24.167 INFO:tasks.workunit.client.1.smithi161.stdout:5/670: write d3/d1c/da7/dae/fc3 [365895,93191] 0 2024-02-22T00:33:24.170 INFO:tasks.workunit.client.1.smithi161.stdout:5/671: mknod d3/d29/d80/ce9 0 2024-02-22T00:33:24.170 INFO:tasks.workunit.client.1.smithi161.stdout:2/540: getdents de/d11/d5c 0 2024-02-22T00:33:24.172 INFO:tasks.workunit.client.1.smithi161.stdout:5/672: read - d3/d1c/da7/fc5 zero size 2024-02-22T00:33:24.172 INFO:tasks.workunit.client.1.smithi161.stdout:4/522: link d5/d8/d41/d57/dbe/d28/d63/d65/f94 d5/d8/d41/d57/dbe/d28/d63/d65/fc7 0 2024-02-22T00:33:24.173 INFO:tasks.workunit.client.1.smithi161.stdout:7/510: dread d3/df/d33/d35/f27 [4194304,4194304] 0 2024-02-22T00:33:24.174 INFO:tasks.workunit.client.1.smithi161.stdout:0/581: rename d14/d37/d42/d8e/ca3 to d14/d1a/d3f/d96/da1/cc0 0 2024-02-22T00:33:24.174 INFO:tasks.workunit.client.1.smithi161.stdout:2/541: read de/d2b/d65/d3a/d72/d8f/f6b [338461,52844] 0 2024-02-22T00:33:24.175 INFO:tasks.workunit.client.1.smithi161.stdout:9/520: stat d1/d5/d9/d33/d4f/f84 0 2024-02-22T00:33:24.175 INFO:tasks.workunit.client.1.smithi161.stdout:2/542: stat de 0 2024-02-22T00:33:24.176 INFO:tasks.workunit.client.1.smithi161.stdout:1/536: rmdir d19/db6 0 2024-02-22T00:33:24.178 INFO:tasks.workunit.client.1.smithi161.stdout:0/582: chown d14/d29/l32 1 1 2024-02-22T00:33:24.179 INFO:tasks.workunit.client.1.smithi161.stdout:7/511: creat d3/df/d43/fa2 x:0 0 0 2024-02-22T00:33:24.181 INFO:tasks.workunit.client.1.smithi161.stdout:9/521: creat d1/d25/d73/d60/fb3 x:0 0 0 2024-02-22T00:33:24.183 INFO:tasks.workunit.client.1.smithi161.stdout:1/537: creat d19/d1d/d2c/d2d/d3f/fbd x:0 0 0 2024-02-22T00:33:24.184 INFO:tasks.workunit.client.1.smithi161.stdout:0/583: mknod d14/d44/cc1 0 2024-02-22T00:33:24.185 INFO:tasks.workunit.client.1.smithi161.stdout:2/543: dwrite de/d11/d5c/fa6 [0,4194304] 0 2024-02-22T00:33:24.186 INFO:tasks.workunit.client.1.smithi161.stdout:0/584: chown d14/d1a/c88 2361 1 2024-02-22T00:33:24.188 INFO:tasks.workunit.client.1.smithi161.stdout:7/512: rename d3/l2f to d3/df/d33/d35/la3 0 2024-02-22T00:33:24.192 INFO:tasks.workunit.client.1.smithi161.stdout:2/544: write de/d11/f1a [3243905,35299] 0 2024-02-22T00:33:24.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/673: getdents d3/d1c/d20 0 2024-02-22T00:33:24.193 INFO:tasks.workunit.client.1.smithi161.stdout:1/538: truncate d19/d1d/d2c/d2d/d3f/f67 961718 0 2024-02-22T00:33:24.195 INFO:tasks.workunit.client.1.smithi161.stdout:1/539: truncate d19/d48/faf 917591 0 2024-02-22T00:33:24.197 INFO:tasks.workunit.client.1.smithi161.stdout:9/522: rename d1/d5/d9/d33 to d1/d25/d73/d98/db4 0 2024-02-22T00:33:24.199 INFO:tasks.workunit.client.1.smithi161.stdout:2/545: symlink de/d2b/d65/d3a/d72/lb5 0 2024-02-22T00:33:24.200 INFO:tasks.workunit.client.1.smithi161.stdout:5/674: dwrite d3/dac/fa4 [0,4194304] 0 2024-02-22T00:33:24.201 INFO:tasks.workunit.client.1.smithi161.stdout:0/585: getdents d14/d1a/d3f/d96/da1 0 2024-02-22T00:33:24.203 INFO:tasks.workunit.client.1.smithi161.stdout:7/513: rename d3/df/d33/d35/d55/d63/d7b/d30/d44/f6e to d3/df/d33/d35/fa4 0 2024-02-22T00:33:24.204 INFO:tasks.workunit.client.1.smithi161.stdout:9/523: symlink d1/d2/d4/lb5 0 2024-02-22T00:33:24.208 INFO:tasks.workunit.client.1.smithi161.stdout:5/675: creat d3/d1b/d36/fea x:0 0 0 2024-02-22T00:33:24.209 INFO:tasks.workunit.client.1.smithi161.stdout:0/586: dread d14/fb4 [0,4194304] 0 2024-02-22T00:33:24.210 INFO:tasks.workunit.client.1.smithi161.stdout:5/676: stat d3/d1b/c56 0 2024-02-22T00:33:24.212 INFO:tasks.workunit.client.1.smithi161.stdout:7/514: mkdir d3/df/d33/d35/d55/d63/d7b/da5 0 2024-02-22T00:33:24.213 INFO:tasks.workunit.client.1.smithi161.stdout:2/546: dwrite de/d11/d14/f18 [0,4194304] 0 2024-02-22T00:33:24.214 INFO:tasks.workunit.client.0.smithi049.stdout:7/69: write d1/df/f18 [622745,83138] 0 2024-02-22T00:33:24.214 INFO:tasks.workunit.client.1.smithi161.stdout:5/677: symlink d3/leb 0 2024-02-22T00:33:24.218 INFO:tasks.workunit.client.1.smithi161.stdout:7/515: readlink d3/df/d33/l88 0 2024-02-22T00:33:24.221 INFO:tasks.workunit.client.1.smithi161.stdout:9/524: dwrite d1/d25/d73/d98/db4/f32 [0,4194304] 0 2024-02-22T00:33:24.221 INFO:tasks.workunit.client.0.smithi049.stdout:7/70: symlink d1/df/d12/l1a 0 2024-02-22T00:33:24.223 INFO:tasks.workunit.client.1.smithi161.stdout:5/678: fsync d3/d1b/d25/d4c/dcb/fe1 0 2024-02-22T00:33:24.229 INFO:tasks.workunit.client.0.smithi049.stdout:7/71: dwrite d1/f6 [0,4194304] 0 2024-02-22T00:33:24.230 INFO:tasks.workunit.client.1.smithi161.stdout:9/525: creat d1/d25/d73/fb6 x:0 0 0 2024-02-22T00:33:24.230 INFO:tasks.workunit.client.1.smithi161.stdout:2/547: dwrite de/f48 [0,4194304] 0 2024-02-22T00:33:24.230 INFO:tasks.workunit.client.1.smithi161.stdout:7/516: mknod d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/ca6 0 2024-02-22T00:33:24.231 INFO:tasks.workunit.client.1.smithi161.stdout:5/679: mkdir d3/d1b/d25/d4c/d7b/dec 0 2024-02-22T00:33:24.234 INFO:tasks.workunit.client.1.smithi161.stdout:2/548: read - de/d2b/d65/d3a/d72/da7/fb1 zero size 2024-02-22T00:33:24.237 INFO:tasks.workunit.client.1.smithi161.stdout:2/549: chown de/d11/d32 1540338 1 2024-02-22T00:33:24.237 INFO:tasks.workunit.client.0.smithi049.stdout:7/72: dwrite d1/f8 [0,4194304] 0 2024-02-22T00:33:24.241 INFO:tasks.workunit.client.1.smithi161.stdout:9/526: dwrite d1/d2/d4/d11/d21/f46 [0,4194304] 0 2024-02-22T00:33:24.241 INFO:tasks.workunit.client.1.smithi161.stdout:0/587: dread d14/d1a/f23 [0,4194304] 0 2024-02-22T00:33:24.241 INFO:tasks.workunit.client.1.smithi161.stdout:9/527: chown d1/d25/l50 2 1 2024-02-22T00:33:24.244 INFO:tasks.workunit.client.0.smithi049.stdout:7/73: mkdir d1/df/d1b 0 2024-02-22T00:33:24.245 INFO:tasks.workunit.client.1.smithi161.stdout:7/517: write d3/dd/d59/d5b/f4e [4126654,5164] 0 2024-02-22T00:33:24.256 INFO:tasks.workunit.client.1.smithi161.stdout:0/588: creat d14/d1a/d9d/dba/fc2 x:0 0 0 2024-02-22T00:33:24.257 INFO:tasks.workunit.client.1.smithi161.stdout:2/550: creat de/d2b/d83/d4f/fb6 x:0 0 0 2024-02-22T00:33:24.260 INFO:tasks.workunit.client.1.smithi161.stdout:9/528: creat d1/d2/d4/d1f/dab/fb7 x:0 0 0 2024-02-22T00:33:24.262 INFO:tasks.workunit.client.1.smithi161.stdout:5/680: link d3/d1b/d25/dcc/fd9 d3/d1b/d25/d4c/fed 0 2024-02-22T00:33:24.262 INFO:tasks.workunit.client.1.smithi161.stdout:7/518: rmdir d3/df/d33/d35/d55/d63/d7b/d9c 0 2024-02-22T00:33:24.263 INFO:tasks.workunit.client.1.smithi161.stdout:2/551: creat de/d2b/d65/d3a/d72/da7/fb7 x:0 0 0 2024-02-22T00:33:24.268 INFO:tasks.workunit.client.1.smithi161.stdout:5/681: creat d3/d1b/d25/d84/fee x:0 0 0 2024-02-22T00:33:24.268 INFO:tasks.workunit.client.1.smithi161.stdout:2/552: mkdir de/d2b/d8b/db8 0 2024-02-22T00:33:24.269 INFO:tasks.workunit.client.1.smithi161.stdout:0/589: dwrite d14/d1a/f8d [0,4194304] 0 2024-02-22T00:33:24.272 INFO:tasks.workunit.client.1.smithi161.stdout:5/682: readlink d3/d1b/d25/l4f 0 2024-02-22T00:33:24.275 INFO:tasks.workunit.client.1.smithi161.stdout:5/683: stat d3/d29/d80/cce 0 2024-02-22T00:33:24.276 INFO:tasks.workunit.client.1.smithi161.stdout:9/529: dwrite d1/d2/d4/d11/f31 [0,4194304] 0 2024-02-22T00:33:24.278 INFO:tasks.workunit.client.1.smithi161.stdout:7/519: dwrite d3/f17 [0,4194304] 0 2024-02-22T00:33:24.289 INFO:tasks.workunit.client.1.smithi161.stdout:9/530: fdatasync d1/d2/f10 0 2024-02-22T00:33:24.290 INFO:tasks.workunit.client.1.smithi161.stdout:5/684: write d3/d1b/d25/f53 [836259,101753] 0 2024-02-22T00:33:24.290 INFO:tasks.workunit.client.1.smithi161.stdout:5/685: dread d3/d1c/d20/f59 [0,4194304] 0 2024-02-22T00:33:24.290 INFO:tasks.workunit.client.1.smithi161.stdout:0/590: rmdir d14/d1a/d3f/d96/da1/daf 0 2024-02-22T00:33:24.290 INFO:tasks.workunit.client.1.smithi161.stdout:7/520: symlink d3/d77/la7 0 2024-02-22T00:33:24.291 INFO:tasks.workunit.client.1.smithi161.stdout:9/531: mkdir d1/d2/d4/d95/db8 0 2024-02-22T00:33:24.293 INFO:tasks.workunit.client.1.smithi161.stdout:7/521: write d3/dd/d59/d5b/f4e [2370574,88367] 0 2024-02-22T00:33:24.294 INFO:tasks.workunit.client.1.smithi161.stdout:0/591: truncate d14/f51 1627096 0 2024-02-22T00:33:24.295 INFO:tasks.workunit.client.1.smithi161.stdout:2/553: write de/f67 [2343009,70279] 0 2024-02-22T00:33:24.297 INFO:tasks.workunit.client.1.smithi161.stdout:0/592: symlink d14/d37/d42/d73/lc3 0 2024-02-22T00:33:24.300 INFO:tasks.workunit.client.1.smithi161.stdout:2/554: mknod de/cb9 0 2024-02-22T00:33:24.303 INFO:tasks.workunit.client.1.smithi161.stdout:0/593: getdents d14/d37/d42/d8e 0 2024-02-22T00:33:24.305 INFO:tasks.workunit.client.1.smithi161.stdout:0/594: creat d14/d1a/d3f/d96/fc4 x:0 0 0 2024-02-22T00:33:24.306 INFO:tasks.workunit.client.1.smithi161.stdout:9/532: dread d1/d5/d9/f76 [0,4194304] 0 2024-02-22T00:33:24.307 INFO:tasks.workunit.client.1.smithi161.stdout:2/555: dwrite de/d2b/d65/d60/d68/f6c [0,4194304] 0 2024-02-22T00:33:24.308 INFO:tasks.workunit.client.1.smithi161.stdout:9/533: fsync d1/d25/d73/d60/d77/f7c 0 2024-02-22T00:33:24.308 INFO:tasks.workunit.client.1.smithi161.stdout:0/595: chown d14/d37/f45 23 1 2024-02-22T00:33:24.311 INFO:tasks.workunit.client.1.smithi161.stdout:9/534: dread d1/d2/d4/d1f/f90 [0,4194304] 0 2024-02-22T00:33:24.312 INFO:tasks.workunit.client.1.smithi161.stdout:0/596: mkdir d14/d1a/d3f/d96/dbc/dc5 0 2024-02-22T00:33:24.314 INFO:tasks.workunit.client.1.smithi161.stdout:5/686: write d3/d1b/d25/dcc/fd9 [675155,55978] 0 2024-02-22T00:33:24.317 INFO:tasks.workunit.client.1.smithi161.stdout:0/597: mknod d14/d44/dbf/cc6 0 2024-02-22T00:33:24.320 INFO:tasks.workunit.client.1.smithi161.stdout:3/485: sync 2024-02-22T00:33:24.321 INFO:tasks.workunit.client.1.smithi161.stdout:9/535: link d1/d2/d7/d3f/f54 d1/d2/d4/d95/fb9 0 2024-02-22T00:33:24.321 INFO:tasks.workunit.client.1.smithi161.stdout:7/522: truncate d3/dd/d59/d5b/f4e 3117742 0 2024-02-22T00:33:24.322 INFO:tasks.workunit.client.1.smithi161.stdout:7/523: write d3/f14 [11005345,90137] 0 2024-02-22T00:33:24.324 INFO:tasks.workunit.client.1.smithi161.stdout:2/556: dread de/d2b/f5b [0,4194304] 0 2024-02-22T00:33:24.325 INFO:tasks.workunit.client.1.smithi161.stdout:3/486: unlink da/l43 0 2024-02-22T00:33:24.325 INFO:tasks.workunit.client.1.smithi161.stdout:3/487: chown da/d29/c88 32025 1 2024-02-22T00:33:24.327 INFO:tasks.workunit.client.1.smithi161.stdout:9/536: write d1/d5/f3e [1099151,39749] 0 2024-02-22T00:33:24.327 INFO:tasks.workunit.client.1.smithi161.stdout:5/687: link d3/d1c/d67/fcf d3/d1b/d36/dc1/fef 0 2024-02-22T00:33:24.329 INFO:tasks.workunit.client.1.smithi161.stdout:5/688: read - d3/d1c/fe7 zero size 2024-02-22T00:33:24.330 INFO:tasks.workunit.client.1.smithi161.stdout:3/488: truncate da/dc/d11/d40/d59/f9d 75496 0 2024-02-22T00:33:24.331 INFO:tasks.workunit.client.1.smithi161.stdout:3/489: fsync da/f46 0 2024-02-22T00:33:24.332 INFO:tasks.workunit.client.1.smithi161.stdout:9/537: truncate d1/d2/d4/d1f/dab/fb7 274665 0 2024-02-22T00:33:24.334 INFO:tasks.workunit.client.1.smithi161.stdout:0/598: getdents d14/d1a/d3f 0 2024-02-22T00:33:24.335 INFO:tasks.workunit.client.1.smithi161.stdout:7/524: creat d3/df/d33/d35/d55/fa8 x:0 0 0 2024-02-22T00:33:24.337 INFO:tasks.workunit.client.1.smithi161.stdout:0/599: fdatasync d14/d37/d42/d73/fa8 0 2024-02-22T00:33:24.338 INFO:tasks.workunit.client.1.smithi161.stdout:2/557: dwrite de/f21 [4194304,4194304] 0 2024-02-22T00:33:24.339 INFO:tasks.workunit.client.1.smithi161.stdout:5/689: link d3/d1b/d25/d4c/dd2/fe5 d3/dac/dd1/ff0 0 2024-02-22T00:33:24.342 INFO:tasks.workunit.client.1.smithi161.stdout:0/600: mkdir d14/d37/d42/d73/dc7 0 2024-02-22T00:33:24.344 INFO:tasks.workunit.client.1.smithi161.stdout:5/690: mknod d3/d1b/d91/cf1 0 2024-02-22T00:33:24.345 INFO:tasks.workunit.client.1.smithi161.stdout:7/525: creat d3/fa9 x:0 0 0 2024-02-22T00:33:24.346 INFO:tasks.workunit.client.1.smithi161.stdout:3/490: write da/dc/d11/d26/f52 [1505967,121668] 0 2024-02-22T00:33:24.350 INFO:tasks.workunit.client.1.smithi161.stdout:0/601: rmdir d14/d37/d42/d8e/d92 39 2024-02-22T00:33:24.351 INFO:tasks.workunit.client.1.smithi161.stdout:9/538: dwrite d1/d25/d73/d60/d77/f87 [0,4194304] 0 2024-02-22T00:33:24.354 INFO:tasks.workunit.client.1.smithi161.stdout:5/691: link d3/c31 d3/d1c/da7/cf2 0 2024-02-22T00:33:24.355 INFO:tasks.workunit.client.1.smithi161.stdout:9/539: fdatasync d1/d2/d4/d11/d21/f46 0 2024-02-22T00:33:24.357 INFO:tasks.workunit.client.1.smithi161.stdout:3/491: link da/d29/c38 da/dc/d11/d26/ca1 0 2024-02-22T00:33:24.360 INFO:tasks.workunit.client.1.smithi161.stdout:7/526: dwrite d3/dd/d60/f6c [4194304,4194304] 0 2024-02-22T00:33:24.362 INFO:tasks.workunit.client.1.smithi161.stdout:0/602: getdents d14/d37/d42/d73 0 2024-02-22T00:33:24.362 INFO:tasks.workunit.client.1.smithi161.stdout:5/692: truncate d3/d1b/d91/d96/fb1 1128468 0 2024-02-22T00:33:24.363 INFO:tasks.workunit.client.1.smithi161.stdout:2/558: dread f8 [0,4194304] 0 2024-02-22T00:33:24.366 INFO:tasks.workunit.client.1.smithi161.stdout:3/492: write da/d29/d8e/d37/d39/f3f [3008771,75822] 0 2024-02-22T00:33:24.367 INFO:tasks.workunit.client.1.smithi161.stdout:9/540: creat d1/d25/d73/d98/db4/fba x:0 0 0 2024-02-22T00:33:24.368 INFO:tasks.workunit.client.1.smithi161.stdout:2/559: mknod de/d11/d14/cba 0 2024-02-22T00:33:24.370 INFO:tasks.workunit.client.1.smithi161.stdout:5/693: rmdir d3/d1b/d25/d4c/dd2 39 2024-02-22T00:33:24.374 INFO:tasks.workunit.client.1.smithi161.stdout:9/541: mknod d1/d2/d4/d11/cbb 0 2024-02-22T00:33:24.376 INFO:tasks.workunit.client.1.smithi161.stdout:3/493: getdents da/d29/d8e 0 2024-02-22T00:33:24.376 INFO:tasks.workunit.client.1.smithi161.stdout:5/694: creat d3/d1b/d25/d4c/dcb/ff3 x:0 0 0 2024-02-22T00:33:24.378 INFO:tasks.workunit.client.1.smithi161.stdout:9/542: fdatasync d1/d25/f58 0 2024-02-22T00:33:24.379 INFO:tasks.workunit.client.1.smithi161.stdout:7/527: dwrite d3/df/d33/d35/d55/d63/d7b/d30/d44/f90 [0,4194304] 0 2024-02-22T00:33:24.379 INFO:tasks.workunit.client.1.smithi161.stdout:0/603: dwrite f11 [0,4194304] 0 2024-02-22T00:33:24.384 INFO:tasks.workunit.client.1.smithi161.stdout:0/604: fsync d14/f19 0 2024-02-22T00:33:24.384 INFO:tasks.workunit.client.1.smithi161.stdout:5/695: symlink d3/d1b/d25/dcc/lf4 0 2024-02-22T00:33:24.386 INFO:tasks.workunit.client.1.smithi161.stdout:2/560: dwrite de/d2b/d83/d4f/f54 [4194304,4194304] 0 2024-02-22T00:33:24.387 INFO:tasks.workunit.client.1.smithi161.stdout:7/528: write d3/f73 [3745951,10642] 0 2024-02-22T00:33:24.390 INFO:tasks.workunit.client.1.smithi161.stdout:3/494: creat da/dc/d11/d26/d80/fa2 x:0 0 0 2024-02-22T00:33:24.390 INFO:tasks.workunit.client.1.smithi161.stdout:9/543: rename d1/d2/d7/d3f to d1/d5/d9/da5/dbc 0 2024-02-22T00:33:24.396 INFO:tasks.workunit.client.1.smithi161.stdout:5/696: creat d3/d1b/d36/ff5 x:0 0 0 2024-02-22T00:33:24.396 INFO:tasks.workunit.client.1.smithi161.stdout:5/697: write d3/d1b/d91/fad [403982,56049] 0 2024-02-22T00:33:24.397 INFO:tasks.workunit.client.1.smithi161.stdout:3/495: rename da/f6c to da/dc/d91/fa3 0 2024-02-22T00:33:24.398 INFO:tasks.workunit.client.1.smithi161.stdout:7/529: fdatasync d3/df/d33/d35/d55/d63/d7b/d30/d44/f90 0 2024-02-22T00:33:24.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/530: stat d3/f1b 0 2024-02-22T00:33:24.400 INFO:tasks.workunit.client.1.smithi161.stdout:2/561: truncate f8 3082341 0 2024-02-22T00:33:24.402 INFO:tasks.workunit.client.1.smithi161.stdout:5/698: truncate d3/d29/f75 11282 0 2024-02-22T00:33:24.403 INFO:tasks.workunit.client.1.smithi161.stdout:9/544: fdatasync d1/d2/d7/da/f3c 0 2024-02-22T00:33:24.409 INFO:tasks.workunit.client.1.smithi161.stdout:5/699: dread d3/d1b/d25/d4c/fed [0,4194304] 0 2024-02-22T00:33:24.410 INFO:tasks.workunit.client.1.smithi161.stdout:9/545: fdatasync d1/d2/d4/d95/fb9 0 2024-02-22T00:33:24.410 INFO:tasks.workunit.client.1.smithi161.stdout:3/496: dwrite da/dc/f1f [0,4194304] 0 2024-02-22T00:33:24.412 INFO:tasks.workunit.client.1.smithi161.stdout:9/546: fdatasync d1/d25/f58 0 2024-02-22T00:33:24.415 INFO:tasks.workunit.client.1.smithi161.stdout:7/531: dread d3/f7d [0,4194304] 0 2024-02-22T00:33:24.416 INFO:tasks.workunit.client.1.smithi161.stdout:3/497: rmdir da/dc/d91 39 2024-02-22T00:33:24.416 INFO:tasks.workunit.client.1.smithi161.stdout:9/547: dread - d1/d2/d4/f79 zero size 2024-02-22T00:33:24.416 INFO:tasks.workunit.client.1.smithi161.stdout:0/605: dwrite d14/d1a/f3d [0,4194304] 0 2024-02-22T00:33:24.424 INFO:tasks.workunit.client.1.smithi161.stdout:2/562: dread de/f1c [0,4194304] 0 2024-02-22T00:33:24.424 INFO:tasks.workunit.client.1.smithi161.stdout:9/548: creat d1/d25/d73/d98/db4/d4f/fbd x:0 0 0 2024-02-22T00:33:24.425 INFO:tasks.workunit.client.1.smithi161.stdout:0/606: symlink d14/d37/d42/d8e/lc8 0 2024-02-22T00:33:24.428 INFO:tasks.workunit.client.1.smithi161.stdout:3/498: mknod da/dc/d11/d40/ca4 0 2024-02-22T00:33:24.429 INFO:tasks.workunit.client.1.smithi161.stdout:3/499: chown da/d29/c88 4135 1 2024-02-22T00:33:24.430 INFO:tasks.workunit.client.1.smithi161.stdout:2/563: unlink de/d2b/d65/d3a/d72/lb5 0 2024-02-22T00:33:24.431 INFO:tasks.workunit.client.1.smithi161.stdout:9/549: unlink d1/d2/d4/d11/c82 0 2024-02-22T00:33:24.433 INFO:tasks.workunit.client.1.smithi161.stdout:7/532: getdents d3/df/d33/d35/d55/d63/d7b 0 2024-02-22T00:33:24.435 INFO:tasks.workunit.client.1.smithi161.stdout:9/550: creat d1/d5/d9/da5/dbc/fbe x:0 0 0 2024-02-22T00:33:24.436 INFO:tasks.workunit.client.1.smithi161.stdout:3/500: mkdir da/dc/d11/da5 0 2024-02-22T00:33:24.441 INFO:tasks.workunit.client.1.smithi161.stdout:3/501: mknod da/d29/ca6 0 2024-02-22T00:33:24.443 INFO:tasks.workunit.client.1.smithi161.stdout:9/551: rename d1/l3 to d1/d4b/d81/lbf 0 2024-02-22T00:33:24.445 INFO:tasks.workunit.client.1.smithi161.stdout:5/700: dread d3/d1c/d62/f94 [0,4194304] 0 2024-02-22T00:33:24.445 INFO:tasks.workunit.client.1.smithi161.stdout:2/564: dwrite de/d2b/d65/d3a/d72/d8f/f91 [0,4194304] 0 2024-02-22T00:33:24.446 INFO:tasks.workunit.client.1.smithi161.stdout:9/552: dread - d1/d2/d4/fad zero size 2024-02-22T00:33:24.448 INFO:tasks.workunit.client.1.smithi161.stdout:0/607: dwrite d14/f82 [4194304,4194304] 0 2024-02-22T00:33:24.454 INFO:tasks.workunit.client.1.smithi161.stdout:7/533: dwrite d3/f14 [4194304,4194304] 0 2024-02-22T00:33:24.454 INFO:tasks.workunit.client.1.smithi161.stdout:3/502: creat da/dc/d11/d26/d80/d92/fa7 x:0 0 0 2024-02-22T00:33:24.454 INFO:tasks.workunit.client.1.smithi161.stdout:2/565: creat de/d11/d14/fbb x:0 0 0 2024-02-22T00:33:24.458 INFO:tasks.workunit.client.1.smithi161.stdout:2/566: fsync de/d11/f13 0 2024-02-22T00:33:24.458 INFO:tasks.workunit.client.1.smithi161.stdout:7/534: readlink d3/df/d33/d35/d55/d63/d7b/l87 0 2024-02-22T00:33:24.458 INFO:tasks.workunit.client.1.smithi161.stdout:0/608: mknod d14/d1a/d3f/d96/dbc/cc9 0 2024-02-22T00:33:24.461 INFO:tasks.workunit.client.1.smithi161.stdout:3/503: mknod da/d29/d8e/d37/d39/ca8 0 2024-02-22T00:33:24.461 INFO:tasks.workunit.client.1.smithi161.stdout:5/701: write d3/d1c/d69/faf [2290077,55495] 0 2024-02-22T00:33:24.462 INFO:tasks.workunit.client.1.smithi161.stdout:3/504: write da/d29/d8e/f85 [1280741,51332] 0 2024-02-22T00:33:24.466 INFO:tasks.workunit.client.1.smithi161.stdout:2/567: creat de/d2b/d8b/da2/fbc x:0 0 0 2024-02-22T00:33:24.467 INFO:tasks.workunit.client.1.smithi161.stdout:9/553: rename d1/d2/f2e to d1/d2/d7/fc0 0 2024-02-22T00:33:24.468 INFO:tasks.workunit.client.1.smithi161.stdout:2/568: stat de/d11/f4e 0 2024-02-22T00:33:24.468 INFO:tasks.workunit.client.1.smithi161.stdout:7/535: dwrite d3/dd/d60/d64/f89 [0,4194304] 0 2024-02-22T00:33:24.469 INFO:tasks.workunit.client.1.smithi161.stdout:5/702: fdatasync d3/d1c/f76 0 2024-02-22T00:33:24.471 INFO:tasks.workunit.client.1.smithi161.stdout:3/505: mknod da/dc/d11/d40/ca9 0 2024-02-22T00:33:24.473 INFO:tasks.workunit.client.1.smithi161.stdout:2/569: symlink de/d2b/d8b/lbd 0 2024-02-22T00:33:24.474 INFO:tasks.workunit.client.1.smithi161.stdout:0/609: getdents d14/d9b 0 2024-02-22T00:33:24.475 INFO:tasks.workunit.client.1.smithi161.stdout:0/610: dread - d14/d1a/d3f/d96/fc4 zero size 2024-02-22T00:33:24.476 INFO:tasks.workunit.client.1.smithi161.stdout:5/703: fsync d3/d1b/d25/d4c/dd2/fe5 0 2024-02-22T00:33:24.478 INFO:tasks.workunit.client.1.smithi161.stdout:6/471: sync 2024-02-22T00:33:24.478 INFO:tasks.workunit.client.1.smithi161.stdout:8/554: sync 2024-02-22T00:33:24.479 INFO:tasks.workunit.client.1.smithi161.stdout:7/536: truncate d3/df/d33/d35/d55/d63/d7b/d8f/f94 2418482 0 2024-02-22T00:33:24.482 INFO:tasks.workunit.client.1.smithi161.stdout:0/611: truncate d14/d37/f45 2883959 0 2024-02-22T00:33:24.484 INFO:tasks.workunit.client.1.smithi161.stdout:5/704: mkdir d3/d29/d80/d92/df6 0 2024-02-22T00:33:24.484 INFO:tasks.workunit.client.1.smithi161.stdout:7/537: write d3/df/d33/d35/d55/d63/f66 [1543212,99109] 0 2024-02-22T00:33:24.486 INFO:tasks.workunit.client.1.smithi161.stdout:7/538: write d3/df/d33/d35/f27 [3634734,10209] 0 2024-02-22T00:33:24.486 INFO:tasks.workunit.client.1.smithi161.stdout:0/612: fsync d14/d29/f5c 0 2024-02-22T00:33:24.486 INFO:tasks.workunit.client.1.smithi161.stdout:5/705: dread d3/d1c/f48 [0,4194304] 0 2024-02-22T00:33:24.488 INFO:tasks.workunit.client.1.smithi161.stdout:5/706: dread - d3/d1c/fbf zero size 2024-02-22T00:33:24.490 INFO:tasks.workunit.client.1.smithi161.stdout:0/613: chown d14/d1a/d3f/d96/fae 362 1 2024-02-22T00:33:24.491 INFO:tasks.workunit.client.1.smithi161.stdout:0/614: truncate d14/d37/d42/d73/f91 4268497 0 2024-02-22T00:33:24.493 INFO:tasks.workunit.client.1.smithi161.stdout:2/570: getdents de/d2b/d65/d60 0 2024-02-22T00:33:24.496 INFO:tasks.workunit.client.1.smithi161.stdout:2/571: write de/d11/f29 [109419,83634] 0 2024-02-22T00:33:24.496 INFO:tasks.workunit.client.1.smithi161.stdout:8/555: rename d1/d1c/d20/d22/d28/f2e to d1/d1c/d75/d18/fb3 0 2024-02-22T00:33:24.499 INFO:tasks.workunit.client.1.smithi161.stdout:6/472: dread d3/d10/d1b/f2e [0,4194304] 0 2024-02-22T00:33:24.500 INFO:tasks.workunit.client.1.smithi161.stdout:0/615: truncate d14/d44/f94 491495 0 2024-02-22T00:33:24.500 INFO:tasks.workunit.client.1.smithi161.stdout:3/506: dwrite da/dc/d91/f9c [0,4194304] 0 2024-02-22T00:33:24.504 INFO:tasks.workunit.client.1.smithi161.stdout:5/707: rename d3/d1c/da7 to d3/d29/d80/d92/df7 0 2024-02-22T00:33:24.507 INFO:tasks.workunit.client.1.smithi161.stdout:7/539: write d3/dd/d59/d5b/f51 [3085523,124605] 0 2024-02-22T00:33:24.511 INFO:tasks.workunit.client.1.smithi161.stdout:3/507: unlink da/dc/d11/d40/ca9 0 2024-02-22T00:33:24.513 INFO:tasks.workunit.client.1.smithi161.stdout:5/708: rename d3/d1c/d20/l61 to d3/d1b/d36/lf8 0 2024-02-22T00:33:24.514 INFO:tasks.workunit.client.1.smithi161.stdout:2/572: link de/d11/f29 de/d11/d32/fbe 0 2024-02-22T00:33:24.515 INFO:tasks.workunit.client.1.smithi161.stdout:0/616: dread d14/f4b [0,4194304] 0 2024-02-22T00:33:24.517 INFO:tasks.workunit.client.1.smithi161.stdout:3/508: unlink da/l1c 0 2024-02-22T00:33:24.518 INFO:tasks.workunit.client.1.smithi161.stdout:5/709: mknod d3/d1b/d25/d4c/dd2/cf9 0 2024-02-22T00:33:24.520 INFO:tasks.workunit.client.1.smithi161.stdout:7/540: unlink d3/df/d33/d35/d55/d63/d7b/d50/d62/l85 0 2024-02-22T00:33:24.521 INFO:tasks.workunit.client.1.smithi161.stdout:7/541: write d3/df/d43/f76 [5041810,63619] 0 2024-02-22T00:33:24.522 INFO:tasks.workunit.client.1.smithi161.stdout:2/573: creat de/d11/d5c/fbf x:0 0 0 2024-02-22T00:33:24.522 INFO:tasks.workunit.client.1.smithi161.stdout:7/542: chown d3/dd/d60 1984 1 2024-02-22T00:33:24.523 INFO:tasks.workunit.client.1.smithi161.stdout:0/617: mkdir d14/d37/dca 0 2024-02-22T00:33:24.527 INFO:tasks.workunit.client.1.smithi161.stdout:6/473: fsync d3/d10/d1b/f46 0 2024-02-22T00:33:24.527 INFO:tasks.workunit.client.1.smithi161.stdout:3/509: mkdir da/dc/d11/d40/d59/d93/daa 0 2024-02-22T00:33:24.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/474: dwrite d3/d10/d1b/d5e/f7a [0,4194304] 0 2024-02-22T00:33:24.532 INFO:tasks.workunit.client.1.smithi161.stdout:0/618: rename d14/l58 to d14/d37/d42/d8e/d92/lcb 0 2024-02-22T00:33:24.536 INFO:tasks.workunit.client.1.smithi161.stdout:2/574: link de/d2b/d8b/lb3 de/d2b/d65/d3a/lc0 0 2024-02-22T00:33:24.541 INFO:tasks.workunit.client.1.smithi161.stdout:5/710: getdents d3/d1c/d67 0 2024-02-22T00:33:24.542 INFO:tasks.workunit.client.1.smithi161.stdout:6/475: dwrite d3/d10/d1b/f2e [0,4194304] 0 2024-02-22T00:33:24.542 INFO:tasks.workunit.client.1.smithi161.stdout:3/510: creat da/dc/d11/fab x:0 0 0 2024-02-22T00:33:24.544 INFO:tasks.workunit.client.1.smithi161.stdout:7/543: getdents d3/df/d33/d35/d55 0 2024-02-22T00:33:24.547 INFO:tasks.workunit.client.1.smithi161.stdout:6/476: rmdir d3/dc/df 39 2024-02-22T00:33:24.548 INFO:tasks.workunit.client.1.smithi161.stdout:0/619: dwrite d14/f2c [0,4194304] 0 2024-02-22T00:33:24.548 INFO:tasks.workunit.client.1.smithi161.stdout:6/477: chown d3/c8f 357329556 1 2024-02-22T00:33:24.551 INFO:tasks.workunit.client.1.smithi161.stdout:5/711: rename d3/d29/f45 to d3/d1b/d25/d84/ffa 0 2024-02-22T00:33:24.553 INFO:tasks.workunit.client.1.smithi161.stdout:2/575: link de/d2b/d65/f9c de/d2b/d65/d3a/d72/da7/fc1 0 2024-02-22T00:33:24.556 INFO:tasks.workunit.client.1.smithi161.stdout:6/478: dread - d3/dc/df/d32/f93 zero size 2024-02-22T00:33:24.558 INFO:tasks.workunit.client.1.smithi161.stdout:7/544: link d3/df/d33/f45 d3/df/d43/faa 0 2024-02-22T00:33:24.560 INFO:tasks.workunit.client.1.smithi161.stdout:5/712: dwrite d3/d1b/d25/db5/dca/fd6 [0,4194304] 0 2024-02-22T00:33:24.569 INFO:tasks.workunit.client.1.smithi161.stdout:5/713: stat d3/c31 0 2024-02-22T00:33:24.569 INFO:tasks.workunit.client.1.smithi161.stdout:0/620: creat d14/d37/d42/d8e/fcc x:0 0 0 2024-02-22T00:33:24.571 INFO:tasks.workunit.client.1.smithi161.stdout:7/545: dread d3/dd/d60/d64/f89 [0,4194304] 0 2024-02-22T00:33:24.573 INFO:tasks.workunit.client.1.smithi161.stdout:6/479: mkdir d3/d10/d12/d2f/d7d/d97 0 2024-02-22T00:33:24.574 INFO:tasks.workunit.client.1.smithi161.stdout:5/714: dread - d3/d1b/d25/d84/fee zero size 2024-02-22T00:33:24.578 INFO:tasks.workunit.client.1.smithi161.stdout:7/546: mkdir d3/dd/d60/dab 0 2024-02-22T00:33:24.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/511: dread da/dc/f51 [0,4194304] 0 2024-02-22T00:33:24.585 INFO:tasks.workunit.client.1.smithi161.stdout:5/715: dwrite d3/f19 [0,4194304] 0 2024-02-22T00:33:24.587 INFO:tasks.workunit.client.1.smithi161.stdout:5/716: fdatasync d3/d1b/d8f/fc6 0 2024-02-22T00:33:24.592 INFO:tasks.workunit.client.1.smithi161.stdout:2/576: truncate de/d11/d5c/fa6 4030384 0 2024-02-22T00:33:24.592 INFO:tasks.workunit.client.1.smithi161.stdout:0/621: truncate f11 3129966 0 2024-02-22T00:33:24.593 INFO:tasks.workunit.client.1.smithi161.stdout:3/512: creat da/d29/d8e/d37/d39/fac x:0 0 0 2024-02-22T00:33:24.593 INFO:tasks.workunit.client.1.smithi161.stdout:5/717: unlink d3/d29/ld5 0 2024-02-22T00:33:24.593 INFO:tasks.workunit.client.1.smithi161.stdout:6/480: link d3/d10/d12/d2f/c60 d3/d10/d12/d3a/c98 0 2024-02-22T00:33:24.594 INFO:tasks.workunit.client.1.smithi161.stdout:2/577: chown de/c15 196593 1 2024-02-22T00:33:24.597 INFO:tasks.workunit.client.1.smithi161.stdout:7/547: rmdir d3/df/d33/d35/d55/d63/d7b/da5 0 2024-02-22T00:33:24.598 INFO:tasks.workunit.client.1.smithi161.stdout:5/718: mkdir d3/d1b/d8f/dfb 0 2024-02-22T00:33:24.599 INFO:tasks.workunit.client.1.smithi161.stdout:2/578: symlink de/d2b/d65/d3a/lc2 0 2024-02-22T00:33:24.599 INFO:tasks.workunit.client.1.smithi161.stdout:5/719: truncate d3/d1b/f68 5086156 0 2024-02-22T00:33:24.601 INFO:tasks.workunit.client.1.smithi161.stdout:5/720: fsync d3/d1c/d69/faf 0 2024-02-22T00:33:24.601 INFO:tasks.workunit.client.1.smithi161.stdout:0/622: mkdir d14/d37/d42/d8e/d92/da5/dcd 0 2024-02-22T00:33:24.601 INFO:tasks.workunit.client.1.smithi161.stdout:6/481: creat d3/d10/d12/d2f/d7d/d5f/f99 x:0 0 0 2024-02-22T00:33:24.602 INFO:tasks.workunit.client.1.smithi161.stdout:6/482: fdatasync d3/d30/f74 0 2024-02-22T00:33:24.603 INFO:tasks.workunit.client.1.smithi161.stdout:3/513: mknod da/dc/d11/d40/d59/d93/daa/cad 0 2024-02-22T00:33:24.603 INFO:tasks.workunit.client.1.smithi161.stdout:6/483: dread - d3/dc/f41 zero size 2024-02-22T00:33:24.605 INFO:tasks.workunit.client.1.smithi161.stdout:2/579: mkdir de/d2b/d8b/da2/da5/dc3 0 2024-02-22T00:33:24.606 INFO:tasks.workunit.client.1.smithi161.stdout:2/580: truncate de/d11/fad 433417 0 2024-02-22T00:33:24.607 INFO:tasks.workunit.client.1.smithi161.stdout:4/523: sync 2024-02-22T00:33:24.607 INFO:tasks.workunit.client.1.smithi161.stdout:2/581: fsync de/d2b/d65/d60/d68/fa3 0 2024-02-22T00:33:24.607 INFO:tasks.workunit.client.1.smithi161.stdout:4/524: stat d5/l4c 0 2024-02-22T00:33:24.608 INFO:tasks.workunit.client.1.smithi161.stdout:0/623: symlink d14/d44/dbf/lce 0 2024-02-22T00:33:24.617 INFO:tasks.workunit.client.1.smithi161.stdout:2/582: rename de/d2b/d65/d3a/d72 to de/d2b/d8b/da2/da5/dc4 0 2024-02-22T00:33:24.618 INFO:tasks.workunit.client.1.smithi161.stdout:7/548: write d3/df/d33/d35/d55/d63/d7b/d50/f61 [2043439,63364] 0 2024-02-22T00:33:24.620 INFO:tasks.workunit.client.1.smithi161.stdout:6/484: fdatasync d3/d10/f65 0 2024-02-22T00:33:24.622 INFO:tasks.workunit.client.1.smithi161.stdout:3/514: rmdir da/dc/d11 39 2024-02-22T00:33:24.622 INFO:tasks.workunit.client.1.smithi161.stdout:2/583: rmdir de/d2b/d8b 39 2024-02-22T00:33:24.624 INFO:tasks.workunit.client.1.smithi161.stdout:5/721: link d3/d29/d80/d92/df7/dae/ld8 d3/d1b/d25/dcc/ddb/lfc 0 2024-02-22T00:33:24.626 INFO:tasks.workunit.client.1.smithi161.stdout:7/549: dwrite d3/df/d33/d35/d55/f79 [0,4194304] 0 2024-02-22T00:33:24.628 INFO:tasks.workunit.client.1.smithi161.stdout:6/485: symlink d3/d7c/l9a 0 2024-02-22T00:33:24.628 INFO:tasks.workunit.client.1.smithi161.stdout:6/486: write d3/d10/f6e [414213,115596] 0 2024-02-22T00:33:24.630 INFO:tasks.workunit.client.1.smithi161.stdout:0/624: rename d14/d44/f94 to d14/d37/d42/d73/fcf 0 2024-02-22T00:33:24.632 INFO:tasks.workunit.client.1.smithi161.stdout:0/625: write f8 [4576217,6273] 0 2024-02-22T00:33:24.634 INFO:tasks.workunit.client.1.smithi161.stdout:0/626: chown d14/f35 1 1 2024-02-22T00:33:24.635 INFO:tasks.workunit.client.1.smithi161.stdout:2/584: mkdir de/d2b/d83/d4f/dc5 0 2024-02-22T00:33:24.636 INFO:tasks.workunit.client.1.smithi161.stdout:6/487: dwrite d3/d10/d12/d2f/f3c [0,4194304] 0 2024-02-22T00:33:24.638 INFO:tasks.workunit.client.1.smithi161.stdout:5/722: write d3/d29/fa3 [926063,120351] 0 2024-02-22T00:33:24.639 INFO:tasks.workunit.client.1.smithi161.stdout:5/723: chown d3/d1b/d91/cf1 70 1 2024-02-22T00:33:24.641 INFO:tasks.workunit.client.1.smithi161.stdout:5/724: dread - d3/d1b/d36/fea zero size 2024-02-22T00:33:24.642 INFO:tasks.workunit.client.1.smithi161.stdout:7/550: write d3/df/d33/d35/d55/d63/d7b/f3e [4607367,30316] 0 2024-02-22T00:33:24.642 INFO:tasks.workunit.client.1.smithi161.stdout:2/585: creat de/d2b/d65/d60/d68/fc6 x:0 0 0 2024-02-22T00:33:24.645 INFO:tasks.workunit.client.1.smithi161.stdout:3/515: write da/dc/f51 [4302163,20749] 0 2024-02-22T00:33:24.651 INFO:tasks.workunit.client.1.smithi161.stdout:5/725: unlink d3/d29/d80/c9b 0 2024-02-22T00:33:24.651 INFO:tasks.workunit.client.1.smithi161.stdout:6/488: getdents d3/dc/df 0 2024-02-22T00:33:24.654 INFO:tasks.workunit.client.1.smithi161.stdout:6/489: getdents d3/d10/d12/d2f/d7d/d82 0 2024-02-22T00:33:24.661 INFO:tasks.workunit.client.1.smithi161.stdout:5/726: truncate d3/d1b/d25/f39 16989854 0 2024-02-22T00:33:24.667 INFO:tasks.workunit.client.1.smithi161.stdout:5/727: fsync d3/d1b/d25/d84/fee 0 2024-02-22T00:33:24.669 INFO:tasks.workunit.client.1.smithi161.stdout:6/490: dwrite d3/d10/d12/d2f/d7d/f80 [0,4194304] 0 2024-02-22T00:33:24.671 INFO:tasks.workunit.client.1.smithi161.stdout:7/551: dread d3/df/d33/d35/d55/d63/d7b/f70 [0,4194304] 0 2024-02-22T00:33:24.673 INFO:tasks.workunit.client.1.smithi161.stdout:2/586: dwrite de/d11/f29 [0,4194304] 0 2024-02-22T00:33:24.673 INFO:tasks.workunit.client.1.smithi161.stdout:0/627: dwrite f11 [0,4194304] 0 2024-02-22T00:33:24.677 INFO:tasks.workunit.client.1.smithi161.stdout:7/552: symlink d3/df/d43/lac 0 2024-02-22T00:33:24.678 INFO:tasks.workunit.client.1.smithi161.stdout:3/516: dread da/dc/d11/d26/f45 [0,4194304] 0 2024-02-22T00:33:24.679 INFO:tasks.workunit.client.1.smithi161.stdout:7/553: fsync d3/df/d33/d35/d55/d63/f66 0 2024-02-22T00:33:24.680 INFO:tasks.workunit.client.1.smithi161.stdout:2/587: symlink de/d2b/d65/d60/d68/lc7 0 2024-02-22T00:33:24.681 INFO:tasks.workunit.client.1.smithi161.stdout:6/491: mknod d3/d10/d12/d2f/d7d/d82/c9b 0 2024-02-22T00:33:24.684 INFO:tasks.workunit.client.1.smithi161.stdout:3/517: write da/dc/f1f [1110172,19353] 0 2024-02-22T00:33:24.685 INFO:tasks.workunit.client.1.smithi161.stdout:3/518: stat da/dc/d11/d40 0 2024-02-22T00:33:24.687 INFO:tasks.workunit.client.1.smithi161.stdout:2/588: symlink de/d2b/d65/d3a/lc8 0 2024-02-22T00:33:24.688 INFO:tasks.workunit.client.1.smithi161.stdout:6/492: mknod d3/d10/d12/d3a/c9c 0 2024-02-22T00:33:24.688 INFO:tasks.workunit.client.1.smithi161.stdout:5/728: link d3/l6a d3/d1b/d25/d4c/dcb/lfd 0 2024-02-22T00:33:24.691 INFO:tasks.workunit.client.1.smithi161.stdout:0/628: link d14/d44/l50 d14/d37/d42/ld0 0 2024-02-22T00:33:24.693 INFO:tasks.workunit.client.1.smithi161.stdout:5/729: chown d3/d29/d80/ce9 0 1 2024-02-22T00:33:24.694 INFO:tasks.workunit.client.1.smithi161.stdout:7/554: dwrite d3/df/d33/d74/f98 [0,4194304] 0 2024-02-22T00:33:24.694 INFO:tasks.workunit.client.1.smithi161.stdout:6/493: unlink d3/f66 0 2024-02-22T00:33:24.696 INFO:tasks.workunit.client.1.smithi161.stdout:2/589: mkdir de/d2b/d83/dc9 0 2024-02-22T00:33:24.696 INFO:tasks.workunit.client.1.smithi161.stdout:5/730: dread - d3/d1b/d36/dc1/fef zero size 2024-02-22T00:33:24.697 INFO:tasks.workunit.client.1.smithi161.stdout:3/519: dwrite da/d56/f7b [0,4194304] 0 2024-02-22T00:33:24.700 INFO:tasks.workunit.client.1.smithi161.stdout:3/520: write da/f46 [41722,3212] 0 2024-02-22T00:33:24.702 INFO:tasks.workunit.client.1.smithi161.stdout:7/555: rmdir d3/dd/d60 39 2024-02-22T00:33:24.709 INFO:tasks.workunit.client.1.smithi161.stdout:5/731: mknod d3/d9c/cfe 0 2024-02-22T00:33:24.711 INFO:tasks.workunit.client.1.smithi161.stdout:2/590: write de/d11/d5c/f80 [709440,92609] 0 2024-02-22T00:33:24.712 INFO:tasks.workunit.client.1.smithi161.stdout:6/494: dwrite d3/d10/d12/d3a/f68 [0,4194304] 0 2024-02-22T00:33:24.719 INFO:tasks.workunit.client.1.smithi161.stdout:2/591: unlink de/d2b/d65/l9f 0 2024-02-22T00:33:24.720 INFO:tasks.workunit.client.1.smithi161.stdout:0/629: dwrite d14/f16 [0,4194304] 0 2024-02-22T00:33:24.721 INFO:tasks.workunit.client.1.smithi161.stdout:5/732: symlink d3/dac/dd1/lff 0 2024-02-22T00:33:24.721 INFO:tasks.workunit.client.1.smithi161.stdout:2/592: chown de/d11/d14/cba 175861 1 2024-02-22T00:33:24.722 INFO:tasks.workunit.client.1.smithi161.stdout:6/495: creat d3/d10/d12/d95/f9d x:0 0 0 2024-02-22T00:33:24.724 INFO:tasks.workunit.client.1.smithi161.stdout:5/733: creat d3/d1b/d25/d84/f100 x:0 0 0 2024-02-22T00:33:24.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/496: write d3/dc/df/f69 [4284100,116435] 0 2024-02-22T00:33:24.725 INFO:tasks.workunit.client.1.smithi161.stdout:2/593: write de/d2b/d65/d60/d68/fa3 [265725,111857] 0 2024-02-22T00:33:24.727 INFO:tasks.workunit.client.1.smithi161.stdout:6/497: chown d3/dc/df/d32 42247 1 2024-02-22T00:33:24.730 INFO:tasks.workunit.client.1.smithi161.stdout:1/540: sync 2024-02-22T00:33:24.730 INFO:tasks.workunit.client.1.smithi161.stdout:9/554: sync 2024-02-22T00:33:24.734 INFO:tasks.workunit.client.1.smithi161.stdout:9/555: write d1/d2/d4/fad [958892,89695] 0 2024-02-22T00:33:24.736 INFO:tasks.workunit.client.1.smithi161.stdout:6/498: rename d3/f15 to d3/d10/d12/f9e 0 2024-02-22T00:33:24.737 INFO:tasks.workunit.client.1.smithi161.stdout:7/556: dread d3/df/d43/faa [0,4194304] 0 2024-02-22T00:33:24.737 INFO:tasks.workunit.client.1.smithi161.stdout:5/734: dwrite d3/dac/fde [0,4194304] 0 2024-02-22T00:33:24.739 INFO:tasks.workunit.client.1.smithi161.stdout:9/556: dread - d1/d25/d73/d60/f9d zero size 2024-02-22T00:33:24.740 INFO:tasks.workunit.client.1.smithi161.stdout:5/735: chown d3/d29/d80/d92/df7 12985 1 2024-02-22T00:33:24.740 INFO:tasks.workunit.client.1.smithi161.stdout:8/556: sync 2024-02-22T00:33:24.740 INFO:tasks.workunit.client.1.smithi161.stdout:4/525: sync 2024-02-22T00:33:24.740 INFO:tasks.workunit.client.1.smithi161.stdout:1/541: rename d19/d51/d64/f6b to d19/d1d/d2c/d7d/da2/fbe 0 2024-02-22T00:33:24.743 INFO:tasks.workunit.client.1.smithi161.stdout:9/557: write d1/d25/d73/d98/db4/d4f/f5e [5374928,116531] 0 2024-02-22T00:33:24.744 INFO:tasks.workunit.client.1.smithi161.stdout:1/542: write d19/f8a [4509325,18682] 0 2024-02-22T00:33:24.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/557: mkdir d1/d1c/d20/d22/d28/d7f/db4 0 2024-02-22T00:33:24.751 INFO:tasks.workunit.client.1.smithi161.stdout:1/543: creat d19/d1d/fbf x:0 0 0 2024-02-22T00:33:24.753 INFO:tasks.workunit.client.1.smithi161.stdout:9/558: write d1/d25/d73/d60/fb3 [493622,77497] 0 2024-02-22T00:33:24.754 INFO:tasks.workunit.client.1.smithi161.stdout:6/499: dwrite d3/d30/f74 [0,4194304] 0 2024-02-22T00:33:24.758 INFO:tasks.workunit.client.1.smithi161.stdout:0/630: truncate d14/d1a/f3d 2847656 0 2024-02-22T00:33:24.760 INFO:tasks.workunit.client.1.smithi161.stdout:9/559: chown d1/d2/d7/da/f80 168 1 2024-02-22T00:33:24.760 INFO:tasks.workunit.client.1.smithi161.stdout:1/544: symlink d19/d1d/d2c/d7d/da2/lc0 0 2024-02-22T00:33:24.761 INFO:tasks.workunit.client.1.smithi161.stdout:2/594: write de/d2b/d65/f9c [427594,129595] 0 2024-02-22T00:33:24.762 INFO:tasks.workunit.client.1.smithi161.stdout:7/557: link d3/df/l34 d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/lad 0 2024-02-22T00:33:24.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/526: getdents d5/d8/d41/d57/dbe/d28/d63/d65 0 2024-02-22T00:33:24.763 INFO:tasks.workunit.client.1.smithi161.stdout:8/558: rename d1/d1c/d75/d18/c8f to d1/d1c/d20/d22/d28/d36/d6c/cb5 0 2024-02-22T00:33:24.765 INFO:tasks.workunit.client.1.smithi161.stdout:3/521: dwrite da/dc/f2b [0,4194304] 0 2024-02-22T00:33:24.767 INFO:tasks.workunit.client.1.smithi161.stdout:5/736: dwrite d3/d1b/d36/f4d [0,4194304] 0 2024-02-22T00:33:24.767 INFO:tasks.workunit.client.1.smithi161.stdout:0/631: write d14/d37/f76 [995807,37680] 0 2024-02-22T00:33:24.771 INFO:tasks.workunit.client.1.smithi161.stdout:9/560: creat d1/d25/d73/fc1 x:0 0 0 2024-02-22T00:33:24.772 INFO:tasks.workunit.client.1.smithi161.stdout:5/737: chown d3/d1b/d25/d4c/dd2/cf9 60314471 1 2024-02-22T00:33:24.773 INFO:tasks.workunit.client.1.smithi161.stdout:0/632: write d14/d1a/d3f/d5d/fb0 [346114,11100] 0 2024-02-22T00:33:24.774 INFO:tasks.workunit.client.1.smithi161.stdout:8/559: mknod d1/d1c/d96/cb6 0 2024-02-22T00:33:24.779 INFO:tasks.workunit.client.1.smithi161.stdout:4/527: fdatasync d5/f13 0 2024-02-22T00:33:24.780 INFO:tasks.workunit.client.1.smithi161.stdout:2/595: symlink de/d2b/d8b/da2/da5/dc4/da7/lca 0 2024-02-22T00:33:24.785 INFO:tasks.workunit.client.1.smithi161.stdout:8/560: stat d1/d1c/d20/d22/d28/d7f/d92/d95/f3c 0 2024-02-22T00:33:24.786 INFO:tasks.workunit.client.1.smithi161.stdout:0/633: write d14/f4b [84296,96345] 0 2024-02-22T00:33:24.786 INFO:tasks.workunit.client.1.smithi161.stdout:6/500: dwrite d3/dc/df/d32/f4b [0,4194304] 0 2024-02-22T00:33:24.791 INFO:tasks.workunit.client.1.smithi161.stdout:4/528: creat d5/db0/fc8 x:0 0 0 2024-02-22T00:33:24.791 INFO:tasks.workunit.client.1.smithi161.stdout:0/634: readlink d14/d29/l78 0 2024-02-22T00:33:24.792 INFO:tasks.workunit.client.1.smithi161.stdout:9/561: dwrite d1/d5/f3e [0,4194304] 0 2024-02-22T00:33:24.793 INFO:tasks.workunit.client.1.smithi161.stdout:1/545: getdents d19/d1d/d56 0 2024-02-22T00:33:24.794 INFO:tasks.workunit.client.1.smithi161.stdout:2/596: creat de/d2b/d65/d3a/fcb x:0 0 0 2024-02-22T00:33:24.796 INFO:tasks.workunit.client.1.smithi161.stdout:8/561: mknod d1/d1c/d96/cb7 0 2024-02-22T00:33:24.797 INFO:tasks.workunit.client.1.smithi161.stdout:7/558: dwrite d3/dd/d59/d5b/f4e [0,4194304] 0 2024-02-22T00:33:24.798 INFO:tasks.workunit.client.1.smithi161.stdout:4/529: write d5/d8/d41/d57/dbe/d28/d63/fa6 [4018306,121536] 0 2024-02-22T00:33:24.798 INFO:tasks.workunit.client.1.smithi161.stdout:2/597: write de/d2b/f98 [798265,28162] 0 2024-02-22T00:33:24.804 INFO:tasks.workunit.client.1.smithi161.stdout:5/738: dread d3/d1b/d25/d4c/f87 [0,4194304] 0 2024-02-22T00:33:24.804 INFO:tasks.workunit.client.1.smithi161.stdout:4/530: dread d5/d8/d41/d57/dbe/d28/f8a [0,4194304] 0 2024-02-22T00:33:24.808 INFO:tasks.workunit.client.1.smithi161.stdout:1/546: write d19/d1d/d2c/d7d/f93 [886534,59748] 0 2024-02-22T00:33:24.809 INFO:tasks.workunit.client.1.smithi161.stdout:8/562: mknod d1/d1c/d96/cb8 0 2024-02-22T00:33:24.810 INFO:tasks.workunit.client.1.smithi161.stdout:8/563: read - d1/d2f/d30/fb2 zero size 2024-02-22T00:33:24.812 INFO:tasks.workunit.client.1.smithi161.stdout:8/564: readlink d1/d1c/d20/d22/d28/d7f/laf 0 2024-02-22T00:33:24.813 INFO:tasks.workunit.client.1.smithi161.stdout:6/501: write d3/d10/d12/f2d [609298,62754] 0 2024-02-22T00:33:24.816 INFO:tasks.workunit.client.1.smithi161.stdout:3/522: truncate da/dc/d5f/f6e 2897288 0 2024-02-22T00:33:24.818 INFO:tasks.workunit.client.1.smithi161.stdout:7/559: symlink d3/df/d33/d35/d55/d63/d7b/d8f/lae 0 2024-02-22T00:33:24.820 INFO:tasks.workunit.client.1.smithi161.stdout:2/598: mknod de/d2b/d8b/db8/ccc 0 2024-02-22T00:33:24.822 INFO:tasks.workunit.client.1.smithi161.stdout:8/565: rmdir d1/d2f/d37 39 2024-02-22T00:33:24.823 INFO:tasks.workunit.client.1.smithi161.stdout:9/562: dwrite d1/d2/d4/d1f/f90 [0,4194304] 0 2024-02-22T00:33:24.826 INFO:tasks.workunit.client.1.smithi161.stdout:6/502: rmdir d3 39 2024-02-22T00:33:24.827 INFO:tasks.workunit.client.1.smithi161.stdout:9/563: chown d1/d2/d4/d1f/l41 335610 1 2024-02-22T00:33:24.830 INFO:tasks.workunit.client.1.smithi161.stdout:4/531: dwrite d5/d8/f81 [0,4194304] 0 2024-02-22T00:33:24.834 INFO:tasks.workunit.client.1.smithi161.stdout:4/532: write d5/d10/d14/f5d [2405766,60983] 0 2024-02-22T00:33:24.834 INFO:tasks.workunit.client.1.smithi161.stdout:2/599: symlink de/d2b/d65/d3a/d71/lcd 0 2024-02-22T00:33:24.835 INFO:tasks.workunit.client.1.smithi161.stdout:8/566: stat d1/d2f/d30/f33 0 2024-02-22T00:33:24.835 INFO:tasks.workunit.client.1.smithi161.stdout:2/600: readlink de/l5a 0 2024-02-22T00:33:24.839 INFO:tasks.workunit.client.1.smithi161.stdout:5/739: truncate d3/d1b/d36/f52 2469132 0 2024-02-22T00:33:24.839 INFO:tasks.workunit.client.1.smithi161.stdout:2/601: write de/d2b/d8b/f97 [298722,109549] 0 2024-02-22T00:33:24.841 INFO:tasks.workunit.client.1.smithi161.stdout:1/547: truncate d19/d48/f81 1409250 0 2024-02-22T00:33:24.841 INFO:tasks.workunit.client.1.smithi161.stdout:5/740: stat d3/d9c/fdc 0 2024-02-22T00:33:24.845 INFO:tasks.workunit.client.1.smithi161.stdout:4/533: rename d5/d8/f81 to d5/d8/d41/d57/dbe/d28/d38/d6d/fc9 0 2024-02-22T00:33:24.847 INFO:tasks.workunit.client.1.smithi161.stdout:9/564: link d1/d2/d4/d11/f31 d1/d25/d73/fc2 0 2024-02-22T00:33:24.847 INFO:tasks.workunit.client.1.smithi161.stdout:8/567: dwrite d1/d1c/d75/f15 [0,4194304] 0 2024-02-22T00:33:24.850 INFO:tasks.workunit.client.1.smithi161.stdout:5/741: creat d3/d1b/d25/d4c/dd2/f101 x:0 0 0 2024-02-22T00:33:24.851 INFO:tasks.workunit.client.1.smithi161.stdout:5/742: dread - d3/d1b/d25/d84/fee zero size 2024-02-22T00:33:24.856 INFO:tasks.workunit.client.1.smithi161.stdout:7/560: dread d3/df/d43/f76 [0,4194304] 0 2024-02-22T00:33:24.858 INFO:tasks.workunit.client.1.smithi161.stdout:1/548: link d19/d51/d6c/f77 d19/d1d/d56/db2/fc1 0 2024-02-22T00:33:24.859 INFO:tasks.workunit.client.1.smithi161.stdout:5/743: dread d3/d1b/d36/f83 [0,4194304] 0 2024-02-22T00:33:24.906 INFO:tasks.workunit.client.1.smithi161.stdout:6/503: getdents d3/dc/df/d32 0 2024-02-22T00:33:24.907 INFO:tasks.workunit.client.1.smithi161.stdout:4/534: link d5/d8/d41/f46 d5/d8/d41/d57/fca 0 2024-02-22T00:33:24.907 INFO:tasks.workunit.client.1.smithi161.stdout:9/565: symlink d1/d2/lc3 0 2024-02-22T00:33:24.908 INFO:tasks.workunit.client.1.smithi161.stdout:9/566: fsync d1/d25/d73/fb6 0 2024-02-22T00:33:24.909 INFO:tasks.workunit.client.1.smithi161.stdout:3/523: truncate da/dc/d5f/f6e 2905410 0 2024-02-22T00:33:24.910 INFO:tasks.workunit.client.1.smithi161.stdout:6/504: chown d3/d10/d12/d2f/c60 308 1 2024-02-22T00:33:24.912 INFO:tasks.workunit.client.1.smithi161.stdout:2/602: dread de/d2b/d83/f87 [4194304,4194304] 0 2024-02-22T00:33:24.912 INFO:tasks.workunit.client.1.smithi161.stdout:4/535: mknod d5/d8/d41/d53/d6c/ccb 0 2024-02-22T00:33:24.913 INFO:tasks.workunit.client.1.smithi161.stdout:4/536: stat d5/d8/d41/d57/l58 0 2024-02-22T00:33:24.915 INFO:tasks.workunit.client.1.smithi161.stdout:9/567: write d1/d25/d73/d98/db4/f32 [4008977,105872] 0 2024-02-22T00:33:24.915 INFO:tasks.workunit.client.1.smithi161.stdout:4/537: write d5/d8/d41/d57/dbe/d28/fbd [671412,38269] 0 2024-02-22T00:33:24.915 INFO:tasks.workunit.client.1.smithi161.stdout:1/549: getdents d19/d48/d68/da8 0 2024-02-22T00:33:24.916 INFO:tasks.workunit.client.1.smithi161.stdout:1/550: readlink le 0 2024-02-22T00:33:24.917 INFO:tasks.workunit.client.1.smithi161.stdout:1/551: fsync d19/d1d/d2c/d2d/d3f/fae 0 2024-02-22T00:33:24.919 INFO:tasks.workunit.client.1.smithi161.stdout:1/552: fsync d19/d1d/fbf 0 2024-02-22T00:33:24.919 INFO:tasks.workunit.client.1.smithi161.stdout:1/553: stat d19/d1d/d2c/d2d/fa6 0 2024-02-22T00:33:24.919 INFO:tasks.workunit.client.1.smithi161.stdout:6/505: rename d3/d10/d12/d3a/c98 to d3/d10/d1b/d5e/d87/c9f 0 2024-02-22T00:33:24.922 INFO:tasks.workunit.client.1.smithi161.stdout:7/561: write d3/dd/d59/f7c [2085418,65131] 0 2024-02-22T00:33:24.922 INFO:tasks.workunit.client.1.smithi161.stdout:4/538: symlink d5/d8/d41/d57/dbe/d28/d63/d65/d9d/lcc 0 2024-02-22T00:33:24.924 INFO:tasks.workunit.client.1.smithi161.stdout:7/562: write d3/df/d33/d35/d55/d63/f66 [4243037,112447] 0 2024-02-22T00:33:24.925 INFO:tasks.workunit.client.1.smithi161.stdout:1/554: creat d19/d1d/d2c/d2d/db7/fc2 x:0 0 0 2024-02-22T00:33:24.928 INFO:tasks.workunit.client.1.smithi161.stdout:3/524: truncate da/dc/d11/d26/f52 475358 0 2024-02-22T00:33:24.929 INFO:tasks.workunit.client.1.smithi161.stdout:2/603: dread de/f53 [0,4194304] 0 2024-02-22T00:33:24.930 INFO:tasks.workunit.client.1.smithi161.stdout:7/563: write d3/df/d33/d35/d55/d63/d7b/d30/f3b [2355143,41032] 0 2024-02-22T00:33:24.931 INFO:tasks.workunit.client.1.smithi161.stdout:6/506: link d3/dc/df/d32/l81 d3/dc/la0 0 2024-02-22T00:33:24.933 INFO:tasks.workunit.client.1.smithi161.stdout:2/604: chown de/d11/d32/fa8 13 1 2024-02-22T00:33:24.933 INFO:tasks.workunit.client.1.smithi161.stdout:3/525: mkdir da/dc/d5f/dae 0 2024-02-22T00:33:24.934 INFO:tasks.workunit.client.1.smithi161.stdout:1/555: dread d19/d1d/d2c/d2d/d3f/f67 [0,4194304] 0 2024-02-22T00:33:24.935 INFO:tasks.workunit.client.1.smithi161.stdout:4/539: dwrite d5/d8/d41/d57/dbe/d28/d63/f98 [0,4194304] 0 2024-02-22T00:33:24.935 INFO:tasks.workunit.client.1.smithi161.stdout:7/564: rename d3/f72 to d3/df/d43/faf 0 2024-02-22T00:33:24.937 INFO:tasks.workunit.client.1.smithi161.stdout:6/507: creat d3/d10/d12/d3a/fa1 x:0 0 0 2024-02-22T00:33:24.937 INFO:tasks.workunit.client.1.smithi161.stdout:3/526: rmdir da/d29/d53 39 2024-02-22T00:33:24.937 INFO:tasks.workunit.client.1.smithi161.stdout:1/556: stat d19/d1d/d2c/d2d/d3f/d69/f70 0 2024-02-22T00:33:24.937 INFO:tasks.workunit.client.1.smithi161.stdout:4/540: write d5/d17/f92 [4659999,20256] 0 2024-02-22T00:33:24.941 INFO:tasks.workunit.client.1.smithi161.stdout:6/508: truncate d3/dc/df/d32/f93 152460 0 2024-02-22T00:33:24.941 INFO:tasks.workunit.client.1.smithi161.stdout:3/527: write da/dc/f9b [29526,42392] 0 2024-02-22T00:33:24.942 INFO:tasks.workunit.client.1.smithi161.stdout:7/565: rmdir d3/dd/d60 39 2024-02-22T00:33:24.942 INFO:tasks.workunit.client.1.smithi161.stdout:6/509: dread - d3/d10/d1b/d5e/d87/f88 zero size 2024-02-22T00:33:24.944 INFO:tasks.workunit.client.1.smithi161.stdout:7/566: write d3/df/d33/d35/d55/fa8 [54269,103810] 0 2024-02-22T00:33:24.947 INFO:tasks.workunit.client.1.smithi161.stdout:1/557: symlink d19/d1d/d2c/d2d/d3f/d69/lc3 0 2024-02-22T00:33:24.947 INFO:tasks.workunit.client.1.smithi161.stdout:7/567: write d3/df/d43/f65 [2924200,3621] 0 2024-02-22T00:33:24.947 INFO:tasks.workunit.client.1.smithi161.stdout:4/541: mkdir d5/d8/d41/d57/dbe/d28/d63/d65/dcd 0 2024-02-22T00:33:24.950 INFO:tasks.workunit.client.1.smithi161.stdout:2/605: link de/d2b/d65/d3a/d71/c89 de/d2b/d65/d3a/d9d/cce 0 2024-02-22T00:33:24.950 INFO:tasks.workunit.client.1.smithi161.stdout:3/528: write da/dc/d11/d26/f45 [5362675,122766] 0 2024-02-22T00:33:24.954 INFO:tasks.workunit.client.1.smithi161.stdout:7/568: unlink d3/df/d33/d35/d55/f79 0 2024-02-22T00:33:24.954 INFO:tasks.workunit.client.1.smithi161.stdout:1/558: write d19/d1d/d2c/d2d/db7/fc2 [348310,39878] 0 2024-02-22T00:33:24.956 INFO:tasks.workunit.client.1.smithi161.stdout:6/510: dwrite d3/d10/d1b/d5e/f7a [0,4194304] 0 2024-02-22T00:33:24.962 INFO:tasks.workunit.client.1.smithi161.stdout:2/606: rename de/d11/d5c/fa6 to de/d2b/d8b/da2/da5/fcf 0 2024-02-22T00:33:24.963 INFO:tasks.workunit.client.1.smithi161.stdout:7/569: write d3/df/d33/d35/fa4 [840076,115233] 0 2024-02-22T00:33:24.964 INFO:tasks.workunit.client.1.smithi161.stdout:3/529: dwrite da/f27 [0,4194304] 0 2024-02-22T00:33:24.965 INFO:tasks.workunit.client.1.smithi161.stdout:6/511: creat d3/d10/d72/fa2 x:0 0 0 2024-02-22T00:33:24.967 INFO:tasks.workunit.client.1.smithi161.stdout:2/607: read de/d2b/d65/d60/d68/fa3 [349257,125233] 0 2024-02-22T00:33:24.969 INFO:tasks.workunit.client.1.smithi161.stdout:3/530: chown da/dc/d5f/d66 0 1 2024-02-22T00:33:24.969 INFO:tasks.workunit.client.1.smithi161.stdout:4/542: truncate d5/d8/d41/d57/f60 186626 0 2024-02-22T00:33:24.971 INFO:tasks.workunit.client.1.smithi161.stdout:4/543: readlink d5/d17/l56 0 2024-02-22T00:33:24.972 INFO:tasks.workunit.client.1.smithi161.stdout:6/512: mknod d3/dc/df/d32/ca3 0 2024-02-22T00:33:24.973 INFO:tasks.workunit.client.1.smithi161.stdout:7/570: creat d3/df/d33/d35/d80/fb0 x:0 0 0 2024-02-22T00:33:24.973 INFO:tasks.workunit.client.1.smithi161.stdout:1/559: dwrite d19/d1d/d2c/d7d/da2/fbe [0,4194304] 0 2024-02-22T00:33:24.973 INFO:tasks.workunit.client.1.smithi161.stdout:3/531: fdatasync da/dc/d11/d40/f97 0 2024-02-22T00:33:24.974 INFO:tasks.workunit.client.1.smithi161.stdout:2/608: write de/d2b/d65/d3a/d71/fa1 [234395,18998] 0 2024-02-22T00:33:24.974 INFO:tasks.workunit.client.1.smithi161.stdout:6/513: fsync d3/d10/f26 0 2024-02-22T00:33:24.976 INFO:tasks.workunit.client.1.smithi161.stdout:0/635: sync 2024-02-22T00:33:24.976 INFO:tasks.workunit.client.1.smithi161.stdout:7/571: stat d3/df/d33/d74/f8e 0 2024-02-22T00:33:24.976 INFO:tasks.workunit.client.1.smithi161.stdout:4/544: write d5/d10/f1f [3786091,62502] 0 2024-02-22T00:33:24.977 INFO:tasks.workunit.client.1.smithi161.stdout:6/514: mknod d3/d10/d1b/ca4 0 2024-02-22T00:33:24.980 INFO:tasks.workunit.client.1.smithi161.stdout:3/532: symlink da/dc/laf 0 2024-02-22T00:33:24.980 INFO:tasks.workunit.client.1.smithi161.stdout:1/560: truncate d19/d1d/d2c/d7d/da2/f54 4768013 0 2024-02-22T00:33:24.981 INFO:tasks.workunit.client.1.smithi161.stdout:2/609: chown de/d2b/d8b/da2/da5/dc4/d8f/f91 441355559 1 2024-02-22T00:33:24.981 INFO:tasks.workunit.client.1.smithi161.stdout:0/636: mknod d14/d1a/d3f/d96/dbc/cd1 0 2024-02-22T00:33:24.986 INFO:tasks.workunit.client.1.smithi161.stdout:6/515: rename d3/d48 to d3/d10/d1b/da5 0 2024-02-22T00:33:24.987 INFO:tasks.workunit.client.1.smithi161.stdout:4/545: dwrite d5/d10/d14/f7a [0,4194304] 0 2024-02-22T00:33:24.988 INFO:tasks.workunit.client.1.smithi161.stdout:6/516: dread - d3/d10/d12/d2f/d7d/d5f/f99 zero size 2024-02-22T00:33:24.989 INFO:tasks.workunit.client.1.smithi161.stdout:1/561: unlink d19/d1d/d2c/f44 0 2024-02-22T00:33:24.994 INFO:tasks.workunit.client.1.smithi161.stdout:3/533: fdatasync da/f1a 0 2024-02-22T00:33:24.997 INFO:tasks.workunit.client.1.smithi161.stdout:7/572: mknod d3/df/d33/d35/d55/d63/d7b/d30/d44/cb1 0 2024-02-22T00:33:24.998 INFO:tasks.workunit.client.1.smithi161.stdout:4/546: creat d5/d8/d41/d53/d6c/d72/fce x:0 0 0 2024-02-22T00:33:24.999 INFO:tasks.workunit.client.1.smithi161.stdout:3/534: dread - da/d29/d8e/d37/d39/f65 zero size 2024-02-22T00:33:24.999 INFO:tasks.workunit.client.1.smithi161.stdout:6/517: mkdir d3/d7c/da6 0 2024-02-22T00:33:25.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/562: dwrite d19/d51/d64/d9b/fb3 [0,4194304] 0 2024-02-22T00:33:25.003 INFO:tasks.workunit.client.1.smithi161.stdout:2/610: creat de/d2b/fd0 x:0 0 0 2024-02-22T00:33:25.004 INFO:tasks.workunit.client.1.smithi161.stdout:3/535: read - da/dc/d5f/f96 zero size 2024-02-22T00:33:25.004 INFO:tasks.workunit.client.1.smithi161.stdout:0/637: dwrite d14/d44/f85 [0,4194304] 0 2024-02-22T00:33:25.006 INFO:tasks.workunit.client.1.smithi161.stdout:0/638: stat d14/d37/d42/l47 0 2024-02-22T00:33:25.006 INFO:tasks.workunit.client.1.smithi161.stdout:2/611: write de/d11/d14/f18 [3121621,50942] 0 2024-02-22T00:33:25.010 INFO:tasks.workunit.client.1.smithi161.stdout:6/518: symlink d3/d10/d72/la7 0 2024-02-22T00:33:25.010 INFO:tasks.workunit.client.1.smithi161.stdout:2/612: chown de/d2b/d65/d60/d68/f6c 6410 1 2024-02-22T00:33:25.011 INFO:tasks.workunit.client.1.smithi161.stdout:6/519: truncate d3/d30/f5b 336302 0 2024-02-22T00:33:25.012 INFO:tasks.workunit.client.1.smithi161.stdout:4/547: rename d5/d8/c30 to d5/d8/d41/d53/ccf 0 2024-02-22T00:33:25.015 INFO:tasks.workunit.client.1.smithi161.stdout:3/536: unlink da/dc/d5f/d66/c7a 0 2024-02-22T00:33:25.020 INFO:tasks.workunit.client.1.smithi161.stdout:7/573: link d3/df/d33/f45 d3/df/d43/fb2 0 2024-02-22T00:33:25.021 INFO:tasks.workunit.client.1.smithi161.stdout:4/548: creat d5/d10/da9/fd0 x:0 0 0 2024-02-22T00:33:25.022 INFO:tasks.workunit.client.1.smithi161.stdout:0/639: rename c4 to d14/d1a/cd2 0 2024-02-22T00:33:25.022 INFO:tasks.workunit.client.1.smithi161.stdout:2/613: write de/f53 [1652686,55707] 0 2024-02-22T00:33:25.028 INFO:tasks.workunit.client.1.smithi161.stdout:0/640: dwrite d14/d1a/f60 [0,4194304] 0 2024-02-22T00:33:25.032 INFO:tasks.workunit.client.1.smithi161.stdout:7/574: creat d3/df/d43/fb3 x:0 0 0 2024-02-22T00:33:25.032 INFO:tasks.workunit.client.1.smithi161.stdout:2/614: mknod de/d2b/d83/cd1 0 2024-02-22T00:33:25.032 INFO:tasks.workunit.client.1.smithi161.stdout:3/537: creat da/d29/d8e/d37/d39/fb0 x:0 0 0 2024-02-22T00:33:25.033 INFO:tasks.workunit.client.1.smithi161.stdout:4/549: creat d5/d8/d41/d57/dbe/d28/d63/d6b/fd1 x:0 0 0 2024-02-22T00:33:25.034 INFO:tasks.workunit.client.1.smithi161.stdout:2/615: write de/d2b/fd0 [279767,127088] 0 2024-02-22T00:33:25.035 INFO:tasks.workunit.client.1.smithi161.stdout:3/538: truncate da/f46 522557 0 2024-02-22T00:33:25.035 INFO:tasks.workunit.client.1.smithi161.stdout:1/563: getdents d19/d1d/d2c/d4f/d84 0 2024-02-22T00:33:25.037 INFO:tasks.workunit.client.1.smithi161.stdout:0/641: mknod d14/d37/d42/d8e/cd3 0 2024-02-22T00:33:25.041 INFO:tasks.workunit.client.1.smithi161.stdout:4/550: symlink d5/d8/d41/d57/dbe/d28/d63/d65/ld2 0 2024-02-22T00:33:25.042 INFO:tasks.workunit.client.1.smithi161.stdout:2/616: dwrite de/d2b/f98 [0,4194304] 0 2024-02-22T00:33:25.044 INFO:tasks.workunit.client.1.smithi161.stdout:0/642: readlink d14/d44/l50 0 2024-02-22T00:33:25.046 INFO:tasks.workunit.client.1.smithi161.stdout:7/575: rename d3/df/d33/d35/d55/d63/d7b/d50/d62/l7a to d3/df/d33/d35/d55/d63/lb4 0 2024-02-22T00:33:25.047 INFO:tasks.workunit.client.1.smithi161.stdout:3/539: truncate da/dc/d5f/f6e 2866800 0 2024-02-22T00:33:25.048 INFO:tasks.workunit.client.1.smithi161.stdout:4/551: write d5/d10/f1d [2791281,116771] 0 2024-02-22T00:33:25.049 INFO:tasks.workunit.client.1.smithi161.stdout:7/576: readlink d3/df/d33/d35/d55/d63/d7b/d8f/lae 0 2024-02-22T00:33:25.050 INFO:tasks.workunit.client.1.smithi161.stdout:0/643: fdatasync d14/d1a/f38 0 2024-02-22T00:33:25.051 INFO:tasks.workunit.client.1.smithi161.stdout:1/564: rename d19/d1d/d2c/d2d/d3f/l7e to d19/d48/d68/da8/lc4 0 2024-02-22T00:33:25.052 INFO:tasks.workunit.client.1.smithi161.stdout:3/540: symlink da/d56/lb1 0 2024-02-22T00:33:25.053 INFO:tasks.workunit.client.1.smithi161.stdout:4/552: creat d5/d17/fd3 x:0 0 0 2024-02-22T00:33:25.054 INFO:tasks.workunit.client.1.smithi161.stdout:7/577: creat d3/dd/d59/d5b/fb5 x:0 0 0 2024-02-22T00:33:25.055 INFO:tasks.workunit.client.1.smithi161.stdout:4/553: read - d5/d8/d41/d57/dbe/d28/d63/d65/fc7 zero size 2024-02-22T00:33:25.056 INFO:tasks.workunit.client.1.smithi161.stdout:0/644: mkdir d14/d29/dd4 0 2024-02-22T00:33:25.057 INFO:tasks.workunit.client.1.smithi161.stdout:2/617: rename de/d11/d32/fac to de/d2b/d83/dc9/fd2 0 2024-02-22T00:33:25.062 INFO:tasks.workunit.client.1.smithi161.stdout:6/520: truncate d3/d10/f65 370756 0 2024-02-22T00:33:25.064 INFO:tasks.workunit.client.1.smithi161.stdout:6/521: write d3/d10/d12/d2f/d7d/d5f/f99 [107472,59604] 0 2024-02-22T00:33:25.068 INFO:tasks.workunit.client.1.smithi161.stdout:1/565: creat d19/d51/d64/d9b/da5/dbc/fc5 x:0 0 0 2024-02-22T00:33:25.069 INFO:tasks.workunit.client.1.smithi161.stdout:3/541: dread da/f8a [0,4194304] 0 2024-02-22T00:33:25.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/578: unlink d3/df/l34 0 2024-02-22T00:33:25.072 INFO:tasks.workunit.client.1.smithi161.stdout:4/554: dread d5/d8/d41/d57/dbe/d28/d38/f85 [0,4194304] 0 2024-02-22T00:33:25.073 INFO:tasks.workunit.client.1.smithi161.stdout:0/645: getdents d14/d44/dbe 0 2024-02-22T00:33:25.075 INFO:tasks.workunit.client.1.smithi161.stdout:1/566: write d19/d1d/d2c/d7d/f93 [491307,76793] 0 2024-02-22T00:33:25.076 INFO:tasks.workunit.client.1.smithi161.stdout:3/542: creat da/d29/d8e/d37/fb2 x:0 0 0 2024-02-22T00:33:25.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/579: stat d3/df/d33/d35/la3 0 2024-02-22T00:33:25.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/580: truncate d3/f9 4954048 0 2024-02-22T00:33:25.078 INFO:tasks.workunit.client.1.smithi161.stdout:6/522: rename d3/d10/d1b/da5/l6f to d3/d10/d1b/la8 0 2024-02-22T00:33:25.078 INFO:tasks.workunit.client.1.smithi161.stdout:6/523: chown d3/d10/f26 66049496 1 2024-02-22T00:33:25.081 INFO:tasks.workunit.client.1.smithi161.stdout:4/555: creat d5/d8/d41/d57/dbe/d28/fd4 x:0 0 0 2024-02-22T00:33:25.086 INFO:tasks.workunit.client.1.smithi161.stdout:3/543: creat da/fb3 x:0 0 0 2024-02-22T00:33:25.086 INFO:tasks.workunit.client.1.smithi161.stdout:4/556: dread d5/d8/d41/d57/dbe/d28/d38/d6d/fc9 [0,4194304] 0 2024-02-22T00:33:25.087 INFO:tasks.workunit.client.1.smithi161.stdout:4/557: dread - d5/d17/fd3 zero size 2024-02-22T00:33:25.087 INFO:tasks.workunit.client.1.smithi161.stdout:3/544: dread - da/d29/f7f zero size 2024-02-22T00:33:25.087 INFO:tasks.workunit.client.1.smithi161.stdout:6/524: creat d3/d10/d12/d2f/d7d/d82/fa9 x:0 0 0 2024-02-22T00:33:25.088 INFO:tasks.workunit.client.1.smithi161.stdout:6/525: write d3/dc/df/d32/f93 [1039879,127614] 0 2024-02-22T00:33:25.089 INFO:tasks.workunit.client.1.smithi161.stdout:0/646: creat d14/d1a/d3f/d9a/fd5 x:0 0 0 2024-02-22T00:33:25.091 INFO:tasks.workunit.client.1.smithi161.stdout:2/618: link de/d2b/d8b/lb3 de/d2b/d65/ld3 0 2024-02-22T00:33:25.096 INFO:tasks.workunit.client.1.smithi161.stdout:3/545: dwrite da/d29/d8e/f7c [0,4194304] 0 2024-02-22T00:33:25.097 INFO:tasks.workunit.client.1.smithi161.stdout:1/567: write d19/d48/d68/f6f [11016,26795] 0 2024-02-22T00:33:25.101 INFO:tasks.workunit.client.1.smithi161.stdout:4/558: getdents d5 0 2024-02-22T00:33:25.102 INFO:tasks.workunit.client.1.smithi161.stdout:2/619: dread de/d2b/d8b/da2/da5/dc4/d8f/f6b [0,4194304] 0 2024-02-22T00:33:25.103 INFO:tasks.workunit.client.1.smithi161.stdout:6/526: dwrite d3/d10/d1b/da5/f5c [4194304,4194304] 0 2024-02-22T00:33:25.104 INFO:tasks.workunit.client.1.smithi161.stdout:3/546: rmdir da/dc/d5f/dae 0 2024-02-22T00:33:25.105 INFO:tasks.workunit.client.1.smithi161.stdout:4/559: write d5/d10/f4d [2497564,42714] 0 2024-02-22T00:33:25.107 INFO:tasks.workunit.client.1.smithi161.stdout:3/547: readlink da/d56/l5d 0 2024-02-22T00:33:25.108 INFO:tasks.workunit.client.1.smithi161.stdout:6/527: symlink d3/d10/d72/laa 0 2024-02-22T00:33:25.110 INFO:tasks.workunit.client.1.smithi161.stdout:6/528: readlink d3/d10/d1b/l51 0 2024-02-22T00:33:25.110 INFO:tasks.workunit.client.1.smithi161.stdout:1/568: dwrite d19/d48/fb0 [0,4194304] 0 2024-02-22T00:33:25.113 INFO:tasks.workunit.client.1.smithi161.stdout:6/529: chown d3/d10/d1b/da5/f6b 3993310 1 2024-02-22T00:33:25.117 INFO:tasks.workunit.client.1.smithi161.stdout:3/548: creat da/dc/d11/d40/d59/d93/daa/fb4 x:0 0 0 2024-02-22T00:33:25.117 INFO:tasks.workunit.client.1.smithi161.stdout:6/530: fdatasync d3/d10/d72/fa2 0 2024-02-22T00:33:25.118 INFO:tasks.workunit.client.1.smithi161.stdout:1/569: rmdir d19/d51/d6c 39 2024-02-22T00:33:25.119 INFO:tasks.workunit.client.1.smithi161.stdout:2/620: link de/l5a de/d2b/d83/d4f/dc5/ld4 0 2024-02-22T00:33:25.121 INFO:tasks.workunit.client.1.smithi161.stdout:1/570: mkdir d19/d85/d87/dc6 0 2024-02-22T00:33:25.121 INFO:tasks.workunit.client.1.smithi161.stdout:2/621: creat de/d11/d32/fd5 x:0 0 0 2024-02-22T00:33:25.124 INFO:tasks.workunit.client.1.smithi161.stdout:6/531: getdents d3/d30 0 2024-02-22T00:33:25.125 INFO:tasks.workunit.client.1.smithi161.stdout:1/571: creat d19/d51/fc7 x:0 0 0 2024-02-22T00:33:25.126 INFO:tasks.workunit.client.1.smithi161.stdout:2/622: mkdir de/d2b/d65/dd6 0 2024-02-22T00:33:25.127 INFO:tasks.workunit.client.1.smithi161.stdout:1/572: fsync d19/d51/d64/d9b/fb3 0 2024-02-22T00:33:25.128 INFO:tasks.workunit.client.1.smithi161.stdout:1/573: write d19/d1d/d2c/d2d/f63 [1187400,91411] 0 2024-02-22T00:33:25.134 INFO:tasks.workunit.client.1.smithi161.stdout:1/574: dwrite d19/d48/d68/f6f [0,4194304] 0 2024-02-22T00:33:25.135 INFO:tasks.workunit.client.1.smithi161.stdout:2/623: readlink de/d2b/d65/d3a/lc0 0 2024-02-22T00:33:25.137 INFO:tasks.workunit.client.1.smithi161.stdout:2/624: write de/d2b/d83/f8e [1680607,128435] 0 2024-02-22T00:33:25.143 INFO:tasks.workunit.client.1.smithi161.stdout:1/575: dwrite d19/d48/faf [0,4194304] 0 2024-02-22T00:33:25.143 INFO:tasks.workunit.client.1.smithi161.stdout:2/625: getdents de/d2b/d8b 0 2024-02-22T00:33:25.146 INFO:tasks.workunit.client.1.smithi161.stdout:2/626: unlink de/d11/d32/c9e 0 2024-02-22T00:33:25.153 INFO:tasks.workunit.client.1.smithi161.stdout:1/576: dread f1 [0,4194304] 0 2024-02-22T00:33:25.155 INFO:tasks.workunit.client.1.smithi161.stdout:2/627: dwrite de/d11/d32/f82 [0,4194304] 0 2024-02-22T00:33:25.157 INFO:tasks.workunit.client.1.smithi161.stdout:2/628: chown de/d2b/d65/d60/d68/c7b 335577936 1 2024-02-22T00:33:25.163 INFO:tasks.workunit.client.1.smithi161.stdout:1/577: dwrite d19/d1d/d2c/d4f/d98/fb8 [0,4194304] 0 2024-02-22T00:33:25.164 INFO:tasks.workunit.client.1.smithi161.stdout:2/629: creat de/d2b/d8b/da2/da5/dc4/d8f/fd7 x:0 0 0 2024-02-22T00:33:25.166 INFO:tasks.workunit.client.1.smithi161.stdout:2/630: chown de/d11/d14/fbb 1 1 2024-02-22T00:33:25.169 INFO:tasks.workunit.client.1.smithi161.stdout:1/578: creat d19/d1d/d56/db2/fc8 x:0 0 0 2024-02-22T00:33:25.173 INFO:tasks.workunit.client.1.smithi161.stdout:1/579: creat d19/d1d/d2c/d4f/d84/fc9 x:0 0 0 2024-02-22T00:33:25.174 INFO:tasks.workunit.client.1.smithi161.stdout:8/568: sync 2024-02-22T00:33:25.174 INFO:tasks.workunit.client.1.smithi161.stdout:5/744: sync 2024-02-22T00:33:25.176 INFO:tasks.workunit.client.1.smithi161.stdout:2/631: rename de/d2b/d8b/lb3 to de/d2b/d65/d60/ld8 0 2024-02-22T00:33:25.178 INFO:tasks.workunit.client.1.smithi161.stdout:1/580: symlink d19/d1d/d2c/d4f/d84/lca 0 2024-02-22T00:33:25.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:23.757543+0000 mgr.smithi161.sazlam (mgr.24369) 29 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 1001 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 24 MiB/s rd, 115 MiB/s wr, 337 op/s 2024-02-22T00:33:25.183 INFO:tasks.workunit.client.1.smithi161.stdout:2/632: write de/f1c [4195704,46849] 0 2024-02-22T00:33:25.186 INFO:tasks.workunit.client.1.smithi161.stdout:5/745: getdents d3/d1b/d25/dcc/ddb 0 2024-02-22T00:33:25.191 INFO:tasks.workunit.client.1.smithi161.stdout:1/581: dwrite f7 [0,4194304] 0 2024-02-22T00:33:25.191 INFO:tasks.workunit.client.1.smithi161.stdout:5/746: mkdir d3/dac/d102 0 2024-02-22T00:33:25.199 INFO:tasks.workunit.client.1.smithi161.stdout:8/569: dwrite d1/d1c/d20/d22/d28/d7f/d92/d95/f57 [0,4194304] 0 2024-02-22T00:33:25.203 INFO:tasks.workunit.client.1.smithi161.stdout:3/549: truncate da/dc/f31 1830571 0 2024-02-22T00:33:25.206 INFO:tasks.workunit.client.1.smithi161.stdout:2/633: fsync de/d2b/d8b/da2/da5/dc4/d8f/fd7 0 2024-02-22T00:33:25.212 INFO:tasks.workunit.client.1.smithi161.stdout:0/647: dwrite d14/f35 [0,4194304] 0 2024-02-22T00:33:25.212 INFO:tasks.workunit.client.1.smithi161.stdout:0/648: fsync d14/f82 0 2024-02-22T00:33:25.212 INFO:tasks.workunit.client.1.smithi161.stdout:4/560: dwrite d5/f7 [0,4194304] 0 2024-02-22T00:33:25.214 INFO:tasks.workunit.client.1.smithi161.stdout:1/582: rename d19/d51/d6c/l8b to d19/d48/d68/da8/lcb 0 2024-02-22T00:33:25.217 INFO:tasks.workunit.client.1.smithi161.stdout:3/550: dread da/dc/f51 [0,4194304] 0 2024-02-22T00:33:25.217 INFO:tasks.workunit.client.1.smithi161.stdout:2/634: creat de/d2b/d83/d4f/fd9 x:0 0 0 2024-02-22T00:33:25.217 INFO:tasks.workunit.client.1.smithi161.stdout:0/649: dread d14/f9e [0,4194304] 0 2024-02-22T00:33:25.218 INFO:tasks.workunit.client.1.smithi161.stdout:8/570: read - d1/d2f/d37/d64/d7b/f9d zero size 2024-02-22T00:33:25.222 INFO:tasks.workunit.client.1.smithi161.stdout:6/532: dread d3/d10/d1b/f46 [0,4194304] 0 2024-02-22T00:33:25.224 INFO:tasks.workunit.client.1.smithi161.stdout:3/551: mkdir da/dc/d91/db5 0 2024-02-22T00:33:25.224 INFO:tasks.workunit.client.1.smithi161.stdout:0/650: dread - d14/d1a/d3f/d96/fae zero size 2024-02-22T00:33:25.226 INFO:tasks.workunit.client.1.smithi161.stdout:6/533: chown d3/dc/df/c73 14410139 1 2024-02-22T00:33:25.227 INFO:tasks.workunit.client.1.smithi161.stdout:2/635: mknod de/d2b/d65/d3a/cda 0 2024-02-22T00:33:25.227 INFO:tasks.workunit.client.1.smithi161.stdout:6/534: stat d3/d10/d1b/d5e/d87/c92 0 2024-02-22T00:33:25.230 INFO:tasks.workunit.client.1.smithi161.stdout:3/552: creat da/dc/d11/d26/d80/fb6 x:0 0 0 2024-02-22T00:33:25.233 INFO:tasks.workunit.client.1.smithi161.stdout:5/747: dread d3/d1b/d36/f52 [0,4194304] 0 2024-02-22T00:33:25.233 INFO:tasks.workunit.client.1.smithi161.stdout:0/651: rename d14/f16 to d14/d37/d42/d8e/d92/fd6 0 2024-02-22T00:33:25.233 INFO:tasks.workunit.client.1.smithi161.stdout:9/568: sync 2024-02-22T00:33:25.233 INFO:tasks.workunit.client.1.smithi161.stdout:7/581: sync 2024-02-22T00:33:25.234 INFO:tasks.workunit.client.1.smithi161.stdout:1/583: getdents d19/d51/d64 0 2024-02-22T00:33:25.234 INFO:tasks.workunit.client.1.smithi161.stdout:4/561: write d5/d8/d41/d57/dbe/d28/f7c [2715127,34498] 0 2024-02-22T00:33:25.240 INFO:tasks.workunit.client.1.smithi161.stdout:5/748: symlink d3/d29/l103 0 2024-02-22T00:33:25.240 INFO:tasks.workunit.client.1.smithi161.stdout:5/749: chown d3/d1c/d67/lb7 15421 1 2024-02-22T00:33:25.242 INFO:tasks.workunit.client.1.smithi161.stdout:6/535: unlink d3/dc/l40 0 2024-02-22T00:33:25.243 INFO:tasks.workunit.client.1.smithi161.stdout:8/571: link d1/d1c/d20/d22/d3f/f63 d1/d2f/d37/d64/fb9 0 2024-02-22T00:33:25.244 INFO:tasks.workunit.client.1.smithi161.stdout:8/572: write d1/d1c/d75/d18/f8a [3702093,50348] 0 2024-02-22T00:33:25.244 INFO:tasks.workunit.client.1.smithi161.stdout:8/573: readlink d1/d1c/d20/d22/d3f/l5b 0 2024-02-22T00:33:25.250 INFO:tasks.workunit.client.1.smithi161.stdout:4/562: dwrite d5/d8/d41/d57/dbe/d28/d38/d6d/fc9 [0,4194304] 0 2024-02-22T00:33:25.250 INFO:tasks.workunit.client.1.smithi161.stdout:3/553: write da/f1a [1536087,54871] 0 2024-02-22T00:33:25.251 INFO:tasks.workunit.client.1.smithi161.stdout:3/554: chown c4 1648453 1 2024-02-22T00:33:25.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:23.757543+0000 mgr.smithi161.sazlam (mgr.24369) 29 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 1001 MiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 24 MiB/s rd, 115 MiB/s wr, 337 op/s 2024-02-22T00:33:25.315 INFO:tasks.workunit.client.1.smithi161.stdout:3/555: chown c6 0 1 2024-02-22T00:33:25.315 INFO:tasks.workunit.client.1.smithi161.stdout:7/582: mknod d3/df/d33/d35/d55/d63/d7b/d30/cb6 0 2024-02-22T00:33:25.316 INFO:tasks.workunit.client.1.smithi161.stdout:1/584: link d19/d48/faf d19/d51/d64/d9b/da5/fcc 0 2024-02-22T00:33:25.317 INFO:tasks.workunit.client.1.smithi161.stdout:2/636: rename de/d11/f59 to de/d2b/d65/fdb 0 2024-02-22T00:33:25.317 INFO:tasks.workunit.client.1.smithi161.stdout:8/574: dread - d1/d2f/d37/d64/d7b/d7e/f80 zero size 2024-02-22T00:33:25.317 INFO:tasks.workunit.client.1.smithi161.stdout:4/563: rmdir d5/d8/d41/d57/dbe/d28/d38 39 2024-02-22T00:33:25.317 INFO:tasks.workunit.client.1.smithi161.stdout:5/750: write d3/d1c/d67/fcf [7419,88823] 0 2024-02-22T00:33:25.317 INFO:tasks.workunit.client.1.smithi161.stdout:0/652: link d14/d37/f89 d14/d1a/d9d/fd7 0 2024-02-22T00:33:25.319 INFO:tasks.workunit.client.1.smithi161.stdout:7/583: write d3/f7d [981884,98543] 0 2024-02-22T00:33:25.320 INFO:tasks.workunit.client.1.smithi161.stdout:3/556: write da/d29/f7f [23851,27977] 0 2024-02-22T00:33:25.321 INFO:tasks.workunit.client.1.smithi161.stdout:5/751: fdatasync d3/d1b/d25/d4c/f63 0 2024-02-22T00:33:25.322 INFO:tasks.workunit.client.1.smithi161.stdout:9/569: rename d1/d25/d73/d98/db4 to d1/d25/dc4 0 2024-02-22T00:33:25.322 INFO:tasks.workunit.client.1.smithi161.stdout:2/637: mkdir de/d2b/d8b/ddc 0 2024-02-22T00:33:25.324 INFO:tasks.workunit.client.1.smithi161.stdout:1/585: unlink d19/d1d/d2c/d7d/da2/f41 0 2024-02-22T00:33:25.324 INFO:tasks.workunit.client.1.smithi161.stdout:3/557: dread - da/d29/d8e/d37/d39/fb0 zero size 2024-02-22T00:33:25.324 INFO:tasks.workunit.client.1.smithi161.stdout:2/638: chown de/d2b/d83/dc9 562 1 2024-02-22T00:33:25.325 INFO:tasks.workunit.client.1.smithi161.stdout:9/570: write d1/d25/d73/d60/f61 [800346,124564] 0 2024-02-22T00:33:25.327 INFO:tasks.workunit.client.1.smithi161.stdout:1/586: fsync d19/d1d/d56/db2/fc8 0 2024-02-22T00:33:25.327 INFO:tasks.workunit.client.1.smithi161.stdout:8/575: chown d1/d1c/d20/d22/d3f/f63 467 1 2024-02-22T00:33:25.328 INFO:tasks.workunit.client.1.smithi161.stdout:1/587: readlink le 0 2024-02-22T00:33:25.328 INFO:tasks.workunit.client.1.smithi161.stdout:5/752: truncate d3/d1b/d36/dc1/fef 277280 0 2024-02-22T00:33:25.331 INFO:tasks.workunit.client.1.smithi161.stdout:0/653: unlink d14/d1a/d3f/d96/dad/cbd 0 2024-02-22T00:33:25.331 INFO:tasks.workunit.client.1.smithi161.stdout:3/558: dread da/dc/f51 [0,4194304] 0 2024-02-22T00:33:25.333 INFO:tasks.workunit.client.1.smithi161.stdout:2/639: symlink de/d2b/d8b/da2/ldd 0 2024-02-22T00:33:25.334 INFO:tasks.workunit.client.1.smithi161.stdout:2/640: write de/d2b/d65/d3a/d9d/fa9 [922842,50479] 0 2024-02-22T00:33:25.337 INFO:tasks.workunit.client.1.smithi161.stdout:1/588: unlink d19/f49 0 2024-02-22T00:33:25.337 INFO:tasks.workunit.client.1.smithi161.stdout:1/589: stat d19/d48/d68/c80 0 2024-02-22T00:33:25.339 INFO:tasks.workunit.client.1.smithi161.stdout:3/559: mknod da/dc/d11/d26/d80/cb7 0 2024-02-22T00:33:25.340 INFO:tasks.workunit.client.1.smithi161.stdout:3/560: readlink da/d29/d8e/d37/l50 0 2024-02-22T00:33:25.340 INFO:tasks.workunit.client.1.smithi161.stdout:5/753: mknod d3/dac/c104 0 2024-02-22T00:33:25.341 INFO:tasks.workunit.client.1.smithi161.stdout:4/564: link d5/d8/l19 d5/d10/ld5 0 2024-02-22T00:33:25.347 INFO:tasks.workunit.client.1.smithi161.stdout:1/590: stat d19/d1d/d2c/f4d 0 2024-02-22T00:33:25.348 INFO:tasks.workunit.client.1.smithi161.stdout:1/591: write f7 [912688,8176] 0 2024-02-22T00:33:25.348 INFO:tasks.workunit.client.1.smithi161.stdout:7/584: link d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/ca6 d3/df/d33/d53/cb7 0 2024-02-22T00:33:25.349 INFO:tasks.workunit.client.1.smithi161.stdout:5/754: creat d3/d1b/d36/f105 x:0 0 0 2024-02-22T00:33:25.351 INFO:tasks.workunit.client.1.smithi161.stdout:8/576: write d1/d2f/d37/f48 [118573,56423] 0 2024-02-22T00:33:25.353 INFO:tasks.workunit.client.1.smithi161.stdout:4/565: mkdir d5/d8/d41/d57/dd6 0 2024-02-22T00:33:25.355 INFO:tasks.workunit.client.1.smithi161.stdout:9/571: rename d1/d2/d7/da/c83 to d1/d5/cc5 0 2024-02-22T00:33:25.356 INFO:tasks.workunit.client.1.smithi161.stdout:1/592: rmdir d19/d1d/d2c/d7d 39 2024-02-22T00:33:25.357 INFO:tasks.workunit.client.1.smithi161.stdout:5/755: fsync d3/d1b/d25/d4c/d7b/fa1 0 2024-02-22T00:33:25.359 INFO:tasks.workunit.client.1.smithi161.stdout:9/572: chown d1/d2/f6d 4151571 1 2024-02-22T00:33:25.361 INFO:tasks.workunit.client.1.smithi161.stdout:7/585: rename d3/df/d33/d35/f27 to d3/dd/d59/fb8 0 2024-02-22T00:33:25.362 INFO:tasks.workunit.client.1.smithi161.stdout:0/654: dwrite d14/f51 [0,4194304] 0 2024-02-22T00:33:25.363 INFO:tasks.workunit.client.1.smithi161.stdout:8/577: dwrite d1/d1c/d20/d22/d28/d36/f7a [0,4194304] 0 2024-02-22T00:33:25.365 INFO:tasks.workunit.client.1.smithi161.stdout:2/641: getdents de/d2b/d65 0 2024-02-22T00:33:25.368 INFO:tasks.workunit.client.1.smithi161.stdout:2/642: fsync de/d2b/d83/f8e 0 2024-02-22T00:33:25.373 INFO:tasks.workunit.client.1.smithi161.stdout:5/756: creat d3/d1c/d62/f106 x:0 0 0 2024-02-22T00:33:25.373 INFO:tasks.workunit.client.1.smithi161.stdout:2/643: write de/f48 [182464,2314] 0 2024-02-22T00:33:25.373 INFO:tasks.workunit.client.1.smithi161.stdout:3/561: getdents da/dc/d11/d40 0 2024-02-22T00:33:25.373 INFO:tasks.workunit.client.1.smithi161.stdout:9/573: dwrite d1/d2/f10 [0,4194304] 0 2024-02-22T00:33:25.376 INFO:tasks.workunit.client.1.smithi161.stdout:0/655: creat d14/d37/d42/d8e/d92/fd8 x:0 0 0 2024-02-22T00:33:25.377 INFO:tasks.workunit.client.1.smithi161.stdout:4/566: link d5/d10/f1f d5/d8/d41/d57/dbe/d28/d63/d65/d9d/fd7 0 2024-02-22T00:33:25.378 INFO:tasks.workunit.client.1.smithi161.stdout:8/578: truncate d1/d1c/d20/d22/d28/d7f/d92/d95/f3c 1255827 0 2024-02-22T00:33:25.380 INFO:tasks.workunit.client.1.smithi161.stdout:0/656: fdatasync d14/d1a/d3f/f4c 0 2024-02-22T00:33:25.380 INFO:tasks.workunit.client.1.smithi161.stdout:3/562: symlink da/dc/d91/lb8 0 2024-02-22T00:33:25.380 INFO:tasks.workunit.client.1.smithi161.stdout:2/644: truncate de/d2b/d65/d3a/fcb 780661 0 2024-02-22T00:33:25.382 INFO:tasks.workunit.client.1.smithi161.stdout:9/574: unlink d1/d2/lc3 0 2024-02-22T00:33:25.383 INFO:tasks.workunit.client.1.smithi161.stdout:1/593: creat d19/d1d/d2c/d2d/fcd x:0 0 0 2024-02-22T00:33:25.384 INFO:tasks.workunit.client.1.smithi161.stdout:1/594: fdatasync d19/d48/fb0 0 2024-02-22T00:33:25.384 INFO:tasks.workunit.client.1.smithi161.stdout:7/586: creat d3/df/fb9 x:0 0 0 2024-02-22T00:33:25.385 INFO:tasks.workunit.client.1.smithi161.stdout:9/575: write d1/d2/d4/f3b [10213526,24963] 0 2024-02-22T00:33:25.385 INFO:tasks.workunit.client.1.smithi161.stdout:4/567: mkdir d5/d8/d41/d53/d6c/dd8 0 2024-02-22T00:33:25.386 INFO:tasks.workunit.client.1.smithi161.stdout:1/595: write f10 [850661,81671] 0 2024-02-22T00:33:25.388 INFO:tasks.workunit.client.1.smithi161.stdout:8/579: rename d1/d2f/d30/fb2 to d1/d1c/d20/fba 0 2024-02-22T00:33:25.396 INFO:tasks.workunit.client.1.smithi161.stdout:3/563: link da/dc/d11/f55 da/d29/d8e/d37/d39/fb9 0 2024-02-22T00:33:25.398 INFO:tasks.workunit.client.1.smithi161.stdout:5/757: getdents d3/d1b/d25 0 2024-02-22T00:33:25.399 INFO:tasks.workunit.client.1.smithi161.stdout:8/580: unlink d1/d1c/d96/cb6 0 2024-02-22T00:33:25.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/587: dwrite d3/dd/d60/d64/f78 [0,4194304] 0 2024-02-22T00:33:25.403 INFO:tasks.workunit.client.1.smithi161.stdout:9/576: symlink d1/d2/d7/lc6 0 2024-02-22T00:33:25.403 INFO:tasks.workunit.client.1.smithi161.stdout:7/588: chown d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/f96 2 1 2024-02-22T00:33:25.405 INFO:tasks.workunit.client.1.smithi161.stdout:0/657: creat d14/d37/d42/d8e/fd9 x:0 0 0 2024-02-22T00:33:25.412 INFO:tasks.workunit.client.1.smithi161.stdout:3/564: fdatasync da/d29/d8e/d37/d39/fb9 0 2024-02-22T00:33:25.412 INFO:tasks.workunit.client.1.smithi161.stdout:4/568: dwrite d5/d8/d41/d57/dbe/d28/d63/d65/d9d/fbb [0,4194304] 0 2024-02-22T00:33:25.412 INFO:tasks.workunit.client.1.smithi161.stdout:8/581: fsync d1/d2f/d37/d64/fb9 0 2024-02-22T00:33:25.412 INFO:tasks.workunit.client.1.smithi161.stdout:2/645: dread de/d2b/d65/d3a/f88 [0,4194304] 0 2024-02-22T00:33:25.415 INFO:tasks.workunit.client.1.smithi161.stdout:9/577: symlink d1/d25/d73/d60/d77/d93/lc7 0 2024-02-22T00:33:25.415 INFO:tasks.workunit.client.1.smithi161.stdout:2/646: read de/d2b/d83/dc9/fd2 [2831532,26382] 0 2024-02-22T00:33:25.415 INFO:tasks.workunit.client.1.smithi161.stdout:0/658: creat d14/d1a/d3f/d96/dbc/fda x:0 0 0 2024-02-22T00:33:25.420 INFO:tasks.workunit.client.1.smithi161.stdout:8/582: symlink d1/d2f/d30/lbb 0 2024-02-22T00:33:25.421 INFO:tasks.workunit.client.1.smithi161.stdout:8/583: chown d1/d1c/d20/d22/f35 138608 1 2024-02-22T00:33:25.423 INFO:tasks.workunit.client.1.smithi161.stdout:3/565: rename da/dc/d11/l14 to da/dc/d11/d40/lba 0 2024-02-22T00:33:25.424 INFO:tasks.workunit.client.1.smithi161.stdout:7/589: mkdir d3/df/dba 0 2024-02-22T00:33:25.424 INFO:tasks.workunit.client.1.smithi161.stdout:1/596: link d19/d1d/d2c/d4f/f72 d19/d1d/d56/db2/fce 0 2024-02-22T00:33:25.424 INFO:tasks.workunit.client.1.smithi161.stdout:3/566: dread da/dc/d11/d40/d59/f9d [0,4194304] 0 2024-02-22T00:33:25.426 INFO:tasks.workunit.client.1.smithi161.stdout:9/578: fdatasync d1/d25/d73/d60/f92 0 2024-02-22T00:33:25.427 INFO:tasks.workunit.client.1.smithi161.stdout:1/597: chown d19/d1d/d2c/d2d/d3f/d69/f8d 39 1 2024-02-22T00:33:25.429 INFO:tasks.workunit.client.1.smithi161.stdout:2/647: creat de/d2b/d83/fde x:0 0 0 2024-02-22T00:33:25.430 INFO:tasks.workunit.client.1.smithi161.stdout:0/659: symlink d14/d1a/d3f/d5d/ldb 0 2024-02-22T00:33:25.432 INFO:tasks.workunit.client.1.smithi161.stdout:4/569: mknod d5/d8/d41/d57/dbe/d28/d38/d6d/cd9 0 2024-02-22T00:33:25.436 INFO:tasks.workunit.client.1.smithi161.stdout:7/590: dwrite d3/f8d [0,4194304] 0 2024-02-22T00:33:25.436 INFO:tasks.workunit.client.1.smithi161.stdout:3/567: creat da/dc/d11/d26/d80/fbb x:0 0 0 2024-02-22T00:33:25.437 INFO:tasks.workunit.client.1.smithi161.stdout:4/570: dread - d5/d10/d14/d4f/fc5 zero size 2024-02-22T00:33:25.439 INFO:tasks.workunit.client.1.smithi161.stdout:5/758: dwrite d3/d1c/d20/f59 [0,4194304] 0 2024-02-22T00:33:25.445 INFO:tasks.workunit.client.1.smithi161.stdout:1/598: dread d19/d48/faf [0,4194304] 0 2024-02-22T00:33:25.446 INFO:tasks.workunit.client.1.smithi161.stdout:9/579: dwrite d1/d25/dc4/fba [0,4194304] 0 2024-02-22T00:33:25.448 INFO:tasks.workunit.client.1.smithi161.stdout:3/568: truncate da/dc/d11/d40/f97 338949 0 2024-02-22T00:33:25.448 INFO:tasks.workunit.client.1.smithi161.stdout:8/584: write d1/d1c/d20/d22/f35 [1263321,106254] 0 2024-02-22T00:33:25.450 INFO:tasks.workunit.client.1.smithi161.stdout:4/571: chown d5/d8/d41/d57/dbe/d28/d63/lb1 1 1 2024-02-22T00:33:25.453 INFO:tasks.workunit.client.1.smithi161.stdout:4/572: chown d5/d8/d41/d57/dbe/c73 4062 1 2024-02-22T00:33:25.453 INFO:tasks.workunit.client.1.smithi161.stdout:2/648: creat de/d11/fdf x:0 0 0 2024-02-22T00:33:25.454 INFO:tasks.workunit.client.1.smithi161.stdout:4/573: readlink d5/d17/l4e 0 2024-02-22T00:33:25.455 INFO:tasks.workunit.client.1.smithi161.stdout:4/574: chown d5/c12 465 1 2024-02-22T00:33:25.455 INFO:tasks.workunit.client.1.smithi161.stdout:2/649: write de/d11/d32/f82 [3385269,119116] 0 2024-02-22T00:33:25.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/575: chown d5/d10/da9 5120672 1 2024-02-22T00:33:25.456 INFO:tasks.workunit.client.1.smithi161.stdout:0/660: rename f11 to d14/fdc 0 2024-02-22T00:33:25.457 INFO:tasks.workunit.client.1.smithi161.stdout:0/661: fdatasync d14/d1a/d3f/d96/fae 0 2024-02-22T00:33:25.458 INFO:tasks.workunit.client.1.smithi161.stdout:7/591: creat d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/fbb x:0 0 0 2024-02-22T00:33:25.459 INFO:tasks.workunit.client.1.smithi161.stdout:7/592: truncate d3/fa9 927216 0 2024-02-22T00:33:25.459 INFO:tasks.workunit.client.1.smithi161.stdout:8/585: write d1/d1c/d75/f4a [1125906,76313] 0 2024-02-22T00:33:25.460 INFO:tasks.workunit.client.1.smithi161.stdout:1/599: mkdir d19/d90/dcf 0 2024-02-22T00:33:25.465 INFO:tasks.workunit.client.1.smithi161.stdout:4/576: creat d5/fda x:0 0 0 2024-02-22T00:33:25.466 INFO:tasks.workunit.client.1.smithi161.stdout:6/536: sync 2024-02-22T00:33:25.466 INFO:tasks.workunit.client.1.smithi161.stdout:0/662: mknod d14/d44/cdd 0 2024-02-22T00:33:25.471 INFO:tasks.workunit.client.1.smithi161.stdout:2/650: mknod de/ce0 0 2024-02-22T00:33:25.473 INFO:tasks.workunit.client.1.smithi161.stdout:3/569: dread da/f1a [0,4194304] 0 2024-02-22T00:33:25.474 INFO:tasks.workunit.client.1.smithi161.stdout:7/593: dread d3/dd/d60/f6c [4194304,4194304] 0 2024-02-22T00:33:25.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/537: mkdir d3/d10/d12/d2f/d7d/dab 0 2024-02-22T00:33:25.476 INFO:tasks.workunit.client.1.smithi161.stdout:1/600: dread d19/f46 [0,4194304] 0 2024-02-22T00:33:25.478 INFO:tasks.workunit.client.1.smithi161.stdout:9/580: link d1/d4b/la2 d1/d25/d73/d60/d77/d99/lc8 0 2024-02-22T00:33:25.481 INFO:tasks.workunit.client.1.smithi161.stdout:8/586: creat d1/fbc x:0 0 0 2024-02-22T00:33:25.482 INFO:tasks.workunit.client.1.smithi161.stdout:8/587: write d1/d1c/d20/d22/d3f/f6e [937370,69688] 0 2024-02-22T00:33:25.484 INFO:tasks.workunit.client.1.smithi161.stdout:0/663: dread d14/d37/f45 [0,4194304] 0 2024-02-22T00:33:25.485 INFO:tasks.workunit.client.1.smithi161.stdout:6/538: symlink d3/dc/df/d32/lac 0 2024-02-22T00:33:25.488 INFO:tasks.workunit.client.1.smithi161.stdout:9/581: mknod d1/d25/d73/cc9 0 2024-02-22T00:33:25.491 INFO:tasks.workunit.client.1.smithi161.stdout:3/570: symlink da/d29/d53/lbc 0 2024-02-22T00:33:25.492 INFO:tasks.workunit.client.1.smithi161.stdout:6/539: dwrite d3/d10/d12/d3a/fa1 [0,4194304] 0 2024-02-22T00:33:25.493 INFO:tasks.workunit.client.1.smithi161.stdout:6/540: write d3/dc/df/d32/f4b [3784193,2461] 0 2024-02-22T00:33:25.494 INFO:tasks.workunit.client.1.smithi161.stdout:7/594: mkdir d3/df/d33/dbc 0 2024-02-22T00:33:25.496 INFO:tasks.workunit.client.1.smithi161.stdout:0/664: write d14/d1a/f23 [1856850,44133] 0 2024-02-22T00:33:25.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/577: symlink d5/d8/d41/d57/dbe/d28/d38/d6d/da5/ldb 0 2024-02-22T00:33:25.498 INFO:tasks.workunit.client.1.smithi161.stdout:1/601: rename d19/d1d/d2c/c31 to d19/d48/d68/da8/cd0 0 2024-02-22T00:33:25.499 INFO:tasks.workunit.client.1.smithi161.stdout:2/651: truncate de/f1c 2702361 0 2024-02-22T00:33:25.500 INFO:tasks.workunit.client.1.smithi161.stdout:0/665: dread - d14/d37/d42/d8e/fa9 zero size 2024-02-22T00:33:25.500 INFO:tasks.workunit.client.1.smithi161.stdout:6/541: read - d3/d10/d12/d95/f9d zero size 2024-02-22T00:33:25.501 INFO:tasks.workunit.client.1.smithi161.stdout:7/595: mknod d3/df/d43/cbd 0 2024-02-22T00:33:25.504 INFO:tasks.workunit.client.1.smithi161.stdout:1/602: mkdir d19/d48/d68/dd1 0 2024-02-22T00:33:25.505 INFO:tasks.workunit.client.1.smithi161.stdout:2/652: symlink de/d2b/d65/d3a/le1 0 2024-02-22T00:33:25.507 INFO:tasks.workunit.client.1.smithi161.stdout:0/666: creat d14/d9b/fde x:0 0 0 2024-02-22T00:33:25.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/542: dwrite d3/d10/d1b/f2e [0,4194304] 0 2024-02-22T00:33:25.509 INFO:tasks.workunit.client.1.smithi161.stdout:4/578: creat d5/d8/d41/d57/dbe/d28/d63/d65/fdc x:0 0 0 2024-02-22T00:33:25.516 INFO:tasks.workunit.client.1.smithi161.stdout:1/603: write d19/f5f [4226606,100775] 0 2024-02-22T00:33:25.516 INFO:tasks.workunit.client.1.smithi161.stdout:2/653: creat de/d2b/d65/fe2 x:0 0 0 2024-02-22T00:33:25.516 INFO:tasks.workunit.client.1.smithi161.stdout:3/571: dread da/dc/d5f/f73 [0,4194304] 0 2024-02-22T00:33:25.516 INFO:tasks.workunit.client.1.smithi161.stdout:0/667: mknod d14/d1a/d3f/d5d/cdf 0 2024-02-22T00:33:25.519 INFO:tasks.workunit.client.1.smithi161.stdout:1/604: write d19/d85/d87/fb1 [675066,37066] 0 2024-02-22T00:33:25.521 INFO:tasks.workunit.client.1.smithi161.stdout:2/654: mknod de/d2b/d83/d4f/ce3 0 2024-02-22T00:33:25.523 INFO:tasks.workunit.client.1.smithi161.stdout:8/588: rename d1/d1c/d20/d22/d28/d36/d70 to d1/d1c/dbd 0 2024-02-22T00:33:25.529 INFO:tasks.workunit.client.1.smithi161.stdout:7/596: getdents d3/df 0 2024-02-22T00:33:25.530 INFO:tasks.workunit.client.1.smithi161.stdout:1/605: creat d19/d1d/d2c/d2d/fd2 x:0 0 0 2024-02-22T00:33:25.530 INFO:tasks.workunit.client.1.smithi161.stdout:7/597: read - d3/df/d33/d35/d55/d63/d7b/d8f/f9d zero size 2024-02-22T00:33:25.531 INFO:tasks.workunit.client.1.smithi161.stdout:2/655: readlink de/d2b/d83/d4f/dc5/ld4 0 2024-02-22T00:33:25.531 INFO:tasks.workunit.client.1.smithi161.stdout:7/598: fsync d3/fa9 0 2024-02-22T00:33:25.532 INFO:tasks.workunit.client.1.smithi161.stdout:1/606: truncate d19/d1d/d2c/d2d/f75 1123048 0 2024-02-22T00:33:25.533 INFO:tasks.workunit.client.1.smithi161.stdout:9/582: rename d1/d5/d9/da5/dbc/f54 to d1/d2/d4/d1f/fca 0 2024-02-22T00:33:25.533 INFO:tasks.workunit.client.1.smithi161.stdout:9/583: stat d1/d25/dc4/d4f/fbd 0 2024-02-22T00:33:25.534 INFO:tasks.workunit.client.1.smithi161.stdout:8/589: mkdir d1/d1c/d20/d22/d28/d36/d6c/dbe 0 2024-02-22T00:33:25.534 INFO:tasks.workunit.client.1.smithi161.stdout:8/590: dread - d1/d2f/d37/d64/d7b/f9d zero size 2024-02-22T00:33:25.535 INFO:tasks.workunit.client.1.smithi161.stdout:6/543: getdents d3/d10/d12/d2f/d7d/d82 0 2024-02-22T00:33:25.536 INFO:tasks.workunit.client.1.smithi161.stdout:0/668: mkdir d14/d37/d42/d73/dc7/de0 0 2024-02-22T00:33:25.542 INFO:tasks.workunit.client.1.smithi161.stdout:6/544: dwrite d3/d10/d12/d2f/d7d/d5f/f99 [0,4194304] 0 2024-02-22T00:33:25.544 INFO:tasks.workunit.client.1.smithi161.stdout:6/545: dread - d3/d10/d72/fa2 zero size 2024-02-22T00:33:25.547 INFO:tasks.workunit.client.1.smithi161.stdout:6/546: fdatasync d3/f7f 0 2024-02-22T00:33:25.547 INFO:tasks.workunit.client.1.smithi161.stdout:9/584: mknod d1/d5/d9/d9c/ccb 0 2024-02-22T00:33:25.548 INFO:tasks.workunit.client.1.smithi161.stdout:3/572: rename da/dc/d5f/f6e to da/fbd 0 2024-02-22T00:33:25.548 INFO:tasks.workunit.client.1.smithi161.stdout:4/579: link d5/d10/ld5 d5/d8/d41/ldd 0 2024-02-22T00:33:25.550 INFO:tasks.workunit.client.1.smithi161.stdout:0/669: symlink d14/d44/dbe/le1 0 2024-02-22T00:33:25.550 INFO:tasks.workunit.client.1.smithi161.stdout:2/656: write de/d2b/d65/d3a/f75 [204824,71233] 0 2024-02-22T00:33:25.551 INFO:tasks.workunit.client.1.smithi161.stdout:7/599: dwrite d3/f73 [4194304,4194304] 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:8/591: getdents d1/d1c 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:6/547: write d3/dc/df/d32/f91 [820196,56952] 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:0/670: dread d14/f9e [0,4194304] 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:4/580: mknod d5/d10/d14/d4f/cde 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:8/592: mknod d1/d1c/cbf 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:6/548: write d3/d10/d12/d3a/f6c [1496996,82130] 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:3/573: unlink da/dc/d11/d26/d80/fbb 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:7/600: creat d3/dd/d59/fbe x:0 0 0 2024-02-22T00:33:25.561 INFO:tasks.workunit.client.1.smithi161.stdout:4/581: stat d5/d8/d41/d57/dbe/c74 0 2024-02-22T00:33:25.562 INFO:tasks.workunit.client.1.smithi161.stdout:2/657: mknod de/d2b/d65/d3a/d71/ce4 0 2024-02-22T00:33:25.563 INFO:tasks.workunit.client.1.smithi161.stdout:1/607: rename d19/f52 to d19/d51/fd3 0 2024-02-22T00:33:25.567 INFO:tasks.workunit.client.1.smithi161.stdout:0/671: symlink d14/d37/d42/d73/le2 0 2024-02-22T00:33:25.567 INFO:tasks.workunit.client.1.smithi161.stdout:0/672: chown d14/d1a/f1b 2323810 1 2024-02-22T00:33:25.568 INFO:tasks.workunit.client.1.smithi161.stdout:5/759: sync 2024-02-22T00:33:25.568 INFO:tasks.workunit.client.1.smithi161.stdout:3/574: creat da/dc/d11/d40/d59/fbe x:0 0 0 2024-02-22T00:33:25.574 INFO:tasks.workunit.client.1.smithi161.stdout:1/608: unlink d19/d48/fb0 0 2024-02-22T00:33:25.574 INFO:tasks.workunit.client.1.smithi161.stdout:4/582: dread d5/d8/d41/d57/f60 [0,4194304] 0 2024-02-22T00:33:25.575 INFO:tasks.workunit.client.1.smithi161.stdout:0/673: creat d14/d44/dbe/fe3 x:0 0 0 2024-02-22T00:33:25.576 INFO:tasks.workunit.client.1.smithi161.stdout:6/549: creat d3/d10/d12/d2f/d7d/dab/fad x:0 0 0 2024-02-22T00:33:25.576 INFO:tasks.workunit.client.1.smithi161.stdout:5/760: dwrite d3/d9c/fdc [0,4194304] 0 2024-02-22T00:33:25.579 INFO:tasks.workunit.client.1.smithi161.stdout:7/601: getdents d3/df/d33/dbc 0 2024-02-22T00:33:25.580 INFO:tasks.workunit.client.1.smithi161.stdout:9/585: dwrite d1/d25/d73/fc2 [0,4194304] 0 2024-02-22T00:33:25.581 INFO:tasks.workunit.client.1.smithi161.stdout:5/761: chown d3/d1c/d67 260380 1 2024-02-22T00:33:25.586 INFO:tasks.workunit.client.1.smithi161.stdout:3/575: unlink da/dc/d11/d26/ca1 0 2024-02-22T00:33:25.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/658: creat de/d2b/d8b/da2/da5/dc4/d8f/fe5 x:0 0 0 2024-02-22T00:33:25.586 INFO:tasks.workunit.client.1.smithi161.stdout:0/674: symlink d14/d37/d42/da2/le4 0 2024-02-22T00:33:25.586 INFO:tasks.workunit.client.1.smithi161.stdout:9/586: fsync d1/d25/d73/d60/d77/f7c 0 2024-02-22T00:33:25.587 INFO:tasks.workunit.client.1.smithi161.stdout:6/550: symlink d3/d10/d1b/lae 0 2024-02-22T00:33:25.589 INFO:tasks.workunit.client.1.smithi161.stdout:9/587: stat d1/d25/f58 0 2024-02-22T00:33:25.590 INFO:tasks.workunit.client.1.smithi161.stdout:4/583: rename d5/d10/d75/f9a to d5/d8/d41/d53/fdf 0 2024-02-22T00:33:25.591 INFO:tasks.workunit.client.1.smithi161.stdout:5/762: rmdir d3/d1b/d25/d4c/dd2 39 2024-02-22T00:33:25.592 INFO:tasks.workunit.client.1.smithi161.stdout:3/576: mknod da/dc/d11/d40/d59/cbf 0 2024-02-22T00:33:25.593 INFO:tasks.workunit.client.1.smithi161.stdout:5/763: stat d3/d1b/d25/fe6 0 2024-02-22T00:33:25.594 INFO:tasks.workunit.client.1.smithi161.stdout:8/593: mkdir d1/d1c/d20/dc0 0 2024-02-22T00:33:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:9/588: read d1/d25/dc4/d4f/f5e [2976500,61239] 0 2024-02-22T00:33:25.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/659: read de/d2b/d83/dc9/fd2 [6884571,101770] 0 2024-02-22T00:33:25.599 INFO:tasks.workunit.client.1.smithi161.stdout:7/602: rename d3/dd/d60 to d3/dbf 0 2024-02-22T00:33:25.599 INFO:tasks.workunit.client.1.smithi161.stdout:3/577: write da/d29/d8e/d37/d39/fb9 [5028658,94921] 0 2024-02-22T00:33:25.602 INFO:tasks.workunit.client.1.smithi161.stdout:5/764: write d3/d1b/d25/d4c/dd2/fe0 [772393,100400] 0 2024-02-22T00:33:25.603 INFO:tasks.workunit.client.1.smithi161.stdout:0/675: dwrite d14/d37/d42/d8e/fcc [0,4194304] 0 2024-02-22T00:33:25.603 INFO:tasks.workunit.client.1.smithi161.stdout:8/594: unlink d1/l2 0 2024-02-22T00:33:25.604 INFO:tasks.workunit.client.1.smithi161.stdout:1/609: dread d19/d1d/f36 [0,4194304] 0 2024-02-22T00:33:25.605 INFO:tasks.workunit.client.1.smithi161.stdout:4/584: fdatasync d5/d8/d41/d57/dbe/d28/d63/d65/d9d/fd7 0 2024-02-22T00:33:25.607 INFO:tasks.workunit.client.1.smithi161.stdout:9/589: rmdir d1/d2/d4 39 2024-02-22T00:33:25.607 INFO:tasks.workunit.client.1.smithi161.stdout:1/610: fsync d19/d48/f50 0 2024-02-22T00:33:25.608 INFO:tasks.workunit.client.1.smithi161.stdout:2/660: mkdir de/d2b/d8b/de6 0 2024-02-22T00:33:25.609 INFO:tasks.workunit.client.1.smithi161.stdout:3/578: unlink da/d29/f86 0 2024-02-22T00:33:25.609 INFO:tasks.workunit.client.1.smithi161.stdout:8/595: write d1/d1c/d20/d22/d3f/f82 [3246275,36407] 0 2024-02-22T00:33:25.611 INFO:tasks.workunit.client.1.smithi161.stdout:2/661: chown de/d2b/d8b/da2/da5/dc4/d8f/fe5 417097504 1 2024-02-22T00:33:25.611 INFO:tasks.workunit.client.1.smithi161.stdout:8/596: dread - d1/d1c/d20/d22/f90 zero size 2024-02-22T00:33:25.616 INFO:tasks.workunit.client.1.smithi161.stdout:0/676: read d14/d1a/d3f/d5d/f8a [7756869,41861] 0 2024-02-22T00:33:25.618 INFO:tasks.workunit.client.1.smithi161.stdout:9/590: rmdir d1/d25 39 2024-02-22T00:33:25.618 INFO:tasks.workunit.client.1.smithi161.stdout:8/597: dread d1/d1c/d20/d22/d28/d36/f41 [0,4194304] 0 2024-02-22T00:33:25.619 INFO:tasks.workunit.client.1.smithi161.stdout:6/551: truncate d3/d10/d1b/f78 755940 0 2024-02-22T00:33:25.619 INFO:tasks.workunit.client.1.smithi161.stdout:9/591: chown d1/d2/d7/da/f3c 6825094 1 2024-02-22T00:33:25.621 INFO:tasks.workunit.client.1.smithi161.stdout:7/603: mkdir d3/df/d33/d35/d55/d63/d7b/d30/dc0 0 2024-02-22T00:33:25.622 INFO:tasks.workunit.client.1.smithi161.stdout:7/604: write d3/f36 [4477698,37864] 0 2024-02-22T00:33:25.623 INFO:tasks.workunit.client.1.smithi161.stdout:7/605: truncate d3/df/d33/d35/d80/fb0 368327 0 2024-02-22T00:33:25.624 INFO:tasks.workunit.client.1.smithi161.stdout:2/662: creat de/d2b/d8b/da2/da5/dc4/da7/fe7 x:0 0 0 2024-02-22T00:33:25.625 INFO:tasks.workunit.client.1.smithi161.stdout:2/663: stat de/d11/d14/fbb 0 2024-02-22T00:33:25.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/677: truncate d14/d1a/d3f/f5b 2155 0 2024-02-22T00:33:25.632 INFO:tasks.workunit.client.1.smithi161.stdout:1/611: rename d19/d1d/d2c/d7d/da2 to d19/d51/d6c/dd4 0 2024-02-22T00:33:25.634 INFO:tasks.workunit.client.1.smithi161.stdout:7/606: dwrite d3/dd/f9e [0,4194304] 0 2024-02-22T00:33:25.637 INFO:tasks.workunit.client.1.smithi161.stdout:9/592: fsync d1/d25/d73/fb6 0 2024-02-22T00:33:25.638 INFO:tasks.workunit.client.1.smithi161.stdout:3/579: fdatasync da/d29/d8e/d37/d39/f42 0 2024-02-22T00:33:25.638 INFO:tasks.workunit.client.1.smithi161.stdout:1/612: read d19/f43 [1254156,966] 0 2024-02-22T00:33:25.640 INFO:tasks.workunit.client.1.smithi161.stdout:5/765: dwrite d3/d1b/d36/f55 [0,4194304] 0 2024-02-22T00:33:25.644 INFO:tasks.workunit.client.1.smithi161.stdout:8/598: mknod d1/d1c/dbd/cc1 0 2024-02-22T00:33:25.645 INFO:tasks.workunit.client.1.smithi161.stdout:3/580: write da/d29/d8e/d37/fb2 [330830,69541] 0 2024-02-22T00:33:25.645 INFO:tasks.workunit.client.1.smithi161.stdout:5/766: fsync d3/d1b/d36/ff5 0 2024-02-22T00:33:25.645 INFO:tasks.workunit.client.1.smithi161.stdout:2/664: dwrite de/d2b/d65/d3a/d71/fa1 [0,4194304] 0 2024-02-22T00:33:25.646 INFO:tasks.workunit.client.1.smithi161.stdout:6/552: mkdir d3/daf 0 2024-02-22T00:33:25.649 INFO:tasks.workunit.client.1.smithi161.stdout:5/767: read - d3/dac/dd1/ff0 zero size 2024-02-22T00:33:25.652 INFO:tasks.workunit.client.1.smithi161.stdout:5/768: chown d3/d29/d80/d92/df7/dae/dbe 752451789 1 2024-02-22T00:33:25.652 INFO:tasks.workunit.client.1.smithi161.stdout:9/593: dwrite d1/d25/dc4/d4f/fbd [0,4194304] 0 2024-02-22T00:33:25.653 INFO:tasks.workunit.client.1.smithi161.stdout:5/769: readlink d3/d1c/d69/l6f 0 2024-02-22T00:33:25.654 INFO:tasks.workunit.client.1.smithi161.stdout:7/607: creat d3/df/d33/d35/d80/fc1 x:0 0 0 2024-02-22T00:33:25.655 INFO:tasks.workunit.client.1.smithi161.stdout:0/678: mkdir d14/d37/d42/d73/dc7/de0/de5 0 2024-02-22T00:33:25.656 INFO:tasks.workunit.client.1.smithi161.stdout:0/679: dread - d14/d1a/f79 zero size 2024-02-22T00:33:25.661 INFO:tasks.workunit.client.1.smithi161.stdout:3/581: unlink da/dc/d11/d40/d59/d93/daa/cad 0 2024-02-22T00:33:25.661 INFO:tasks.workunit.client.1.smithi161.stdout:4/585: link d5/d17/d5c/l7e d5/d8/d41/d57/dbe/le0 0 2024-02-22T00:33:25.662 INFO:tasks.workunit.client.1.smithi161.stdout:8/599: truncate d1/d1c/d20/d22/d28/d36/f46 1477532 0 2024-02-22T00:33:25.664 INFO:tasks.workunit.client.1.smithi161.stdout:9/594: rename d1/d5/d9/da5/dbc/c52 to d1/d25/d73/d60/d77/d99/ccc 0 2024-02-22T00:33:25.665 INFO:tasks.workunit.client.1.smithi161.stdout:1/613: getdents d19/d48/d68/dd1 0 2024-02-22T00:33:25.666 INFO:tasks.workunit.client.1.smithi161.stdout:7/608: symlink d3/dd/d59/d5b/lc2 0 2024-02-22T00:33:25.666 INFO:tasks.workunit.client.1.smithi161.stdout:7/609: readlink d3/df/d33/l7e 0 2024-02-22T00:33:25.668 INFO:tasks.workunit.client.1.smithi161.stdout:7/610: readlink d3/df/d33/d35/l31 0 2024-02-22T00:33:25.670 INFO:tasks.workunit.client.1.smithi161.stdout:3/582: readlink da/dc/d11/d40/lba 0 2024-02-22T00:33:25.672 INFO:tasks.workunit.client.1.smithi161.stdout:4/586: mknod d5/d8/d41/d57/dbe/d28/d63/d64/ce1 0 2024-02-22T00:33:25.674 INFO:tasks.workunit.client.1.smithi161.stdout:4/587: fsync d5/d10/d14/fb7 0 2024-02-22T00:33:25.674 INFO:tasks.workunit.client.1.smithi161.stdout:9/595: unlink d1/c30 0 2024-02-22T00:33:25.675 INFO:tasks.workunit.client.1.smithi161.stdout:6/553: creat d3/d10/fb0 x:0 0 0 2024-02-22T00:33:25.676 INFO:tasks.workunit.client.1.smithi161.stdout:7/611: dwrite d3/f14 [0,4194304] 0 2024-02-22T00:33:25.676 INFO:tasks.workunit.client.1.smithi161.stdout:1/614: rmdir d19/d51 39 2024-02-22T00:33:25.679 INFO:tasks.workunit.client.1.smithi161.stdout:4/588: dread - d5/d8/d41/d57/dbe/d28/d63/d65/f94 zero size 2024-02-22T00:33:25.680 INFO:tasks.workunit.client.1.smithi161.stdout:8/600: fsync d1/d1c/f3d 0 2024-02-22T00:33:25.683 INFO:tasks.workunit.client.1.smithi161.stdout:1/615: symlink d19/d1d/ld5 0 2024-02-22T00:33:25.683 INFO:tasks.workunit.client.1.smithi161.stdout:3/583: dwrite da/dc/d11/d40/d59/d93/daa/fb4 [0,4194304] 0 2024-02-22T00:33:25.686 INFO:tasks.workunit.client.1.smithi161.stdout:6/554: creat d3/d10/d12/d2f/d7d/d5f/fb1 x:0 0 0 2024-02-22T00:33:25.688 INFO:tasks.workunit.client.1.smithi161.stdout:1/616: read d19/f43 [2665840,13171] 0 2024-02-22T00:33:25.689 INFO:tasks.workunit.client.1.smithi161.stdout:5/770: write d3/f3a [2955617,1709] 0 2024-02-22T00:33:25.689 INFO:tasks.workunit.client.1.smithi161.stdout:9/596: mkdir d1/d2/d4/d1f/dab/dcd 0 2024-02-22T00:33:25.691 INFO:tasks.workunit.client.1.smithi161.stdout:4/589: mknod d5/d8/d41/d57/dbe/d28/d38/d6d/da5/ce2 0 2024-02-22T00:33:25.692 INFO:tasks.workunit.client.1.smithi161.stdout:4/590: dread - d5/d10/d75/fa0 zero size 2024-02-22T00:33:25.695 INFO:tasks.workunit.client.1.smithi161.stdout:3/584: symlink da/dc/d11/d26/d80/d92/lc0 0 2024-02-22T00:33:25.695 INFO:tasks.workunit.client.1.smithi161.stdout:2/665: truncate de/d2b/d65/d60/d68/fa3 343105 0 2024-02-22T00:33:25.696 INFO:tasks.workunit.client.1.smithi161.stdout:6/555: mknod d3/d10/d12/d3a/cb2 0 2024-02-22T00:33:25.697 INFO:tasks.workunit.client.1.smithi161.stdout:3/585: chown da/dc/d11/d26/f45 1082229121 1 2024-02-22T00:33:25.697 INFO:tasks.workunit.client.1.smithi161.stdout:8/601: mknod d1/cc2 0 2024-02-22T00:33:25.699 INFO:tasks.workunit.client.1.smithi161.stdout:0/680: truncate d14/d1a/d3f/f5b 945632 0 2024-02-22T00:33:25.701 INFO:tasks.workunit.client.1.smithi161.stdout:4/591: dwrite d5/d17/fd3 [0,4194304] 0 2024-02-22T00:33:25.701 INFO:tasks.workunit.client.1.smithi161.stdout:1/617: write d19/d51/d6c/f9c [111378,100848] 0 2024-02-22T00:33:25.701 INFO:tasks.workunit.client.1.smithi161.stdout:5/771: creat d3/d1b/d25/d84/f107 x:0 0 0 2024-02-22T00:33:25.703 INFO:tasks.workunit.client.1.smithi161.stdout:2/666: rmdir de/d2b/d8b/da2/da5 39 2024-02-22T00:33:25.705 INFO:tasks.workunit.client.1.smithi161.stdout:3/586: write da/f8a [1262390,117668] 0 2024-02-22T00:33:25.706 INFO:tasks.workunit.client.1.smithi161.stdout:8/602: chown d1/d1c/d20/c6a 105746330 1 2024-02-22T00:33:25.707 INFO:tasks.workunit.client.1.smithi161.stdout:2/667: fsync de/d2b/f98 0 2024-02-22T00:33:25.707 INFO:tasks.workunit.client.1.smithi161.stdout:9/597: creat d1/d25/dc4/d4f/da3/fce x:0 0 0 2024-02-22T00:33:25.707 INFO:tasks.workunit.client.1.smithi161.stdout:0/681: symlink d14/d44/dbf/le6 0 2024-02-22T00:33:25.709 INFO:tasks.workunit.client.1.smithi161.stdout:1/618: mkdir d19/d90/dd6 0 2024-02-22T00:33:25.711 INFO:tasks.workunit.client.1.smithi161.stdout:5/772: creat d3/d29/d80/d92/f108 x:0 0 0 2024-02-22T00:33:25.712 INFO:tasks.workunit.client.1.smithi161.stdout:6/556: symlink d3/d10/d12/lb3 0 2024-02-22T00:33:25.715 INFO:tasks.workunit.client.1.smithi161.stdout:3/587: mkdir da/d29/d53/dc1 0 2024-02-22T00:33:25.716 INFO:tasks.workunit.client.1.smithi161.stdout:1/619: dwrite d19/d1d/d2c/d4f/d98/fb8 [0,4194304] 0 2024-02-22T00:33:25.718 INFO:tasks.workunit.client.1.smithi161.stdout:3/588: write da/dc/d11/f2e [3933311,83134] 0 2024-02-22T00:33:25.718 INFO:tasks.workunit.client.1.smithi161.stdout:2/668: read de/d2b/d65/f9c [107650,113923] 0 2024-02-22T00:33:25.719 INFO:tasks.workunit.client.1.smithi161.stdout:9/598: creat d1/d2/d4/d1f/fcf x:0 0 0 2024-02-22T00:33:25.720 INFO:tasks.workunit.client.1.smithi161.stdout:8/603: creat d1/d1c/d20/d22/d28/d7f/d92/fc3 x:0 0 0 2024-02-22T00:33:25.721 INFO:tasks.workunit.client.1.smithi161.stdout:9/599: write d1/d2/d4/d11/f28 [4852371,21335] 0 2024-02-22T00:33:25.724 INFO:tasks.workunit.client.1.smithi161.stdout:5/773: mkdir d3/d1b/d25/d109 0 2024-02-22T00:33:25.725 INFO:tasks.workunit.client.1.smithi161.stdout:5/774: readlink d3/d1b/d91/lb3 0 2024-02-22T00:33:25.725 INFO:tasks.workunit.client.1.smithi161.stdout:6/557: mkdir d3/d30/db4 0 2024-02-22T00:33:25.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/682: link d14/d1a/f79 d14/d44/fe7 0 2024-02-22T00:33:25.734 INFO:tasks.workunit.client.1.smithi161.stdout:8/604: mkdir d1/d1c/d20/d22/d28/d36/d6c/dc4 0 2024-02-22T00:33:25.735 INFO:tasks.workunit.client.1.smithi161.stdout:9/600: creat d1/d25/d73/d60/db0/fd0 x:0 0 0 2024-02-22T00:33:25.735 INFO:tasks.workunit.client.1.smithi161.stdout:0/683: dread d14/d37/f45 [0,4194304] 0 2024-02-22T00:33:25.736 INFO:tasks.workunit.client.1.smithi161.stdout:5/775: creat d3/d1b/f10a x:0 0 0 2024-02-22T00:33:25.739 INFO:tasks.workunit.client.1.smithi161.stdout:3/589: write f0 [3253367,94168] 0 2024-02-22T00:33:25.740 INFO:tasks.workunit.client.1.smithi161.stdout:2/669: mknod de/d2b/d8b/da2/da5/dc4/ce8 0 2024-02-22T00:33:25.741 INFO:tasks.workunit.client.1.smithi161.stdout:6/558: mkdir d3/d30/db4/db5 0 2024-02-22T00:33:25.743 INFO:tasks.workunit.client.1.smithi161.stdout:0/684: unlink d14/d1a/c88 0 2024-02-22T00:33:25.744 INFO:tasks.workunit.client.1.smithi161.stdout:0/685: write f8 [3135100,87822] 0 2024-02-22T00:33:25.744 INFO:tasks.workunit.client.1.smithi161.stdout:1/620: creat d19/d1d/d2c/fd7 x:0 0 0 2024-02-22T00:33:25.745 INFO:tasks.workunit.client.1.smithi161.stdout:0/686: fdatasync d14/f19 0 2024-02-22T00:33:25.746 INFO:tasks.workunit.client.1.smithi161.stdout:8/605: rmdir d1/d1c/d96 39 2024-02-22T00:33:25.746 INFO:tasks.workunit.client.1.smithi161.stdout:1/621: readlink d19/d1d/l2b 0 2024-02-22T00:33:25.748 INFO:tasks.workunit.client.1.smithi161.stdout:5/776: read d3/d1b/d25/f23 [185065,74533] 0 2024-02-22T00:33:25.748 INFO:tasks.workunit.client.1.smithi161.stdout:6/559: rename d3/d10/f6e to d3/d10/d1b/d5e/fb6 0 2024-02-22T00:33:25.749 INFO:tasks.workunit.client.1.smithi161.stdout:6/560: write d3/dc/f27 [242570,108665] 0 2024-02-22T00:33:25.750 INFO:tasks.workunit.client.1.smithi161.stdout:9/601: symlink d1/d2/d4/d95/db8/ld1 0 2024-02-22T00:33:25.751 INFO:tasks.workunit.client.1.smithi161.stdout:9/602: fdatasync d1/d2/d4/d11/f28 0 2024-02-22T00:33:25.751 INFO:tasks.workunit.client.1.smithi161.stdout:6/561: truncate d3/d10/f26 4234851 0 2024-02-22T00:33:25.753 INFO:tasks.workunit.client.1.smithi161.stdout:9/603: write d1/d2/d4/d11/f28 [5454741,129444] 0 2024-02-22T00:33:25.753 INFO:tasks.workunit.client.1.smithi161.stdout:0/687: unlink d14/d37/f5f 0 2024-02-22T00:33:25.757 INFO:tasks.workunit.client.1.smithi161.stdout:2/670: link de/d2b/f96 de/d2b/d83/dc9/fe9 0 2024-02-22T00:33:25.759 INFO:tasks.workunit.client.1.smithi161.stdout:1/622: rmdir d19/d51/d64/d9b 39 2024-02-22T00:33:25.760 INFO:tasks.workunit.client.1.smithi161.stdout:9/604: dwrite d1/f9e [0,4194304] 0 2024-02-22T00:33:25.760 INFO:tasks.workunit.client.1.smithi161.stdout:1/623: chown d19/d51/d6c/f9c 1538439317 1 2024-02-22T00:33:25.761 INFO:tasks.workunit.client.1.smithi161.stdout:5/777: mknod d3/d1c/d69/c10b 0 2024-02-22T00:33:25.765 INFO:tasks.workunit.client.1.smithi161.stdout:6/562: creat d3/d10/d1b/d5e/fb7 x:0 0 0 2024-02-22T00:33:25.766 INFO:tasks.workunit.client.1.smithi161.stdout:0/688: mknod d14/d29/ce8 0 2024-02-22T00:33:25.772 INFO:tasks.workunit.client.1.smithi161.stdout:2/671: dread de/d11/f4e [0,4194304] 0 2024-02-22T00:33:25.773 INFO:tasks.workunit.client.1.smithi161.stdout:3/590: dwrite da/dc/d11/f28 [0,4194304] 0 2024-02-22T00:33:25.774 INFO:tasks.workunit.client.1.smithi161.stdout:6/563: unlink d3/dc/df/d32/f93 0 2024-02-22T00:33:25.775 INFO:tasks.workunit.client.1.smithi161.stdout:6/564: chown d3/d10/d12/f23 33389119 1 2024-02-22T00:33:25.779 INFO:tasks.workunit.client.1.smithi161.stdout:1/624: mknod d19/cd8 0 2024-02-22T00:33:25.780 INFO:tasks.workunit.client.1.smithi161.stdout:8/606: dread d1/d1c/d20/d22/d28/d36/f46 [0,4194304] 0 2024-02-22T00:33:25.784 INFO:tasks.workunit.client.1.smithi161.stdout:2/672: chown de/d11/d5c 0 1 2024-02-22T00:33:25.786 INFO:tasks.workunit.client.1.smithi161.stdout:6/565: rename d3/d10/d1b/l8c to d3/d10/d1b/da5/lb8 0 2024-02-22T00:33:25.786 INFO:tasks.workunit.client.1.smithi161.stdout:1/625: dwrite d19/d1d/f22 [0,4194304] 0 2024-02-22T00:33:25.789 INFO:tasks.workunit.client.1.smithi161.stdout:9/605: creat d1/d2/fd2 x:0 0 0 2024-02-22T00:33:25.791 INFO:tasks.workunit.client.1.smithi161.stdout:3/591: link da/dc/d11/f71 da/dc/d11/d40/d59/d93/daa/fc2 0 2024-02-22T00:33:25.791 INFO:tasks.workunit.client.1.smithi161.stdout:9/606: chown d1 35 1 2024-02-22T00:33:25.792 INFO:tasks.workunit.client.1.smithi161.stdout:2/673: rmdir de/d2b/d65/d3a 39 2024-02-22T00:33:25.794 INFO:tasks.workunit.client.1.smithi161.stdout:8/607: mkdir d1/d2f/dc5 0 2024-02-22T00:33:25.795 INFO:tasks.workunit.client.1.smithi161.stdout:6/566: rename d3/dc/c57 to d3/d10/d1b/d5e/cb9 0 2024-02-22T00:33:25.798 INFO:tasks.workunit.client.1.smithi161.stdout:3/592: getdents da/dc/d11/da5 0 2024-02-22T00:33:25.798 INFO:tasks.workunit.client.1.smithi161.stdout:5/778: dwrite d3/d29/d80/d92/f9d [0,4194304] 0 2024-02-22T00:33:25.799 INFO:tasks.workunit.client.1.smithi161.stdout:2/674: write de/d11/d5c/f69 [3864453,50882] 0 2024-02-22T00:33:25.800 INFO:tasks.workunit.client.1.smithi161.stdout:0/689: dwrite d14/f56 [4194304,4194304] 0 2024-02-22T00:33:25.801 INFO:tasks.workunit.client.1.smithi161.stdout:8/608: fsync d1/d1c/d20/d22/d28/d7f/d92/fc3 0 2024-02-22T00:33:25.803 INFO:tasks.workunit.client.1.smithi161.stdout:9/607: rename d1/d2/d4/d11/f71 to d1/d2/d4/d1f/dab/dcd/fd3 0 2024-02-22T00:33:25.803 INFO:tasks.workunit.client.1.smithi161.stdout:0/690: stat d14/d29/l32 0 2024-02-22T00:33:25.803 INFO:tasks.workunit.client.1.smithi161.stdout:6/567: truncate d3/d10/d1b/f59 3417012 0 2024-02-22T00:33:25.805 INFO:tasks.workunit.client.1.smithi161.stdout:6/568: chown d3/l2c 53886907 1 2024-02-22T00:33:25.805 INFO:tasks.workunit.client.1.smithi161.stdout:0/691: chown d14/d44/f81 0 1 2024-02-22T00:33:25.806 INFO:tasks.workunit.client.1.smithi161.stdout:8/609: write d1/d1c/d20/d22/d28/d7f/d92/d95/f3b [2268555,91122] 0 2024-02-22T00:33:25.808 INFO:tasks.workunit.client.1.smithi161.stdout:2/675: mkdir de/d11/d5c/dea 0 2024-02-22T00:33:25.812 INFO:tasks.workunit.client.1.smithi161.stdout:0/692: unlink d14/d44/f85 0 2024-02-22T00:33:25.812 INFO:tasks.workunit.client.1.smithi161.stdout:6/569: creat d3/d30/db4/db5/fba x:0 0 0 2024-02-22T00:33:25.814 INFO:tasks.workunit.client.1.smithi161.stdout:2/676: mknod de/d11/d32/ceb 0 2024-02-22T00:33:25.815 INFO:tasks.workunit.client.1.smithi161.stdout:5/779: rename d3/d1b/d25/d84/fee to d3/d1b/d25/d4c/dd2/f10c 0 2024-02-22T00:33:25.816 INFO:tasks.workunit.client.1.smithi161.stdout:9/608: dwrite d1/d2/d4/d11/f28 [0,4194304] 0 2024-02-22T00:33:25.817 INFO:tasks.workunit.client.1.smithi161.stdout:0/693: rmdir d14/d37/d42/d73/dc7 39 2024-02-22T00:33:25.817 INFO:tasks.workunit.client.1.smithi161.stdout:2/677: chown de/d2b/d83/d4f 0 1 2024-02-22T00:33:25.817 INFO:tasks.workunit.client.1.smithi161.stdout:1/626: dread d19/f1a [0,4194304] 0 2024-02-22T00:33:25.819 INFO:tasks.workunit.client.1.smithi161.stdout:6/570: chown d3/d10/d12/d2f/d7d/d5f/fb1 75 1 2024-02-22T00:33:25.823 INFO:tasks.workunit.client.1.smithi161.stdout:8/610: dwrite d1/d1c/d20/d22/f62 [4194304,4194304] 0 2024-02-22T00:33:25.824 INFO:tasks.workunit.client.1.smithi161.stdout:5/780: chown d3/d29/d80/d92/fdf 238458 1 2024-02-22T00:33:25.828 INFO:tasks.workunit.client.1.smithi161.stdout:2/678: creat de/d2b/d8b/ddc/fec x:0 0 0 2024-02-22T00:33:25.829 INFO:tasks.workunit.client.1.smithi161.stdout:6/571: truncate d3/d10/d1b/d5e/f94 4720805 0 2024-02-22T00:33:25.829 INFO:tasks.workunit.client.1.smithi161.stdout:8/611: creat d1/d1c/d20/fc6 x:0 0 0 2024-02-22T00:33:25.831 INFO:tasks.workunit.client.1.smithi161.stdout:5/781: mknod d3/d1b/d25/d4c/dd2/ddd/c10d 0 2024-02-22T00:33:25.832 INFO:tasks.workunit.client.1.smithi161.stdout:6/572: write d3/d10/d1b/f2e [5100347,103609] 0 2024-02-22T00:33:25.835 INFO:tasks.workunit.client.1.smithi161.stdout:1/627: dwrite f9 [0,4194304] 0 2024-02-22T00:33:25.838 INFO:tasks.workunit.client.1.smithi161.stdout:9/609: link d1/d2/d7/f91 d1/d25/d73/d60/fd4 0 2024-02-22T00:33:25.845 INFO:tasks.workunit.client.1.smithi161.stdout:0/694: getdents d14/d1a/d3f/d96/da1 0 2024-02-22T00:33:25.845 INFO:tasks.workunit.client.1.smithi161.stdout:1/628: dread - d19/d1d/d2c/d7d/f7f zero size 2024-02-22T00:33:25.846 INFO:tasks.workunit.client.1.smithi161.stdout:8/612: creat d1/d1c/d96/fc7 x:0 0 0 2024-02-22T00:33:25.846 INFO:tasks.workunit.client.1.smithi161.stdout:9/610: read d1/d2/f6d [1797340,41718] 0 2024-02-22T00:33:25.850 INFO:tasks.workunit.client.1.smithi161.stdout:5/782: dwrite d3/d1c/d69/fa8 [0,4194304] 0 2024-02-22T00:33:25.854 INFO:tasks.workunit.client.1.smithi161.stdout:8/613: creat d1/d1c/d75/fc8 x:0 0 0 2024-02-22T00:33:25.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/611: creat d1/d5/d9/da5/fd5 x:0 0 0 2024-02-22T00:33:25.855 INFO:tasks.workunit.client.1.smithi161.stdout:2/679: dwrite de/d2b/d65/d60/d68/fc6 [0,4194304] 0 2024-02-22T00:33:25.858 INFO:tasks.workunit.client.1.smithi161.stdout:1/629: truncate d19/d51/d64/d9b/da5/daa/fab 107527 0 2024-02-22T00:33:25.858 INFO:tasks.workunit.client.1.smithi161.stdout:5/783: mknod d3/d29/d80/c10e 0 2024-02-22T00:33:25.860 INFO:tasks.workunit.client.1.smithi161.stdout:2/680: chown de/d2b/d8b/da2/da5/dc4/d8f/f47 179009 1 2024-02-22T00:33:25.861 INFO:tasks.workunit.client.1.smithi161.stdout:8/614: write d1/d1c/d20/d22/f35 [1838666,26319] 0 2024-02-22T00:33:25.865 INFO:tasks.workunit.client.1.smithi161.stdout:1/630: mknod d19/d1d/d2c/d2d/db7/cd9 0 2024-02-22T00:33:25.866 INFO:tasks.workunit.client.1.smithi161.stdout:8/615: creat d1/d2f/d37/d64/d7b/d7e/fc9 x:0 0 0 2024-02-22T00:33:25.868 INFO:tasks.workunit.client.1.smithi161.stdout:2/681: creat de/d2b/d8b/da2/da5/dc4/da7/fed x:0 0 0 2024-02-22T00:33:25.870 INFO:tasks.workunit.client.1.smithi161.stdout:1/631: symlink d19/d51/d64/d9b/da5/daa/lda 0 2024-02-22T00:33:25.872 INFO:tasks.workunit.client.1.smithi161.stdout:8/616: symlink d1/lca 0 2024-02-22T00:33:25.872 INFO:tasks.workunit.client.1.smithi161.stdout:5/784: dwrite d3/d1b/d25/d4c/dcb/fe1 [0,4194304] 0 2024-02-22T00:33:25.874 INFO:tasks.workunit.client.1.smithi161.stdout:6/573: write d3/d10/d12/f2d [1169101,108223] 0 2024-02-22T00:33:25.881 INFO:tasks.workunit.client.1.smithi161.stdout:0/695: dread d14/f2c [0,4194304] 0 2024-02-22T00:33:25.881 INFO:tasks.workunit.client.1.smithi161.stdout:6/574: readlink d3/d10/d12/d2f/d7d/d5f/l71 0 2024-02-22T00:33:25.881 INFO:tasks.workunit.client.1.smithi161.stdout:0/696: readlink d14/d37/d42/d73/le2 0 2024-02-22T00:33:25.881 INFO:tasks.workunit.client.1.smithi161.stdout:2/682: dwrite de/d2b/f2d [0,4194304] 0 2024-02-22T00:33:25.884 INFO:tasks.workunit.client.1.smithi161.stdout:1/632: unlink d19/d1d/d2c/d2d/d3f/d69/f70 0 2024-02-22T00:33:25.885 INFO:tasks.workunit.client.1.smithi161.stdout:5/785: creat d3/dac/dd1/f10f x:0 0 0 2024-02-22T00:33:25.886 INFO:tasks.workunit.client.1.smithi161.stdout:6/575: chown d3/d10/d1b/c75 19106524 1 2024-02-22T00:33:25.887 INFO:tasks.workunit.client.1.smithi161.stdout:0/697: creat d14/d1a/d9d/dba/fe9 x:0 0 0 2024-02-22T00:33:25.888 INFO:tasks.workunit.client.1.smithi161.stdout:1/633: mkdir d19/d51/d64/d9b/da5/ddb 0 2024-02-22T00:33:25.890 INFO:tasks.workunit.client.1.smithi161.stdout:5/786: truncate d3/d1b/d25/fe6 732719 0 2024-02-22T00:33:25.890 INFO:tasks.workunit.client.1.smithi161.stdout:2/683: mknod de/d2b/d8b/da2/da5/dc4/d8f/cee 0 2024-02-22T00:33:25.892 INFO:tasks.workunit.client.1.smithi161.stdout:5/787: readlink d3/dac/dd1/lff 0 2024-02-22T00:33:25.892 INFO:tasks.workunit.client.1.smithi161.stdout:8/617: creat d1/d1c/d20/d22/d28/d7f/d92/d95/fcb x:0 0 0 2024-02-22T00:33:25.893 INFO:tasks.workunit.client.1.smithi161.stdout:6/576: symlink d3/lbb 0 2024-02-22T00:33:25.894 INFO:tasks.workunit.client.1.smithi161.stdout:9/612: dread d1/d25/d73/d60/d77/f87 [0,4194304] 0 2024-02-22T00:33:25.895 INFO:tasks.workunit.client.1.smithi161.stdout:2/684: write de/d2b/d83/f70 [1017395,102980] 0 2024-02-22T00:33:25.897 INFO:tasks.workunit.client.1.smithi161.stdout:9/613: write d1/d2/d4/d1f/f90 [1707672,90533] 0 2024-02-22T00:33:25.897 INFO:tasks.workunit.client.1.smithi161.stdout:6/577: chown d3/d10/d12/d2f/d7d/d5f/f90 1 1 2024-02-22T00:33:25.899 INFO:tasks.workunit.client.1.smithi161.stdout:5/788: dread d3/d1b/d91/d96/fb1 [0,4194304] 0 2024-02-22T00:33:25.903 INFO:tasks.workunit.client.1.smithi161.stdout:8/618: creat d1/d1c/d20/d22/fcc x:0 0 0 2024-02-22T00:33:25.904 INFO:tasks.workunit.client.1.smithi161.stdout:9/614: dread d1/f9e [0,4194304] 0 2024-02-22T00:33:25.906 INFO:tasks.workunit.client.1.smithi161.stdout:6/578: symlink d3/d10/d12/d2f/d7d/d5f/lbc 0 2024-02-22T00:33:25.906 INFO:tasks.workunit.client.1.smithi161.stdout:5/789: readlink d3/d1b/d25/dcc/lf4 0 2024-02-22T00:33:25.906 INFO:tasks.workunit.client.1.smithi161.stdout:8/619: dread - d1/d2f/f84 zero size 2024-02-22T00:33:25.907 INFO:tasks.workunit.client.1.smithi161.stdout:0/698: getdents d14/d1a/d3f 0 2024-02-22T00:33:25.912 INFO:tasks.workunit.client.1.smithi161.stdout:1/634: dwrite d19/d1d/d2c/d7d/f7f [0,4194304] 0 2024-02-22T00:33:25.912 INFO:tasks.workunit.client.1.smithi161.stdout:5/790: chown d3/d1c/d20/f71 1985574797 1 2024-02-22T00:33:25.916 INFO:tasks.workunit.client.1.smithi161.stdout:0/699: creat d14/fea x:0 0 0 2024-02-22T00:33:25.916 INFO:tasks.workunit.client.1.smithi161.stdout:5/791: chown d3/d9c/fdc 0 1 2024-02-22T00:33:25.917 INFO:tasks.workunit.client.1.smithi161.stdout:9/615: write d1/d2/d7/f16 [444021,21240] 0 2024-02-22T00:33:25.919 INFO:tasks.workunit.client.1.smithi161.stdout:8/620: write d1/d2f/d30/f33 [952392,125027] 0 2024-02-22T00:33:25.919 INFO:tasks.workunit.client.1.smithi161.stdout:1/635: readlink d19/d1d/d2c/d2d/d3f/d69/lb9 0 2024-02-22T00:33:25.920 INFO:tasks.workunit.client.1.smithi161.stdout:9/616: stat d1/d2/d4/d1f/c15 0 2024-02-22T00:33:25.921 INFO:tasks.workunit.client.1.smithi161.stdout:2/685: dwrite de/d2b/d65/d3a/f7c [4194304,4194304] 0 2024-02-22T00:33:25.923 INFO:tasks.workunit.client.1.smithi161.stdout:5/792: rename d3/dac/dd1/f10f to d3/d9c/f110 0 2024-02-22T00:33:25.927 INFO:tasks.workunit.client.1.smithi161.stdout:6/579: dwrite d3/d10/d1b/da5/f8d [0,4194304] 0 2024-02-22T00:33:25.929 INFO:tasks.workunit.client.1.smithi161.stdout:9/617: creat d1/d2/d7/fd6 x:0 0 0 2024-02-22T00:33:25.929 INFO:tasks.workunit.client.1.smithi161.stdout:2/686: symlink de/d11/d14/lef 0 2024-02-22T00:33:25.930 INFO:tasks.workunit.client.1.smithi161.stdout:5/793: stat d3/d1b/d25/c89 0 2024-02-22T00:33:25.932 INFO:tasks.workunit.client.1.smithi161.stdout:6/580: truncate d3/d30/f76 23200 0 2024-02-22T00:33:25.933 INFO:tasks.workunit.client.1.smithi161.stdout:2/687: creat de/d2b/d8b/db8/ff0 x:0 0 0 2024-02-22T00:33:25.935 INFO:tasks.workunit.client.1.smithi161.stdout:6/581: fdatasync d3/d10/d1b/d5e/fb7 0 2024-02-22T00:33:25.937 INFO:tasks.workunit.client.1.smithi161.stdout:8/621: dwrite d1/d1c/d20/d22/d28/d7f/d92/d95/f50 [0,4194304] 0 2024-02-22T00:33:25.938 INFO:tasks.workunit.client.1.smithi161.stdout:6/582: dread - d3/dc/f41 zero size 2024-02-22T00:33:25.941 INFO:tasks.workunit.client.1.smithi161.stdout:9/618: dwrite d1/d25/f43 [0,4194304] 0 2024-02-22T00:33:25.941 INFO:tasks.workunit.client.1.smithi161.stdout:8/622: write d1/d1c/d20/d22/f62 [4286682,65145] 0 2024-02-22T00:33:25.942 INFO:tasks.workunit.client.1.smithi161.stdout:6/583: unlink d3/d7c/l89 0 2024-02-22T00:33:25.944 INFO:tasks.workunit.client.1.smithi161.stdout:9/619: mkdir d1/d5/d9/da5/dbc/dd7 0 2024-02-22T00:33:25.944 INFO:tasks.workunit.client.1.smithi161.stdout:6/584: write d3/d10/fb0 [445276,104090] 0 2024-02-22T00:33:25.947 INFO:tasks.workunit.client.1.smithi161.stdout:2/688: rename de/d2b/d65/d60/d68/c7b to de/d2b/d65/cf1 0 2024-02-22T00:33:25.947 INFO:tasks.workunit.client.1.smithi161.stdout:9/620: creat d1/d25/d73/d60/d77/d99/fd8 x:0 0 0 2024-02-22T00:33:25.948 INFO:tasks.workunit.client.1.smithi161.stdout:9/621: chown d1/d2/d4 194 1 2024-02-22T00:33:25.950 INFO:tasks.workunit.client.1.smithi161.stdout:8/623: rename d1/d1c/d75/f4a to d1/d1c/d20/d22/fcd 0 2024-02-22T00:33:25.954 INFO:tasks.workunit.client.1.smithi161.stdout:2/689: rename de/ce0 to de/d2b/d65/cf2 0 2024-02-22T00:33:25.954 INFO:tasks.workunit.client.1.smithi161.stdout:8/624: creat d1/d1c/d20/d22/d28/d7f/db4/fce x:0 0 0 2024-02-22T00:33:25.956 INFO:tasks.workunit.client.1.smithi161.stdout:8/625: write d1/d2f/d30/f74 [1499777,130375] 0 2024-02-22T00:33:25.957 INFO:tasks.workunit.client.1.smithi161.stdout:2/690: truncate de/d2b/d83/d4f/f56 4463734 0 2024-02-22T00:33:25.959 INFO:tasks.workunit.client.1.smithi161.stdout:8/626: unlink d1/d1c/d20/d22/d28/d7f/d92/l9c 0 2024-02-22T00:33:25.962 INFO:tasks.workunit.client.1.smithi161.stdout:2/691: link de/d11/d5c/c27 de/d11/d14/cf3 0 2024-02-22T00:33:25.963 INFO:tasks.workunit.client.1.smithi161.stdout:8/627: getdents d1/d2f/d37/d64/d7b 0 2024-02-22T00:33:25.964 INFO:tasks.workunit.client.1.smithi161.stdout:2/692: chown de/d2b/d65/dd6 26055986 1 2024-02-22T00:33:25.966 INFO:tasks.workunit.client.1.smithi161.stdout:2/693: mkdir de/df4 0 2024-02-22T00:33:25.967 INFO:tasks.workunit.client.1.smithi161.stdout:8/628: truncate d1/d1c/f77 965026 0 2024-02-22T00:33:25.969 INFO:tasks.workunit.client.1.smithi161.stdout:2/694: symlink de/d2b/d8b/da2/da5/dc4/da7/lf5 0 2024-02-22T00:33:25.969 INFO:tasks.workunit.client.1.smithi161.stdout:8/629: fsync d1/d1c/d20/d22/d3f/f63 0 2024-02-22T00:33:25.971 INFO:tasks.workunit.client.1.smithi161.stdout:2/695: mkdir de/d2b/df6 0 2024-02-22T00:33:25.971 INFO:tasks.workunit.client.1.smithi161.stdout:2/696: chown de/d11/d5c/dea 0 1 2024-02-22T00:33:25.972 INFO:tasks.workunit.client.1.smithi161.stdout:2/697: fsync de/d2b/d83/d4f/fd9 0 2024-02-22T00:33:25.972 INFO:tasks.workunit.client.1.smithi161.stdout:8/630: getdents d1/d2f/d37 0 2024-02-22T00:33:25.974 INFO:tasks.workunit.client.1.smithi161.stdout:2/698: dread de/d11/fad [0,4194304] 0 2024-02-22T00:33:25.977 INFO:tasks.workunit.client.1.smithi161.stdout:2/699: rmdir de/d2b/d8b/da2/da5/dc3 0 2024-02-22T00:33:25.978 INFO:tasks.workunit.client.1.smithi161.stdout:2/700: chown de/d2b/d83/d4f/dc5/ld4 0 1 2024-02-22T00:33:25.981 INFO:tasks.workunit.client.1.smithi161.stdout:7/612: sync 2024-02-22T00:33:25.990 INFO:tasks.workunit.client.1.smithi161.stdout:9/622: dread d1/d25/dc4/d4f/f5e [4194304,4194304] 0 2024-02-22T00:33:25.990 INFO:tasks.workunit.client.1.smithi161.stdout:7/613: dwrite d3/f14 [8388608,4194304] 0 2024-02-22T00:33:25.991 INFO:tasks.workunit.client.1.smithi161.stdout:1/636: truncate d19/d85/d87/fb1 457243 0 2024-02-22T00:33:25.992 INFO:tasks.workunit.client.1.smithi161.stdout:5/794: truncate d3/d1c/d20/f5b 1069300 0 2024-02-22T00:33:25.996 INFO:tasks.workunit.client.1.smithi161.stdout:7/614: creat d3/df/d33/d35/d55/d63/d7b/d50/fc3 x:0 0 0 2024-02-22T00:33:25.998 INFO:tasks.workunit.client.1.smithi161.stdout:1/637: mknod d19/d48/d68/dd1/cdc 0 2024-02-22T00:33:26.000 INFO:tasks.workunit.client.1.smithi161.stdout:9/623: getdents d1/d25/d73/d60 0 2024-02-22T00:33:26.000 INFO:tasks.workunit.client.1.smithi161.stdout:9/624: fdatasync d1/d2/d4/fad 0 2024-02-22T00:33:26.001 INFO:tasks.workunit.client.1.smithi161.stdout:7/615: creat d3/dd/d59/fc4 x:0 0 0 2024-02-22T00:33:26.001 INFO:tasks.workunit.client.1.smithi161.stdout:7/616: readlink d3/df/l21 0 2024-02-22T00:33:26.002 INFO:tasks.workunit.client.1.smithi161.stdout:5/795: creat d3/d29/d80/d92/df7/dae/dbe/f111 x:0 0 0 2024-02-22T00:33:26.003 INFO:tasks.workunit.client.1.smithi161.stdout:7/617: fsync d3/df/d33/d35/d80/fb0 0 2024-02-22T00:33:26.008 INFO:tasks.workunit.client.1.smithi161.stdout:9/625: dwrite d1/d2/fd2 [0,4194304] 0 2024-02-22T00:33:26.018 INFO:tasks.workunit.client.1.smithi161.stdout:7/618: mkdir d3/df/d33/dbc/dc5 0 2024-02-22T00:33:26.019 INFO:tasks.workunit.client.1.smithi161.stdout:2/701: write de/d2b/d8b/da2/da5/dc4/da7/fc1 [226406,107150] 0 2024-02-22T00:33:26.028 INFO:tasks.workunit.client.1.smithi161.stdout:9/626: creat d1/fd9 x:0 0 0 2024-02-22T00:33:26.028 INFO:tasks.workunit.client.1.smithi161.stdout:1/638: write d19/d1d/d56/db2/fce [4188944,31891] 0 2024-02-22T00:33:26.028 INFO:tasks.workunit.client.1.smithi161.stdout:7/619: read - d3/df/d33/d35/d80/fc1 zero size 2024-02-22T00:33:26.030 INFO:tasks.workunit.client.1.smithi161.stdout:8/631: dread d1/d1c/d20/d22/d3f/f51 [0,4194304] 0 2024-02-22T00:33:26.031 INFO:tasks.workunit.client.1.smithi161.stdout:7/620: readlink d3/df/d43/l8b 0 2024-02-22T00:33:26.032 INFO:tasks.workunit.client.1.smithi161.stdout:1/639: dread - d19/d1d/d56/db2/fc8 zero size 2024-02-22T00:33:26.032 INFO:tasks.workunit.client.1.smithi161.stdout:9/627: dread - d1/d25/d73/d60/d77/d99/fa1 zero size 2024-02-22T00:33:26.033 INFO:tasks.workunit.client.1.smithi161.stdout:9/628: chown d1/d5/d9/d9c 2849 1 2024-02-22T00:33:26.037 INFO:tasks.workunit.client.1.smithi161.stdout:5/796: dread d3/d1b/d36/f83 [0,4194304] 0 2024-02-22T00:33:26.038 INFO:tasks.workunit.client.1.smithi161.stdout:5/797: fsync d3/d1c/d67/fcf 0 2024-02-22T00:33:26.040 INFO:tasks.workunit.client.1.smithi161.stdout:2/702: rename de/d2b/d83/dc9/fe9 to de/d2b/d8b/da2/da5/ff7 0 2024-02-22T00:33:26.041 INFO:tasks.workunit.client.1.smithi161.stdout:1/640: mkdir d19/d1d/d2c/d2d/d3f/d69/ddd 0 2024-02-22T00:33:26.042 INFO:tasks.workunit.client.1.smithi161.stdout:7/621: symlink d3/df/d33/d35/d55/d63/d7b/d8f/lc6 0 2024-02-22T00:33:26.042 INFO:tasks.workunit.client.1.smithi161.stdout:9/629: mknod d1/d2/d4/d95/cda 0 2024-02-22T00:33:26.043 INFO:tasks.workunit.client.1.smithi161.stdout:8/632: mkdir d1/d1c/d96/dcf 0 2024-02-22T00:33:26.045 INFO:tasks.workunit.client.1.smithi161.stdout:5/798: unlink d3/d29/d80/d92/f9d 0 2024-02-22T00:33:26.047 INFO:tasks.workunit.client.1.smithi161.stdout:9/630: readlink d1/d2/d4/d11/l7e 0 2024-02-22T00:33:26.049 INFO:tasks.workunit.client.1.smithi161.stdout:2/703: mkdir de/d11/d5c/dea/df8 0 2024-02-22T00:33:26.051 INFO:tasks.workunit.client.1.smithi161.stdout:8/633: dwrite d1/d1c/d75/d18/f45 [0,4194304] 0 2024-02-22T00:33:26.052 INFO:tasks.workunit.client.1.smithi161.stdout:5/799: rename d3/d1c/d67/fcf to d3/d1b/d25/d4c/dcb/f112 0 2024-02-22T00:33:26.053 INFO:tasks.workunit.client.1.smithi161.stdout:7/622: creat d3/df/d33/d35/d55/d63/d7b/d30/fc7 x:0 0 0 2024-02-22T00:33:26.059 INFO:tasks.workunit.client.1.smithi161.stdout:2/704: rename de/d2b/d65/d60/d68/f7a to de/d2b/d83/d4f/ff9 0 2024-02-22T00:33:26.062 INFO:tasks.workunit.client.1.smithi161.stdout:9/631: dwrite d1/d25/d73/fc2 [0,4194304] 0 2024-02-22T00:33:26.067 INFO:tasks.workunit.client.1.smithi161.stdout:5/800: rmdir d3/d1b/d25/d109 0 2024-02-22T00:33:26.068 INFO:tasks.workunit.client.1.smithi161.stdout:5/801: stat d3/d1c/d67 0 2024-02-22T00:33:26.070 INFO:tasks.workunit.client.1.smithi161.stdout:9/632: dwrite d1/d25/dc4/d4f/fbd [4194304,4194304] 0 2024-02-22T00:33:26.071 INFO:tasks.workunit.client.1.smithi161.stdout:5/802: chown d3/d1b/d91/lbd 246743 1 2024-02-22T00:33:26.072 INFO:tasks.workunit.client.1.smithi161.stdout:5/803: stat d3/d1b/d25/d4c/dcb 0 2024-02-22T00:33:26.075 INFO:tasks.workunit.client.1.smithi161.stdout:9/633: creat d1/d2/d4/d95/db8/fdb x:0 0 0 2024-02-22T00:33:26.080 INFO:tasks.workunit.client.1.smithi161.stdout:5/804: dread d3/d1b/d36/f55 [0,4194304] 0 2024-02-22T00:33:26.080 INFO:tasks.workunit.client.1.smithi161.stdout:9/634: creat d1/d25/d73/d60/d77/d99/fdc x:0 0 0 2024-02-22T00:33:26.081 INFO:tasks.workunit.client.1.smithi161.stdout:1/641: dwrite d19/d48/f5c [4194304,4194304] 0 2024-02-22T00:33:26.084 INFO:tasks.workunit.client.1.smithi161.stdout:5/805: dread - d3/d1b/d8f/fc6 zero size 2024-02-22T00:33:26.088 INFO:tasks.workunit.client.1.smithi161.stdout:1/642: rename d19/d51/c78 to d19/d48/d68/dd1/cde 0 2024-02-22T00:33:26.090 INFO:tasks.workunit.client.1.smithi161.stdout:7/623: dread d3/dd/d59/fb8 [0,4194304] 0 2024-02-22T00:33:26.091 INFO:tasks.workunit.client.1.smithi161.stdout:8/634: truncate d1/d1c/f89 3185393 0 2024-02-22T00:33:26.092 INFO:tasks.workunit.client.1.smithi161.stdout:2/705: write de/d2b/d65/d60/d68/fa3 [1095043,43202] 0 2024-02-22T00:33:26.093 INFO:tasks.workunit.client.1.smithi161.stdout:7/624: fdatasync d3/f1b 0 2024-02-22T00:33:26.093 INFO:tasks.workunit.client.1.smithi161.stdout:9/635: dwrite d1/d2/d4/fa4 [0,4194304] 0 2024-02-22T00:33:26.097 INFO:tasks.workunit.client.1.smithi161.stdout:7/625: readlink d3/dbf/d64/l91 0 2024-02-22T00:33:26.097 INFO:tasks.workunit.client.1.smithi161.stdout:5/806: dwrite d3/d29/d80/d92/df7/fc5 [0,4194304] 0 2024-02-22T00:33:26.099 INFO:tasks.workunit.client.1.smithi161.stdout:2/706: write de/d2b/d8b/da2/da5/dc4/f74 [69402,73642] 0 2024-02-22T00:33:26.106 INFO:tasks.workunit.client.1.smithi161.stdout:5/807: unlink d3/d1c/f76 0 2024-02-22T00:33:26.110 INFO:tasks.workunit.client.1.smithi161.stdout:8/635: truncate d1/d2f/d37/d64/f91 882135 0 2024-02-22T00:33:26.112 INFO:tasks.workunit.client.1.smithi161.stdout:2/707: rename de/d11/d32/f82 to de/d2b/d65/d3a/ffa 0 2024-02-22T00:33:26.114 INFO:tasks.workunit.client.1.smithi161.stdout:5/808: mkdir d3/d1c/d67/d113 0 2024-02-22T00:33:26.121 INFO:tasks.workunit.client.1.smithi161.stdout:9/636: dwrite d1/d2/d4/d95/fb9 [0,4194304] 0 2024-02-22T00:33:26.122 INFO:tasks.workunit.client.1.smithi161.stdout:5/809: unlink d3/d1b/d25/d4c/dd2/fe0 0 2024-02-22T00:33:26.123 INFO:tasks.workunit.client.1.smithi161.stdout:5/810: read - d3/d1b/d36/fea zero size 2024-02-22T00:33:26.124 INFO:tasks.workunit.client.1.smithi161.stdout:8/636: mknod d1/d2f/dc5/cd0 0 2024-02-22T00:33:26.126 INFO:tasks.workunit.client.1.smithi161.stdout:5/811: dread - d3/d1b/d8f/fc6 zero size 2024-02-22T00:33:26.127 INFO:tasks.workunit.client.1.smithi161.stdout:5/812: chown d3/d1c/d20/f35 175410 1 2024-02-22T00:33:26.127 INFO:tasks.workunit.client.1.smithi161.stdout:7/626: dread d3/df/d33/d74/f98 [0,4194304] 0 2024-02-22T00:33:26.129 INFO:tasks.workunit.client.1.smithi161.stdout:5/813: write d3/dac/fde [114291,107478] 0 2024-02-22T00:33:26.130 INFO:tasks.workunit.client.1.smithi161.stdout:5/814: chown d3/d1b/d25/d84/l98 88727768 1 2024-02-22T00:33:26.131 INFO:tasks.workunit.client.1.smithi161.stdout:9/637: rename d1/d2/d4/d95/db8/ld1 to d1/d25/d73/d60/d77/d93/ldd 0 2024-02-22T00:33:26.133 INFO:tasks.workunit.client.1.smithi161.stdout:8/637: dread d1/d1c/d20/d22/fcd [0,4194304] 0 2024-02-22T00:33:26.134 INFO:tasks.workunit.client.1.smithi161.stdout:7/627: symlink d3/df/d43/lc8 0 2024-02-22T00:33:26.135 INFO:tasks.workunit.client.1.smithi161.stdout:9/638: dread d1/d2/d4/d1f/dab/fb7 [0,4194304] 0 2024-02-22T00:33:26.138 INFO:tasks.workunit.client.1.smithi161.stdout:2/708: dwrite de/d2b/d83/d4f/f54 [4194304,4194304] 0 2024-02-22T00:33:26.139 INFO:tasks.workunit.client.1.smithi161.stdout:7/628: write d3/df/d33/d35/d55/d63/d7b/d50/f61 [3046160,116869] 0 2024-02-22T00:33:26.140 INFO:tasks.workunit.client.1.smithi161.stdout:8/638: dread - d1/d1c/d20/d22/d28/d7f/d92/d95/fcb zero size 2024-02-22T00:33:26.141 INFO:tasks.workunit.client.1.smithi161.stdout:9/639: truncate d1/d2/f6d 3460609 0 2024-02-22T00:33:26.142 INFO:tasks.workunit.client.1.smithi161.stdout:7/629: chown d3/df/d33/l46 9 1 2024-02-22T00:33:26.143 INFO:tasks.workunit.client.1.smithi161.stdout:9/640: stat d1/d2/d4/d11/f31 0 2024-02-22T00:33:26.144 INFO:tasks.workunit.client.1.smithi161.stdout:7/630: readlink d3/df/d33/d35/d55/d63/d7b/d8f/lc6 0 2024-02-22T00:33:26.144 INFO:tasks.workunit.client.1.smithi161.stdout:2/709: mkdir de/d2b/d8b/de6/dfb 0 2024-02-22T00:33:26.149 INFO:tasks.workunit.client.1.smithi161.stdout:9/641: unlink d1/d2/d4/d1f/f90 0 2024-02-22T00:33:26.154 INFO:tasks.workunit.client.1.smithi161.stdout:9/642: write d1/d25/dc4/fba [2990827,24973] 0 2024-02-22T00:33:26.154 INFO:tasks.workunit.client.1.smithi161.stdout:5/815: dwrite d3/d1b/f38 [0,4194304] 0 2024-02-22T00:33:26.155 INFO:tasks.workunit.client.1.smithi161.stdout:8/639: dwrite d1/d1c/f76 [0,4194304] 0 2024-02-22T00:33:26.165 INFO:tasks.workunit.client.1.smithi161.stdout:9/643: read - d1/d25/dc4/f6f zero size 2024-02-22T00:33:26.167 INFO:tasks.workunit.client.1.smithi161.stdout:8/640: mknod d1/d1c/dbd/cd1 0 2024-02-22T00:33:26.169 INFO:tasks.workunit.client.1.smithi161.stdout:9/644: read - d1/d25/d73/d60/d77/d99/fa1 zero size 2024-02-22T00:33:26.170 INFO:tasks.workunit.client.1.smithi161.stdout:9/645: chown d1/d2 958 1 2024-02-22T00:33:26.171 INFO:tasks.workunit.client.1.smithi161.stdout:8/641: mkdir d1/d2f/d37/dd2 0 2024-02-22T00:33:26.173 INFO:tasks.workunit.client.1.smithi161.stdout:5/816: dwrite d3/d1b/d36/f3b [0,4194304] 0 2024-02-22T00:33:26.176 INFO:tasks.workunit.client.1.smithi161.stdout:9/646: creat d1/d2/d4/d95/fde x:0 0 0 2024-02-22T00:33:26.177 INFO:tasks.workunit.client.1.smithi161.stdout:2/710: dread de/d2b/d83/dc9/fd2 [0,4194304] 0 2024-02-22T00:33:26.178 INFO:tasks.workunit.client.1.smithi161.stdout:5/817: chown d3/dac/d8b 105321753 1 2024-02-22T00:33:26.184 INFO:tasks.workunit.client.1.smithi161.stdout:7/631: dread d3/df/d33/d35/d55/d63/d7b/f29 [0,4194304] 0 2024-02-22T00:33:26.186 INFO:tasks.workunit.client.1.smithi161.stdout:2/711: mknod de/d2b/d83/d4f/dc5/cfc 0 2024-02-22T00:33:26.186 INFO:tasks.workunit.client.1.smithi161.stdout:9/647: rmdir d1/d5/d9/da5/dbc/dd7 0 2024-02-22T00:33:26.187 INFO:tasks.workunit.client.1.smithi161.stdout:2/712: fsync de/d11/f29 0 2024-02-22T00:33:26.189 INFO:tasks.workunit.client.1.smithi161.stdout:2/713: dread - de/d2b/d83/d4f/fb6 zero size 2024-02-22T00:33:26.191 INFO:tasks.workunit.client.1.smithi161.stdout:9/648: fdatasync d1/d5/f59 0 2024-02-22T00:33:26.191 INFO:tasks.workunit.client.1.smithi161.stdout:7/632: creat d3/df/d33/dbc/dc5/fc9 x:0 0 0 2024-02-22T00:33:26.191 INFO:tasks.workunit.client.1.smithi161.stdout:5/818: link d3/d1c/f48 d3/f114 0 2024-02-22T00:33:26.192 INFO:tasks.workunit.client.1.smithi161.stdout:2/714: truncate de/d2b/d8b/ddc/fec 693733 0 2024-02-22T00:33:26.194 INFO:tasks.workunit.client.1.smithi161.stdout:9/649: mknod d1/d2/d4/d11/d21/cdf 0 2024-02-22T00:33:26.194 INFO:tasks.workunit.client.1.smithi161.stdout:5/819: dread d3/f95 [0,4194304] 0 2024-02-22T00:33:26.195 INFO:tasks.workunit.client.1.smithi161.stdout:9/650: chown d1/d2/d4/d1f/dab/fb7 4 1 2024-02-22T00:33:26.196 INFO:tasks.workunit.client.1.smithi161.stdout:2/715: mkdir de/dfd 0 2024-02-22T00:33:26.197 INFO:tasks.workunit.client.1.smithi161.stdout:9/651: write d1/d25/dc4/f32 [1185077,80047] 0 2024-02-22T00:33:26.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/716: chown de/d2b/d65/d3a/f75 186235 1 2024-02-22T00:33:26.199 INFO:tasks.workunit.client.1.smithi161.stdout:5/820: rename d3/d1c/d62/f106 to d3/d1c/d62/f115 0 2024-02-22T00:33:26.199 INFO:tasks.workunit.client.1.smithi161.stdout:9/652: chown d1/d25/d73/d60/d77/d93/l8b 738588 1 2024-02-22T00:33:26.200 INFO:tasks.workunit.client.1.smithi161.stdout:2/717: fdatasync de/d2b/d65/d60/d68/fc6 0 2024-02-22T00:33:26.200 INFO:tasks.workunit.client.1.smithi161.stdout:8/642: write d1/d1c/f3d [4949020,24250] 0 2024-02-22T00:33:26.201 INFO:tasks.workunit.client.1.smithi161.stdout:9/653: chown d1/d5/f97 384034 1 2024-02-22T00:33:26.202 INFO:tasks.workunit.client.1.smithi161.stdout:7/633: rename d3/df/d33/d35/d55/d63/d7b/d30/d44/f9f to d3/df/d33/dbc/dc5/fca 0 2024-02-22T00:33:26.206 INFO:tasks.workunit.client.1.smithi161.stdout:8/643: mkdir d1/d2f/d30/dd3 0 2024-02-22T00:33:26.208 INFO:tasks.workunit.client.1.smithi161.stdout:9/654: creat d1/d2/d7/da/fe0 x:0 0 0 2024-02-22T00:33:26.212 INFO:tasks.workunit.client.1.smithi161.stdout:2/718: getdents de/d2b/d65/dd6 0 2024-02-22T00:33:26.215 INFO:tasks.workunit.client.1.smithi161.stdout:8/644: dwrite d1/d1c/f76 [0,4194304] 0 2024-02-22T00:33:26.218 INFO:tasks.workunit.client.1.smithi161.stdout:9/655: link d1/d5/d9/c14 d1/d5/d9/da5/ce1 0 2024-02-22T00:33:26.219 INFO:tasks.workunit.client.1.smithi161.stdout:7/634: dwrite d3/dbf/d64/f89 [0,4194304] 0 2024-02-22T00:33:26.230 INFO:tasks.workunit.client.1.smithi161.stdout:2/719: dwrite de/d2b/d65/d60/d68/fa3 [0,4194304] 0 2024-02-22T00:33:26.232 INFO:tasks.workunit.client.1.smithi161.stdout:7/635: mkdir d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb 0 2024-02-22T00:33:26.234 INFO:tasks.workunit.client.1.smithi161.stdout:5/821: dwrite d3/f26 [0,4194304] 0 2024-02-22T00:33:26.237 INFO:tasks.workunit.client.1.smithi161.stdout:8/645: dwrite d1/d1c/d75/f85 [0,4194304] 0 2024-02-22T00:33:26.238 INFO:tasks.workunit.client.1.smithi161.stdout:8/646: stat d1/cc2 0 2024-02-22T00:33:26.244 INFO:tasks.workunit.client.1.smithi161.stdout:5/822: mkdir d3/d1c/d20/d116 0 2024-02-22T00:33:26.244 INFO:tasks.workunit.client.1.smithi161.stdout:2/720: mknod de/d2b/d8b/ddc/cfe 0 2024-02-22T00:33:26.244 INFO:tasks.workunit.client.1.smithi161.stdout:7/636: creat d3/dd/d59/fcc x:0 0 0 2024-02-22T00:33:26.245 INFO:tasks.workunit.client.1.smithi161.stdout:2/721: rmdir de/d2b/d8b/da2/da5/dc4/da7 39 2024-02-22T00:33:26.245 INFO:tasks.workunit.client.1.smithi161.stdout:8/647: read d1/d1c/d75/d18/fb3 [3889389,121112] 0 2024-02-22T00:33:26.246 INFO:tasks.workunit.client.1.smithi161.stdout:9/656: dread d1/d2/f6d [0,4194304] 0 2024-02-22T00:33:26.247 INFO:tasks.workunit.client.1.smithi161.stdout:7/637: chown d3/dd/d59/fb8 101 1 2024-02-22T00:33:26.248 INFO:tasks.workunit.client.1.smithi161.stdout:5/823: creat d3/d1c/d67/f117 x:0 0 0 2024-02-22T00:33:26.251 INFO:tasks.workunit.client.1.smithi161.stdout:8/648: mknod d1/d2f/d30/cd4 0 2024-02-22T00:33:26.251 INFO:tasks.workunit.client.1.smithi161.stdout:9/657: write d1/d25/dc4/f32 [4876318,65682] 0 2024-02-22T00:33:26.253 INFO:tasks.workunit.client.1.smithi161.stdout:5/824: mkdir d3/d1b/d118 0 2024-02-22T00:33:26.257 INFO:tasks.workunit.client.1.smithi161.stdout:2/722: mknod de/d2b/d65/cff 0 2024-02-22T00:33:26.261 INFO:tasks.workunit.client.1.smithi161.stdout:8/649: dwrite d1/d1c/d75/d18/f45 [0,4194304] 0 2024-02-22T00:33:26.263 INFO:tasks.workunit.client.1.smithi161.stdout:8/650: write d1/d1c/d75/d18/f68 [1017128,73748] 0 2024-02-22T00:33:26.264 INFO:tasks.workunit.client.1.smithi161.stdout:2/723: dread de/d11/f13 [4194304,4194304] 0 2024-02-22T00:33:26.265 INFO:tasks.workunit.client.1.smithi161.stdout:5/825: dread d3/d1c/d20/f12 [4194304,4194304] 0 2024-02-22T00:33:26.265 INFO:tasks.workunit.client.1.smithi161.stdout:8/651: dread - d1/d1c/d20/d22/d28/d7f/d92/d95/fcb zero size 2024-02-22T00:33:26.277 INFO:tasks.workunit.client.1.smithi161.stdout:3/593: sync 2024-02-22T00:33:26.277 INFO:tasks.workunit.client.1.smithi161.stdout:4/592: sync 2024-02-22T00:33:26.277 INFO:tasks.workunit.client.1.smithi161.stdout:0/700: sync 2024-02-22T00:33:26.278 INFO:tasks.workunit.client.1.smithi161.stdout:0/701: dread - d14/d44/fe7 zero size 2024-02-22T00:33:26.278 INFO:tasks.workunit.client.1.smithi161.stdout:4/593: chown d5/d8/d41/d53/d6c/d72/fce 12442 1 2024-02-22T00:33:26.279 INFO:tasks.workunit.client.1.smithi161.stdout:0/702: dread - d14/d37/d42/d73/f74 zero size 2024-02-22T00:33:26.283 INFO:tasks.workunit.client.1.smithi161.stdout:3/594: dwrite da/dc/d11/d40/d59/d93/daa/fb4 [4194304,4194304] 0 2024-02-22T00:33:26.295 INFO:tasks.workunit.client.1.smithi161.stdout:9/658: mkdir d1/d25/dc4/d4f/da3/de2 0 2024-02-22T00:33:26.297 INFO:tasks.workunit.client.1.smithi161.stdout:8/652: dread d1/d2f/f97 [0,4194304] 0 2024-02-22T00:33:26.300 INFO:tasks.workunit.client.1.smithi161.stdout:5/826: unlink d3/d29/d80/d92/df7/dae/fc3 0 2024-02-22T00:33:26.303 INFO:tasks.workunit.client.1.smithi161.stdout:9/659: dread d1/d2/d4/d11/f28 [4194304,4194304] 0 2024-02-22T00:33:26.303 INFO:tasks.workunit.client.1.smithi161.stdout:4/594: symlink d5/d8/d41/d57/dbe/d28/d38/le3 0 2024-02-22T00:33:26.304 INFO:tasks.workunit.client.1.smithi161.stdout:3/595: dread da/dc/d11/d26/f21 [0,4194304] 0 2024-02-22T00:33:26.306 INFO:tasks.workunit.client.1.smithi161.stdout:0/703: rename d14/d1a/d3f/d9a to d14/d44/dbf/deb 0 2024-02-22T00:33:26.307 INFO:tasks.workunit.client.1.smithi161.stdout:7/638: link d3/df/d43/lc8 d3/df/d43/lcd 0 2024-02-22T00:33:26.310 INFO:tasks.workunit.client.1.smithi161.stdout:3/596: dread da/d29/f54 [0,4194304] 0 2024-02-22T00:33:26.316 INFO:tasks.workunit.client.1.smithi161.stdout:7/639: dwrite d3/fa9 [0,4194304] 0 2024-02-22T00:33:26.316 INFO:tasks.workunit.client.1.smithi161.stdout:5/827: dread d3/f19 [0,4194304] 0 2024-02-22T00:33:26.317 INFO:tasks.workunit.client.1.smithi161.stdout:4/595: creat d5/d10/d14/d4f/fe4 x:0 0 0 2024-02-22T00:33:26.318 INFO:tasks.workunit.client.1.smithi161.stdout:4/596: chown d5/d8/d41/d57/l68 5 1 2024-02-22T00:33:26.319 INFO:tasks.workunit.client.1.smithi161.stdout:4/597: readlink d5/d8/d41/d57/dbe/d28/d38/le3 0 2024-02-22T00:33:26.323 INFO:tasks.workunit.client.1.smithi161.stdout:8/653: mknod d1/d1c/cd5 0 2024-02-22T00:33:26.324 INFO:tasks.workunit.client.1.smithi161.stdout:2/724: write de/f1c [1553657,46615] 0 2024-02-22T00:33:26.325 INFO:tasks.workunit.client.1.smithi161.stdout:8/654: read d1/d1c/d20/d22/d3f/f63 [513731,104899] 0 2024-02-22T00:33:26.328 INFO:tasks.workunit.client.1.smithi161.stdout:7/640: dread d3/df/d33/dbc/dc5/fca [0,4194304] 0 2024-02-22T00:33:26.331 INFO:tasks.workunit.client.1.smithi161.stdout:5/828: getdents d3/d1b/d118 0 2024-02-22T00:33:26.333 INFO:tasks.workunit.client.1.smithi161.stdout:9/660: rename d1/d25/dc4/d4f/f5e to d1/d2/d7/fe3 0 2024-02-22T00:33:26.334 INFO:tasks.workunit.client.1.smithi161.stdout:0/704: creat d14/d37/d42/d73/dc7/de0/de5/fec x:0 0 0 2024-02-22T00:33:26.336 INFO:tasks.workunit.client.1.smithi161.stdout:4/598: fdatasync d5/d17/f4a 0 2024-02-22T00:33:26.337 INFO:tasks.workunit.client.1.smithi161.stdout:2/725: rename de/d2b/d83/dc9 to de/d2b/d65/d60/d68/d100 0 2024-02-22T00:33:26.342 INFO:tasks.workunit.client.1.smithi161.stdout:4/599: dread - d5/d10/da9/fd0 zero size 2024-02-22T00:33:26.342 INFO:tasks.workunit.client.1.smithi161.stdout:3/597: dwrite da/dc/d11/d26/f19 [0,4194304] 0 2024-02-22T00:33:26.343 INFO:tasks.workunit.client.1.smithi161.stdout:7/641: dwrite d3/fa9 [0,4194304] 0 2024-02-22T00:33:26.343 INFO:tasks.workunit.client.1.smithi161.stdout:2/726: readlink de/d2b/d65/d60/ld8 0 2024-02-22T00:33:26.346 INFO:tasks.workunit.client.1.smithi161.stdout:2/727: fsync de/d11/d32/fd5 0 2024-02-22T00:33:26.347 INFO:tasks.workunit.client.1.smithi161.stdout:8/655: dwrite d1/d1c/dbd/f8c [0,4194304] 0 2024-02-22T00:33:26.348 INFO:tasks.workunit.client.1.smithi161.stdout:3/598: write da/d29/d8e/d37/d39/f4b [3100123,86332] 0 2024-02-22T00:33:26.350 INFO:tasks.workunit.client.1.smithi161.stdout:0/705: rename d14/d37/d42/da2/le4 to d14/d37/d42/d8e/d92/da5/dcd/led 0 2024-02-22T00:33:26.350 INFO:tasks.workunit.client.1.smithi161.stdout:2/728: write de/d2b/d83/f70 [992832,40579] 0 2024-02-22T00:33:26.351 INFO:tasks.workunit.client.1.smithi161.stdout:7/642: stat d3/dd/l23 0 2024-02-22T00:33:26.352 INFO:tasks.workunit.client.1.smithi161.stdout:0/706: chown d14/f35 9026744 1 2024-02-22T00:33:26.353 INFO:tasks.workunit.client.1.smithi161.stdout:2/729: readlink de/d2b/d65/d3a/le1 0 2024-02-22T00:33:26.356 INFO:tasks.workunit.client.1.smithi161.stdout:9/661: dwrite d1/d2/f6d [0,4194304] 0 2024-02-22T00:33:26.356 INFO:tasks.workunit.client.1.smithi161.stdout:4/600: fsync d5/f13 0 2024-02-22T00:33:26.357 INFO:tasks.workunit.client.1.smithi161.stdout:3/599: creat da/d56/fc3 x:0 0 0 2024-02-22T00:33:26.358 INFO:tasks.workunit.client.1.smithi161.stdout:0/707: creat d14/d37/d42/d8e/d92/fee x:0 0 0 2024-02-22T00:33:26.360 INFO:tasks.workunit.client.1.smithi161.stdout:3/600: chown da/d29/d53 15580 1 2024-02-22T00:33:26.361 INFO:tasks.workunit.client.1.smithi161.stdout:2/730: symlink de/d2b/d83/d4f/l101 0 2024-02-22T00:33:26.362 INFO:tasks.workunit.client.1.smithi161.stdout:7/643: symlink d3/dd/lce 0 2024-02-22T00:33:26.364 INFO:tasks.workunit.client.1.smithi161.stdout:9/662: creat d1/d25/d73/d60/d77/fe4 x:0 0 0 2024-02-22T00:33:26.365 INFO:tasks.workunit.client.1.smithi161.stdout:0/708: mkdir d14/d44/dbf/deb/def 0 2024-02-22T00:33:26.369 INFO:tasks.workunit.client.1.smithi161.stdout:8/656: link d1/d1c/d20/d22/d3f/l5b d1/d1c/d20/d22/d28/d36/d6c/da1/ld6 0 2024-02-22T00:33:26.369 INFO:tasks.workunit.client.1.smithi161.stdout:9/663: dread - d1/d25/dc4/d4f/da3/fce zero size 2024-02-22T00:33:26.371 INFO:tasks.workunit.client.1.smithi161.stdout:2/731: getdents de/dfd 0 2024-02-22T00:33:26.374 INFO:tasks.workunit.client.1.smithi161.stdout:9/664: rmdir d1/d2 39 2024-02-22T00:33:26.375 INFO:tasks.workunit.client.1.smithi161.stdout:7/644: dwrite d3/dd/f1d [0,4194304] 0 2024-02-22T00:33:26.377 INFO:tasks.workunit.client.1.smithi161.stdout:0/709: dwrite f3 [0,4194304] 0 2024-02-22T00:33:26.380 INFO:tasks.workunit.client.1.smithi161.stdout:9/665: mknod d1/d25/ce5 0 2024-02-22T00:33:26.385 INFO:tasks.workunit.client.1.smithi161.stdout:2/732: creat de/d2b/d8b/da2/f102 x:0 0 0 2024-02-22T00:33:26.386 INFO:tasks.workunit.client.1.smithi161.stdout:0/710: write d14/d37/d42/d8e/d92/fd6 [1257672,95830] 0 2024-02-22T00:33:26.386 INFO:tasks.workunit.client.1.smithi161.stdout:7/645: symlink d3/df/d33/d35/d55/d63/d7b/lcf 0 2024-02-22T00:33:26.387 INFO:tasks.workunit.client.1.smithi161.stdout:9/666: fdatasync d1/d2/d4/d95/faf 0 2024-02-22T00:33:26.388 INFO:tasks.workunit.client.1.smithi161.stdout:7/646: write f2 [1461262,122804] 0 2024-02-22T00:33:26.389 INFO:tasks.workunit.client.1.smithi161.stdout:8/657: dread d1/d2f/d30/f33 [0,4194304] 0 2024-02-22T00:33:26.389 INFO:tasks.workunit.client.1.smithi161.stdout:2/733: symlink de/d2b/d8b/ddc/l103 0 2024-02-22T00:33:26.390 INFO:tasks.workunit.client.1.smithi161.stdout:4/601: dread d5/d10/d14/f5d [0,4194304] 0 2024-02-22T00:33:26.392 INFO:tasks.workunit.client.1.smithi161.stdout:7/647: creat d3/dbf/d64/fd0 x:0 0 0 2024-02-22T00:33:26.394 INFO:tasks.workunit.client.1.smithi161.stdout:9/667: mknod d1/d25/d73/d60/db0/ce6 0 2024-02-22T00:33:26.395 INFO:tasks.workunit.client.1.smithi161.stdout:4/602: chown d5/l4c 5 1 2024-02-22T00:33:26.395 INFO:tasks.workunit.client.1.smithi161.stdout:8/658: mkdir d1/d2f/d37/dd7 0 2024-02-22T00:33:26.396 INFO:tasks.workunit.client.1.smithi161.stdout:9/668: dread - d1/d2/d4/d95/fde zero size 2024-02-22T00:33:26.396 INFO:tasks.workunit.client.1.smithi161.stdout:2/734: write de/d2b/d65/d60/d68/d100/fd2 [9097905,19611] 0 2024-02-22T00:33:26.397 INFO:tasks.workunit.client.1.smithi161.stdout:7/648: symlink d3/df/ld1 0 2024-02-22T00:33:26.399 INFO:tasks.workunit.client.1.smithi161.stdout:4/603: symlink d5/d8/d41/d53/le5 0 2024-02-22T00:33:26.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/649: write d3/f1b [1311753,103538] 0 2024-02-22T00:33:26.400 INFO:tasks.workunit.client.1.smithi161.stdout:9/669: symlink d1/d2/d4/d11/d21/le7 0 2024-02-22T00:33:26.404 INFO:tasks.workunit.client.1.smithi161.stdout:9/670: creat d1/d2/d4/d1f/fe8 x:0 0 0 2024-02-22T00:33:26.406 INFO:tasks.workunit.client.1.smithi161.stdout:8/659: dwrite d1/d1c/d20/d22/d28/d7f/d92/d95/fcb [0,4194304] 0 2024-02-22T00:33:26.407 INFO:tasks.workunit.client.1.smithi161.stdout:4/604: mknod d5/d8/d41/d57/dbe/d28/d63/d65/dcd/ce6 0 2024-02-22T00:33:26.410 INFO:tasks.workunit.client.1.smithi161.stdout:9/671: mknod d1/d2/d4/d1f/dab/ce9 0 2024-02-22T00:33:26.411 INFO:tasks.workunit.client.1.smithi161.stdout:9/672: chown d1/d25/d73/d60/d77/d93 1026 1 2024-02-22T00:33:26.412 INFO:tasks.workunit.client.1.smithi161.stdout:8/660: creat d1/d2f/d37/d64/fd8 x:0 0 0 2024-02-22T00:33:26.413 INFO:tasks.workunit.client.1.smithi161.stdout:4/605: creat d5/d8/d41/d53/fe7 x:0 0 0 2024-02-22T00:33:26.414 INFO:tasks.workunit.client.1.smithi161.stdout:2/735: link de/d2b/d65/c6a de/d11/c104 0 2024-02-22T00:33:26.418 INFO:tasks.workunit.client.1.smithi161.stdout:8/661: mkdir d1/d1c/d20/d22/d28/d7f/d92/d95/dd9 0 2024-02-22T00:33:26.419 INFO:tasks.workunit.client.1.smithi161.stdout:4/606: mknod d5/db0/ce8 0 2024-02-22T00:33:26.419 INFO:tasks.workunit.client.1.smithi161.stdout:7/650: mkdir d3/df/d33/d35/d55/d63/d7b/d8f/dd2 0 2024-02-22T00:33:26.423 INFO:tasks.workunit.client.1.smithi161.stdout:9/673: dwrite d1/d2/d4/d1f/dab/dcd/fd3 [0,4194304] 0 2024-02-22T00:33:26.425 INFO:tasks.workunit.client.1.smithi161.stdout:2/736: dread f8 [0,4194304] 0 2024-02-22T00:33:26.429 INFO:tasks.workunit.client.1.smithi161.stdout:9/674: write d1/d5/f36 [3903118,32079] 0 2024-02-22T00:33:26.429 INFO:tasks.workunit.client.1.smithi161.stdout:6/585: sync 2024-02-22T00:33:26.431 INFO:tasks.workunit.client.1.smithi161.stdout:9/675: stat d1/d5/d9/d9c/ccb 0 2024-02-22T00:33:26.432 INFO:tasks.workunit.client.1.smithi161.stdout:2/737: unlink de/d2b/d83/d4f/f54 0 2024-02-22T00:33:26.433 INFO:tasks.workunit.client.1.smithi161.stdout:2/738: write de/f67 [1085648,1405] 0 2024-02-22T00:33:26.433 INFO:tasks.workunit.client.1.smithi161.stdout:9/676: readlink d1/d2/d4/d11/d21/la9 0 2024-02-22T00:33:26.433 INFO:tasks.workunit.client.1.smithi161.stdout:8/662: rmdir d1/d1c/d20/d22/d28/d36/d6c/dc4 0 2024-02-22T00:33:26.433 INFO:tasks.workunit.client.1.smithi161.stdout:2/739: chown de/d2b/d65/d3a/f75 18814750 1 2024-02-22T00:33:26.435 INFO:tasks.workunit.client.1.smithi161.stdout:4/607: creat d5/d8/d41/d57/dbe/d28/fe9 x:0 0 0 2024-02-22T00:33:26.440 INFO:tasks.workunit.client.1.smithi161.stdout:7/651: link d3/df/c5a d3/dd/cd3 0 2024-02-22T00:33:26.440 INFO:tasks.workunit.client.1.smithi161.stdout:7/652: dread - d3/df/fb9 zero size 2024-02-22T00:33:26.440 INFO:tasks.workunit.client.1.smithi161.stdout:4/608: readlink d5/d10/da9/lb8 0 2024-02-22T00:33:26.442 INFO:tasks.workunit.client.1.smithi161.stdout:2/740: getdents de/d2b/d65 0 2024-02-22T00:33:26.443 INFO:tasks.workunit.client.1.smithi161.stdout:7/653: write d3/dd/d59/f7c [748600,38358] 0 2024-02-22T00:33:26.443 INFO:tasks.workunit.client.1.smithi161.stdout:2/741: stat de/d2b/d65/cff 0 2024-02-22T00:33:26.449 INFO:tasks.workunit.client.1.smithi161.stdout:6/586: write d3/d10/d12/d2f/d7d/f52 [442144,62107] 0 2024-02-22T00:33:26.452 INFO:tasks.workunit.client.1.smithi161.stdout:2/742: write de/d2b/d8b/da2/f102 [133225,2327] 0 2024-02-22T00:33:26.452 INFO:tasks.workunit.client.1.smithi161.stdout:6/587: fdatasync d3/d10/f55 0 2024-02-22T00:33:26.456 INFO:tasks.workunit.client.1.smithi161.stdout:4/609: dwrite d5/d8/d41/d53/d6c/d72/fce [0,4194304] 0 2024-02-22T00:33:26.458 INFO:tasks.workunit.client.1.smithi161.stdout:6/588: dread - d3/d10/d1b/d5e/fb7 zero size 2024-02-22T00:33:26.459 INFO:tasks.workunit.client.1.smithi161.stdout:2/743: write de/d11/d32/fa8 [916635,25570] 0 2024-02-22T00:33:26.461 INFO:tasks.workunit.client.1.smithi161.stdout:8/663: dwrite d1/d2f/d37/d64/d7b/f5d [0,4194304] 0 2024-02-22T00:33:26.461 INFO:tasks.workunit.client.1.smithi161.stdout:6/589: dread - d3/d30/db4/db5/fba zero size 2024-02-22T00:33:26.463 INFO:tasks.workunit.client.1.smithi161.stdout:8/664: stat d1/d1c/d75/f3a 0 2024-02-22T00:33:26.464 INFO:tasks.workunit.client.1.smithi161.stdout:4/610: symlink d5/d10/da9/lea 0 2024-02-22T00:33:26.466 INFO:tasks.workunit.client.1.smithi161.stdout:6/590: truncate d3/d10/d1b/f34 5175094 0 2024-02-22T00:33:26.466 INFO:tasks.workunit.client.1.smithi161.stdout:8/665: fsync d1/d2f/d37/d64/fa9 0 2024-02-22T00:33:26.467 INFO:tasks.workunit.client.1.smithi161.stdout:2/744: creat de/d2b/d8b/de6/f105 x:0 0 0 2024-02-22T00:33:26.469 INFO:tasks.workunit.client.1.smithi161.stdout:7/654: dread d3/f17 [0,4194304] 0 2024-02-22T00:33:26.477 INFO:tasks.workunit.client.1.smithi161.stdout:4/611: write d5/d10/f4d [1467275,97628] 0 2024-02-22T00:33:26.479 INFO:tasks.workunit.client.1.smithi161.stdout:4/612: write d5/d10/d14/fad [1124780,47322] 0 2024-02-22T00:33:26.483 INFO:tasks.workunit.client.1.smithi161.stdout:4/613: write d5/d17/f92 [5258753,8228] 0 2024-02-22T00:33:26.487 INFO:tasks.workunit.client.1.smithi161.stdout:6/591: dwrite d3/d10/f26 [0,4194304] 0 2024-02-22T00:33:26.489 INFO:tasks.workunit.client.1.smithi161.stdout:7/655: dwrite d3/dd/d59/d5b/fb5 [0,4194304] 0 2024-02-22T00:33:26.490 INFO:tasks.workunit.client.1.smithi161.stdout:2/745: dread de/d2b/d65/d3a/f88 [0,4194304] 0 2024-02-22T00:33:26.491 INFO:tasks.workunit.client.1.smithi161.stdout:4/614: unlink d5/d8/d41/d57/dbe/d28/d38/c4b 0 2024-02-22T00:33:26.493 INFO:tasks.workunit.client.1.smithi161.stdout:2/746: chown de/d2b/d8b/da2/da5/dc4/d8f/fe5 359947 1 2024-02-22T00:33:26.493 INFO:tasks.workunit.client.1.smithi161.stdout:6/592: unlink d3/d10/l6d 0 2024-02-22T00:33:26.495 INFO:tasks.workunit.client.1.smithi161.stdout:6/593: fdatasync d3/d10/d12/f23 0 2024-02-22T00:33:26.498 INFO:tasks.workunit.client.1.smithi161.stdout:4/615: write d5/d8/d41/d57/dbe/d28/fbd [1060912,97878] 0 2024-02-22T00:33:26.506 INFO:tasks.workunit.client.1.smithi161.stdout:7/656: dread d3/df/d33/d35/d55/d63/d7b/f3e [4194304,4194304] 0 2024-02-22T00:33:26.506 INFO:tasks.workunit.client.1.smithi161.stdout:8/666: dwrite d1/d1c/d20/d22/d28/d7f/d92/d95/f3c [0,4194304] 0 2024-02-22T00:33:26.514 INFO:tasks.workunit.client.1.smithi161.stdout:2/747: dwrite de/d11/d5c/f80 [0,4194304] 0 2024-02-22T00:33:26.516 INFO:tasks.workunit.client.1.smithi161.stdout:6/594: dwrite d3/d10/d1b/d5e/f7a [4194304,4194304] 0 2024-02-22T00:33:26.521 INFO:tasks.workunit.client.1.smithi161.stdout:7/657: unlink d3/dd/d59/l9b 0 2024-02-22T00:33:26.522 INFO:tasks.workunit.client.1.smithi161.stdout:6/595: write d3/d10/d1b/d5e/d87/f88 [549680,78267] 0 2024-02-22T00:33:26.522 INFO:tasks.workunit.client.1.smithi161.stdout:8/667: rmdir d1/d2f/d30/dd3 0 2024-02-22T00:33:26.522 INFO:tasks.workunit.client.1.smithi161.stdout:4/616: rename d5/d10/d14/d4f/c6e to d5/d8/d41/d57/dbe/d28/d63/ceb 0 2024-02-22T00:33:26.523 INFO:tasks.workunit.client.1.smithi161.stdout:7/658: write d3/df/d33/d35/d55/d63/d7b/d50/f61 [4295133,128540] 0 2024-02-22T00:33:26.528 INFO:tasks.workunit.client.1.smithi161.stdout:8/668: mknod d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/cda 0 2024-02-22T00:33:26.529 INFO:tasks.workunit.client.1.smithi161.stdout:4/617: creat d5/d10/d14/d4f/fec x:0 0 0 2024-02-22T00:33:26.529 INFO:tasks.workunit.client.1.smithi161.stdout:7/659: truncate d3/f36 5292865 0 2024-02-22T00:33:26.530 INFO:tasks.workunit.client.1.smithi161.stdout:7/660: chown d3/dbf 433375 1 2024-02-22T00:33:26.531 INFO:tasks.workunit.client.1.smithi161.stdout:8/669: fdatasync d1/d2f/d37/d64/fa9 0 2024-02-22T00:33:26.532 INFO:tasks.workunit.client.1.smithi161.stdout:6/596: dwrite d3/dc/f27 [0,4194304] 0 2024-02-22T00:33:26.536 INFO:tasks.workunit.client.1.smithi161.stdout:4/618: symlink d5/d8/d41/d57/dbe/d28/d38/led 0 2024-02-22T00:33:26.537 INFO:tasks.workunit.client.1.smithi161.stdout:7/661: symlink d3/df/d33/d35/d55/d63/d7b/d50/d62/ld4 0 2024-02-22T00:33:26.538 INFO:tasks.workunit.client.1.smithi161.stdout:4/619: read d5/d8/d41/d57/dbe/d28/d63/fa6 [109032,27423] 0 2024-02-22T00:33:26.540 INFO:tasks.workunit.client.1.smithi161.stdout:8/670: link d1/d1c/d20/d22/d28/d36/f7a d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/fdb 0 2024-02-22T00:33:26.545 INFO:tasks.workunit.client.1.smithi161.stdout:1/643: sync 2024-02-22T00:33:26.547 INFO:tasks.workunit.client.1.smithi161.stdout:8/671: fdatasync d1/d2f/d37/d64/d7b/f9d 0 2024-02-22T00:33:26.547 INFO:tasks.workunit.client.1.smithi161.stdout:6/597: rename d3/dc/df/d32/lac to d3/dc/lbd 0 2024-02-22T00:33:26.553 INFO:tasks.workunit.client.1.smithi161.stdout:4/620: rename d5/d8/d41/d53/d6c/d91/lb9 to d5/d17/d5c/lee 0 2024-02-22T00:33:26.555 INFO:tasks.workunit.client.1.smithi161.stdout:1/644: creat d19/d1d/d56/db2/fdf x:0 0 0 2024-02-22T00:33:26.557 INFO:tasks.workunit.client.1.smithi161.stdout:8/672: symlink d1/d1c/d20/d22/d28/d7f/d92/ldc 0 2024-02-22T00:33:26.558 INFO:tasks.workunit.client.1.smithi161.stdout:2/748: truncate de/d11/f4e 3330864 0 2024-02-22T00:33:26.559 INFO:tasks.workunit.client.1.smithi161.stdout:4/621: creat d5/d8/d41/d57/dbe/d28/d38/fef x:0 0 0 2024-02-22T00:33:26.561 INFO:tasks.workunit.client.1.smithi161.stdout:4/622: rename d5/d8 to d5/d8/d41/d57/dbe/d28/d38/d6d/da5/df0 22 2024-02-22T00:33:26.563 INFO:tasks.workunit.client.1.smithi161.stdout:8/673: mkdir d1/d2f/d37/ddd 0 2024-02-22T00:33:26.564 INFO:tasks.workunit.client.1.smithi161.stdout:2/749: fdatasync de/d2b/d8b/da2/da5/dc4/d8f/f47 0 2024-02-22T00:33:26.565 INFO:tasks.workunit.client.1.smithi161.stdout:8/674: write d1/d2f/f97 [1731007,91928] 0 2024-02-22T00:33:26.565 INFO:tasks.workunit.client.1.smithi161.stdout:6/598: dread d3/d10/d12/d3a/f43 [0,4194304] 0 2024-02-22T00:33:26.566 INFO:tasks.workunit.client.1.smithi161.stdout:4/623: creat d5/d8/d41/d57/dbe/d28/d38/ff1 x:0 0 0 2024-02-22T00:33:26.567 INFO:tasks.workunit.client.1.smithi161.stdout:2/750: chown de/d2b/d8b/da2/da5/dc4 235 1 2024-02-22T00:33:26.568 INFO:tasks.workunit.client.1.smithi161.stdout:8/675: write d1/d1c/d96/fc7 [125857,11787] 0 2024-02-22T00:33:26.569 INFO:tasks.workunit.client.1.smithi161.stdout:8/676: fsync d1/d1c/d20/fc6 0 2024-02-22T00:33:26.570 INFO:tasks.workunit.client.1.smithi161.stdout:2/751: truncate de/d2b/d8b/da2/da5/dc4/f74 280081 0 2024-02-22T00:33:26.571 INFO:tasks.workunit.client.1.smithi161.stdout:7/662: write d3/df/d43/faa [2160324,4503] 0 2024-02-22T00:33:26.572 INFO:tasks.workunit.client.1.smithi161.stdout:6/599: mkdir d3/d10/d12/d2f/d7d/dab/dbe 0 2024-02-22T00:33:26.574 INFO:tasks.workunit.client.1.smithi161.stdout:8/677: symlink d1/d2f/d30/lde 0 2024-02-22T00:33:26.575 INFO:tasks.workunit.client.1.smithi161.stdout:1/645: link d19/d1d/d2c/l62 d19/d1d/d2c/d4f/d84/le0 0 2024-02-22T00:33:26.581 INFO:tasks.workunit.client.1.smithi161.stdout:7/663: dwrite d3/f14 [8388608,4194304] 0 2024-02-22T00:33:26.584 INFO:tasks.workunit.client.1.smithi161.stdout:4/624: symlink d5/d8/d41/d57/dbe/d28/lf2 0 2024-02-22T00:33:26.589 INFO:tasks.workunit.client.1.smithi161.stdout:1/646: mkdir d19/d51/d64/de1 0 2024-02-22T00:33:26.591 INFO:tasks.workunit.client.1.smithi161.stdout:6/600: dwrite d3/d10/d12/f2d [0,4194304] 0 2024-02-22T00:33:26.598 INFO:tasks.workunit.client.1.smithi161.stdout:1/647: symlink d19/d90/dcf/le2 0 2024-02-22T00:33:26.599 INFO:tasks.workunit.client.1.smithi161.stdout:7/664: dread - d3/df/d33/d35/d55/d63/d7b/d30/fc7 zero size 2024-02-22T00:33:26.602 INFO:tasks.workunit.client.1.smithi161.stdout:2/752: dwrite de/d2b/d83/f8e [0,4194304] 0 2024-02-22T00:33:26.604 INFO:tasks.workunit.client.1.smithi161.stdout:1/648: chown d19/d85/f94 6391782 1 2024-02-22T00:33:26.606 INFO:tasks.workunit.client.1.smithi161.stdout:1/649: fdatasync f7 0 2024-02-22T00:33:26.609 INFO:tasks.workunit.client.1.smithi161.stdout:7/665: creat d3/dbf/fd5 x:0 0 0 2024-02-22T00:33:26.611 INFO:tasks.workunit.client.1.smithi161.stdout:4/625: dwrite d5/db0/fc8 [0,4194304] 0 2024-02-22T00:33:26.613 INFO:tasks.workunit.client.1.smithi161.stdout:2/753: rename de/f21 to de/d11/d32/f106 0 2024-02-22T00:33:26.614 INFO:tasks.workunit.client.1.smithi161.stdout:6/601: dwrite d3/d10/d12/d2f/d7d/d5f/f70 [0,4194304] 0 2024-02-22T00:33:26.617 INFO:tasks.workunit.client.1.smithi161.stdout:8/678: dread d1/d1c/d75/d18/fb3 [4194304,4194304] 0 2024-02-22T00:33:26.617 INFO:tasks.workunit.client.1.smithi161.stdout:2/754: fsync de/d2b/d83/f70 0 2024-02-22T00:33:26.620 INFO:tasks.workunit.client.1.smithi161.stdout:7/666: rename d3/df/d33/l7e to d3/df/d33/d35/d55/d63/ld6 0 2024-02-22T00:33:26.621 INFO:tasks.workunit.client.1.smithi161.stdout:7/667: readlink d3/df/d43/lac 0 2024-02-22T00:33:26.625 INFO:tasks.workunit.client.1.smithi161.stdout:8/679: write d1/d1c/d75/d18/fb3 [5172116,80785] 0 2024-02-22T00:33:26.625 INFO:tasks.workunit.client.1.smithi161.stdout:1/650: getdents d19/d51/d6c/dd4 0 2024-02-22T00:33:26.627 INFO:tasks.workunit.client.1.smithi161.stdout:8/680: fdatasync d1/d2f/f84 0 2024-02-22T00:33:26.628 INFO:tasks.workunit.client.1.smithi161.stdout:2/755: dwrite de/d2b/d8b/da2/fbc [0,4194304] 0 2024-02-22T00:33:26.632 INFO:tasks.workunit.client.1.smithi161.stdout:2/756: chown de/d11/d14/c57 1536 1 2024-02-22T00:33:26.632 INFO:tasks.workunit.client.1.smithi161.stdout:4/626: link d5/d8/d41/fa3 d5/d10/d14/d4f/ff3 0 2024-02-22T00:33:26.634 INFO:tasks.workunit.client.1.smithi161.stdout:8/681: mkdir d1/d2f/d37/d64/d7b/ddf 0 2024-02-22T00:33:26.635 INFO:tasks.workunit.client.1.smithi161.stdout:7/668: mknod d3/df/d33/d35/d55/d63/d7b/d30/cd7 0 2024-02-22T00:33:26.637 INFO:tasks.workunit.client.1.smithi161.stdout:2/757: mknod de/d2b/d8b/da2/da5/daf/c107 0 2024-02-22T00:33:26.642 INFO:tasks.workunit.client.1.smithi161.stdout:7/669: dread - d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/fbb zero size 2024-02-22T00:33:26.643 INFO:tasks.workunit.client.1.smithi161.stdout:4/627: dwrite d5/d8/d41/d53/fa7 [0,4194304] 0 2024-02-22T00:33:26.643 INFO:tasks.workunit.client.1.smithi161.stdout:2/758: mknod de/d2b/d8b/db8/c108 0 2024-02-22T00:33:26.644 INFO:tasks.workunit.client.1.smithi161.stdout:7/670: fsync d3/dbf/d64/f78 0 2024-02-22T00:33:26.645 INFO:tasks.workunit.client.1.smithi161.stdout:2/759: dread - de/d11/d32/fd5 zero size 2024-02-22T00:33:26.651 INFO:tasks.workunit.client.1.smithi161.stdout:8/682: rename d1/d1c/d20/d22/d28/d36/d6c/da1 to d1/de0 0 2024-02-22T00:33:26.651 INFO:tasks.workunit.client.1.smithi161.stdout:6/602: truncate d3/d10/d12/d2f/d7d/f80 1325529 0 2024-02-22T00:33:26.652 INFO:tasks.workunit.client.1.smithi161.stdout:7/671: dwrite f2 [0,4194304] 0 2024-02-22T00:33:26.652 INFO:tasks.workunit.client.1.smithi161.stdout:1/651: write d19/d51/d64/d9b/da5/fcc [3197205,38544] 0 2024-02-22T00:33:26.653 INFO:tasks.workunit.client.1.smithi161.stdout:4/628: creat d5/d8/d41/ff4 x:0 0 0 2024-02-22T00:33:26.654 INFO:tasks.workunit.client.1.smithi161.stdout:5/829: sync 2024-02-22T00:33:26.656 INFO:tasks.workunit.client.1.smithi161.stdout:2/760: dread - de/d2b/d8b/da2/da5/dc4/da7/fed zero size 2024-02-22T00:33:26.657 INFO:tasks.workunit.client.1.smithi161.stdout:6/603: creat d3/d30/fbf x:0 0 0 2024-02-22T00:33:26.658 INFO:tasks.workunit.client.1.smithi161.stdout:7/672: stat d3/df/d33/d35/d55/d63/d7b/d30 0 2024-02-22T00:33:26.658 INFO:tasks.workunit.client.1.smithi161.stdout:1/652: chown d19/d1d/d2c/d2d/f83 7 1 2024-02-22T00:33:26.661 INFO:tasks.workunit.client.1.smithi161.stdout:2/761: write de/d11/f1a [4455931,81107] 0 2024-02-22T00:33:26.664 INFO:tasks.workunit.client.1.smithi161.stdout:1/653: dread - d19/d1d/d56/fa4 zero size 2024-02-22T00:33:26.667 INFO:tasks.workunit.client.1.smithi161.stdout:7/673: write d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/f96 [758275,107494] 0 2024-02-22T00:33:26.668 INFO:tasks.workunit.client.1.smithi161.stdout:5/830: write d3/d1c/d20/f12 [2901107,87370] 0 2024-02-22T00:33:26.670 INFO:tasks.workunit.client.1.smithi161.stdout:2/762: dread de/d2b/d65/f79 [0,4194304] 0 2024-02-22T00:33:26.673 INFO:tasks.workunit.client.1.smithi161.stdout:1/654: creat d19/d1d/d2c/d2d/fe3 x:0 0 0 2024-02-22T00:33:26.674 INFO:tasks.workunit.client.1.smithi161.stdout:4/629: dwrite d5/d8/d41/d57/dbe/d28/d38/d6d/da5/fc3 [0,4194304] 0 2024-02-22T00:33:26.676 INFO:tasks.workunit.client.1.smithi161.stdout:8/683: dread d1/d2f/d37/d64/d7b/f5d [0,4194304] 0 2024-02-22T00:33:26.677 INFO:tasks.workunit.client.1.smithi161.stdout:7/674: chown d3/df/d33/d35/d55/d63/d7b/d30/c4c 137270 1 2024-02-22T00:33:26.679 INFO:tasks.workunit.client.1.smithi161.stdout:1/655: mknod d19/d51/d64/de1/ce4 0 2024-02-22T00:33:26.681 INFO:tasks.workunit.client.1.smithi161.stdout:2/763: rename de/d11/d14/c55 to de/d11/c109 0 2024-02-22T00:33:26.685 INFO:tasks.workunit.client.1.smithi161.stdout:7/675: creat d3/df/d33/d74/fd8 x:0 0 0 2024-02-22T00:33:26.685 INFO:tasks.workunit.client.1.smithi161.stdout:1/656: creat d19/d51/d64/d9b/da5/daa/fe5 x:0 0 0 2024-02-22T00:33:26.687 INFO:tasks.workunit.client.1.smithi161.stdout:7/676: chown d3/dd/l23 224472 1 2024-02-22T00:33:26.688 INFO:tasks.workunit.client.1.smithi161.stdout:4/630: creat d5/d8/d41/d57/dbe/ff5 x:0 0 0 2024-02-22T00:33:26.689 INFO:tasks.workunit.client.1.smithi161.stdout:5/831: truncate d3/d1b/d25/f39 6198091 0 2024-02-22T00:33:26.691 INFO:tasks.workunit.client.1.smithi161.stdout:1/657: write d19/d1d/d2c/d7d/f7f [2545644,106755] 0 2024-02-22T00:33:26.692 INFO:tasks.workunit.client.1.smithi161.stdout:2/764: dwrite de/d2b/d65/d3a/f7c [0,4194304] 0 2024-02-22T00:33:26.693 INFO:tasks.workunit.client.1.smithi161.stdout:4/631: stat d5/d8/d41/d57/dbe/d28/d38/f85 0 2024-02-22T00:33:26.698 INFO:tasks.workunit.client.1.smithi161.stdout:7/677: fdatasync d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/f96 0 2024-02-22T00:33:26.701 INFO:tasks.workunit.client.1.smithi161.stdout:2/765: rmdir de/d2b/d65/d60/d68/d100 39 2024-02-22T00:33:26.702 INFO:tasks.workunit.client.1.smithi161.stdout:4/632: rmdir d5/d8 39 2024-02-22T00:33:26.705 INFO:tasks.workunit.client.1.smithi161.stdout:7/678: write d3/df/d33/d35/d55/d63/d7b/d50/fc3 [293517,45075] 0 2024-02-22T00:33:26.706 INFO:tasks.workunit.client.1.smithi161.stdout:5/832: dwrite d3/f5 [0,4194304] 0 2024-02-22T00:33:26.714 INFO:tasks.workunit.client.1.smithi161.stdout:2/766: rename de/d2b/d65/d3a/l4a to de/l10a 0 2024-02-22T00:33:26.721 INFO:tasks.workunit.client.1.smithi161.stdout:5/833: dwrite d3/d1b/d36/fea [0,4194304] 0 2024-02-22T00:33:26.721 INFO:tasks.workunit.client.1.smithi161.stdout:1/658: dwrite d19/d1d/d2c/d4f/f72 [0,4194304] 0 2024-02-22T00:33:26.725 INFO:tasks.workunit.client.1.smithi161.stdout:2/767: dread - de/d2b/d8b/da2/da5/dc4/da7/fb7 zero size 2024-02-22T00:33:26.726 INFO:tasks.workunit.client.1.smithi161.stdout:1/659: write d19/d1d/d2c/d2d/d3f/f9f [1405130,60728] 0 2024-02-22T00:33:26.727 INFO:tasks.workunit.client.1.smithi161.stdout:2/768: readlink de/d2b/d83/d4f/dc5/ld4 0 2024-02-22T00:33:26.729 INFO:tasks.workunit.client.1.smithi161.stdout:4/633: rename d5/d8/d41/l95 to d5/lf6 0 2024-02-22T00:33:26.729 INFO:tasks.workunit.client.1.smithi161.stdout:1/660: chown d19/d51/d64/d9b 588 1 2024-02-22T00:33:26.731 INFO:tasks.workunit.client.1.smithi161.stdout:1/661: chown d19/d51/d6c/dd4/f54 33688865 1 2024-02-22T00:33:26.731 INFO:tasks.workunit.client.1.smithi161.stdout:7/679: dread d3/df/d33/d35/d55/d63/d7b/f3e [0,4194304] 0 2024-02-22T00:33:26.736 INFO:tasks.workunit.client.1.smithi161.stdout:4/634: fdatasync d5/d10/d14/f7a 0 2024-02-22T00:33:26.736 INFO:tasks.workunit.client.1.smithi161.stdout:1/662: creat d19/d1d/d2c/d4f/d98/fe6 x:0 0 0 2024-02-22T00:33:26.741 INFO:tasks.workunit.client.1.smithi161.stdout:1/663: mknod d19/d51/d64/d9b/da5/daa/ce7 0 2024-02-22T00:33:26.742 INFO:tasks.workunit.client.1.smithi161.stdout:4/635: write d5/d8/d41/d57/dbe/d28/d63/d65/d9d/fbb [4245346,38696] 0 2024-02-22T00:33:26.742 INFO:tasks.workunit.client.1.smithi161.stdout:2/769: link de/d11/c109 de/d2b/d83/c10b 0 2024-02-22T00:33:26.745 INFO:tasks.workunit.client.1.smithi161.stdout:5/834: dwrite d3/d1b/d36/f55 [0,4194304] 0 2024-02-22T00:33:26.746 INFO:tasks.workunit.client.1.smithi161.stdout:1/664: symlink d19/d51/d64/d9b/le8 0 2024-02-22T00:33:26.747 INFO:tasks.workunit.client.1.smithi161.stdout:1/665: chown d19/d1d/d2c 15777 1 2024-02-22T00:33:26.747 INFO:tasks.workunit.client.1.smithi161.stdout:5/835: stat d3/d1b/d25/l6e 0 2024-02-22T00:33:26.749 INFO:tasks.workunit.client.1.smithi161.stdout:1/666: fsync d19/d1d/d2c/d4f/d98/fe6 0 2024-02-22T00:33:26.750 INFO:tasks.workunit.client.1.smithi161.stdout:2/770: mknod de/dfd/c10c 0 2024-02-22T00:33:26.752 INFO:tasks.workunit.client.1.smithi161.stdout:2/771: truncate de/d11/d32/fd5 739720 0 2024-02-22T00:33:26.754 INFO:tasks.workunit.client.1.smithi161.stdout:1/667: truncate d19/d51/d64/d9b/da5/daa/fab 876605 0 2024-02-22T00:33:26.757 INFO:tasks.workunit.client.1.smithi161.stdout:2/772: getdents de/d2b/df6 0 2024-02-22T00:33:26.763 INFO:tasks.workunit.client.1.smithi161.stdout:5/836: dwrite d3/d1b/d25/d84/ffa [0,4194304] 0 2024-02-22T00:33:26.766 INFO:tasks.workunit.client.1.smithi161.stdout:2/773: getdents de/d2b/d8b 0 2024-02-22T00:33:26.768 INFO:tasks.workunit.client.1.smithi161.stdout:7/680: dread d3/f14 [4194304,4194304] 0 2024-02-22T00:33:26.768 INFO:tasks.workunit.client.1.smithi161.stdout:5/837: mknod d3/d1c/d20/d116/c119 0 2024-02-22T00:33:26.768 INFO:tasks.workunit.client.1.smithi161.stdout:4/636: dwrite d5/d8/d41/d57/dbe/d28/d63/fa6 [0,4194304] 0 2024-02-22T00:33:26.772 INFO:tasks.workunit.client.1.smithi161.stdout:4/637: dread - d5/d10/da9/fd0 zero size 2024-02-22T00:33:26.774 INFO:tasks.workunit.client.1.smithi161.stdout:5/838: unlink d3/d1c/d20/f35 0 2024-02-22T00:33:26.776 INFO:tasks.workunit.client.1.smithi161.stdout:1/668: dwrite d19/d1d/d56/db2/fc1 [0,4194304] 0 2024-02-22T00:33:26.779 INFO:tasks.workunit.client.1.smithi161.stdout:4/638: chown d5/d8/d41/d57/dbe/d28/d63/l71 344027646 1 2024-02-22T00:33:26.780 INFO:tasks.workunit.client.1.smithi161.stdout:1/669: rmdir d19/d51/d64 39 2024-02-22T00:33:26.781 INFO:tasks.workunit.client.1.smithi161.stdout:7/681: dwrite d3/f36 [4194304,4194304] 0 2024-02-22T00:33:26.788 INFO:tasks.workunit.client.1.smithi161.stdout:4/639: creat d5/d8/d41/d57/dbe/d28/d38/d6d/da5/ff7 x:0 0 0 2024-02-22T00:33:26.789 INFO:tasks.workunit.client.1.smithi161.stdout:2/774: truncate de/d11/d32/f106 4546315 0 2024-02-22T00:33:26.792 INFO:tasks.workunit.client.1.smithi161.stdout:7/682: dwrite d3/df/d33/d35/d55/d63/d7b/d50/f81 [0,4194304] 0 2024-02-22T00:33:26.792 INFO:tasks.workunit.client.1.smithi161.stdout:4/640: chown d5/d8/d41/d53/d6c/d72/f8e 10 1 2024-02-22T00:33:26.793 INFO:tasks.workunit.client.1.smithi161.stdout:1/670: rename d19/d51/d6c/l97 to d19/d51/d64/d9b/da5/ddb/le9 0 2024-02-22T00:33:26.795 INFO:tasks.workunit.client.1.smithi161.stdout:4/641: chown d5/d8/d41/d57/dbe/c73 17762788 1 2024-02-22T00:33:26.796 INFO:tasks.workunit.client.1.smithi161.stdout:7/683: write d3/dbf/f6c [6488889,129824] 0 2024-02-22T00:33:26.796 INFO:tasks.workunit.client.1.smithi161.stdout:9/677: sync 2024-02-22T00:33:26.796 INFO:tasks.workunit.client.1.smithi161.stdout:3/601: sync 2024-02-22T00:33:26.796 INFO:tasks.workunit.client.1.smithi161.stdout:0/711: sync 2024-02-22T00:33:26.798 INFO:tasks.workunit.client.1.smithi161.stdout:5/839: truncate d3/d1c/d20/f59 3179877 0 2024-02-22T00:33:26.801 INFO:tasks.workunit.client.1.smithi161.stdout:1/671: rename d19/d48/f81 to d19/d51/d64/d9b/da5/daa/fea 0 2024-02-22T00:33:26.801 INFO:tasks.workunit.client.1.smithi161.stdout:5/840: read - d3/d1b/d25/d84/f107 zero size 2024-02-22T00:33:26.803 INFO:tasks.workunit.client.1.smithi161.stdout:4/642: mknod d5/d8/d41/d57/dbe/d28/d38/d6d/cf8 0 2024-02-22T00:33:26.804 INFO:tasks.workunit.client.1.smithi161.stdout:7/684: symlink d3/dd/ld9 0 2024-02-22T00:33:26.806 INFO:tasks.workunit.client.1.smithi161.stdout:2/775: dread de/d2b/d8b/da2/da5/dc4/f74 [0,4194304] 0 2024-02-22T00:33:26.807 INFO:tasks.workunit.client.1.smithi161.stdout:1/672: chown d19/d51/d6c/dd4/fbe 24360867 1 2024-02-22T00:33:26.809 INFO:tasks.workunit.client.1.smithi161.stdout:3/602: rename da/d29/d8e to da/dc/d11/d40/d59/d93/daa/dc4 0 2024-02-22T00:33:26.809 INFO:tasks.workunit.client.1.smithi161.stdout:4/643: dread - d5/d8/d41/ff4 zero size 2024-02-22T00:33:26.815 INFO:tasks.workunit.client.1.smithi161.stdout:2/776: mkdir de/d2b/d8b/ddc/d10d 0 2024-02-22T00:33:26.815 INFO:tasks.workunit.client.1.smithi161.stdout:0/712: dwrite d14/f56 [4194304,4194304] 0 2024-02-22T00:33:26.818 INFO:tasks.workunit.client.1.smithi161.stdout:1/673: rename d19/d1d/d2c/l5e to d19/d1d/leb 0 2024-02-22T00:33:26.820 INFO:tasks.workunit.client.1.smithi161.stdout:7/685: mknod d3/df/d33/d35/d55/d63/d7b/d30/cda 0 2024-02-22T00:33:26.822 INFO:tasks.workunit.client.1.smithi161.stdout:0/713: write d14/d1a/d9d/dba/fc2 [938605,35787] 0 2024-02-22T00:33:26.825 INFO:tasks.workunit.client.1.smithi161.stdout:1/674: write d19/d51/d6c/f9c [2332805,61443] 0 2024-02-22T00:33:26.826 INFO:tasks.workunit.client.1.smithi161.stdout:0/714: truncate d14/fea 278619 0 2024-02-22T00:33:26.827 INFO:tasks.workunit.client.1.smithi161.stdout:5/841: dwrite d3/d1c/d69/fa8 [0,4194304] 0 2024-02-22T00:33:26.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/644: write d5/d8/d41/d57/dbe/d28/f2d [5621748,67082] 0 2024-02-22T00:33:26.831 INFO:tasks.workunit.client.1.smithi161.stdout:3/603: write da/dc/d11/d40/d59/d93/daa/fc2 [412525,43238] 0 2024-02-22T00:33:26.831 INFO:tasks.workunit.client.1.smithi161.stdout:1/675: fsync d19/d1d/d2c/fd7 0 2024-02-22T00:33:26.831 INFO:tasks.workunit.client.1.smithi161.stdout:5/842: mkdir d3/d1b/d91/d96/d11a 0 2024-02-22T00:33:26.833 INFO:tasks.workunit.client.1.smithi161.stdout:2/777: mkdir de/d11/d5c/dea/df8/d10e 0 2024-02-22T00:33:26.835 INFO:tasks.workunit.client.1.smithi161.stdout:7/686: dwrite d3/f8d [4194304,4194304] 0 2024-02-22T00:33:26.838 INFO:tasks.workunit.client.1.smithi161.stdout:4/645: dread d5/d8/f76 [0,4194304] 0 2024-02-22T00:33:26.843 INFO:tasks.workunit.client.1.smithi161.stdout:1/676: creat d19/d51/d64/fec x:0 0 0 2024-02-22T00:33:26.843 INFO:tasks.workunit.client.1.smithi161.stdout:4/646: stat d5/d8/d41/d57/dbe/d28/d63/d6b/cb2 0 2024-02-22T00:33:26.843 INFO:tasks.workunit.client.1.smithi161.stdout:3/604: creat da/d29/d53/dc1/fc5 x:0 0 0 2024-02-22T00:33:26.844 INFO:tasks.workunit.client.1.smithi161.stdout:5/843: rename d3/d1c/d69/faf to d3/d29/d80/d92/f11b 0 2024-02-22T00:33:26.847 INFO:tasks.workunit.client.1.smithi161.stdout:3/605: fdatasync da/dc/d11/d26/f45 0 2024-02-22T00:33:26.848 INFO:tasks.workunit.client.1.smithi161.stdout:2/778: creat de/d2b/d65/d60/d68/f10f x:0 0 0 2024-02-22T00:33:26.851 INFO:tasks.workunit.client.1.smithi161.stdout:5/844: mkdir d3/d1b/d91/d11c 0 2024-02-22T00:33:26.854 INFO:tasks.workunit.client.1.smithi161.stdout:1/677: creat d19/d1d/d2c/d7d/fed x:0 0 0 2024-02-22T00:33:26.861 INFO:tasks.workunit.client.1.smithi161.stdout:3/606: dwrite da/f27 [0,4194304] 0 2024-02-22T00:33:26.862 INFO:tasks.workunit.client.1.smithi161.stdout:5/845: symlink d3/d1c/d62/l11d 0 2024-02-22T00:33:26.864 INFO:tasks.workunit.client.1.smithi161.stdout:4/647: getdents d5/d8/d41/d57/dbe/d28/d63/d64 0 2024-02-22T00:33:26.864 INFO:tasks.workunit.client.1.smithi161.stdout:1/678: creat d19/d51/d6c/fee x:0 0 0 2024-02-22T00:33:26.871 INFO:tasks.workunit.client.1.smithi161.stdout:5/846: symlink d3/dac/dd1/l11e 0 2024-02-22T00:33:26.877 INFO:tasks.workunit.client.1.smithi161.stdout:5/847: fsync d3/d1b/d25/d4c/dd2/fe5 0 2024-02-22T00:33:26.877 INFO:tasks.workunit.client.1.smithi161.stdout:2/779: dwrite de/d2b/f2d [4194304,4194304] 0 2024-02-22T00:33:26.878 INFO:tasks.workunit.client.1.smithi161.stdout:7/687: dread d3/f73 [4194304,4194304] 0 2024-02-22T00:33:26.883 INFO:tasks.workunit.client.1.smithi161.stdout:7/688: fdatasync d3/dd/d59/d5b/f4e 0 2024-02-22T00:33:26.884 INFO:tasks.workunit.client.1.smithi161.stdout:1/679: dwrite d19/d1d/d2c/d2d/f63 [0,4194304] 0 2024-02-22T00:33:26.889 INFO:tasks.workunit.client.1.smithi161.stdout:9/678: dread d1/d25/d73/d60/d77/f87 [0,4194304] 0 2024-02-22T00:33:26.890 INFO:tasks.workunit.client.1.smithi161.stdout:9/679: chown d1/d2/d4/d11/d21/le7 2 1 2024-02-22T00:33:26.892 INFO:tasks.workunit.client.1.smithi161.stdout:9/680: write d1/d25/dc4/d4f/fbd [6461054,106145] 0 2024-02-22T00:33:26.900 INFO:tasks.workunit.client.1.smithi161.stdout:2/780: dwrite de/d11/f29 [0,4194304] 0 2024-02-22T00:33:26.901 INFO:tasks.workunit.client.1.smithi161.stdout:9/681: write d1/d5/f3e [2169114,87588] 0 2024-02-22T00:33:26.901 INFO:tasks.workunit.client.1.smithi161.stdout:7/689: dwrite d3/fa9 [4194304,4194304] 0 2024-02-22T00:33:26.911 INFO:tasks.workunit.client.1.smithi161.stdout:9/682: symlink d1/d25/dc4/d4f/da3/de2/lea 0 2024-02-22T00:33:26.914 INFO:tasks.workunit.client.1.smithi161.stdout:3/607: dwrite da/dc/f31 [0,4194304] 0 2024-02-22T00:33:26.919 INFO:tasks.workunit.client.1.smithi161.stdout:5/848: getdents d3/d29/d80/d92/df7/dae/dbe 0 2024-02-22T00:33:26.921 INFO:tasks.workunit.client.1.smithi161.stdout:9/683: symlink d1/d25/dc4/d4f/da3/leb 0 2024-02-22T00:33:26.923 INFO:tasks.workunit.client.1.smithi161.stdout:3/608: unlink da/dc/d11/d40/d59/d93/daa/dc4/f82 0 2024-02-22T00:33:26.924 INFO:tasks.workunit.client.1.smithi161.stdout:7/690: getdents d3/dd/d59/d5b 0 2024-02-22T00:33:26.926 INFO:tasks.workunit.client.1.smithi161.stdout:3/609: write da/dc/d11/d26/f21 [3596901,66503] 0 2024-02-22T00:33:26.927 INFO:tasks.workunit.client.1.smithi161.stdout:1/680: dread d19/d1d/d2c/d7d/f7f [0,4194304] 0 2024-02-22T00:33:26.928 INFO:tasks.workunit.client.1.smithi161.stdout:5/849: creat d3/d1b/d25/d4c/dd2/ddd/f11f x:0 0 0 2024-02-22T00:33:26.930 INFO:tasks.workunit.client.1.smithi161.stdout:1/681: write d19/d1d/d2c/d4f/d98/fb8 [905440,119880] 0 2024-02-22T00:33:26.931 INFO:tasks.workunit.client.1.smithi161.stdout:9/684: mkdir d1/d25/d73/d98/dec 0 2024-02-22T00:33:26.932 INFO:tasks.workunit.client.1.smithi161.stdout:2/781: dread de/d2b/d65/d60/d68/fc6 [0,4194304] 0 2024-02-22T00:33:26.932 INFO:tasks.workunit.client.1.smithi161.stdout:3/610: mknod da/dc/d11/d40/d60/cc6 0 2024-02-22T00:33:26.933 INFO:tasks.workunit.client.1.smithi161.stdout:7/691: creat d3/dbf/dab/fdb x:0 0 0 2024-02-22T00:33:26.936 INFO:tasks.workunit.client.1.smithi161.stdout:2/782: dread - de/d2b/d8b/da2/da5/dc4/da7/fb1 zero size 2024-02-22T00:33:26.937 INFO:tasks.workunit.client.1.smithi161.stdout:1/682: symlink d19/d1d/d2c/d2d/d3f/d69/ddd/lef 0 2024-02-22T00:33:26.939 INFO:tasks.workunit.client.1.smithi161.stdout:6/604: sync 2024-02-22T00:33:26.939 INFO:tasks.workunit.client.1.smithi161.stdout:2/783: read f8 [269155,79519] 0 2024-02-22T00:33:26.939 INFO:tasks.workunit.client.1.smithi161.stdout:5/850: getdents d3/d1b/d91 0 2024-02-22T00:33:26.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/685: mknod d1/d2/d4/d11/ced 0 2024-02-22T00:33:26.940 INFO:tasks.workunit.client.1.smithi161.stdout:7/692: mkdir d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc 0 2024-02-22T00:33:26.943 INFO:tasks.workunit.client.1.smithi161.stdout:2/784: fsync de/d2b/d65/fe2 0 2024-02-22T00:33:26.943 INFO:tasks.workunit.client.1.smithi161.stdout:1/683: fdatasync d19/f43 0 2024-02-22T00:33:26.946 INFO:tasks.workunit.client.1.smithi161.stdout:2/785: fdatasync de/d11/f8a 0 2024-02-22T00:33:26.947 INFO:tasks.workunit.client.1.smithi161.stdout:9/686: creat d1/d2/d4/d1f/dab/dcd/fee x:0 0 0 2024-02-22T00:33:26.950 INFO:tasks.workunit.client.1.smithi161.stdout:3/611: dwrite da/dc/d11/d26/d80/fb6 [0,4194304] 0 2024-02-22T00:33:26.954 INFO:tasks.workunit.client.1.smithi161.stdout:9/687: fsync d1/d2/f65 0 2024-02-22T00:33:26.955 INFO:tasks.workunit.client.1.smithi161.stdout:2/786: write de/d2b/d83/f8e [6001803,123976] 0 2024-02-22T00:33:26.955 INFO:tasks.workunit.client.1.smithi161.stdout:5/851: link d3/d1b/d36/cc9 d3/d1b/d91/d96/d11a/c120 0 2024-02-22T00:33:26.958 INFO:tasks.workunit.client.1.smithi161.stdout:6/605: dwrite d3/d10/f55 [0,4194304] 0 2024-02-22T00:33:26.958 INFO:tasks.workunit.client.1.smithi161.stdout:1/684: rename d19/d1d/d2c/d4f to d19/d1d/d2c/d2d/d3f/d69/ddd/df0 0 2024-02-22T00:33:26.964 INFO:tasks.workunit.client.1.smithi161.stdout:5/852: creat d3/d1c/d67/f121 x:0 0 0 2024-02-22T00:33:26.965 INFO:tasks.workunit.client.1.smithi161.stdout:5/853: stat d3/d1b/d25/dcc 0 2024-02-22T00:33:26.966 INFO:tasks.workunit.client.1.smithi161.stdout:1/685: creat d19/d51/d64/d9b/da5/ff1 x:0 0 0 2024-02-22T00:33:26.966 INFO:tasks.workunit.client.1.smithi161.stdout:5/854: write d3/f5 [2078905,12140] 0 2024-02-22T00:33:26.966 INFO:tasks.workunit.client.1.smithi161.stdout:6/606: mknod d3/dc/df/d32/cc0 0 2024-02-22T00:33:26.970 INFO:tasks.workunit.client.1.smithi161.stdout:1/686: chown d19/d1d/d2c/d2d/d3f/fae 421824 1 2024-02-22T00:33:26.974 INFO:tasks.workunit.client.1.smithi161.stdout:9/688: unlink d1/d2/d4/l72 0 2024-02-22T00:33:26.974 INFO:tasks.workunit.client.1.smithi161.stdout:6/607: rmdir d3/d10/d12/d3a 39 2024-02-22T00:33:26.975 INFO:tasks.workunit.client.1.smithi161.stdout:7/693: link d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/ca6 d3/df/d33/cdd 0 2024-02-22T00:33:26.978 INFO:tasks.workunit.client.1.smithi161.stdout:5/855: dwrite d3/d1c/d67/f117 [0,4194304] 0 2024-02-22T00:33:26.980 INFO:tasks.workunit.client.1.smithi161.stdout:5/856: write d3/f5 [3221755,52589] 0 2024-02-22T00:33:26.981 INFO:tasks.workunit.client.1.smithi161.stdout:9/689: mkdir d1/d2/d7/da/def 0 2024-02-22T00:33:26.985 INFO:tasks.workunit.client.1.smithi161.stdout:6/608: dread d3/d10/d1b/f2e [0,4194304] 0 2024-02-22T00:33:26.985 INFO:tasks.workunit.client.1.smithi161.stdout:7/694: dread d3/f9 [4194304,4194304] 0 2024-02-22T00:33:26.989 INFO:tasks.workunit.client.1.smithi161.stdout:3/612: write da/dc/d11/d40/d59/d93/daa/dc4/d37/d39/f42 [1435890,19596] 0 2024-02-22T00:33:26.989 INFO:tasks.workunit.client.1.smithi161.stdout:5/857: dread d3/d29/f75 [0,4194304] 0 2024-02-22T00:33:26.991 INFO:tasks.workunit.client.1.smithi161.stdout:9/690: creat d1/d25/dc4/d4f/da3/ff0 x:0 0 0 2024-02-22T00:33:26.991 INFO:tasks.workunit.client.1.smithi161.stdout:3/613: stat da/dc/d5f/d68/f6d 0 2024-02-22T00:33:26.993 INFO:tasks.workunit.client.1.smithi161.stdout:3/614: readlink da/d56/l5d 0 2024-02-22T00:33:26.994 INFO:tasks.workunit.client.1.smithi161.stdout:5/858: mkdir d3/d29/d122 0 2024-02-22T00:33:26.994 INFO:tasks.workunit.client.1.smithi161.stdout:2/787: dwrite de/d11/d5c/f30 [0,4194304] 0 2024-02-22T00:33:26.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/687: rename d19/d1d/d2c/d2d/d3f/d69/c7a to d19/d1d/d2c/d7d/cf2 0 2024-02-22T00:33:26.996 INFO:tasks.workunit.client.1.smithi161.stdout:5/859: chown d3/d1b/d91/cf1 9735 1 2024-02-22T00:33:26.997 INFO:tasks.workunit.client.1.smithi161.stdout:9/691: write d1/d2/d7/fe3 [6172981,4612] 0 2024-02-22T00:33:26.998 INFO:tasks.workunit.client.1.smithi161.stdout:3/615: truncate da/f13 609309 0 2024-02-22T00:33:26.999 INFO:tasks.workunit.client.1.smithi161.stdout:5/860: truncate d3/d1b/d25/d4c/f63 4276360 0 2024-02-22T00:33:27.002 INFO:tasks.workunit.client.1.smithi161.stdout:1/688: creat d19/d85/d87/dc6/ff3 x:0 0 0 2024-02-22T00:33:27.005 INFO:tasks.workunit.client.1.smithi161.stdout:5/861: truncate d3/d1c/f7d 4447440 0 2024-02-22T00:33:27.010 INFO:tasks.workunit.client.1.smithi161.stdout:1/689: creat d19/d1d/d2c/ff4 x:0 0 0 2024-02-22T00:33:27.012 INFO:tasks.workunit.client.1.smithi161.stdout:5/862: write d3/d1c/d69/fa8 [1574150,87663] 0 2024-02-22T00:33:27.013 INFO:tasks.workunit.client.1.smithi161.stdout:2/788: dread de/f1c [0,4194304] 0 2024-02-22T00:33:27.015 INFO:tasks.workunit.client.1.smithi161.stdout:9/692: dwrite d1/f9e [0,4194304] 0 2024-02-22T00:33:27.015 INFO:tasks.workunit.client.1.smithi161.stdout:3/616: dwrite da/dc/d11/d40/d59/d93/daa/fc2 [0,4194304] 0 2024-02-22T00:33:27.015 INFO:tasks.workunit.client.1.smithi161.stdout:7/695: dread d3/df/d33/d35/d55/d63/f66 [0,4194304] 0 2024-02-22T00:33:27.021 INFO:tasks.workunit.client.1.smithi161.stdout:2/789: mknod de/d2b/d65/d3a/d9d/c110 0 2024-02-22T00:33:27.027 INFO:tasks.workunit.client.1.smithi161.stdout:1/690: link d19/d1d/d2c/d2d/d3f/fae d19/d1d/d2c/d7d/ff5 0 2024-02-22T00:33:27.036 INFO:tasks.workunit.client.1.smithi161.stdout:3/617: rename da/dc/d11/d40 to da/dc/d11/d26/d80/dc7 0 2024-02-22T00:33:27.039 INFO:tasks.workunit.client.1.smithi161.stdout:9/693: dwrite d1/d25/d73/fc1 [0,4194304] 0 2024-02-22T00:33:27.039 INFO:tasks.workunit.client.1.smithi161.stdout:7/696: chown d3/df/d33/d35/d55/d63/d7b/c69 230493 1 2024-02-22T00:33:27.046 INFO:tasks.workunit.client.1.smithi161.stdout:9/694: write d1/d2/d4/d11/d21/f46 [3466568,66375] 0 2024-02-22T00:33:27.052 INFO:tasks.workunit.client.1.smithi161.stdout:0/715: sync 2024-02-22T00:33:27.053 INFO:tasks.workunit.client.1.smithi161.stdout:8/684: sync 2024-02-22T00:33:27.062 INFO:tasks.workunit.client.1.smithi161.stdout:8/685: dwrite d1/d1c/f3d [4194304,4194304] 0 2024-02-22T00:33:27.092 INFO:tasks.workunit.client.1.smithi161.stdout:5/863: dwrite d3/d1b/d36/f83 [0,4194304] 0 2024-02-22T00:33:27.097 INFO:tasks.workunit.client.1.smithi161.stdout:8/686: dread d1/d1c/d20/d22/d28/d7f/d92/d95/f3c [0,4194304] 0 2024-02-22T00:33:27.101 INFO:tasks.workunit.client.1.smithi161.stdout:1/691: symlink d19/d1d/d2c/d2d/d3f/d69/ddd/lf6 0 2024-02-22T00:33:27.119 INFO:tasks.workunit.client.1.smithi161.stdout:2/790: creat de/f111 x:0 0 0 2024-02-22T00:33:27.119 INFO:tasks.workunit.client.1.smithi161.stdout:1/692: creat d19/d85/d87/ff7 x:0 0 0 2024-02-22T00:33:27.120 INFO:tasks.workunit.client.1.smithi161.stdout:9/695: dwrite d1/d2/d7/da/f8e [0,4194304] 0 2024-02-22T00:33:27.130 INFO:tasks.workunit.client.1.smithi161.stdout:3/618: rmdir da/dc/d11/da5 0 2024-02-22T00:33:27.130 INFO:tasks.workunit.client.1.smithi161.stdout:2/791: mknod de/d11/d14/c112 0 2024-02-22T00:33:27.139 INFO:tasks.workunit.client.1.smithi161.stdout:2/792: truncate de/d2b/d8b/da2/da5/dc4/d8f/fd7 571095 0 2024-02-22T00:33:27.139 INFO:tasks.workunit.client.1.smithi161.stdout:7/697: creat d3/dd/fde x:0 0 0 2024-02-22T00:33:27.139 INFO:tasks.workunit.client.1.smithi161.stdout:1/693: mkdir d19/d51/d64/d9b/da5/dbc/df8 0 2024-02-22T00:33:27.139 INFO:tasks.workunit.client.1.smithi161.stdout:8/687: creat d1/d1c/d20/d22/fe1 x:0 0 0 2024-02-22T00:33:27.139 INFO:tasks.workunit.client.1.smithi161.stdout:1/694: readlink d19/d1d/l1e 0 2024-02-22T00:33:27.141 INFO:tasks.workunit.client.1.smithi161.stdout:8/688: write d1/d1c/d20/d22/d3f/f6e [1491521,814] 0 2024-02-22T00:33:27.143 INFO:tasks.workunit.client.1.smithi161.stdout:3/619: rename da/d29/f32 to da/fc8 0 2024-02-22T00:33:27.145 INFO:tasks.workunit.client.1.smithi161.stdout:0/716: creat d14/d37/d42/d73/ff0 x:0 0 0 2024-02-22T00:33:27.146 INFO:tasks.workunit.client.1.smithi161.stdout:3/620: stat da/dc/f31 0 2024-02-22T00:33:27.146 INFO:tasks.workunit.client.1.smithi161.stdout:3/621: stat da/d29/f7f 0 2024-02-22T00:33:27.148 INFO:tasks.workunit.client.1.smithi161.stdout:8/689: creat d1/d1c/d20/d22/d28/d7f/d92/fe2 x:0 0 0 2024-02-22T00:33:27.148 INFO:tasks.workunit.client.1.smithi161.stdout:7/698: mknod d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc/cdf 0 2024-02-22T00:33:27.150 INFO:tasks.workunit.client.1.smithi161.stdout:2/793: rename de/d2b/d8b/ddc/d10d to de/d2b/d8b/da2/da5/dc4/da7/d113 0 2024-02-22T00:33:27.152 INFO:tasks.workunit.client.1.smithi161.stdout:1/695: fdatasync d19/d51/d64/d9b/da5/daa/fe5 0 2024-02-22T00:33:27.155 INFO:tasks.workunit.client.1.smithi161.stdout:2/794: fsync de/d2b/f46 0 2024-02-22T00:33:27.165 INFO:tasks.workunit.client.1.smithi161.stdout:2/795: mkdir de/df4/d114 0 2024-02-22T00:33:27.166 INFO:tasks.workunit.client.1.smithi161.stdout:1/696: dwrite d19/d85/d87/dc6/ff3 [0,4194304] 0 2024-02-22T00:33:27.166 INFO:tasks.workunit.client.1.smithi161.stdout:8/690: creat d1/d1c/d20/d22/d28/d7f/d92/d95/fe3 x:0 0 0 2024-02-22T00:33:27.168 INFO:tasks.workunit.client.1.smithi161.stdout:2/796: symlink de/d2b/d83/l115 0 2024-02-22T00:33:27.174 INFO:tasks.workunit.client.1.smithi161.stdout:8/691: symlink d1/d1c/d96/le4 0 2024-02-22T00:33:27.174 INFO:tasks.workunit.client.1.smithi161.stdout:2/797: mkdir de/d2b/d8b/d116 0 2024-02-22T00:33:27.176 INFO:tasks.workunit.client.1.smithi161.stdout:7/699: dread d3/df/d33/d35/d55/d63/d7b/f29 [0,4194304] 0 2024-02-22T00:33:27.178 INFO:tasks.workunit.client.1.smithi161.stdout:7/700: fdatasync d3/df/d33/d35/fa4 0 2024-02-22T00:33:27.178 INFO:tasks.workunit.client.1.smithi161.stdout:2/798: rmdir de/d2b/d8b/db8 39 2024-02-22T00:33:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:25.757907+0000 mgr.smithi161.sazlam (mgr.24369) 30 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 32 MiB/s rd, 133 MiB/s wr, 369 op/s 2024-02-22T00:33:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.499591+0000 mon.smithi049 (mon.0) 686 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.512696+0000 mon.smithi049 (mon.0) 687 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.524717+0000 mon.smithi161 (mon.1) 58 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.525515+0000 mon.smithi049 (mon.0) 688 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.527164+0000 mon.smithi161 (mon.1) 59 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.527702+0000 mon.smithi049 (mon.0) 689 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.531027+0000 mon.smithi161 (mon.1) 60 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.531493+0000 mon.smithi049 (mon.0) 690 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.543514+0000 mon.smithi049 (mon.0) 691 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:27.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.544894+0000 mon.smithi161 (mon.1) 61 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:33:27.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:26.546280+0000 mon.smithi161 (mon.1) 62 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:33:27.179 INFO:tasks.workunit.client.1.smithi161.stdout:8/692: stat d1/d1c/d20/d22/d28/d36/d6c/cb5 0 2024-02-22T00:33:27.185 INFO:tasks.workunit.client.1.smithi161.stdout:1/697: link d19/d51/d64/d9b/da5/ddb/le9 d19/d1d/d2c/lf9 0 2024-02-22T00:33:27.185 INFO:tasks.workunit.client.1.smithi161.stdout:2/799: mknod de/d11/d5c/dea/df8/d10e/c117 0 2024-02-22T00:33:27.186 INFO:tasks.workunit.client.1.smithi161.stdout:8/693: symlink d1/d1c/le5 0 2024-02-22T00:33:27.192 INFO:tasks.workunit.client.1.smithi161.stdout:5/864: write d3/d1b/d91/d96/fb1 [1747306,19825] 0 2024-02-22T00:33:27.193 INFO:tasks.workunit.client.1.smithi161.stdout:5/865: stat d3/d1b/d8f/lb2 0 2024-02-22T00:33:27.195 INFO:tasks.workunit.client.1.smithi161.stdout:5/866: mkdir d3/d1b/d25/d4c/dcb/d123 0 2024-02-22T00:33:27.199 INFO:tasks.workunit.client.1.smithi161.stdout:2/800: dwrite de/d11/fdf [0,4194304] 0 2024-02-22T00:33:27.203 INFO:tasks.workunit.client.1.smithi161.stdout:5/867: creat d3/d29/d80/d92/df7/f124 x:0 0 0 2024-02-22T00:33:27.203 INFO:tasks.workunit.client.1.smithi161.stdout:2/801: write de/d11/fdf [3447200,27152] 0 2024-02-22T00:33:27.208 INFO:tasks.workunit.client.1.smithi161.stdout:8/694: dwrite d1/d2f/d37/d64/d7b/d7e/f80 [0,4194304] 0 2024-02-22T00:33:27.210 INFO:tasks.workunit.client.1.smithi161.stdout:7/701: dread d3/f9 [0,4194304] 0 2024-02-22T00:33:27.214 INFO:tasks.workunit.client.1.smithi161.stdout:7/702: chown d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/f96 11 1 2024-02-22T00:33:27.216 INFO:tasks.workunit.client.1.smithi161.stdout:5/868: mkdir d3/d1b/d25/d4c/dcb/d123/d125 0 2024-02-22T00:33:27.219 INFO:tasks.workunit.client.1.smithi161.stdout:8/695: rmdir d1/d2f/d37/dd2 0 2024-02-22T00:33:27.219 INFO:tasks.workunit.client.1.smithi161.stdout:5/869: write d3/d1c/fe7 [722155,121065] 0 2024-02-22T00:33:27.219 INFO:tasks.workunit.client.1.smithi161.stdout:7/703: write d3/df/d33/d35/d55/d63/d7b/f3e [1964800,18156] 0 2024-02-22T00:33:27.224 INFO:tasks.workunit.client.1.smithi161.stdout:7/704: fsync d3/df/d33/dbc/dc5/fca 0 2024-02-22T00:33:27.224 INFO:tasks.workunit.client.1.smithi161.stdout:5/870: mknod d3/d1b/d25/c126 0 2024-02-22T00:33:27.225 INFO:tasks.workunit.client.1.smithi161.stdout:7/705: dread - d3/dbf/fd5 zero size 2024-02-22T00:33:27.225 INFO:tasks.workunit.client.1.smithi161.stdout:5/871: dread - d3/d1b/f10a zero size 2024-02-22T00:33:27.227 INFO:tasks.workunit.client.1.smithi161.stdout:4/648: sync 2024-02-22T00:33:27.228 INFO:tasks.workunit.client.1.smithi161.stdout:8/696: read d1/d1c/d75/d18/fb3 [2114255,28862] 0 2024-02-22T00:33:27.229 INFO:tasks.workunit.client.1.smithi161.stdout:5/872: symlink d3/d1b/d91/d96/d11a/l127 0 2024-02-22T00:33:27.231 INFO:tasks.workunit.client.1.smithi161.stdout:7/706: creat d3/df/d33/d35/d55/d63/d7b/d30/d44/fe0 x:0 0 0 2024-02-22T00:33:27.231 INFO:tasks.workunit.client.1.smithi161.stdout:2/802: dread de/d11/d14/f18 [0,4194304] 0 2024-02-22T00:33:27.232 INFO:tasks.workunit.client.1.smithi161.stdout:4/649: symlink d5/lf9 0 2024-02-22T00:33:27.232 INFO:tasks.workunit.client.1.smithi161.stdout:8/697: chown d1/d1c/d20/d22/d28/c6d 3003361 1 2024-02-22T00:33:27.235 INFO:tasks.workunit.client.1.smithi161.stdout:7/707: dread - d3/df/d33/d35/d80/fc1 zero size 2024-02-22T00:33:27.235 INFO:tasks.workunit.client.1.smithi161.stdout:3/622: truncate da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f7c 2344406 0 2024-02-22T00:33:27.237 INFO:tasks.workunit.client.1.smithi161.stdout:2/803: unlink de/d11/d14/l77 0 2024-02-22T00:33:27.239 INFO:tasks.workunit.client.1.smithi161.stdout:5/873: creat d3/f128 x:0 0 0 2024-02-22T00:33:27.240 INFO:tasks.workunit.client.1.smithi161.stdout:4/650: mknod d5/d8/d41/d53/d6c/d72/cfa 0 2024-02-22T00:33:27.242 INFO:tasks.workunit.client.1.smithi161.stdout:7/708: mknod d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc/ce1 0 2024-02-22T00:33:27.244 INFO:tasks.workunit.client.1.smithi161.stdout:7/709: write d3/dd/d59/fc4 [164996,50149] 0 2024-02-22T00:33:27.245 INFO:tasks.workunit.client.1.smithi161.stdout:3/623: unlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/c8b 0 2024-02-22T00:33:27.247 INFO:tasks.workunit.client.1.smithi161.stdout:0/717: mkdir d14/df1 0 2024-02-22T00:33:27.247 INFO:tasks.workunit.client.1.smithi161.stdout:8/698: dwrite d1/d2f/d37/d64/d7b/f5d [0,4194304] 0 2024-02-22T00:33:27.251 INFO:tasks.workunit.client.1.smithi161.stdout:5/874: mknod d3/d29/d122/c129 0 2024-02-22T00:33:27.254 INFO:tasks.workunit.client.1.smithi161.stdout:5/875: stat d3/d29/d80/c99 0 2024-02-22T00:33:27.257 INFO:tasks.workunit.client.1.smithi161.stdout:8/699: stat d1/de0/ld6 0 2024-02-22T00:33:27.257 INFO:tasks.workunit.client.1.smithi161.stdout:2/804: creat de/d2b/d8b/da2/f118 x:0 0 0 2024-02-22T00:33:27.261 INFO:tasks.workunit.client.1.smithi161.stdout:8/700: unlink d1/d1c/d96/le4 0 2024-02-22T00:33:27.262 INFO:tasks.workunit.client.1.smithi161.stdout:5/876: chown d3/d1b/d25/d4c/d7b/lda 3076058 1 2024-02-22T00:33:27.264 INFO:tasks.workunit.client.1.smithi161.stdout:3/624: rename da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/c78 to da/dc/d11/d26/d80/dc7/d59/cc9 0 2024-02-22T00:33:27.265 INFO:tasks.workunit.client.1.smithi161.stdout:8/701: dread - d1/d2f/f84 zero size 2024-02-22T00:33:27.266 INFO:tasks.workunit.client.1.smithi161.stdout:1/698: dwrite d19/d1d/f65 [0,4194304] 0 2024-02-22T00:33:27.272 INFO:tasks.workunit.client.1.smithi161.stdout:7/710: dwrite f2 [8388608,4194304] 0 2024-02-22T00:33:27.272 INFO:tasks.workunit.client.1.smithi161.stdout:1/699: write d19/d1d/d56/db2/fdf [366397,81982] 0 2024-02-22T00:33:27.274 INFO:tasks.workunit.client.1.smithi161.stdout:2/805: link de/d2b/d8b/da2/da5/cab de/c119 0 2024-02-22T00:33:27.283 INFO:tasks.workunit.client.1.smithi161.stdout:1/700: unlink d19/d48/l82 0 2024-02-22T00:33:27.283 INFO:tasks.workunit.client.1.smithi161.stdout:5/877: dread d3/d1b/d25/d4c/d7b/fa1 [0,4194304] 0 2024-02-22T00:33:27.288 INFO:tasks.workunit.client.1.smithi161.stdout:7/711: rename d3/df/d33/d35/d80 to d3/df/d33/d35/d55/d63/d7b/d8f/dd2/de2 0 2024-02-22T00:33:27.289 INFO:tasks.workunit.client.1.smithi161.stdout:7/712: chown d3/df/d33/d35/d55 4056 1 2024-02-22T00:33:27.291 INFO:tasks.workunit.client.1.smithi161.stdout:3/625: link da/dc/d91/fa3 da/dc/d11/d26/d80/dc7/d59/d93/daa/fca 0 2024-02-22T00:33:27.292 INFO:tasks.workunit.client.1.smithi161.stdout:7/713: dread - d3/df/d33/d35/d55/d63/d7b/d30/fc7 zero size 2024-02-22T00:33:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:25.757907+0000 mgr.smithi161.sazlam (mgr.24369) 30 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 32 MiB/s rd, 133 MiB/s wr, 369 op/s 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.499591+0000 mon.smithi049 (mon.0) 686 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.512696+0000 mon.smithi049 (mon.0) 687 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.524717+0000 mon.smithi161 (mon.1) 58 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.525515+0000 mon.smithi049 (mon.0) 688 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.527164+0000 mon.smithi161 (mon.1) 59 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.527702+0000 mon.smithi049 (mon.0) 689 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.531027+0000 mon.smithi161 (mon.1) 60 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.531493+0000 mon.smithi049 (mon.0) 690 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.543514+0000 mon.smithi049 (mon.0) 691 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.544894+0000 mon.smithi161 (mon.1) 61 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:33:27.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:26.546280+0000 mon.smithi161 (mon.1) 62 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:33:27.297 INFO:tasks.workunit.client.1.smithi161.stdout:3/626: stat da/dc/d5f/c8f 0 2024-02-22T00:33:27.299 INFO:tasks.workunit.client.1.smithi161.stdout:0/718: truncate fb 3814283 0 2024-02-22T00:33:27.301 INFO:tasks.workunit.client.1.smithi161.stdout:5/878: mkdir d3/d1b/d25/d4c/d12a 0 2024-02-22T00:33:27.302 INFO:tasks.workunit.client.1.smithi161.stdout:1/701: rename d19/d51/d64/f7b to d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/ffa 0 2024-02-22T00:33:27.304 INFO:tasks.workunit.client.1.smithi161.stdout:0/719: chown d14/d37/f59 315670702 1 2024-02-22T00:33:27.307 INFO:tasks.workunit.client.1.smithi161.stdout:4/651: dread d5/d17/f92 [0,4194304] 0 2024-02-22T00:33:27.307 INFO:tasks.workunit.client.1.smithi161.stdout:3/627: dread da/dc/d11/d26/d80/dc7/d59/f9d [0,4194304] 0 2024-02-22T00:33:27.307 INFO:tasks.workunit.client.1.smithi161.stdout:5/879: mknod d3/d1b/d25/dcc/ddb/c12b 0 2024-02-22T00:33:27.309 INFO:tasks.workunit.client.1.smithi161.stdout:2/806: dread de/f53 [0,4194304] 0 2024-02-22T00:33:27.310 INFO:tasks.workunit.client.1.smithi161.stdout:5/880: stat d3/d1b/d25/d4c/dd2/cf9 0 2024-02-22T00:33:27.311 INFO:tasks.workunit.client.1.smithi161.stdout:2/807: readlink de/d11/d32/l3c 0 2024-02-22T00:33:27.312 INFO:tasks.workunit.client.1.smithi161.stdout:7/714: dwrite d3/df/d33/d35/d55/d63/d7b/d30/f9a [0,4194304] 0 2024-02-22T00:33:27.314 INFO:tasks.workunit.client.1.smithi161.stdout:8/702: truncate d1/d1c/d20/d22/d28/d7f/d92/d95/f57 7631158 0 2024-02-22T00:33:27.315 INFO:tasks.workunit.client.1.smithi161.stdout:8/703: chown d1/d2f/d30/f74 30740256 1 2024-02-22T00:33:27.317 INFO:tasks.workunit.client.1.smithi161.stdout:1/702: symlink d19/lfb 0 2024-02-22T00:33:27.325 INFO:tasks.workunit.client.1.smithi161.stdout:5/881: fdatasync d3/d1b/d25/f23 0 2024-02-22T00:33:27.328 INFO:tasks.workunit.client.1.smithi161.stdout:4/652: truncate d5/f27 2293788 0 2024-02-22T00:33:27.329 INFO:tasks.workunit.client.1.smithi161.stdout:2/808: dwrite de/d11/d14/faa [0,4194304] 0 2024-02-22T00:33:27.329 INFO:tasks.workunit.client.1.smithi161.stdout:7/715: symlink d3/df/d43/le3 0 2024-02-22T00:33:27.334 INFO:tasks.workunit.client.1.smithi161.stdout:4/653: chown d5/d10/d14/f1c 195 1 2024-02-22T00:33:27.336 INFO:tasks.workunit.client.1.smithi161.stdout:2/809: write de/d2b/d8b/ddc/fec [1515752,76841] 0 2024-02-22T00:33:27.342 INFO:tasks.workunit.client.1.smithi161.stdout:2/810: fsync de/d2b/d65/d3a/f75 0 2024-02-22T00:33:27.343 INFO:tasks.workunit.client.1.smithi161.stdout:4/654: unlink d5/d8/f76 0 2024-02-22T00:33:27.349 INFO:tasks.workunit.client.1.smithi161.stdout:0/720: dwrite d14/d1a/f71 [0,4194304] 0 2024-02-22T00:33:27.351 INFO:tasks.workunit.client.1.smithi161.stdout:3/628: dwrite da/dc/d11/d26/d80/fb6 [0,4194304] 0 2024-02-22T00:33:27.352 INFO:tasks.workunit.client.1.smithi161.stdout:1/703: dread d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/ffa [0,4194304] 0 2024-02-22T00:33:27.355 INFO:tasks.workunit.client.1.smithi161.stdout:5/882: dread d3/d1b/d36/f52 [0,4194304] 0 2024-02-22T00:33:27.355 INFO:tasks.workunit.client.1.smithi161.stdout:2/811: fdatasync de/d11/f29 0 2024-02-22T00:33:27.358 INFO:tasks.workunit.client.1.smithi161.stdout:8/704: dwrite d1/d1c/f89 [0,4194304] 0 2024-02-22T00:33:27.360 INFO:tasks.workunit.client.1.smithi161.stdout:2/812: fdatasync de/d2b/d65/d3a/d9d/fa9 0 2024-02-22T00:33:27.364 INFO:tasks.workunit.client.1.smithi161.stdout:5/883: rmdir d3/d1b/d25/dcc 39 2024-02-22T00:33:27.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/609: sync 2024-02-22T00:33:27.367 INFO:tasks.workunit.client.1.smithi161.stdout:7/716: rename d3/dd/d59/d5b to d3/df/d33/d35/d55/de4 0 2024-02-22T00:33:27.369 INFO:tasks.workunit.client.1.smithi161.stdout:0/721: truncate d14/d37/d42/d73/fa8 925948 0 2024-02-22T00:33:27.375 INFO:tasks.workunit.client.1.smithi161.stdout:6/610: readlink d3/dc/la0 0 2024-02-22T00:33:27.377 INFO:tasks.workunit.client.1.smithi161.stdout:6/611: chown d3/f5d 339560 1 2024-02-22T00:33:27.377 INFO:tasks.workunit.client.1.smithi161.stdout:2/813: truncate de/d2b/fd0 1155063 0 2024-02-22T00:33:27.377 INFO:tasks.workunit.client.1.smithi161.stdout:5/884: creat d3/d1b/d36/dc1/f12c x:0 0 0 2024-02-22T00:33:27.382 INFO:tasks.workunit.client.1.smithi161.stdout:1/704: rename d19/d1d/d2c/d2d/f63 to d19/d51/d64/d9b/da5/dbc/ffc 0 2024-02-22T00:33:27.383 INFO:tasks.workunit.client.1.smithi161.stdout:4/655: dwrite d5/d10/d14/d4f/fe4 [0,4194304] 0 2024-02-22T00:33:27.385 INFO:tasks.workunit.client.1.smithi161.stdout:6/612: mknod d3/d10/d1b/d5e/d87/cc1 0 2024-02-22T00:33:27.386 INFO:tasks.workunit.client.1.smithi161.stdout:2/814: chown de/d2b/fd0 72 1 2024-02-22T00:33:27.393 INFO:tasks.workunit.client.1.smithi161.stdout:5/885: getdents d3/d1b/d8f/dfb 0 2024-02-22T00:33:27.398 INFO:tasks.workunit.client.1.smithi161.stdout:1/705: read d19/d1d/f27 [189296,27542] 0 2024-02-22T00:33:27.399 INFO:tasks.workunit.client.1.smithi161.stdout:4/656: mkdir d5/d8/d41/d53/d6c/d72/dfb 0 2024-02-22T00:33:27.399 INFO:tasks.workunit.client.1.smithi161.stdout:7/717: chown d3/df/d33/d35/d55/d63/d7b/l2e 15670783 1 2024-02-22T00:33:27.402 INFO:tasks.workunit.client.1.smithi161.stdout:7/718: chown d3/df/d33/d35/d55/d63/f66 12503 1 2024-02-22T00:33:27.403 INFO:tasks.workunit.client.1.smithi161.stdout:6/613: creat d3/d10/d1b/d5e/d87/fc2 x:0 0 0 2024-02-22T00:33:27.405 INFO:tasks.workunit.client.1.smithi161.stdout:0/722: write d14/d44/fe7 [230290,27194] 0 2024-02-22T00:33:27.405 INFO:tasks.workunit.client.1.smithi161.stdout:5/886: creat d3/d1c/d20/f12d x:0 0 0 2024-02-22T00:33:27.407 INFO:tasks.workunit.client.1.smithi161.stdout:4/657: write d5/d8/d41/d57/dbe/d28/d38/d6d/da5/ff7 [1015523,21710] 0 2024-02-22T00:33:27.409 INFO:tasks.workunit.client.1.smithi161.stdout:6/614: write d3/d10/f65 [563989,1561] 0 2024-02-22T00:33:27.412 INFO:tasks.workunit.client.1.smithi161.stdout:2/815: mkdir de/d2b/d8b/de6/dfb/d11a 0 2024-02-22T00:33:27.415 INFO:tasks.workunit.client.1.smithi161.stdout:7/719: mkdir d3/df/d33/d35/d55/d63/d7b/de5 0 2024-02-22T00:33:27.420 INFO:tasks.workunit.client.1.smithi161.stdout:1/706: dwrite d19/fb4 [0,4194304] 0 2024-02-22T00:33:27.424 INFO:tasks.workunit.client.1.smithi161.stdout:0/723: dread d14/d1a/d9d/dba/fc2 [0,4194304] 0 2024-02-22T00:33:27.424 INFO:tasks.workunit.client.1.smithi161.stdout:5/887: truncate d3/d1b/d36/f81 733766 0 2024-02-22T00:33:27.429 INFO:tasks.workunit.client.1.smithi161.stdout:3/629: dwrite da/dc/d11/d26/f52 [0,4194304] 0 2024-02-22T00:33:27.429 INFO:tasks.workunit.client.1.smithi161.stdout:8/705: dread d1/d1c/d20/d22/d28/d7f/d92/d95/f50 [0,4194304] 0 2024-02-22T00:33:27.429 INFO:tasks.workunit.client.1.smithi161.stdout:9/696: sync 2024-02-22T00:33:27.434 INFO:tasks.workunit.client.1.smithi161.stdout:8/706: readlink d1/l60 0 2024-02-22T00:33:27.434 INFO:tasks.workunit.client.1.smithi161.stdout:2/816: chown de/d2b/d8b/da2/da5/dc4/f74 827838208 1 2024-02-22T00:33:27.434 INFO:tasks.workunit.client.1.smithi161.stdout:0/724: write d14/d37/d42/d8e/d92/fd8 [973892,100995] 0 2024-02-22T00:33:27.435 INFO:tasks.workunit.client.1.smithi161.stdout:7/720: truncate d3/df/d33/d35/d55/de4/f51 3385825 0 2024-02-22T00:33:27.437 INFO:tasks.workunit.client.1.smithi161.stdout:1/707: creat d19/d1d/d2c/ffd x:0 0 0 2024-02-22T00:33:27.437 INFO:tasks.workunit.client.1.smithi161.stdout:5/888: fdatasync d3/d1b/d25/f39 0 2024-02-22T00:33:27.442 INFO:tasks.workunit.client.1.smithi161.stdout:8/707: mkdir d1/d1c/d20/de6 0 2024-02-22T00:33:27.444 INFO:tasks.workunit.client.1.smithi161.stdout:6/615: write d3/d10/d12/d3a/f96 [821441,8074] 0 2024-02-22T00:33:27.448 INFO:tasks.workunit.client.1.smithi161.stdout:7/721: mknod d3/df/d33/d35/ce6 0 2024-02-22T00:33:27.449 INFO:tasks.workunit.client.1.smithi161.stdout:5/889: creat d3/d1b/d25/d4c/dcb/f12e x:0 0 0 2024-02-22T00:33:27.452 INFO:tasks.workunit.client.1.smithi161.stdout:9/697: truncate d1/d25/dc4/d4f/da3/fce 57365 0 2024-02-22T00:33:27.453 INFO:tasks.workunit.client.1.smithi161.stdout:2/817: link de/d11/d14/f18 de/d2b/d8b/da2/f11b 0 2024-02-22T00:33:27.455 INFO:tasks.workunit.client.1.smithi161.stdout:8/708: dread d1/d2f/f3e [0,4194304] 0 2024-02-22T00:33:27.456 INFO:tasks.workunit.client.1.smithi161.stdout:6/616: write d3/d10/d12/d3a/f43 [4132574,2353] 0 2024-02-22T00:33:27.458 INFO:tasks.workunit.client.1.smithi161.stdout:7/722: dread - d3/dbf/d64/fd0 zero size 2024-02-22T00:33:27.460 INFO:tasks.workunit.client.1.smithi161.stdout:2/818: write de/d2b/d65/d60/f78 [1038942,120199] 0 2024-02-22T00:33:27.461 INFO:tasks.workunit.client.1.smithi161.stdout:0/725: write d14/d37/f45 [1240591,85322] 0 2024-02-22T00:33:27.462 INFO:tasks.workunit.client.1.smithi161.stdout:1/708: truncate d19/d1d/d2c/d2d/d3f/fbd 618473 0 2024-02-22T00:33:27.463 INFO:tasks.workunit.client.1.smithi161.stdout:1/709: chown d19/d1d/d56/fa4 556864092 1 2024-02-22T00:33:27.464 INFO:tasks.workunit.client.1.smithi161.stdout:6/617: rmdir d3/d7c 39 2024-02-22T00:33:27.465 INFO:tasks.workunit.client.1.smithi161.stdout:4/658: dwrite d5/d8/d41/d57/dbe/d28/fa2 [0,4194304] 0 2024-02-22T00:33:27.469 INFO:tasks.workunit.client.1.smithi161.stdout:3/630: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/fb2 [0,4194304] 0 2024-02-22T00:33:27.469 INFO:tasks.workunit.client.1.smithi161.stdout:5/890: mknod d3/d29/d80/d92/df6/c12f 0 2024-02-22T00:33:27.470 INFO:tasks.workunit.client.1.smithi161.stdout:8/709: truncate d1/d2f/fa8 789657 0 2024-02-22T00:33:27.471 INFO:tasks.workunit.client.1.smithi161.stdout:9/698: creat d1/d25/d73/d60/d77/d99/ff1 x:0 0 0 2024-02-22T00:33:27.473 INFO:tasks.workunit.client.1.smithi161.stdout:7/723: write d3/f73 [1675354,89046] 0 2024-02-22T00:33:27.476 INFO:tasks.workunit.client.1.smithi161.stdout:1/710: creat d19/d51/ffe x:0 0 0 2024-02-22T00:33:27.484 INFO:tasks.workunit.client.1.smithi161.stdout:9/699: write d1/d2/d4/d1f/fcf [196912,86838] 0 2024-02-22T00:33:27.484 INFO:tasks.workunit.client.1.smithi161.stdout:2/819: mknod de/d2b/d8b/db8/c11c 0 2024-02-22T00:33:27.485 INFO:tasks.workunit.client.1.smithi161.stdout:5/891: read d3/d1b/d91/fad [326166,72754] 0 2024-02-22T00:33:27.487 INFO:tasks.workunit.client.1.smithi161.stdout:1/711: unlink d19/f8a 0 2024-02-22T00:33:27.492 INFO:tasks.workunit.client.1.smithi161.stdout:0/726: dwrite d14/f4b [0,4194304] 0 2024-02-22T00:33:27.494 INFO:tasks.workunit.client.1.smithi161.stdout:3/631: rename da/dc/d11/c15 to da/dc/d11/d26/d80/dc7/d59/d93/ccb 0 2024-02-22T00:33:27.496 INFO:tasks.workunit.client.1.smithi161.stdout:5/892: write d3/d1c/d62/f94 [279829,89431] 0 2024-02-22T00:33:27.498 INFO:tasks.workunit.client.1.smithi161.stdout:7/724: write d3/df/d33/d35/d55/d63/d7b/f70 [1796270,105962] 0 2024-02-22T00:33:27.499 INFO:tasks.workunit.client.1.smithi161.stdout:6/618: dwrite d3/d10/d12/d2f/d7d/d5f/f99 [0,4194304] 0 2024-02-22T00:33:27.509 INFO:tasks.workunit.client.1.smithi161.stdout:4/659: truncate d5/d8/d41/f54 2306300 0 2024-02-22T00:33:27.509 INFO:tasks.workunit.client.1.smithi161.stdout:7/725: chown d3/df/d33/d35/d55/d63/d7b/f29 6575 1 2024-02-22T00:33:27.509 INFO:tasks.workunit.client.1.smithi161.stdout:0/727: unlink d14/d44/f67 0 2024-02-22T00:33:27.509 INFO:tasks.workunit.client.1.smithi161.stdout:2/820: unlink de/d2b/d65/ld3 0 2024-02-22T00:33:27.512 INFO:tasks.workunit.client.1.smithi161.stdout:3/632: dwrite da/fb3 [0,4194304] 0 2024-02-22T00:33:27.513 INFO:tasks.workunit.client.1.smithi161.stdout:7/726: write d3/df/d33/d74/fd8 [111034,72083] 0 2024-02-22T00:33:27.513 INFO:tasks.workunit.client.1.smithi161.stdout:3/633: stat da/fb3 0 2024-02-22T00:33:27.517 INFO:tasks.workunit.client.1.smithi161.stdout:5/893: write d3/d1b/d25/d4c/fed [1155975,72074] 0 2024-02-22T00:33:27.517 INFO:tasks.workunit.client.1.smithi161.stdout:9/700: write d1/d5/d9/f76 [3114462,3100] 0 2024-02-22T00:33:27.517 INFO:tasks.workunit.client.1.smithi161.stdout:4/660: creat d5/d8/d41/ffc x:0 0 0 2024-02-22T00:33:27.518 INFO:tasks.workunit.client.1.smithi161.stdout:0/728: creat d14/d1a/d3f/d96/da1/ff2 x:0 0 0 2024-02-22T00:33:27.519 INFO:tasks.workunit.client.1.smithi161.stdout:3/634: creat da/dc/d11/d26/d80/d92/fcc x:0 0 0 2024-02-22T00:33:27.520 INFO:tasks.workunit.client.1.smithi161.stdout:8/710: link d1/d1c/d20/d22/d28/d36/f7a d1/d1c/d20/d22/d28/d7f/d92/fe7 0 2024-02-22T00:33:27.522 INFO:tasks.workunit.client.1.smithi161.stdout:3/635: fsync da/dc/d91/f9c 0 2024-02-22T00:33:27.523 INFO:tasks.workunit.client.1.smithi161.stdout:1/712: dread d19/d1d/d2c/d2d/d3f/f9f [0,4194304] 0 2024-02-22T00:33:27.525 INFO:tasks.workunit.client.1.smithi161.stdout:1/713: stat d19/d1d/d2c/ffd 0 2024-02-22T00:33:27.527 INFO:tasks.workunit.client.1.smithi161.stdout:6/619: getdents d3/d10/d12/d95 0 2024-02-22T00:33:27.527 INFO:tasks.workunit.client.1.smithi161.stdout:7/727: read d3/dbf/d64/f78 [3232948,69223] 0 2024-02-22T00:33:27.527 INFO:tasks.workunit.client.1.smithi161.stdout:8/711: write d1/d1c/d75/d18/fb3 [4471637,81861] 0 2024-02-22T00:33:27.530 INFO:tasks.workunit.client.1.smithi161.stdout:9/701: rename d1/d25/f58 to d1/d2/d4/d11/ff2 0 2024-02-22T00:33:27.531 INFO:tasks.workunit.client.1.smithi161.stdout:3/636: creat da/dc/d91/db5/fcd x:0 0 0 2024-02-22T00:33:27.532 INFO:tasks.workunit.client.1.smithi161.stdout:7/728: fsync d3/df/d33/d74/f98 0 2024-02-22T00:33:27.536 INFO:tasks.workunit.client.1.smithi161.stdout:6/620: write d3/d10/d1b/d5e/d87/f88 [112701,98062] 0 2024-02-22T00:33:27.538 INFO:tasks.workunit.client.1.smithi161.stdout:9/702: read - d1/d25/d73/d60/d77/d99/ff1 zero size 2024-02-22T00:33:27.539 INFO:tasks.workunit.client.1.smithi161.stdout:0/729: rename d14/d37/d42/d73/fa7 to d14/d1a/d3f/d96/dbc/dc5/ff3 0 2024-02-22T00:33:27.540 INFO:tasks.workunit.client.1.smithi161.stdout:5/894: dwrite d3/d1b/d25/dcc/fd9 [0,4194304] 0 2024-02-22T00:33:27.540 INFO:tasks.workunit.client.1.smithi161.stdout:7/729: symlink d3/dbf/d64/le7 0 2024-02-22T00:33:27.543 INFO:tasks.workunit.client.1.smithi161.stdout:4/661: write d5/d10/d14/f29 [1773899,83504] 0 2024-02-22T00:33:27.543 INFO:tasks.workunit.client.1.smithi161.stdout:7/730: chown d3/df/d33/d35/la3 285 1 2024-02-22T00:33:27.549 INFO:tasks.workunit.client.1.smithi161.stdout:3/637: rename da/d56 to da/d29/d53/dc1/dce 0 2024-02-22T00:33:27.550 INFO:tasks.workunit.client.1.smithi161.stdout:8/712: creat d1/d1c/d20/d22/d28/d7f/d92/d93/fe8 x:0 0 0 2024-02-22T00:33:27.551 INFO:tasks.workunit.client.1.smithi161.stdout:7/731: fdatasync d3/df/d33/d35/d55/d63/d7b/d50/f83 0 2024-02-22T00:33:27.553 INFO:tasks.workunit.client.1.smithi161.stdout:5/895: mknod d3/d1c/d20/d116/c130 0 2024-02-22T00:33:27.554 INFO:tasks.workunit.client.1.smithi161.stdout:1/714: dread d19/f37 [0,4194304] 0 2024-02-22T00:33:27.556 INFO:tasks.workunit.client.1.smithi161.stdout:4/662: write d5/d17/f93 [1602898,8761] 0 2024-02-22T00:33:27.557 INFO:tasks.workunit.client.1.smithi161.stdout:6/621: rename d3/d30/db4/db5 to d3/d10/d1b/da5/dc3 0 2024-02-22T00:33:27.557 INFO:tasks.workunit.client.1.smithi161.stdout:1/715: readlink d19/d48/l60 0 2024-02-22T00:33:27.560 INFO:tasks.workunit.client.1.smithi161.stdout:5/896: symlink d3/d1b/l131 0 2024-02-22T00:33:27.564 INFO:tasks.workunit.client.1.smithi161.stdout:9/703: creat d1/d2/d4/d11/ff3 x:0 0 0 2024-02-22T00:33:27.566 INFO:tasks.workunit.client.1.smithi161.stdout:4/663: readlink d5/d8/l19 0 2024-02-22T00:33:27.567 INFO:tasks.workunit.client.1.smithi161.stdout:0/730: dwrite d14/d1a/d3f/f64 [0,4194304] 0 2024-02-22T00:33:27.567 INFO:tasks.workunit.client.1.smithi161.stdout:6/622: unlink d3/d10/d1b/f34 0 2024-02-22T00:33:27.572 INFO:tasks.workunit.client.1.smithi161.stdout:9/704: mknod d1/d5/d9/da5/dbc/cf4 0 2024-02-22T00:33:27.573 INFO:tasks.workunit.client.1.smithi161.stdout:4/664: read - d5/d8/d41/d57/dbe/d28/d63/d6b/f78 zero size 2024-02-22T00:33:27.576 INFO:tasks.workunit.client.1.smithi161.stdout:8/713: link d1/d1c/d20/d22/d28/d7f/d92/d95/f3c d1/d2f/d37/dd7/fe9 0 2024-02-22T00:33:27.580 INFO:tasks.workunit.client.1.smithi161.stdout:5/897: creat d3/d1c/d67/d113/f132 x:0 0 0 2024-02-22T00:33:27.580 INFO:tasks.workunit.client.1.smithi161.stdout:9/705: dread - d1/d2/f3d zero size 2024-02-22T00:33:27.580 INFO:tasks.workunit.client.1.smithi161.stdout:3/638: getdents da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4 0 2024-02-22T00:33:27.580 INFO:tasks.workunit.client.1.smithi161.stdout:0/731: mknod d14/d37/d42/d8e/cf4 0 2024-02-22T00:33:27.582 INFO:tasks.workunit.client.1.smithi161.stdout:7/732: getdents d3/df/d33/d35/d55/d63/d7b/d8f/dd2/de2 0 2024-02-22T00:33:27.583 INFO:tasks.workunit.client.1.smithi161.stdout:0/732: readlink d14/d37/l72 0 2024-02-22T00:33:27.584 INFO:tasks.workunit.client.1.smithi161.stdout:4/665: symlink d5/d8/d41/d53/d6c/dd8/lfd 0 2024-02-22T00:33:27.588 INFO:tasks.workunit.client.1.smithi161.stdout:5/898: symlink d3/d1c/d67/l133 0 2024-02-22T00:33:27.588 INFO:tasks.workunit.client.1.smithi161.stdout:7/733: write d3/df/d43/fb3 [546101,107290] 0 2024-02-22T00:33:27.592 INFO:tasks.workunit.client.1.smithi161.stdout:0/733: fsync d14/d37/d42/d8e/fa9 0 2024-02-22T00:33:27.592 INFO:tasks.workunit.client.1.smithi161.stdout:6/623: dwrite d3/d10/d1b/f2e [4194304,4194304] 0 2024-02-22T00:33:27.593 INFO:tasks.workunit.client.1.smithi161.stdout:3/639: fsync da/fc8 0 2024-02-22T00:33:27.593 INFO:tasks.workunit.client.1.smithi161.stdout:7/734: read - d3/dbf/d64/fd0 zero size 2024-02-22T00:33:27.596 INFO:tasks.workunit.client.1.smithi161.stdout:8/714: rename d1/d2f/d37/d64/fb9 to d1/d2f/fea 0 2024-02-22T00:33:27.598 INFO:tasks.workunit.client.1.smithi161.stdout:6/624: creat d3/d30/db4/fc4 x:0 0 0 2024-02-22T00:33:27.599 INFO:tasks.workunit.client.1.smithi161.stdout:7/735: write d3/f17 [2212980,17698] 0 2024-02-22T00:33:27.599 INFO:tasks.workunit.client.1.smithi161.stdout:0/734: mknod d14/d44/dbe/cf5 0 2024-02-22T00:33:27.603 INFO:tasks.workunit.client.1.smithi161.stdout:5/899: rename d3/l6a to d3/d1b/d8f/l134 0 2024-02-22T00:33:27.605 INFO:tasks.workunit.client.1.smithi161.stdout:8/715: mknod d1/d1c/d75/d18/ceb 0 2024-02-22T00:33:27.607 INFO:tasks.workunit.client.1.smithi161.stdout:0/735: write d14/d37/d42/d73/ff0 [377306,113289] 0 2024-02-22T00:33:27.609 INFO:tasks.workunit.client.1.smithi161.stdout:1/716: dwrite d19/f46 [0,4194304] 0 2024-02-22T00:33:27.610 INFO:tasks.workunit.client.1.smithi161.stdout:9/706: write d1/d25/d73/d60/f92 [3261352,63056] 0 2024-02-22T00:33:27.611 INFO:tasks.workunit.client.1.smithi161.stdout:5/900: write d3/d1b/d25/d84/f107 [163774,53583] 0 2024-02-22T00:33:27.612 INFO:tasks.workunit.client.1.smithi161.stdout:3/640: truncate da/dc/d91/f9c 2545957 0 2024-02-22T00:33:27.613 INFO:tasks.workunit.client.1.smithi161.stdout:7/736: symlink d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc/le8 0 2024-02-22T00:33:27.615 INFO:tasks.workunit.client.1.smithi161.stdout:1/717: stat d19/d1d/d56/db2/fc8 0 2024-02-22T00:33:27.615 INFO:tasks.workunit.client.1.smithi161.stdout:6/625: getdents d3/d10/d72 0 2024-02-22T00:33:27.618 INFO:tasks.workunit.client.1.smithi161.stdout:7/737: readlink d3/df/d43/l8b 0 2024-02-22T00:33:27.620 INFO:tasks.workunit.client.1.smithi161.stdout:6/626: chown d3/d10/d12/d3a/c9c 0 1 2024-02-22T00:33:27.621 INFO:tasks.workunit.client.1.smithi161.stdout:0/736: mkdir d14/d1a/d3f/d5d/df6 0 2024-02-22T00:33:27.625 INFO:tasks.workunit.client.1.smithi161.stdout:3/641: mknod da/dc/d11/ccf 0 2024-02-22T00:33:27.629 INFO:tasks.workunit.client.1.smithi161.stdout:5/901: dwrite d3/d1c/d67/d113/f132 [0,4194304] 0 2024-02-22T00:33:27.629 INFO:tasks.workunit.client.1.smithi161.stdout:8/716: truncate d1/d1c/d20/d22/d28/d7f/d92/d95/f57 6837451 0 2024-02-22T00:33:27.629 INFO:tasks.workunit.client.1.smithi161.stdout:9/707: getdents d1/d5/d9/da5 0 2024-02-22T00:33:27.629 INFO:tasks.workunit.client.1.smithi161.stdout:7/738: chown d3/df/d33/d35/d55/d63/d7b/d8f/dd2/de2/fb0 22 1 2024-02-22T00:33:27.631 INFO:tasks.workunit.client.1.smithi161.stdout:0/737: creat d14/df1/ff7 x:0 0 0 2024-02-22T00:33:27.633 INFO:tasks.workunit.client.1.smithi161.stdout:1/718: write d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f79 [491203,61881] 0 2024-02-22T00:33:27.633 INFO:tasks.workunit.client.1.smithi161.stdout:4/666: dread d5/d10/d14/f45 [0,4194304] 0 2024-02-22T00:33:27.636 INFO:tasks.workunit.client.1.smithi161.stdout:9/708: dread - d1/d25/d73/d60/fd4 zero size 2024-02-22T00:33:27.638 INFO:tasks.workunit.client.1.smithi161.stdout:8/717: rmdir d1/d1c/d20/d22/d3f 39 2024-02-22T00:33:27.639 INFO:tasks.workunit.client.1.smithi161.stdout:7/739: symlink d3/df/d33/d53/le9 0 2024-02-22T00:33:27.639 INFO:tasks.workunit.client.1.smithi161.stdout:1/719: write d19/d48/f5a [1757470,37219] 0 2024-02-22T00:33:27.641 INFO:tasks.workunit.client.1.smithi161.stdout:4/667: unlink d5/l4c 0 2024-02-22T00:33:27.641 INFO:tasks.workunit.client.1.smithi161.stdout:1/720: readlink d19/d51/d6c/dd4/lc0 0 2024-02-22T00:33:27.643 INFO:tasks.workunit.client.1.smithi161.stdout:5/902: symlink d3/d1b/d25/db5/l135 0 2024-02-22T00:33:27.646 INFO:tasks.workunit.client.1.smithi161.stdout:9/709: creat d1/d25/dc4/d4f/da3/de2/ff5 x:0 0 0 2024-02-22T00:33:27.652 INFO:tasks.workunit.client.1.smithi161.stdout:1/721: read d19/d51/d64/d9b/da5/fcc [2495880,49136] 0 2024-02-22T00:33:27.652 INFO:tasks.workunit.client.1.smithi161.stdout:3/642: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f85 [0,4194304] 0 2024-02-22T00:33:27.652 INFO:tasks.workunit.client.1.smithi161.stdout:0/738: link d14/d1a/l6d d14/d1a/lf8 0 2024-02-22T00:33:27.658 INFO:tasks.workunit.client.1.smithi161.stdout:6/627: dread d3/d10/d12/d3a/f43 [0,4194304] 0 2024-02-22T00:33:27.658 INFO:tasks.workunit.client.1.smithi161.stdout:1/722: chown d19/l1c 98921330 1 2024-02-22T00:33:27.659 INFO:tasks.workunit.client.1.smithi161.stdout:0/739: stat d14/d37/d42/d73/fa8 0 2024-02-22T00:33:27.660 INFO:tasks.workunit.client.1.smithi161.stdout:7/740: rename d3/dd/d59/f7c to d3/df/d33/d35/d55/d63/d7b/d8f/fea 0 2024-02-22T00:33:27.660 INFO:tasks.workunit.client.1.smithi161.stdout:4/668: dwrite d5/d8/d41/d57/dbe/d28/d63/d6b/fd1 [0,4194304] 0 2024-02-22T00:33:27.661 INFO:tasks.workunit.client.1.smithi161.stdout:9/710: symlink d1/d5/d9/lf6 0 2024-02-22T00:33:27.662 INFO:tasks.workunit.client.1.smithi161.stdout:8/718: creat d1/d1c/d20/d22/d28/d36/fec x:0 0 0 2024-02-22T00:33:27.663 INFO:tasks.workunit.client.1.smithi161.stdout:6/628: write d3/dc/f41 [319163,47101] 0 2024-02-22T00:33:27.668 INFO:tasks.workunit.client.1.smithi161.stdout:7/741: symlink d3/df/d33/d35/d55/de4/leb 0 2024-02-22T00:33:27.671 INFO:tasks.workunit.client.1.smithi161.stdout:9/711: unlink d1/d25/f43 0 2024-02-22T00:33:27.672 INFO:tasks.workunit.client.1.smithi161.stdout:6/629: truncate d3/d30/f76 431831 0 2024-02-22T00:33:27.673 INFO:tasks.workunit.client.1.smithi161.stdout:1/723: creat d19/d51/d64/d9b/da5/ddb/fff x:0 0 0 2024-02-22T00:33:27.680 INFO:tasks.workunit.client.1.smithi161.stdout:0/740: dwrite f3 [0,4194304] 0 2024-02-22T00:33:27.680 INFO:tasks.workunit.client.1.smithi161.stdout:8/719: mknod d1/d2f/d37/d64/d7b/ddf/ced 0 2024-02-22T00:33:27.681 INFO:tasks.workunit.client.1.smithi161.stdout:4/669: dread d5/d10/f1b [0,4194304] 0 2024-02-22T00:33:27.682 INFO:tasks.workunit.client.1.smithi161.stdout:6/630: mkdir d3/d10/d72/dc5 0 2024-02-22T00:33:27.686 INFO:tasks.workunit.client.1.smithi161.stdout:7/742: creat d3/df/d33/d35/d55/d63/d7b/d30/d44/fec x:0 0 0 2024-02-22T00:33:27.686 INFO:tasks.workunit.client.1.smithi161.stdout:6/631: fdatasync d3/f5d 0 2024-02-22T00:33:27.688 INFO:tasks.workunit.client.1.smithi161.stdout:3/643: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/fb0 [0,4194304] 0 2024-02-22T00:33:27.688 INFO:tasks.workunit.client.1.smithi161.stdout:4/670: write d5/d10/d14/fad [716066,57287] 0 2024-02-22T00:33:27.689 INFO:tasks.workunit.client.1.smithi161.stdout:1/724: creat d19/d90/dd6/f100 x:0 0 0 2024-02-22T00:33:27.689 INFO:tasks.workunit.client.1.smithi161.stdout:0/741: chown d14/d1a/d3f/d5d/f69 48 1 2024-02-22T00:33:27.693 INFO:tasks.workunit.client.1.smithi161.stdout:6/632: chown d3/d30/c4a 6 1 2024-02-22T00:33:27.699 INFO:tasks.workunit.client.1.smithi161.stdout:3/644: chown da/dc/d11/f3e 0 1 2024-02-22T00:33:27.699 INFO:tasks.workunit.client.1.smithi161.stdout:1/725: symlink d19/d85/d87/l101 0 2024-02-22T00:33:27.701 INFO:tasks.workunit.client.1.smithi161.stdout:0/742: dwrite d14/d1a/d3f/d96/da1/ff2 [0,4194304] 0 2024-02-22T00:33:27.705 INFO:tasks.workunit.client.1.smithi161.stdout:9/712: link d1/d2/d7/l19 d1/d25/d73/d98/dec/lf7 0 2024-02-22T00:33:27.708 INFO:tasks.workunit.client.1.smithi161.stdout:6/633: link d3/d10/f65 d3/d10/d12/d2f/fc6 0 2024-02-22T00:33:27.711 INFO:tasks.workunit.client.1.smithi161.stdout:6/634: write d3/d10/d12/d2f/f3c [2885460,2273] 0 2024-02-22T00:33:27.712 INFO:tasks.workunit.client.1.smithi161.stdout:4/671: link d5/d8/d41/d57/dbe/d28/d63/d65/fdc d5/d8/d41/d53/d6c/d91/ffe 0 2024-02-22T00:33:27.713 INFO:tasks.workunit.client.1.smithi161.stdout:3/645: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/fd0 x:0 0 0 2024-02-22T00:33:27.715 INFO:tasks.workunit.client.1.smithi161.stdout:0/743: dwrite d14/d1a/d3f/d5d/fb6 [0,4194304] 0 2024-02-22T00:33:27.715 INFO:tasks.workunit.client.1.smithi161.stdout:9/713: mknod d1/d25/d73/cf8 0 2024-02-22T00:33:27.715 INFO:tasks.workunit.client.1.smithi161.stdout:8/720: write d1/d1c/d20/d22/d28/d7f/d92/d95/f57 [2432950,104108] 0 2024-02-22T00:33:27.719 INFO:tasks.workunit.client.1.smithi161.stdout:1/726: rename d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/fe6 to d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f102 0 2024-02-22T00:33:27.722 INFO:tasks.workunit.client.1.smithi161.stdout:8/721: stat d1/d2f/d30/f74 0 2024-02-22T00:33:27.722 INFO:tasks.workunit.client.1.smithi161.stdout:3/646: unlink da/c2c 0 2024-02-22T00:33:27.724 INFO:tasks.workunit.client.1.smithi161.stdout:0/744: rename d14/d1a/cb8 to d14/d1a/d9d/dba/cf9 0 2024-02-22T00:33:27.728 INFO:tasks.workunit.client.1.smithi161.stdout:7/743: dread d3/df/d33/d35/d55/de4/f4e [0,4194304] 0 2024-02-22T00:33:27.729 INFO:tasks.workunit.client.1.smithi161.stdout:6/635: getdents d3/d10/d12/d2f/d7d/d82 0 2024-02-22T00:33:27.731 INFO:tasks.workunit.client.1.smithi161.stdout:3/647: dread da/f46 [0,4194304] 0 2024-02-22T00:33:27.733 INFO:tasks.workunit.client.1.smithi161.stdout:7/744: truncate d3/fa 9196631 0 2024-02-22T00:33:27.733 INFO:tasks.workunit.client.1.smithi161.stdout:0/745: unlink d14/d29/f5c 0 2024-02-22T00:33:27.737 INFO:tasks.workunit.client.1.smithi161.stdout:9/714: write d1/d2/f89 [889166,122365] 0 2024-02-22T00:33:27.737 INFO:tasks.workunit.client.1.smithi161.stdout:1/727: dwrite d19/d48/f5a [4194304,4194304] 0 2024-02-22T00:33:27.739 INFO:tasks.workunit.client.1.smithi161.stdout:8/722: creat d1/d1c/d20/d22/d28/d36/fee x:0 0 0 2024-02-22T00:33:27.739 INFO:tasks.workunit.client.1.smithi161.stdout:4/672: dwrite d5/d8/d41/d57/dbe/d28/fa2 [0,4194304] 0 2024-02-22T00:33:27.742 INFO:tasks.workunit.client.1.smithi161.stdout:0/746: chown d14/d44/l5e 552041462 1 2024-02-22T00:33:27.747 INFO:tasks.workunit.client.1.smithi161.stdout:1/728: mknod d19/d85/d87/c103 0 2024-02-22T00:33:27.747 INFO:tasks.workunit.client.1.smithi161.stdout:6/636: dwrite d3/d10/d72/fa2 [0,4194304] 0 2024-02-22T00:33:27.748 INFO:tasks.workunit.client.1.smithi161.stdout:3/648: rename da/dc/d11/d26/d80/cb7 to da/dc/d5f/d68/cd1 0 2024-02-22T00:33:27.752 INFO:tasks.workunit.client.1.smithi161.stdout:4/673: creat d5/d10/d14/d4f/fff x:0 0 0 2024-02-22T00:33:27.755 INFO:tasks.workunit.client.1.smithi161.stdout:1/729: chown d19/d48/d68/dd1/cdc 120647052 1 2024-02-22T00:33:27.758 INFO:tasks.workunit.client.1.smithi161.stdout:1/730: fsync d19/d1d/d2c/d2d/fd2 0 2024-02-22T00:33:27.759 INFO:tasks.workunit.client.1.smithi161.stdout:7/745: dwrite d3/df/d33/d35/d55/d63/d7b/d50/f83 [0,4194304] 0 2024-02-22T00:33:27.766 INFO:tasks.workunit.client.1.smithi161.stdout:7/746: fsync d3/df/d33/dbc/dc5/fc9 0 2024-02-22T00:33:27.769 INFO:tasks.workunit.client.1.smithi161.stdout:1/731: dwrite d19/d1d/d2c/d2d/fe3 [0,4194304] 0 2024-02-22T00:33:27.814 INFO:tasks.workunit.client.1.smithi161.stdout:9/715: symlink d1/d2/d4/lf9 0 2024-02-22T00:33:27.815 INFO:tasks.workunit.client.1.smithi161.stdout:9/716: write d1/d25/dc4/d4f/da3/fce [740892,61314] 0 2024-02-22T00:33:27.816 INFO:tasks.workunit.client.1.smithi161.stdout:0/747: creat d14/d37/d42/d8e/d92/da5/dcd/ffa x:0 0 0 2024-02-22T00:33:27.819 INFO:tasks.workunit.client.1.smithi161.stdout:6/637: mknod d3/dc/df/d32/cc7 0 2024-02-22T00:33:27.821 INFO:tasks.workunit.client.1.smithi161.stdout:4/674: mkdir d5/d8/d41/d57/dbe/d28/d63/d65/d100 0 2024-02-22T00:33:27.822 INFO:tasks.workunit.client.1.smithi161.stdout:4/675: chown d5/d10/l9b 8238 1 2024-02-22T00:33:27.824 INFO:tasks.workunit.client.1.smithi161.stdout:7/747: creat d3/df/d33/d53/fed x:0 0 0 2024-02-22T00:33:27.825 INFO:tasks.workunit.client.1.smithi161.stdout:7/748: write d3/df/d33/f45 [3741726,1095] 0 2024-02-22T00:33:27.825 INFO:tasks.workunit.client.1.smithi161.stdout:1/732: creat d19/d51/d64/d9b/da5/dbc/f104 x:0 0 0 2024-02-22T00:33:27.830 INFO:tasks.workunit.client.1.smithi161.stdout:8/723: rename d1/d1c/d20/d22/d28/d7f/d92/d95/f3c to d1/d2f/dc5/fef 0 2024-02-22T00:33:27.832 INFO:tasks.workunit.client.1.smithi161.stdout:7/749: dwrite d3/dbf/f6c [4194304,4194304] 0 2024-02-22T00:33:27.832 INFO:tasks.workunit.client.1.smithi161.stdout:2/821: sync 2024-02-22T00:33:27.833 INFO:tasks.workunit.client.1.smithi161.stdout:6/638: creat d3/dc/df/fc8 x:0 0 0 2024-02-22T00:33:27.834 INFO:tasks.workunit.client.1.smithi161.stdout:4/676: creat d5/d8/d41/d53/d6c/d91/f101 x:0 0 0 2024-02-22T00:33:27.840 INFO:tasks.workunit.client.1.smithi161.stdout:8/724: read d1/d2f/d37/d64/d7b/d7e/f80 [3345021,51318] 0 2024-02-22T00:33:27.840 INFO:tasks.workunit.client.1.smithi161.stdout:4/677: fsync d5/d8/d41/d57/dbe/d28/d63/d65/faf 0 2024-02-22T00:33:27.841 INFO:tasks.workunit.client.1.smithi161.stdout:8/725: chown d1/d1c/d96/cb7 292 1 2024-02-22T00:33:27.842 INFO:tasks.workunit.client.1.smithi161.stdout:3/649: truncate da/dc/d11/d26/f19 301254 0 2024-02-22T00:33:27.843 INFO:tasks.workunit.client.1.smithi161.stdout:0/748: creat d14/d37/d42/d73/ffb x:0 0 0 2024-02-22T00:33:27.844 INFO:tasks.workunit.client.1.smithi161.stdout:4/678: rmdir d5/d8/d41/d57/dbe/d28/d63 39 2024-02-22T00:33:27.845 INFO:tasks.workunit.client.1.smithi161.stdout:2/822: dread - de/d2b/d65/d60/d68/f10f zero size 2024-02-22T00:33:27.848 INFO:tasks.workunit.client.1.smithi161.stdout:1/733: rename d19/d51/d64/d9b/da5/ff1 to d19/d1d/d2c/f105 0 2024-02-22T00:33:27.849 INFO:tasks.workunit.client.1.smithi161.stdout:8/726: creat d1/d2f/d37/ddd/ff0 x:0 0 0 2024-02-22T00:33:27.851 INFO:tasks.workunit.client.1.smithi161.stdout:2/823: dread de/d11/fdf [0,4194304] 0 2024-02-22T00:33:27.852 INFO:tasks.workunit.client.1.smithi161.stdout:6/639: write d3/d10/d12/f2d [2897466,64223] 0 2024-02-22T00:33:27.853 INFO:tasks.workunit.client.1.smithi161.stdout:2/824: readlink de/d2b/d83/d4f/lb4 0 2024-02-22T00:33:27.858 INFO:tasks.workunit.client.1.smithi161.stdout:1/734: mkdir d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d84/d106 0 2024-02-22T00:33:27.860 INFO:tasks.workunit.client.1.smithi161.stdout:4/679: unlink d5/d8/d41/d57/dbe/d28/d38/l8d 0 2024-02-22T00:33:27.862 INFO:tasks.workunit.client.1.smithi161.stdout:0/749: link d14/d1a/f28 d14/d37/d42/ffc 0 2024-02-22T00:33:27.863 INFO:tasks.workunit.client.1.smithi161.stdout:6/640: symlink d3/d10/d1b/lc9 0 2024-02-22T00:33:27.864 INFO:tasks.workunit.client.1.smithi161.stdout:3/650: write da/dc/d11/d26/f3c [1124636,68641] 0 2024-02-22T00:33:27.872 INFO:tasks.workunit.client.1.smithi161.stdout:7/750: rename d3/df/d33/d35/d55/d63/d7b/d50/l57 to d3/df/d33/d35/d55/lee 0 2024-02-22T00:33:27.873 INFO:tasks.workunit.client.1.smithi161.stdout:0/750: rename d14/d1a/d3f to d14/d1a/d3f/d96/dbc/dfd 22 2024-02-22T00:33:27.873 INFO:tasks.workunit.client.1.smithi161.stdout:6/641: mkdir d3/d10/d12/d3a/dca 0 2024-02-22T00:33:27.873 INFO:tasks.workunit.client.1.smithi161.stdout:1/735: mkdir d19/d51/d64/d9b/da5/dbc/df8/d107 0 2024-02-22T00:33:27.873 INFO:tasks.workunit.client.1.smithi161.stdout:7/751: readlink d3/dd/lce 0 2024-02-22T00:33:27.873 INFO:tasks.workunit.client.1.smithi161.stdout:8/727: getdents d1/d2f 0 2024-02-22T00:33:27.877 INFO:tasks.workunit.client.1.smithi161.stdout:7/752: unlink d3/dd/c97 0 2024-02-22T00:33:27.879 INFO:tasks.workunit.client.1.smithi161.stdout:3/651: dwrite da/d29/f7f [0,4194304] 0 2024-02-22T00:33:27.880 INFO:tasks.workunit.client.1.smithi161.stdout:2/825: truncate de/d2b/d83/f8e 5092969 0 2024-02-22T00:33:27.880 INFO:tasks.workunit.client.1.smithi161.stdout:8/728: chown d1/d1c/d20/d22/d28/d7f/d92/d95/fcb 858603856 1 2024-02-22T00:33:27.884 INFO:tasks.workunit.client.1.smithi161.stdout:4/680: dread d5/d10/f4d [0,4194304] 0 2024-02-22T00:33:27.888 INFO:tasks.workunit.client.1.smithi161.stdout:3/652: dread - da/dc/d11/d26/d80/dc7/d59/fa0 zero size 2024-02-22T00:33:27.888 INFO:tasks.workunit.client.1.smithi161.stdout:2/826: creat de/d11/d5c/f11d x:0 0 0 2024-02-22T00:33:27.889 INFO:tasks.workunit.client.1.smithi161.stdout:1/736: dread d19/d1d/d2c/d7d/f93 [0,4194304] 0 2024-02-22T00:33:27.889 INFO:tasks.workunit.client.1.smithi161.stdout:8/729: symlink d1/d1c/d20/d22/d28/d7f/d92/d93/lf1 0 2024-02-22T00:33:27.890 INFO:tasks.workunit.client.1.smithi161.stdout:7/753: rename d3/df/d33/d35/d55/c54 to d3/dd/d59/cef 0 2024-02-22T00:33:27.890 INFO:tasks.workunit.client.1.smithi161.stdout:6/642: dwrite d3/d10/d12/f36 [0,4194304] 0 2024-02-22T00:33:27.892 INFO:tasks.workunit.client.1.smithi161.stdout:1/737: chown d19/d1d/fbf 240165 1 2024-02-22T00:33:27.893 INFO:tasks.workunit.client.1.smithi161.stdout:2/827: mkdir de/d11/d5c/d11e 0 2024-02-22T00:33:27.895 INFO:tasks.workunit.client.1.smithi161.stdout:7/754: symlink d3/df/d33/d35/lf0 0 2024-02-22T00:33:27.896 INFO:tasks.workunit.client.1.smithi161.stdout:3/653: mkdir da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/dd2 0 2024-02-22T00:33:27.897 INFO:tasks.workunit.client.1.smithi161.stdout:8/730: truncate d1/d2f/d37/d64/d7b/d7e/fc9 259065 0 2024-02-22T00:33:27.899 INFO:tasks.workunit.client.1.smithi161.stdout:1/738: creat d19/f108 x:0 0 0 2024-02-22T00:33:27.901 INFO:tasks.workunit.client.1.smithi161.stdout:4/681: link d5/d10/d14/d4f/fe4 d5/d8/d41/d57/dbe/d28/d63/d65/f102 0 2024-02-22T00:33:27.903 INFO:tasks.workunit.client.1.smithi161.stdout:8/731: unlink d1/d1c/d75/d18/f8a 0 2024-02-22T00:33:27.904 INFO:tasks.workunit.client.1.smithi161.stdout:1/739: rmdir d19/d51/da1 39 2024-02-22T00:33:27.905 INFO:tasks.workunit.client.1.smithi161.stdout:6/643: dwrite d3/f7f [0,4194304] 0 2024-02-22T00:33:27.909 INFO:tasks.workunit.client.1.smithi161.stdout:1/740: chown d19/d51/d64/fec 0 1 2024-02-22T00:33:27.910 INFO:tasks.workunit.client.1.smithi161.stdout:3/654: getdents da/dc/d11/d26/d80/dc7/d59/d93 0 2024-02-22T00:33:27.915 INFO:tasks.workunit.client.1.smithi161.stdout:2/828: dwrite de/d2b/d8b/da2/da5/dc4/da7/fe7 [0,4194304] 0 2024-02-22T00:33:27.917 INFO:tasks.workunit.client.1.smithi161.stdout:6/644: write d3/d10/d12/f9e [536263,71695] 0 2024-02-22T00:33:27.920 INFO:tasks.workunit.client.1.smithi161.stdout:6/645: read d3/d10/f65 [3560075,8907] 0 2024-02-22T00:33:27.920 INFO:tasks.workunit.client.1.smithi161.stdout:1/741: creat d19/d51/d64/d9b/da5/dbc/df8/f109 x:0 0 0 2024-02-22T00:33:27.922 INFO:tasks.workunit.client.1.smithi161.stdout:3/655: symlink da/dc/d11/d26/d80/dc7/d59/d93/ld3 0 2024-02-22T00:33:27.924 INFO:tasks.workunit.client.1.smithi161.stdout:3/656: chown da/dc/d11/d26/d80/dc7/d60 51502404 1 2024-02-22T00:33:27.926 INFO:tasks.workunit.client.1.smithi161.stdout:2/829: write de/d2b/d65/d3a/f7c [8359441,40608] 0 2024-02-22T00:33:27.927 INFO:tasks.workunit.client.1.smithi161.stdout:6/646: chown d3/d10/d1b/d5e/d87/c9f 24863 1 2024-02-22T00:33:27.929 INFO:tasks.workunit.client.1.smithi161.stdout:1/742: rmdir d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d84 39 2024-02-22T00:33:27.929 INFO:tasks.workunit.client.1.smithi161.stdout:6/647: dread - d3/d10/d1b/d5e/fb7 zero size 2024-02-22T00:33:27.930 INFO:tasks.workunit.client.1.smithi161.stdout:2/830: chown de/d11/d14/c112 7395573 1 2024-02-22T00:33:27.930 INFO:tasks.workunit.client.1.smithi161.stdout:1/743: chown d19/d51/d6c/dd4 1 1 2024-02-22T00:33:27.933 INFO:tasks.workunit.client.1.smithi161.stdout:7/755: truncate d3/df/d33/d35/d55/d63/d7b/d50/f81 2815663 0 2024-02-22T00:33:27.933 INFO:tasks.workunit.client.1.smithi161.stdout:8/732: dread d1/d1c/d20/d22/d28/d7f/d92/d95/f3b [0,4194304] 0 2024-02-22T00:33:27.935 INFO:tasks.workunit.client.1.smithi161.stdout:7/756: dread - d3/df/d33/d74/f8e zero size 2024-02-22T00:33:27.937 INFO:tasks.workunit.client.1.smithi161.stdout:6/648: mkdir d3/d10/d12/d2f/d7d/dcb 0 2024-02-22T00:33:27.937 INFO:tasks.workunit.client.1.smithi161.stdout:7/757: fsync d3/dbf/d64/f78 0 2024-02-22T00:33:27.939 INFO:tasks.workunit.client.1.smithi161.stdout:1/744: creat d19/d51/da1/f10a x:0 0 0 2024-02-22T00:33:27.940 INFO:tasks.workunit.client.1.smithi161.stdout:2/831: symlink de/d11/d5c/d11e/l11f 0 2024-02-22T00:33:27.940 INFO:tasks.workunit.client.1.smithi161.stdout:6/649: fsync d3/d10/d12/d3a/f68 0 2024-02-22T00:33:27.944 INFO:tasks.workunit.client.1.smithi161.stdout:6/650: fsync d3/d10/d1b/d5e/f94 0 2024-02-22T00:33:27.945 INFO:tasks.workunit.client.1.smithi161.stdout:1/745: write d19/d48/f92 [617692,108635] 0 2024-02-22T00:33:27.946 INFO:tasks.workunit.client.1.smithi161.stdout:8/733: dwrite d1/d1c/d75/d18/f45 [0,4194304] 0 2024-02-22T00:33:27.948 INFO:tasks.workunit.client.1.smithi161.stdout:3/657: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/fc2 [0,4194304] 0 2024-02-22T00:33:27.949 INFO:tasks.workunit.client.1.smithi161.stdout:1/746: fsync d19/f43 0 2024-02-22T00:33:27.956 INFO:tasks.workunit.client.1.smithi161.stdout:8/734: symlink d1/d2f/dc5/lf2 0 2024-02-22T00:33:27.959 INFO:tasks.workunit.client.1.smithi161.stdout:1/747: rename f7 to d19/d1d/d2c/d2d/d3f/f10b 0 2024-02-22T00:33:27.960 INFO:tasks.workunit.client.1.smithi161.stdout:3/658: symlink da/dc/d5f/d66/ld4 0 2024-02-22T00:33:27.961 INFO:tasks.workunit.client.1.smithi161.stdout:2/832: mkdir de/d2b/d8b/da2/da5/dc4/d120 0 2024-02-22T00:33:27.964 INFO:tasks.workunit.client.1.smithi161.stdout:3/659: fsync da/dc/d91/fa3 0 2024-02-22T00:33:27.965 INFO:tasks.workunit.client.1.smithi161.stdout:1/748: write d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f72 [5255595,92966] 0 2024-02-22T00:33:27.975 INFO:tasks.workunit.client.1.smithi161.stdout:8/735: dread d1/d2f/d37/d64/f91 [0,4194304] 0 2024-02-22T00:33:27.976 INFO:tasks.workunit.client.1.smithi161.stdout:3/660: creat da/dc/d11/d26/fd5 x:0 0 0 2024-02-22T00:33:27.978 INFO:tasks.workunit.client.1.smithi161.stdout:3/661: readlink da/dc/d11/d26/l70 0 2024-02-22T00:33:27.979 INFO:tasks.workunit.client.1.smithi161.stdout:7/758: dread d3/f37 [0,4194304] 0 2024-02-22T00:33:27.983 INFO:tasks.workunit.client.1.smithi161.stdout:1/749: creat d19/d1d/d2c/d7d/f10c x:0 0 0 2024-02-22T00:33:27.983 INFO:tasks.workunit.client.1.smithi161.stdout:3/662: fsync da/dc/d11/d26/d80/dc7/d59/d93/daa/fc2 0 2024-02-22T00:33:27.985 INFO:tasks.workunit.client.1.smithi161.stdout:6/651: dread d3/d10/f65 [0,4194304] 0 2024-02-22T00:33:27.985 INFO:tasks.workunit.client.1.smithi161.stdout:2/833: write de/d2b/d65/d60/d68/d100/fd2 [4332400,86814] 0 2024-02-22T00:33:27.985 INFO:tasks.workunit.client.1.smithi161.stdout:1/750: fsync d19/d1d/d2c/ffd 0 2024-02-22T00:33:27.996 INFO:tasks.workunit.client.1.smithi161.stdout:7/759: rename d3/df/d33/d35/d55/d63/d7b/d50/fc3 to d3/dd/ff1 0 2024-02-22T00:33:27.996 INFO:tasks.workunit.client.1.smithi161.stdout:3/663: unlink da/dc/d5f/c8f 0 2024-02-22T00:33:27.997 INFO:tasks.workunit.client.1.smithi161.stdout:5/903: sync 2024-02-22T00:33:27.998 INFO:tasks.workunit.client.1.smithi161.stdout:3/664: chown da/f8a 2 1 2024-02-22T00:33:27.999 INFO:tasks.workunit.client.1.smithi161.stdout:8/736: dwrite d1/d1c/fa4 [4194304,4194304] 0 2024-02-22T00:33:28.000 INFO:tasks.workunit.client.1.smithi161.stdout:5/904: mkdir d3/d29/d122/d136 0 2024-02-22T00:33:28.001 INFO:tasks.workunit.client.1.smithi161.stdout:7/760: mkdir d3/df/d33/d74/df2 0 2024-02-22T00:33:28.003 INFO:tasks.workunit.client.1.smithi161.stdout:6/652: creat d3/d10/d72/dc5/fcc x:0 0 0 2024-02-22T00:33:28.006 INFO:tasks.workunit.client.1.smithi161.stdout:5/905: rmdir d3/d1c/d67 39 2024-02-22T00:33:28.007 INFO:tasks.workunit.client.1.smithi161.stdout:8/737: write d1/d1c/d20/d22/d28/d36/fee [345476,93773] 0 2024-02-22T00:33:28.009 INFO:tasks.workunit.client.1.smithi161.stdout:3/665: symlink da/dc/d11/d26/d80/dc7/d59/d93/daa/ld6 0 2024-02-22T00:33:28.009 INFO:tasks.workunit.client.1.smithi161.stdout:8/738: chown d1/d2f/d30/cd4 2086 1 2024-02-22T00:33:28.011 INFO:tasks.workunit.client.1.smithi161.stdout:6/653: mknod d3/d10/d12/ccd 0 2024-02-22T00:33:28.012 INFO:tasks.workunit.client.1.smithi161.stdout:1/751: truncate d19/d1d/d2c/d2d/f40 2014298 0 2024-02-22T00:33:28.015 INFO:tasks.workunit.client.1.smithi161.stdout:2/834: dwrite de/d2b/f98 [4194304,4194304] 0 2024-02-22T00:33:28.018 INFO:tasks.workunit.client.1.smithi161.stdout:3/666: mkdir da/dc/d11/d26/d80/dc7/d60/dd7 0 2024-02-22T00:33:28.024 INFO:tasks.workunit.client.1.smithi161.stdout:6/654: unlink d3/d10/d12/d2f/d7d/l84 0 2024-02-22T00:33:28.027 INFO:tasks.workunit.client.1.smithi161.stdout:1/752: mknod d19/d1d/d2c/c10d 0 2024-02-22T00:33:28.029 INFO:tasks.workunit.client.1.smithi161.stdout:7/761: dwrite d3/df/d43/fa2 [0,4194304] 0 2024-02-22T00:33:28.030 INFO:tasks.workunit.client.1.smithi161.stdout:2/835: creat de/d2b/d8b/da2/da5/dc4/da7/f121 x:0 0 0 2024-02-22T00:33:28.033 INFO:tasks.workunit.client.1.smithi161.stdout:6/655: write d3/d10/d12/f23 [3621161,48359] 0 2024-02-22T00:33:28.033 INFO:tasks.workunit.client.1.smithi161.stdout:5/906: dwrite d3/d1b/d36/f83 [4194304,4194304] 0 2024-02-22T00:33:28.043 INFO:tasks.workunit.client.1.smithi161.stdout:7/762: rmdir d3/df 39 2024-02-22T00:33:28.044 INFO:tasks.workunit.client.1.smithi161.stdout:2/836: mkdir de/d2b/d8b/da2/da5/dc4/da7/d122 0 2024-02-22T00:33:28.049 INFO:tasks.workunit.client.1.smithi161.stdout:1/753: dwrite d19/d48/f92 [0,4194304] 0 2024-02-22T00:33:28.056 INFO:tasks.workunit.client.1.smithi161.stdout:3/667: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/fd8 x:0 0 0 2024-02-22T00:33:28.060 INFO:tasks.workunit.client.1.smithi161.stdout:1/754: creat d19/d51/d6c/dd4/f10e x:0 0 0 2024-02-22T00:33:28.060 INFO:tasks.workunit.client.1.smithi161.stdout:5/907: link d3/d1b/d25/d84/f100 d3/d1b/d25/d4c/dcb/d123/d125/f137 0 2024-02-22T00:33:28.062 INFO:tasks.workunit.client.1.smithi161.stdout:2/837: rename de/d2b/d8b/de6/f105 to de/f123 0 2024-02-22T00:33:28.064 INFO:tasks.workunit.client.1.smithi161.stdout:7/763: getdents d3/dbf 0 2024-02-22T00:33:28.065 INFO:tasks.workunit.client.1.smithi161.stdout:1/755: write d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f79 [127730,78282] 0 2024-02-22T00:33:28.065 INFO:tasks.workunit.client.1.smithi161.stdout:2/838: dread - de/d11/d14/fbb zero size 2024-02-22T00:33:28.068 INFO:tasks.workunit.client.1.smithi161.stdout:7/764: creat d3/d77/ff3 x:0 0 0 2024-02-22T00:33:28.068 INFO:tasks.workunit.client.1.smithi161.stdout:3/668: dwrite da/f27 [0,4194304] 0 2024-02-22T00:33:28.074 INFO:tasks.workunit.client.1.smithi161.stdout:7/765: fsync d3/df/d33/dbc/dc5/fc9 0 2024-02-22T00:33:28.074 INFO:tasks.workunit.client.1.smithi161.stdout:1/756: creat d19/d51/d6c/f10f x:0 0 0 2024-02-22T00:33:28.078 INFO:tasks.workunit.client.1.smithi161.stdout:8/739: dread d1/d1c/d75/f85 [0,4194304] 0 2024-02-22T00:33:28.079 INFO:tasks.workunit.client.1.smithi161.stdout:5/908: dwrite d3/d1b/d25/d84/f100 [0,4194304] 0 2024-02-22T00:33:28.079 INFO:tasks.workunit.client.1.smithi161.stdout:7/766: chown d3/df/d43/f65 53817 1 2024-02-22T00:33:28.080 INFO:tasks.workunit.client.1.smithi161.stdout:2/839: rename de/d2b/d65/d60/f78 to de/d11/f124 0 2024-02-22T00:33:28.081 INFO:tasks.workunit.client.1.smithi161.stdout:8/740: dread - d1/d2f/d37/d64/fd8 zero size 2024-02-22T00:33:28.082 INFO:tasks.workunit.client.1.smithi161.stdout:3/669: symlink da/dc/d11/d26/d80/dc7/d60/dd7/ld9 0 2024-02-22T00:33:28.083 INFO:tasks.workunit.client.1.smithi161.stdout:5/909: dread d3/d1b/d25/fe6 [0,4194304] 0 2024-02-22T00:33:28.083 INFO:tasks.workunit.client.1.smithi161.stdout:7/767: fdatasync d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/fbb 0 2024-02-22T00:33:28.089 INFO:tasks.workunit.client.1.smithi161.stdout:3/670: mkdir da/dc/d11/d26/d80/dc7/d59/d93/dda 0 2024-02-22T00:33:28.090 INFO:tasks.workunit.client.1.smithi161.stdout:5/910: creat d3/d1c/d20/f138 x:0 0 0 2024-02-22T00:33:28.093 INFO:tasks.workunit.client.1.smithi161.stdout:7/768: creat d3/df/dba/ff4 x:0 0 0 2024-02-22T00:33:28.094 INFO:tasks.workunit.client.1.smithi161.stdout:7/769: write d3/dd/f1d [770925,117213] 0 2024-02-22T00:33:28.095 INFO:tasks.workunit.client.1.smithi161.stdout:8/741: getdents d1/d2f/d37/d64/d7b/ddf 0 2024-02-22T00:33:28.097 INFO:tasks.workunit.client.1.smithi161.stdout:7/770: dread - d3/df/dba/ff4 zero size 2024-02-22T00:33:28.098 INFO:tasks.workunit.client.1.smithi161.stdout:5/911: creat d3/d1b/d8f/dfb/f139 x:0 0 0 2024-02-22T00:33:28.102 INFO:tasks.workunit.client.1.smithi161.stdout:5/912: write d3/d1b/d25/fe6 [1215522,112079] 0 2024-02-22T00:33:28.103 INFO:tasks.workunit.client.1.smithi161.stdout:6/656: truncate d3/d10/d12/d3a/f96 2896582 0 2024-02-22T00:33:28.104 INFO:tasks.workunit.client.1.smithi161.stdout:6/657: read - d3/d10/d12/d95/f9d zero size 2024-02-22T00:33:28.106 INFO:tasks.workunit.client.1.smithi161.stdout:7/771: creat d3/df/d33/d35/d55/d63/d7b/ff5 x:0 0 0 2024-02-22T00:33:28.108 INFO:tasks.workunit.client.1.smithi161.stdout:7/772: write d3/df/d33/d74/f8e [791571,36237] 0 2024-02-22T00:33:28.109 INFO:tasks.workunit.client.1.smithi161.stdout:7/773: write d3/f8d [2617584,83037] 0 2024-02-22T00:33:28.112 INFO:tasks.workunit.client.1.smithi161.stdout:2/840: rename de/d2b/d65 to de/d2b/d8b/ddc/d125 0 2024-02-22T00:33:28.113 INFO:tasks.workunit.client.1.smithi161.stdout:7/774: symlink d3/df/d33/d35/d55/d63/d7b/d50/lf6 0 2024-02-22T00:33:28.115 INFO:tasks.workunit.client.1.smithi161.stdout:8/742: dread d1/d1c/d20/d22/d28/d7f/d92/d95/f9f [0,4194304] 0 2024-02-22T00:33:28.115 INFO:tasks.workunit.client.1.smithi161.stdout:6/658: rename d3/d10/d1b/f46 to d3/d7c/fce 0 2024-02-22T00:33:28.119 INFO:tasks.workunit.client.1.smithi161.stdout:8/743: creat d1/d1c/d20/d22/d28/d7f/ff3 x:0 0 0 2024-02-22T00:33:28.120 INFO:tasks.workunit.client.1.smithi161.stdout:6/659: unlink d3/d10/d1b/d5e/cb9 0 2024-02-22T00:33:28.123 INFO:tasks.workunit.client.1.smithi161.stdout:3/671: truncate da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f58 1810927 0 2024-02-22T00:33:28.123 INFO:tasks.workunit.client.1.smithi161.stdout:3/672: stat da/dc/d11/ccf 0 2024-02-22T00:33:28.127 INFO:tasks.workunit.client.1.smithi161.stdout:3/673: fdatasync da/fb3 0 2024-02-22T00:33:28.128 INFO:tasks.workunit.client.1.smithi161.stdout:2/841: dwrite de/d2b/d8b/ddc/d125/d3a/fcb [0,4194304] 0 2024-02-22T00:33:28.128 INFO:tasks.workunit.client.1.smithi161.stdout:5/913: dread d3/f26 [0,4194304] 0 2024-02-22T00:33:28.128 INFO:tasks.workunit.client.1.smithi161.stdout:6/660: unlink d3/d10/d12/d2f/c60 0 2024-02-22T00:33:28.131 INFO:tasks.workunit.client.1.smithi161.stdout:8/744: dread d1/d2f/fea [0,4194304] 0 2024-02-22T00:33:28.133 INFO:tasks.workunit.client.1.smithi161.stdout:5/914: creat d3/d29/d122/f13a x:0 0 0 2024-02-22T00:33:28.133 INFO:tasks.workunit.client.1.smithi161.stdout:2/842: write de/d11/d14/faa [4908965,874] 0 2024-02-22T00:33:28.136 INFO:tasks.workunit.client.1.smithi161.stdout:5/915: chown d3/d1b/d25/c89 110944 1 2024-02-22T00:33:28.136 INFO:tasks.workunit.client.1.smithi161.stdout:7/775: dread d3/dbf/d64/f78 [0,4194304] 0 2024-02-22T00:33:28.138 INFO:tasks.workunit.client.1.smithi161.stdout:7/776: truncate d3/df/d43/faf 87866 0 2024-02-22T00:33:28.139 INFO:tasks.workunit.client.1.smithi161.stdout:6/661: creat d3/d10/d12/d2f/d7d/d97/fcf x:0 0 0 2024-02-22T00:33:28.141 INFO:tasks.workunit.client.1.smithi161.stdout:2/843: symlink de/d2b/d8b/db8/l126 0 2024-02-22T00:33:28.142 INFO:tasks.workunit.client.1.smithi161.stdout:2/844: fdatasync de/d11/f29 0 2024-02-22T00:33:28.145 INFO:tasks.workunit.client.1.smithi161.stdout:3/674: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f85 [0,4194304] 0 2024-02-22T00:33:28.145 INFO:tasks.workunit.client.1.smithi161.stdout:5/916: fdatasync d3/d1c/d69/fd3 0 2024-02-22T00:33:28.146 INFO:tasks.workunit.client.1.smithi161.stdout:7/777: unlink d3/df/d33/d35/d55/d63/d7b/d30/fc7 0 2024-02-22T00:33:28.151 INFO:tasks.workunit.client.1.smithi161.stdout:8/745: creat d1/d2f/d37/d64/d7b/ff4 x:0 0 0 2024-02-22T00:33:28.152 INFO:tasks.workunit.client.1.smithi161.stdout:8/746: chown d1/d2f/d37/d64/f91 101598852 1 2024-02-22T00:33:28.153 INFO:tasks.workunit.client.1.smithi161.stdout:3/675: truncate da/dc/d91/fa3 221328 0 2024-02-22T00:33:28.155 INFO:tasks.workunit.client.1.smithi161.stdout:5/917: mkdir d3/d29/d80/d92/df7/dae/dbe/d13b 0 2024-02-22T00:33:28.157 INFO:tasks.workunit.client.1.smithi161.stdout:5/918: read - d3/d1b/d36/ff5 zero size 2024-02-22T00:33:28.158 INFO:tasks.workunit.client.1.smithi161.stdout:5/919: chown d3/d1c/d69/fa8 5 1 2024-02-22T00:33:28.160 INFO:tasks.workunit.client.1.smithi161.stdout:2/845: link de/d2b/d8b/ddc/d125/d3a/ffa de/d2b/d83/d4f/f127 0 2024-02-22T00:33:28.161 INFO:tasks.workunit.client.1.smithi161.stdout:8/747: creat d1/d1c/d20/ff5 x:0 0 0 2024-02-22T00:33:28.163 INFO:tasks.workunit.client.1.smithi161.stdout:7/778: creat d3/df/d33/d35/d55/d63/d7b/de5/ff7 x:0 0 0 2024-02-22T00:33:28.164 INFO:tasks.workunit.client.1.smithi161.stdout:6/662: truncate d3/d7c/fce 700582 0 2024-02-22T00:33:28.170 INFO:tasks.workunit.client.1.smithi161.stdout:3/676: mknod da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/dd2/cdb 0 2024-02-22T00:33:28.172 INFO:tasks.workunit.client.1.smithi161.stdout:3/677: write da/dc/f2b [5165193,123234] 0 2024-02-22T00:33:28.172 INFO:tasks.workunit.client.1.smithi161.stdout:2/846: rmdir de/d2b/d8b/ddc 39 2024-02-22T00:33:28.173 INFO:tasks.workunit.client.1.smithi161.stdout:3/678: readlink da/dc/d11/d26/d80/dc7/d60/dd7/ld9 0 2024-02-22T00:33:28.177 INFO:tasks.workunit.client.1.smithi161.stdout:8/748: symlink d1/lf6 0 2024-02-22T00:33:28.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:26.532427+0000 mgr.smithi161.sazlam (mgr.24369) 31 : cephadm [INF] Adjusting osd_memory_target on smithi161 to 2251M 2024-02-22T00:33:28.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:26.547649+0000 mgr.smithi161.sazlam (mgr.24369) 32 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:33:28.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:26.547838+0000 mgr.smithi161.sazlam (mgr.24369) 33 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:33:28.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:26.965693+0000 mgr.smithi161.sazlam (mgr.24369) 34 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:33:28.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:27.016078+0000 mgr.smithi161.sazlam (mgr.24369) 35 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:33:28.181 INFO:tasks.workunit.client.1.smithi161.stdout:5/920: link d3/d29/d80/ce9 d3/d1b/d36/d88/c13c 0 2024-02-22T00:33:28.184 INFO:tasks.workunit.client.1.smithi161.stdout:7/779: mkdir d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/df8 0 2024-02-22T00:33:28.184 INFO:tasks.workunit.client.1.smithi161.stdout:3/679: read da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f58 [333549,45698] 0 2024-02-22T00:33:28.185 INFO:tasks.workunit.client.1.smithi161.stdout:3/680: write da/dc/d5f/f73 [3825646,36284] 0 2024-02-22T00:33:28.186 INFO:tasks.workunit.client.1.smithi161.stdout:8/749: mkdir d1/d1c/d96/df7 0 2024-02-22T00:33:28.187 INFO:tasks.workunit.client.1.smithi161.stdout:6/663: mknod d3/d10/d1b/d5e/d87/cd0 0 2024-02-22T00:33:28.188 INFO:tasks.workunit.client.1.smithi161.stdout:2/847: creat de/d2b/d8b/ddc/d125/d60/f128 x:0 0 0 2024-02-22T00:33:28.189 INFO:tasks.workunit.client.1.smithi161.stdout:8/750: read d1/d1c/dbd/f8c [4125799,27505] 0 2024-02-22T00:33:28.191 INFO:tasks.workunit.client.1.smithi161.stdout:6/664: mkdir d3/d7c/dd1 0 2024-02-22T00:33:28.194 INFO:tasks.workunit.client.1.smithi161.stdout:5/921: mknod d3/d1b/d25/d4c/d7b/dec/c13d 0 2024-02-22T00:33:28.196 INFO:tasks.workunit.client.1.smithi161.stdout:2/848: mknod de/d2b/d8b/da2/da5/daf/c129 0 2024-02-22T00:33:28.197 INFO:tasks.workunit.client.1.smithi161.stdout:6/665: truncate d3/d10/d12/f2d 904076 0 2024-02-22T00:33:28.199 INFO:tasks.workunit.client.1.smithi161.stdout:8/751: dwrite d1/d1c/d20/d22/f35 [0,4194304] 0 2024-02-22T00:33:28.201 INFO:tasks.workunit.client.1.smithi161.stdout:8/752: readlink d1/d2f/dc5/lf2 0 2024-02-22T00:33:28.201 INFO:tasks.workunit.client.1.smithi161.stdout:8/753: chown d1/d1c/d96 54 1 2024-02-22T00:33:28.210 INFO:tasks.workunit.client.1.smithi161.stdout:3/681: dread da/dc/d11/f55 [0,4194304] 0 2024-02-22T00:33:28.210 INFO:tasks.workunit.client.1.smithi161.stdout:2/849: rename de/d2b/l3b to de/d2b/d8b/l12a 0 2024-02-22T00:33:28.212 INFO:tasks.workunit.client.1.smithi161.stdout:3/682: creat da/d29/d53/dc1/fdc x:0 0 0 2024-02-22T00:33:28.212 INFO:tasks.workunit.client.1.smithi161.stdout:8/754: dread d1/d1c/d75/f85 [0,4194304] 0 2024-02-22T00:33:28.218 INFO:tasks.workunit.client.1.smithi161.stdout:3/683: dwrite da/dc/d5f/f73 [0,4194304] 0 2024-02-22T00:33:28.218 INFO:tasks.workunit.client.1.smithi161.stdout:8/755: dread d1/d2f/d37/f48 [0,4194304] 0 2024-02-22T00:33:28.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/717: sync 2024-02-22T00:33:28.225 INFO:tasks.workunit.client.1.smithi161.stdout:2/850: rename de/d2b/d8b/ddc/d125/c6a to de/d11/d5c/c12b 0 2024-02-22T00:33:28.229 INFO:tasks.workunit.client.1.smithi161.stdout:2/851: chown de/f53 4 1 2024-02-22T00:33:28.229 INFO:tasks.workunit.client.1.smithi161.stdout:5/922: truncate d3/f5 6429433 0 2024-02-22T00:33:28.232 INFO:tasks.workunit.client.1.smithi161.stdout:2/852: read - de/d2b/d8b/da2/da5/dc4/da7/fed zero size 2024-02-22T00:33:28.233 INFO:tasks.workunit.client.1.smithi161.stdout:2/853: write de/d2b/fd0 [869644,6395] 0 2024-02-22T00:33:28.234 INFO:tasks.workunit.client.1.smithi161.stdout:3/684: symlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/ldd 0 2024-02-22T00:33:28.236 INFO:tasks.workunit.client.1.smithi161.stdout:9/718: rename d1/d5/d9/c14 to d1/d2/d4/d95/cfa 0 2024-02-22T00:33:28.239 INFO:tasks.workunit.client.1.smithi161.stdout:8/756: mknod d1/d1c/d20/d22/d28/d36/d6c/dbe/cf8 0 2024-02-22T00:33:28.239 INFO:tasks.workunit.client.1.smithi161.stdout:6/666: creat d3/d10/d1b/d5e/d87/fd2 x:0 0 0 2024-02-22T00:33:28.240 INFO:tasks.workunit.client.1.smithi161.stdout:9/719: write d1/d2/fd2 [2432347,43341] 0 2024-02-22T00:33:28.241 INFO:tasks.workunit.client.1.smithi161.stdout:3/685: creat da/dc/d11/d26/d80/dc7/d59/d93/fde x:0 0 0 2024-02-22T00:33:28.246 INFO:tasks.workunit.client.1.smithi161.stdout:2/854: dwrite de/d2b/d8b/da2/f118 [0,4194304] 0 2024-02-22T00:33:28.247 INFO:tasks.workunit.client.1.smithi161.stdout:6/667: rename d3/dc/df/c4e to d3/d7c/cd3 0 2024-02-22T00:33:28.252 INFO:tasks.workunit.client.1.smithi161.stdout:2/855: fsync de/d2b/d8b/f97 0 2024-02-22T00:33:28.257 INFO:tasks.workunit.client.1.smithi161.stdout:5/923: dread d3/d1c/d20/f59 [0,4194304] 0 2024-02-22T00:33:28.258 INFO:tasks.workunit.client.1.smithi161.stdout:2/856: rmdir de/d11 39 2024-02-22T00:33:28.259 INFO:tasks.workunit.client.1.smithi161.stdout:9/720: dwrite d1/d2/d4/fa4 [0,4194304] 0 2024-02-22T00:33:28.263 INFO:tasks.workunit.client.1.smithi161.stdout:3/686: link da/dc/d11/d26/f4d da/d29/fdf 0 2024-02-22T00:33:28.265 INFO:tasks.workunit.client.1.smithi161.stdout:2/857: symlink de/d2b/d8b/da2/da5/l12c 0 2024-02-22T00:33:28.265 INFO:tasks.workunit.client.1.smithi161.stdout:6/668: write d3/d10/d1b/f47 [308524,31034] 0 2024-02-22T00:33:28.267 INFO:tasks.workunit.client.1.smithi161.stdout:9/721: creat d1/d25/d73/d60/d77/d93/ffb x:0 0 0 2024-02-22T00:33:28.269 INFO:tasks.workunit.client.1.smithi161.stdout:8/757: link d1/d1c/d20/d22/d28/d7f/d92/d93/lf1 d1/d1c/d20/d22/d28/lf9 0 2024-02-22T00:33:28.270 INFO:tasks.workunit.client.1.smithi161.stdout:6/669: creat d3/dc/df/d32/fd4 x:0 0 0 2024-02-22T00:33:28.271 INFO:tasks.workunit.client.1.smithi161.stdout:2/858: chown de/d11/d32/ceb 4714012 1 2024-02-22T00:33:28.272 INFO:tasks.workunit.client.1.smithi161.stdout:5/924: link d3/d1b/d25/d4c/dcb/ff3 d3/dac/f13e 0 2024-02-22T00:33:28.274 INFO:tasks.workunit.client.1.smithi161.stdout:6/670: stat d3/d10/d1b/lc9 0 2024-02-22T00:33:28.274 INFO:tasks.workunit.client.1.smithi161.stdout:3/687: dwrite da/d29/d53/dc1/dce/fc3 [0,4194304] 0 2024-02-22T00:33:28.275 INFO:tasks.workunit.client.1.smithi161.stdout:8/758: symlink d1/d1c/lfa 0 2024-02-22T00:33:28.280 INFO:tasks.workunit.client.1.smithi161.stdout:6/671: fsync d3/dc/f2b 0 2024-02-22T00:33:28.280 INFO:tasks.workunit.client.1.smithi161.stdout:3/688: rmdir da/dc 39 2024-02-22T00:33:28.280 INFO:tasks.workunit.client.1.smithi161.stdout:8/759: truncate d1/d2f/f97 2278752 0 2024-02-22T00:33:28.281 INFO:tasks.workunit.client.1.smithi161.stdout:8/760: read - d1/d1c/d20/fba zero size 2024-02-22T00:33:28.289 INFO:tasks.workunit.client.1.smithi161.stdout:2/859: dwrite de/d2b/d83/f87 [4194304,4194304] 0 2024-02-22T00:33:28.289 INFO:tasks.workunit.client.1.smithi161.stdout:6/672: dwrite d3/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:28.294 INFO:tasks.workunit.client.1.smithi161.stdout:3/689: mkdir da/dc/d11/d26/d80/dc7/d59/d93/de0 0 2024-02-22T00:33:28.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:26.532427+0000 mgr.smithi161.sazlam (mgr.24369) 31 : cephadm [INF] Adjusting osd_memory_target on smithi161 to 2251M 2024-02-22T00:33:28.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:26.547649+0000 mgr.smithi161.sazlam (mgr.24369) 32 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:33:28.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:26.547838+0000 mgr.smithi161.sazlam (mgr.24369) 33 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:33:28.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:26.965693+0000 mgr.smithi161.sazlam (mgr.24369) 34 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:33:28.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:27.016078+0000 mgr.smithi161.sazlam (mgr.24369) 35 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:33:28.297 INFO:tasks.workunit.client.1.smithi161.stdout:5/925: link d3/d1b/d25/c43 d3/dac/dd1/c13f 0 2024-02-22T00:33:28.297 INFO:tasks.workunit.client.1.smithi161.stdout:9/722: truncate d1/d25/d73/d60/fb3 79692 0 2024-02-22T00:33:28.299 INFO:tasks.workunit.client.1.smithi161.stdout:6/673: mknod d3/d10/d12/d2f/d7d/d97/cd5 0 2024-02-22T00:33:28.302 INFO:tasks.workunit.client.1.smithi161.stdout:5/926: unlink d3/dac/fde 0 2024-02-22T00:33:28.303 INFO:tasks.workunit.client.1.smithi161.stdout:3/690: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/fb9 [6094767,4450] 0 2024-02-22T00:33:28.304 INFO:tasks.workunit.client.1.smithi161.stdout:9/723: creat d1/d2/d4/d1f/dab/ffc x:0 0 0 2024-02-22T00:33:28.307 INFO:tasks.workunit.client.1.smithi161.stdout:6/674: creat d3/d10/d12/d2f/d7d/d82/fd6 x:0 0 0 2024-02-22T00:33:28.308 INFO:tasks.workunit.client.1.smithi161.stdout:3/691: mknod da/dc/d11/d26/d80/dc7/ce1 0 2024-02-22T00:33:28.309 INFO:tasks.workunit.client.1.smithi161.stdout:9/724: mkdir d1/d2/d7/da/dfd 0 2024-02-22T00:33:28.311 INFO:tasks.workunit.client.1.smithi161.stdout:6/675: write d3/d10/d12/d2f/d7d/d82/fd6 [225204,75762] 0 2024-02-22T00:33:28.312 INFO:tasks.workunit.client.1.smithi161.stdout:9/725: write d1/d2/d4/d95/fde [150868,39795] 0 2024-02-22T00:33:28.312 INFO:tasks.workunit.client.1.smithi161.stdout:3/692: readlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/l47 0 2024-02-22T00:33:28.313 INFO:tasks.workunit.client.1.smithi161.stdout:5/927: link d3/d1c/f7d d3/d1b/d25/db5/dca/f140 0 2024-02-22T00:33:28.315 INFO:tasks.workunit.client.1.smithi161.stdout:3/693: read da/dc/d11/d26/f7e [2653596,11416] 0 2024-02-22T00:33:28.316 INFO:tasks.workunit.client.1.smithi161.stdout:6/676: read d3/d10/d12/f36 [239705,91201] 0 2024-02-22T00:33:28.318 INFO:tasks.workunit.client.1.smithi161.stdout:9/726: symlink d1/lfe 0 2024-02-22T00:33:28.319 INFO:tasks.workunit.client.1.smithi161.stdout:3/694: readlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/l47 0 2024-02-22T00:33:28.320 INFO:tasks.workunit.client.1.smithi161.stdout:5/928: symlink d3/d1b/d25/db5/l141 0 2024-02-22T00:33:28.321 INFO:tasks.workunit.client.1.smithi161.stdout:9/727: fsync d1/d2/d4/f3b 0 2024-02-22T00:33:28.321 INFO:tasks.workunit.client.1.smithi161.stdout:3/695: dread - da/dc/d11/d26/d80/fa2 zero size 2024-02-22T00:33:28.323 INFO:tasks.workunit.client.1.smithi161.stdout:9/728: fsync d1/d2/f10 0 2024-02-22T00:33:28.323 INFO:tasks.workunit.client.1.smithi161.stdout:2/860: truncate de/d2b/d8b/ddc/d125/d3a/f88 3802080 0 2024-02-22T00:33:28.324 INFO:tasks.workunit.client.1.smithi161.stdout:5/929: truncate d3/d1b/f10a 646262 0 2024-02-22T00:33:28.326 INFO:tasks.workunit.client.1.smithi161.stdout:8/761: dread d1/d2f/d37/d64/d7b/f5d [0,4194304] 0 2024-02-22T00:33:28.328 INFO:tasks.workunit.client.1.smithi161.stdout:9/729: fdatasync d1/d2/d7/f91 0 2024-02-22T00:33:28.329 INFO:tasks.workunit.client.1.smithi161.stdout:5/930: mknod d3/d1b/d91/d96/c142 0 2024-02-22T00:33:28.329 INFO:tasks.workunit.client.1.smithi161.stdout:6/677: dwrite d3/dc/df/d32/f91 [0,4194304] 0 2024-02-22T00:33:28.330 INFO:tasks.workunit.client.1.smithi161.stdout:8/762: chown d1/d1c/d96/cb7 24064783 1 2024-02-22T00:33:28.332 INFO:tasks.workunit.client.1.smithi161.stdout:3/696: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/fe2 x:0 0 0 2024-02-22T00:33:28.332 INFO:tasks.workunit.client.1.smithi161.stdout:5/931: read d3/f19 [2325247,48826] 0 2024-02-22T00:33:28.333 INFO:tasks.workunit.client.1.smithi161.stdout:5/932: stat d3/dac/dd1/lff 0 2024-02-22T00:33:28.338 INFO:tasks.workunit.client.1.smithi161.stdout:9/730: rename d1/lb1 to d1/d25/d73/d60/d77/lff 0 2024-02-22T00:33:28.341 INFO:tasks.workunit.client.1.smithi161.stdout:6/678: symlink d3/d10/d12/d3a/ld7 0 2024-02-22T00:33:28.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/731: write d1/d2/d7/fe3 [1724062,46003] 0 2024-02-22T00:33:28.342 INFO:tasks.workunit.client.1.smithi161.stdout:5/933: dwrite d3/d1b/f10a [0,4194304] 0 2024-02-22T00:33:28.348 INFO:tasks.workunit.client.1.smithi161.stdout:9/732: symlink d1/d25/d73/d98/l100 0 2024-02-22T00:33:28.349 INFO:tasks.workunit.client.1.smithi161.stdout:8/763: creat d1/d1c/ffb x:0 0 0 2024-02-22T00:33:28.350 INFO:tasks.workunit.client.1.smithi161.stdout:9/733: chown d1/d25/d73/d60/d77/d99 455117 1 2024-02-22T00:33:28.350 INFO:tasks.workunit.client.1.smithi161.stdout:6/679: dread d3/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:28.352 INFO:tasks.workunit.client.1.smithi161.stdout:8/764: fdatasync d1/d1c/d20/d22/d28/d7f/d92/d95/fe3 0 2024-02-22T00:33:28.359 INFO:tasks.workunit.client.1.smithi161.stdout:5/934: rename d3/d1b/d8f/l134 to d3/dac/d102/l143 0 2024-02-22T00:33:28.360 INFO:tasks.workunit.client.1.smithi161.stdout:6/680: symlink d3/daf/ld8 0 2024-02-22T00:33:28.361 INFO:tasks.workunit.client.1.smithi161.stdout:2/861: dread de/d2b/d8b/ddc/d125/fdb [0,4194304] 0 2024-02-22T00:33:28.363 INFO:tasks.workunit.client.1.smithi161.stdout:8/765: creat d1/d1c/d20/de6/ffc x:0 0 0 2024-02-22T00:33:28.366 INFO:tasks.workunit.client.1.smithi161.stdout:5/935: dwrite d3/d1c/d20/f73 [0,4194304] 0 2024-02-22T00:33:28.367 INFO:tasks.workunit.client.1.smithi161.stdout:3/697: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/fb2 [0,4194304] 0 2024-02-22T00:33:28.369 INFO:tasks.workunit.client.1.smithi161.stdout:6/681: rename d3/d10/d1b/d5e to d3/dc/df/d32/dd9 0 2024-02-22T00:33:28.374 INFO:tasks.workunit.client.1.smithi161.stdout:9/734: write d1/d2/d7/da/f75 [1782385,13575] 0 2024-02-22T00:33:28.374 INFO:tasks.workunit.client.1.smithi161.stdout:9/735: read - d1/d2/d4/f79 zero size 2024-02-22T00:33:28.376 INFO:tasks.workunit.client.1.smithi161.stdout:8/766: getdents d1/d1c/d20/dc0 0 2024-02-22T00:33:28.376 INFO:tasks.workunit.client.1.smithi161.stdout:8/767: stat d1/c5 0 2024-02-22T00:33:28.377 INFO:tasks.workunit.client.1.smithi161.stdout:3/698: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/fca [0,4194304] 0 2024-02-22T00:33:28.377 INFO:tasks.workunit.client.1.smithi161.stdout:9/736: read d1/f9e [2864623,93588] 0 2024-02-22T00:33:28.378 INFO:tasks.workunit.client.1.smithi161.stdout:8/768: write d1/d1c/d20/de6/ffc [18536,125083] 0 2024-02-22T00:33:28.380 INFO:tasks.workunit.client.1.smithi161.stdout:3/699: stat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/l47 0 2024-02-22T00:33:28.381 INFO:tasks.workunit.client.1.smithi161.stdout:6/682: mkdir d3/dda 0 2024-02-22T00:33:28.382 INFO:tasks.workunit.client.1.smithi161.stdout:6/683: write d3/dc/f2b [3580226,52830] 0 2024-02-22T00:33:28.383 INFO:tasks.workunit.client.1.smithi161.stdout:6/684: fsync d3/d10/d12/d2f/d7d/d5f/f70 0 2024-02-22T00:33:28.384 INFO:tasks.workunit.client.1.smithi161.stdout:6/685: write d3/dc/df/f69 [3586910,4613] 0 2024-02-22T00:33:28.386 INFO:tasks.workunit.client.1.smithi161.stdout:6/686: dread - d3/d10/d12/d2f/d7d/d82/fa9 zero size 2024-02-22T00:33:28.387 INFO:tasks.workunit.client.1.smithi161.stdout:5/936: write d3/f72 [402818,130432] 0 2024-02-22T00:33:28.390 INFO:tasks.workunit.client.1.smithi161.stdout:9/737: write d1/d2/d7/f47 [1436232,101169] 0 2024-02-22T00:33:28.392 INFO:tasks.workunit.client.1.smithi161.stdout:2/862: dwrite de/d11/f1a [0,4194304] 0 2024-02-22T00:33:28.394 INFO:tasks.workunit.client.1.smithi161.stdout:6/687: rmdir d3/d30/db4 39 2024-02-22T00:33:28.394 INFO:tasks.workunit.client.1.smithi161.stdout:5/937: truncate d3/f15 243299 0 2024-02-22T00:33:28.396 INFO:tasks.workunit.client.1.smithi161.stdout:8/769: write d1/d2f/d37/dd7/fe9 [1251386,72262] 0 2024-02-22T00:33:28.396 INFO:tasks.workunit.client.1.smithi161.stdout:3/700: truncate da/d29/d53/dc1/dce/f7b 1455429 0 2024-02-22T00:33:28.398 INFO:tasks.workunit.client.1.smithi161.stdout:6/688: dread - d3/d10/d1b/da5/dc3/fba zero size 2024-02-22T00:33:28.399 INFO:tasks.workunit.client.1.smithi161.stdout:8/770: fsync d1/d1c/d75/d18/f45 0 2024-02-22T00:33:28.400 INFO:tasks.workunit.client.1.smithi161.stdout:9/738: dread d1/d25/d73/d60/f61 [0,4194304] 0 2024-02-22T00:33:28.401 INFO:tasks.workunit.client.1.smithi161.stdout:8/771: dread - d1/d2f/d37/d64/fd8 zero size 2024-02-22T00:33:28.405 INFO:tasks.workunit.client.1.smithi161.stdout:3/701: rename da/dc/d11/d26/d80/dc7/d59/l67 to da/dc/d11/d26/d80/dc7/le3 0 2024-02-22T00:33:28.406 INFO:tasks.workunit.client.1.smithi161.stdout:6/689: rename d3/d10/d12/d2f/d7d/c58 to d3/d10/d12/d2f/d7d/cdb 0 2024-02-22T00:33:28.407 INFO:tasks.workunit.client.1.smithi161.stdout:6/690: write d3/d10/d12/d2f/d7d/d82/fa9 [153898,85805] 0 2024-02-22T00:33:28.408 INFO:tasks.workunit.client.1.smithi161.stdout:8/772: mknod d1/de0/cfd 0 2024-02-22T00:33:28.410 INFO:tasks.workunit.client.1.smithi161.stdout:5/938: link d3/d1b/d36/ff5 d3/d29/f144 0 2024-02-22T00:33:28.411 INFO:tasks.workunit.client.1.smithi161.stdout:9/739: creat d1/d25/d73/d98/dec/f101 x:0 0 0 2024-02-22T00:33:28.412 INFO:tasks.workunit.client.1.smithi161.stdout:6/691: chown d3/d30/db4/fc4 84 1 2024-02-22T00:33:28.415 INFO:tasks.workunit.client.1.smithi161.stdout:4/682: sync 2024-02-22T00:33:28.415 INFO:tasks.workunit.client.1.smithi161.stdout:0/751: sync 2024-02-22T00:33:28.422 INFO:tasks.workunit.client.1.smithi161.stdout:2/863: link de/d2b/d8b/ddc/d125/d3a/cda de/d2b/d8b/da2/da5/dc4/c12d 0 2024-02-22T00:33:28.422 INFO:tasks.workunit.client.1.smithi161.stdout:4/683: chown d5/d8/d41/d57/dbe/d28/d63/d65/c66 42185548 1 2024-02-22T00:33:28.425 INFO:tasks.workunit.client.1.smithi161.stdout:2/864: write de/f67 [86634,21290] 0 2024-02-22T00:33:28.425 INFO:tasks.workunit.client.1.smithi161.stdout:0/752: chown d14/d1a/lf8 5722481 1 2024-02-22T00:33:28.427 INFO:tasks.workunit.client.1.smithi161.stdout:9/740: write d1/d2/d7/f91 [195771,116319] 0 2024-02-22T00:33:28.428 INFO:tasks.workunit.client.1.smithi161.stdout:3/702: dwrite da/dc/d5f/d66/f95 [0,4194304] 0 2024-02-22T00:33:28.430 INFO:tasks.workunit.client.1.smithi161.stdout:4/684: write d5/f7 [4643011,18190] 0 2024-02-22T00:33:28.430 INFO:tasks.workunit.client.1.smithi161.stdout:6/692: rename d3/d10/d12/d2f/d7d/dcb to d3/d10/d12/d2f/d7d/d97/ddc 0 2024-02-22T00:33:28.431 INFO:tasks.workunit.client.1.smithi161.stdout:2/865: unlink de/f111 0 2024-02-22T00:33:28.433 INFO:tasks.workunit.client.1.smithi161.stdout:3/703: dread - da/dc/d11/d26/fd5 zero size 2024-02-22T00:33:28.436 INFO:tasks.workunit.client.1.smithi161.stdout:8/773: dread d1/d1c/d20/d22/d28/d7f/d92/d95/fcb [0,4194304] 0 2024-02-22T00:33:28.437 INFO:tasks.workunit.client.1.smithi161.stdout:0/753: rename d14/d44/c87 to d14/d37/d42/d73/dc7/cfe 0 2024-02-22T00:33:28.443 INFO:tasks.workunit.client.1.smithi161.stdout:4/685: fsync d5/d8/d41/d57/dbe/d28/fba 0 2024-02-22T00:33:28.445 INFO:tasks.workunit.client.1.smithi161.stdout:3/704: creat da/dc/d11/d26/d80/dc7/d60/dd7/fe4 x:0 0 0 2024-02-22T00:33:28.449 INFO:tasks.workunit.client.1.smithi161.stdout:8/774: dwrite d1/d1c/ffb [0,4194304] 0 2024-02-22T00:33:28.451 INFO:tasks.workunit.client.1.smithi161.stdout:4/686: dread - d5/d8/d41/d57/dbe/d28/d63/d6b/f78 zero size 2024-02-22T00:33:28.455 INFO:tasks.workunit.client.1.smithi161.stdout:2/866: dread de/d11/d14/f18 [0,4194304] 0 2024-02-22T00:33:28.456 INFO:tasks.workunit.client.1.smithi161.stdout:0/754: write d14/d1a/d3f/f80 [736601,87405] 0 2024-02-22T00:33:28.458 INFO:tasks.workunit.client.1.smithi161.stdout:5/939: dread d3/d1b/d25/db5/dca/f140 [0,4194304] 0 2024-02-22T00:33:28.459 INFO:tasks.workunit.client.1.smithi161.stdout:0/755: chown d14/d44/dbf/deb/def 492275021 1 2024-02-22T00:33:28.460 INFO:tasks.workunit.client.1.smithi161.stdout:8/775: rename d1/de0 to d1/d1c/d20/d22/dfe 0 2024-02-22T00:33:28.460 INFO:tasks.workunit.client.1.smithi161.stdout:2/867: mkdir de/df4/d12e 0 2024-02-22T00:33:28.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/756: stat d14/d1a/d3f/d96/dad 0 2024-02-22T00:33:28.463 INFO:tasks.workunit.client.1.smithi161.stdout:6/693: dread d3/d10/f55 [4194304,4194304] 0 2024-02-22T00:33:28.463 INFO:tasks.workunit.client.1.smithi161.stdout:3/705: rename da/dc/d11/d26/d80/dc7/d59/d93/dda to da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5 0 2024-02-22T00:33:28.464 INFO:tasks.workunit.client.1.smithi161.stdout:8/776: creat d1/d1c/d20/d22/d28/d7f/db4/fff x:0 0 0 2024-02-22T00:33:28.469 INFO:tasks.workunit.client.1.smithi161.stdout:0/757: write d14/d37/d42/d73/ffb [6487,10978] 0 2024-02-22T00:33:28.469 INFO:tasks.workunit.client.1.smithi161.stdout:8/777: write d1/d1c/fa4 [2445930,2027] 0 2024-02-22T00:33:28.471 INFO:tasks.workunit.client.1.smithi161.stdout:4/687: dwrite d5/d8/d41/d57/dbe/d28/d63/f98 [0,4194304] 0 2024-02-22T00:33:28.472 INFO:tasks.workunit.client.1.smithi161.stdout:3/706: mknod da/dc/d11/d26/d80/dc7/d59/d93/ce6 0 2024-02-22T00:33:28.474 INFO:tasks.workunit.client.1.smithi161.stdout:2/868: dread de/d2b/d8b/ddc/d125/d3a/fcb [0,4194304] 0 2024-02-22T00:33:28.476 INFO:tasks.workunit.client.1.smithi161.stdout:6/694: getdents d3/d10/d1b 0 2024-02-22T00:33:28.478 INFO:tasks.workunit.client.1.smithi161.stdout:8/778: symlink d1/d1c/l100 0 2024-02-22T00:33:28.480 INFO:tasks.workunit.client.1.smithi161.stdout:6/695: write d3/d10/d12/d2f/d7d/d5f/f90 [450219,26084] 0 2024-02-22T00:33:28.484 INFO:tasks.workunit.client.1.smithi161.stdout:0/758: link d14/d29/l70 d14/d29/dd4/lff 0 2024-02-22T00:33:28.485 INFO:tasks.workunit.client.1.smithi161.stdout:4/688: rename d5/d8/d41/d57/dbe/c74 to d5/d8/d41/d57/dbe/d28/c103 0 2024-02-22T00:33:28.488 INFO:tasks.workunit.client.1.smithi161.stdout:3/707: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f4b [0,4194304] 0 2024-02-22T00:33:28.488 INFO:tasks.workunit.client.1.smithi161.stdout:8/779: write d1/d1c/d20/d22/d28/d7f/d92/d95/f57 [1398272,121740] 0 2024-02-22T00:33:28.490 INFO:tasks.workunit.client.1.smithi161.stdout:2/869: dwrite de/d2b/d8b/da2/fbc [0,4194304] 0 2024-02-22T00:33:28.493 INFO:tasks.workunit.client.1.smithi161.stdout:0/759: truncate d14/d37/d42/d73/fa8 1596145 0 2024-02-22T00:33:28.494 INFO:tasks.workunit.client.1.smithi161.stdout:0/760: dread - d14/df1/ff7 zero size 2024-02-22T00:33:28.495 INFO:tasks.workunit.client.1.smithi161.stdout:8/780: rmdir d1/d2f/d37/d64/d7b/d7e 39 2024-02-22T00:33:28.498 INFO:tasks.workunit.client.1.smithi161.stdout:0/761: chown d14/d37/d42/d73/f91 12519 1 2024-02-22T00:33:28.498 INFO:tasks.workunit.client.1.smithi161.stdout:3/708: readlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/l47 0 2024-02-22T00:33:28.500 INFO:tasks.workunit.client.1.smithi161.stdout:4/689: truncate d5/d8/d41/d57/dbe/d28/d38/f85 3670848 0 2024-02-22T00:33:28.503 INFO:tasks.workunit.client.1.smithi161.stdout:2/870: rename de/d2b/d8b/ddc/d125/d3a/d9d/c110 to de/d2b/d8b/d116/c12f 0 2024-02-22T00:33:28.504 INFO:tasks.workunit.client.1.smithi161.stdout:2/871: chown de/d11/d5c/fbf 114 1 2024-02-22T00:33:28.505 INFO:tasks.workunit.client.1.smithi161.stdout:0/762: mkdir d14/df1/d100 0 2024-02-22T00:33:28.506 INFO:tasks.workunit.client.1.smithi161.stdout:3/709: mkdir da/dc/d91/de7 0 2024-02-22T00:33:28.506 INFO:tasks.workunit.client.1.smithi161.stdout:2/872: write de/d2b/d8b/ddc/d125/fe2 [975065,55699] 0 2024-02-22T00:33:28.507 INFO:tasks.workunit.client.1.smithi161.stdout:4/690: mknod d5/d17/d5c/c104 0 2024-02-22T00:33:28.511 INFO:tasks.workunit.client.1.smithi161.stdout:8/781: creat d1/d2f/d37/d64/d7b/f101 x:0 0 0 2024-02-22T00:33:28.512 INFO:tasks.workunit.client.1.smithi161.stdout:4/691: write d5/d10/d14/f5d [631790,83943] 0 2024-02-22T00:33:28.513 INFO:tasks.workunit.client.1.smithi161.stdout:2/873: creat de/d2b/d83/d4f/f130 x:0 0 0 2024-02-22T00:33:28.518 INFO:tasks.workunit.client.1.smithi161.stdout:6/696: dread d3/d10/d12/d3a/f43 [0,4194304] 0 2024-02-22T00:33:28.518 INFO:tasks.workunit.client.1.smithi161.stdout:4/692: read - d5/d8/d41/d57/dbe/d28/d63/d64/fc0 zero size 2024-02-22T00:33:28.518 INFO:tasks.workunit.client.1.smithi161.stdout:2/874: creat de/d11/d14/f131 x:0 0 0 2024-02-22T00:33:28.521 INFO:tasks.workunit.client.1.smithi161.stdout:0/763: dwrite d14/d1a/f79 [0,4194304] 0 2024-02-22T00:33:28.522 INFO:tasks.workunit.client.1.smithi161.stdout:2/875: readlink de/d2b/d8b/ddc/l103 0 2024-02-22T00:33:28.524 INFO:tasks.workunit.client.1.smithi161.stdout:6/697: write d3/dc/df/f69 [1683281,125637] 0 2024-02-22T00:33:28.527 INFO:tasks.workunit.client.1.smithi161.stdout:8/782: dwrite d1/d1c/d20/d22/d28/d7f/d92/fe2 [0,4194304] 0 2024-02-22T00:33:28.527 INFO:tasks.workunit.client.1.smithi161.stdout:0/764: fdatasync d14/d37/d42/d8e/d92/fee 0 2024-02-22T00:33:28.528 INFO:tasks.workunit.client.1.smithi161.stdout:0/765: fsync d14/f4b 0 2024-02-22T00:33:28.533 INFO:tasks.workunit.client.1.smithi161.stdout:6/698: mknod d3/d10/cdd 0 2024-02-22T00:33:28.537 INFO:tasks.workunit.client.1.smithi161.stdout:4/693: rename d5/d8/d41/d57/dbe/d28/d63/lb1 to d5/d8/d41/d57/dbe/d28/d38/l105 0 2024-02-22T00:33:28.538 INFO:tasks.workunit.client.1.smithi161.stdout:2/876: fdatasync de/d2b/d8b/ddc/d125/f79 0 2024-02-22T00:33:28.543 INFO:tasks.workunit.client.1.smithi161.stdout:8/783: rename d1/d1c/d75/c21 to d1/d2f/d30/c102 0 2024-02-22T00:33:28.547 INFO:tasks.workunit.client.1.smithi161.stdout:6/699: fdatasync d3/d10/f65 0 2024-02-22T00:33:28.549 INFO:tasks.workunit.client.1.smithi161.stdout:4/694: creat d5/d8/d41/d53/d6c/d72/dfb/f106 x:0 0 0 2024-02-22T00:33:28.551 INFO:tasks.workunit.client.1.smithi161.stdout:2/877: fsync de/d11/f4e 0 2024-02-22T00:33:28.551 INFO:tasks.workunit.client.1.smithi161.stdout:3/710: dwrite da/d29/d53/dc1/dce/f64 [0,4194304] 0 2024-02-22T00:33:28.551 INFO:tasks.workunit.client.1.smithi161.stdout:4/695: dread - d5/d10/d14/d4f/fff zero size 2024-02-22T00:33:28.555 INFO:tasks.workunit.client.1.smithi161.stdout:2/878: read - de/d2b/d8b/da2/da5/dc4/da7/fb1 zero size 2024-02-22T00:33:28.557 INFO:tasks.workunit.client.1.smithi161.stdout:6/700: creat d3/dc/df/d32/fde x:0 0 0 2024-02-22T00:33:28.557 INFO:tasks.workunit.client.1.smithi161.stdout:6/701: readlink d3/dc/la0 0 2024-02-22T00:33:28.562 INFO:tasks.workunit.client.1.smithi161.stdout:8/784: truncate d1/d1c/d20/d22/d28/d7f/d92/d95/f9f 1679691 0 2024-02-22T00:33:28.563 INFO:tasks.workunit.client.1.smithi161.stdout:0/766: dwrite d14/d29/f7a [0,4194304] 0 2024-02-22T00:33:28.564 INFO:tasks.workunit.client.1.smithi161.stdout:0/767: readlink d14/d37/l6e 0 2024-02-22T00:33:28.566 INFO:tasks.workunit.client.1.smithi161.stdout:3/711: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/fe8 x:0 0 0 2024-02-22T00:33:28.567 INFO:tasks.workunit.client.1.smithi161.stdout:2/879: chown de/d2b/d8b/ddc/d125/d3a/cda 169432144 1 2024-02-22T00:33:28.570 INFO:tasks.workunit.client.1.smithi161.stdout:3/712: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/fb0 [2983424,66733] 0 2024-02-22T00:33:28.572 INFO:tasks.workunit.client.1.smithi161.stdout:3/713: dread da/dc/d11/d26/d80/dc7/f97 [0,4194304] 0 2024-02-22T00:33:28.573 INFO:tasks.workunit.client.1.smithi161.stdout:6/702: symlink d3/d7c/da6/ldf 0 2024-02-22T00:33:28.579 INFO:tasks.workunit.client.1.smithi161.stdout:0/768: mkdir d14/d101 0 2024-02-22T00:33:28.581 INFO:tasks.workunit.client.1.smithi161.stdout:3/714: mknod da/d29/d53/dc1/dce/ce9 0 2024-02-22T00:33:28.582 INFO:tasks.workunit.client.1.smithi161.stdout:6/703: write d3/d10/f38 [1034504,110348] 0 2024-02-22T00:33:28.583 INFO:tasks.workunit.client.1.smithi161.stdout:0/769: mkdir d14/d1a/d9d/dba/d102 0 2024-02-22T00:33:28.583 INFO:tasks.workunit.client.1.smithi161.stdout:1/757: sync 2024-02-22T00:33:28.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/880: mkdir de/d2b/d8b/ddc/d125/dd6/d132 0 2024-02-22T00:33:28.590 INFO:tasks.workunit.client.1.smithi161.stdout:8/785: write d1/d1c/d20/d22/d28/d36/f41 [1932707,121425] 0 2024-02-22T00:33:28.591 INFO:tasks.workunit.client.1.smithi161.stdout:3/715: mknod da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/cea 0 2024-02-22T00:33:28.592 INFO:tasks.workunit.client.1.smithi161.stdout:2/881: symlink de/d2b/d83/l133 0 2024-02-22T00:33:28.594 INFO:tasks.workunit.client.1.smithi161.stdout:6/704: link d3/dc/df/d32/dd9/d87/cd0 d3/d10/d72/ce0 0 2024-02-22T00:33:28.595 INFO:tasks.workunit.client.1.smithi161.stdout:2/882: chown de/d11/d14/fbb 20 1 2024-02-22T00:33:28.597 INFO:tasks.workunit.client.1.smithi161.stdout:6/705: fsync d3/d10/f26 0 2024-02-22T00:33:28.598 INFO:tasks.workunit.client.1.smithi161.stdout:4/696: dread d5/d8/d41/fa3 [0,4194304] 0 2024-02-22T00:33:28.600 INFO:tasks.workunit.client.1.smithi161.stdout:3/716: read - da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/fe8 zero size 2024-02-22T00:33:28.601 INFO:tasks.workunit.client.1.smithi161.stdout:8/786: dwrite d1/d1c/d20/de6/ffc [0,4194304] 0 2024-02-22T00:33:28.602 INFO:tasks.workunit.client.1.smithi161.stdout:6/706: truncate d3/d30/f76 959768 0 2024-02-22T00:33:28.604 INFO:tasks.workunit.client.1.smithi161.stdout:3/717: unlink da/f1a 0 2024-02-22T00:33:28.606 INFO:tasks.workunit.client.1.smithi161.stdout:6/707: readlink d3/d10/d1b/lae 0 2024-02-22T00:33:28.607 INFO:tasks.workunit.client.1.smithi161.stdout:8/787: rmdir d1/d1c/d20/d22/d28 39 2024-02-22T00:33:28.610 INFO:tasks.workunit.client.1.smithi161.stdout:4/697: mknod d5/d8/d41/d57/dbe/d28/c107 0 2024-02-22T00:33:28.611 INFO:tasks.workunit.client.1.smithi161.stdout:6/708: creat d3/dc/df/d32/fe1 x:0 0 0 2024-02-22T00:33:28.613 INFO:tasks.workunit.client.1.smithi161.stdout:0/770: dwrite d14/d44/f81 [0,4194304] 0 2024-02-22T00:33:28.614 INFO:tasks.workunit.client.1.smithi161.stdout:2/883: dwrite de/d2b/d8b/ddc/d125/fdb [0,4194304] 0 2024-02-22T00:33:28.614 INFO:tasks.workunit.client.1.smithi161.stdout:1/758: dread d19/f26 [4194304,4194304] 0 2024-02-22T00:33:28.615 INFO:tasks.workunit.client.1.smithi161.stdout:8/788: dread d1/d2f/fa8 [0,4194304] 0 2024-02-22T00:33:28.619 INFO:tasks.workunit.client.1.smithi161.stdout:6/709: write d3/d10/d72/dc5/fcc [52350,43633] 0 2024-02-22T00:33:28.620 INFO:tasks.workunit.client.1.smithi161.stdout:6/710: write d3/f5d [3581015,108518] 0 2024-02-22T00:33:28.620 INFO:tasks.workunit.client.1.smithi161.stdout:3/718: rmdir da/dc/d11/d26/d80/dc7/d59/d93/de0 0 2024-02-22T00:33:28.623 INFO:tasks.workunit.client.1.smithi161.stdout:6/711: write d3/d30/f74 [4077195,88008] 0 2024-02-22T00:33:28.625 INFO:tasks.workunit.client.1.smithi161.stdout:3/719: read - da/dc/d11/d26/d80/dc7/d59/fa0 zero size 2024-02-22T00:33:28.630 INFO:tasks.workunit.client.1.smithi161.stdout:1/759: dwrite d19/d1d/d56/fa4 [0,4194304] 0 2024-02-22T00:33:28.636 INFO:tasks.workunit.client.1.smithi161.stdout:2/884: symlink de/d2b/l134 0 2024-02-22T00:33:28.639 INFO:tasks.workunit.client.1.smithi161.stdout:0/771: symlink d14/d1a/d9d/dba/d102/l103 0 2024-02-22T00:33:28.640 INFO:tasks.workunit.client.1.smithi161.stdout:4/698: creat d5/d8/d41/d57/dbe/f108 x:0 0 0 2024-02-22T00:33:28.640 INFO:tasks.workunit.client.1.smithi161.stdout:8/789: fdatasync d1/d2f/d37/d64/d7b/f99 0 2024-02-22T00:33:28.642 INFO:tasks.workunit.client.1.smithi161.stdout:2/885: mknod de/d2b/d8b/d116/c135 0 2024-02-22T00:33:28.642 INFO:tasks.workunit.client.1.smithi161.stdout:6/712: chown d3/dc/df/d32/dd9/d87/fc2 2295507 1 2024-02-22T00:33:28.645 INFO:tasks.workunit.client.1.smithi161.stdout:3/720: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/fe2 [0,4194304] 0 2024-02-22T00:33:28.646 INFO:tasks.workunit.client.1.smithi161.stdout:4/699: chown d5/db0 6054 1 2024-02-22T00:33:28.647 INFO:tasks.workunit.client.1.smithi161.stdout:1/760: dread d19/d1d/d56/fa4 [0,4194304] 0 2024-02-22T00:33:28.648 INFO:tasks.workunit.client.1.smithi161.stdout:2/886: symlink de/d2b/d8b/ddc/l136 0 2024-02-22T00:33:28.649 INFO:tasks.workunit.client.1.smithi161.stdout:0/772: mkdir d14/d37/d42/d8e/d92/da5/dcd/d104 0 2024-02-22T00:33:28.653 INFO:tasks.workunit.client.1.smithi161.stdout:6/713: fdatasync d3/d10/d12/d3a/f43 0 2024-02-22T00:33:28.653 INFO:tasks.workunit.client.1.smithi161.stdout:3/721: read da/fb3 [4049719,113343] 0 2024-02-22T00:33:28.653 INFO:tasks.workunit.client.1.smithi161.stdout:3/722: chown da/dc/d11/d26/f63 1 1 2024-02-22T00:33:28.653 INFO:tasks.workunit.client.1.smithi161.stdout:8/790: fsync d1/d1c/d20/d22/d3f/f6e 0 2024-02-22T00:33:28.655 INFO:tasks.workunit.client.1.smithi161.stdout:0/773: creat d14/d1a/d3f/d96/dbc/f105 x:0 0 0 2024-02-22T00:33:28.656 INFO:tasks.workunit.client.1.smithi161.stdout:2/887: read de/d11/d5c/f80 [2238905,50513] 0 2024-02-22T00:33:28.658 INFO:tasks.workunit.client.1.smithi161.stdout:4/700: getdents d5/d8/d41/d53 0 2024-02-22T00:33:28.661 INFO:tasks.workunit.client.1.smithi161.stdout:2/888: unlink de/d11/fdf 0 2024-02-22T00:33:28.662 INFO:tasks.workunit.client.1.smithi161.stdout:0/774: creat d14/d37/d42/d73/dc7/de0/de5/f106 x:0 0 0 2024-02-22T00:33:28.663 INFO:tasks.workunit.client.1.smithi161.stdout:8/791: link d1/d2f/d37/d64/d7b/ff4 d1/d1c/d20/d22/d28/d36/d6c/f103 0 2024-02-22T00:33:28.664 INFO:tasks.workunit.client.1.smithi161.stdout:4/701: creat d5/d10/d14/d4f/f109 x:0 0 0 2024-02-22T00:33:28.664 INFO:tasks.workunit.client.1.smithi161.stdout:6/714: dwrite d3/d10/f55 [4194304,4194304] 0 2024-02-22T00:33:28.664 INFO:tasks.workunit.client.1.smithi161.stdout:0/775: write d14/f18 [8782969,72894] 0 2024-02-22T00:33:28.665 INFO:tasks.workunit.client.1.smithi161.stdout:1/761: write d19/d1d/f8c [601205,63538] 0 2024-02-22T00:33:28.666 INFO:tasks.workunit.client.1.smithi161.stdout:4/702: fsync d5/f7 0 2024-02-22T00:33:28.668 INFO:tasks.workunit.client.1.smithi161.stdout:1/762: fdatasync d19/d1d/d56/db2/fc8 0 2024-02-22T00:33:28.671 INFO:tasks.workunit.client.1.smithi161.stdout:2/889: link de/d11/l58 de/l137 0 2024-02-22T00:33:28.672 INFO:tasks.workunit.client.1.smithi161.stdout:4/703: fdatasync d5/f27 0 2024-02-22T00:33:28.676 INFO:tasks.workunit.client.1.smithi161.stdout:2/890: write de/d2b/d8b/ddc/d125/fdb [5844121,89954] 0 2024-02-22T00:33:28.677 INFO:tasks.workunit.client.1.smithi161.stdout:3/723: dwrite da/dc/d5f/d66/f95 [0,4194304] 0 2024-02-22T00:33:28.681 INFO:tasks.workunit.client.1.smithi161.stdout:6/715: dwrite d3/dc/df/d32/fde [0,4194304] 0 2024-02-22T00:33:28.681 INFO:tasks.workunit.client.1.smithi161.stdout:8/792: truncate d1/d1c/d20/d22/f35 2210095 0 2024-02-22T00:33:28.686 INFO:tasks.workunit.client.1.smithi161.stdout:8/793: truncate d1/d1c/d20/d22/d28/d7f/d92/fc3 456665 0 2024-02-22T00:33:28.688 INFO:tasks.workunit.client.1.smithi161.stdout:2/891: dread de/d2b/d8b/da2/da5/dc4/d8f/f8d [0,4194304] 0 2024-02-22T00:33:28.690 INFO:tasks.workunit.client.1.smithi161.stdout:2/892: fdatasync de/d2b/d8b/da2/da5/dc4/da7/fb7 0 2024-02-22T00:33:28.694 INFO:tasks.workunit.client.1.smithi161.stdout:6/716: link d3/d10/d12/d2f/d7d/d5f/lbc d3/d10/d12/le2 0 2024-02-22T00:33:28.696 INFO:tasks.workunit.client.1.smithi161.stdout:8/794: write d1/f29 [1005801,897] 0 2024-02-22T00:33:28.698 INFO:tasks.workunit.client.1.smithi161.stdout:6/717: creat d3/d10/d12/d2f/d7d/d5f/fe3 x:0 0 0 2024-02-22T00:33:28.698 INFO:tasks.workunit.client.1.smithi161.stdout:6/718: readlink d3/daf/ld8 0 2024-02-22T00:33:28.698 INFO:tasks.workunit.client.1.smithi161.stdout:4/704: truncate d5/d8/d41/d57/dbe/d28/d63/f98 2359220 0 2024-02-22T00:33:28.701 INFO:tasks.workunit.client.1.smithi161.stdout:4/705: dread - d5/d8/d41/d57/dbe/d28/d63/d6b/f78 zero size 2024-02-22T00:33:28.702 INFO:tasks.workunit.client.1.smithi161.stdout:3/724: truncate da/d29/f7f 4062068 0 2024-02-22T00:33:28.703 INFO:tasks.workunit.client.1.smithi161.stdout:8/795: dread d1/d1c/d20/d22/d28/d7f/d92/d95/fcb [0,4194304] 0 2024-02-22T00:33:28.704 INFO:tasks.workunit.client.1.smithi161.stdout:4/706: read - d5/d8/d41/d57/dbe/d28/d63/d65/fc7 zero size 2024-02-22T00:33:28.706 INFO:tasks.workunit.client.1.smithi161.stdout:6/719: rename d3/dc/df/d32/f4b to d3/d10/d12/d2f/d7d/d82/fe4 0 2024-02-22T00:33:28.706 INFO:tasks.workunit.client.1.smithi161.stdout:6/720: readlink d3/dc/l64 0 2024-02-22T00:33:28.710 INFO:tasks.workunit.client.1.smithi161.stdout:8/796: fsync d1/d2f/d37/d64/d7b/f9d 0 2024-02-22T00:33:28.711 INFO:tasks.workunit.client.1.smithi161.stdout:8/797: chown d1/d1c/d20/d22/d28/d36 33234 1 2024-02-22T00:33:28.712 INFO:tasks.workunit.client.1.smithi161.stdout:8/798: chown d1/d1c/d20/d22 0 1 2024-02-22T00:33:28.714 INFO:tasks.workunit.client.1.smithi161.stdout:2/893: dread de/d2b/d8b/da2/da5/fcf [0,4194304] 0 2024-02-22T00:33:28.720 INFO:tasks.workunit.client.1.smithi161.stdout:8/799: dwrite d1/d1c/ffb [0,4194304] 0 2024-02-22T00:33:28.721 INFO:tasks.workunit.client.1.smithi161.stdout:4/707: creat d5/d10/d14/f10a x:0 0 0 2024-02-22T00:33:28.722 INFO:tasks.workunit.client.1.smithi161.stdout:6/721: write d3/d10/d12/d2f/fc6 [1780444,102410] 0 2024-02-22T00:33:28.723 INFO:tasks.workunit.client.1.smithi161.stdout:2/894: truncate de/d11/d32/f76 1100444 0 2024-02-22T00:33:28.727 INFO:tasks.workunit.client.1.smithi161.stdout:8/800: symlink d1/d1c/d96/dcf/l104 0 2024-02-22T00:33:28.729 INFO:tasks.workunit.client.1.smithi161.stdout:3/725: dwrite da/dc/d11/d26/f7e [4194304,4194304] 0 2024-02-22T00:33:28.735 INFO:tasks.workunit.client.1.smithi161.stdout:6/722: dwrite d3/dc/df/d32/dd9/f94 [0,4194304] 0 2024-02-22T00:33:28.737 INFO:tasks.workunit.client.1.smithi161.stdout:4/708: dread d5/d17/f4a [0,4194304] 0 2024-02-22T00:33:28.738 INFO:tasks.workunit.client.1.smithi161.stdout:2/895: link de/d2b/d8b/f97 de/d11/d14/f138 0 2024-02-22T00:33:28.740 INFO:tasks.workunit.client.1.smithi161.stdout:6/723: write d3/dc/df/fc8 [436421,6142] 0 2024-02-22T00:33:28.740 INFO:tasks.workunit.client.1.smithi161.stdout:8/801: mknod d1/d2f/d37/dd7/c105 0 2024-02-22T00:33:28.740 INFO:tasks.workunit.client.1.smithi161.stdout:4/709: fsync d5/d8/d41/d57/dbe/f108 0 2024-02-22T00:33:28.743 INFO:tasks.workunit.client.1.smithi161.stdout:2/896: fdatasync de/d2b/d8b/da2/f11b 0 2024-02-22T00:33:28.745 INFO:tasks.workunit.client.1.smithi161.stdout:6/724: write d3/d10/d12/d2f/d7d/d5f/f70 [3108068,28395] 0 2024-02-22T00:33:28.745 INFO:tasks.workunit.client.1.smithi161.stdout:3/726: fdatasync da/d29/f7f 0 2024-02-22T00:33:28.751 INFO:tasks.workunit.client.1.smithi161.stdout:6/725: dwrite d3/d10/f26 [0,4194304] 0 2024-02-22T00:33:28.754 INFO:tasks.workunit.client.1.smithi161.stdout:8/802: link d1/d1c/dbd/f8c d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/f106 0 2024-02-22T00:33:28.757 INFO:tasks.workunit.client.1.smithi161.stdout:6/726: write d3/dc/df/d32/dd9/fb6 [939918,11742] 0 2024-02-22T00:33:28.757 INFO:tasks.workunit.client.1.smithi161.stdout:3/727: getdents da/dc/d11/d26/d80 0 2024-02-22T00:33:28.760 INFO:tasks.workunit.client.1.smithi161.stdout:6/727: unlink d3/d30/f76 0 2024-02-22T00:33:28.767 INFO:tasks.workunit.client.1.smithi161.stdout:4/710: truncate d5/d8/d41/d57/dbe/d28/f7c 1946360 0 2024-02-22T00:33:28.767 INFO:tasks.workunit.client.1.smithi161.stdout:6/728: getdents d3/dc/df 0 2024-02-22T00:33:28.768 INFO:tasks.workunit.client.1.smithi161.stdout:4/711: fsync d5/d8/d41/d57/dbe/d28/fd4 0 2024-02-22T00:33:28.774 INFO:tasks.workunit.client.1.smithi161.stdout:7/780: sync 2024-02-22T00:33:28.776 INFO:tasks.workunit.client.1.smithi161.stdout:3/728: dread da/dc/f2b [0,4194304] 0 2024-02-22T00:33:28.778 INFO:tasks.workunit.client.1.smithi161.stdout:7/781: link d3/df/dba/ff4 d3/df/d33/d35/d55/d63/d7b/d30/dc0/ff9 0 2024-02-22T00:33:28.779 INFO:tasks.workunit.client.1.smithi161.stdout:7/782: fdatasync d3/df/d43/fa2 0 2024-02-22T00:33:28.782 INFO:tasks.workunit.client.1.smithi161.stdout:7/783: symlink d3/df/d33/d74/df2/lfa 0 2024-02-22T00:33:28.787 INFO:tasks.workunit.client.1.smithi161.stdout:7/784: fsync d3/df/d43/faf 0 2024-02-22T00:33:28.788 INFO:tasks.workunit.client.1.smithi161.stdout:7/785: readlink d3/df/d33/d35/la3 0 2024-02-22T00:33:28.788 INFO:tasks.workunit.client.1.smithi161.stdout:7/786: chown d3/df/d43/f76 2061891 1 2024-02-22T00:33:28.790 INFO:tasks.workunit.client.1.smithi161.stdout:3/729: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/fb4 [4194304,4194304] 0 2024-02-22T00:33:28.792 INFO:tasks.workunit.client.1.smithi161.stdout:3/730: rmdir da/dc/d11/d26/d80 39 2024-02-22T00:33:28.794 INFO:tasks.workunit.client.1.smithi161.stdout:7/787: truncate d3/df/d43/f65 3156887 0 2024-02-22T00:33:28.795 INFO:tasks.workunit.client.1.smithi161.stdout:3/731: symlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/leb 0 2024-02-22T00:33:28.796 INFO:tasks.workunit.client.1.smithi161.stdout:7/788: write d3/df/d33/d35/d55/fa8 [1182458,91039] 0 2024-02-22T00:33:28.798 INFO:tasks.workunit.client.1.smithi161.stdout:3/732: symlink da/dc/d91/de7/lec 0 2024-02-22T00:33:28.801 INFO:tasks.workunit.client.1.smithi161.stdout:3/733: mknod da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/ced 0 2024-02-22T00:33:28.802 INFO:tasks.workunit.client.1.smithi161.stdout:3/734: chown da/dc/d11/d26/d80/dc7/ca4 860981255 1 2024-02-22T00:33:28.802 INFO:tasks.workunit.client.1.smithi161.stdout:7/789: truncate d3/df/d33/d35/d55/d63/d7b/d30/d44/f90 47288 0 2024-02-22T00:33:28.808 INFO:tasks.workunit.client.1.smithi161.stdout:3/735: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/fb9 [0,4194304] 0 2024-02-22T00:33:28.808 INFO:tasks.workunit.client.1.smithi161.stdout:7/790: rename d3/dd/c11 to d3/df/d33/d35/d55/d63/d7b/d8f/dd2/cfb 0 2024-02-22T00:33:28.809 INFO:tasks.workunit.client.1.smithi161.stdout:7/791: truncate d3/dbf/dab/fdb 286554 0 2024-02-22T00:33:28.814 INFO:tasks.workunit.client.1.smithi161.stdout:7/792: getdents d3/df/d33/d35/d55/d63 0 2024-02-22T00:33:28.816 INFO:tasks.workunit.client.1.smithi161.stdout:7/793: creat d3/df/d33/d53/ffc x:0 0 0 2024-02-22T00:33:28.819 INFO:tasks.workunit.client.1.smithi161.stdout:7/794: write d3/f7d [4608274,122499] 0 2024-02-22T00:33:28.822 INFO:tasks.workunit.client.1.smithi161.stdout:3/736: dwrite da/fbd [0,4194304] 0 2024-02-22T00:33:28.831 INFO:tasks.workunit.client.1.smithi161.stdout:3/737: truncate da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f85 2285792 0 2024-02-22T00:33:28.832 INFO:tasks.workunit.client.1.smithi161.stdout:3/738: write da/dc/d11/d26/d80/dc7/d59/d93/daa/fe2 [3220017,19961] 0 2024-02-22T00:33:28.833 INFO:tasks.workunit.client.1.smithi161.stdout:3/739: fsync da/dc/d11/f28 0 2024-02-22T00:33:28.834 INFO:tasks.workunit.client.1.smithi161.stdout:3/740: chown da/dc 59813 1 2024-02-22T00:33:28.843 INFO:tasks.workunit.client.1.smithi161.stdout:3/741: link da/dc/d11/d26/d80/dc7/d59/d93/ccb da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/cee 0 2024-02-22T00:33:28.844 INFO:tasks.workunit.client.1.smithi161.stdout:3/742: fsync da/dc/d11/f3e 0 2024-02-22T00:33:28.848 INFO:tasks.workunit.client.1.smithi161.stdout:3/743: mknod da/dc/d11/d26/d80/dc7/d59/d93/daa/cef 0 2024-02-22T00:33:28.849 INFO:tasks.workunit.client.1.smithi161.stdout:3/744: read da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f4b [2135536,67320] 0 2024-02-22T00:33:28.850 INFO:tasks.workunit.client.1.smithi161.stdout:3/745: write da/fbd [1395525,6688] 0 2024-02-22T00:33:28.855 INFO:tasks.workunit.client.1.smithi161.stdout:3/746: getdents da/d29/d53/dc1/dce 0 2024-02-22T00:33:28.858 INFO:tasks.workunit.client.1.smithi161.stdout:3/747: dread da/dc/d11/d26/f19 [0,4194304] 0 2024-02-22T00:33:28.860 INFO:tasks.workunit.client.1.smithi161.stdout:3/748: truncate da/dc/d11/d26/d80/fa2 834 0 2024-02-22T00:33:28.862 INFO:tasks.workunit.client.1.smithi161.stdout:3/749: symlink da/dc/d11/d26/d80/dc7/d59/d93/daa/lf0 0 2024-02-22T00:33:28.863 INFO:tasks.workunit.client.1.smithi161.stdout:3/750: dread da/dc/d11/d26/d80/fa2 [0,4194304] 0 2024-02-22T00:33:28.866 INFO:tasks.workunit.client.1.smithi161.stdout:3/751: mkdir da/df1 0 2024-02-22T00:33:28.875 INFO:tasks.workunit.client.1.smithi161.stdout:3/752: dwrite da/d29/f7f [0,4194304] 0 2024-02-22T00:33:28.878 INFO:tasks.workunit.client.1.smithi161.stdout:3/753: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/fb9 [3025259,9344] 0 2024-02-22T00:33:28.880 INFO:tasks.workunit.client.1.smithi161.stdout:3/754: readlink da/dc/l83 0 2024-02-22T00:33:28.882 INFO:tasks.workunit.client.1.smithi161.stdout:3/755: truncate da/dc/d5f/f73 4563462 0 2024-02-22T00:33:28.883 INFO:tasks.workunit.client.1.smithi161.stdout:3/756: readlink da/dc/d11/d26/d80/dc7/le3 0 2024-02-22T00:33:28.893 INFO:tasks.workunit.client.1.smithi161.stdout:3/757: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f58 [0,4194304] 0 2024-02-22T00:33:28.900 INFO:tasks.workunit.client.1.smithi161.stdout:3/758: rename da/dc/d11/d26/d80/c9f to da/dc/d5f/cf2 0 2024-02-22T00:33:28.902 INFO:tasks.workunit.client.1.smithi161.stdout:3/759: read - da/dc/d5f/d68/f6d zero size 2024-02-22T00:33:28.904 INFO:tasks.workunit.client.1.smithi161.stdout:3/760: creat da/dc/d91/db5/ff3 x:0 0 0 2024-02-22T00:33:28.906 INFO:tasks.workunit.client.1.smithi161.stdout:3/761: mknod da/dc/d91/de7/cf4 0 2024-02-22T00:33:28.909 INFO:tasks.workunit.client.1.smithi161.stdout:5/940: sync 2024-02-22T00:33:28.909 INFO:tasks.workunit.client.1.smithi161.stdout:9/741: sync 2024-02-22T00:33:28.911 INFO:tasks.workunit.client.1.smithi161.stdout:5/941: symlink d3/d1b/d25/d4c/dcb/l145 0 2024-02-22T00:33:28.912 INFO:tasks.workunit.client.1.smithi161.stdout:9/742: mknod d1/d2/d4/d1f/dab/c102 0 2024-02-22T00:33:28.912 INFO:tasks.workunit.client.1.smithi161.stdout:3/762: link da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/cee da/dc/d11/d26/d80/dc7/d59/d93/cf5 0 2024-02-22T00:33:28.913 INFO:tasks.workunit.client.1.smithi161.stdout:3/763: readlink da/dc/d11/d26/l70 0 2024-02-22T00:33:28.914 INFO:tasks.workunit.client.1.smithi161.stdout:9/743: mknod d1/d25/d73/d60/d77/c103 0 2024-02-22T00:33:28.915 INFO:tasks.workunit.client.1.smithi161.stdout:3/764: read da/dc/d11/d26/f63 [1251526,82134] 0 2024-02-22T00:33:28.916 INFO:tasks.workunit.client.1.smithi161.stdout:9/744: mknod d1/d2/d4/d95/db8/c104 0 2024-02-22T00:33:28.917 INFO:tasks.workunit.client.1.smithi161.stdout:9/745: stat d1/d25/d73/d98/dec/f101 0 2024-02-22T00:33:28.917 INFO:tasks.workunit.client.1.smithi161.stdout:3/765: creat da/dc/d91/de7/ff6 x:0 0 0 2024-02-22T00:33:28.918 INFO:tasks.workunit.client.1.smithi161.stdout:9/746: truncate d1/d2/d4/d95/fde 220779 0 2024-02-22T00:33:28.919 INFO:tasks.workunit.client.1.smithi161.stdout:3/766: write da/dc/f2b [3878802,32175] 0 2024-02-22T00:33:28.919 INFO:tasks.workunit.client.1.smithi161.stdout:9/747: write d1/d2/f89 [1215266,95699] 0 2024-02-22T00:33:28.921 INFO:tasks.workunit.client.1.smithi161.stdout:3/767: write da/fb3 [2943139,8603] 0 2024-02-22T00:33:28.924 INFO:tasks.workunit.client.1.smithi161.stdout:9/748: rename d1/d2/d4/d95/db8/fdb to d1/d25/d73/d60/db0/f105 0 2024-02-22T00:33:28.925 INFO:tasks.workunit.client.1.smithi161.stdout:9/749: fdatasync d1/fd9 0 2024-02-22T00:33:28.925 INFO:tasks.workunit.client.1.smithi161.stdout:3/768: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/fb2 [1520063,79310] 0 2024-02-22T00:33:28.927 INFO:tasks.workunit.client.1.smithi161.stdout:3/769: stat da/dc/d11/d26/d80/dc7/d59/fbe 0 2024-02-22T00:33:28.927 INFO:tasks.workunit.client.1.smithi161.stdout:9/750: dread - d1/d5/d9/da5/dbc/f7d zero size 2024-02-22T00:33:28.927 INFO:tasks.workunit.client.1.smithi161.stdout:3/770: write da/fb3 [1487228,21867] 0 2024-02-22T00:33:28.931 INFO:tasks.workunit.client.1.smithi161.stdout:3/771: unlink da/dc/d11/d26/d80/dc7/f6a 0 2024-02-22T00:33:28.935 INFO:tasks.workunit.client.1.smithi161.stdout:9/751: link d1/d2/d7/lc6 d1/d25/dc4/d4f/l106 0 2024-02-22T00:33:28.936 INFO:tasks.workunit.client.1.smithi161.stdout:3/772: dwrite da/dc/d11/f28 [0,4194304] 0 2024-02-22T00:33:28.938 INFO:tasks.workunit.client.1.smithi161.stdout:3/773: write da/dc/d11/d26/d80/dc7/d59/f84 [4937688,29962] 0 2024-02-22T00:33:28.938 INFO:tasks.workunit.client.1.smithi161.stdout:9/752: creat d1/d5/d9/f107 x:0 0 0 2024-02-22T00:33:28.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/753: readlink d1/d2/d4/l53 0 2024-02-22T00:33:28.942 INFO:tasks.workunit.client.1.smithi161.stdout:9/754: mknod d1/d2/d4/d11/d21/c108 0 2024-02-22T00:33:28.946 INFO:tasks.workunit.client.1.smithi161.stdout:9/755: unlink d1/d2/c48 0 2024-02-22T00:33:28.948 INFO:tasks.workunit.client.1.smithi161.stdout:3/774: getdents da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37 0 2024-02-22T00:33:28.950 INFO:tasks.workunit.client.1.smithi161.stdout:3/775: symlink da/d29/d53/lf7 0 2024-02-22T00:33:28.952 INFO:tasks.workunit.client.1.smithi161.stdout:3/776: mkdir da/dc/d11/d26/d80/dc7/d60/dd7/df8 0 2024-02-22T00:33:28.954 INFO:tasks.workunit.client.1.smithi161.stdout:3/777: mkdir da/dc/d5f/d66/df9 0 2024-02-22T00:33:28.955 INFO:tasks.workunit.client.1.smithi161.stdout:3/778: chown da/d29/d53/l99 13936195 1 2024-02-22T00:33:28.960 INFO:tasks.workunit.client.1.smithi161.stdout:3/779: truncate da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f85 2120494 0 2024-02-22T00:33:28.960 INFO:tasks.workunit.client.1.smithi161.stdout:9/756: write d1/d2/f65 [3774248,34555] 0 2024-02-22T00:33:28.961 INFO:tasks.workunit.client.1.smithi161.stdout:3/780: readlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/l50 0 2024-02-22T00:33:28.962 INFO:tasks.workunit.client.1.smithi161.stdout:3/781: write da/dc/d91/de7/ff6 [598472,49937] 0 2024-02-22T00:33:28.969 INFO:tasks.workunit.client.1.smithi161.stdout:3/782: rename da/dc/d11/d26/c24 to da/dc/d5f/cfa 0 2024-02-22T00:33:28.971 INFO:tasks.workunit.client.1.smithi161.stdout:3/783: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f42 [980150,40626] 0 2024-02-22T00:33:28.971 INFO:tasks.workunit.client.1.smithi161.stdout:9/757: rmdir d1/d25/d73/d60/d77/d93 39 2024-02-22T00:33:28.975 INFO:tasks.workunit.client.1.smithi161.stdout:3/784: mkdir da/dc/d5f/d66/df9/dfb 0 2024-02-22T00:33:28.976 INFO:tasks.workunit.client.1.smithi161.stdout:9/758: truncate d1/d2/d4/f3b 433453 0 2024-02-22T00:33:28.977 INFO:tasks.workunit.client.1.smithi161.stdout:3/785: mkdir da/dc/d5f/dfc 0 2024-02-22T00:33:28.979 INFO:tasks.workunit.client.1.smithi161.stdout:9/759: mkdir d1/d5/d9/da5/d109 0 2024-02-22T00:33:28.979 INFO:tasks.workunit.client.1.smithi161.stdout:9/760: write d1/d2/d7/fd6 [635459,185] 0 2024-02-22T00:33:28.987 INFO:tasks.workunit.client.1.smithi161.stdout:7/795: sync 2024-02-22T00:33:28.987 INFO:tasks.workunit.client.1.smithi161.stdout:1/763: sync 2024-02-22T00:33:28.987 INFO:tasks.workunit.client.1.smithi161.stdout:6/729: sync 2024-02-22T00:33:28.987 INFO:tasks.workunit.client.1.smithi161.stdout:4/712: sync 2024-02-22T00:33:28.987 INFO:tasks.workunit.client.1.smithi161.stdout:0/776: sync 2024-02-22T00:33:28.987 INFO:tasks.workunit.client.1.smithi161.stdout:2/897: sync 2024-02-22T00:33:28.987 INFO:tasks.workunit.client.1.smithi161.stdout:8/803: sync 2024-02-22T00:33:28.988 INFO:tasks.workunit.client.1.smithi161.stdout:8/804: stat d1/d1c/ffb 0 2024-02-22T00:33:28.988 INFO:tasks.workunit.client.1.smithi161.stdout:1/764: read - d19/d1d/d2c/f105 zero size 2024-02-22T00:33:28.989 INFO:tasks.workunit.client.1.smithi161.stdout:7/796: mkdir d3/df/dfd 0 2024-02-22T00:33:28.998 INFO:tasks.workunit.client.1.smithi161.stdout:1/765: write d19/d48/f5c [2277390,102277] 0 2024-02-22T00:33:28.998 INFO:tasks.workunit.client.1.smithi161.stdout:0/777: creat d14/d1a/d3f/d96/dbc/dc5/f107 x:0 0 0 2024-02-22T00:33:28.998 INFO:tasks.workunit.client.1.smithi161.stdout:8/805: unlink d1/d2f/d37/dd7/fe9 0 2024-02-22T00:33:28.998 INFO:tasks.workunit.client.1.smithi161.stdout:6/730: rename d3/d10/d1b/da5/dc3 to d3/dc/df/d32/de5 0 2024-02-22T00:33:28.999 INFO:tasks.workunit.client.1.smithi161.stdout:4/713: truncate d5/d8/d41/d57/dbe/f77 4860459 0 2024-02-22T00:33:29.001 INFO:tasks.workunit.client.1.smithi161.stdout:1/766: write d19/d1d/d2c/fd7 [942775,52696] 0 2024-02-22T00:33:29.004 INFO:tasks.workunit.client.1.smithi161.stdout:8/806: unlink d1/d1c/d75/d18/cae 0 2024-02-22T00:33:29.005 INFO:tasks.workunit.client.1.smithi161.stdout:0/778: getdents d14/d101 0 2024-02-22T00:33:29.007 INFO:tasks.workunit.client.1.smithi161.stdout:4/714: creat d5/d8/d41/d57/dbe/f10b x:0 0 0 2024-02-22T00:33:29.008 INFO:tasks.workunit.client.1.smithi161.stdout:0/779: write d14/f19 [3325106,82368] 0 2024-02-22T00:33:29.008 INFO:tasks.workunit.client.1.smithi161.stdout:7/797: link d3/l20 d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/df8/lfe 0 2024-02-22T00:33:29.009 INFO:tasks.workunit.client.1.smithi161.stdout:8/807: symlink d1/d1c/d20/d22/dfe/l107 0 2024-02-22T00:33:29.012 INFO:tasks.workunit.client.1.smithi161.stdout:7/798: fdatasync d3/dbf/d64/f78 0 2024-02-22T00:33:29.012 INFO:tasks.workunit.client.1.smithi161.stdout:4/715: mknod d5/d10/d14/c10c 0 2024-02-22T00:33:29.013 INFO:tasks.workunit.client.1.smithi161.stdout:6/731: dwrite d3/d10/d12/d2f/d7d/d82/fe4 [0,4194304] 0 2024-02-22T00:33:29.013 INFO:tasks.workunit.client.1.smithi161.stdout:0/780: mkdir d14/d1a/d3f/d108 0 2024-02-22T00:33:29.013 INFO:tasks.workunit.client.1.smithi161.stdout:1/767: dwrite d19/d1d/f65 [0,4194304] 0 2024-02-22T00:33:29.016 INFO:tasks.workunit.client.1.smithi161.stdout:6/732: chown d3/d10/cdd 787527906 1 2024-02-22T00:33:29.020 INFO:tasks.workunit.client.1.smithi161.stdout:0/781: creat d14/d37/d42/da2/f109 x:0 0 0 2024-02-22T00:33:29.021 INFO:tasks.workunit.client.1.smithi161.stdout:0/782: chown d14/d37/d42/d73/dc7 259350761 1 2024-02-22T00:33:29.022 INFO:tasks.workunit.client.1.smithi161.stdout:7/799: dwrite d3/df/d33/d35/d55/d63/d7b/f70 [0,4194304] 0 2024-02-22T00:33:29.028 INFO:tasks.workunit.client.1.smithi161.stdout:6/733: mkdir d3/d10/d12/d2f/d7d/dab/dbe/de6 0 2024-02-22T00:33:29.029 INFO:tasks.workunit.client.1.smithi161.stdout:6/734: dread - d3/dc/df/d32/dd9/d87/fc2 zero size 2024-02-22T00:33:29.033 INFO:tasks.workunit.client.1.smithi161.stdout:8/808: creat d1/d1c/d20/d22/d28/d7f/d92/d95/f108 x:0 0 0 2024-02-22T00:33:29.034 INFO:tasks.workunit.client.1.smithi161.stdout:4/716: link d5/d8/d41/lac d5/d8/d41/d57/dbe/d28/d63/d65/dcd/l10d 0 2024-02-22T00:33:29.036 INFO:tasks.workunit.client.1.smithi161.stdout:0/783: link d14/f2c d14/d1a/d9d/dba/f10a 0 2024-02-22T00:33:29.038 INFO:tasks.workunit.client.1.smithi161.stdout:7/800: truncate d3/df/d33/d35/d55/d63/d7b/d50/f81 913542 0 2024-02-22T00:33:29.039 INFO:tasks.workunit.client.1.smithi161.stdout:6/735: mknod d3/d7c/dd1/ce7 0 2024-02-22T00:33:29.048 INFO:tasks.workunit.client.1.smithi161.stdout:4/717: dwrite d5/d8/d41/d57/dbe/ff5 [0,4194304] 0 2024-02-22T00:33:29.048 INFO:tasks.workunit.client.1.smithi161.stdout:7/801: readlink d3/l41 0 2024-02-22T00:33:29.049 INFO:tasks.workunit.client.1.smithi161.stdout:6/736: symlink d3/d10/d72/dc5/le8 0 2024-02-22T00:33:29.055 INFO:tasks.workunit.client.1.smithi161.stdout:0/784: dwrite d14/d37/d42/d73/fab [0,4194304] 0 2024-02-22T00:33:29.060 INFO:tasks.workunit.client.1.smithi161.stdout:1/768: dwrite d19/d1d/d2c/d2d/f40 [0,4194304] 0 2024-02-22T00:33:29.062 INFO:tasks.workunit.client.1.smithi161.stdout:7/802: mkdir d3/df/d33/dff 0 2024-02-22T00:33:29.066 INFO:tasks.workunit.client.1.smithi161.stdout:6/737: dwrite d3/d30/f74 [0,4194304] 0 2024-02-22T00:33:29.067 INFO:tasks.workunit.client.1.smithi161.stdout:0/785: dread d14/d1a/d3f/f5b [0,4194304] 0 2024-02-22T00:33:29.069 INFO:tasks.workunit.client.1.smithi161.stdout:6/738: chown d3/d10/d12/d2f/d7d/d5f/c63 5692 1 2024-02-22T00:33:29.071 INFO:tasks.workunit.client.1.smithi161.stdout:7/803: dread - d3/df/d33/d35/d55/d63/d7b/de5/ff7 zero size 2024-02-22T00:33:29.071 INFO:tasks.workunit.client.1.smithi161.stdout:0/786: read d14/f25 [1318718,124758] 0 2024-02-22T00:33:29.072 INFO:tasks.workunit.client.1.smithi161.stdout:0/787: write d14/d29/f7a [1232365,23481] 0 2024-02-22T00:33:29.073 INFO:tasks.workunit.client.1.smithi161.stdout:6/739: dread - d3/d10/d12/d2f/d7d/d5f/fb1 zero size 2024-02-22T00:33:29.076 INFO:tasks.workunit.client.1.smithi161.stdout:6/740: chown d3/dc/df/d32/dd9/d87 78664905 1 2024-02-22T00:33:29.103 INFO:tasks.workunit.client.1.smithi161.stdout:5/942: sync 2024-02-22T00:33:29.120 INFO:tasks.workunit.client.1.smithi161.stdout:4/718: write d5/d8/d41/fa3 [3383369,54266] 0 2024-02-22T00:33:29.122 INFO:tasks.workunit.client.1.smithi161.stdout:7/804: dwrite d3/df/d43/fb3 [0,4194304] 0 2024-02-22T00:33:29.122 INFO:tasks.workunit.client.1.smithi161.stdout:5/943: read - d3/d1c/fbc zero size 2024-02-22T00:33:29.125 INFO:tasks.workunit.client.1.smithi161.stdout:4/719: mkdir d5/d10/d10e 0 2024-02-22T00:33:29.126 INFO:tasks.workunit.client.1.smithi161.stdout:6/741: creat d3/d10/d12/d2f/d7d/d97/ddc/fe9 x:0 0 0 2024-02-22T00:33:29.126 INFO:tasks.workunit.client.1.smithi161.stdout:0/788: dwrite d14/d37/d42/d73/f91 [0,4194304] 0 2024-02-22T00:33:29.128 INFO:tasks.workunit.client.1.smithi161.stdout:5/944: creat d3/d1b/d25/d4c/dd2/f146 x:0 0 0 2024-02-22T00:33:29.130 INFO:tasks.workunit.client.1.smithi161.stdout:4/720: mknod d5/d8/d41/d57/c10f 0 2024-02-22T00:33:29.131 INFO:tasks.workunit.client.1.smithi161.stdout:6/742: unlink d3/d10/d1b/l79 0 2024-02-22T00:33:29.133 INFO:tasks.workunit.client.1.smithi161.stdout:0/789: mkdir d14/d37/d10b 0 2024-02-22T00:33:29.134 INFO:tasks.workunit.client.1.smithi161.stdout:7/805: rename d3/df/d33/d35/d55/d63/d7b/d8f/dd2/de2 to d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100 0 2024-02-22T00:33:29.136 INFO:tasks.workunit.client.1.smithi161.stdout:6/743: creat d3/d7c/dd1/fea x:0 0 0 2024-02-22T00:33:29.138 INFO:tasks.workunit.client.1.smithi161.stdout:0/790: mkdir d14/d1a/d3f/d108/d10c 0 2024-02-22T00:33:29.139 INFO:tasks.workunit.client.1.smithi161.stdout:4/721: creat d5/d8/d41/d57/dbe/d28/f110 x:0 0 0 2024-02-22T00:33:29.139 INFO:tasks.workunit.client.1.smithi161.stdout:6/744: write d3/d10/d12/d2f/d7d/d97/ddc/fe9 [511692,60357] 0 2024-02-22T00:33:29.140 INFO:tasks.workunit.client.1.smithi161.stdout:7/806: rename d3/dd/d59/fb8 to d3/df/d33/d35/d55/d63/d7b/de5/f101 0 2024-02-22T00:33:29.142 INFO:tasks.workunit.client.1.smithi161.stdout:4/722: write d5/d10/d14/d4f/fc5 [995998,78710] 0 2024-02-22T00:33:29.143 INFO:tasks.workunit.client.1.smithi161.stdout:0/791: truncate d14/d37/d42/fb2 318908 0 2024-02-22T00:33:29.145 INFO:tasks.workunit.client.1.smithi161.stdout:7/807: creat d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc/f102 x:0 0 0 2024-02-22T00:33:29.145 INFO:tasks.workunit.client.1.smithi161.stdout:0/792: dread - d14/d37/d42/d8e/fa4 zero size 2024-02-22T00:33:29.148 INFO:tasks.workunit.client.1.smithi161.stdout:0/793: symlink d14/d44/dbf/l10d 0 2024-02-22T00:33:29.148 INFO:tasks.workunit.client.1.smithi161.stdout:6/745: rmdir d3/d10/d12/d2f/d7d/d97/ddc 39 2024-02-22T00:33:29.149 INFO:tasks.workunit.client.1.smithi161.stdout:6/746: fdatasync d3/d10/f65 0 2024-02-22T00:33:29.149 INFO:tasks.workunit.client.1.smithi161.stdout:4/723: link d5/d8/d41/d57/dbe/f88 d5/f111 0 2024-02-22T00:33:29.150 INFO:tasks.workunit.client.1.smithi161.stdout:7/808: dread d3/df/d33/d35/fa4 [0,4194304] 0 2024-02-22T00:33:29.152 INFO:tasks.workunit.client.1.smithi161.stdout:6/747: mknod d3/dc/df/d32/ceb 0 2024-02-22T00:33:29.154 INFO:tasks.workunit.client.1.smithi161.stdout:7/809: truncate d3/df/d33/d53/ffc 637993 0 2024-02-22T00:33:29.155 INFO:tasks.workunit.client.1.smithi161.stdout:5/945: truncate d3/d1b/d36/f83 6175667 0 2024-02-22T00:33:29.157 INFO:tasks.workunit.client.1.smithi161.stdout:4/724: dwrite d5/d8/d41/d57/dbe/d28/fe9 [0,4194304] 0 2024-02-22T00:33:29.158 INFO:tasks.workunit.client.1.smithi161.stdout:6/748: symlink d3/d10/d12/d3a/lec 0 2024-02-22T00:33:29.159 INFO:tasks.workunit.client.1.smithi161.stdout:7/810: unlink d3/df/dba/ff4 0 2024-02-22T00:33:29.160 INFO:tasks.workunit.client.1.smithi161.stdout:7/811: stat d3/df/d33/d74/df2 0 2024-02-22T00:33:29.162 INFO:tasks.workunit.client.1.smithi161.stdout:5/946: creat d3/d1b/d8f/f147 x:0 0 0 2024-02-22T00:33:29.162 INFO:tasks.workunit.client.1.smithi161.stdout:6/749: mknod d3/d10/d72/dc5/ced 0 2024-02-22T00:33:29.163 INFO:tasks.workunit.client.1.smithi161.stdout:4/725: write d5/d10/f4d [2163835,9939] 0 2024-02-22T00:33:29.166 INFO:tasks.workunit.client.1.smithi161.stdout:4/726: readlink d5/d8/d41/d57/dbe/d28/d63/d6b/lc1 0 2024-02-22T00:33:29.168 INFO:tasks.workunit.client.1.smithi161.stdout:6/750: rmdir d3/d10/d12/d2f/d7d/d97 39 2024-02-22T00:33:29.171 INFO:tasks.workunit.client.1.smithi161.stdout:6/751: symlink d3/d30/db4/lee 0 2024-02-22T00:33:29.172 INFO:tasks.workunit.client.1.smithi161.stdout:4/727: rmdir d5/d8/d41/d57/dd6 0 2024-02-22T00:33:29.173 INFO:tasks.workunit.client.1.smithi161.stdout:5/947: dread d3/d1c/d20/f5b [0,4194304] 0 2024-02-22T00:33:29.177 INFO:tasks.workunit.client.1.smithi161.stdout:6/752: mkdir d3/def 0 2024-02-22T00:33:29.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:27.388079+0000 mgr.smithi161.sazlam (mgr.24369) 36 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:33:29.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:27.537000+0000 mgr.smithi161.sazlam (mgr.24369) 37 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:33:29.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:27.758588+0000 mgr.smithi161.sazlam (mgr.24369) 38 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 54 MiB/s rd, 200 MiB/s wr, 537 op/s 2024-02-22T00:33:29.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:27.902105+0000 mgr.smithi161.sazlam (mgr.24369) 39 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:27.911867+0000 mgr.smithi161.sazlam (mgr.24369) 40 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.287484+0000 mon.smithi049 (mon.0) 692 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.299322+0000 mon.smithi049 (mon.0) 693 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.324137+0000 mon.smithi049 (mon.0) 694 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.331200+0000 mon.smithi049 (mon.0) 695 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.339778+0000 mon.smithi049 (mon.0) 696 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.482447+0000 mon.smithi049 (mon.0) 697 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.487858+0000 mon.smithi049 (mon.0) 698 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.498037+0000 mon.smithi049 (mon.0) 699 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:28.508334+0000 mon.smithi049 (mon.0) 700 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.180 INFO:tasks.workunit.client.1.smithi161.stdout:5/948: mkdir d3/d1b/d25/d4c/d148 0 2024-02-22T00:33:29.180 INFO:tasks.workunit.client.1.smithi161.stdout:6/753: read d3/d10/d1b/f47 [95532,84165] 0 2024-02-22T00:33:29.180 INFO:tasks.workunit.client.1.smithi161.stdout:4/728: creat d5/d10/d14/f112 x:0 0 0 2024-02-22T00:33:29.181 INFO:tasks.workunit.client.1.smithi161.stdout:7/812: dread d3/f37 [0,4194304] 0 2024-02-22T00:33:29.182 INFO:tasks.workunit.client.1.smithi161.stdout:5/949: write d3/d1c/d67/d113/f132 [4097644,101680] 0 2024-02-22T00:33:29.183 INFO:tasks.workunit.client.1.smithi161.stdout:7/813: truncate d3/df/d43/faa 4226392 0 2024-02-22T00:33:29.184 INFO:tasks.workunit.client.1.smithi161.stdout:4/729: creat d5/d8/d41/d53/d6c/dd8/f113 x:0 0 0 2024-02-22T00:33:29.185 INFO:tasks.workunit.client.1.smithi161.stdout:6/754: rename d3/d10/d12/f36 to d3/d10/d12/d2f/d7d/dab/dbe/ff0 0 2024-02-22T00:33:29.186 INFO:tasks.workunit.client.1.smithi161.stdout:7/814: stat d3/df/d33/d35/d55/d63/d7b/d50/lf6 0 2024-02-22T00:33:29.188 INFO:tasks.workunit.client.1.smithi161.stdout:4/730: mknod d5/d10/c114 0 2024-02-22T00:33:29.190 INFO:tasks.workunit.client.1.smithi161.stdout:5/950: dwrite d3/d1c/d67/f117 [0,4194304] 0 2024-02-22T00:33:29.194 INFO:tasks.workunit.client.1.smithi161.stdout:5/951: write d3/d29/d80/d92/f108 [337227,128031] 0 2024-02-22T00:33:29.196 INFO:tasks.workunit.client.1.smithi161.stdout:6/755: dwrite d3/d10/d12/f2d [0,4194304] 0 2024-02-22T00:33:29.197 INFO:tasks.workunit.client.1.smithi161.stdout:5/952: chown d3/d29/l3c 227131 1 2024-02-22T00:33:29.241 INFO:tasks.workunit.client.1.smithi161.stdout:3/786: sync 2024-02-22T00:33:29.241 INFO:tasks.workunit.client.1.smithi161.stdout:9/761: sync 2024-02-22T00:33:29.242 INFO:tasks.workunit.client.1.smithi161.stdout:7/815: dwrite d3/df/d33/d35/fa4 [0,4194304] 0 2024-02-22T00:33:29.246 INFO:tasks.workunit.client.1.smithi161.stdout:5/953: creat d3/d29/f149 x:0 0 0 2024-02-22T00:33:29.250 INFO:tasks.workunit.client.1.smithi161.stdout:9/762: truncate d1/d25/d73/d60/f9d 357991 0 2024-02-22T00:33:29.252 INFO:tasks.workunit.client.1.smithi161.stdout:6/756: creat d3/d10/d12/d2f/d7d/d97/ff1 x:0 0 0 2024-02-22T00:33:29.253 INFO:tasks.workunit.client.1.smithi161.stdout:7/816: rename d3/df/d33/d35/l31 to d3/df/d33/d35/d55/d63/d7b/d30/d44/l103 0 2024-02-22T00:33:29.255 INFO:tasks.workunit.client.1.smithi161.stdout:3/787: truncate da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/f49 3408292 0 2024-02-22T00:33:29.256 INFO:tasks.workunit.client.1.smithi161.stdout:7/817: write d3/df/d33/d35/d55/de4/f4e [505537,46675] 0 2024-02-22T00:33:29.256 INFO:tasks.workunit.client.1.smithi161.stdout:6/757: readlink d3/d10/d12/d3a/l7e 0 2024-02-22T00:33:29.258 INFO:tasks.workunit.client.1.smithi161.stdout:9/763: creat d1/d5/f10a x:0 0 0 2024-02-22T00:33:29.259 INFO:tasks.workunit.client.1.smithi161.stdout:5/954: getdents d3/d1b/d25/d4c/dcb 0 2024-02-22T00:33:29.259 INFO:tasks.workunit.client.1.smithi161.stdout:4/731: dread d5/d17/f93 [0,4194304] 0 2024-02-22T00:33:29.259 INFO:tasks.workunit.client.1.smithi161.stdout:6/758: stat d3/d10/d12/d2f/d7d/d5f/l71 0 2024-02-22T00:33:29.261 INFO:tasks.workunit.client.1.smithi161.stdout:7/818: mknod d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100/c104 0 2024-02-22T00:33:29.262 INFO:tasks.workunit.client.1.smithi161.stdout:5/955: stat d3/d1b/d25/d4c/d7b/ld0 0 2024-02-22T00:33:29.264 INFO:tasks.workunit.client.1.smithi161.stdout:7/819: truncate d3/dd/fde 78482 0 2024-02-22T00:33:29.267 INFO:tasks.workunit.client.1.smithi161.stdout:6/759: dread d3/d10/f65 [0,4194304] 0 2024-02-22T00:33:29.267 INFO:tasks.workunit.client.1.smithi161.stdout:5/956: mknod d3/d1c/d67/c14a 0 2024-02-22T00:33:29.268 INFO:tasks.workunit.client.1.smithi161.stdout:5/957: dread - d3/d1c/d62/f115 zero size 2024-02-22T00:33:29.270 INFO:tasks.workunit.client.1.smithi161.stdout:7/820: fdatasync d3/f73 0 2024-02-22T00:33:29.271 INFO:tasks.workunit.client.1.smithi161.stdout:4/732: symlink d5/d8/d41/d57/dbe/d28/d63/l115 0 2024-02-22T00:33:29.272 INFO:tasks.workunit.client.1.smithi161.stdout:3/788: link da/dc/d11/d26/f19 da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/ffd 0 2024-02-22T00:33:29.273 INFO:tasks.workunit.client.1.smithi161.stdout:4/733: dread - d5/d8/d41/d53/d6c/d91/f101 zero size 2024-02-22T00:33:29.275 INFO:tasks.workunit.client.1.smithi161.stdout:9/764: dwrite d1/d2/d7/da/fa0 [0,4194304] 0 2024-02-22T00:33:29.276 INFO:tasks.workunit.client.1.smithi161.stdout:5/958: rename d3/d29/f4a to d3/d1c/d20/d116/f14b 0 2024-02-22T00:33:29.277 INFO:tasks.workunit.client.1.smithi161.stdout:6/760: link d3/d10/d12/d3a/cb2 d3/d10/d12/d2f/d7d/dab/cf2 0 2024-02-22T00:33:29.278 INFO:tasks.workunit.client.1.smithi161.stdout:5/959: chown d3/d1c/d62/f94 121 1 2024-02-22T00:33:29.278 INFO:tasks.workunit.client.1.smithi161.stdout:9/765: chown d1/d2/d4/d11/ca6 919 1 2024-02-22T00:33:29.279 INFO:tasks.workunit.client.1.smithi161.stdout:7/821: mknod d3/df/d33/d35/d55/d63/d7b/c105 0 2024-02-22T00:33:29.279 INFO:tasks.workunit.client.1.smithi161.stdout:9/766: fdatasync d1/d2/d7/f91 0 2024-02-22T00:33:29.280 INFO:tasks.workunit.client.1.smithi161.stdout:4/734: mkdir d5/d10/d75/d116 0 2024-02-22T00:33:29.283 INFO:tasks.workunit.client.1.smithi161.stdout:5/960: dread d3/d1c/d67/f117 [0,4194304] 0 2024-02-22T00:33:29.284 INFO:tasks.workunit.client.1.smithi161.stdout:3/789: rename da/dc/d91/de7 to da/dc/d11/d26/d80/dc7/dfe 0 2024-02-22T00:33:29.285 INFO:tasks.workunit.client.1.smithi161.stdout:6/761: symlink d3/dc/df/lf3 0 2024-02-22T00:33:29.286 INFO:tasks.workunit.client.1.smithi161.stdout:9/767: dwrite d1/fd9 [0,4194304] 0 2024-02-22T00:33:29.287 INFO:tasks.workunit.client.1.smithi161.stdout:2/898: sync 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:27.388079+0000 mgr.smithi161.sazlam (mgr.24369) 36 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:27.537000+0000 mgr.smithi161.sazlam (mgr.24369) 37 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:27.758588+0000 mgr.smithi161.sazlam (mgr.24369) 38 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 54 MiB/s rd, 200 MiB/s wr, 537 op/s 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:27.902105+0000 mgr.smithi161.sazlam (mgr.24369) 39 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:27.911867+0000 mgr.smithi161.sazlam (mgr.24369) 40 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.287484+0000 mon.smithi049 (mon.0) 692 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.299322+0000 mon.smithi049 (mon.0) 693 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.324137+0000 mon.smithi049 (mon.0) 694 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.331200+0000 mon.smithi049 (mon.0) 695 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.339778+0000 mon.smithi049 (mon.0) 696 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.482447+0000 mon.smithi049 (mon.0) 697 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.487858+0000 mon.smithi049 (mon.0) 698 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.498037+0000 mon.smithi049 (mon.0) 699 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:28.508334+0000 mon.smithi049 (mon.0) 700 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:33:29.295 INFO:tasks.workunit.client.1.smithi161.stdout:9/768: fsync d1/d2/d4/d11/f28 0 2024-02-22T00:33:29.295 INFO:tasks.workunit.client.1.smithi161.stdout:4/735: fdatasync d5/f13 0 2024-02-22T00:33:29.296 INFO:tasks.workunit.client.1.smithi161.stdout:5/961: dwrite d3/d1b/d25/db5/dca/fd6 [0,4194304] 0 2024-02-22T00:33:29.300 INFO:tasks.workunit.client.1.smithi161.stdout:7/822: creat d3/df/f106 x:0 0 0 2024-02-22T00:33:29.301 INFO:tasks.workunit.client.1.smithi161.stdout:2/899: mkdir de/d139 0 2024-02-22T00:33:29.301 INFO:tasks.workunit.client.1.smithi161.stdout:5/962: read - d3/d1b/d8f/fc6 zero size 2024-02-22T00:33:29.301 INFO:tasks.workunit.client.1.smithi161.stdout:3/790: dread da/d29/f54 [0,4194304] 0 2024-02-22T00:33:29.301 INFO:tasks.workunit.client.1.smithi161.stdout:4/736: fsync d5/d17/f4a 0 2024-02-22T00:33:29.303 INFO:tasks.workunit.client.1.smithi161.stdout:6/762: getdents d3/d10/d12/d2f/d7d/dab 0 2024-02-22T00:33:29.303 INFO:tasks.workunit.client.1.smithi161.stdout:5/963: read d3/d29/d80/d92/f11b [7273473,73435] 0 2024-02-22T00:33:29.304 INFO:tasks.workunit.client.1.smithi161.stdout:7/823: rmdir d3/dbf/d64 39 2024-02-22T00:33:29.305 INFO:tasks.workunit.client.1.smithi161.stdout:9/769: mkdir d1/d2/d4/d1f/dab/dcd/d10b 0 2024-02-22T00:33:29.305 INFO:tasks.workunit.client.1.smithi161.stdout:5/964: fdatasync d3/f72 0 2024-02-22T00:33:29.308 INFO:tasks.workunit.client.1.smithi161.stdout:5/965: chown d3/dac/c104 310 1 2024-02-22T00:33:29.308 INFO:tasks.workunit.client.1.smithi161.stdout:9/770: read d1/d5/f36 [3043863,76196] 0 2024-02-22T00:33:29.309 INFO:tasks.workunit.client.1.smithi161.stdout:6/763: rmdir d3/daf 39 2024-02-22T00:33:29.309 INFO:tasks.workunit.client.1.smithi161.stdout:2/900: dwrite de/d2b/f98 [0,4194304] 0 2024-02-22T00:33:29.313 INFO:tasks.workunit.client.1.smithi161.stdout:7/824: mkdir d3/df/d33/dbc/dc5/d107 0 2024-02-22T00:33:29.314 INFO:tasks.workunit.client.1.smithi161.stdout:7/825: fdatasync d3/df/d43/fb3 0 2024-02-22T00:33:29.316 INFO:tasks.workunit.client.1.smithi161.stdout:7/826: read d3/dd/ff1 [131469,32758] 0 2024-02-22T00:33:29.317 INFO:tasks.workunit.client.1.smithi161.stdout:3/791: rename da/dc/d11/d26/d80/dc7/d60/dd7 to da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff 0 2024-02-22T00:33:29.319 INFO:tasks.workunit.client.1.smithi161.stdout:9/771: mkdir d1/d2/d4/d95/db8/d10c 0 2024-02-22T00:33:29.322 INFO:tasks.workunit.client.1.smithi161.stdout:5/966: symlink d3/d1b/d25/d4c/d148/l14c 0 2024-02-22T00:33:29.324 INFO:tasks.workunit.client.1.smithi161.stdout:6/764: creat d3/daf/ff4 x:0 0 0 2024-02-22T00:33:29.326 INFO:tasks.workunit.client.1.smithi161.stdout:3/792: mkdir da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff/d100 0 2024-02-22T00:33:29.328 INFO:tasks.workunit.client.1.smithi161.stdout:4/737: creat d5/d10/d14/f117 x:0 0 0 2024-02-22T00:33:29.330 INFO:tasks.workunit.client.1.smithi161.stdout:6/765: dwrite d3/d10/d12/d3a/f68 [0,4194304] 0 2024-02-22T00:33:29.330 INFO:tasks.workunit.client.1.smithi161.stdout:9/772: creat d1/d5/d9/f10d x:0 0 0 2024-02-22T00:33:29.331 INFO:tasks.workunit.client.1.smithi161.stdout:9/773: fsync d1/d2/d7/fd6 0 2024-02-22T00:33:29.331 INFO:tasks.workunit.client.1.smithi161.stdout:7/827: mknod d3/df/dfd/c108 0 2024-02-22T00:33:29.334 INFO:tasks.workunit.client.1.smithi161.stdout:9/774: dread - d1/d2/d4/d1f/dab/dcd/fee zero size 2024-02-22T00:33:29.334 INFO:tasks.workunit.client.1.smithi161.stdout:5/967: mkdir d3/d1c/d20/d14d 0 2024-02-22T00:33:29.334 INFO:tasks.workunit.client.1.smithi161.stdout:5/968: write d3/d29/d80/d92/f108 [600945,39487] 0 2024-02-22T00:33:29.335 INFO:tasks.workunit.client.1.smithi161.stdout:6/766: chown d3/d10/d72/ce0 353 1 2024-02-22T00:33:29.336 INFO:tasks.workunit.client.1.smithi161.stdout:5/969: truncate d3/d9c/f110 587363 0 2024-02-22T00:33:29.338 INFO:tasks.workunit.client.1.smithi161.stdout:2/901: rename de/d2b/d8b/da2/da5/daf/c129 to de/d2b/d8b/da2/da5/dc4/c13a 0 2024-02-22T00:33:29.342 INFO:tasks.workunit.client.1.smithi161.stdout:4/738: mkdir d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118 0 2024-02-22T00:33:29.346 INFO:tasks.workunit.client.1.smithi161.stdout:7/828: rename d3/df/d33/d53/fed to d3/dbf/dab/f109 0 2024-02-22T00:33:29.346 INFO:tasks.workunit.client.1.smithi161.stdout:3/793: write da/d29/fdf [4171530,22861] 0 2024-02-22T00:33:29.346 INFO:tasks.workunit.client.1.smithi161.stdout:1/769: sync 2024-02-22T00:33:29.346 INFO:tasks.workunit.client.1.smithi161.stdout:8/809: sync 2024-02-22T00:33:29.348 INFO:tasks.workunit.client.1.smithi161.stdout:2/902: creat de/d2b/d8b/da2/da5/f13b x:0 0 0 2024-02-22T00:33:29.350 INFO:tasks.workunit.client.1.smithi161.stdout:5/970: symlink d3/d1b/d118/l14e 0 2024-02-22T00:33:29.350 INFO:tasks.workunit.client.1.smithi161.stdout:9/775: write d1/d2/d7/da/f13 [1562064,7504] 0 2024-02-22T00:33:29.395 INFO:tasks.workunit.client.1.smithi161.stdout:1/770: creat d19/d1d/d2c/d2d/db7/f110 x:0 0 0 2024-02-22T00:33:29.396 INFO:tasks.workunit.client.1.smithi161.stdout:9/776: chown d1/d25/d73/d60/d77 16530256 1 2024-02-22T00:33:29.396 INFO:tasks.workunit.client.1.smithi161.stdout:4/739: creat d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/f119 x:0 0 0 2024-02-22T00:33:29.399 INFO:tasks.workunit.client.1.smithi161.stdout:6/767: truncate d3/d10/d1b/da5/f5c 2817203 0 2024-02-22T00:33:29.401 INFO:tasks.workunit.client.1.smithi161.stdout:3/794: creat da/dc/d5f/d66/f101 x:0 0 0 2024-02-22T00:33:29.403 INFO:tasks.workunit.client.1.smithi161.stdout:8/810: dwrite d1/d1c/d20/d22/d28/d7f/db4/fff [0,4194304] 0 2024-02-22T00:33:29.405 INFO:tasks.workunit.client.1.smithi161.stdout:2/903: dwrite de/d2b/d8b/ddc/d125/d60/d68/f6c [0,4194304] 0 2024-02-22T00:33:29.405 INFO:tasks.workunit.client.1.smithi161.stdout:4/740: dread - d5/d10/da9/fd0 zero size 2024-02-22T00:33:29.409 INFO:tasks.workunit.client.1.smithi161.stdout:1/771: mknod d19/d51/d64/d9b/da5/dbc/df8/c111 0 2024-02-22T00:33:29.409 INFO:tasks.workunit.client.1.smithi161.stdout:5/971: dwrite d3/d1c/d20/f12 [0,4194304] 0 2024-02-22T00:33:29.412 INFO:tasks.workunit.client.1.smithi161.stdout:3/795: write da/dc/d11/d26/d80/dc7/d59/d93/fde [659644,25635] 0 2024-02-22T00:33:29.414 INFO:tasks.workunit.client.1.smithi161.stdout:9/777: rename d1/d25/dc4/d4f/da3/leb to d1/d2/d4/d11/d21/l10e 0 2024-02-22T00:33:29.414 INFO:tasks.workunit.client.1.smithi161.stdout:1/772: write d19/d51/d6c/dd4/fbe [3659465,31179] 0 2024-02-22T00:33:29.415 INFO:tasks.workunit.client.1.smithi161.stdout:5/972: mkdir d3/d1b/d36/d88/d14f 0 2024-02-22T00:33:29.417 INFO:tasks.workunit.client.1.smithi161.stdout:3/796: readlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/l50 0 2024-02-22T00:33:29.418 INFO:tasks.workunit.client.1.smithi161.stdout:6/768: creat d3/ff5 x:0 0 0 2024-02-22T00:33:29.418 INFO:tasks.workunit.client.1.smithi161.stdout:4/741: mknod d5/d10/c11a 0 2024-02-22T00:33:29.419 INFO:tasks.workunit.client.1.smithi161.stdout:4/742: readlink d5/d8/l19 0 2024-02-22T00:33:29.420 INFO:tasks.workunit.client.1.smithi161.stdout:6/769: write d3/d10/f55 [9028971,78823] 0 2024-02-22T00:33:29.422 INFO:tasks.workunit.client.1.smithi161.stdout:8/811: rename d1/d2f/d30 to d1/d1c/d20/d22/d28/d7f/d109 0 2024-02-22T00:33:29.423 INFO:tasks.workunit.client.1.smithi161.stdout:1/773: write d19/d48/f5a [2098698,11192] 0 2024-02-22T00:33:29.425 INFO:tasks.workunit.client.1.smithi161.stdout:9/778: mknod d1/d2/d4/d11/d21/c10f 0 2024-02-22T00:33:29.425 INFO:tasks.workunit.client.1.smithi161.stdout:5/973: symlink d3/d1b/d8f/dfb/l150 0 2024-02-22T00:33:29.426 INFO:tasks.workunit.client.1.smithi161.stdout:6/770: dread d3/d10/d12/d3a/f68 [0,4194304] 0 2024-02-22T00:33:29.427 INFO:tasks.workunit.client.1.smithi161.stdout:9/779: write d1/d25/dc4/d4f/da3/ff0 [765370,122161] 0 2024-02-22T00:33:29.428 INFO:tasks.workunit.client.1.smithi161.stdout:3/797: creat da/dc/d11/d26/d80/dc7/dfe/f102 x:0 0 0 2024-02-22T00:33:29.429 INFO:tasks.workunit.client.1.smithi161.stdout:4/743: rmdir d5/d8/d41/d57/dbe/d28/d38 39 2024-02-22T00:33:29.430 INFO:tasks.workunit.client.1.smithi161.stdout:6/771: chown d3/dc/df/d32/dd9/d87/fc2 146507641 1 2024-02-22T00:33:29.431 INFO:tasks.workunit.client.1.smithi161.stdout:9/780: read d1/d2/d4/d11/f1c [4050649,127187] 0 2024-02-22T00:33:29.431 INFO:tasks.workunit.client.1.smithi161.stdout:6/772: fsync d3/d10/d72/fa2 0 2024-02-22T00:33:29.433 INFO:tasks.workunit.client.1.smithi161.stdout:6/773: chown d3/c8f 3 1 2024-02-22T00:33:29.433 INFO:tasks.workunit.client.1.smithi161.stdout:8/812: fsync d1/d2f/fea 0 2024-02-22T00:33:29.436 INFO:tasks.workunit.client.1.smithi161.stdout:4/744: fdatasync d5/d10/d14/f5d 0 2024-02-22T00:33:29.436 INFO:tasks.workunit.client.1.smithi161.stdout:9/781: write d1/d2/d7/da/f8e [4094641,47102] 0 2024-02-22T00:33:29.437 INFO:tasks.workunit.client.1.smithi161.stdout:6/774: chown d3/d10/d1b/l86 7201229 1 2024-02-22T00:33:29.444 INFO:tasks.workunit.client.1.smithi161.stdout:1/774: mkdir d19/d112 0 2024-02-22T00:33:29.444 INFO:tasks.workunit.client.1.smithi161.stdout:5/974: mkdir d3/d29/d80/d92/df7/dae/dbe/d13b/d151 0 2024-02-22T00:33:29.444 INFO:tasks.workunit.client.1.smithi161.stdout:3/798: dwrite da/d29/d53/dc1/fdc [0,4194304] 0 2024-02-22T00:33:29.446 INFO:tasks.workunit.client.1.smithi161.stdout:2/904: rename de/d2b/d8b/ddc/d125/dd6/d132 to de/d13c 0 2024-02-22T00:33:29.447 INFO:tasks.workunit.client.1.smithi161.stdout:0/794: sync 2024-02-22T00:33:29.448 INFO:tasks.workunit.client.1.smithi161.stdout:6/775: symlink d3/dc/df/d32/dd9/lf6 0 2024-02-22T00:33:29.449 INFO:tasks.workunit.client.1.smithi161.stdout:9/782: write d1/d25/d73/d60/f92 [1903709,99718] 0 2024-02-22T00:33:29.450 INFO:tasks.workunit.client.1.smithi161.stdout:8/813: dwrite d1/d1c/d96/fc7 [0,4194304] 0 2024-02-22T00:33:29.453 INFO:tasks.workunit.client.1.smithi161.stdout:3/799: rmdir da/d29 39 2024-02-22T00:33:29.456 INFO:tasks.workunit.client.1.smithi161.stdout:6/776: chown d3/d10/d12/d3a/f6c 86 1 2024-02-22T00:33:29.457 INFO:tasks.workunit.client.1.smithi161.stdout:0/795: symlink d14/d1a/d3f/d96/dbc/dc5/l10e 0 2024-02-22T00:33:29.459 INFO:tasks.workunit.client.1.smithi161.stdout:4/745: dread d5/f7 [0,4194304] 0 2024-02-22T00:33:29.464 INFO:tasks.workunit.client.1.smithi161.stdout:1/775: getdents d19/d1d/d2c/d7d 0 2024-02-22T00:33:29.466 INFO:tasks.workunit.client.1.smithi161.stdout:1/776: rmdir d19/d90 39 2024-02-22T00:33:29.470 INFO:tasks.workunit.client.1.smithi161.stdout:1/777: readlink d19/l1c 0 2024-02-22T00:33:29.472 INFO:tasks.workunit.client.1.smithi161.stdout:5/975: dwrite d3/d1b/d36/dc1/fef [0,4194304] 0 2024-02-22T00:33:29.484 INFO:tasks.workunit.client.1.smithi161.stdout:2/905: dwrite de/d2b/f5b [0,4194304] 0 2024-02-22T00:33:29.485 INFO:tasks.workunit.client.1.smithi161.stdout:1/778: symlink d19/d1d/l113 0 2024-02-22T00:33:29.486 INFO:tasks.workunit.client.1.smithi161.stdout:9/783: dread d1/d2/d4/d1f/f35 [0,4194304] 0 2024-02-22T00:33:29.490 INFO:tasks.workunit.client.1.smithi161.stdout:1/779: chown d19/d51 2123 1 2024-02-22T00:33:29.490 INFO:tasks.workunit.client.1.smithi161.stdout:4/746: dwrite d5/d17/fd3 [0,4194304] 0 2024-02-22T00:33:29.491 INFO:tasks.workunit.client.1.smithi161.stdout:6/777: dwrite d3/dc/df/d32/dd9/fb7 [0,4194304] 0 2024-02-22T00:33:29.498 INFO:tasks.workunit.client.1.smithi161.stdout:9/784: fdatasync d1/d2/d4/d1f/dab/ffc 0 2024-02-22T00:33:29.498 INFO:tasks.workunit.client.1.smithi161.stdout:3/800: dwrite da/dc/d11/d26/d80/dc7/d59/f9d [0,4194304] 0 2024-02-22T00:33:29.504 INFO:tasks.workunit.client.1.smithi161.stdout:2/906: rename de/d2b/d83/f8e to de/d139/f13d 0 2024-02-22T00:33:29.505 INFO:tasks.workunit.client.1.smithi161.stdout:4/747: symlink d5/d8/d41/d53/d6c/d72/dfb/l11b 0 2024-02-22T00:33:29.506 INFO:tasks.workunit.client.1.smithi161.stdout:8/814: dread d1/d1c/d20/d22/d28/d7f/d92/fe7 [0,4194304] 0 2024-02-22T00:33:29.507 INFO:tasks.workunit.client.1.smithi161.stdout:6/778: rmdir d3/dda 0 2024-02-22T00:33:29.507 INFO:tasks.workunit.client.1.smithi161.stdout:8/815: chown d1/d1c/d20/d22/d3f/l8b 3237 1 2024-02-22T00:33:29.509 INFO:tasks.workunit.client.1.smithi161.stdout:8/816: stat d1/d1c/d20/d22/d3f/f51 0 2024-02-22T00:33:29.510 INFO:tasks.workunit.client.1.smithi161.stdout:1/780: rename d19/d51/d6c/dd4/fbe to d19/d1d/f114 0 2024-02-22T00:33:29.510 INFO:tasks.workunit.client.1.smithi161.stdout:2/907: rmdir de/d11/d5c 39 2024-02-22T00:33:29.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/781: read - d19/d1d/d2c/d2d/fcd zero size 2024-02-22T00:33:29.513 INFO:tasks.workunit.client.1.smithi161.stdout:8/817: creat d1/d1c/d96/f10a x:0 0 0 2024-02-22T00:33:29.513 INFO:tasks.workunit.client.1.smithi161.stdout:3/801: dread da/f13 [0,4194304] 0 2024-02-22T00:33:29.514 INFO:tasks.workunit.client.1.smithi161.stdout:4/748: creat d5/d8/d41/d57/dbe/d28/d38/d6d/f11c x:0 0 0 2024-02-22T00:33:29.515 INFO:tasks.workunit.client.1.smithi161.stdout:1/782: mknod d19/d1d/d56/c115 0 2024-02-22T00:33:29.515 INFO:tasks.workunit.client.1.smithi161.stdout:8/818: readlink d1/d1c/d96/l98 0 2024-02-22T00:33:29.516 INFO:tasks.workunit.client.1.smithi161.stdout:9/785: rename d1/l6e to d1/d2/d4/l110 0 2024-02-22T00:33:29.519 INFO:tasks.workunit.client.1.smithi161.stdout:5/976: dread d3/dac/fa4 [0,4194304] 0 2024-02-22T00:33:29.521 INFO:tasks.workunit.client.1.smithi161.stdout:6/779: rename d3/d10/d12/d2f/d7d/d82/fe4 to d3/d10/d1b/ff7 0 2024-02-22T00:33:29.522 INFO:tasks.workunit.client.1.smithi161.stdout:9/786: dread - d1/d5/d9/da5/dbc/fbe zero size 2024-02-22T00:33:29.523 INFO:tasks.workunit.client.1.smithi161.stdout:2/908: dwrite de/d2b/d8b/ddc/d125/d60/d68/f10f [0,4194304] 0 2024-02-22T00:33:29.525 INFO:tasks.workunit.client.1.smithi161.stdout:4/749: rmdir d5/d8/d41/d57/dbe/d28/d63/d65/d100 39 2024-02-22T00:33:29.526 INFO:tasks.workunit.client.1.smithi161.stdout:8/819: symlink d1/d1c/d20/d22/d28/d7f/db4/l10b 0 2024-02-22T00:33:29.527 INFO:tasks.workunit.client.1.smithi161.stdout:4/750: write d5/d10/d14/d4f/ff3 [2389495,114417] 0 2024-02-22T00:33:29.528 INFO:tasks.workunit.client.1.smithi161.stdout:2/909: chown de/d2b/d8b/da2/da5/dc4/d8f/f91 51 1 2024-02-22T00:33:29.529 INFO:tasks.workunit.client.1.smithi161.stdout:1/783: dread d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f79 [0,4194304] 0 2024-02-22T00:33:29.530 INFO:tasks.workunit.client.1.smithi161.stdout:6/780: fsync d3/d10/d12/d3a/f68 0 2024-02-22T00:33:29.536 INFO:tasks.workunit.client.1.smithi161.stdout:6/781: dwrite d3/d10/fb0 [0,4194304] 0 2024-02-22T00:33:29.537 INFO:tasks.workunit.client.1.smithi161.stdout:5/977: creat d3/d1b/d25/d4c/d12a/f152 x:0 0 0 2024-02-22T00:33:29.539 INFO:tasks.workunit.client.1.smithi161.stdout:6/782: truncate d3/d10/d72/dc5/fcc 1026306 0 2024-02-22T00:33:29.540 INFO:tasks.workunit.client.1.smithi161.stdout:2/910: symlink de/d2b/d83/l13e 0 2024-02-22T00:33:29.547 INFO:tasks.workunit.client.1.smithi161.stdout:3/802: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f4b [0,4194304] 0 2024-02-22T00:33:29.547 INFO:tasks.workunit.client.1.smithi161.stdout:4/751: truncate d5/d8/d41/f46 785696 0 2024-02-22T00:33:29.548 INFO:tasks.workunit.client.1.smithi161.stdout:5/978: dwrite d3/d29/d80/d92/f108 [0,4194304] 0 2024-02-22T00:33:29.549 INFO:tasks.workunit.client.1.smithi161.stdout:2/911: truncate de/d2b/d8b/da2/da5/dc4/d8f/f8d 2331397 0 2024-02-22T00:33:29.550 INFO:tasks.workunit.client.1.smithi161.stdout:9/787: getdents d1/d25/d73/d98 0 2024-02-22T00:33:29.552 INFO:tasks.workunit.client.1.smithi161.stdout:1/784: getdents d19/d48/d68 0 2024-02-22T00:33:29.553 INFO:tasks.workunit.client.1.smithi161.stdout:8/820: link d1/d2f/f97 d1/d1c/f10c 0 2024-02-22T00:33:29.555 INFO:tasks.workunit.client.1.smithi161.stdout:7/829: sync 2024-02-22T00:33:29.557 INFO:tasks.workunit.client.1.smithi161.stdout:5/979: mknod d3/d1b/d8f/c153 0 2024-02-22T00:33:29.559 INFO:tasks.workunit.client.1.smithi161.stdout:3/803: read da/dc/d91/fa3 [147343,70506] 0 2024-02-22T00:33:29.560 INFO:tasks.workunit.client.1.smithi161.stdout:2/912: rename de/d11/c19 to de/d2b/df6/c13f 0 2024-02-22T00:33:29.562 INFO:tasks.workunit.client.1.smithi161.stdout:4/752: dread d5/d17/fd3 [0,4194304] 0 2024-02-22T00:33:29.562 INFO:tasks.workunit.client.1.smithi161.stdout:8/821: creat d1/d2f/d37/d64/f10d x:0 0 0 2024-02-22T00:33:29.563 INFO:tasks.workunit.client.1.smithi161.stdout:9/788: truncate d1/d2/d4/d1f/dab/dcd/fee 1012884 0 2024-02-22T00:33:29.563 INFO:tasks.workunit.client.1.smithi161.stdout:7/830: truncate d3/d77/f93 400522 0 2024-02-22T00:33:29.566 INFO:tasks.workunit.client.1.smithi161.stdout:6/783: dwrite d3/dc/df/d32/dd9/d87/f88 [0,4194304] 0 2024-02-22T00:33:29.573 INFO:tasks.workunit.client.1.smithi161.stdout:8/822: write d1/d1c/d20/d22/d3f/f51 [2635250,16380] 0 2024-02-22T00:33:29.575 INFO:tasks.workunit.client.1.smithi161.stdout:6/784: unlink d3/dc/f41 0 2024-02-22T00:33:29.578 INFO:tasks.workunit.client.1.smithi161.stdout:1/785: rename fa to d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/f116 0 2024-02-22T00:33:29.579 INFO:tasks.workunit.client.1.smithi161.stdout:3/804: mkdir da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d103 0 2024-02-22T00:33:29.584 INFO:tasks.workunit.client.1.smithi161.stdout:7/831: dread - d3/df/f106 zero size 2024-02-22T00:33:29.584 INFO:tasks.workunit.client.1.smithi161.stdout:5/980: mknod d3/d1b/d25/d4c/dcb/d123/d125/c154 0 2024-02-22T00:33:29.586 INFO:tasks.workunit.client.1.smithi161.stdout:2/913: dwrite de/d11/f124 [0,4194304] 0 2024-02-22T00:33:29.588 INFO:tasks.workunit.client.1.smithi161.stdout:6/785: mknod d3/d10/d12/d2f/d7d/dab/cf8 0 2024-02-22T00:33:29.594 INFO:tasks.workunit.client.1.smithi161.stdout:5/981: link d3/dac/fa5 d3/d1c/d69/f155 0 2024-02-22T00:33:29.597 INFO:tasks.workunit.client.1.smithi161.stdout:2/914: mkdir de/d2b/d8b/da2/da5/d140 0 2024-02-22T00:33:29.600 INFO:tasks.workunit.client.1.smithi161.stdout:1/786: creat d19/d1d/d2c/d2d/d3f/d69/ddd/f117 x:0 0 0 2024-02-22T00:33:29.602 INFO:tasks.workunit.client.1.smithi161.stdout:3/805: dwrite da/dc/d5f/f96 [0,4194304] 0 2024-02-22T00:33:29.607 INFO:tasks.workunit.client.1.smithi161.stdout:1/787: read - d19/d85/d87/ff7 zero size 2024-02-22T00:33:29.608 INFO:tasks.workunit.client.1.smithi161.stdout:7/832: write d3/df/d33/d35/d55/d63/d7b/d50/f61 [1436276,14336] 0 2024-02-22T00:33:29.609 INFO:tasks.workunit.client.1.smithi161.stdout:5/982: rename d3/c31 to d3/d29/d122/c156 0 2024-02-22T00:33:29.609 INFO:tasks.workunit.client.1.smithi161.stdout:4/753: read d5/d8/d41/f46 [206740,19872] 0 2024-02-22T00:33:29.614 INFO:tasks.workunit.client.1.smithi161.stdout:5/983: dread - d3/d29/f144 zero size 2024-02-22T00:33:29.615 INFO:tasks.workunit.client.1.smithi161.stdout:8/823: dwrite d1/d1c/d20/d22/d28/d7f/db4/fff [0,4194304] 0 2024-02-22T00:33:29.618 INFO:tasks.workunit.client.1.smithi161.stdout:6/786: dwrite d3/d10/d12/f2d [0,4194304] 0 2024-02-22T00:33:29.623 INFO:tasks.workunit.client.1.smithi161.stdout:3/806: mkdir da/dc/d11/d26/d104 0 2024-02-22T00:33:29.627 INFO:tasks.workunit.client.1.smithi161.stdout:2/915: mknod de/d2b/d8b/de6/dfb/d11a/c141 0 2024-02-22T00:33:29.631 INFO:tasks.workunit.client.1.smithi161.stdout:8/824: creat d1/d1c/dbd/f10e x:0 0 0 2024-02-22T00:33:29.636 INFO:tasks.workunit.client.1.smithi161.stdout:9/789: dwrite d1/d25/dc4/d4f/f6c [0,4194304] 0 2024-02-22T00:33:29.640 INFO:tasks.workunit.client.1.smithi161.stdout:1/788: dwrite d19/d1d/d2c/d2d/fd2 [0,4194304] 0 2024-02-22T00:33:29.640 INFO:tasks.workunit.client.1.smithi161.stdout:6/787: dwrite d3/d10/f65 [4194304,4194304] 0 2024-02-22T00:33:29.640 INFO:tasks.workunit.client.1.smithi161.stdout:7/833: rename d3/df/d33/d35/l39 to d3/df/d33/d35/d55/d63/d7b/de5/l10a 0 2024-02-22T00:33:29.649 INFO:tasks.workunit.client.1.smithi161.stdout:2/916: symlink de/d2b/d8b/ddc/d125/d3a/d71/l142 0 2024-02-22T00:33:29.652 INFO:tasks.workunit.client.1.smithi161.stdout:2/917: chown de/d2b/d8b/ddc/d125/dd6 20348 1 2024-02-22T00:33:29.652 INFO:tasks.workunit.client.1.smithi161.stdout:1/789: mkdir d19/d1d/d2c/d2d/d3f/d118 0 2024-02-22T00:33:29.654 INFO:tasks.workunit.client.1.smithi161.stdout:7/834: chown d3/df/d33/d35/d55/d63/d7b/l87 64052125 1 2024-02-22T00:33:29.656 INFO:tasks.workunit.client.1.smithi161.stdout:9/790: read d1/d2/d7/da/f80 [342649,82051] 0 2024-02-22T00:33:29.657 INFO:tasks.workunit.client.1.smithi161.stdout:1/790: truncate f5 1790558 0 2024-02-22T00:33:29.659 INFO:tasks.workunit.client.1.smithi161.stdout:6/788: creat d3/d30/ff9 x:0 0 0 2024-02-22T00:33:29.660 INFO:tasks.workunit.client.1.smithi161.stdout:8/825: symlink d1/d1c/d75/d18/l10f 0 2024-02-22T00:33:29.660 INFO:tasks.workunit.client.1.smithi161.stdout:3/807: getdents da/d29/d53 0 2024-02-22T00:33:29.661 INFO:tasks.workunit.client.1.smithi161.stdout:6/789: readlink d3/d10/d1b/lc9 0 2024-02-22T00:33:29.661 INFO:tasks.workunit.client.1.smithi161.stdout:3/808: stat da/dc/d11/f71 0 2024-02-22T00:33:29.662 INFO:tasks.workunit.client.1.smithi161.stdout:7/835: mknod d3/dd/c10b 0 2024-02-22T00:33:29.664 INFO:tasks.workunit.client.1.smithi161.stdout:2/918: dread de/d11/f8a [0,4194304] 0 2024-02-22T00:33:29.664 INFO:tasks.workunit.client.1.smithi161.stdout:1/791: truncate d19/d51/da1/f10a 554782 0 2024-02-22T00:33:29.668 INFO:tasks.workunit.client.1.smithi161.stdout:6/790: dread d3/d30/f5b [0,4194304] 0 2024-02-22T00:33:29.670 INFO:tasks.workunit.client.1.smithi161.stdout:2/919: chown de/d11/d5c/d11e 1427044106 1 2024-02-22T00:33:29.671 INFO:tasks.workunit.client.1.smithi161.stdout:2/920: chown de/dfd 1576 1 2024-02-22T00:33:29.673 INFO:tasks.workunit.client.1.smithi161.stdout:1/792: creat d19/d1d/d2c/d2d/d3f/d69/ddd/f119 x:0 0 0 2024-02-22T00:33:29.673 INFO:tasks.workunit.client.1.smithi161.stdout:4/754: dread d5/d10/f52 [0,4194304] 0 2024-02-22T00:33:29.674 INFO:tasks.workunit.client.1.smithi161.stdout:3/809: truncate da/dc/d11/d26/d80/dc7/dfe/ff6 829350 0 2024-02-22T00:33:29.674 INFO:tasks.workunit.client.1.smithi161.stdout:7/836: write d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/fbb [285873,70806] 0 2024-02-22T00:33:29.676 INFO:tasks.workunit.client.1.smithi161.stdout:1/793: rmdir d19/d48 39 2024-02-22T00:33:29.677 INFO:tasks.workunit.client.1.smithi161.stdout:2/921: mkdir de/d2b/d8b/ddc/d125/d3a/d71/d143 0 2024-02-22T00:33:29.683 INFO:tasks.workunit.client.1.smithi161.stdout:7/837: creat d3/df/d33/dbc/dc5/f10c x:0 0 0 2024-02-22T00:33:29.686 INFO:tasks.workunit.client.1.smithi161.stdout:2/922: symlink de/d2b/d8b/da2/l144 0 2024-02-22T00:33:29.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/838: write d3/dbf/f6c [1595152,61498] 0 2024-02-22T00:33:29.689 INFO:tasks.workunit.client.1.smithi161.stdout:9/791: dwrite d1/d25/f5b [0,4194304] 0 2024-02-22T00:33:29.690 INFO:tasks.workunit.client.1.smithi161.stdout:1/794: write d19/d48/d68/f71 [3374144,65214] 0 2024-02-22T00:33:29.691 INFO:tasks.workunit.client.1.smithi161.stdout:8/826: dread d1/d1c/d20/d22/d28/d7f/d92/d95/fcb [0,4194304] 0 2024-02-22T00:33:29.695 INFO:tasks.workunit.client.1.smithi161.stdout:7/839: write d3/df/d33/d35/d55/de4/fb5 [3636068,113026] 0 2024-02-22T00:33:29.696 INFO:tasks.workunit.client.1.smithi161.stdout:1/795: stat d19/d51/d6c/f10f 0 2024-02-22T00:33:29.699 INFO:tasks.workunit.client.1.smithi161.stdout:8/827: creat d1/d2f/f110 x:0 0 0 2024-02-22T00:33:29.700 INFO:tasks.workunit.client.1.smithi161.stdout:3/810: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/fc2 [0,4194304] 0 2024-02-22T00:33:29.702 INFO:tasks.workunit.client.1.smithi161.stdout:9/792: creat d1/d5/d9/da5/f111 x:0 0 0 2024-02-22T00:33:29.706 INFO:tasks.workunit.client.1.smithi161.stdout:8/828: write d1/d2f/d37/d64/fd8 [913014,62307] 0 2024-02-22T00:33:29.706 INFO:tasks.workunit.client.1.smithi161.stdout:1/796: write d19/d1d/d2c/f4d [1706566,22832] 0 2024-02-22T00:33:29.714 INFO:tasks.workunit.client.1.smithi161.stdout:8/829: write d1/d1c/d20/d22/d28/d7f/d92/d95/f57 [6474428,31137] 0 2024-02-22T00:33:29.715 INFO:tasks.workunit.client.1.smithi161.stdout:4/755: dread d5/d17/f1e [0,4194304] 0 2024-02-22T00:33:29.715 INFO:tasks.workunit.client.1.smithi161.stdout:0/796: sync 2024-02-22T00:33:29.717 INFO:tasks.workunit.client.1.smithi161.stdout:3/811: dwrite da/d29/d53/dc1/fc5 [0,4194304] 0 2024-02-22T00:33:29.718 INFO:tasks.workunit.client.1.smithi161.stdout:4/756: rename d5/d10/d10e to d5/d10/d10e/d11d 22 2024-02-22T00:33:29.787 INFO:tasks.workunit.client.1.smithi161.stdout:1/797: write d19/d85/d87/fb1 [482368,52732] 0 2024-02-22T00:33:29.788 INFO:tasks.workunit.client.1.smithi161.stdout:8/830: creat d1/d2f/dc5/f111 x:0 0 0 2024-02-22T00:33:29.790 INFO:tasks.workunit.client.1.smithi161.stdout:0/797: symlink d14/d37/d42/d8e/d92/da5/dcd/l10f 0 2024-02-22T00:33:29.797 INFO:tasks.workunit.client.1.smithi161.stdout:1/798: dwrite d19/d1d/d2c/fd7 [0,4194304] 0 2024-02-22T00:33:29.802 INFO:tasks.workunit.client.1.smithi161.stdout:9/793: link d1/d2/d4/d11/d21/l8f d1/d5/d9/da5/l112 0 2024-02-22T00:33:29.805 INFO:tasks.workunit.client.1.smithi161.stdout:3/812: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/fb0 [0,4194304] 0 2024-02-22T00:33:29.806 INFO:tasks.workunit.client.1.smithi161.stdout:8/831: getdents d1/d1c/d20/dc0 0 2024-02-22T00:33:29.810 INFO:tasks.workunit.client.1.smithi161.stdout:1/799: write d19/d51/d64/d9b/da5/fcc [4956294,83380] 0 2024-02-22T00:33:29.812 INFO:tasks.workunit.client.1.smithi161.stdout:8/832: chown d1/d1c/d96/dcf/l104 172238 1 2024-02-22T00:33:29.813 INFO:tasks.workunit.client.1.smithi161.stdout:0/798: dwrite d14/d37/d42/d8e/d92/da5/dcd/ffa [0,4194304] 0 2024-02-22T00:33:29.815 INFO:tasks.workunit.client.1.smithi161.stdout:4/757: dwrite d5/d8/d41/d53/fdf [0,4194304] 0 2024-02-22T00:33:29.815 INFO:tasks.workunit.client.1.smithi161.stdout:9/794: truncate d1/d25/d73/d60/d77/d99/fd8 74378 0 2024-02-22T00:33:29.815 INFO:tasks.workunit.client.1.smithi161.stdout:1/800: chown d19/d1d/d2c/f4d 21316 1 2024-02-22T00:33:29.818 INFO:tasks.workunit.client.1.smithi161.stdout:0/799: fsync d14/d37/d42/d8e/d92/fd8 0 2024-02-22T00:33:29.819 INFO:tasks.workunit.client.1.smithi161.stdout:1/801: readlink d19/d51/l7c 0 2024-02-22T00:33:29.819 INFO:tasks.workunit.client.1.smithi161.stdout:8/833: write d1/d1c/d20/d22/d28/d36/f41 [94230,112307] 0 2024-02-22T00:33:29.823 INFO:tasks.workunit.client.1.smithi161.stdout:9/795: creat d1/d25/d73/d60/db0/f113 x:0 0 0 2024-02-22T00:33:29.825 INFO:tasks.workunit.client.1.smithi161.stdout:0/800: chown d14/d37/d42/d73/dc7/cfe 59133880 1 2024-02-22T00:33:29.825 INFO:tasks.workunit.client.1.smithi161.stdout:8/834: fsync d1/d1c/d20/d22/f90 0 2024-02-22T00:33:29.827 INFO:tasks.workunit.client.1.smithi161.stdout:1/802: creat d19/d90/dd6/f11a x:0 0 0 2024-02-22T00:33:29.833 INFO:tasks.workunit.client.1.smithi161.stdout:3/813: link da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/fe8 da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/f105 0 2024-02-22T00:33:29.833 INFO:tasks.workunit.client.1.smithi161.stdout:4/758: dwrite d5/d10/d14/f112 [0,4194304] 0 2024-02-22T00:33:29.840 INFO:tasks.workunit.client.1.smithi161.stdout:0/801: dwrite f8 [0,4194304] 0 2024-02-22T00:33:29.843 INFO:tasks.workunit.client.1.smithi161.stdout:4/759: symlink d5/d8/d41/d57/dbe/d28/d38/l11e 0 2024-02-22T00:33:29.843 INFO:tasks.workunit.client.1.smithi161.stdout:9/796: dwrite d1/d25/d73/d60/d77/d99/ff1 [0,4194304] 0 2024-02-22T00:33:29.844 INFO:tasks.workunit.client.1.smithi161.stdout:4/760: chown d5/d8/d41/ffc 31775 1 2024-02-22T00:33:29.851 INFO:tasks.workunit.client.1.smithi161.stdout:0/802: creat d14/d37/d42/d73/dc7/f110 x:0 0 0 2024-02-22T00:33:29.852 INFO:tasks.workunit.client.1.smithi161.stdout:3/814: link da/d29/d53/dc1/dce/lb1 da/d29/d53/dc1/dce/l106 0 2024-02-22T00:33:29.853 INFO:tasks.workunit.client.1.smithi161.stdout:4/761: read d5/d10/d14/f20 [36642,111564] 0 2024-02-22T00:33:29.853 INFO:tasks.workunit.client.1.smithi161.stdout:1/803: dwrite f9 [0,4194304] 0 2024-02-22T00:33:29.854 INFO:tasks.workunit.client.1.smithi161.stdout:9/797: mkdir d1/d2/d4/d95/db8/d10c/d114 0 2024-02-22T00:33:29.855 INFO:tasks.workunit.client.1.smithi161.stdout:9/798: chown d1/d4b/d81 1 1 2024-02-22T00:33:29.856 INFO:tasks.workunit.client.1.smithi161.stdout:8/835: write d1/d1c/d20/d22/d28/d36/d6c/f103 [923856,29957] 0 2024-02-22T00:33:29.857 INFO:tasks.workunit.client.1.smithi161.stdout:3/815: stat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/dd2/cdb 0 2024-02-22T00:33:29.861 INFO:tasks.workunit.client.1.smithi161.stdout:9/799: mkdir d1/d5/d9/da5/dbc/d115 0 2024-02-22T00:33:29.862 INFO:tasks.workunit.client.1.smithi161.stdout:4/762: dread d5/d8/d41/d53/fdf [0,4194304] 0 2024-02-22T00:33:29.865 INFO:tasks.workunit.client.1.smithi161.stdout:3/816: link da/dc/d11/d26/d80/dc7/d59/d93/daa/fb4 da/dc/d5f/d66/f107 0 2024-02-22T00:33:29.865 INFO:tasks.workunit.client.1.smithi161.stdout:9/800: mknod d1/d5/d9/c116 0 2024-02-22T00:33:29.868 INFO:tasks.workunit.client.1.smithi161.stdout:9/801: chown d1/d25/d73/d60/d77/f87 4 1 2024-02-22T00:33:29.868 INFO:tasks.workunit.client.1.smithi161.stdout:3/817: mkdir da/dc/d11/d26/d80/dc7/d108 0 2024-02-22T00:33:29.869 INFO:tasks.workunit.client.1.smithi161.stdout:4/763: creat d5/d8/d41/d57/dbe/d28/d63/d65/d100/f11f x:0 0 0 2024-02-22T00:33:29.872 INFO:tasks.workunit.client.1.smithi161.stdout:3/818: write da/dc/d5f/d66/f107 [4153544,67888] 0 2024-02-22T00:33:29.873 INFO:tasks.workunit.client.1.smithi161.stdout:3/819: dread - da/dc/d11/d26/d80/dc7/dfe/f102 zero size 2024-02-22T00:33:29.874 INFO:tasks.workunit.client.1.smithi161.stdout:9/802: rename d1/d5/f10a to d1/d5/d9/f117 0 2024-02-22T00:33:29.877 INFO:tasks.workunit.client.1.smithi161.stdout:3/820: stat da/dc/d11/d26/d80/dc7/d59/d93/cf5 0 2024-02-22T00:33:29.879 INFO:tasks.workunit.client.1.smithi161.stdout:9/803: unlink d1/d2/fd2 0 2024-02-22T00:33:29.882 INFO:tasks.workunit.client.1.smithi161.stdout:3/821: mknod da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff/c109 0 2024-02-22T00:33:29.882 INFO:tasks.workunit.client.1.smithi161.stdout:8/836: truncate d1/d1c/d20/d22/d28/d7f/d92/d95/fcb 582991 0 2024-02-22T00:33:29.885 INFO:tasks.workunit.client.1.smithi161.stdout:4/764: write d5/f7d [3843058,111584] 0 2024-02-22T00:33:29.886 INFO:tasks.workunit.client.1.smithi161.stdout:8/837: fdatasync d1/d1c/dbd/f8c 0 2024-02-22T00:33:29.888 INFO:tasks.workunit.client.1.smithi161.stdout:3/822: link f0 da/dc/d11/d26/d80/dc7/f10a 0 2024-02-22T00:33:29.889 INFO:tasks.workunit.client.1.smithi161.stdout:4/765: rmdir d5/d8/d41/d53 39 2024-02-22T00:33:29.890 INFO:tasks.workunit.client.1.smithi161.stdout:8/838: creat d1/d1c/d20/d22/d28/d7f/d92/f112 x:0 0 0 2024-02-22T00:33:29.893 INFO:tasks.workunit.client.1.smithi161.stdout:1/804: dread d19/d51/d64/d9b/da5/daa/fea [4194304,4194304] 0 2024-02-22T00:33:29.893 INFO:tasks.workunit.client.1.smithi161.stdout:8/839: chown d1/d1c/d20/d22/d28/d7f/d92/d93/fe8 75316 1 2024-02-22T00:33:29.895 INFO:tasks.workunit.client.1.smithi161.stdout:3/823: mkdir da/dc/d10b 0 2024-02-22T00:33:29.897 INFO:tasks.workunit.client.1.smithi161.stdout:4/766: rmdir d5/d8/d41/d53/d6c/d72/dfb 39 2024-02-22T00:33:29.897 INFO:tasks.workunit.client.1.smithi161.stdout:3/824: chown da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/cee 76329 1 2024-02-22T00:33:29.898 INFO:tasks.workunit.client.1.smithi161.stdout:5/984: sync 2024-02-22T00:33:29.900 INFO:tasks.workunit.client.1.smithi161.stdout:8/840: symlink d1/d1c/d20/d22/d28/d36/l113 0 2024-02-22T00:33:29.901 INFO:tasks.workunit.client.1.smithi161.stdout:4/767: rmdir d5/d8/d41/d57/dbe/d28/d38/d6d/da5 39 2024-02-22T00:33:29.903 INFO:tasks.workunit.client.1.smithi161.stdout:8/841: mkdir d1/d2f/d114 0 2024-02-22T00:33:29.904 INFO:tasks.workunit.client.1.smithi161.stdout:9/804: dread d1/d2/d7/da/f3c [0,4194304] 0 2024-02-22T00:33:29.910 INFO:tasks.workunit.client.1.smithi161.stdout:9/805: chown d1/d25/d73/d60/d77/c103 57574 1 2024-02-22T00:33:29.910 INFO:tasks.workunit.client.1.smithi161.stdout:4/768: mknod d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/c120 0 2024-02-22T00:33:29.910 INFO:tasks.workunit.client.1.smithi161.stdout:3/825: dwrite da/dc/d11/d26/d80/d92/fcc [0,4194304] 0 2024-02-22T00:33:29.912 INFO:tasks.workunit.client.1.smithi161.stdout:5/985: dwrite d3/d1c/d67/d113/f132 [0,4194304] 0 2024-02-22T00:33:29.915 INFO:tasks.workunit.client.1.smithi161.stdout:1/805: dread d19/d1d/d56/f74 [0,4194304] 0 2024-02-22T00:33:29.915 INFO:tasks.workunit.client.1.smithi161.stdout:4/769: mkdir d5/d10/d14/d4f/d121 0 2024-02-22T00:33:29.918 INFO:tasks.workunit.client.1.smithi161.stdout:9/806: write d1/d5/f36 [1642002,34550] 0 2024-02-22T00:33:29.919 INFO:tasks.workunit.client.1.smithi161.stdout:4/770: dread - d5/d8/d41/d53/d6c/d91/f101 zero size 2024-02-22T00:33:29.922 INFO:tasks.workunit.client.1.smithi161.stdout:8/842: dread d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/fdb [0,4194304] 0 2024-02-22T00:33:29.923 INFO:tasks.workunit.client.1.smithi161.stdout:9/807: read d1/d5/d9/f76 [2661219,120985] 0 2024-02-22T00:33:29.923 INFO:tasks.workunit.client.1.smithi161.stdout:1/806: rename d19/d48/l60 to d19/d1d/l11b 0 2024-02-22T00:33:29.927 INFO:tasks.workunit.client.1.smithi161.stdout:4/771: mknod d5/d10/d10e/c122 0 2024-02-22T00:33:29.928 INFO:tasks.workunit.client.1.smithi161.stdout:9/808: creat d1/d2/d4/d11/d21/f118 x:0 0 0 2024-02-22T00:33:29.929 INFO:tasks.workunit.client.1.smithi161.stdout:4/772: fdatasync d5/f27 0 2024-02-22T00:33:29.931 INFO:tasks.workunit.client.1.smithi161.stdout:5/986: write d3/d1c/d69/f155 [634698,69920] 0 2024-02-22T00:33:29.934 INFO:tasks.workunit.client.1.smithi161.stdout:9/809: creat d1/d5/d9/da5/d109/f119 x:0 0 0 2024-02-22T00:33:29.935 INFO:tasks.workunit.client.1.smithi161.stdout:1/807: dwrite d19/d1d/d2c/d2d/d3f/f9f [0,4194304] 0 2024-02-22T00:33:29.936 INFO:tasks.workunit.client.1.smithi161.stdout:4/773: truncate d5/d8/d41/d57/dbe/d28/fd4 879109 0 2024-02-22T00:33:29.937 INFO:tasks.workunit.client.1.smithi161.stdout:5/987: rmdir d3/d1b/d8f 39 2024-02-22T00:33:29.939 INFO:tasks.workunit.client.1.smithi161.stdout:9/810: mkdir d1/d5/d9/da5/d11a 0 2024-02-22T00:33:29.941 INFO:tasks.workunit.client.1.smithi161.stdout:3/826: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f3f [0,4194304] 0 2024-02-22T00:33:29.943 INFO:tasks.workunit.client.1.smithi161.stdout:5/988: symlink d3/d1b/d25/d84/l157 0 2024-02-22T00:33:29.944 INFO:tasks.workunit.client.1.smithi161.stdout:3/827: readlink da/dc/d11/d26/d80/dc7/le3 0 2024-02-22T00:33:29.946 INFO:tasks.workunit.client.1.smithi161.stdout:5/989: write d3/d1c/d20/f73 [2164291,82311] 0 2024-02-22T00:33:29.948 INFO:tasks.workunit.client.1.smithi161.stdout:1/808: dwrite d19/d1d/d56/fa4 [4194304,4194304] 0 2024-02-22T00:33:29.949 INFO:tasks.workunit.client.1.smithi161.stdout:9/811: dread d1/d2/d7/da/f3c [0,4194304] 0 2024-02-22T00:33:29.952 INFO:tasks.workunit.client.1.smithi161.stdout:4/774: write d5/d17/f4a [1065722,40417] 0 2024-02-22T00:33:29.953 INFO:tasks.workunit.client.1.smithi161.stdout:1/809: write d19/d51/d64/d9b/da5/fcc [4642694,31714] 0 2024-02-22T00:33:29.957 INFO:tasks.workunit.client.1.smithi161.stdout:3/828: dwrite da/dc/d11/fab [0,4194304] 0 2024-02-22T00:33:29.959 INFO:tasks.workunit.client.1.smithi161.stdout:1/810: mkdir d19/d51/d64/d9b/da5/d11c 0 2024-02-22T00:33:29.968 INFO:tasks.workunit.client.1.smithi161.stdout:4/775: truncate d5/d8/d41/d57/dbe/d28/fe9 1756155 0 2024-02-22T00:33:29.969 INFO:tasks.workunit.client.1.smithi161.stdout:5/990: dwrite d3/d1b/d25/f39 [4194304,4194304] 0 2024-02-22T00:33:29.969 INFO:tasks.workunit.client.1.smithi161.stdout:3/829: dwrite da/dc/d11/d26/d80/dc7/d59/fbe [0,4194304] 0 2024-02-22T00:33:29.972 INFO:tasks.workunit.client.1.smithi161.stdout:4/776: fdatasync d5/d8/d41/d53/fa7 0 2024-02-22T00:33:29.974 INFO:tasks.workunit.client.1.smithi161.stdout:5/991: readlink d3/d1c/d20/l4e 0 2024-02-22T00:33:29.976 INFO:tasks.workunit.client.1.smithi161.stdout:5/992: dread - d3/d1c/fbf zero size 2024-02-22T00:33:29.981 INFO:tasks.workunit.client.1.smithi161.stdout:4/777: mkdir d5/d8/d41/d57/dbe/d28/d63/d65/dcd/d123 0 2024-02-22T00:33:29.982 INFO:tasks.workunit.client.1.smithi161.stdout:3/830: mknod da/dc/d91/db5/c10c 0 2024-02-22T00:33:29.982 INFO:tasks.workunit.client.1.smithi161.stdout:5/993: rmdir d3/d1b/d25/d4c/dcb/d123 39 2024-02-22T00:33:29.983 INFO:tasks.workunit.client.1.smithi161.stdout:1/811: dwrite d19/d1d/d2c/d2d/d3f/f67 [0,4194304] 0 2024-02-22T00:33:29.985 INFO:tasks.workunit.client.1.smithi161.stdout:9/812: dread d1/d5/f59 [0,4194304] 0 2024-02-22T00:33:29.985 INFO:tasks.workunit.client.1.smithi161.stdout:5/994: write d3/d1c/fe7 [191431,97508] 0 2024-02-22T00:33:29.985 INFO:tasks.workunit.client.1.smithi161.stdout:4/778: mknod d5/d10/d14/d4f/c124 0 2024-02-22T00:33:29.988 INFO:tasks.workunit.client.1.smithi161.stdout:5/995: chown d3/d1b/d25/f39 86048984 1 2024-02-22T00:33:29.989 INFO:tasks.workunit.client.1.smithi161.stdout:5/996: chown d3/d1b/d25/d4c/fed 510254685 1 2024-02-22T00:33:29.990 INFO:tasks.workunit.client.1.smithi161.stdout:5/997: write d3/d1c/fe7 [279073,124339] 0 2024-02-22T00:33:29.994 INFO:tasks.workunit.client.1.smithi161.stdout:1/812: getdents d19/d1d/d2c/d2d/d3f/d69/ddd/df0 0 2024-02-22T00:33:29.995 INFO:tasks.workunit.client.1.smithi161.stdout:9/813: getdents d1/d25/dc4/d4f/da3 0 2024-02-22T00:33:29.997 INFO:tasks.workunit.client.1.smithi161.stdout:4/779: dwrite d5/d8/d41/f8b [0,4194304] 0 2024-02-22T00:33:29.999 INFO:tasks.workunit.client.1.smithi161.stdout:9/814: fdatasync d1/d2/f7f 0 2024-02-22T00:33:29.999 INFO:tasks.workunit.client.1.smithi161.stdout:4/780: readlink d5/d8/d41/d57/dbe/d28/d63/d65/d9d/lcc 0 2024-02-22T00:33:30.000 INFO:tasks.workunit.client.1.smithi161.stdout:1/813: creat d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f11d x:0 0 0 2024-02-22T00:33:30.003 INFO:tasks.workunit.client.1.smithi161.stdout:5/998: link d3/d29/d80/d92/df7/dae/ld8 d3/d1b/d36/d88/d14f/l158 0 2024-02-22T00:33:30.007 INFO:tasks.workunit.client.1.smithi161.stdout:5/999: chown d3/dac/dd1/ff0 31694116 1 2024-02-22T00:33:30.010 INFO:tasks.workunit.client.1.smithi161.stdout:9/815: dwrite d1/d25/d73/d60/db0/f113 [0,4194304] 0 2024-02-22T00:33:30.012 INFO:tasks.workunit.client.1.smithi161.stdout:3/831: dread da/fb3 [0,4194304] 0 2024-02-22T00:33:30.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/781: dwrite d5/d8/d41/d57/dbe/d28/d38/d6d/f11c [0,4194304] 0 2024-02-22T00:33:30.019 INFO:tasks.workunit.client.1.smithi161.stdout:4/782: write d5/d10/d14/d4f/f109 [477073,106147] 0 2024-02-22T00:33:30.020 INFO:tasks.workunit.client.1.smithi161.stdout:4/783: stat d5/d8/d41/d57/dbe/f10b 0 2024-02-22T00:33:30.022 INFO:tasks.workunit.client.1.smithi161.stdout:6/791: sync 2024-02-22T00:33:30.022 INFO:tasks.workunit.client.1.smithi161.stdout:7/840: sync 2024-02-22T00:33:30.022 INFO:tasks.workunit.client.1.smithi161.stdout:2/923: sync 2024-02-22T00:33:30.022 INFO:tasks.workunit.client.1.smithi161.stdout:9/816: dwrite d1/d25/d73/d60/d77/d99/fa1 [0,4194304] 0 2024-02-22T00:33:30.024 INFO:tasks.workunit.client.1.smithi161.stdout:4/784: chown d5/d8/d41/d57/dbe/d28/d63/d65/dcd/d123 31833 1 2024-02-22T00:33:30.025 INFO:tasks.workunit.client.1.smithi161.stdout:4/785: readlink d5/d10/da9/lb8 0 2024-02-22T00:33:30.026 INFO:tasks.workunit.client.1.smithi161.stdout:2/924: write de/d2b/d8b/da2/da5/dc4/d8f/f8d [141821,96764] 0 2024-02-22T00:33:30.027 INFO:tasks.workunit.client.1.smithi161.stdout:6/792: symlink d3/d7c/dd1/lfa 0 2024-02-22T00:33:30.029 INFO:tasks.workunit.client.1.smithi161.stdout:1/814: rmdir d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d84/d106 0 2024-02-22T00:33:30.031 INFO:tasks.workunit.client.1.smithi161.stdout:7/841: creat d3/df/d33/d35/d55/d63/d7b/d30/d44/f10d x:0 0 0 2024-02-22T00:33:30.031 INFO:tasks.workunit.client.1.smithi161.stdout:1/815: stat d19/d85/d87/fb1 0 2024-02-22T00:33:30.031 INFO:tasks.workunit.client.1.smithi161.stdout:2/925: readlink de/d11/d5c/l84 0 2024-02-22T00:33:30.032 INFO:tasks.workunit.client.1.smithi161.stdout:1/816: write d19/d51/da1/f10a [42694,6966] 0 2024-02-22T00:33:30.038 INFO:tasks.workunit.client.1.smithi161.stdout:4/786: dread d5/d10/f26 [0,4194304] 0 2024-02-22T00:33:30.043 INFO:tasks.workunit.client.1.smithi161.stdout:3/832: dread da/dc/d5f/f73 [0,4194304] 0 2024-02-22T00:33:30.043 INFO:tasks.workunit.client.1.smithi161.stdout:3/833: dread - da/dc/d91/db5/ff3 zero size 2024-02-22T00:33:30.066 INFO:tasks.workunit.client.1.smithi161.stdout:6/793: creat d3/d10/d12/d2f/ffb x:0 0 0 2024-02-22T00:33:30.067 INFO:tasks.workunit.client.1.smithi161.stdout:6/794: write d3/d10/d12/d2f/d7d/d5f/f90 [433880,25052] 0 2024-02-22T00:33:30.068 INFO:tasks.workunit.client.1.smithi161.stdout:9/817: creat d1/d25/d73/d60/f11b x:0 0 0 2024-02-22T00:33:30.068 INFO:tasks.workunit.client.1.smithi161.stdout:7/842: mknod d3/d77/c10e 0 2024-02-22T00:33:30.070 INFO:tasks.workunit.client.1.smithi161.stdout:7/843: write d3/df/d43/faa [4205392,93788] 0 2024-02-22T00:33:30.076 INFO:tasks.workunit.client.1.smithi161.stdout:7/844: dwrite d3/df/d33/d35/d55/d63/d7b/de5/ff7 [0,4194304] 0 2024-02-22T00:33:30.077 INFO:tasks.workunit.client.1.smithi161.stdout:7/845: write d3/df/d33/d74/f8e [594256,11057] 0 2024-02-22T00:33:30.078 INFO:tasks.workunit.client.1.smithi161.stdout:7/846: dread - d3/df/f106 zero size 2024-02-22T00:33:30.079 INFO:tasks.workunit.client.1.smithi161.stdout:1/817: write d19/d51/d6c/dd4/f4c [573043,111811] 0 2024-02-22T00:33:30.079 INFO:tasks.workunit.client.1.smithi161.stdout:1/818: chown d19/f5f 221509714 1 2024-02-22T00:33:30.081 INFO:tasks.workunit.client.1.smithi161.stdout:1/819: stat d19/d1d/d2c/d2d/d3f/d69 0 2024-02-22T00:33:30.088 INFO:tasks.workunit.client.1.smithi161.stdout:9/818: write d1/d2/d7/f47 [2213992,103057] 0 2024-02-22T00:33:30.090 INFO:tasks.workunit.client.1.smithi161.stdout:9/819: write d1/d2/d7/da/f13 [3564743,7051] 0 2024-02-22T00:33:30.091 INFO:tasks.workunit.client.1.smithi161.stdout:1/820: chown d19/d1d/d2c/l38 7655 1 2024-02-22T00:33:30.093 INFO:tasks.workunit.client.1.smithi161.stdout:2/926: rmdir de/df4/d114 0 2024-02-22T00:33:30.099 INFO:tasks.workunit.client.1.smithi161.stdout:9/820: dread d1/d25/d73/d60/d77/d99/fa1 [0,4194304] 0 2024-02-22T00:33:30.102 INFO:tasks.workunit.client.1.smithi161.stdout:6/795: link d3/d10/d12/d3a/f96 d3/d10/d72/ffc 0 2024-02-22T00:33:30.103 INFO:tasks.workunit.client.1.smithi161.stdout:6/796: write d3/dc/f27 [3711744,37865] 0 2024-02-22T00:33:30.103 INFO:tasks.workunit.client.1.smithi161.stdout:1/821: getdents d19/d51/d64/d9b/da5/d11c 0 2024-02-22T00:33:30.104 INFO:tasks.workunit.client.1.smithi161.stdout:4/787: getdents d5/d8/d41/d53/d6c/d72/dfb 0 2024-02-22T00:33:30.105 INFO:tasks.workunit.client.1.smithi161.stdout:2/927: mknod de/c145 0 2024-02-22T00:33:30.106 INFO:tasks.workunit.client.1.smithi161.stdout:7/847: getdents d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100 0 2024-02-22T00:33:30.107 INFO:tasks.workunit.client.1.smithi161.stdout:4/788: chown d5/d8/d41/d53/d6c/d72/fce 192 1 2024-02-22T00:33:30.107 INFO:tasks.workunit.client.1.smithi161.stdout:9/821: mkdir d1/d5/d9/d9c/d11c 0 2024-02-22T00:33:30.109 INFO:tasks.workunit.client.1.smithi161.stdout:1/822: creat d19/d48/f11e x:0 0 0 2024-02-22T00:33:30.111 INFO:tasks.workunit.client.1.smithi161.stdout:6/797: dwrite d3/dc/df/d32/dd9/f94 [0,4194304] 0 2024-02-22T00:33:30.111 INFO:tasks.workunit.client.1.smithi161.stdout:7/848: rmdir d3/df/d33/dbc/dc5 39 2024-02-22T00:33:30.112 INFO:tasks.workunit.client.1.smithi161.stdout:6/798: dread - d3/d30/fbf zero size 2024-02-22T00:33:30.113 INFO:tasks.workunit.client.1.smithi161.stdout:7/849: write d3/df/d33/d35/d55/de4/f4e [2262479,55415] 0 2024-02-22T00:33:30.116 INFO:tasks.workunit.client.1.smithi161.stdout:9/822: creat d1/d5/d9/f11d x:0 0 0 2024-02-22T00:33:30.116 INFO:tasks.workunit.client.1.smithi161.stdout:6/799: write d3/dc/df/d32/dd9/f94 [4186990,5349] 0 2024-02-22T00:33:30.119 INFO:tasks.workunit.client.1.smithi161.stdout:2/928: mkdir de/d2b/d8b/ddc/d125/d3a/d71/d143/d146 0 2024-02-22T00:33:30.124 INFO:tasks.workunit.client.1.smithi161.stdout:7/850: creat d3/df/d43/f10f x:0 0 0 2024-02-22T00:33:30.124 INFO:tasks.workunit.client.1.smithi161.stdout:7/851: chown d3/d77 51164 1 2024-02-22T00:33:30.125 INFO:tasks.workunit.client.1.smithi161.stdout:7/852: read - d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100/fc1 zero size 2024-02-22T00:33:30.125 INFO:tasks.workunit.client.1.smithi161.stdout:4/789: creat d5/d8/d41/d57/dbe/d28/d38/d6d/da5/f125 x:0 0 0 2024-02-22T00:33:30.125 INFO:tasks.workunit.client.1.smithi161.stdout:2/929: read de/d2b/d8b/da2/fbc [4184053,124563] 0 2024-02-22T00:33:30.126 INFO:tasks.workunit.client.1.smithi161.stdout:7/853: write d3/df/d33/d35/d55/d63/d7b/d50/f61 [4438564,40073] 0 2024-02-22T00:33:30.126 INFO:tasks.workunit.client.1.smithi161.stdout:6/800: mkdir d3/dc/df/dfd 0 2024-02-22T00:33:30.129 INFO:tasks.workunit.client.1.smithi161.stdout:4/790: readlink d5/d17/d5c/l7e 0 2024-02-22T00:33:30.132 INFO:tasks.workunit.client.1.smithi161.stdout:9/823: dread d1/d2/d4/d11/f1c [0,4194304] 0 2024-02-22T00:33:30.132 INFO:tasks.workunit.client.1.smithi161.stdout:7/854: chown d3/dbf/d64/le7 99210 1 2024-02-22T00:33:30.135 INFO:tasks.workunit.client.1.smithi161.stdout:6/801: symlink d3/dc/df/dfd/lfe 0 2024-02-22T00:33:30.135 INFO:tasks.workunit.client.1.smithi161.stdout:1/823: write d19/d1d/f27 [94019,105324] 0 2024-02-22T00:33:30.136 INFO:tasks.workunit.client.1.smithi161.stdout:9/824: fsync d1/d5/d9/f117 0 2024-02-22T00:33:30.139 INFO:tasks.workunit.client.1.smithi161.stdout:4/791: creat d5/d8/d41/d57/dbe/d28/d38/d6d/f126 x:0 0 0 2024-02-22T00:33:30.140 INFO:tasks.workunit.client.1.smithi161.stdout:1/824: creat d19/d48/f11f x:0 0 0 2024-02-22T00:33:30.140 INFO:tasks.workunit.client.1.smithi161.stdout:0/803: sync 2024-02-22T00:33:30.141 INFO:tasks.workunit.client.1.smithi161.stdout:9/825: mknod d1/d4b/c11e 0 2024-02-22T00:33:30.142 INFO:tasks.workunit.client.1.smithi161.stdout:1/825: write d19/d1d/f65 [233215,81043] 0 2024-02-22T00:33:30.143 INFO:tasks.workunit.client.1.smithi161.stdout:2/930: write de/d11/fad [788234,669] 0 2024-02-22T00:33:30.144 INFO:tasks.workunit.client.1.smithi161.stdout:6/802: dwrite d3/dc/df/d32/dd9/f94 [0,4194304] 0 2024-02-22T00:33:30.146 INFO:tasks.workunit.client.1.smithi161.stdout:4/792: unlink d5/d8/d41/d53/d6c/d91/ffe 0 2024-02-22T00:33:30.152 INFO:tasks.workunit.client.1.smithi161.stdout:7/855: rename d3/df/d33/dbc/dc5 to d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/d110 0 2024-02-22T00:33:30.152 INFO:tasks.workunit.client.1.smithi161.stdout:4/793: stat d5/d8/d41/d57/dbe/d28/d63/d65/faf 0 2024-02-22T00:33:30.155 INFO:tasks.workunit.client.1.smithi161.stdout:9/826: dwrite d1/fd9 [0,4194304] 0 2024-02-22T00:33:30.155 INFO:tasks.workunit.client.1.smithi161.stdout:6/803: getdents d3/d10/d12/d2f/d7d/dab/dbe 0 2024-02-22T00:33:30.157 INFO:tasks.workunit.client.1.smithi161.stdout:9/827: write d1/d5/d9/f10d [899211,109710] 0 2024-02-22T00:33:30.158 INFO:tasks.workunit.client.1.smithi161.stdout:6/804: chown d3/d10/d12/d2f/d7d/d5f 3666 1 2024-02-22T00:33:30.160 INFO:tasks.workunit.client.1.smithi161.stdout:7/856: read d3/df/d33/d74/f98 [433167,44139] 0 2024-02-22T00:33:30.161 INFO:tasks.workunit.client.1.smithi161.stdout:1/826: write d19/d1d/d2c/d2d/d3f/fae [241412,95795] 0 2024-02-22T00:33:30.162 INFO:tasks.workunit.client.1.smithi161.stdout:0/804: write fb [3983523,43403] 0 2024-02-22T00:33:30.165 INFO:tasks.workunit.client.1.smithi161.stdout:4/794: truncate d5/d8/d41/d57/dbe/d28/d38/fef 792009 0 2024-02-22T00:33:30.167 INFO:tasks.workunit.client.1.smithi161.stdout:9/828: unlink d1/d25/dc4/d4f/fbd 0 2024-02-22T00:33:30.170 INFO:tasks.workunit.client.1.smithi161.stdout:4/795: chown d5/d8/d41/d57/f60 2 1 2024-02-22T00:33:30.171 INFO:tasks.workunit.client.1.smithi161.stdout:0/805: creat d14/d37/d10b/f111 x:0 0 0 2024-02-22T00:33:30.171 INFO:tasks.workunit.client.1.smithi161.stdout:8/843: sync 2024-02-22T00:33:30.172 INFO:tasks.workunit.client.1.smithi161.stdout:2/931: dread de/d2b/d8b/ddc/d125/fdb [0,4194304] 0 2024-02-22T00:33:30.173 INFO:tasks.workunit.client.1.smithi161.stdout:1/827: getdents d19/d51/d64/d9b 0 2024-02-22T00:33:30.173 INFO:tasks.workunit.client.1.smithi161.stdout:9/829: unlink d1/d25/c88 0 2024-02-22T00:33:30.176 INFO:tasks.workunit.client.1.smithi161.stdout:7/857: dwrite d3/f1b [0,4194304] 0 2024-02-22T00:33:30.177 INFO:tasks.workunit.client.1.smithi161.stdout:4/796: write d5/fe [1999568,41091] 0 2024-02-22T00:33:30.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:28.510498+0000 mgr.smithi161.sazlam (mgr.24369) 41 : cephadm [INF] Reconfiguring alertmanager.smithi049 (dependencies changed)... 2024-02-22T00:33:30.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:33:28.526647+0000 mgr.smithi161.sazlam (mgr.24369) 42 : cephadm [INF] Reconfiguring daemon alertmanager.smithi049 on smithi049 2024-02-22T00:33:30.179 INFO:tasks.workunit.client.1.smithi161.stdout:6/805: dwrite d3/d10/d12/d2f/d7d/d82/fd6 [0,4194304] 0 2024-02-22T00:33:30.179 INFO:tasks.workunit.client.1.smithi161.stdout:7/858: dread - d3/d77/ff3 zero size 2024-02-22T00:33:30.181 INFO:tasks.workunit.client.1.smithi161.stdout:0/806: write d14/d1a/d3f/d96/dbc/dc5/f107 [49854,123133] 0 2024-02-22T00:33:30.184 INFO:tasks.workunit.client.1.smithi161.stdout:6/806: chown d3/dc/c16 58378 1 2024-02-22T00:33:30.186 INFO:tasks.workunit.client.1.smithi161.stdout:1/828: dread d19/d51/d64/d9b/da5/daa/fab [0,4194304] 0 2024-02-22T00:33:30.189 INFO:tasks.workunit.client.1.smithi161.stdout:6/807: fdatasync d3/d10/d12/d3a/fa1 0 2024-02-22T00:33:30.189 INFO:tasks.workunit.client.1.smithi161.stdout:7/859: symlink d3/df/d33/d35/d55/d63/d7b/d50/l111 0 2024-02-22T00:33:30.193 INFO:tasks.workunit.client.1.smithi161.stdout:9/830: dwrite d1/d5/d9/f107 [0,4194304] 0 2024-02-22T00:33:30.196 INFO:tasks.workunit.client.1.smithi161.stdout:6/808: fdatasync d3/d10/d12/d2f/d7d/d82/fa9 0 2024-02-22T00:33:30.198 INFO:tasks.workunit.client.1.smithi161.stdout:0/807: getdents d14/d37/d42/d73/dc7/de0 0 2024-02-22T00:33:30.198 INFO:tasks.workunit.client.1.smithi161.stdout:2/932: dread f3 [0,4194304] 0 2024-02-22T00:33:30.201 INFO:tasks.workunit.client.1.smithi161.stdout:8/844: dread d1/f2d [0,4194304] 0 2024-02-22T00:33:30.201 INFO:tasks.workunit.client.1.smithi161.stdout:7/860: creat d3/df/d33/d35/d55/f112 x:0 0 0 2024-02-22T00:33:30.202 INFO:tasks.workunit.client.1.smithi161.stdout:6/809: creat d3/d7c/dd1/fff x:0 0 0 2024-02-22T00:33:30.203 INFO:tasks.workunit.client.1.smithi161.stdout:2/933: read de/d2b/d8b/da2/f118 [766678,13317] 0 2024-02-22T00:33:30.204 INFO:tasks.workunit.client.1.smithi161.stdout:9/831: mknod d1/d2/d4/d95/c11f 0 2024-02-22T00:33:30.206 INFO:tasks.workunit.client.1.smithi161.stdout:2/934: chown de/d2b/d8b/da2/da5/daf/c107 233 1 2024-02-22T00:33:30.206 INFO:tasks.workunit.client.1.smithi161.stdout:4/797: write d5/d8/d41/d57/dbe/f88 [515766,46803] 0 2024-02-22T00:33:30.206 INFO:tasks.workunit.client.1.smithi161.stdout:9/832: chown d1/d25/d73/d98/dec 10628284 1 2024-02-22T00:33:30.209 INFO:tasks.workunit.client.1.smithi161.stdout:1/829: write d19/f1f [598284,85822] 0 2024-02-22T00:33:30.209 INFO:tasks.workunit.client.1.smithi161.stdout:8/845: mknod d1/d1c/d75/d18/c115 0 2024-02-22T00:33:30.212 INFO:tasks.workunit.client.1.smithi161.stdout:2/935: write de/d2b/d8b/da2/da5/dc4/da7/fed [397498,26254] 0 2024-02-22T00:33:30.213 INFO:tasks.workunit.client.1.smithi161.stdout:6/810: dread d3/d10/d1b/f78 [0,4194304] 0 2024-02-22T00:33:30.213 INFO:tasks.workunit.client.1.smithi161.stdout:9/833: read d1/d25/d73/d60/db0/f113 [1948569,111726] 0 2024-02-22T00:33:30.216 INFO:tasks.workunit.client.1.smithi161.stdout:4/798: mknod d5/d8/d41/d57/dbe/d28/d63/c127 0 2024-02-22T00:33:30.218 INFO:tasks.workunit.client.1.smithi161.stdout:9/834: fsync d1/d25/dc4/d4f/f6c 0 2024-02-22T00:33:30.218 INFO:tasks.workunit.client.1.smithi161.stdout:7/861: dwrite d3/df/d33/d35/d55/d63/d7b/d8f/f9d [0,4194304] 0 2024-02-22T00:33:30.221 INFO:tasks.workunit.client.1.smithi161.stdout:0/808: dread d14/d1a/f79 [0,4194304] 0 2024-02-22T00:33:30.221 INFO:tasks.workunit.client.1.smithi161.stdout:1/830: mkdir d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d120 0 2024-02-22T00:33:30.222 INFO:tasks.workunit.client.1.smithi161.stdout:8/846: dread d1/d1c/d20/d22/d28/d36/d6c/f103 [0,4194304] 0 2024-02-22T00:33:30.222 INFO:tasks.workunit.client.1.smithi161.stdout:4/799: fsync d5/d8/d41/d53/d6c/d72/dfb/f106 0 2024-02-22T00:33:30.224 INFO:tasks.workunit.client.1.smithi161.stdout:9/835: rmdir d1/d5/d9 39 2024-02-22T00:33:30.225 INFO:tasks.workunit.client.1.smithi161.stdout:6/811: creat d3/d10/d12/d2f/d7d/dab/dbe/f100 x:0 0 0 2024-02-22T00:33:30.226 INFO:tasks.workunit.client.1.smithi161.stdout:0/809: readlink d14/l15 0 2024-02-22T00:33:30.229 INFO:tasks.workunit.client.1.smithi161.stdout:7/862: symlink d3/df/d33/d35/d55/d63/d7b/d8f/l113 0 2024-02-22T00:33:30.232 INFO:tasks.workunit.client.1.smithi161.stdout:6/812: unlink d3/dc/df/d32/ceb 0 2024-02-22T00:33:30.233 INFO:tasks.workunit.client.1.smithi161.stdout:0/810: creat d14/d9b/f112 x:0 0 0 2024-02-22T00:33:30.234 INFO:tasks.workunit.client.1.smithi161.stdout:7/863: chown d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/l8a 12957 1 2024-02-22T00:33:30.235 INFO:tasks.workunit.client.1.smithi161.stdout:9/836: creat d1/d5/d9/da5/dbc/f120 x:0 0 0 2024-02-22T00:33:30.236 INFO:tasks.workunit.client.1.smithi161.stdout:8/847: dwrite d1/d1c/f76 [0,4194304] 0 2024-02-22T00:33:30.236 INFO:tasks.workunit.client.1.smithi161.stdout:4/800: creat d5/d10/f128 x:0 0 0 2024-02-22T00:33:30.238 INFO:tasks.workunit.client.1.smithi161.stdout:8/848: fsync d1/d2f/d37/d64/fd8 0 2024-02-22T00:33:30.238 INFO:tasks.workunit.client.1.smithi161.stdout:0/811: mkdir d14/d44/dbf/deb/d113 0 2024-02-22T00:33:30.240 INFO:tasks.workunit.client.1.smithi161.stdout:8/849: chown d1/d1c/d20/dc0 54879850 1 2024-02-22T00:33:30.242 INFO:tasks.workunit.client.1.smithi161.stdout:6/813: creat d3/d10/d12/d2f/d7d/d97/f101 x:0 0 0 2024-02-22T00:33:30.244 INFO:tasks.workunit.client.1.smithi161.stdout:4/801: rename d5/d8/d41/d57/dbe/f77 to d5/d10/d14/d4f/d121/f129 0 2024-02-22T00:33:30.245 INFO:tasks.workunit.client.1.smithi161.stdout:7/864: creat d3/df/d33/f114 x:0 0 0 2024-02-22T00:33:30.246 INFO:tasks.workunit.client.1.smithi161.stdout:1/831: dread d19/d1d/d2c/f4d [0,4194304] 0 2024-02-22T00:33:30.247 INFO:tasks.workunit.client.1.smithi161.stdout:0/812: dread - d14/d1a/d3f/d5d/f69 zero size 2024-02-22T00:33:30.247 INFO:tasks.workunit.client.1.smithi161.stdout:8/850: truncate d1/d1c/d20/fba 1004115 0 2024-02-22T00:33:30.248 INFO:tasks.workunit.client.1.smithi161.stdout:6/814: creat d3/d10/d72/dc5/f102 x:0 0 0 2024-02-22T00:33:30.250 INFO:tasks.workunit.client.1.smithi161.stdout:9/837: dwrite d1/d25/d73/d60/d77/d99/ff1 [4194304,4194304] 0 2024-02-22T00:33:30.252 INFO:tasks.workunit.client.1.smithi161.stdout:0/813: dread - d14/d1a/d3f/d96/dbc/f105 zero size 2024-02-22T00:33:30.252 INFO:tasks.workunit.client.1.smithi161.stdout:1/832: chown d19/d1d/d2c/d2d/d3f/c6a 114 1 2024-02-22T00:33:30.253 INFO:tasks.workunit.client.1.smithi161.stdout:7/865: chown d3/df/d33/d35/d55/d63/d7b/d30/f9a 3357 1 2024-02-22T00:33:30.254 INFO:tasks.workunit.client.1.smithi161.stdout:6/815: symlink d3/d10/d12/d95/l103 0 2024-02-22T00:33:30.256 INFO:tasks.workunit.client.1.smithi161.stdout:0/814: readlink d14/l48 0 2024-02-22T00:33:30.257 INFO:tasks.workunit.client.1.smithi161.stdout:4/802: dread d5/d10/f52 [0,4194304] 0 2024-02-22T00:33:30.260 INFO:tasks.workunit.client.1.smithi161.stdout:6/816: truncate d3/d10/d12/d2f/d7d/d97/fcf 763797 0 2024-02-22T00:33:30.261 INFO:tasks.workunit.client.1.smithi161.stdout:1/833: rmdir d19/d51/d64/d9b/da5/d11c 0 2024-02-22T00:33:30.261 INFO:tasks.workunit.client.1.smithi161.stdout:1/834: stat d19/d90/dcf/le2 0 2024-02-22T00:33:30.264 INFO:tasks.workunit.client.1.smithi161.stdout:7/866: rename d3/f7d to d3/df/d33/f115 0 2024-02-22T00:33:30.265 INFO:tasks.workunit.client.1.smithi161.stdout:9/838: dwrite d1/d2/d4/d95/faf [0,4194304] 0 2024-02-22T00:33:30.265 INFO:tasks.workunit.client.1.smithi161.stdout:1/835: write d19/d51/d64/d9b/da5/ddb/fff [969492,26274] 0 2024-02-22T00:33:30.266 INFO:tasks.workunit.client.1.smithi161.stdout:4/803: mknod d5/d8/d41/d57/dbe/d28/d63/d65/dcd/c12a 0 2024-02-22T00:33:30.273 INFO:tasks.workunit.client.1.smithi161.stdout:9/839: creat d1/d2/d4/d1f/dab/dcd/f121 x:0 0 0 2024-02-22T00:33:30.275 INFO:tasks.workunit.client.1.smithi161.stdout:1/836: dwrite f9 [4194304,4194304] 0 2024-02-22T00:33:30.275 INFO:tasks.workunit.client.1.smithi161.stdout:8/851: write d1/d1c/d20/d22/d28/d36/f7a [1846858,36946] 0 2024-02-22T00:33:30.276 INFO:tasks.workunit.client.1.smithi161.stdout:1/837: fsync d19/d1d/d2c/d2d/d3f/f9f 0 2024-02-22T00:33:30.281 INFO:tasks.workunit.client.1.smithi161.stdout:4/804: mkdir d5/d8/d12b 0 2024-02-22T00:33:30.281 INFO:tasks.workunit.client.1.smithi161.stdout:9/840: symlink d1/d2/d4/d95/l122 0 2024-02-22T00:33:30.281 INFO:tasks.workunit.client.1.smithi161.stdout:7/867: mkdir d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/df8/d116 0 2024-02-22T00:33:30.281 INFO:tasks.workunit.client.1.smithi161.stdout:1/838: creat d19/d48/d68/da8/f121 x:0 0 0 2024-02-22T00:33:30.282 INFO:tasks.workunit.client.1.smithi161.stdout:9/841: readlink d1/d25/dc4/d4f/l106 0 2024-02-22T00:33:30.284 INFO:tasks.workunit.client.1.smithi161.stdout:4/805: truncate d5/d8/d41/d57/dbe/fa4 51954 0 2024-02-22T00:33:30.284 INFO:tasks.workunit.client.1.smithi161.stdout:0/815: dwrite d14/d37/d42/d8e/f98 [0,4194304] 0 2024-02-22T00:33:30.292 INFO:tasks.workunit.client.1.smithi161.stdout:3/834: sync 2024-02-22T00:33:30.292 INFO:tasks.workunit.client.1.smithi161.stdout:3/835: readlink da/dc/d91/lb8 0 2024-02-22T00:33:30.293 INFO:tasks.workunit.client.1.smithi161.stdout:3/836: chown da/f27 135 1 2024-02-22T00:33:30.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:28.510498+0000 mgr.smithi161.sazlam (mgr.24369) 41 : cephadm [INF] Reconfiguring alertmanager.smithi049 (dependencies changed)... 2024-02-22T00:33:30.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:33:28.526647+0000 mgr.smithi161.sazlam (mgr.24369) 42 : cephadm [INF] Reconfiguring daemon alertmanager.smithi049 on smithi049 2024-02-22T00:33:30.303 INFO:tasks.workunit.client.1.smithi161.stdout:0/816: mkdir d14/d1a/d9d/dba/d114 0 2024-02-22T00:33:30.304 INFO:tasks.workunit.client.1.smithi161.stdout:8/852: getdents d1/d2f/d37/d64/d7b 0 2024-02-22T00:33:30.305 INFO:tasks.workunit.client.1.smithi161.stdout:8/853: chown d1/d1c/d20/fc6 9 1 2024-02-22T00:33:30.307 INFO:tasks.workunit.client.1.smithi161.stdout:1/839: dwrite f1 [0,4194304] 0 2024-02-22T00:33:30.311 INFO:tasks.workunit.client.1.smithi161.stdout:1/840: dread d19/d51/da1/f10a [0,4194304] 0 2024-02-22T00:33:30.312 INFO:tasks.workunit.client.1.smithi161.stdout:1/841: chown d19/d1d/d56/c115 5892163 1 2024-02-22T00:33:30.313 INFO:tasks.workunit.client.1.smithi161.stdout:1/842: readlink d19/d51/d64/d9b/da5/daa/lda 0 2024-02-22T00:33:30.340 INFO:tasks.workunit.client.1.smithi161.stdout:6/817: write d3/d10/d12/d2f/d7d/dab/dbe/ff0 [666124,62284] 0 2024-02-22T00:33:30.341 INFO:tasks.workunit.client.1.smithi161.stdout:9/842: creat d1/d5/d9/da5/d11a/f123 x:0 0 0 2024-02-22T00:33:30.346 INFO:tasks.workunit.client.1.smithi161.stdout:6/818: dwrite d3/d10/fb0 [0,4194304] 0 2024-02-22T00:33:30.348 INFO:tasks.workunit.client.1.smithi161.stdout:4/806: rename d5/d8/f9 to d5/d8/f12c 0 2024-02-22T00:33:30.349 INFO:tasks.workunit.client.1.smithi161.stdout:9/843: creat d1/d2/d4/d95/db8/f124 x:0 0 0 2024-02-22T00:33:30.350 INFO:tasks.workunit.client.1.smithi161.stdout:0/817: symlink d14/d37/d42/d8e/l115 0 2024-02-22T00:33:30.353 INFO:tasks.workunit.client.1.smithi161.stdout:6/819: creat d3/d10/d12/d2f/d7d/dab/dbe/f104 x:0 0 0 2024-02-22T00:33:30.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/820: write d3/d30/f74 [328118,49757] 0 2024-02-22T00:33:30.355 INFO:tasks.workunit.client.1.smithi161.stdout:9/844: creat d1/d25/d73/d60/d77/d99/f125 x:0 0 0 2024-02-22T00:33:30.356 INFO:tasks.workunit.client.1.smithi161.stdout:8/854: link d1/d1c/d75/f3a d1/d1c/d20/f116 0 2024-02-22T00:33:30.357 INFO:tasks.workunit.client.1.smithi161.stdout:9/845: read - d1/d25/d73/d60/f11b zero size 2024-02-22T00:33:30.360 INFO:tasks.workunit.client.1.smithi161.stdout:6/821: mknod d3/d10/d72/dc5/c105 0 2024-02-22T00:33:30.361 INFO:tasks.workunit.client.1.smithi161.stdout:0/818: mknod d14/d29/dd4/c116 0 2024-02-22T00:33:30.364 INFO:tasks.workunit.client.1.smithi161.stdout:0/819: dread d14/d44/fe7 [0,4194304] 0 2024-02-22T00:33:30.365 INFO:tasks.workunit.client.1.smithi161.stdout:6/822: rename d3/dc/c16 to d3/dc/df/c106 0 2024-02-22T00:33:30.365 INFO:tasks.workunit.client.1.smithi161.stdout:1/843: truncate d19/d1d/d2c/d7d/f7f 2081765 0 2024-02-22T00:33:30.366 INFO:tasks.workunit.client.1.smithi161.stdout:1/844: write d19/d1d/d2c/ff4 [154969,31106] 0 2024-02-22T00:33:30.369 INFO:tasks.workunit.client.1.smithi161.stdout:0/820: creat d14/d1a/d3f/d96/dad/f117 x:0 0 0 2024-02-22T00:33:30.371 INFO:tasks.workunit.client.1.smithi161.stdout:6/823: mkdir d3/dc/d107 0 2024-02-22T00:33:30.371 INFO:tasks.workunit.client.1.smithi161.stdout:1/845: dread d19/d1d/d2c/d7d/f93 [0,4194304] 0 2024-02-22T00:33:30.372 INFO:tasks.workunit.client.1.smithi161.stdout:0/821: write d14/d37/d42/d8e/d92/fee [209343,41830] 0 2024-02-22T00:33:30.374 INFO:tasks.workunit.client.1.smithi161.stdout:8/855: truncate d1/d1c/d20/d22/fcd 731707 0 2024-02-22T00:33:30.375 INFO:tasks.workunit.client.1.smithi161.stdout:0/822: fsync d14/d44/dbe/fe3 0 2024-02-22T00:33:30.377 INFO:tasks.workunit.client.1.smithi161.stdout:4/807: dwrite d5/d8/d41/d57/dbe/d28/d63/d65/f102 [0,4194304] 0 2024-02-22T00:33:30.377 INFO:tasks.workunit.client.1.smithi161.stdout:0/823: stat d14/d37/d42/l4f 0 2024-02-22T00:33:30.377 INFO:tasks.workunit.client.1.smithi161.stdout:1/846: truncate d19/d51/d64/d9b/da5/ddb/fff 1716350 0 2024-02-22T00:33:30.379 INFO:tasks.workunit.client.1.smithi161.stdout:1/847: write d19/d85/d87/fb1 [1309855,5129] 0 2024-02-22T00:33:30.380 INFO:tasks.workunit.client.1.smithi161.stdout:6/824: getdents d3/d10/d12/d2f/d7d/dab 0 2024-02-22T00:33:30.382 INFO:tasks.workunit.client.1.smithi161.stdout:4/808: write d5/d8/d41/d57/dbe/d28/fa2 [526801,33509] 0 2024-02-22T00:33:30.385 INFO:tasks.workunit.client.1.smithi161.stdout:6/825: stat d3/d10/d72/ce0 0 2024-02-22T00:33:30.389 INFO:tasks.workunit.client.1.smithi161.stdout:8/856: dwrite d1/d1c/d20/d22/d28/d7f/d92/fc3 [0,4194304] 0 2024-02-22T00:33:30.389 INFO:tasks.workunit.client.1.smithi161.stdout:0/824: dwrite d14/f4b [0,4194304] 0 2024-02-22T00:33:30.391 INFO:tasks.workunit.client.1.smithi161.stdout:8/857: fdatasync d1/d1c/d20/d22/f90 0 2024-02-22T00:33:30.391 INFO:tasks.workunit.client.1.smithi161.stdout:4/809: mkdir d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/d12d 0 2024-02-22T00:33:30.391 INFO:tasks.workunit.client.1.smithi161.stdout:0/825: dread - d14/d37/d42/d8e/fd9 zero size 2024-02-22T00:33:30.394 INFO:tasks.workunit.client.1.smithi161.stdout:0/826: symlink d14/d9b/l118 0 2024-02-22T00:33:30.395 INFO:tasks.workunit.client.1.smithi161.stdout:8/858: rmdir d1/d2f/d37/d64/d7b/d7e 39 2024-02-22T00:33:30.396 INFO:tasks.workunit.client.1.smithi161.stdout:1/848: write d19/f9d [891994,52428] 0 2024-02-22T00:33:30.396 INFO:tasks.workunit.client.1.smithi161.stdout:8/859: fdatasync d1/d1c/d75/f15 0 2024-02-22T00:33:30.397 INFO:tasks.workunit.client.1.smithi161.stdout:4/810: mkdir d5/d8/d41/d53/d6c/d72/d12e 0 2024-02-22T00:33:30.397 INFO:tasks.workunit.client.1.smithi161.stdout:1/849: write d19/f1f [988038,63697] 0 2024-02-22T00:33:30.398 INFO:tasks.workunit.client.1.smithi161.stdout:0/827: mkdir d14/d1a/d9d/dba/d119 0 2024-02-22T00:33:30.405 INFO:tasks.workunit.client.1.smithi161.stdout:8/860: unlink d1/d1c/ffb 0 2024-02-22T00:33:30.406 INFO:tasks.workunit.client.1.smithi161.stdout:0/828: dwrite d14/d1a/d3f/d96/fae [0,4194304] 0 2024-02-22T00:33:30.408 INFO:tasks.workunit.client.1.smithi161.stdout:4/811: rename d5/d17/d5c/l7e to d5/d10/d10e/l12f 0 2024-02-22T00:33:30.414 INFO:tasks.workunit.client.1.smithi161.stdout:0/829: symlink d14/d37/d42/d73/dc7/de0/de5/l11a 0 2024-02-22T00:33:30.417 INFO:tasks.workunit.client.1.smithi161.stdout:1/850: rename d19/d51/d64/d9b/le8 to d19/d51/d64/d9b/da5/ddb/l122 0 2024-02-22T00:33:30.417 INFO:tasks.workunit.client.1.smithi161.stdout:1/851: chown d19/d48/d68/f71 264468969 1 2024-02-22T00:33:30.422 INFO:tasks.workunit.client.1.smithi161.stdout:0/830: unlink d14/d37/d42/d73/ffb 0 2024-02-22T00:33:30.423 INFO:tasks.workunit.client.1.smithi161.stdout:0/831: write d14/d37/d42/d8e/d92/fee [596165,67042] 0 2024-02-22T00:33:30.426 INFO:tasks.workunit.client.1.smithi161.stdout:4/812: write d5/d8/d41/d57/dbe/d28/fba [910552,45248] 0 2024-02-22T00:33:30.426 INFO:tasks.workunit.client.1.smithi161.stdout:8/861: link d1/d2f/d37/l49 d1/d1c/d20/d22/d28/d7f/d92/l117 0 2024-02-22T00:33:30.428 INFO:tasks.workunit.client.1.smithi161.stdout:0/832: chown d14/d1a/d9d/dba/cf9 0 1 2024-02-22T00:33:30.429 INFO:tasks.workunit.client.1.smithi161.stdout:4/813: mkdir d5/d8/d41/d53/d6c/d130 0 2024-02-22T00:33:30.430 INFO:tasks.workunit.client.1.smithi161.stdout:1/852: dwrite d19/d1d/d2c/d2d/d3f/f10b [0,4194304] 0 2024-02-22T00:33:30.436 INFO:tasks.workunit.client.1.smithi161.stdout:8/862: dwrite d1/d1c/d20/de6/ffc [0,4194304] 0 2024-02-22T00:33:30.437 INFO:tasks.workunit.client.1.smithi161.stdout:1/853: mkdir d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d123 0 2024-02-22T00:33:30.438 INFO:tasks.workunit.client.1.smithi161.stdout:4/814: mkdir d5/d8/d41/d57/dbe/d131 0 2024-02-22T00:33:30.439 INFO:tasks.workunit.client.1.smithi161.stdout:8/863: stat d1/d1c/d20/d22/d28/d7f/d92/d95/c6f 0 2024-02-22T00:33:30.440 INFO:tasks.workunit.client.1.smithi161.stdout:7/868: sync 2024-02-22T00:33:30.440 INFO:tasks.workunit.client.1.smithi161.stdout:2/936: sync 2024-02-22T00:33:30.440 INFO:tasks.workunit.client.1.smithi161.stdout:3/837: sync 2024-02-22T00:33:30.440 INFO:tasks.workunit.client.1.smithi161.stdout:1/854: creat d19/d51/d64/d9b/da5/dbc/f124 x:0 0 0 2024-02-22T00:33:30.441 INFO:tasks.workunit.client.1.smithi161.stdout:4/815: mkdir d5/db0/d132 0 2024-02-22T00:33:30.441 INFO:tasks.workunit.client.1.smithi161.stdout:0/833: link d14/d37/d42/d8e/d92/da5/dcd/led d14/d44/dbf/deb/d113/l11b 0 2024-02-22T00:33:30.442 INFO:tasks.workunit.client.1.smithi161.stdout:4/816: chown d5/db0/d132 411 1 2024-02-22T00:33:30.442 INFO:tasks.workunit.client.1.smithi161.stdout:8/864: mknod d1/d2f/dc5/c118 0 2024-02-22T00:33:30.446 INFO:tasks.workunit.client.1.smithi161.stdout:4/817: dread d5/d10/f52 [0,4194304] 0 2024-02-22T00:33:30.447 INFO:tasks.workunit.client.1.smithi161.stdout:7/869: creat d3/dbf/d64/f117 x:0 0 0 2024-02-22T00:33:30.448 INFO:tasks.workunit.client.1.smithi161.stdout:1/855: mkdir d19/d90/d125 0 2024-02-22T00:33:30.450 INFO:tasks.workunit.client.1.smithi161.stdout:8/865: mknod d1/d1c/d20/d22/d3f/c119 0 2024-02-22T00:33:30.452 INFO:tasks.workunit.client.1.smithi161.stdout:8/866: chown d1/d2f/d37/d64/fd8 129467 1 2024-02-22T00:33:30.453 INFO:tasks.workunit.client.1.smithi161.stdout:4/818: dwrite d5/d10/d14/f112 [4194304,4194304] 0 2024-02-22T00:33:30.455 INFO:tasks.workunit.client.1.smithi161.stdout:4/819: write d5/d8/d41/d57/dbe/d28/d38/d6d/da5/f125 [68258,68100] 0 2024-02-22T00:33:30.455 INFO:tasks.workunit.client.1.smithi161.stdout:7/870: creat d3/dbf/dab/f118 x:0 0 0 2024-02-22T00:33:30.455 INFO:tasks.workunit.client.1.smithi161.stdout:0/834: mknod d14/d37/d42/d8e/c11c 0 2024-02-22T00:33:30.459 INFO:tasks.workunit.client.1.smithi161.stdout:2/937: write de/d11/fae [3751622,70535] 0 2024-02-22T00:33:30.459 INFO:tasks.workunit.client.1.smithi161.stdout:4/820: fsync d5/d10/f1d 0 2024-02-22T00:33:30.462 INFO:tasks.workunit.client.1.smithi161.stdout:0/835: symlink d14/d37/d42/d73/dc7/de0/l11d 0 2024-02-22T00:33:30.462 INFO:tasks.workunit.client.1.smithi161.stdout:2/938: fsync de/d11/f8a 0 2024-02-22T00:33:30.463 INFO:tasks.workunit.client.1.smithi161.stdout:8/867: chown d1/d2f/d37/d64/d7b/f101 1235 1 2024-02-22T00:33:30.465 INFO:tasks.workunit.client.1.smithi161.stdout:4/821: read d5/d10/d14/f7a [3631832,105663] 0 2024-02-22T00:33:30.466 INFO:tasks.workunit.client.1.smithi161.stdout:0/836: write d14/d37/d42/d8e/d92/fd6 [2625857,7552] 0 2024-02-22T00:33:30.466 INFO:tasks.workunit.client.1.smithi161.stdout:8/868: chown d1/d1c/f3d 3355863 1 2024-02-22T00:33:30.470 INFO:tasks.workunit.client.1.smithi161.stdout:1/856: dwrite d19/d51/fd3 [0,4194304] 0 2024-02-22T00:33:30.470 INFO:tasks.workunit.client.1.smithi161.stdout:0/837: chown d14/f82 62118 1 2024-02-22T00:33:30.470 INFO:tasks.workunit.client.1.smithi161.stdout:7/871: getdents d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/d110 0 2024-02-22T00:33:30.472 INFO:tasks.workunit.client.1.smithi161.stdout:8/869: dread - d1/d1c/d20/d22/d28/d36/fec zero size 2024-02-22T00:33:30.472 INFO:tasks.workunit.client.1.smithi161.stdout:0/838: chown d14/l48 66274 1 2024-02-22T00:33:30.473 INFO:tasks.workunit.client.1.smithi161.stdout:1/857: dread - d19/d48/f11e zero size 2024-02-22T00:33:30.474 INFO:tasks.workunit.client.1.smithi161.stdout:4/822: fdatasync d5/d8/d41/d57/dbe/d28/d63/d65/fc7 0 2024-02-22T00:33:30.474 INFO:tasks.workunit.client.1.smithi161.stdout:2/939: dread de/d2b/d8b/ddc/fec [0,4194304] 0 2024-02-22T00:33:30.476 INFO:tasks.workunit.client.1.smithi161.stdout:7/872: truncate d3/dd/d59/fbe 426292 0 2024-02-22T00:33:30.477 INFO:tasks.workunit.client.1.smithi161.stdout:7/873: readlink d3/df/d33/d35/d55/d63/d7b/l2e 0 2024-02-22T00:33:30.480 INFO:tasks.workunit.client.1.smithi161.stdout:2/940: chown de/d2b/d8b/ddc/d125/cf2 24 1 2024-02-22T00:33:30.482 INFO:tasks.workunit.client.1.smithi161.stdout:0/839: dwrite d14/d1a/d3f/f80 [0,4194304] 0 2024-02-22T00:33:30.482 INFO:tasks.workunit.client.1.smithi161.stdout:4/823: creat d5/d8/d41/d57/dbe/f133 x:0 0 0 2024-02-22T00:33:30.482 INFO:tasks.workunit.client.1.smithi161.stdout:7/874: read - d3/df/d33/d35/d55/d63/d7b/d30/d44/fe0 zero size 2024-02-22T00:33:30.485 INFO:tasks.workunit.client.1.smithi161.stdout:0/840: read d14/d37/d42/d73/fa8 [1487274,60787] 0 2024-02-22T00:33:30.485 INFO:tasks.workunit.client.1.smithi161.stdout:2/941: read de/d2b/d8b/ddc/d125/d3a/d9d/fa9 [903465,5428] 0 2024-02-22T00:33:30.485 INFO:tasks.workunit.client.1.smithi161.stdout:7/875: stat d3/df/d33/d35/d55/d63/d7b/d50/lf6 0 2024-02-22T00:33:30.487 INFO:tasks.workunit.client.1.smithi161.stdout:4/824: mkdir d5/d10/d14/d134 0 2024-02-22T00:33:30.488 INFO:tasks.workunit.client.1.smithi161.stdout:0/841: fdatasync d14/d1a/f79 0 2024-02-22T00:33:30.490 INFO:tasks.workunit.client.1.smithi161.stdout:2/942: getdents de/d2b/d8b/da2/da5/d140 0 2024-02-22T00:33:30.491 INFO:tasks.workunit.client.1.smithi161.stdout:8/870: dread d1/d1c/fa4 [4194304,4194304] 0 2024-02-22T00:33:30.493 INFO:tasks.workunit.client.1.smithi161.stdout:0/842: symlink d14/d1a/d3f/d108/l11e 0 2024-02-22T00:33:30.495 INFO:tasks.workunit.client.1.smithi161.stdout:7/876: dwrite d3/df/f106 [0,4194304] 0 2024-02-22T00:33:30.495 INFO:tasks.workunit.client.1.smithi161.stdout:0/843: dread - d14/d9b/f112 zero size 2024-02-22T00:33:30.495 INFO:tasks.workunit.client.1.smithi161.stdout:2/943: fsync de/d2b/d8b/ddc/d125/d3a/fcb 0 2024-02-22T00:33:30.496 INFO:tasks.workunit.client.1.smithi161.stdout:4/825: truncate d5/d8/d41/d53/d6c/d72/f8e 2101760 0 2024-02-22T00:33:30.498 INFO:tasks.workunit.client.1.smithi161.stdout:8/871: mkdir d1/d1c/d20/de6/d11a 0 2024-02-22T00:33:30.498 INFO:tasks.workunit.client.1.smithi161.stdout:0/844: chown d14/d37/d42/d73/dc7/de0/l11d 51873393 1 2024-02-22T00:33:30.499 INFO:tasks.workunit.client.1.smithi161.stdout:7/877: chown d3/df/c18 264438019 1 2024-02-22T00:33:30.503 INFO:tasks.workunit.client.1.smithi161.stdout:4/826: unlink d5/d8/d41/d57/dbe/d28/c9c 0 2024-02-22T00:33:30.503 INFO:tasks.workunit.client.1.smithi161.stdout:8/872: creat d1/d1c/d20/d22/d28/d7f/d109/f11b x:0 0 0 2024-02-22T00:33:30.505 INFO:tasks.workunit.client.1.smithi161.stdout:2/944: mknod de/d2b/d8b/ddc/d125/d60/d68/c147 0 2024-02-22T00:33:30.506 INFO:tasks.workunit.client.1.smithi161.stdout:2/945: fdatasync de/d11/d14/faa 0 2024-02-22T00:33:30.507 INFO:tasks.workunit.client.1.smithi161.stdout:0/845: fdatasync d14/d37/d42/fb2 0 2024-02-22T00:33:30.511 INFO:tasks.workunit.client.1.smithi161.stdout:1/858: dread d19/f43 [0,4194304] 0 2024-02-22T00:33:30.513 INFO:tasks.workunit.client.1.smithi161.stdout:8/873: dwrite d1/d1c/d20/d22/d28/d36/fec [0,4194304] 0 2024-02-22T00:33:30.516 INFO:tasks.workunit.client.1.smithi161.stdout:0/846: creat d14/d37/d42/d8e/d92/da5/f11f x:0 0 0 2024-02-22T00:33:30.517 INFO:tasks.workunit.client.1.smithi161.stdout:2/946: rmdir de/d2b/d8b/ddc/d125/d60 39 2024-02-22T00:33:30.517 INFO:tasks.workunit.client.1.smithi161.stdout:0/847: chown d14/d44/cc1 79763300 1 2024-02-22T00:33:30.518 INFO:tasks.workunit.client.1.smithi161.stdout:2/947: readlink de/d2b/d8b/ddc/d125/d3a/la4 0 2024-02-22T00:33:30.519 INFO:tasks.workunit.client.1.smithi161.stdout:4/827: getdents d5/d10/da9 0 2024-02-22T00:33:30.521 INFO:tasks.workunit.client.1.smithi161.stdout:8/874: readlink d1/d1c/d20/d22/d28/d7f/d92/l117 0 2024-02-22T00:33:30.523 INFO:tasks.workunit.client.1.smithi161.stdout:0/848: dwrite d14/f82 [0,4194304] 0 2024-02-22T00:33:30.528 INFO:tasks.workunit.client.1.smithi161.stdout:1/859: rename d19/d1d/d2c/d2d/fe3 to d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/f126 0 2024-02-22T00:33:30.529 INFO:tasks.workunit.client.1.smithi161.stdout:1/860: truncate d19/d48/f11e 69664 0 2024-02-22T00:33:30.530 INFO:tasks.workunit.client.1.smithi161.stdout:8/875: symlink d1/d1c/d75/l11c 0 2024-02-22T00:33:30.531 INFO:tasks.workunit.client.1.smithi161.stdout:2/948: read de/d2b/d8b/ddc/d125/f9c [5108,8436] 0 2024-02-22T00:33:30.531 INFO:tasks.workunit.client.1.smithi161.stdout:7/878: link d3/df/d33/d35/d55/d63/d7b/d30/dc0/ff9 d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/d110/d107/f119 0 2024-02-22T00:33:30.534 INFO:tasks.workunit.client.1.smithi161.stdout:1/861: read f10 [126849,25116] 0 2024-02-22T00:33:30.534 INFO:tasks.workunit.client.1.smithi161.stdout:1/862: dread - d19/d1d/d2c/d2d/fcd zero size 2024-02-22T00:33:30.536 INFO:tasks.workunit.client.1.smithi161.stdout:0/849: rename d14/d1a/d3f/d5d/f69 to d14/d1a/d9d/f120 0 2024-02-22T00:33:30.538 INFO:tasks.workunit.client.1.smithi161.stdout:0/850: fsync d14/d1a/d3f/d96/dad/f117 0 2024-02-22T00:33:30.539 INFO:tasks.workunit.client.1.smithi161.stdout:2/949: creat de/d11/d5c/dea/df8/f148 x:0 0 0 2024-02-22T00:33:30.543 INFO:tasks.workunit.client.1.smithi161.stdout:7/879: dread d3/df/d43/f76 [4194304,4194304] 0 2024-02-22T00:33:30.544 INFO:tasks.workunit.client.1.smithi161.stdout:8/876: fsync d1/d1c/d20/d22/f35 0 2024-02-22T00:33:30.544 INFO:tasks.workunit.client.1.smithi161.stdout:9/846: sync 2024-02-22T00:33:30.545 INFO:tasks.workunit.client.1.smithi161.stdout:1/863: dwrite d19/d1d/d2c/d2d/f75 [0,4194304] 0 2024-02-22T00:33:30.546 INFO:tasks.workunit.client.1.smithi161.stdout:2/950: symlink de/d2b/d8b/ddc/l149 0 2024-02-22T00:33:30.546 INFO:tasks.workunit.client.1.smithi161.stdout:4/828: dread d5/d8/d41/f54 [0,4194304] 0 2024-02-22T00:33:30.548 INFO:tasks.workunit.client.1.smithi161.stdout:7/880: write d3/df/d33/f114 [904005,9688] 0 2024-02-22T00:33:30.554 INFO:tasks.workunit.client.1.smithi161.stdout:0/851: dwrite d14/f18 [0,4194304] 0 2024-02-22T00:33:30.555 INFO:tasks.workunit.client.1.smithi161.stdout:9/847: creat d1/d5/d9/da5/dbc/d115/f126 x:0 0 0 2024-02-22T00:33:30.555 INFO:tasks.workunit.client.1.smithi161.stdout:7/881: chown d3/df/d33/d35/d55/de4/f51 11 1 2024-02-22T00:33:30.555 INFO:tasks.workunit.client.1.smithi161.stdout:8/877: dread d1/d1c/d20/d22/d3f/f63 [0,4194304] 0 2024-02-22T00:33:30.556 INFO:tasks.workunit.client.1.smithi161.stdout:0/852: readlink d14/l20 0 2024-02-22T00:33:30.556 INFO:tasks.workunit.client.1.smithi161.stdout:2/951: link de/d2b/d83/f70 de/d11/f14a 0 2024-02-22T00:33:30.557 INFO:tasks.workunit.client.1.smithi161.stdout:9/848: write d1/d25/dc4/fba [3456017,52587] 0 2024-02-22T00:33:30.558 INFO:tasks.workunit.client.1.smithi161.stdout:4/829: rename d5/d10/d14/f45 to d5/d8/d41/d53/d6c/d72/dfb/f135 0 2024-02-22T00:33:30.561 INFO:tasks.workunit.client.1.smithi161.stdout:3/838: sync 2024-02-22T00:33:30.563 INFO:tasks.workunit.client.1.smithi161.stdout:6/826: sync 2024-02-22T00:33:30.563 INFO:tasks.workunit.client.1.smithi161.stdout:7/882: unlink d3/df/d33/d35/d55/d63/d7b/d30/d44/fec 0 2024-02-22T00:33:30.567 INFO:tasks.workunit.client.1.smithi161.stdout:8/878: getdents d1/d1c/d20/d22/d28/d36/d6c/dbe 0 2024-02-22T00:33:30.570 INFO:tasks.workunit.client.1.smithi161.stdout:7/883: stat d3/df/d33/d35/d55/de4 0 2024-02-22T00:33:30.573 INFO:tasks.workunit.client.1.smithi161.stdout:0/853: dwrite d14/d1a/d9d/dba/fe9 [0,4194304] 0 2024-02-22T00:33:30.575 INFO:tasks.workunit.client.1.smithi161.stdout:3/839: rename da/d29/d53 to da/dc/d11/d26/d80/dc7/d108/d10d 0 2024-02-22T00:33:30.576 INFO:tasks.workunit.client.1.smithi161.stdout:6/827: dread d3/d10/d12/d2f/d7d/d97/fcf [0,4194304] 0 2024-02-22T00:33:30.577 INFO:tasks.workunit.client.1.smithi161.stdout:9/849: dwrite d1/d2/d4/d1f/dab/ffc [0,4194304] 0 2024-02-22T00:33:30.579 INFO:tasks.workunit.client.1.smithi161.stdout:9/850: readlink d1/d25/l50 0 2024-02-22T00:33:30.582 INFO:tasks.workunit.client.1.smithi161.stdout:9/851: write d1/d2/d7/fc0 [5972884,129460] 0 2024-02-22T00:33:30.582 INFO:tasks.workunit.client.1.smithi161.stdout:6/828: mkdir d3/d7c/d108 0 2024-02-22T00:33:30.583 INFO:tasks.workunit.client.1.smithi161.stdout:6/829: readlink d3/d10/d72/dc5/le8 0 2024-02-22T00:33:30.583 INFO:tasks.workunit.client.1.smithi161.stdout:9/852: chown d1/d25/dc4/fba 2 1 2024-02-22T00:33:30.583 INFO:tasks.workunit.client.1.smithi161.stdout:9/853: readlink d1/l3a 0 2024-02-22T00:33:30.585 INFO:tasks.workunit.client.1.smithi161.stdout:4/830: rename d5/d8/d41/d57/dbe/d28/d63/d65/fdc to d5/d8/d41/d57/dbe/d28/d63/d65/dcd/d123/f136 0 2024-02-22T00:33:30.585 INFO:tasks.workunit.client.1.smithi161.stdout:1/864: dread d19/d48/f92 [0,4194304] 0 2024-02-22T00:33:30.586 INFO:tasks.workunit.client.1.smithi161.stdout:7/884: creat d3/dd/f11a x:0 0 0 2024-02-22T00:33:30.592 INFO:tasks.workunit.client.1.smithi161.stdout:4/831: mknod d5/d8/d41/d53/d6c/d72/dfb/c137 0 2024-02-22T00:33:30.593 INFO:tasks.workunit.client.1.smithi161.stdout:1/865: dwrite d19/d48/f5c [4194304,4194304] 0 2024-02-22T00:33:30.597 INFO:tasks.workunit.client.1.smithi161.stdout:6/830: link d3/d10/d72/ce0 d3/d7c/da6/c109 0 2024-02-22T00:33:30.600 INFO:tasks.workunit.client.1.smithi161.stdout:7/885: creat d3/df/d33/d35/d55/d63/d7b/d30/dc0/f11b x:0 0 0 2024-02-22T00:33:30.602 INFO:tasks.workunit.client.1.smithi161.stdout:1/866: mkdir d19/d1d/d2c/d2d/d3f/d118/d127 0 2024-02-22T00:33:30.602 INFO:tasks.workunit.client.1.smithi161.stdout:4/832: dwrite d5/d10/d14/fb7 [0,4194304] 0 2024-02-22T00:33:30.607 INFO:tasks.workunit.client.1.smithi161.stdout:1/867: creat d19/d85/f128 x:0 0 0 2024-02-22T00:33:30.608 INFO:tasks.workunit.client.1.smithi161.stdout:1/868: truncate d19/d51/ffe 627196 0 2024-02-22T00:33:30.609 INFO:tasks.workunit.client.1.smithi161.stdout:1/869: write d19/d51/d6c/fee [600822,5648] 0 2024-02-22T00:33:30.610 INFO:tasks.workunit.client.1.smithi161.stdout:6/831: link d3/d10/d12/f23 d3/dc/df/d32/f10a 0 2024-02-22T00:33:30.611 INFO:tasks.workunit.client.1.smithi161.stdout:3/840: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f89 [0,4194304] 0 2024-02-22T00:33:30.612 INFO:tasks.workunit.client.1.smithi161.stdout:4/833: symlink d5/l138 0 2024-02-22T00:33:30.613 INFO:tasks.workunit.client.1.smithi161.stdout:8/879: truncate d1/d1c/d20/d22/d28/d7f/d92/d95/f50 3571395 0 2024-02-22T00:33:30.615 INFO:tasks.workunit.client.1.smithi161.stdout:1/870: readlink d19/d51/d64/d9b/da5/ddb/l122 0 2024-02-22T00:33:30.616 INFO:tasks.workunit.client.1.smithi161.stdout:9/854: dread d1/d2/d7/da/fa0 [0,4194304] 0 2024-02-22T00:33:30.617 INFO:tasks.workunit.client.1.smithi161.stdout:8/880: dread d1/d1c/d20/d22/d3f/f63 [0,4194304] 0 2024-02-22T00:33:30.620 INFO:tasks.workunit.client.1.smithi161.stdout:8/881: chown d1/d1c/d96/fc7 53638363 1 2024-02-22T00:33:30.621 INFO:tasks.workunit.client.1.smithi161.stdout:1/871: symlink d19/d51/d64/d9b/l129 0 2024-02-22T00:33:30.622 INFO:tasks.workunit.client.1.smithi161.stdout:4/834: dwrite d5/d10/d14/d4f/fec [0,4194304] 0 2024-02-22T00:33:30.622 INFO:tasks.workunit.client.1.smithi161.stdout:1/872: fdatasync d19/d48/f11f 0 2024-02-22T00:33:30.623 INFO:tasks.workunit.client.1.smithi161.stdout:9/855: symlink d1/d5/d9/da5/dbc/d115/l127 0 2024-02-22T00:33:30.623 INFO:tasks.workunit.client.1.smithi161.stdout:4/835: fsync d5/d10/d14/fad 0 2024-02-22T00:33:30.624 INFO:tasks.workunit.client.1.smithi161.stdout:6/832: getdents d3/dc/df/d32/dd9 0 2024-02-22T00:33:30.625 INFO:tasks.workunit.client.1.smithi161.stdout:1/873: write d19/d85/f128 [46213,87839] 0 2024-02-22T00:33:30.626 INFO:tasks.workunit.client.1.smithi161.stdout:3/841: getdents da/dc/d5f/d66/df9 0 2024-02-22T00:33:30.627 INFO:tasks.workunit.client.1.smithi161.stdout:9/856: rmdir d1/d5/d9 39 2024-02-22T00:33:30.628 INFO:tasks.workunit.client.1.smithi161.stdout:1/874: write d19/d1d/d56/db2/fc1 [712520,49517] 0 2024-02-22T00:33:30.629 INFO:tasks.workunit.client.1.smithi161.stdout:9/857: chown d1/d25/d73/cf8 0 1 2024-02-22T00:33:30.631 INFO:tasks.workunit.client.1.smithi161.stdout:8/882: fdatasync d1/d1c/d20/f116 0 2024-02-22T00:33:30.632 INFO:tasks.workunit.client.1.smithi161.stdout:6/833: creat d3/dc/df/dfd/f10b x:0 0 0 2024-02-22T00:33:30.638 INFO:tasks.workunit.client.1.smithi161.stdout:3/842: rename da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/fe8 to da/dc/d11/d26/d80/dc7/dfe/f10e 0 2024-02-22T00:33:30.639 INFO:tasks.workunit.client.1.smithi161.stdout:8/883: dwrite d1/d2f/d37/d64/fa9 [0,4194304] 0 2024-02-22T00:33:30.640 INFO:tasks.workunit.client.1.smithi161.stdout:3/843: chown da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff 15564869 1 2024-02-22T00:33:30.642 INFO:tasks.workunit.client.1.smithi161.stdout:9/858: creat d1/d25/dc4/d4f/f128 x:0 0 0 2024-02-22T00:33:30.643 INFO:tasks.workunit.client.1.smithi161.stdout:1/875: mknod d19/d1d/d2c/c12a 0 2024-02-22T00:33:30.643 INFO:tasks.workunit.client.1.smithi161.stdout:9/859: chown d1/d2/d7/da/f3c 62 1 2024-02-22T00:33:30.645 INFO:tasks.workunit.client.1.smithi161.stdout:6/834: truncate d3/d10/d12/d2f/d7d/d97/fcf 481561 0 2024-02-22T00:33:30.649 INFO:tasks.workunit.client.1.smithi161.stdout:4/836: getdents d5/d10/d75 0 2024-02-22T00:33:30.651 INFO:tasks.workunit.client.1.smithi161.stdout:4/837: read d5/d10/d14/d4f/fe4 [965600,64528] 0 2024-02-22T00:33:30.652 INFO:tasks.workunit.client.1.smithi161.stdout:9/860: mkdir d1/d2/d4/d11/d129 0 2024-02-22T00:33:30.652 INFO:tasks.workunit.client.1.smithi161.stdout:8/884: dread d1/d2f/f97 [0,4194304] 0 2024-02-22T00:33:30.652 INFO:tasks.workunit.client.1.smithi161.stdout:6/835: dwrite d3/d10/d12/f2d [4194304,4194304] 0 2024-02-22T00:33:30.653 INFO:tasks.workunit.client.1.smithi161.stdout:3/844: link da/dc/d11/d26/d80/dc7/d108/d10d/dc1/dce/ce9 da/dc/d11/d26/d80/dc7/dfe/c10f 0 2024-02-22T00:33:30.654 INFO:tasks.workunit.client.1.smithi161.stdout:9/861: fsync d1/d2/d4/fa4 0 2024-02-22T00:33:30.658 INFO:tasks.workunit.client.1.smithi161.stdout:3/845: creat da/dc/d10b/f110 x:0 0 0 2024-02-22T00:33:30.660 INFO:tasks.workunit.client.1.smithi161.stdout:8/885: mkdir d1/d1c/d20/d22/d28/d7f/db4/d11d 0 2024-02-22T00:33:30.662 INFO:tasks.workunit.client.1.smithi161.stdout:3/846: fdatasync da/dc/f1f 0 2024-02-22T00:33:30.665 INFO:tasks.workunit.client.1.smithi161.stdout:4/838: link d5/d8/d41/d57/dbe/d28/d38/d6d/da5/fc3 d5/db0/d132/f139 0 2024-02-22T00:33:30.667 INFO:tasks.workunit.client.1.smithi161.stdout:3/847: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff/d100/f111 x:0 0 0 2024-02-22T00:33:30.671 INFO:tasks.workunit.client.1.smithi161.stdout:6/836: dread d3/dc/df/d32/f10a [0,4194304] 0 2024-02-22T00:33:30.672 INFO:tasks.workunit.client.1.smithi161.stdout:6/837: write d3/d10/d12/d95/f9d [837174,84171] 0 2024-02-22T00:33:30.674 INFO:tasks.workunit.client.1.smithi161.stdout:6/838: write d3/d10/f38 [360813,10197] 0 2024-02-22T00:33:30.679 INFO:tasks.workunit.client.1.smithi161.stdout:6/839: rename d3/d30/fbf to d3/d10/f10c 0 2024-02-22T00:33:30.681 INFO:tasks.workunit.client.1.smithi161.stdout:4/839: write d5/d8/d41/d57/dbe/d28/f7c [703091,50046] 0 2024-02-22T00:33:30.682 INFO:tasks.workunit.client.1.smithi161.stdout:9/862: dwrite d1/d5/d9/f76 [0,4194304] 0 2024-02-22T00:33:30.682 INFO:tasks.workunit.client.1.smithi161.stdout:6/840: creat d3/daf/f10d x:0 0 0 2024-02-22T00:33:30.685 INFO:tasks.workunit.client.1.smithi161.stdout:4/840: symlink d5/d8/d41/d53/d6c/l13a 0 2024-02-22T00:33:30.686 INFO:tasks.workunit.client.1.smithi161.stdout:3/848: dread da/dc/d11/d26/d80/dc7/f10a [0,4194304] 0 2024-02-22T00:33:30.686 INFO:tasks.workunit.client.1.smithi161.stdout:6/841: mkdir d3/d10/d12/d3a/d10e 0 2024-02-22T00:33:30.687 INFO:tasks.workunit.client.1.smithi161.stdout:6/842: stat d3/dc/df/d32/dd9/d87/f88 0 2024-02-22T00:33:30.687 INFO:tasks.workunit.client.1.smithi161.stdout:3/849: truncate da/f13 920418 0 2024-02-22T00:33:30.688 INFO:tasks.workunit.client.1.smithi161.stdout:4/841: symlink d5/d10/d14/l13b 0 2024-02-22T00:33:30.689 INFO:tasks.workunit.client.1.smithi161.stdout:9/863: getdents d1/d25/dc4 0 2024-02-22T00:33:30.689 INFO:tasks.workunit.client.1.smithi161.stdout:6/843: creat d3/d30/db4/f10f x:0 0 0 2024-02-22T00:33:30.690 INFO:tasks.workunit.client.1.smithi161.stdout:4/842: mknod d5/d17/c13c 0 2024-02-22T00:33:30.691 INFO:tasks.workunit.client.1.smithi161.stdout:9/864: mknod d1/d5/d9/d9c/d11c/c12a 0 2024-02-22T00:33:30.692 INFO:tasks.workunit.client.1.smithi161.stdout:6/844: getdents d3/dc/d107 0 2024-02-22T00:33:30.693 INFO:tasks.workunit.client.1.smithi161.stdout:4/843: creat d5/d10/d14/f13d x:0 0 0 2024-02-22T00:33:30.695 INFO:tasks.workunit.client.1.smithi161.stdout:4/844: write d5/db0/fc8 [4272616,123562] 0 2024-02-22T00:33:30.696 INFO:tasks.workunit.client.1.smithi161.stdout:6/845: creat d3/d10/d12/d2f/d7d/dab/dbe/de6/f110 x:0 0 0 2024-02-22T00:33:30.697 INFO:tasks.workunit.client.1.smithi161.stdout:4/845: chown d5/d10/f128 437545611 1 2024-02-22T00:33:30.698 INFO:tasks.workunit.client.1.smithi161.stdout:9/865: dwrite d1/d2/d4/d1f/fcf [0,4194304] 0 2024-02-22T00:33:30.702 INFO:tasks.workunit.client.1.smithi161.stdout:9/866: unlink d1/d5/d9/da5/d11a/f123 0 2024-02-22T00:33:30.703 INFO:tasks.workunit.client.1.smithi161.stdout:6/846: link d3/dc/l64 d3/d10/l111 0 2024-02-22T00:33:30.705 INFO:tasks.workunit.client.1.smithi161.stdout:6/847: read d3/d10/d1b/f2e [3467252,101094] 0 2024-02-22T00:33:30.706 INFO:tasks.workunit.client.1.smithi161.stdout:2/952: sync 2024-02-22T00:33:30.714 INFO:tasks.workunit.client.1.smithi161.stdout:8/886: dread d1/d1c/d20/d22/d28/d7f/db4/fff [0,4194304] 0 2024-02-22T00:33:30.716 INFO:tasks.workunit.client.1.smithi161.stdout:6/848: dwrite d3/f5d [0,4194304] 0 2024-02-22T00:33:30.717 INFO:tasks.workunit.client.1.smithi161.stdout:6/849: dread - d3/daf/ff4 zero size 2024-02-22T00:33:30.718 INFO:tasks.workunit.client.1.smithi161.stdout:8/887: fsync d1/d1c/d20/d22/fcd 0 2024-02-22T00:33:30.720 INFO:tasks.workunit.client.1.smithi161.stdout:8/888: write d1/d2f/d37/f48 [1415527,39197] 0 2024-02-22T00:33:30.722 INFO:tasks.workunit.client.1.smithi161.stdout:6/850: fdatasync d3/d10/d1b/f2e 0 2024-02-22T00:33:30.723 INFO:tasks.workunit.client.1.smithi161.stdout:9/867: dread d1/d2/f10 [0,4194304] 0 2024-02-22T00:33:30.725 INFO:tasks.workunit.client.1.smithi161.stdout:9/868: chown d1/d2/d4/d11/d21/c108 887651 1 2024-02-22T00:33:30.727 INFO:tasks.workunit.client.1.smithi161.stdout:9/869: dread - d1/d25/d73/d60/d77/fe4 zero size 2024-02-22T00:33:30.730 INFO:tasks.workunit.client.1.smithi161.stdout:6/851: creat d3/d10/f112 x:0 0 0 2024-02-22T00:33:30.735 INFO:tasks.workunit.client.1.smithi161.stdout:6/852: chown d3/d7c/dd1/lfa 1 1 2024-02-22T00:33:30.735 INFO:tasks.workunit.client.1.smithi161.stdout:8/889: dwrite d1/d1c/d20/fba [0,4194304] 0 2024-02-22T00:33:30.737 INFO:tasks.workunit.client.1.smithi161.stdout:4/846: dwrite d5/d10/f52 [0,4194304] 0 2024-02-22T00:33:30.738 INFO:tasks.workunit.client.1.smithi161.stdout:8/890: chown d1/c4b 23791 1 2024-02-22T00:33:30.738 INFO:tasks.workunit.client.1.smithi161.stdout:2/953: dread de/d11/d32/fbe [0,4194304] 0 2024-02-22T00:33:30.739 INFO:tasks.workunit.client.1.smithi161.stdout:6/853: dread - d3/d10/d12/d2f/d7d/d97/f101 zero size 2024-02-22T00:33:30.740 INFO:tasks.workunit.client.1.smithi161.stdout:2/954: readlink de/d2b/d8b/da2/l144 0 2024-02-22T00:33:30.741 INFO:tasks.workunit.client.1.smithi161.stdout:6/854: chown d3/d10/d72 1498 1 2024-02-22T00:33:30.743 INFO:tasks.workunit.client.1.smithi161.stdout:8/891: getdents d1 0 2024-02-22T00:33:30.743 INFO:tasks.workunit.client.1.smithi161.stdout:6/855: read - d3/d10/d12/d2f/ffb zero size 2024-02-22T00:33:30.750 INFO:tasks.workunit.client.1.smithi161.stdout:2/955: rename de/c2e to de/d2b/d8b/ddc/d125/d60/c14b 0 2024-02-22T00:33:30.754 INFO:tasks.workunit.client.1.smithi161.stdout:4/847: dwrite d5/d8/d41/d57/dbe/f10b [0,4194304] 0 2024-02-22T00:33:30.755 INFO:tasks.workunit.client.1.smithi161.stdout:2/956: chown de/d2b/d8b/ddc/d125/d3a/d71/d143 2343 1 2024-02-22T00:33:30.757 INFO:tasks.workunit.client.1.smithi161.stdout:8/892: dwrite d1/d1c/d20/ff5 [0,4194304] 0 2024-02-22T00:33:30.762 INFO:tasks.workunit.client.1.smithi161.stdout:4/848: write d5/d8/d41/ffc [947522,116417] 0 2024-02-22T00:33:30.763 INFO:tasks.workunit.client.1.smithi161.stdout:8/893: stat d1/d1c/d20/de6/d11a 0 2024-02-22T00:33:30.763 INFO:tasks.workunit.client.1.smithi161.stdout:4/849: readlink d5/d8/d41/d53/l89 0 2024-02-22T00:33:30.767 INFO:tasks.workunit.client.1.smithi161.stdout:9/870: dread d1/d2/d4/d1f/dab/dcd/fd3 [0,4194304] 0 2024-02-22T00:33:30.768 INFO:tasks.workunit.client.1.smithi161.stdout:9/871: fdatasync d1/d2/d4/fad 0 2024-02-22T00:33:30.797 INFO:tasks.workunit.client.1.smithi161.stdout:0/854: sync 2024-02-22T00:33:30.798 INFO:tasks.workunit.client.1.smithi161.stdout:0/855: stat d14/d37/d42/d73/f74 0 2024-02-22T00:33:30.798 INFO:tasks.workunit.client.1.smithi161.stdout:0/856: chown d14/d1a/d3f/cb5 9626953 1 2024-02-22T00:33:30.799 INFO:tasks.workunit.client.1.smithi161.stdout:0/857: chown d14/d1a/d3f/d96 7 1 2024-02-22T00:33:30.817 INFO:tasks.workunit.client.1.smithi161.stdout:6/856: rename d3/d10/d1b/ca4 to d3/d10/d12/d2f/d7d/dab/dbe/c113 0 2024-02-22T00:33:30.818 INFO:tasks.workunit.client.1.smithi161.stdout:6/857: dread - d3/d10/d12/d2f/d7d/d5f/fe3 zero size 2024-02-22T00:33:30.822 INFO:tasks.workunit.client.1.smithi161.stdout:4/850: mknod d5/d8/d41/d57/dbe/d28/d63/d65/d100/c13e 0 2024-02-22T00:33:30.824 INFO:tasks.workunit.client.1.smithi161.stdout:9/872: creat d1/d5/d9/d9c/d11c/f12b x:0 0 0 2024-02-22T00:33:30.825 INFO:tasks.workunit.client.1.smithi161.stdout:6/858: symlink d3/d10/d12/d2f/d7d/dab/dbe/l114 0 2024-02-22T00:33:30.825 INFO:tasks.workunit.client.1.smithi161.stdout:2/957: mknod de/d2b/d8b/da2/da5/d140/c14c 0 2024-02-22T00:33:30.826 INFO:tasks.workunit.client.1.smithi161.stdout:8/894: symlink d1/d2f/d37/d64/d7b/l11e 0 2024-02-22T00:33:30.827 INFO:tasks.workunit.client.1.smithi161.stdout:4/851: dread - d5/d8/d41/d57/dbe/d28/d63/d65/f94 zero size 2024-02-22T00:33:30.827 INFO:tasks.workunit.client.1.smithi161.stdout:0/858: dread d14/d37/d42/d73/fa8 [0,4194304] 0 2024-02-22T00:33:30.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/852: stat d5/d8/d41/d57/dbe/d28 0 2024-02-22T00:33:30.828 INFO:tasks.workunit.client.1.smithi161.stdout:6/859: symlink d3/d7c/da6/l115 0 2024-02-22T00:33:30.829 INFO:tasks.workunit.client.1.smithi161.stdout:4/853: write d5/d10/d14/f5d [221534,110066] 0 2024-02-22T00:33:30.830 INFO:tasks.workunit.client.1.smithi161.stdout:6/860: stat d3/dc/df/d32/dd9/fb6 0 2024-02-22T00:33:30.830 INFO:tasks.workunit.client.1.smithi161.stdout:9/873: mkdir d1/d25/d73/d60/d12c 0 2024-02-22T00:33:30.832 INFO:tasks.workunit.client.1.smithi161.stdout:8/895: mkdir d1/d1c/d20/d22/dfe/d11f 0 2024-02-22T00:33:30.833 INFO:tasks.workunit.client.1.smithi161.stdout:0/859: creat d14/d29/f121 x:0 0 0 2024-02-22T00:33:30.834 INFO:tasks.workunit.client.1.smithi161.stdout:8/896: write d1/d1c/d20/d22/fe1 [672868,68854] 0 2024-02-22T00:33:30.842 INFO:tasks.workunit.client.1.smithi161.stdout:9/874: dwrite d1/d2/d4/d95/fb9 [4194304,4194304] 0 2024-02-22T00:33:30.845 INFO:tasks.workunit.client.1.smithi161.stdout:9/875: read d1/d2/d4/fad [756290,24159] 0 2024-02-22T00:33:30.847 INFO:tasks.workunit.client.1.smithi161.stdout:8/897: dwrite d1/d2f/d37/ddd/ff0 [0,4194304] 0 2024-02-22T00:33:30.849 INFO:tasks.workunit.client.1.smithi161.stdout:0/860: rename d14/d29 to d14/d37/d42/d8e/d122 0 2024-02-22T00:33:30.851 INFO:tasks.workunit.client.1.smithi161.stdout:9/876: creat d1/d2/d4/d1f/dab/f12d x:0 0 0 2024-02-22T00:33:30.852 INFO:tasks.workunit.client.1.smithi161.stdout:6/861: dread d3/d10/d1b/da5/f5c [0,4194304] 0 2024-02-22T00:33:30.853 INFO:tasks.workunit.client.1.smithi161.stdout:0/861: creat d14/d1a/d3f/d96/dad/f123 x:0 0 0 2024-02-22T00:33:30.854 INFO:tasks.workunit.client.1.smithi161.stdout:4/854: dread d5/d8/d41/d57/dbe/d28/f2d [0,4194304] 0 2024-02-22T00:33:30.856 INFO:tasks.workunit.client.1.smithi161.stdout:0/862: fdatasync d14/d1a/d3f/f80 0 2024-02-22T00:33:30.857 INFO:tasks.workunit.client.1.smithi161.stdout:8/898: dwrite d1/d2f/d37/d64/d7b/f101 [0,4194304] 0 2024-02-22T00:33:30.859 INFO:tasks.workunit.client.1.smithi161.stdout:4/855: creat d5/d8/d41/d53/f13f x:0 0 0 2024-02-22T00:33:30.859 INFO:tasks.workunit.client.1.smithi161.stdout:0/863: dread - d14/d1a/d9d/f120 zero size 2024-02-22T00:33:30.861 INFO:tasks.workunit.client.1.smithi161.stdout:8/899: write d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/fdb [609776,119369] 0 2024-02-22T00:33:30.862 INFO:tasks.workunit.client.1.smithi161.stdout:6/862: read d3/dc/df/d32/dd9/f7a [1873873,6533] 0 2024-02-22T00:33:30.863 INFO:tasks.workunit.client.1.smithi161.stdout:4/856: rmdir d5/d10/d14/d4f/d121 39 2024-02-22T00:33:30.865 INFO:tasks.workunit.client.1.smithi161.stdout:4/857: dread - d5/d8/d41/d53/f13f zero size 2024-02-22T00:33:30.866 INFO:tasks.workunit.client.1.smithi161.stdout:8/900: stat d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/f106 0 2024-02-22T00:33:30.866 INFO:tasks.workunit.client.1.smithi161.stdout:6/863: mkdir d3/d7c/dd1/d116 0 2024-02-22T00:33:30.868 INFO:tasks.workunit.client.1.smithi161.stdout:8/901: chown d1/d1c/d75/f3a 939 1 2024-02-22T00:33:30.868 INFO:tasks.workunit.client.1.smithi161.stdout:4/858: write d5/d8/d41/d57/dbe/d28/d63/fa6 [152260,10659] 0 2024-02-22T00:33:30.871 INFO:tasks.workunit.client.1.smithi161.stdout:4/859: stat d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/d12d 0 2024-02-22T00:33:30.875 INFO:tasks.workunit.client.1.smithi161.stdout:4/860: symlink d5/d8/d41/d57/dbe/d28/d63/l140 0 2024-02-22T00:33:30.875 INFO:tasks.workunit.client.1.smithi161.stdout:6/864: link d3/d10/d12/f22 d3/dc/f117 0 2024-02-22T00:33:30.878 INFO:tasks.workunit.client.1.smithi161.stdout:8/902: dwrite d1/d2f/d37/d64/d7b/ff4 [0,4194304] 0 2024-02-22T00:33:30.880 INFO:tasks.workunit.client.1.smithi161.stdout:8/903: creat d1/d1c/d96/f120 x:0 0 0 2024-02-22T00:33:30.883 INFO:tasks.workunit.client.1.smithi161.stdout:4/861: rename d5/d10/d14/d134 to d5/d8/d41/d141 0 2024-02-22T00:33:30.885 INFO:tasks.workunit.client.1.smithi161.stdout:6/865: rename d3/d10/d12/d2f/d7d/dab/fad to d3/d7c/d108/f118 0 2024-02-22T00:33:30.887 INFO:tasks.workunit.client.1.smithi161.stdout:4/862: creat d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/d12d/f142 x:0 0 0 2024-02-22T00:33:30.887 INFO:tasks.workunit.client.1.smithi161.stdout:8/904: getdents d1/d2f/d37 0 2024-02-22T00:33:30.891 INFO:tasks.workunit.client.1.smithi161.stdout:6/866: dwrite d3/d10/d12/d3a/f43 [0,4194304] 0 2024-02-22T00:33:30.893 INFO:tasks.workunit.client.1.smithi161.stdout:4/863: rename d5/d17/c32 to d5/d8/d41/d57/dbe/d28/d63/d65/dcd/d123/c143 0 2024-02-22T00:33:30.895 INFO:tasks.workunit.client.1.smithi161.stdout:4/864: dread - d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/f119 zero size 2024-02-22T00:33:30.895 INFO:tasks.workunit.client.1.smithi161.stdout:8/905: link d1/d1c/l23 d1/d1c/d96/l121 0 2024-02-22T00:33:30.903 INFO:tasks.workunit.client.1.smithi161.stdout:7/886: sync 2024-02-22T00:33:30.904 INFO:tasks.workunit.client.1.smithi161.stdout:3/850: sync 2024-02-22T00:33:30.904 INFO:tasks.workunit.client.1.smithi161.stdout:1/876: sync 2024-02-22T00:33:30.908 INFO:tasks.workunit.client.1.smithi161.stdout:8/906: write d1/f6 [1208043,52205] 0 2024-02-22T00:33:30.908 INFO:tasks.workunit.client.1.smithi161.stdout:1/877: mknod d19/d51/d64/d9b/da5/c12b 0 2024-02-22T00:33:30.911 INFO:tasks.workunit.client.1.smithi161.stdout:8/907: fsync d1/d1c/dbd/f10e 0 2024-02-22T00:33:30.912 INFO:tasks.workunit.client.1.smithi161.stdout:3/851: rename da/l57 to da/dc/d11/d26/d80/dc7/dfe/l112 0 2024-02-22T00:33:30.914 INFO:tasks.workunit.client.1.smithi161.stdout:7/887: unlink d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc/le8 0 2024-02-22T00:33:30.914 INFO:tasks.workunit.client.1.smithi161.stdout:0/864: dwrite d14/d37/d42/d73/f74 [0,4194304] 0 2024-02-22T00:33:30.918 INFO:tasks.workunit.client.1.smithi161.stdout:4/865: link d5/d17/d5c/l90 d5/d8/d41/d141/l144 0 2024-02-22T00:33:30.919 INFO:tasks.workunit.client.1.smithi161.stdout:6/867: dwrite d3/d10/d1b/f47 [0,4194304] 0 2024-02-22T00:33:30.920 INFO:tasks.workunit.client.1.smithi161.stdout:3/852: mkdir da/dc/d11/d26/d104/d113 0 2024-02-22T00:33:30.921 INFO:tasks.workunit.client.1.smithi161.stdout:7/888: chown d3/df/d33/d35/d55/d63/d7b/d50 27183097 1 2024-02-22T00:33:30.924 INFO:tasks.workunit.client.1.smithi161.stdout:1/878: dwrite d19/d51/d64/d9b/fb3 [0,4194304] 0 2024-02-22T00:33:30.927 INFO:tasks.workunit.client.1.smithi161.stdout:8/908: creat d1/d1c/d20/d22/d28/d7f/db4/d11d/f122 x:0 0 0 2024-02-22T00:33:30.928 INFO:tasks.workunit.client.1.smithi161.stdout:7/889: write d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/f96 [998306,116926] 0 2024-02-22T00:33:30.933 INFO:tasks.workunit.client.1.smithi161.stdout:0/865: write d14/f25 [2078867,22084] 0 2024-02-22T00:33:30.933 INFO:tasks.workunit.client.1.smithi161.stdout:4/866: fsync d5/d8/d41/d57/dbe/d28/d63/f98 0 2024-02-22T00:33:30.936 INFO:tasks.workunit.client.1.smithi161.stdout:6/868: dread d3/dc/df/d32/f10a [0,4194304] 0 2024-02-22T00:33:30.939 INFO:tasks.workunit.client.1.smithi161.stdout:3/853: dwrite da/dc/d11/d26/d80/dc7/d59/f84 [0,4194304] 0 2024-02-22T00:33:30.941 INFO:tasks.workunit.client.1.smithi161.stdout:7/890: truncate d3/df/d43/fa2 259338 0 2024-02-22T00:33:30.943 INFO:tasks.workunit.client.1.smithi161.stdout:6/869: symlink d3/dc/df/l119 0 2024-02-22T00:33:30.943 INFO:tasks.workunit.client.1.smithi161.stdout:1/879: dwrite d19/d48/d68/f71 [0,4194304] 0 2024-02-22T00:33:30.944 INFO:tasks.workunit.client.1.smithi161.stdout:4/867: symlink d5/d8/d41/d57/dbe/d131/l145 0 2024-02-22T00:33:30.946 INFO:tasks.workunit.client.1.smithi161.stdout:1/880: stat d19/d1d/d56/fa4 0 2024-02-22T00:33:30.948 INFO:tasks.workunit.client.1.smithi161.stdout:3/854: creat da/f114 x:0 0 0 2024-02-22T00:33:30.949 INFO:tasks.workunit.client.1.smithi161.stdout:4/868: write d5/db0/fbc [10005468,101015] 0 2024-02-22T00:33:30.951 INFO:tasks.workunit.client.1.smithi161.stdout:3/855: write da/dc/d11/f55 [1401588,76554] 0 2024-02-22T00:33:30.955 INFO:tasks.workunit.client.1.smithi161.stdout:7/891: rmdir d3/df/d33/d35/d55/d63/d7b 39 2024-02-22T00:33:30.957 INFO:tasks.workunit.client.1.smithi161.stdout:1/881: readlink d19/d1d/d2c/d2d/d3f/d69/ddd/df0/l55 0 2024-02-22T00:33:30.959 INFO:tasks.workunit.client.1.smithi161.stdout:4/869: mknod d5/d17/c146 0 2024-02-22T00:33:30.961 INFO:tasks.workunit.client.1.smithi161.stdout:0/866: dread d14/f35 [0,4194304] 0 2024-02-22T00:33:30.961 INFO:tasks.workunit.client.1.smithi161.stdout:3/856: creat da/dc/d11/d26/d80/dc7/f115 x:0 0 0 2024-02-22T00:33:30.963 INFO:tasks.workunit.client.1.smithi161.stdout:3/857: fsync da/dc/d11/d26/d80/dc7/d59/d93/daa/fb4 0 2024-02-22T00:33:30.966 INFO:tasks.workunit.client.1.smithi161.stdout:1/882: mknod d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d123/c12c 0 2024-02-22T00:33:30.968 INFO:tasks.workunit.client.1.smithi161.stdout:7/892: rename d3/df/d33/d53/l92 to d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc/l11c 0 2024-02-22T00:33:30.970 INFO:tasks.workunit.client.1.smithi161.stdout:3/858: fdatasync da/dc/d11/d26/d80/fa2 0 2024-02-22T00:33:30.971 INFO:tasks.workunit.client.1.smithi161.stdout:0/867: symlink d14/d37/d42/d8e/l124 0 2024-02-22T00:33:30.972 INFO:tasks.workunit.client.1.smithi161.stdout:4/870: creat d5/d10/f147 x:0 0 0 2024-02-22T00:33:30.973 INFO:tasks.workunit.client.1.smithi161.stdout:2/958: sync 2024-02-22T00:33:30.973 INFO:tasks.workunit.client.1.smithi161.stdout:9/877: sync 2024-02-22T00:33:30.975 INFO:tasks.workunit.client.1.smithi161.stdout:6/870: dwrite d3/d10/d1b/f78 [0,4194304] 0 2024-02-22T00:33:30.976 INFO:tasks.workunit.client.1.smithi161.stdout:8/909: dread d1/d1c/d20/d22/d3f/f51 [0,4194304] 0 2024-02-22T00:33:30.978 INFO:tasks.workunit.client.1.smithi161.stdout:1/883: creat d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d120/f12d x:0 0 0 2024-02-22T00:33:30.980 INFO:tasks.workunit.client.1.smithi161.stdout:7/893: dwrite f2 [4194304,4194304] 0 2024-02-22T00:33:30.980 INFO:tasks.workunit.client.1.smithi161.stdout:3/859: creat da/dc/d11/d26/d80/d92/f116 x:0 0 0 2024-02-22T00:33:30.980 INFO:tasks.workunit.client.1.smithi161.stdout:9/878: truncate d1/d25/d73/d60/d77/d99/f125 236649 0 2024-02-22T00:33:30.981 INFO:tasks.workunit.client.1.smithi161.stdout:3/860: stat da/dc/l83 0 2024-02-22T00:33:30.983 INFO:tasks.workunit.client.1.smithi161.stdout:9/879: dread - d1/d5/d9/da5/dbc/f7d zero size 2024-02-22T00:33:30.985 INFO:tasks.workunit.client.1.smithi161.stdout:4/871: mknod d5/d8/c148 0 2024-02-22T00:33:30.985 INFO:tasks.workunit.client.1.smithi161.stdout:3/861: write da/dc/d11/d26/d80/dc7/d59/fbe [1109356,124294] 0 2024-02-22T00:33:30.988 INFO:tasks.workunit.client.1.smithi161.stdout:2/959: mknod de/d2b/d8b/c14d 0 2024-02-22T00:33:30.989 INFO:tasks.workunit.client.1.smithi161.stdout:4/872: readlink d5/d8/d41/d57/dbe/d28/d63/l71 0 2024-02-22T00:33:30.990 INFO:tasks.workunit.client.1.smithi161.stdout:7/894: mkdir d3/df/d33/d35/d55/d63/d7b/d30/d44/d11d 0 2024-02-22T00:33:30.991 INFO:tasks.workunit.client.1.smithi161.stdout:4/873: chown d5/d10/l9b 1036 1 2024-02-22T00:33:30.992 INFO:tasks.workunit.client.1.smithi161.stdout:3/862: mknod da/dc/d11/d26/d80/dc7/c117 0 2024-02-22T00:33:30.993 INFO:tasks.workunit.client.1.smithi161.stdout:2/960: creat de/d2b/d8b/ddc/f14e x:0 0 0 2024-02-22T00:33:30.995 INFO:tasks.workunit.client.1.smithi161.stdout:1/884: creat d19/f12e x:0 0 0 2024-02-22T00:33:30.995 INFO:tasks.workunit.client.1.smithi161.stdout:3/863: stat da/dc/d5f/dfc 0 2024-02-22T00:33:30.996 INFO:tasks.workunit.client.1.smithi161.stdout:7/895: write d3/df/d33/d35/d55/d63/d7b/d8f/f9d [1828547,92580] 0 2024-02-22T00:33:30.996 INFO:tasks.workunit.client.1.smithi161.stdout:0/868: dwrite d14/d1a/f24 [0,4194304] 0 2024-02-22T00:33:30.998 INFO:tasks.workunit.client.1.smithi161.stdout:2/961: write de/d11/d5c/f69 [2122775,106135] 0 2024-02-22T00:33:31.000 INFO:tasks.workunit.client.1.smithi161.stdout:9/880: getdents d1/d5/d9/da5/dbc 0 2024-02-22T00:33:31.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/885: chown d19/d1d/d2c/d7d/f7f 601089141 1 2024-02-22T00:33:31.004 INFO:tasks.workunit.client.1.smithi161.stdout:0/869: symlink d14/d1a/l125 0 2024-02-22T00:33:31.009 INFO:tasks.workunit.client.1.smithi161.stdout:7/896: creat d3/df/dba/f11e x:0 0 0 2024-02-22T00:33:31.009 INFO:tasks.workunit.client.1.smithi161.stdout:9/881: chown d1/d5/l26 25076 1 2024-02-22T00:33:31.012 INFO:tasks.workunit.client.1.smithi161.stdout:4/874: write d5/d8/d41/f54 [17337,41922] 0 2024-02-22T00:33:31.015 INFO:tasks.workunit.client.1.smithi161.stdout:6/871: dwrite d3/d30/f5b [0,4194304] 0 2024-02-22T00:33:31.016 INFO:tasks.workunit.client.1.smithi161.stdout:9/882: chown d1/d25/d73/fc2 167 1 2024-02-22T00:33:31.019 INFO:tasks.workunit.client.1.smithi161.stdout:8/910: dwrite d1/d1c/f77 [0,4194304] 0 2024-02-22T00:33:31.019 INFO:tasks.workunit.client.1.smithi161.stdout:3/864: rename da/dc/d11/d26/d80/dc7/d108/d10d/lf7 to da/dc/d11/l118 0 2024-02-22T00:33:31.019 INFO:tasks.workunit.client.1.smithi161.stdout:2/962: dwrite de/d11/d14/f131 [0,4194304] 0 2024-02-22T00:33:31.021 INFO:tasks.workunit.client.1.smithi161.stdout:6/872: chown d3/d10/fb0 0 1 2024-02-22T00:33:31.024 INFO:tasks.workunit.client.1.smithi161.stdout:6/873: fdatasync d3/d10/d12/d3a/fa1 0 2024-02-22T00:33:31.026 INFO:tasks.workunit.client.1.smithi161.stdout:0/870: rename d14/d37/d42/d8e/d92 to d14/d1a/d3f/d108/d10c/d126 0 2024-02-22T00:33:31.027 INFO:tasks.workunit.client.1.smithi161.stdout:2/963: write de/d2b/d8b/da2/da5/dc4/da7/fb7 [638627,13488] 0 2024-02-22T00:33:31.027 INFO:tasks.workunit.client.1.smithi161.stdout:4/875: mkdir d5/d8/d149 0 2024-02-22T00:33:31.031 INFO:tasks.workunit.client.1.smithi161.stdout:2/964: chown de/d2b/d83/d4f/dc5/cfc 1752 1 2024-02-22T00:33:31.033 INFO:tasks.workunit.client.1.smithi161.stdout:9/883: symlink d1/l12e 0 2024-02-22T00:33:31.033 INFO:tasks.workunit.client.1.smithi161.stdout:3/865: dwrite da/dc/d11/d26/d80/d92/fcc [0,4194304] 0 2024-02-22T00:33:31.034 INFO:tasks.workunit.client.1.smithi161.stdout:4/876: write d5/d8/d41/d57/dbe/d28/d38/ff1 [644796,47262] 0 2024-02-22T00:33:31.034 INFO:tasks.workunit.client.1.smithi161.stdout:2/965: read - de/d2b/d83/d4f/fd9 zero size 2024-02-22T00:33:31.036 INFO:tasks.workunit.client.1.smithi161.stdout:7/897: mknod d3/df/d33/d35/d55/d63/d7b/d30/dc0/c11f 0 2024-02-22T00:33:31.036 INFO:tasks.workunit.client.1.smithi161.stdout:6/874: dwrite d3/d10/d12/d3a/f43 [0,4194304] 0 2024-02-22T00:33:31.039 INFO:tasks.workunit.client.1.smithi161.stdout:0/871: unlink d14/d9b/fde 0 2024-02-22T00:33:31.046 INFO:tasks.workunit.client.1.smithi161.stdout:1/886: getdents d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d123 0 2024-02-22T00:33:31.047 INFO:tasks.workunit.client.1.smithi161.stdout:4/877: mknod d5/d17/c14a 0 2024-02-22T00:33:31.047 INFO:tasks.workunit.client.1.smithi161.stdout:8/911: link d1/d1c/d96/l98 d1/d1c/d96/dcf/l123 0 2024-02-22T00:33:31.049 INFO:tasks.workunit.client.1.smithi161.stdout:2/966: read de/d2b/d8b/ddc/d125/fe2 [1001800,116732] 0 2024-02-22T00:33:31.050 INFO:tasks.workunit.client.1.smithi161.stdout:6/875: creat d3/d10/d12/d3a/f11a x:0 0 0 2024-02-22T00:33:31.051 INFO:tasks.workunit.client.1.smithi161.stdout:0/872: dread d14/d37/d42/d73/fa8 [0,4194304] 0 2024-02-22T00:33:31.052 INFO:tasks.workunit.client.1.smithi161.stdout:3/866: creat da/dc/d11/d26/d80/dc7/d108/d10d/dc1/dce/f119 x:0 0 0 2024-02-22T00:33:31.063 INFO:tasks.workunit.client.1.smithi161.stdout:9/884: dwrite d1/d25/d73/d60/db0/fd0 [0,4194304] 0 2024-02-22T00:33:31.063 INFO:tasks.workunit.client.1.smithi161.stdout:1/887: creat d19/d51/d64/d9b/f12f x:0 0 0 2024-02-22T00:33:31.063 INFO:tasks.workunit.client.1.smithi161.stdout:4/878: mknod d5/d17/c14b 0 2024-02-22T00:33:31.065 INFO:tasks.workunit.client.1.smithi161.stdout:7/898: rename d3/dbf/d64/f78 to d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100/f120 0 2024-02-22T00:33:31.066 INFO:tasks.workunit.client.1.smithi161.stdout:3/867: stat da/dc/d11/d26/d80/d92/fa7 0 2024-02-22T00:33:31.071 INFO:tasks.workunit.client.1.smithi161.stdout:3/868: write da/dc/d11/d26/f21 [3780068,45165] 0 2024-02-22T00:33:31.071 INFO:tasks.workunit.client.1.smithi161.stdout:8/912: dwrite d1/d1c/d96/fc7 [0,4194304] 0 2024-02-22T00:33:31.074 INFO:tasks.workunit.client.1.smithi161.stdout:2/967: dread de/d11/f4e [0,4194304] 0 2024-02-22T00:33:31.075 INFO:tasks.workunit.client.1.smithi161.stdout:3/869: fsync da/dc/d11/d26/d80/dc7/d59/d93/daa/fe2 0 2024-02-22T00:33:31.094 INFO:tasks.workunit.client.1.smithi161.stdout:6/876: mkdir d3/dc/df/d32/de5/d11b 0 2024-02-22T00:33:31.095 INFO:tasks.workunit.client.1.smithi161.stdout:6/877: chown d3/d10/d12/d2f/d7d/d82/fd6 7846161 1 2024-02-22T00:33:31.101 INFO:tasks.workunit.client.1.smithi161.stdout:6/878: symlink d3/daf/l11c 0 2024-02-22T00:33:31.101 INFO:tasks.workunit.client.1.smithi161.stdout:6/879: stat d3/d10/d1b/l51 0 2024-02-22T00:33:31.102 INFO:tasks.workunit.client.1.smithi161.stdout:7/899: creat d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/d110/d107/f121 x:0 0 0 2024-02-22T00:33:31.104 INFO:tasks.workunit.client.1.smithi161.stdout:8/913: creat d1/d2f/d37/d64/d7b/d7e/f124 x:0 0 0 2024-02-22T00:33:31.106 INFO:tasks.workunit.client.1.smithi161.stdout:9/885: link d1/d2/d4/d1f/fca d1/d5/f12f 0 2024-02-22T00:33:31.108 INFO:tasks.workunit.client.1.smithi161.stdout:1/888: rename d19/d51/d64/d9b/da5/daa/fab to d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f130 0 2024-02-22T00:33:31.109 INFO:tasks.workunit.client.1.smithi161.stdout:6/880: symlink d3/d10/d12/d2f/d7d/d5f/l11d 0 2024-02-22T00:33:31.110 INFO:tasks.workunit.client.1.smithi161.stdout:7/900: mkdir d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100/d122 0 2024-02-22T00:33:31.110 INFO:tasks.workunit.client.1.smithi161.stdout:4/879: link d5/d8/d41/d57/l58 d5/d8/d41/d57/dbe/d28/d63/d65/dcd/l14c 0 2024-02-22T00:33:31.111 INFO:tasks.workunit.client.1.smithi161.stdout:8/914: dwrite d1/d1c/f77 [0,4194304] 0 2024-02-22T00:33:31.113 INFO:tasks.workunit.client.1.smithi161.stdout:6/881: truncate d3/dc/df/d32/fe1 791361 0 2024-02-22T00:33:31.113 INFO:tasks.workunit.client.1.smithi161.stdout:9/886: mknod d1/d2/d4/d95/c130 0 2024-02-22T00:33:31.115 INFO:tasks.workunit.client.1.smithi161.stdout:9/887: read - d1/d5/d9/da5/dbc/d115/f126 zero size 2024-02-22T00:33:31.115 INFO:tasks.workunit.client.1.smithi161.stdout:3/870: rename da/dc/d11/d26/d80/dc7/d108/d10d/lbc to da/dc/d11/d26/d104/l11a 0 2024-02-22T00:33:31.116 INFO:tasks.workunit.client.1.smithi161.stdout:1/889: rmdir d19/d48/d68/da8 39 2024-02-22T00:33:31.119 INFO:tasks.workunit.client.1.smithi161.stdout:4/880: symlink d5/d8/d41/d141/l14d 0 2024-02-22T00:33:31.120 INFO:tasks.workunit.client.1.smithi161.stdout:8/915: creat d1/d2f/d37/d64/d7b/d7e/f125 x:0 0 0 2024-02-22T00:33:31.122 INFO:tasks.workunit.client.1.smithi161.stdout:6/882: chown d3/dc/df/d32/dd9/d87/c8a 846230 1 2024-02-22T00:33:31.123 INFO:tasks.workunit.client.1.smithi161.stdout:9/888: symlink d1/d2/d4/d1f/dab/dcd/l131 0 2024-02-22T00:33:31.125 INFO:tasks.workunit.client.1.smithi161.stdout:3/871: dwrite da/dc/d11/d26/f45 [4194304,4194304] 0 2024-02-22T00:33:31.126 INFO:tasks.workunit.client.1.smithi161.stdout:9/889: chown d1/fd9 1 1 2024-02-22T00:33:31.126 INFO:tasks.workunit.client.1.smithi161.stdout:4/881: chown d5/l21 67498598 1 2024-02-22T00:33:31.128 INFO:tasks.workunit.client.1.smithi161.stdout:1/890: dwrite d19/d48/d68/f71 [0,4194304] 0 2024-02-22T00:33:31.130 INFO:tasks.workunit.client.1.smithi161.stdout:4/882: write d5/d17/f4a [239517,107215] 0 2024-02-22T00:33:31.132 INFO:tasks.workunit.client.1.smithi161.stdout:9/890: write d1/d5/d9/da5/dbc/f120 [463734,32316] 0 2024-02-22T00:33:31.133 INFO:tasks.workunit.client.1.smithi161.stdout:1/891: dread - d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f11d zero size 2024-02-22T00:33:31.133 INFO:tasks.workunit.client.1.smithi161.stdout:8/916: link d1/c1a d1/d1c/d20/d22/d28/c126 0 2024-02-22T00:33:31.135 INFO:tasks.workunit.client.1.smithi161.stdout:3/872: rename da/dc/d11/d26/d80/fb6 to da/dc/d11/d26/d80/dc7/d108/f11b 0 2024-02-22T00:33:31.135 INFO:tasks.workunit.client.1.smithi161.stdout:9/891: write d1/d2/d7/da/f8e [3404204,72647] 0 2024-02-22T00:33:31.142 INFO:tasks.workunit.client.1.smithi161.stdout:1/892: unlink d19/d1d/f8c 0 2024-02-22T00:33:31.142 INFO:tasks.workunit.client.1.smithi161.stdout:8/917: mkdir d1/d1c/d20/d22/dfe/d127 0 2024-02-22T00:33:31.146 INFO:tasks.workunit.client.1.smithi161.stdout:3/873: mkdir da/dc/d11/d26/d80/dc7/d59/d11c 0 2024-02-22T00:33:31.147 INFO:tasks.workunit.client.1.smithi161.stdout:9/892: chown d1/c4d 15635105 1 2024-02-22T00:33:31.148 INFO:tasks.workunit.client.1.smithi161.stdout:8/918: mkdir d1/d1c/d20/d22/d3f/d128 0 2024-02-22T00:33:31.150 INFO:tasks.workunit.client.1.smithi161.stdout:4/883: rename d5/d8/d41/d57/dbe/d28/d38/d6d/f126 to d5/d8/d41/d57/dbe/d28/d38/d6d/f14e 0 2024-02-22T00:33:31.152 INFO:tasks.workunit.client.1.smithi161.stdout:8/919: fsync d1/f2d 0 2024-02-22T00:33:31.153 INFO:tasks.workunit.client.1.smithi161.stdout:1/893: dwrite d19/f46 [4194304,4194304] 0 2024-02-22T00:33:31.155 INFO:tasks.workunit.client.1.smithi161.stdout:8/920: readlink d1/d1c/d75/d18/l10f 0 2024-02-22T00:33:31.158 INFO:tasks.workunit.client.1.smithi161.stdout:1/894: write d19/d85/d87/dc6/ff3 [5129313,59431] 0 2024-02-22T00:33:31.158 INFO:tasks.workunit.client.1.smithi161.stdout:9/893: rmdir d1/d2/d7/da/dfd 0 2024-02-22T00:33:31.158 INFO:tasks.workunit.client.1.smithi161.stdout:0/873: dwrite d14/d37/d42/d73/fa8 [0,4194304] 0 2024-02-22T00:33:31.160 INFO:tasks.workunit.client.1.smithi161.stdout:8/921: write d1/d2f/d37/d64/d7b/d7e/fc9 [163807,33215] 0 2024-02-22T00:33:31.162 INFO:tasks.workunit.client.1.smithi161.stdout:8/922: readlink d1/d1c/d75/d18/l10f 0 2024-02-22T00:33:31.166 INFO:tasks.workunit.client.1.smithi161.stdout:0/874: symlink d14/d1a/d3f/l127 0 2024-02-22T00:33:31.168 INFO:tasks.workunit.client.1.smithi161.stdout:9/894: truncate d1/d2/d4/d1f/fe8 313073 0 2024-02-22T00:33:31.168 INFO:tasks.workunit.client.1.smithi161.stdout:0/875: chown d14/d1a/d3f/d96/dad/f117 162069893 1 2024-02-22T00:33:31.169 INFO:tasks.workunit.client.1.smithi161.stdout:7/901: truncate d3/df/d33/d35/d55/d63/d7b/d8f/fea 929875 0 2024-02-22T00:33:31.174 INFO:tasks.workunit.client.1.smithi161.stdout:7/902: unlink d3/df/d33/d35/d55/d63/d7b/d30/f9a 0 2024-02-22T00:33:31.178 INFO:tasks.workunit.client.1.smithi161.stdout:6/883: dwrite d3/d10/d12/d2f/d7d/f80 [0,4194304] 0 2024-02-22T00:33:31.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:29.758938+0000 mgr.smithi161.sazlam (mgr.24369) 43 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 53 MiB/s rd, 173 MiB/s wr, 426 op/s 2024-02-22T00:33:31.181 INFO:tasks.workunit.client.1.smithi161.stdout:9/895: getdents d1/d25/d73/d60/d77/d93 0 2024-02-22T00:33:31.183 INFO:tasks.workunit.client.1.smithi161.stdout:1/895: dread d19/d1d/d2c/d7d/f7f [0,4194304] 0 2024-02-22T00:33:31.183 INFO:tasks.workunit.client.1.smithi161.stdout:4/884: write d5/f27 [1708953,8593] 0 2024-02-22T00:33:31.186 INFO:tasks.workunit.client.1.smithi161.stdout:8/923: dread d1/d2f/d37/d64/d7b/d7e/f80 [0,4194304] 0 2024-02-22T00:33:31.187 INFO:tasks.workunit.client.1.smithi161.stdout:1/896: dread - d19/d90/dd6/f100 zero size 2024-02-22T00:33:31.188 INFO:tasks.workunit.client.1.smithi161.stdout:4/885: creat d5/d17/d5c/f14f x:0 0 0 2024-02-22T00:33:31.190 INFO:tasks.workunit.client.1.smithi161.stdout:4/886: dread - d5/d17/d5c/f7b zero size 2024-02-22T00:33:31.196 INFO:tasks.workunit.client.1.smithi161.stdout:8/924: creat d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/f129 x:0 0 0 2024-02-22T00:33:31.198 INFO:tasks.workunit.client.1.smithi161.stdout:9/896: write d1/d2/d7/da/f3c [3000547,52723] 0 2024-02-22T00:33:31.198 INFO:tasks.workunit.client.1.smithi161.stdout:4/887: truncate d5/d8/f12c 2978678 0 2024-02-22T00:33:31.199 INFO:tasks.workunit.client.1.smithi161.stdout:0/876: dread d14/f56 [4194304,4194304] 0 2024-02-22T00:33:31.200 INFO:tasks.workunit.client.1.smithi161.stdout:1/897: dwrite d19/f43 [0,4194304] 0 2024-02-22T00:33:31.202 INFO:tasks.workunit.client.1.smithi161.stdout:7/903: dread d3/f8d [0,4194304] 0 2024-02-22T00:33:31.203 INFO:tasks.workunit.client.1.smithi161.stdout:4/888: dread d5/f13 [0,4194304] 0 2024-02-22T00:33:31.204 INFO:tasks.workunit.client.1.smithi161.stdout:6/884: dread d3/d10/d12/d2f/d7d/d5f/f99 [0,4194304] 0 2024-02-22T00:33:31.205 INFO:tasks.workunit.client.1.smithi161.stdout:8/925: rename d1/d1c/d20/d22/d28/d7f/d109/lbb to d1/d1c/d96/l12a 0 2024-02-22T00:33:31.206 INFO:tasks.workunit.client.1.smithi161.stdout:8/926: stat d1/d1c/d75 0 2024-02-22T00:33:31.207 INFO:tasks.workunit.client.1.smithi161.stdout:2/968: sync 2024-02-22T00:33:31.209 INFO:tasks.workunit.client.1.smithi161.stdout:2/969: read de/f1c [2542126,424] 0 2024-02-22T00:33:31.209 INFO:tasks.workunit.client.1.smithi161.stdout:7/904: symlink d3/df/dfd/l123 0 2024-02-22T00:33:31.210 INFO:tasks.workunit.client.1.smithi161.stdout:2/970: write de/d2b/d83/d4f/f130 [104747,122382] 0 2024-02-22T00:33:31.210 INFO:tasks.workunit.client.1.smithi161.stdout:1/898: creat d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d120/f131 x:0 0 0 2024-02-22T00:33:31.212 INFO:tasks.workunit.client.1.smithi161.stdout:6/885: mknod d3/d10/d12/d2f/d7d/dab/dbe/c11e 0 2024-02-22T00:33:31.213 INFO:tasks.workunit.client.1.smithi161.stdout:0/877: write d14/f9e [537111,103741] 0 2024-02-22T00:33:31.214 INFO:tasks.workunit.client.1.smithi161.stdout:1/899: write d19/d51/d64/d9b/da5/daa/fe5 [753648,130417] 0 2024-02-22T00:33:31.214 INFO:tasks.workunit.client.1.smithi161.stdout:2/971: write de/d2b/d8b/da2/da5/dc4/d8f/f8d [546766,33156] 0 2024-02-22T00:33:31.217 INFO:tasks.workunit.client.1.smithi161.stdout:4/889: rename d5/d10 to d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150 0 2024-02-22T00:33:31.218 INFO:tasks.workunit.client.1.smithi161.stdout:6/886: write d3/d10/d12/d3a/f11a [366592,20782] 0 2024-02-22T00:33:31.219 INFO:tasks.workunit.client.1.smithi161.stdout:1/900: stat d19/d51/d64/d9b/da5/daa 0 2024-02-22T00:33:31.220 INFO:tasks.workunit.client.1.smithi161.stdout:7/905: chown d3/df/d33/d35/d55/d63/d7b/d8f/fea 4 1 2024-02-22T00:33:31.220 INFO:tasks.workunit.client.1.smithi161.stdout:6/887: fdatasync d3/dc/df/f69 0 2024-02-22T00:33:31.222 INFO:tasks.workunit.client.1.smithi161.stdout:0/878: creat d14/d37/d10b/f128 x:0 0 0 2024-02-22T00:33:31.223 INFO:tasks.workunit.client.1.smithi161.stdout:8/927: creat d1/d1c/d20/d22/dfe/d127/f12b x:0 0 0 2024-02-22T00:33:31.226 INFO:tasks.workunit.client.1.smithi161.stdout:6/888: dread d3/d30/f5b [0,4194304] 0 2024-02-22T00:33:31.226 INFO:tasks.workunit.client.1.smithi161.stdout:2/972: write de/d2b/d8b/ddc/d125/d3a/ffa [4674449,28435] 0 2024-02-22T00:33:31.227 INFO:tasks.workunit.client.1.smithi161.stdout:6/889: chown d3/d10/d12/d2f/d7d/c61 1794003 1 2024-02-22T00:33:31.228 INFO:tasks.workunit.client.1.smithi161.stdout:2/973: truncate de/f123 175944 0 2024-02-22T00:33:31.229 INFO:tasks.workunit.client.1.smithi161.stdout:7/906: symlink d3/df/d33/d35/d55/d63/d7b/de5/l124 0 2024-02-22T00:33:31.230 INFO:tasks.workunit.client.1.smithi161.stdout:0/879: mknod d14/d44/c129 0 2024-02-22T00:33:31.231 INFO:tasks.workunit.client.1.smithi161.stdout:9/897: dread d1/d2/d7/f6a [0,4194304] 0 2024-02-22T00:33:31.233 INFO:tasks.workunit.client.1.smithi161.stdout:1/901: rename d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f130 to d19/d112/f132 0 2024-02-22T00:33:31.235 INFO:tasks.workunit.client.1.smithi161.stdout:2/974: symlink de/d2b/d8b/ddc/d125/dd6/l14f 0 2024-02-22T00:33:31.236 INFO:tasks.workunit.client.1.smithi161.stdout:8/928: mknod d1/d2f/d114/c12c 0 2024-02-22T00:33:31.238 INFO:tasks.workunit.client.1.smithi161.stdout:4/890: creat d5/d8/f151 x:0 0 0 2024-02-22T00:33:31.240 INFO:tasks.workunit.client.1.smithi161.stdout:4/891: stat d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/d14/c10c 0 2024-02-22T00:33:31.240 INFO:tasks.workunit.client.1.smithi161.stdout:7/907: creat d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc/f125 x:0 0 0 2024-02-22T00:33:31.243 INFO:tasks.workunit.client.1.smithi161.stdout:1/902: dread - d19/d1d/d2c/d2d/f83 zero size 2024-02-22T00:33:31.243 INFO:tasks.workunit.client.1.smithi161.stdout:6/890: dread d3/dc/df/d32/dd9/fb7 [0,4194304] 0 2024-02-22T00:33:31.244 INFO:tasks.workunit.client.1.smithi161.stdout:9/898: dread d1/d2/d4/d11/f31 [0,4194304] 0 2024-02-22T00:33:31.244 INFO:tasks.workunit.client.1.smithi161.stdout:6/891: dread - d3/d7c/dd1/fff zero size 2024-02-22T00:33:31.245 INFO:tasks.workunit.client.1.smithi161.stdout:8/929: fsync d1/d1c/d75/f3a 0 2024-02-22T00:33:31.247 INFO:tasks.workunit.client.1.smithi161.stdout:7/908: read d3/df/d33/d35/d55/d63/d7b/d50/f81 [372423,47926] 0 2024-02-22T00:33:31.248 INFO:tasks.workunit.client.1.smithi161.stdout:8/930: write d1/d1c/d20/d22/d28/d7f/db4/d11d/f122 [943917,91405] 0 2024-02-22T00:33:31.251 INFO:tasks.workunit.client.1.smithi161.stdout:2/975: write de/d11/d5c/fbf [792099,107579] 0 2024-02-22T00:33:31.257 INFO:tasks.workunit.client.1.smithi161.stdout:3/874: sync 2024-02-22T00:33:31.258 INFO:tasks.workunit.client.1.smithi161.stdout:1/903: rename d19/d51/d64/l9e to d19/d51/da1/l133 0 2024-02-22T00:33:31.260 INFO:tasks.workunit.client.1.smithi161.stdout:9/899: unlink d1/d4b/d81/lbf 0 2024-02-22T00:33:31.261 INFO:tasks.workunit.client.1.smithi161.stdout:2/976: dwrite de/d2b/d8b/ddc/d125/d3a/d9d/fa9 [0,4194304] 0 2024-02-22T00:33:31.261 INFO:tasks.workunit.client.1.smithi161.stdout:8/931: write d1/d1c/d20/f2b [351924,25290] 0 2024-02-22T00:33:31.261 INFO:tasks.workunit.client.1.smithi161.stdout:0/880: getdents d14/d44 0 2024-02-22T00:33:31.262 INFO:tasks.workunit.client.1.smithi161.stdout:1/904: write d19/d51/d6c/dd4/f4c [1492244,28129] 0 2024-02-22T00:33:31.264 INFO:tasks.workunit.client.1.smithi161.stdout:3/875: symlink da/dc/d91/db5/l11d 0 2024-02-22T00:33:31.266 INFO:tasks.workunit.client.1.smithi161.stdout:4/892: getdents d5/d8/d41/d53/d6c/d72 0 2024-02-22T00:33:31.266 INFO:tasks.workunit.client.1.smithi161.stdout:0/881: read - d14/d44/dbe/fe3 zero size 2024-02-22T00:33:31.267 INFO:tasks.workunit.client.1.smithi161.stdout:6/892: dread d3/d10/d12/d2f/d7d/d5f/f70 [0,4194304] 0 2024-02-22T00:33:31.267 INFO:tasks.workunit.client.1.smithi161.stdout:7/909: dread d3/df/d33/d35/d55/d63/d7b/f3e [0,4194304] 0 2024-02-22T00:33:31.267 INFO:tasks.workunit.client.1.smithi161.stdout:8/932: fsync d1/d2f/f5e 0 2024-02-22T00:33:31.268 INFO:tasks.workunit.client.1.smithi161.stdout:0/882: readlink d14/d37/l6e 0 2024-02-22T00:33:31.271 INFO:tasks.workunit.client.1.smithi161.stdout:0/883: readlink d14/d37/l8b 0 2024-02-22T00:33:31.271 INFO:tasks.workunit.client.1.smithi161.stdout:7/910: fsync d3/df/d33/d35/d55/fa8 0 2024-02-22T00:33:31.271 INFO:tasks.workunit.client.1.smithi161.stdout:8/933: fdatasync d1/d1c/d20/d22/d28/d7f/d92/fc3 0 2024-02-22T00:33:31.274 INFO:tasks.workunit.client.1.smithi161.stdout:3/876: read da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f42 [1551348,18106] 0 2024-02-22T00:33:31.274 INFO:tasks.workunit.client.1.smithi161.stdout:0/884: chown d14/d1a/d3f/d5d/ldb 17 1 2024-02-22T00:33:31.276 INFO:tasks.workunit.client.1.smithi161.stdout:2/977: rename de/d11/d5c/dea/df8 to de/d2b/d8b/de6/dfb/d11a/d150 0 2024-02-22T00:33:31.276 INFO:tasks.workunit.client.1.smithi161.stdout:0/885: fdatasync d14/d1a/d3f/d96/dbc/f105 0 2024-02-22T00:33:31.277 INFO:tasks.workunit.client.1.smithi161.stdout:3/877: dread - da/dc/d11/d26/d80/dc7/d59/fa0 zero size 2024-02-22T00:33:31.277 INFO:tasks.workunit.client.1.smithi161.stdout:9/900: write d1/d5/d9/da5/fd5 [495817,116995] 0 2024-02-22T00:33:31.279 INFO:tasks.workunit.client.1.smithi161.stdout:6/893: stat d3/d10/d12/d2f/d7d/d97/ddc 0 2024-02-22T00:33:31.281 INFO:tasks.workunit.client.1.smithi161.stdout:9/901: dread d1/d2/d7/fd6 [0,4194304] 0 2024-02-22T00:33:31.285 INFO:tasks.workunit.client.1.smithi161.stdout:7/911: rmdir d3/df/d33/d35/d55/d63/d7b/d30 39 2024-02-22T00:33:31.287 INFO:tasks.workunit.client.1.smithi161.stdout:8/934: fsync d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/f106 0 2024-02-22T00:33:31.290 INFO:tasks.workunit.client.1.smithi161.stdout:2/978: write de/d11/f1a [5595498,99783] 0 2024-02-22T00:33:31.291 INFO:tasks.workunit.client.1.smithi161.stdout:2/979: chown de/d2b/d8b/da2/da5/dc4/da7/d113 111973508 1 2024-02-22T00:33:31.291 INFO:tasks.workunit.client.1.smithi161.stdout:6/894: mknod d3/daf/c11f 0 2024-02-22T00:33:31.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:29.758938+0000 mgr.smithi161.sazlam (mgr.24369) 43 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 53 MiB/s rd, 173 MiB/s wr, 426 op/s 2024-02-22T00:33:31.293 INFO:tasks.workunit.client.1.smithi161.stdout:9/902: symlink d1/d25/dc4/d4f/l132 0 2024-02-22T00:33:31.294 INFO:tasks.workunit.client.1.smithi161.stdout:7/912: mknod d3/df/d33/d74/df2/c126 0 2024-02-22T00:33:31.296 INFO:tasks.workunit.client.1.smithi161.stdout:8/935: unlink d1/d1c/d20/d22/d3f/l61 0 2024-02-22T00:33:31.297 INFO:tasks.workunit.client.1.smithi161.stdout:6/895: creat d3/d7c/da6/f120 x:0 0 0 2024-02-22T00:33:31.299 INFO:tasks.workunit.client.1.smithi161.stdout:9/903: creat d1/d25/d73/d60/db0/f133 x:0 0 0 2024-02-22T00:33:31.301 INFO:tasks.workunit.client.1.smithi161.stdout:4/893: rename d5/d8/d41/d57/dbe/d28/d38/led to d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/d14/l152 0 2024-02-22T00:33:31.303 INFO:tasks.workunit.client.1.smithi161.stdout:7/913: dwrite d3/dd/d59/fcc [0,4194304] 0 2024-02-22T00:33:31.305 INFO:tasks.workunit.client.1.smithi161.stdout:7/914: readlink d3/l41 0 2024-02-22T00:33:31.306 INFO:tasks.workunit.client.1.smithi161.stdout:3/878: dread da/dc/f51 [0,4194304] 0 2024-02-22T00:33:31.307 INFO:tasks.workunit.client.1.smithi161.stdout:6/896: dwrite d3/d30/f74 [4194304,4194304] 0 2024-02-22T00:33:31.309 INFO:tasks.workunit.client.1.smithi161.stdout:3/879: write da/dc/d11/d26/d80/dc7/d59/d93/daa/fe2 [4231577,40819] 0 2024-02-22T00:33:31.362 INFO:tasks.workunit.client.1.smithi161.stdout:1/905: getdents d19/d48/d68/da8 0 2024-02-22T00:33:31.363 INFO:tasks.workunit.client.1.smithi161.stdout:1/906: fdatasync d19/d1d/d2c/d2d/d3f/f67 0 2024-02-22T00:33:31.366 INFO:tasks.workunit.client.1.smithi161.stdout:9/904: readlink d1/d2/d4/d11/d21/l10e 0 2024-02-22T00:33:31.369 INFO:tasks.workunit.client.1.smithi161.stdout:9/905: write d1/d25/dc4/d4f/da3/fce [992172,14630] 0 2024-02-22T00:33:31.371 INFO:tasks.workunit.client.1.smithi161.stdout:1/907: dwrite d19/d1d/f27 [0,4194304] 0 2024-02-22T00:33:31.372 INFO:tasks.workunit.client.1.smithi161.stdout:2/980: dwrite de/d2b/d8b/da2/da5/dc4/d8f/f91 [0,4194304] 0 2024-02-22T00:33:31.372 INFO:tasks.workunit.client.1.smithi161.stdout:4/894: dread d5/d8/d41/d57/dbe/d28/d63/d6b/fd1 [0,4194304] 0 2024-02-22T00:33:31.374 INFO:tasks.workunit.client.1.smithi161.stdout:1/908: write d19/d1d/d56/fa4 [8623142,33121] 0 2024-02-22T00:33:31.380 INFO:tasks.workunit.client.1.smithi161.stdout:1/909: chown d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d120/f131 6 1 2024-02-22T00:33:31.383 INFO:tasks.workunit.client.1.smithi161.stdout:6/897: unlink d3/d10/d1b/f59 0 2024-02-22T00:33:31.385 INFO:tasks.workunit.client.1.smithi161.stdout:2/981: dwrite de/d11/f63 [0,4194304] 0 2024-02-22T00:33:31.386 INFO:tasks.workunit.client.1.smithi161.stdout:0/886: getdents d14/d37/d10b 0 2024-02-22T00:33:31.387 INFO:tasks.workunit.client.1.smithi161.stdout:9/906: dwrite d1/d2/d7/fd6 [0,4194304] 0 2024-02-22T00:33:31.392 INFO:tasks.workunit.client.1.smithi161.stdout:4/895: creat d5/d8/d41/d53/d6c/d72/dfb/f153 x:0 0 0 2024-02-22T00:33:31.394 INFO:tasks.workunit.client.1.smithi161.stdout:4/896: fsync d5/d8/d41/d53/d6c/d91/f101 0 2024-02-22T00:33:31.395 INFO:tasks.workunit.client.1.smithi161.stdout:1/910: creat d19/d51/d64/d9b/da5/dbc/f134 x:0 0 0 2024-02-22T00:33:31.398 INFO:tasks.workunit.client.1.smithi161.stdout:6/898: rename d3/dc/df to d3/dc/df/d32/dd9/d87/d121 22 2024-02-22T00:33:31.398 INFO:tasks.workunit.client.1.smithi161.stdout:2/982: dwrite de/d11/d5c/f11d [0,4194304] 0 2024-02-22T00:33:31.399 INFO:tasks.workunit.client.1.smithi161.stdout:1/911: read d19/d48/f11e [39131,15281] 0 2024-02-22T00:33:31.400 INFO:tasks.workunit.client.1.smithi161.stdout:9/907: mknod d1/d25/d73/d60/db0/c134 0 2024-02-22T00:33:31.401 INFO:tasks.workunit.client.1.smithi161.stdout:1/912: dread - d19/f12e zero size 2024-02-22T00:33:31.402 INFO:tasks.workunit.client.1.smithi161.stdout:3/880: link da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/f105 da/dc/d11/d26/d80/f11e 0 2024-02-22T00:33:31.404 INFO:tasks.workunit.client.1.smithi161.stdout:8/936: getdents d1/d1c/d75/d18 0 2024-02-22T00:33:31.406 INFO:tasks.workunit.client.1.smithi161.stdout:1/913: fdatasync d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f11d 0 2024-02-22T00:33:31.406 INFO:tasks.workunit.client.1.smithi161.stdout:7/915: dread d3/f7 [0,4194304] 0 2024-02-22T00:33:31.406 INFO:tasks.workunit.client.1.smithi161.stdout:4/897: unlink d5/d8/d41/d57/dbe/d131/l145 0 2024-02-22T00:33:31.407 INFO:tasks.workunit.client.1.smithi161.stdout:7/916: write d3/dd/f1d [492834,108115] 0 2024-02-22T00:33:31.410 INFO:tasks.workunit.client.1.smithi161.stdout:0/887: rename d14/d44/c5a to d14/d1a/d3f/d108/d10c/d126/da5/dcd/d104/c12a 0 2024-02-22T00:33:31.412 INFO:tasks.workunit.client.1.smithi161.stdout:9/908: creat d1/d5/d9/da5/d109/f135 x:0 0 0 2024-02-22T00:33:31.412 INFO:tasks.workunit.client.1.smithi161.stdout:4/898: truncate f3 933780 0 2024-02-22T00:33:31.417 INFO:tasks.workunit.client.1.smithi161.stdout:9/909: truncate d1/d5/d9/f10d 1167064 0 2024-02-22T00:33:31.420 INFO:tasks.workunit.client.1.smithi161.stdout:6/899: rename d3/l2c to d3/dc/df/d32/dd9/d87/l122 0 2024-02-22T00:33:31.422 INFO:tasks.workunit.client.1.smithi161.stdout:0/888: dwrite d14/d1a/f71 [4194304,4194304] 0 2024-02-22T00:33:31.423 INFO:tasks.workunit.client.1.smithi161.stdout:4/899: mknod d5/d8/d41/d57/dbe/d28/d38/d6d/da5/c154 0 2024-02-22T00:33:31.425 INFO:tasks.workunit.client.1.smithi161.stdout:9/910: mkdir d1/d25/d73/d98/d136 0 2024-02-22T00:33:31.426 INFO:tasks.workunit.client.1.smithi161.stdout:6/900: readlink d3/d10/l42 0 2024-02-22T00:33:31.429 INFO:tasks.workunit.client.1.smithi161.stdout:6/901: chown d3/dc/df/c73 248687349 1 2024-02-22T00:33:31.429 INFO:tasks.workunit.client.1.smithi161.stdout:0/889: write d14/f56 [4757008,59020] 0 2024-02-22T00:33:31.430 INFO:tasks.workunit.client.1.smithi161.stdout:4/900: fdatasync d5/d8/d41/d57/dbe/d28/f2d 0 2024-02-22T00:33:31.432 INFO:tasks.workunit.client.1.smithi161.stdout:1/914: dread d19/d1d/f114 [0,4194304] 0 2024-02-22T00:33:31.432 INFO:tasks.workunit.client.1.smithi161.stdout:7/917: write d3/df/d33/d35/d55/d63/d7b/d30/dc0/ff9 [73150,8864] 0 2024-02-22T00:33:31.433 INFO:tasks.workunit.client.1.smithi161.stdout:9/911: read d1/d2/d4/f2a [2189215,53719] 0 2024-02-22T00:33:31.438 INFO:tasks.workunit.client.1.smithi161.stdout:7/918: fdatasync d3/df/d43/fb3 0 2024-02-22T00:33:31.439 INFO:tasks.workunit.client.1.smithi161.stdout:4/901: write d5/d8/d41/d57/f60 [2857382,110389] 0 2024-02-22T00:33:31.439 INFO:tasks.workunit.client.1.smithi161.stdout:0/890: rename d14/d44/c54 to d14/d44/c12b 0 2024-02-22T00:33:31.439 INFO:tasks.workunit.client.1.smithi161.stdout:2/983: dread de/d2b/d83/d4f/f56 [0,4194304] 0 2024-02-22T00:33:31.440 INFO:tasks.workunit.client.1.smithi161.stdout:8/937: dread d1/d1c/d75/d18/f25 [0,4194304] 0 2024-02-22T00:33:31.440 INFO:tasks.workunit.client.1.smithi161.stdout:1/915: write d19/d90/dd6/f100 [634372,110440] 0 2024-02-22T00:33:31.445 INFO:tasks.workunit.client.1.smithi161.stdout:6/902: dwrite d3/f5d [0,4194304] 0 2024-02-22T00:33:31.446 INFO:tasks.workunit.client.1.smithi161.stdout:7/919: chown d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/d110/f10c 241 1 2024-02-22T00:33:31.447 INFO:tasks.workunit.client.1.smithi161.stdout:9/912: link d1/d2/d4/d11/f31 d1/d2/d4/d1f/f137 0 2024-02-22T00:33:31.450 INFO:tasks.workunit.client.1.smithi161.stdout:8/938: getdents d1/d2f 0 2024-02-22T00:33:31.451 INFO:tasks.workunit.client.1.smithi161.stdout:6/903: creat d3/d7c/f123 x:0 0 0 2024-02-22T00:33:31.453 INFO:tasks.workunit.client.1.smithi161.stdout:6/904: fsync d3/d10/d12/d2f/ffb 0 2024-02-22T00:33:31.455 INFO:tasks.workunit.client.1.smithi161.stdout:9/913: dread - d1/d5/f97 zero size 2024-02-22T00:33:31.456 INFO:tasks.workunit.client.1.smithi161.stdout:1/916: truncate d19/d51/d64/d9b/da5/dbc/fc5 1017803 0 2024-02-22T00:33:31.459 INFO:tasks.workunit.client.1.smithi161.stdout:2/984: creat de/d2b/d8b/da2/da5/dc4/f151 x:0 0 0 2024-02-22T00:33:31.459 INFO:tasks.workunit.client.1.smithi161.stdout:9/914: dread - d1/d2/d7/da/fe0 zero size 2024-02-22T00:33:31.461 INFO:tasks.workunit.client.1.smithi161.stdout:7/920: dread d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100/fb0 [0,4194304] 0 2024-02-22T00:33:31.464 INFO:tasks.workunit.client.1.smithi161.stdout:8/939: dwrite d1/d2f/f110 [0,4194304] 0 2024-02-22T00:33:31.464 INFO:tasks.workunit.client.1.smithi161.stdout:9/915: rmdir d1/d2/d4/d11 39 2024-02-22T00:33:31.467 INFO:tasks.workunit.client.1.smithi161.stdout:2/985: mkdir de/d2b/d8b/de6/dfb/d11a/d152 0 2024-02-22T00:33:31.468 INFO:tasks.workunit.client.1.smithi161.stdout:0/891: dread d14/d1a/f60 [0,4194304] 0 2024-02-22T00:33:31.470 INFO:tasks.workunit.client.1.smithi161.stdout:9/916: write d1/d5/d9/da5/d109/f119 [11644,17382] 0 2024-02-22T00:33:31.473 INFO:tasks.workunit.client.1.smithi161.stdout:4/902: dread d5/d8/d41/d57/dbe/ff5 [0,4194304] 0 2024-02-22T00:33:31.474 INFO:tasks.workunit.client.1.smithi161.stdout:7/921: mknod d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/df8/c127 0 2024-02-22T00:33:31.476 INFO:tasks.workunit.client.1.smithi161.stdout:2/986: symlink de/d2b/d8b/ddc/d125/l153 0 2024-02-22T00:33:31.479 INFO:tasks.workunit.client.1.smithi161.stdout:9/917: rename d1/d2/d4/d11 to d1/d5/d9/da5/dbc/d115/d138 0 2024-02-22T00:33:31.480 INFO:tasks.workunit.client.1.smithi161.stdout:0/892: dwrite d14/d1a/d3f/d96/dad/f123 [0,4194304] 0 2024-02-22T00:33:31.480 INFO:tasks.workunit.client.1.smithi161.stdout:4/903: truncate d5/d8/d41/d53/d6c/d91/f101 490014 0 2024-02-22T00:33:31.484 INFO:tasks.workunit.client.1.smithi161.stdout:9/918: read d1/d2/d7/da/f13 [3329093,112368] 0 2024-02-22T00:33:31.484 INFO:tasks.workunit.client.1.smithi161.stdout:6/905: dread d3/d10/d12/d2f/f3c [0,4194304] 0 2024-02-22T00:33:31.485 INFO:tasks.workunit.client.1.smithi161.stdout:6/906: readlink d3/l1c 0 2024-02-22T00:33:31.493 INFO:tasks.workunit.client.1.smithi161.stdout:9/919: mknod d1/c139 0 2024-02-22T00:33:31.494 INFO:tasks.workunit.client.1.smithi161.stdout:6/907: dwrite d3/d10/d12/d2f/d7d/dab/dbe/ff0 [0,4194304] 0 2024-02-22T00:33:31.495 INFO:tasks.workunit.client.1.smithi161.stdout:7/922: write d3/df/d43/fa2 [132,86416] 0 2024-02-22T00:33:31.496 INFO:tasks.workunit.client.1.smithi161.stdout:1/917: dwrite d19/d85/f94 [4194304,4194304] 0 2024-02-22T00:33:31.497 INFO:tasks.workunit.client.1.smithi161.stdout:4/904: getdents d5/d8/d41/d53 0 2024-02-22T00:33:31.497 INFO:tasks.workunit.client.1.smithi161.stdout:0/893: write d14/d1a/f28 [5055496,67015] 0 2024-02-22T00:33:31.499 INFO:tasks.workunit.client.1.smithi161.stdout:2/987: truncate de/d11/d32/f106 1879692 0 2024-02-22T00:33:31.501 INFO:tasks.workunit.client.1.smithi161.stdout:6/908: fsync d3/d10/d12/d3a/f11a 0 2024-02-22T00:33:31.505 INFO:tasks.workunit.client.1.smithi161.stdout:7/923: chown d3/df/d33/d35/d55/d63/d7b/f70 1341123619 1 2024-02-22T00:33:31.506 INFO:tasks.workunit.client.1.smithi161.stdout:4/905: mkdir d5/d8/d41/d155 0 2024-02-22T00:33:31.507 INFO:tasks.workunit.client.1.smithi161.stdout:1/918: mkdir d19/d1d/d2c/d2d/d3f/d118/d135 0 2024-02-22T00:33:31.508 INFO:tasks.workunit.client.1.smithi161.stdout:6/909: rmdir d3/d7c 39 2024-02-22T00:33:31.508 INFO:tasks.workunit.client.1.smithi161.stdout:1/919: fsync d19/d51/d6c/f10f 0 2024-02-22T00:33:31.510 INFO:tasks.workunit.client.1.smithi161.stdout:7/924: creat d3/df/d33/d35/d55/de4/f128 x:0 0 0 2024-02-22T00:33:31.510 INFO:tasks.workunit.client.1.smithi161.stdout:1/920: fdatasync d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d120/f12d 0 2024-02-22T00:33:31.511 INFO:tasks.workunit.client.1.smithi161.stdout:7/925: dread - d3/df/dba/f11e zero size 2024-02-22T00:33:31.512 INFO:tasks.workunit.client.1.smithi161.stdout:2/988: dread de/d2b/d83/f70 [0,4194304] 0 2024-02-22T00:33:31.512 INFO:tasks.workunit.client.1.smithi161.stdout:6/910: rmdir d3/dc 39 2024-02-22T00:33:31.515 INFO:tasks.workunit.client.1.smithi161.stdout:1/921: creat d19/d51/d64/de1/f136 x:0 0 0 2024-02-22T00:33:31.517 INFO:tasks.workunit.client.1.smithi161.stdout:2/989: write de/d139/f13d [3005729,5536] 0 2024-02-22T00:33:31.519 INFO:tasks.workunit.client.1.smithi161.stdout:4/906: dwrite d5/d17/fd3 [0,4194304] 0 2024-02-22T00:33:31.520 INFO:tasks.workunit.client.1.smithi161.stdout:9/920: truncate d1/d2/d7/da/fa0 1862530 0 2024-02-22T00:33:31.522 INFO:tasks.workunit.client.1.smithi161.stdout:2/990: fdatasync de/d11/f4e 0 2024-02-22T00:33:31.523 INFO:tasks.workunit.client.1.smithi161.stdout:4/907: write d5/d8/d41/ff4 [923022,20001] 0 2024-02-22T00:33:31.524 INFO:tasks.workunit.client.1.smithi161.stdout:1/922: rename d19/d51/d6c to d19/d90/dd6/d137 0 2024-02-22T00:33:31.526 INFO:tasks.workunit.client.1.smithi161.stdout:7/926: dwrite d3/dd/d59/fbe [0,4194304] 0 2024-02-22T00:33:31.531 INFO:tasks.workunit.client.1.smithi161.stdout:7/927: symlink d3/df/d33/d53/l129 0 2024-02-22T00:33:31.535 INFO:tasks.workunit.client.1.smithi161.stdout:1/923: rename d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f102 to d19/d51/da1/f138 0 2024-02-22T00:33:31.536 INFO:tasks.workunit.client.1.smithi161.stdout:2/991: link de/d2b/d8b/da2/da5/dc4/da7/fb7 de/d2b/d8b/de6/dfb/d11a/d150/f154 0 2024-02-22T00:33:31.538 INFO:tasks.workunit.client.1.smithi161.stdout:4/908: rename d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/f1f to d5/d8/d41/d53/d6c/d72/dfb/f156 0 2024-02-22T00:33:31.539 INFO:tasks.workunit.client.1.smithi161.stdout:1/924: symlink d19/d51/d64/d9b/l139 0 2024-02-22T00:33:31.539 INFO:tasks.workunit.client.1.smithi161.stdout:3/881: sync 2024-02-22T00:33:31.539 INFO:tasks.workunit.client.1.smithi161.stdout:2/992: rmdir de/d2b/d8b/ddc/d125/d3a 39 2024-02-22T00:33:31.542 INFO:tasks.workunit.client.1.smithi161.stdout:7/928: dwrite d3/df/d33/d35/d55/d63/f66 [4194304,4194304] 0 2024-02-22T00:33:31.547 INFO:tasks.workunit.client.1.smithi161.stdout:1/925: mkdir d19/d1d/d56/db2/d13a 0 2024-02-22T00:33:31.548 INFO:tasks.workunit.client.1.smithi161.stdout:3/882: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f3f [5025515,20245] 0 2024-02-22T00:33:31.550 INFO:tasks.workunit.client.1.smithi161.stdout:6/911: dread d3/d10/d12/d3a/fa1 [0,4194304] 0 2024-02-22T00:33:31.551 INFO:tasks.workunit.client.1.smithi161.stdout:1/926: creat d19/f13b x:0 0 0 2024-02-22T00:33:31.552 INFO:tasks.workunit.client.1.smithi161.stdout:2/993: unlink de/d2b/d8b/ddc/d125/f79 0 2024-02-22T00:33:31.552 INFO:tasks.workunit.client.1.smithi161.stdout:1/927: write d19/d90/dd6/d137/dd4/f4c [56129,100566] 0 2024-02-22T00:33:31.562 INFO:tasks.workunit.client.1.smithi161.stdout:0/894: dread d14/d37/d42/d73/f91 [0,4194304] 0 2024-02-22T00:33:31.564 INFO:tasks.workunit.client.1.smithi161.stdout:7/929: link d3/df/d33/d35/d55/d63/d7b/d30/d44/cb1 d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100/c12a 0 2024-02-22T00:33:31.567 INFO:tasks.workunit.client.1.smithi161.stdout:2/994: unlink de/d2b/d8b/ddc/d125/dd6/l14f 0 2024-02-22T00:33:31.567 INFO:tasks.workunit.client.1.smithi161.stdout:9/921: dread d1/d2/d4/d1f/fcf [0,4194304] 0 2024-02-22T00:33:31.568 INFO:tasks.workunit.client.1.smithi161.stdout:1/928: rmdir d19/d1d/d2c/d2d/d3f/d69/ddd/df0 39 2024-02-22T00:33:31.568 INFO:tasks.workunit.client.1.smithi161.stdout:2/995: dread - de/d2b/d8b/ddc/f14e zero size 2024-02-22T00:33:31.569 INFO:tasks.workunit.client.1.smithi161.stdout:1/929: read d19/f43 [1685765,102697] 0 2024-02-22T00:33:31.571 INFO:tasks.workunit.client.1.smithi161.stdout:3/883: mknod da/dc/d11/d26/d80/dc7/d59/d11c/c11f 0 2024-02-22T00:33:31.575 INFO:tasks.workunit.client.1.smithi161.stdout:0/895: symlink d14/d1a/d3f/d96/l12c 0 2024-02-22T00:33:31.576 INFO:tasks.workunit.client.1.smithi161.stdout:6/912: dread d3/d10/d1b/f78 [0,4194304] 0 2024-02-22T00:33:31.577 INFO:tasks.workunit.client.1.smithi161.stdout:7/930: chown d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/ca6 24199 1 2024-02-22T00:33:31.578 INFO:tasks.workunit.client.1.smithi161.stdout:9/922: dwrite d1/d2/d7/f47 [0,4194304] 0 2024-02-22T00:33:31.579 INFO:tasks.workunit.client.1.smithi161.stdout:1/930: readlink d19/d1d/d2c/l62 0 2024-02-22T00:33:31.579 INFO:tasks.workunit.client.1.smithi161.stdout:7/931: write d3/dbf/d64/f89 [5190722,8975] 0 2024-02-22T00:33:31.580 INFO:tasks.workunit.client.1.smithi161.stdout:1/931: readlink d19/d1d/d2c/l62 0 2024-02-22T00:33:31.581 INFO:tasks.workunit.client.1.smithi161.stdout:2/996: rename de/d2b/df6 to de/d11/d5c/d11e/d155 0 2024-02-22T00:33:31.583 INFO:tasks.workunit.client.1.smithi161.stdout:3/884: readlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/l4a 0 2024-02-22T00:33:31.584 INFO:tasks.workunit.client.1.smithi161.stdout:7/932: write d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/d110/fc9 [314038,60068] 0 2024-02-22T00:33:31.587 INFO:tasks.workunit.client.1.smithi161.stdout:9/923: rmdir d1/d25/dc4 39 2024-02-22T00:33:31.588 INFO:tasks.workunit.client.1.smithi161.stdout:1/932: mknod d19/d1d/d2c/d2d/d3f/d118/c13c 0 2024-02-22T00:33:31.590 INFO:tasks.workunit.client.1.smithi161.stdout:8/940: sync 2024-02-22T00:33:31.593 INFO:tasks.workunit.client.1.smithi161.stdout:6/913: rename d3/dc/df/d32 to d3/dc/df/dfd/d124 0 2024-02-22T00:33:31.596 INFO:tasks.workunit.client.1.smithi161.stdout:3/885: dwrite da/d29/fdf [0,4194304] 0 2024-02-22T00:33:31.596 INFO:tasks.workunit.client.1.smithi161.stdout:8/941: read d1/d1c/d75/d18/f45 [2163108,47532] 0 2024-02-22T00:33:31.596 INFO:tasks.workunit.client.1.smithi161.stdout:2/997: creat de/d2b/d8b/ddc/d125/d3a/d71/d143/d146/f156 x:0 0 0 2024-02-22T00:33:31.597 INFO:tasks.workunit.client.1.smithi161.stdout:4/909: dwrite d5/d8/d41/d53/d6c/d72/dfb/f156 [4194304,4194304] 0 2024-02-22T00:33:31.598 INFO:tasks.workunit.client.1.smithi161.stdout:1/933: rename d19/d48/f5a to d19/d90/d125/f13d 0 2024-02-22T00:33:31.601 INFO:tasks.workunit.client.1.smithi161.stdout:4/910: readlink d5/d17/l4e 0 2024-02-22T00:33:31.603 INFO:tasks.workunit.client.1.smithi161.stdout:6/914: mknod d3/def/c125 0 2024-02-22T00:33:31.605 INFO:tasks.workunit.client.1.smithi161.stdout:9/924: link d1/d5/d9/da5/dbc/d115/f126 d1/d25/dc4/d4f/da3/f13a 0 2024-02-22T00:33:31.605 INFO:tasks.workunit.client.1.smithi161.stdout:8/942: stat d1/d2f/d37/d64/d7b/d7e/f125 0 2024-02-22T00:33:31.606 INFO:tasks.workunit.client.1.smithi161.stdout:3/886: symlink da/d29/l120 0 2024-02-22T00:33:31.607 INFO:tasks.workunit.client.1.smithi161.stdout:2/998: mknod de/d11/d5c/d11e/d155/c157 0 2024-02-22T00:33:31.616 INFO:tasks.workunit.client.1.smithi161.stdout:0/896: dwrite d14/d1a/f1b [0,4194304] 0 2024-02-22T00:33:31.616 INFO:tasks.workunit.client.1.smithi161.stdout:4/911: readlink d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/ld5 0 2024-02-22T00:33:31.616 INFO:tasks.workunit.client.1.smithi161.stdout:7/933: dread d3/f17 [0,4194304] 0 2024-02-22T00:33:31.616 INFO:tasks.workunit.client.1.smithi161.stdout:0/897: readlink d14/d1a/l30 0 2024-02-22T00:33:31.616 INFO:tasks.workunit.client.1.smithi161.stdout:2/999: mkdir de/d2b/d8b/ddc/d125/d60/d158 0 2024-02-22T00:33:31.621 INFO:tasks.workunit.client.1.smithi161.stdout:4/912: mknod d5/d8/d41/d57/dbe/c157 0 2024-02-22T00:33:31.623 INFO:tasks.workunit.client.1.smithi161.stdout:1/934: dwrite d19/d90/dd6/d137/f10f [0,4194304] 0 2024-02-22T00:33:31.623 INFO:tasks.workunit.client.1.smithi161.stdout:0/898: mkdir d14/d1a/d3f/d96/d12d 0 2024-02-22T00:33:31.627 INFO:tasks.workunit.client.1.smithi161.stdout:0/899: chown d14/d1a/f3d 1 1 2024-02-22T00:33:31.627 INFO:tasks.workunit.client.1.smithi161.stdout:4/913: write d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/d12d/f142 [378764,49907] 0 2024-02-22T00:33:31.630 INFO:tasks.workunit.client.1.smithi161.stdout:1/935: creat d19/d51/d64/d9b/da5/ddb/f13e x:0 0 0 2024-02-22T00:33:31.630 INFO:tasks.workunit.client.1.smithi161.stdout:3/887: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/fc2 [0,4194304] 0 2024-02-22T00:33:31.636 INFO:tasks.workunit.client.1.smithi161.stdout:1/936: truncate d19/d85/f128 562524 0 2024-02-22T00:33:31.636 INFO:tasks.workunit.client.1.smithi161.stdout:4/914: chown d5/d8/d41/d57/dbe/d28/d63/ceb 587996468 1 2024-02-22T00:33:31.638 INFO:tasks.workunit.client.1.smithi161.stdout:3/888: truncate da/dc/d11/d26/f52 5227578 0 2024-02-22T00:33:31.640 INFO:tasks.workunit.client.1.smithi161.stdout:4/915: mkdir d5/db0/d158 0 2024-02-22T00:33:31.642 INFO:tasks.workunit.client.1.smithi161.stdout:6/915: write d3/d10/d12/f9e [2004526,41433] 0 2024-02-22T00:33:31.643 INFO:tasks.workunit.client.1.smithi161.stdout:3/889: symlink da/dc/d11/d26/d80/dc7/dfe/l121 0 2024-02-22T00:33:31.645 INFO:tasks.workunit.client.1.smithi161.stdout:0/900: dwrite d14/d37/d42/d73/f74 [4194304,4194304] 0 2024-02-22T00:33:31.645 INFO:tasks.workunit.client.1.smithi161.stdout:9/925: write d1/d5/d9/da5/dbc/d115/d138/f31 [3396210,98657] 0 2024-02-22T00:33:31.647 INFO:tasks.workunit.client.1.smithi161.stdout:7/934: truncate d3/f17 1323624 0 2024-02-22T00:33:31.648 INFO:tasks.workunit.client.1.smithi161.stdout:4/916: link d5/d8/d41/d53/fe7 d5/db0/d158/f159 0 2024-02-22T00:33:31.648 INFO:tasks.workunit.client.1.smithi161.stdout:8/943: dread d1/d2f/d37/d64/d7b/ff4 [0,4194304] 0 2024-02-22T00:33:31.650 INFO:tasks.workunit.client.1.smithi161.stdout:9/926: fdatasync d1/d5/f97 0 2024-02-22T00:33:31.650 INFO:tasks.workunit.client.1.smithi161.stdout:4/917: read - d5/d8/d41/d57/dbe/f108 zero size 2024-02-22T00:33:31.652 INFO:tasks.workunit.client.1.smithi161.stdout:7/935: chown d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/ca6 221 1 2024-02-22T00:33:31.652 INFO:tasks.workunit.client.1.smithi161.stdout:8/944: chown d1/d1c/d20/d22/d28/d7f/d109/f11b 51 1 2024-02-22T00:33:31.653 INFO:tasks.workunit.client.1.smithi161.stdout:6/916: mkdir d3/d7c/dd1/d116/d126 0 2024-02-22T00:33:31.654 INFO:tasks.workunit.client.1.smithi161.stdout:7/936: fdatasync d3/df/d33/d35/d55/d63/d7b/d30/dc0/ff9 0 2024-02-22T00:33:31.658 INFO:tasks.workunit.client.1.smithi161.stdout:8/945: readlink d1/d1c/d96/l98 0 2024-02-22T00:33:31.658 INFO:tasks.workunit.client.1.smithi161.stdout:1/937: write d19/d1d/f36 [1675568,37909] 0 2024-02-22T00:33:31.663 INFO:tasks.workunit.client.1.smithi161.stdout:6/917: rmdir d3/d10/d12/d2f 39 2024-02-22T00:33:31.666 INFO:tasks.workunit.client.1.smithi161.stdout:8/946: dwrite d1/d1c/d20/d22/d28/d7f/ff3 [0,4194304] 0 2024-02-22T00:33:31.666 INFO:tasks.workunit.client.1.smithi161.stdout:6/918: chown d3/dc/df/dfd/d124/dd9/lf6 50 1 2024-02-22T00:33:31.668 INFO:tasks.workunit.client.1.smithi161.stdout:7/937: rename d3/df/d33/d35/d55/d63/d7b/d8f/lae to d3/df/d33/d35/d55/d63/d7b/de5/l12b 0 2024-02-22T00:33:31.668 INFO:tasks.workunit.client.1.smithi161.stdout:4/918: dread d5/d8/d41/d57/dbe/d28/d63/f98 [0,4194304] 0 2024-02-22T00:33:31.670 INFO:tasks.workunit.client.1.smithi161.stdout:0/901: link d14/d1a/d3f/d96/dbc/dc5/f107 d14/d37/d42/d73/f12e 0 2024-02-22T00:33:31.674 INFO:tasks.workunit.client.1.smithi161.stdout:7/938: write d3/df/d43/fb3 [522615,104425] 0 2024-02-22T00:33:31.675 INFO:tasks.workunit.client.1.smithi161.stdout:4/919: symlink d5/d8/d41/d57/dbe/d28/d38/l15a 0 2024-02-22T00:33:31.679 INFO:tasks.workunit.client.1.smithi161.stdout:0/902: mknod d14/d101/c12f 0 2024-02-22T00:33:31.679 INFO:tasks.workunit.client.1.smithi161.stdout:7/939: symlink d3/dbf/d64/l12c 0 2024-02-22T00:33:31.681 INFO:tasks.workunit.client.1.smithi161.stdout:8/947: rmdir d1/d1c/d20/dc0 0 2024-02-22T00:33:31.682 INFO:tasks.workunit.client.1.smithi161.stdout:6/919: dwrite d3/daf/f10d [0,4194304] 0 2024-02-22T00:33:31.683 INFO:tasks.workunit.client.1.smithi161.stdout:0/903: write fb [1010750,46783] 0 2024-02-22T00:33:31.685 INFO:tasks.workunit.client.1.smithi161.stdout:7/940: fsync d3/df/d33/f114 0 2024-02-22T00:33:31.687 INFO:tasks.workunit.client.1.smithi161.stdout:3/890: dwrite da/dc/d11/d26/d80/dc7/f97 [0,4194304] 0 2024-02-22T00:33:31.690 INFO:tasks.workunit.client.1.smithi161.stdout:6/920: write d3/d10/f55 [2517310,30463] 0 2024-02-22T00:33:31.692 INFO:tasks.workunit.client.1.smithi161.stdout:9/927: dwrite d1/d25/d73/d60/d77/f7c [0,4194304] 0 2024-02-22T00:33:31.695 INFO:tasks.workunit.client.1.smithi161.stdout:0/904: read d14/d1a/f24 [724166,80801] 0 2024-02-22T00:33:31.697 INFO:tasks.workunit.client.1.smithi161.stdout:6/921: fsync d3/d10/d12/f23 0 2024-02-22T00:33:31.699 INFO:tasks.workunit.client.1.smithi161.stdout:1/938: dwrite d19/d1d/d2c/d2d/f83 [0,4194304] 0 2024-02-22T00:33:31.699 INFO:tasks.workunit.client.1.smithi161.stdout:3/891: fsync da/dc/d11/d26/d80/dc7/f10a 0 2024-02-22T00:33:31.703 INFO:tasks.workunit.client.1.smithi161.stdout:9/928: dread d1/d2/d7/f47 [0,4194304] 0 2024-02-22T00:33:31.705 INFO:tasks.workunit.client.1.smithi161.stdout:4/920: rename d5/d17/d5c/l90 to d5/d8/d41/d57/dbe/d28/d63/d65/l15b 0 2024-02-22T00:33:31.706 INFO:tasks.workunit.client.1.smithi161.stdout:9/929: write d1/d2/d7/da/f75 [1843089,115706] 0 2024-02-22T00:33:31.708 INFO:tasks.workunit.client.1.smithi161.stdout:4/921: chown d5/d8/d41/d57/dbe/d28/fa2 25774 1 2024-02-22T00:33:31.709 INFO:tasks.workunit.client.1.smithi161.stdout:1/939: readlink d19/d51/d64/l96 0 2024-02-22T00:33:31.711 INFO:tasks.workunit.client.1.smithi161.stdout:6/922: creat d3/dc/df/dfd/d124/de5/f127 x:0 0 0 2024-02-22T00:33:31.715 INFO:tasks.workunit.client.1.smithi161.stdout:9/930: creat d1/d5/d9/da5/f13b x:0 0 0 2024-02-22T00:33:31.716 INFO:tasks.workunit.client.1.smithi161.stdout:9/931: stat d1/d2/d4/d95/db8/f124 0 2024-02-22T00:33:31.718 INFO:tasks.workunit.client.1.smithi161.stdout:9/932: chown d1/d5/d9/f4a 258543 1 2024-02-22T00:33:31.720 INFO:tasks.workunit.client.1.smithi161.stdout:3/892: creat da/d29/f122 x:0 0 0 2024-02-22T00:33:31.722 INFO:tasks.workunit.client.1.smithi161.stdout:0/905: getdents d14/d44/dbf 0 2024-02-22T00:33:31.723 INFO:tasks.workunit.client.1.smithi161.stdout:6/923: link d3/dc/df/dfd/d124/dd9/fb7 d3/dc/df/f128 0 2024-02-22T00:33:31.724 INFO:tasks.workunit.client.1.smithi161.stdout:9/933: mkdir d1/d25/dc4/d4f/da3/d13c 0 2024-02-22T00:33:31.725 INFO:tasks.workunit.client.1.smithi161.stdout:0/906: stat d14/f1f 0 2024-02-22T00:33:31.726 INFO:tasks.workunit.client.1.smithi161.stdout:7/941: dread d3/fa9 [4194304,4194304] 0 2024-02-22T00:33:31.726 INFO:tasks.workunit.client.1.smithi161.stdout:1/940: getdents d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98 0 2024-02-22T00:33:31.727 INFO:tasks.workunit.client.1.smithi161.stdout:3/893: creat da/dc/d11/d26/d80/d92/f123 x:0 0 0 2024-02-22T00:33:31.728 INFO:tasks.workunit.client.1.smithi161.stdout:9/934: mknod d1/d25/dc4/d4f/da3/c13d 0 2024-02-22T00:33:31.728 INFO:tasks.workunit.client.1.smithi161.stdout:0/907: dread - d14/d37/d42/d8e/fa9 zero size 2024-02-22T00:33:31.728 INFO:tasks.workunit.client.1.smithi161.stdout:6/924: symlink d3/d10/l129 0 2024-02-22T00:33:31.733 INFO:tasks.workunit.client.1.smithi161.stdout:6/925: write d3/d10/d12/d2f/d7d/dab/dbe/f100 [64638,96772] 0 2024-02-22T00:33:31.733 INFO:tasks.workunit.client.1.smithi161.stdout:3/894: fdatasync da/dc/d11/d26/d80/d92/fa7 0 2024-02-22T00:33:31.735 INFO:tasks.workunit.client.1.smithi161.stdout:4/922: dread d5/fe [0,4194304] 0 2024-02-22T00:33:31.736 INFO:tasks.workunit.client.1.smithi161.stdout:0/908: rename d14/d1a/d3f/c7d to d14/df1/c130 0 2024-02-22T00:33:31.736 INFO:tasks.workunit.client.1.smithi161.stdout:6/926: write d3/dc/df/dfd/d124/dd9/d87/fd2 [365365,115629] 0 2024-02-22T00:33:31.737 INFO:tasks.workunit.client.1.smithi161.stdout:7/942: mknod d3/df/d33/d35/d55/d63/d7b/d30/dc0/c12d 0 2024-02-22T00:33:31.745 INFO:tasks.workunit.client.1.smithi161.stdout:4/923: dread d5/d17/f4a [0,4194304] 0 2024-02-22T00:33:31.745 INFO:tasks.workunit.client.1.smithi161.stdout:3/895: rmdir da/dc/d11/d26/d80/d92 39 2024-02-22T00:33:31.746 INFO:tasks.workunit.client.1.smithi161.stdout:6/927: dwrite d3/d30/db4/f10f [0,4194304] 0 2024-02-22T00:33:31.747 INFO:tasks.workunit.client.1.smithi161.stdout:1/941: write d19/d1d/d2c/d2d/fa6 [516122,120627] 0 2024-02-22T00:33:31.749 INFO:tasks.workunit.client.1.smithi161.stdout:6/928: creat d3/d10/d72/f12a x:0 0 0 2024-02-22T00:33:31.750 INFO:tasks.workunit.client.1.smithi161.stdout:9/935: dread d1/d2/d7/da/f8e [0,4194304] 0 2024-02-22T00:33:31.751 INFO:tasks.workunit.client.1.smithi161.stdout:7/943: truncate d3/f8d 6277848 0 2024-02-22T00:33:31.753 INFO:tasks.workunit.client.1.smithi161.stdout:1/942: chown d19/d1d/d2c/d2d/d3f/d69/ddd/df0/f79 0 1 2024-02-22T00:33:31.756 INFO:tasks.workunit.client.1.smithi161.stdout:3/896: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f124 x:0 0 0 2024-02-22T00:33:31.760 INFO:tasks.workunit.client.1.smithi161.stdout:1/943: dwrite d19/d51/d64/d9b/da5/dbc/f124 [0,4194304] 0 2024-02-22T00:33:31.761 INFO:tasks.workunit.client.1.smithi161.stdout:6/929: symlink d3/d10/d12/l12b 0 2024-02-22T00:33:31.763 INFO:tasks.workunit.client.1.smithi161.stdout:6/930: chown d3/d10/d12/d2f 202808 1 2024-02-22T00:33:31.764 INFO:tasks.workunit.client.1.smithi161.stdout:1/944: mkdir d19/d13f 0 2024-02-22T00:33:31.765 INFO:tasks.workunit.client.1.smithi161.stdout:6/931: stat d3/d10/d12/d3a/d10e 0 2024-02-22T00:33:31.768 INFO:tasks.workunit.client.1.smithi161.stdout:3/897: dwrite da/dc/d11/d26/d80/dc7/f115 [0,4194304] 0 2024-02-22T00:33:31.770 INFO:tasks.workunit.client.1.smithi161.stdout:3/898: chown da/dc/d11/d26/c22 123 1 2024-02-22T00:33:31.771 INFO:tasks.workunit.client.1.smithi161.stdout:4/924: truncate d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/f1b 1655591 0 2024-02-22T00:33:31.773 INFO:tasks.workunit.client.1.smithi161.stdout:4/925: readlink d5/lb3 0 2024-02-22T00:33:31.773 INFO:tasks.workunit.client.1.smithi161.stdout:6/932: dwrite d3/d10/f38 [0,4194304] 0 2024-02-22T00:33:31.776 INFO:tasks.workunit.client.1.smithi161.stdout:1/945: write d19/f43 [2528938,85429] 0 2024-02-22T00:33:31.782 INFO:tasks.workunit.client.1.smithi161.stdout:9/936: dread d1/d2/d4/d1f/fca [0,4194304] 0 2024-02-22T00:33:31.785 INFO:tasks.workunit.client.1.smithi161.stdout:4/926: dwrite d5/d8/d41/d57/dbe/f10b [4194304,4194304] 0 2024-02-22T00:33:31.788 INFO:tasks.workunit.client.1.smithi161.stdout:9/937: rmdir d1/d5/d9/d9c/d11c 39 2024-02-22T00:33:31.790 INFO:tasks.workunit.client.1.smithi161.stdout:4/927: symlink d5/db0/l15c 0 2024-02-22T00:33:31.791 INFO:tasks.workunit.client.1.smithi161.stdout:1/946: dwrite d19/d90/dd6/d137/f10f [0,4194304] 0 2024-02-22T00:33:31.792 INFO:tasks.workunit.client.1.smithi161.stdout:9/938: write d1/d5/d9/d9c/d11c/f12b [641113,45698] 0 2024-02-22T00:33:31.793 INFO:tasks.workunit.client.1.smithi161.stdout:9/939: fsync d1/d25/f5b 0 2024-02-22T00:33:31.794 INFO:tasks.workunit.client.1.smithi161.stdout:4/928: creat d5/d8/d41/d57/f15d x:0 0 0 2024-02-22T00:33:31.796 INFO:tasks.workunit.client.1.smithi161.stdout:1/947: rmdir d19/d1d/d2c/d2d/d3f/d118 39 2024-02-22T00:33:31.798 INFO:tasks.workunit.client.1.smithi161.stdout:9/940: symlink d1/d2/d4/d1f/dab/dcd/l13e 0 2024-02-22T00:33:31.800 INFO:tasks.workunit.client.1.smithi161.stdout:4/929: truncate d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/d75/fa0 134122 0 2024-02-22T00:33:31.800 INFO:tasks.workunit.client.1.smithi161.stdout:9/941: fsync d1/d2/d4/d1f/dab/f12d 0 2024-02-22T00:33:31.802 INFO:tasks.workunit.client.1.smithi161.stdout:4/930: truncate d5/d8/d41/d53/d6c/d72/dfb/f156 9320526 0 2024-02-22T00:33:31.806 INFO:tasks.workunit.client.1.smithi161.stdout:1/948: rename d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d120/f12d to d19/d1d/d2c/d2d/d3f/d69/f140 0 2024-02-22T00:33:31.807 INFO:tasks.workunit.client.1.smithi161.stdout:4/931: creat d5/d17/d5c/f15e x:0 0 0 2024-02-22T00:33:31.808 INFO:tasks.workunit.client.1.smithi161.stdout:1/949: mknod d19/d51/d64/d9b/da5/dbc/df8/c141 0 2024-02-22T00:33:31.809 INFO:tasks.workunit.client.1.smithi161.stdout:1/950: chown d19/d48 510 1 2024-02-22T00:33:31.813 INFO:tasks.workunit.client.1.smithi161.stdout:1/951: getdents d19/d90/dd6/d137/dd4 0 2024-02-22T00:33:31.827 INFO:tasks.workunit.client.1.smithi161.stdout:8/948: sync 2024-02-22T00:33:31.828 INFO:tasks.workunit.client.1.smithi161.stdout:4/932: dread d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/f52 [0,4194304] 0 2024-02-22T00:33:31.829 INFO:tasks.workunit.client.1.smithi161.stdout:4/933: chown d5/d8/d41/d53/d6c/dd8/f113 962 1 2024-02-22T00:33:31.832 INFO:tasks.workunit.client.1.smithi161.stdout:1/952: dread d19/d1d/f22 [0,4194304] 0 2024-02-22T00:33:31.833 INFO:tasks.workunit.client.1.smithi161.stdout:4/934: rename d5/d8/d41/d57/dbe/d28/d63/ceb to d5/d8/d41/d57/c15f 0 2024-02-22T00:33:31.835 INFO:tasks.workunit.client.1.smithi161.stdout:4/935: write d5/d8/d41/d53/d6c/d72/dfb/f153 [267716,108660] 0 2024-02-22T00:33:31.836 INFO:tasks.workunit.client.1.smithi161.stdout:1/953: write d19/d51/d64/d9b/da5/daa/fea [5935316,95057] 0 2024-02-22T00:33:31.839 INFO:tasks.workunit.client.1.smithi161.stdout:4/936: fdatasync d5/d8/f12c 0 2024-02-22T00:33:31.843 INFO:tasks.workunit.client.1.smithi161.stdout:1/954: dwrite d19/d51/d64/d9b/fb3 [0,4194304] 0 2024-02-22T00:33:31.845 INFO:tasks.workunit.client.1.smithi161.stdout:8/949: dwrite d1/d1c/d20/d22/d28/d7f/d92/d95/f50 [0,4194304] 0 2024-02-22T00:33:31.845 INFO:tasks.workunit.client.1.smithi161.stdout:4/937: creat d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/f160 x:0 0 0 2024-02-22T00:33:31.849 INFO:tasks.workunit.client.1.smithi161.stdout:1/955: creat d19/d90/dcf/f142 x:0 0 0 2024-02-22T00:33:31.850 INFO:tasks.workunit.client.1.smithi161.stdout:8/950: creat d1/d1c/d75/d18/f12d x:0 0 0 2024-02-22T00:33:31.859 INFO:tasks.workunit.client.1.smithi161.stdout:1/956: read d19/d1d/d56/db2/fc1 [711502,118883] 0 2024-02-22T00:33:31.867 INFO:tasks.workunit.client.1.smithi161.stdout:1/957: dwrite d19/d51/d64/d9b/f12f [0,4194304] 0 2024-02-22T00:33:31.873 INFO:tasks.workunit.client.1.smithi161.stdout:4/938: dread d5/d8/d41/d57/dbe/d28/d38/d6d/da5/fc3 [0,4194304] 0 2024-02-22T00:33:31.875 INFO:tasks.workunit.client.1.smithi161.stdout:4/939: write d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/d14/f10a [989194,111490] 0 2024-02-22T00:33:31.913 INFO:tasks.workunit.client.1.smithi161.stdout:8/951: rename d1/d1c/d96/dcf to d1/d1c/d96/df7/d12e 0 2024-02-22T00:33:31.916 INFO:tasks.workunit.client.1.smithi161.stdout:0/909: sync 2024-02-22T00:33:31.918 INFO:tasks.workunit.client.1.smithi161.stdout:4/940: rmdir d5/d8/d41/d53 39 2024-02-22T00:33:31.919 INFO:tasks.workunit.client.1.smithi161.stdout:8/952: dwrite d1/d1c/d20/fc6 [0,4194304] 0 2024-02-22T00:33:31.926 INFO:tasks.workunit.client.1.smithi161.stdout:8/953: mknod d1/d1c/d20/d22/d28/d7f/db4/c12f 0 2024-02-22T00:33:31.927 INFO:tasks.workunit.client.1.smithi161.stdout:8/954: dread - d1/d1c/d20/d22/d28/d7f/d92/d93/fe8 zero size 2024-02-22T00:33:31.929 INFO:tasks.workunit.client.1.smithi161.stdout:1/958: write d19/d51/d64/d9b/da5/dbc/fc5 [1505391,8510] 0 2024-02-22T00:33:31.931 INFO:tasks.workunit.client.1.smithi161.stdout:1/959: fdatasync d19/d85/d87/fb1 0 2024-02-22T00:33:31.931 INFO:tasks.workunit.client.1.smithi161.stdout:0/910: dread d14/d1a/d3f/d108/d10c/d126/fd6 [0,4194304] 0 2024-02-22T00:33:31.932 INFO:tasks.workunit.client.1.smithi161.stdout:4/941: write d5/d8/d41/d57/dbe/f35 [138382,8351] 0 2024-02-22T00:33:31.933 INFO:tasks.workunit.client.1.smithi161.stdout:1/960: fdatasync d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d120/f131 0 2024-02-22T00:33:31.936 INFO:tasks.workunit.client.1.smithi161.stdout:4/942: creat d5/d8/d41/d57/dbe/d28/d63/d64/f161 x:0 0 0 2024-02-22T00:33:31.939 INFO:tasks.workunit.client.1.smithi161.stdout:1/961: rename d19/d1d/d2c/d2d/db7 to d19/d90/dcf/d143 0 2024-02-22T00:33:31.941 INFO:tasks.workunit.client.1.smithi161.stdout:4/943: mknod d5/d8/d41/d57/dbe/d28/d63/d65/d100/c162 0 2024-02-22T00:33:31.941 INFO:tasks.workunit.client.1.smithi161.stdout:1/962: write d19/d48/faf [4733635,3842] 0 2024-02-22T00:33:31.946 INFO:tasks.workunit.client.1.smithi161.stdout:0/911: dwrite d14/d37/d42/d73/f12e [0,4194304] 0 2024-02-22T00:33:31.947 INFO:tasks.workunit.client.1.smithi161.stdout:1/963: creat d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d120/f144 x:0 0 0 2024-02-22T00:33:31.947 INFO:tasks.workunit.client.1.smithi161.stdout:8/955: dread d1/d1c/d20/d22/d28/d7f/d92/fc3 [0,4194304] 0 2024-02-22T00:33:31.947 INFO:tasks.workunit.client.1.smithi161.stdout:0/912: readlink d14/d37/l8b 0 2024-02-22T00:33:31.949 INFO:tasks.workunit.client.1.smithi161.stdout:4/944: mknod d5/d8/d41/d53/d6c/d130/c163 0 2024-02-22T00:33:31.951 INFO:tasks.workunit.client.1.smithi161.stdout:0/913: write d14/d1a/d3f/d96/da1/ff2 [208064,58784] 0 2024-02-22T00:33:31.951 INFO:tasks.workunit.client.1.smithi161.stdout:8/956: dread - d1/d1c/d20/d22/d28/d7f/d109/f11b zero size 2024-02-22T00:33:31.954 INFO:tasks.workunit.client.1.smithi161.stdout:0/914: truncate d14/f9e 1489850 0 2024-02-22T00:33:31.957 INFO:tasks.workunit.client.1.smithi161.stdout:1/964: dwrite d19/f108 [0,4194304] 0 2024-02-22T00:33:31.957 INFO:tasks.workunit.client.1.smithi161.stdout:8/957: creat d1/d1c/d96/df7/d12e/f130 x:0 0 0 2024-02-22T00:33:31.959 INFO:tasks.workunit.client.1.smithi161.stdout:0/915: creat d14/d1a/d9d/dba/d119/f131 x:0 0 0 2024-02-22T00:33:31.960 INFO:tasks.workunit.client.1.smithi161.stdout:1/965: symlink d19/d48/l145 0 2024-02-22T00:33:31.961 INFO:tasks.workunit.client.1.smithi161.stdout:0/916: chown d14/c61 13519 1 2024-02-22T00:33:31.961 INFO:tasks.workunit.client.1.smithi161.stdout:1/966: chown d19/d51/d64/d9b/f12f 935699475 1 2024-02-22T00:33:31.962 INFO:tasks.workunit.client.1.smithi161.stdout:0/917: fdatasync d14/d1a/f23 0 2024-02-22T00:33:31.962 INFO:tasks.workunit.client.1.smithi161.stdout:1/967: stat d19/d48/d68/da8/lcb 0 2024-02-22T00:33:31.994 INFO:tasks.workunit.client.1.smithi161.stdout:1/968: symlink d19/d1d/d56/db2/d13a/l146 0 2024-02-22T00:33:31.995 INFO:tasks.workunit.client.1.smithi161.stdout:4/945: dwrite d5/d8/d41/d53/d6c/d72/f8e [0,4194304] 0 2024-02-22T00:33:31.995 INFO:tasks.workunit.client.1.smithi161.stdout:4/946: stat d5/f27 0 2024-02-22T00:33:31.997 INFO:tasks.workunit.client.1.smithi161.stdout:1/969: unlink f9 0 2024-02-22T00:33:32.001 INFO:tasks.workunit.client.1.smithi161.stdout:1/970: creat d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d123/f147 x:0 0 0 2024-02-22T00:33:32.003 INFO:tasks.workunit.client.1.smithi161.stdout:1/971: write d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d123/f147 [303695,56651] 0 2024-02-22T00:33:32.006 INFO:tasks.workunit.client.1.smithi161.stdout:1/972: creat d19/d90/f148 x:0 0 0 2024-02-22T00:33:32.007 INFO:tasks.workunit.client.1.smithi161.stdout:1/973: truncate d19/d85/d87/fb1 2057904 0 2024-02-22T00:33:32.009 INFO:tasks.workunit.client.1.smithi161.stdout:0/918: dread d14/d1a/f8d [0,4194304] 0 2024-02-22T00:33:32.012 INFO:tasks.workunit.client.1.smithi161.stdout:0/919: truncate d14/d44/dbf/deb/fd5 417217 0 2024-02-22T00:33:32.013 INFO:tasks.workunit.client.1.smithi161.stdout:4/947: write d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/f1b [1126323,74792] 0 2024-02-22T00:33:32.013 INFO:tasks.workunit.client.1.smithi161.stdout:0/920: fdatasync d14/d37/d42/d8e/d122/f121 0 2024-02-22T00:33:32.021 INFO:tasks.workunit.client.1.smithi161.stdout:4/948: dwrite d5/d17/d5c/f14f [0,4194304] 0 2024-02-22T00:33:32.022 INFO:tasks.workunit.client.1.smithi161.stdout:0/921: dwrite d14/d37/f45 [0,4194304] 0 2024-02-22T00:33:32.022 INFO:tasks.workunit.client.1.smithi161.stdout:7/944: sync 2024-02-22T00:33:32.025 INFO:tasks.workunit.client.1.smithi161.stdout:7/945: chown d3/df/d33/d35/d55/d63/d7b/de5/l12b 6783 1 2024-02-22T00:33:32.028 INFO:tasks.workunit.client.1.smithi161.stdout:1/974: dread d19/d51/d64/d9b/da5/dbc/ffc [0,4194304] 0 2024-02-22T00:33:32.029 INFO:tasks.workunit.client.1.smithi161.stdout:0/922: write d14/d1a/f38 [1368449,25716] 0 2024-02-22T00:33:32.031 INFO:tasks.workunit.client.1.smithi161.stdout:4/949: dread d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/d14/d4f/d121/f129 [4194304,4194304] 0 2024-02-22T00:33:32.033 INFO:tasks.workunit.client.1.smithi161.stdout:1/975: creat d19/d13f/f149 x:0 0 0 2024-02-22T00:33:32.036 INFO:tasks.workunit.client.1.smithi161.stdout:0/923: dwrite d14/f25 [0,4194304] 0 2024-02-22T00:33:32.089 INFO:tasks.workunit.client.1.smithi161.stdout:6/933: sync 2024-02-22T00:33:32.089 INFO:tasks.workunit.client.1.smithi161.stdout:3/899: sync 2024-02-22T00:33:32.089 INFO:tasks.workunit.client.1.smithi161.stdout:9/942: sync 2024-02-22T00:33:32.118 INFO:tasks.workunit.client.1.smithi161.stdout:1/976: rename d19/d90/dcf/d143 to d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d14a 0 2024-02-22T00:33:32.125 INFO:tasks.workunit.client.1.smithi161.stdout:4/950: dwrite d5/d8/d41/d57/dbe/d28/d38/d6d/da5/fc3 [0,4194304] 0 2024-02-22T00:33:32.130 INFO:tasks.workunit.client.1.smithi161.stdout:4/951: dwrite d5/d8/d41/d57/fca [0,4194304] 0 2024-02-22T00:33:32.132 INFO:tasks.workunit.client.1.smithi161.stdout:4/952: truncate d5/d8/d41/d57/f15d 51010 0 2024-02-22T00:33:32.134 INFO:tasks.workunit.client.1.smithi161.stdout:8/958: sync 2024-02-22T00:33:32.134 INFO:tasks.workunit.client.1.smithi161.stdout:8/959: stat d1/d2f/d37/ddd/ff0 0 2024-02-22T00:33:32.135 INFO:tasks.workunit.client.1.smithi161.stdout:8/960: chown d1/d1c/d96/df7/d12e 5076440 1 2024-02-22T00:33:32.188 INFO:tasks.workunit.client.1.smithi161.stdout:8/961: creat d1/d1c/d20/d22/dfe/f131 x:0 0 0 2024-02-22T00:33:32.189 INFO:tasks.workunit.client.1.smithi161.stdout:7/946: sync 2024-02-22T00:33:32.190 INFO:tasks.workunit.client.1.smithi161.stdout:6/934: mknod d3/d10/d12/d3a/dca/c12c 0 2024-02-22T00:33:32.192 INFO:tasks.workunit.client.1.smithi161.stdout:7/947: truncate d3/df/d33/d35/d55/d63/d7b/d30/d44/f10d 736829 0 2024-02-22T00:33:32.193 INFO:tasks.workunit.client.1.smithi161.stdout:9/943: symlink d1/d5/d9/d9c/l13f 0 2024-02-22T00:33:32.194 INFO:tasks.workunit.client.1.smithi161.stdout:3/900: truncate da/dc/d5f/d66/f107 4532516 0 2024-02-22T00:33:32.199 INFO:tasks.workunit.client.1.smithi161.stdout:8/962: creat d1/d1c/d20/d22/d28/d7f/db4/f132 x:0 0 0 2024-02-22T00:33:32.200 INFO:tasks.workunit.client.1.smithi161.stdout:3/901: dwrite da/dc/d91/db5/ff3 [0,4194304] 0 2024-02-22T00:33:32.206 INFO:tasks.workunit.client.1.smithi161.stdout:0/924: getdents d14/d1a/d3f/d108/d10c/d126/da5 0 2024-02-22T00:33:32.208 INFO:tasks.workunit.client.1.smithi161.stdout:4/953: link d5/d8/d41/d57/dbe/d28/d38/d6d/cd9 d5/d8/d41/d53/d6c/d130/c164 0 2024-02-22T00:33:32.211 INFO:tasks.workunit.client.1.smithi161.stdout:6/935: symlink d3/dc/df/dfd/d124/de5/d11b/l12d 0 2024-02-22T00:33:32.219 INFO:tasks.workunit.client.1.smithi161.stdout:6/936: dwrite d3/d10/f38 [4194304,4194304] 0 2024-02-22T00:33:32.221 INFO:tasks.workunit.client.1.smithi161.stdout:3/902: dread da/dc/f2b [0,4194304] 0 2024-02-22T00:33:32.225 INFO:tasks.workunit.client.1.smithi161.stdout:0/925: dread d14/d1a/d3f/d5d/f8a [0,4194304] 0 2024-02-22T00:33:32.228 INFO:tasks.workunit.client.1.smithi161.stdout:3/903: mkdir da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/d125 0 2024-02-22T00:33:32.233 INFO:tasks.workunit.client.1.smithi161.stdout:3/904: truncate da/dc/d11/d26/d80/dc7/d59/f90 129334 0 2024-02-22T00:33:32.234 INFO:tasks.workunit.client.1.smithi161.stdout:3/905: chown da/dc/d11/d26/d80/dc7/d59/d93/daa/ld6 215 1 2024-02-22T00:33:32.235 INFO:tasks.workunit.client.1.smithi161.stdout:0/926: link d14/d1a/d9d/dba/fc2 d14/d1a/d3f/d108/d10c/f132 0 2024-02-22T00:33:32.236 INFO:tasks.workunit.client.1.smithi161.stdout:0/927: chown d14/d37/d42/d8e/d122/l32 165 1 2024-02-22T00:33:32.245 INFO:tasks.workunit.client.1.smithi161.stdout:6/937: dread d3/d10/d1b/f2e [0,4194304] 0 2024-02-22T00:33:32.250 INFO:tasks.workunit.client.1.smithi161.stdout:6/938: dread d3/d10/d12/d2f/d7d/f52 [0,4194304] 0 2024-02-22T00:33:32.253 INFO:tasks.workunit.client.1.smithi161.stdout:6/939: creat d3/d7c/d108/f12e x:0 0 0 2024-02-22T00:33:32.255 INFO:tasks.workunit.client.1.smithi161.stdout:6/940: creat d3/dc/df/dfd/d124/de5/d11b/f12f x:0 0 0 2024-02-22T00:33:32.256 INFO:tasks.workunit.client.1.smithi161.stdout:6/941: write d3/dc/df/dfd/d124/de5/fba [184980,107110] 0 2024-02-22T00:33:32.268 INFO:tasks.workunit.client.1.smithi161.stdout:7/948: symlink d3/df/d33/l12e 0 2024-02-22T00:33:32.274 INFO:tasks.workunit.client.1.smithi161.stdout:1/977: unlink d19/d1d/l21 0 2024-02-22T00:33:32.276 INFO:tasks.workunit.client.1.smithi161.stdout:9/944: dwrite d1/d2/d7/da/f80 [0,4194304] 0 2024-02-22T00:33:32.277 INFO:tasks.workunit.client.1.smithi161.stdout:9/945: fdatasync d1/d2/d4/f3b 0 2024-02-22T00:33:32.283 INFO:tasks.workunit.client.1.smithi161.stdout:3/906: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/fac [339165,49764] 0 2024-02-22T00:33:32.283 INFO:tasks.workunit.client.1.smithi161.stdout:6/942: mknod d3/d30/c130 0 2024-02-22T00:33:32.284 INFO:tasks.workunit.client.1.smithi161.stdout:0/928: truncate d14/d1a/f71 4385185 0 2024-02-22T00:33:32.286 INFO:tasks.workunit.client.1.smithi161.stdout:8/963: rename d1/d1c/d20/d22/d28/d7f/d92/d95/f3b to d1/d1c/d20/de6/d11a/f133 0 2024-02-22T00:33:32.287 INFO:tasks.workunit.client.1.smithi161.stdout:3/907: chown da/dc/d11/d26/d80/d92/lc0 7419 1 2024-02-22T00:33:32.288 INFO:tasks.workunit.client.1.smithi161.stdout:0/929: fdatasync d14/d1a/d9d/dba/f10a 0 2024-02-22T00:33:32.288 INFO:tasks.workunit.client.1.smithi161.stdout:7/949: dread f2 [8388608,4194304] 0 2024-02-22T00:33:32.290 INFO:tasks.workunit.client.1.smithi161.stdout:1/978: rename d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/d14a/cd9 to d19/d85/c14b 0 2024-02-22T00:33:32.290 INFO:tasks.workunit.client.1.smithi161.stdout:8/964: write d1/d1c/d20/d22/d28/d7f/d92/d95/dd9/f129 [877849,87637] 0 2024-02-22T00:33:32.292 INFO:tasks.workunit.client.1.smithi161.stdout:0/930: truncate d14/fb4 1300584 0 2024-02-22T00:33:32.292 INFO:tasks.workunit.client.1.smithi161.stdout:4/954: sync 2024-02-22T00:33:32.294 INFO:tasks.workunit.client.1.smithi161.stdout:8/965: read d1/d2f/f3e [511159,92198] 0 2024-02-22T00:33:32.296 INFO:tasks.workunit.client.1.smithi161.stdout:1/979: fdatasync d19/d112/f132 0 2024-02-22T00:33:32.296 INFO:tasks.workunit.client.1.smithi161.stdout:0/931: stat d14/d1a/d3f/d96/dbc/dc5/f107 0 2024-02-22T00:33:32.298 INFO:tasks.workunit.client.1.smithi161.stdout:4/955: write d5/d8/d41/d57/dbe/f35 [377041,11182] 0 2024-02-22T00:33:32.300 INFO:tasks.workunit.client.1.smithi161.stdout:0/932: chown d14/d1a/d3f/d108/d10c/d126/lcb 215692891 1 2024-02-22T00:33:32.300 INFO:tasks.workunit.client.1.smithi161.stdout:7/950: dwrite d3/fa9 [0,4194304] 0 2024-02-22T00:33:32.301 INFO:tasks.workunit.client.1.smithi161.stdout:8/966: creat d1/d2f/f134 x:0 0 0 2024-02-22T00:33:32.302 INFO:tasks.workunit.client.1.smithi161.stdout:9/946: write d1/d25/dc4/f6f [997088,82358] 0 2024-02-22T00:33:32.304 INFO:tasks.workunit.client.1.smithi161.stdout:1/980: mknod d19/d1d/d56/db2/d13a/c14c 0 2024-02-22T00:33:32.304 INFO:tasks.workunit.client.1.smithi161.stdout:4/956: write d5/d8/d41/d57/dbe/d28/f2d [16693,70830] 0 2024-02-22T00:33:32.305 INFO:tasks.workunit.client.1.smithi161.stdout:0/933: write d14/d1a/f38 [1038634,60840] 0 2024-02-22T00:33:32.306 INFO:tasks.workunit.client.1.smithi161.stdout:9/947: fdatasync d1/d25/dc4/d4f/f6c 0 2024-02-22T00:33:32.309 INFO:tasks.workunit.client.1.smithi161.stdout:6/943: dread d3/dc/df/dfd/d124/dd9/f7a [4194304,4194304] 0 2024-02-22T00:33:32.309 INFO:tasks.workunit.client.1.smithi161.stdout:0/934: stat d14/d1a/d3f/d108/d10c/f132 0 2024-02-22T00:33:32.309 INFO:tasks.workunit.client.1.smithi161.stdout:4/957: read - d5/d8/d41/d57/dbe/f133 zero size 2024-02-22T00:33:32.310 INFO:tasks.workunit.client.1.smithi161.stdout:9/948: write d1/d2/d4/f79 [682314,57512] 0 2024-02-22T00:33:32.310 INFO:tasks.workunit.client.1.smithi161.stdout:8/967: truncate d1/d2f/d37/d64/d7b/d7e/f124 23552 0 2024-02-22T00:33:32.312 INFO:tasks.workunit.client.1.smithi161.stdout:4/958: fsync d5/d8/d41/d53/fa7 0 2024-02-22T00:33:32.314 INFO:tasks.workunit.client.1.smithi161.stdout:1/981: creat d19/d1d/d2c/d2d/d3f/d69/f14d x:0 0 0 2024-02-22T00:33:32.315 INFO:tasks.workunit.client.1.smithi161.stdout:0/935: mknod d14/d1a/d3f/d108/c133 0 2024-02-22T00:33:32.318 INFO:tasks.workunit.client.1.smithi161.stdout:1/982: fdatasync d19/d1d/d56/fa4 0 2024-02-22T00:33:32.318 INFO:tasks.workunit.client.1.smithi161.stdout:9/949: chown d1/d5/l24 12290861 1 2024-02-22T00:33:32.324 INFO:tasks.workunit.client.1.smithi161.stdout:3/908: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/fb4 [0,4194304] 0 2024-02-22T00:33:32.324 INFO:tasks.workunit.client.1.smithi161.stdout:1/983: chown d19/d51/d64/d9b/da5/ddb/l122 1892 1 2024-02-22T00:33:32.327 INFO:tasks.workunit.client.1.smithi161.stdout:0/936: link d14/f4b d14/d37/dca/f134 0 2024-02-22T00:33:32.328 INFO:tasks.workunit.client.1.smithi161.stdout:9/950: symlink d1/d25/dc4/d4f/da3/de2/l140 0 2024-02-22T00:33:32.328 INFO:tasks.workunit.client.1.smithi161.stdout:6/944: dwrite d3/dc/df/dfd/d124/dd9/d87/fc2 [0,4194304] 0 2024-02-22T00:33:32.330 INFO:tasks.workunit.client.1.smithi161.stdout:8/968: dwrite d1/d1c/d20/d22/d28/d36/fec [0,4194304] 0 2024-02-22T00:33:32.331 INFO:tasks.workunit.client.1.smithi161.stdout:3/909: creat da/dc/d91/f126 x:0 0 0 2024-02-22T00:33:32.334 INFO:tasks.workunit.client.1.smithi161.stdout:7/951: dread d3/df/d33/d35/d55/d63/f66 [4194304,4194304] 0 2024-02-22T00:33:32.334 INFO:tasks.workunit.client.1.smithi161.stdout:1/984: mkdir d19/d48/d68/d14e 0 2024-02-22T00:33:32.336 INFO:tasks.workunit.client.1.smithi161.stdout:8/969: write d1/d1c/d96/df7/d12e/f130 [314630,112387] 0 2024-02-22T00:33:32.340 INFO:tasks.workunit.client.1.smithi161.stdout:0/937: write d14/d1a/d3f/d108/d10c/d126/fd6 [2716388,27544] 0 2024-02-22T00:33:32.340 INFO:tasks.workunit.client.1.smithi161.stdout:4/959: rename d5/d8/d41/d53/d6c/d130/c164 to d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150/d14/c165 0 2024-02-22T00:33:32.342 INFO:tasks.workunit.client.1.smithi161.stdout:3/910: read da/dc/d11/d26/d80/dc7/d59/f9d [4122121,10947] 0 2024-02-22T00:33:32.344 INFO:tasks.workunit.client.1.smithi161.stdout:4/960: chown d5/d8/d41/d57/dbe/d28/d63/d6b 745254 1 2024-02-22T00:33:32.344 INFO:tasks.workunit.client.1.smithi161.stdout:8/970: creat d1/d2f/d114/f135 x:0 0 0 2024-02-22T00:33:32.344 INFO:tasks.workunit.client.1.smithi161.stdout:9/951: mknod d1/d5/d9/da5/d11a/c141 0 2024-02-22T00:33:32.346 INFO:tasks.workunit.client.1.smithi161.stdout:7/952: truncate d3/df/d33/d35/d55/d63/d7b/d30/d44/ddc/f102 755357 0 2024-02-22T00:33:32.346 INFO:tasks.workunit.client.1.smithi161.stdout:6/945: dread d3/dc/df/dfd/d124/dd9/fb6 [0,4194304] 0 2024-02-22T00:33:32.347 INFO:tasks.workunit.client.1.smithi161.stdout:9/952: dread - d1/d25/dc4/d4f/da3/de2/ff5 zero size 2024-02-22T00:33:32.348 INFO:tasks.workunit.client.1.smithi161.stdout:0/938: link d14/f82 d14/d1a/d3f/d96/f135 0 2024-02-22T00:33:32.349 INFO:tasks.workunit.client.1.smithi161.stdout:1/985: mknod d19/d1d/d2c/d2d/d3f/d118/d127/c14f 0 2024-02-22T00:33:32.350 INFO:tasks.workunit.client.1.smithi161.stdout:4/961: truncate d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/f119 246883 0 2024-02-22T00:33:32.351 INFO:tasks.workunit.client.1.smithi161.stdout:8/971: rmdir d1/d1c/d20/d22/d3f 39 2024-02-22T00:33:32.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/946: creat d3/d10/d72/f131 x:0 0 0 2024-02-22T00:33:32.354 INFO:tasks.workunit.client.1.smithi161.stdout:9/953: fdatasync d1/d2/d4/d1f/dab/dcd/fd3 0 2024-02-22T00:33:32.354 INFO:tasks.workunit.client.1.smithi161.stdout:6/947: stat d3/d10/d12/d2f/d7d/dab/dbe/de6/f110 0 2024-02-22T00:33:32.356 INFO:tasks.workunit.client.1.smithi161.stdout:0/939: symlink d14/d37/d42/d73/dc7/l136 0 2024-02-22T00:33:32.356 INFO:tasks.workunit.client.1.smithi161.stdout:0/940: fdatasync d14/d1a/d3f/d96/fae 0 2024-02-22T00:33:32.361 INFO:tasks.workunit.client.1.smithi161.stdout:3/911: link da/dc/d11/f28 da/dc/d11/d26/d104/d113/f127 0 2024-02-22T00:33:32.362 INFO:tasks.workunit.client.1.smithi161.stdout:4/962: dread f3 [0,4194304] 0 2024-02-22T00:33:32.370 INFO:tasks.workunit.client.1.smithi161.stdout:1/986: write d19/f1a [4683219,61421] 0 2024-02-22T00:33:32.370 INFO:tasks.workunit.client.1.smithi161.stdout:9/954: truncate d1/d2/d4/fad 375536 0 2024-02-22T00:33:32.372 INFO:tasks.workunit.client.1.smithi161.stdout:7/953: dwrite d3/dd/f8c [0,4194304] 0 2024-02-22T00:33:32.373 INFO:tasks.workunit.client.1.smithi161.stdout:9/955: read - d1/d5/d9/da5/dbc/fbe zero size 2024-02-22T00:33:32.374 INFO:tasks.workunit.client.1.smithi161.stdout:9/956: stat d1/d25/d73/d60/d77/f7c 0 2024-02-22T00:33:32.381 INFO:tasks.workunit.client.1.smithi161.stdout:0/941: link d14/d1a/d3f/d108/c133 d14/d44/dbf/deb/def/c137 0 2024-02-22T00:33:32.381 INFO:tasks.workunit.client.1.smithi161.stdout:3/912: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f128 x:0 0 0 2024-02-22T00:33:32.382 INFO:tasks.workunit.client.1.smithi161.stdout:9/957: creat d1/d5/d9/f142 x:0 0 0 2024-02-22T00:33:32.383 INFO:tasks.workunit.client.1.smithi161.stdout:6/948: link d3/d10/l111 d3/d10/d12/d3a/dca/l132 0 2024-02-22T00:33:32.384 INFO:tasks.workunit.client.1.smithi161.stdout:1/987: write d19/d51/fc7 [365499,47306] 0 2024-02-22T00:33:32.384 INFO:tasks.workunit.client.1.smithi161.stdout:4/963: link d5/d8/d41/d57/dbe/c73 d5/d8/d41/d53/c166 0 2024-02-22T00:33:32.386 INFO:tasks.workunit.client.1.smithi161.stdout:0/942: readlink d14/d44/dbf/deb/d113/l11b 0 2024-02-22T00:33:32.387 INFO:tasks.workunit.client.1.smithi161.stdout:1/988: read d19/d85/d87/fb1 [357482,11042] 0 2024-02-22T00:33:32.388 INFO:tasks.workunit.client.1.smithi161.stdout:3/913: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/f129 x:0 0 0 2024-02-22T00:33:32.388 INFO:tasks.workunit.client.1.smithi161.stdout:9/958: fsync d1/d25/d73/d60/d77/d99/fa1 0 2024-02-22T00:33:32.389 INFO:tasks.workunit.client.1.smithi161.stdout:0/943: write d14/f19 [3557150,40035] 0 2024-02-22T00:33:32.390 INFO:tasks.workunit.client.1.smithi161.stdout:7/954: rename d3/d77/la7 to d3/dbf/l12f 0 2024-02-22T00:33:32.392 INFO:tasks.workunit.client.1.smithi161.stdout:9/959: chown d1/d2/d4/c37 26274175 1 2024-02-22T00:33:32.393 INFO:tasks.workunit.client.1.smithi161.stdout:6/949: dwrite d3/dc/df/dfd/d124/f91 [0,4194304] 0 2024-02-22T00:33:32.393 INFO:tasks.workunit.client.1.smithi161.stdout:6/950: readlink d3/d10/l42 0 2024-02-22T00:33:32.397 INFO:tasks.workunit.client.1.smithi161.stdout:4/964: rename d5/d8/d41/d57/dbe/d28/d38/d6d/da5/d150 to d5/d8/d41/d53/d6c/d72/d167 0 2024-02-22T00:33:32.400 INFO:tasks.workunit.client.1.smithi161.stdout:3/914: mkdir da/dc/d11/d26/d80/dc7/d108/d12a 0 2024-02-22T00:33:32.400 INFO:tasks.workunit.client.1.smithi161.stdout:3/915: chown da/d29/c38 8046 1 2024-02-22T00:33:32.401 INFO:tasks.workunit.client.1.smithi161.stdout:3/916: chown da/dc/d11/d26/f4d 9198183 1 2024-02-22T00:33:32.401 INFO:tasks.workunit.client.1.smithi161.stdout:6/951: creat d3/dc/df/dfd/f133 x:0 0 0 2024-02-22T00:33:32.402 INFO:tasks.workunit.client.1.smithi161.stdout:7/955: symlink d3/df/l130 0 2024-02-22T00:33:32.403 INFO:tasks.workunit.client.1.smithi161.stdout:6/952: truncate d3/d10/d12/d2f/ffb 947627 0 2024-02-22T00:33:32.404 INFO:tasks.workunit.client.1.smithi161.stdout:0/944: rename d14/f4b to d14/d1a/d3f/d96/da1/f138 0 2024-02-22T00:33:32.405 INFO:tasks.workunit.client.1.smithi161.stdout:0/945: dread - d14/d1a/d3f/d96/dbc/f105 zero size 2024-02-22T00:33:32.407 INFO:tasks.workunit.client.1.smithi161.stdout:7/956: unlink d3/dbf/d64/le7 0 2024-02-22T00:33:32.408 INFO:tasks.workunit.client.1.smithi161.stdout:6/953: creat d3/dc/df/dfd/d124/de5/f134 x:0 0 0 2024-02-22T00:33:32.420 INFO:tasks.workunit.client.1.smithi161.stdout:7/957: rename d3/dbf/d64 to d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/d131 0 2024-02-22T00:33:32.421 INFO:tasks.workunit.client.1.smithi161.stdout:4/965: dwrite d5/d8/d41/d53/d6c/d72/d167/d14/d4f/fec [0,4194304] 0 2024-02-22T00:33:32.423 INFO:tasks.workunit.client.1.smithi161.stdout:7/958: fsync d3/df/d43/faa 0 2024-02-22T00:33:32.424 INFO:tasks.workunit.client.1.smithi161.stdout:7/959: chown d3/d77 205582 1 2024-02-22T00:33:32.424 INFO:tasks.workunit.client.1.smithi161.stdout:6/954: dread d3/dc/df/dfd/d124/dd9/fb7 [0,4194304] 0 2024-02-22T00:33:32.428 INFO:tasks.workunit.client.1.smithi161.stdout:3/917: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/ffd [0,4194304] 0 2024-02-22T00:33:32.430 INFO:tasks.workunit.client.1.smithi161.stdout:3/918: stat da/dc/d11/f2e 0 2024-02-22T00:33:32.431 INFO:tasks.workunit.client.1.smithi161.stdout:6/955: creat d3/d10/d1b/da5/f135 x:0 0 0 2024-02-22T00:33:32.431 INFO:tasks.workunit.client.1.smithi161.stdout:4/966: dwrite d5/f7d [4194304,4194304] 0 2024-02-22T00:33:32.457 INFO:tasks.workunit.client.1.smithi161.stdout:8/972: sync 2024-02-22T00:33:32.470 INFO:tasks.workunit.client.1.smithi161.stdout:3/919: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff/f12b x:0 0 0 2024-02-22T00:33:32.470 INFO:tasks.workunit.client.1.smithi161.stdout:4/967: write d5/d8/d41/d53/d6c/d72/d167/d14/fad [1599049,82254] 0 2024-02-22T00:33:32.471 INFO:tasks.workunit.client.1.smithi161.stdout:8/973: mkdir d1/d1c/d20/d22/d28/d136 0 2024-02-22T00:33:32.474 INFO:tasks.workunit.client.1.smithi161.stdout:3/920: chown da/dc/d11/d26/d80/dc7/dfe/f10e 7 1 2024-02-22T00:33:32.477 INFO:tasks.workunit.client.1.smithi161.stdout:8/974: rename d1/d1c/d20/d22/d28/d7f/d92/l117 to d1/d1c/d96/df7/l137 0 2024-02-22T00:33:32.478 INFO:tasks.workunit.client.1.smithi161.stdout:4/968: dread d5/d8/d41/d57/dbe/d28/d63/d65/d100/d118/d12d/f142 [0,4194304] 0 2024-02-22T00:33:32.479 INFO:tasks.workunit.client.1.smithi161.stdout:7/960: dread d3/dd/d59/fcc [0,4194304] 0 2024-02-22T00:33:32.480 INFO:tasks.workunit.client.1.smithi161.stdout:8/975: chown d1/d1c/d75/d18 108483672 1 2024-02-22T00:33:32.480 INFO:tasks.workunit.client.1.smithi161.stdout:4/969: stat d5/d8/d41/d53/d6c/d72/d167/d14/d4f/cde 0 2024-02-22T00:33:32.482 INFO:tasks.workunit.client.1.smithi161.stdout:3/921: getdents da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39 0 2024-02-22T00:33:32.485 INFO:tasks.workunit.client.1.smithi161.stdout:3/922: stat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/cee 0 2024-02-22T00:33:32.486 INFO:tasks.workunit.client.1.smithi161.stdout:3/923: dread - da/dc/d91/db5/fcd zero size 2024-02-22T00:33:32.487 INFO:tasks.workunit.client.1.smithi161.stdout:6/956: dread d3/d10/d12/d2f/d7d/d5f/f70 [0,4194304] 0 2024-02-22T00:33:32.487 INFO:tasks.workunit.client.1.smithi161.stdout:4/970: creat d5/d8/d41/d57/dbe/d28/f168 x:0 0 0 2024-02-22T00:33:32.488 INFO:tasks.workunit.client.1.smithi161.stdout:8/976: truncate d1/d1c/d20/de6/ffc 2068637 0 2024-02-22T00:33:32.490 INFO:tasks.workunit.client.1.smithi161.stdout:8/977: write d1/d1c/d20/d22/d28/d7f/ff3 [4235171,54335] 0 2024-02-22T00:33:32.490 INFO:tasks.workunit.client.1.smithi161.stdout:3/924: mknod da/dc/d5f/d66/df9/c12c 0 2024-02-22T00:33:32.491 INFO:tasks.workunit.client.1.smithi161.stdout:3/925: chown f0 8210 1 2024-02-22T00:33:32.491 INFO:tasks.workunit.client.1.smithi161.stdout:6/957: creat d3/dc/df/dfd/d124/dd9/f136 x:0 0 0 2024-02-22T00:33:32.492 INFO:tasks.workunit.client.1.smithi161.stdout:7/961: link d3/df/d33/d74/df2/lfa d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/d110/l132 0 2024-02-22T00:33:32.496 INFO:tasks.workunit.client.1.smithi161.stdout:7/962: truncate d3/df/d33/d35/d55/d63/d7b/ff5 213122 0 2024-02-22T00:33:32.498 INFO:tasks.workunit.client.1.smithi161.stdout:8/978: rename d1/d1c/d20/d22/d28/d7f/d92/fc3 to d1/d1c/d20/d22/d28/d7f/db4/f138 0 2024-02-22T00:33:32.503 INFO:tasks.workunit.client.1.smithi161.stdout:8/979: symlink d1/d1c/d20/d22/d28/d7f/d92/l139 0 2024-02-22T00:33:32.503 INFO:tasks.workunit.client.1.smithi161.stdout:4/971: dread d5/d8/d41/d57/dbe/f10b [0,4194304] 0 2024-02-22T00:33:32.504 INFO:tasks.workunit.client.1.smithi161.stdout:7/963: dwrite d3/df/d43/fb3 [0,4194304] 0 2024-02-22T00:33:32.505 INFO:tasks.workunit.client.1.smithi161.stdout:4/972: write d5/d17/f4a [330765,88535] 0 2024-02-22T00:33:32.508 INFO:tasks.workunit.client.1.smithi161.stdout:8/980: symlink d1/d1c/d20/d22/d3f/l13a 0 2024-02-22T00:33:32.511 INFO:tasks.workunit.client.1.smithi161.stdout:3/926: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f65 [0,4194304] 0 2024-02-22T00:33:32.512 INFO:tasks.workunit.client.1.smithi161.stdout:7/964: link d3/df/d33/d53/ffc d3/df/d33/d35/d55/d63/d7b/d30/d44/d11d/f133 0 2024-02-22T00:33:32.513 INFO:tasks.workunit.client.1.smithi161.stdout:6/958: dread d3/d10/fb0 [0,4194304] 0 2024-02-22T00:33:32.514 INFO:tasks.workunit.client.1.smithi161.stdout:8/981: getdents d1/d2f/d37/d64/d7b/ddf 0 2024-02-22T00:33:32.516 INFO:tasks.workunit.client.1.smithi161.stdout:3/927: rmdir da/dc/d11/d26/d80/dc7/d108 39 2024-02-22T00:33:32.518 INFO:tasks.workunit.client.1.smithi161.stdout:8/982: read d1/d2f/f3e [456200,57583] 0 2024-02-22T00:33:32.521 INFO:tasks.workunit.client.1.smithi161.stdout:6/959: rename d3/d10/d12/d2f/d7d/dab/dbe/ff0 to d3/d10/d12/d2f/d7d/dab/dbe/de6/f137 0 2024-02-22T00:33:32.524 INFO:tasks.workunit.client.1.smithi161.stdout:7/965: dwrite d3/df/d33/d74/f8e [0,4194304] 0 2024-02-22T00:33:32.525 INFO:tasks.workunit.client.1.smithi161.stdout:6/960: dread - d3/d10/d12/d2f/d7d/dab/dbe/de6/f110 zero size 2024-02-22T00:33:32.527 INFO:tasks.workunit.client.1.smithi161.stdout:6/961: readlink d3/d10/d12/d95/l103 0 2024-02-22T00:33:32.527 INFO:tasks.workunit.client.1.smithi161.stdout:7/966: chown d3/dd/d59 93738 1 2024-02-22T00:33:32.530 INFO:tasks.workunit.client.1.smithi161.stdout:3/928: dread da/dc/d11/d26/d80/dc7/d59/d93/daa/fb4 [0,4194304] 0 2024-02-22T00:33:32.530 INFO:tasks.workunit.client.1.smithi161.stdout:8/983: dwrite d1/d1c/d75/d18/fb3 [0,4194304] 0 2024-02-22T00:33:32.533 INFO:tasks.workunit.client.1.smithi161.stdout:6/962: mknod d3/d10/d12/c138 0 2024-02-22T00:33:32.539 INFO:tasks.workunit.client.1.smithi161.stdout:7/967: link d3/df/d33/d35/d55/d63/d7b/d30/d44/d95/d131/l99 d3/df/d33/d35/d55/d63/d7b/d8f/l134 0 2024-02-22T00:33:32.540 INFO:tasks.workunit.client.1.smithi161.stdout:1/989: sync 2024-02-22T00:33:32.541 INFO:tasks.workunit.client.1.smithi161.stdout:6/963: dwrite d3/d10/d12/d2f/fc6 [4194304,4194304] 0 2024-02-22T00:33:32.543 INFO:tasks.workunit.client.1.smithi161.stdout:7/968: creat d3/dbf/dab/f135 x:0 0 0 2024-02-22T00:33:32.544 INFO:tasks.workunit.client.1.smithi161.stdout:1/990: fsync d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d98/f126 0 2024-02-22T00:33:32.544 INFO:tasks.workunit.client.1.smithi161.stdout:6/964: write d3/dc/df/dfd/d124/dd9/fb6 [1576425,101634] 0 2024-02-22T00:33:32.546 INFO:tasks.workunit.client.1.smithi161.stdout:7/969: mknod d3/df/dba/c136 0 2024-02-22T00:33:32.549 INFO:tasks.workunit.client.1.smithi161.stdout:7/970: mknod d3/df/d33/d35/d55/d63/d7b/d8f/c137 0 2024-02-22T00:33:32.551 INFO:tasks.workunit.client.1.smithi161.stdout:1/991: getdents d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d84 0 2024-02-22T00:33:32.552 INFO:tasks.workunit.client.1.smithi161.stdout:6/965: dwrite d3/d10/d12/d2f/d7d/f80 [0,4194304] 0 2024-02-22T00:33:32.554 INFO:tasks.workunit.client.1.smithi161.stdout:7/971: write d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/d110/f10c [1018879,102894] 0 2024-02-22T00:33:32.554 INFO:tasks.workunit.client.1.smithi161.stdout:6/966: dread - d3/d10/d1b/da5/f135 zero size 2024-02-22T00:33:32.556 INFO:tasks.workunit.client.1.smithi161.stdout:1/992: creat d19/d1d/d2c/d2d/d3f/d118/f150 x:0 0 0 2024-02-22T00:33:32.557 INFO:tasks.workunit.client.1.smithi161.stdout:6/967: chown d3/d10/d72/ce0 1577516777 1 2024-02-22T00:33:32.558 INFO:tasks.workunit.client.1.smithi161.stdout:1/993: read d19/d1d/d56/db2/fce [3968503,1593] 0 2024-02-22T00:33:32.559 INFO:tasks.workunit.client.1.smithi161.stdout:7/972: creat d3/df/d33/d35/d55/de4/f138 x:0 0 0 2024-02-22T00:33:32.561 INFO:tasks.workunit.client.1.smithi161.stdout:1/994: read d19/d85/d87/dc6/ff3 [1397532,126743] 0 2024-02-22T00:33:32.568 INFO:tasks.workunit.client.1.smithi161.stdout:6/968: dread d3/d10/d12/d2f/d7d/dab/dbe/f100 [0,4194304] 0 2024-02-22T00:33:32.572 INFO:tasks.workunit.client.1.smithi161.stdout:7/973: link d3/df/d33/d35/d55/d63/d7b/de5/f101 d3/df/d33/d35/d55/d63/d7b/d30/d44/d11d/f139 0 2024-02-22T00:33:32.572 INFO:tasks.workunit.client.1.smithi161.stdout:7/974: write d3/df/d43/faf [369126,49349] 0 2024-02-22T00:33:32.573 INFO:tasks.workunit.client.1.smithi161.stdout:1/995: dwrite d19/d90/dd6/f100 [0,4194304] 0 2024-02-22T00:33:32.575 INFO:tasks.workunit.client.1.smithi161.stdout:1/996: write d19/d1d/f65 [2292336,75492] 0 2024-02-22T00:33:32.579 INFO:tasks.workunit.client.1.smithi161.stdout:6/969: rename d3/dc/df/dfd/d124/dd9/d87/c92 to d3/d10/d12/d2f/d7d/dab/dbe/de6/c139 0 2024-02-22T00:33:32.580 INFO:tasks.workunit.client.1.smithi161.stdout:1/997: creat d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d84/f151 x:0 0 0 2024-02-22T00:33:32.581 INFO:tasks.workunit.client.1.smithi161.stdout:7/975: link d3/df/d33/d35/d55/de4/f138 d3/df/d33/d35/d55/d63/d7b/d50/d62/f13a 0 2024-02-22T00:33:32.588 INFO:tasks.workunit.client.1.smithi161.stdout:1/998: getdents d19/d1d/d2c/d2d/d3f/d69/ddd/df0/d123 0 2024-02-22T00:33:32.588 INFO:tasks.workunit.client.1.smithi161.stdout:7/976: dread d3/df/d33/d35/d55/d63/d7b/d30/d44/f10d [0,4194304] 0 2024-02-22T00:33:32.590 INFO:tasks.workunit.client.1.smithi161.stdout:7/977: unlink d3/fa 0 2024-02-22T00:33:32.593 INFO:tasks.workunit.client.1.smithi161.stdout:1/999: dread d19/d51/d64/d9b/fb3 [0,4194304] 0 2024-02-22T00:33:32.598 INFO:tasks.workunit.client.1.smithi161.stdout:7/978: dwrite d3/dd/f11a [0,4194304] 0 2024-02-22T00:33:32.598 INFO:tasks.workunit.client.1.smithi161.stdout:3/929: dread da/dc/d11/d26/d80/dc7/d59/fbe [0,4194304] 0 2024-02-22T00:33:32.606 INFO:tasks.workunit.client.1.smithi161.stdout:6/970: dread d3/d10/d12/d2f/d7d/d5f/f99 [0,4194304] 0 2024-02-22T00:33:32.614 INFO:tasks.workunit.client.1.smithi161.stdout:7/979: truncate f2 6570523 0 2024-02-22T00:33:32.615 INFO:tasks.workunit.client.1.smithi161.stdout:9/960: sync 2024-02-22T00:33:32.616 INFO:tasks.workunit.client.1.smithi161.stdout:9/961: chown d1/d2/d7/da/def 562648403 1 2024-02-22T00:33:32.617 INFO:tasks.workunit.client.1.smithi161.stdout:9/962: mknod d1/d5/d9/c143 0 2024-02-22T00:33:32.623 INFO:tasks.workunit.client.1.smithi161.stdout:9/963: dwrite d1/d25/d73/d60/f11b [0,4194304] 0 2024-02-22T00:33:32.624 INFO:tasks.workunit.client.1.smithi161.stdout:9/964: dread - d1/d2/f7f zero size 2024-02-22T00:33:32.630 INFO:tasks.workunit.client.1.smithi161.stdout:9/965: write d1/d25/d73/fb6 [614918,80421] 0 2024-02-22T00:33:32.631 INFO:tasks.workunit.client.1.smithi161.stdout:9/966: fsync d1/d5/d9/da5/dbc/d115/d138/d21/f118 0 2024-02-22T00:33:32.633 INFO:tasks.workunit.client.1.smithi161.stdout:6/971: dread d3/d30/f74 [0,4194304] 0 2024-02-22T00:33:32.634 INFO:tasks.workunit.client.1.smithi161.stdout:6/972: write d3/ff5 [404339,121028] 0 2024-02-22T00:33:32.634 INFO:tasks.workunit.client.1.smithi161.stdout:9/967: creat d1/d25/dc4/d4f/da3/f144 x:0 0 0 2024-02-22T00:33:32.637 INFO:tasks.workunit.client.1.smithi161.stdout:6/973: write d3/d10/d12/d2f/d7d/d5f/f99 [1340947,25198] 0 2024-02-22T00:33:32.645 INFO:tasks.workunit.client.1.smithi161.stdout:7/980: dread d3/dd/f1d [0,4194304] 0 2024-02-22T00:33:32.645 INFO:tasks.workunit.client.1.smithi161.stdout:9/968: truncate d1/d2/d7/da/f80 2227414 0 2024-02-22T00:33:32.646 INFO:tasks.workunit.client.1.smithi161.stdout:7/981: write d3/df/d33/d35/d55/de4/f4e [3817625,129008] 0 2024-02-22T00:33:32.649 INFO:tasks.workunit.client.1.smithi161.stdout:7/982: symlink d3/df/d33/dff/l13b 0 2024-02-22T00:33:32.650 INFO:tasks.workunit.client.1.smithi161.stdout:7/983: chown d3/l20 0 1 2024-02-22T00:33:32.652 INFO:tasks.workunit.client.1.smithi161.stdout:9/969: dwrite d1/d5/f12f [4194304,4194304] 0 2024-02-22T00:33:32.652 INFO:tasks.workunit.client.1.smithi161.stdout:7/984: chown d3/df/d33/d35/d55/d63/d7b/ff5 168663 1 2024-02-22T00:33:32.653 INFO:tasks.workunit.client.1.smithi161.stdout:9/970: write d1/d2/d4/d1f/dab/ffc [4796465,23994] 0 2024-02-22T00:33:32.656 INFO:tasks.workunit.client.1.smithi161.stdout:7/985: mkdir d3/df/d33/d35/d55/d63/d7b/d30/dc0/dcb/df8/d13c 0 2024-02-22T00:33:32.657 INFO:tasks.workunit.client.1.smithi161.stdout:7/986: readlink d3/df/d33/d53/l129 0 2024-02-22T00:33:32.660 INFO:tasks.workunit.client.1.smithi161.stdout:7/987: creat d3/df/d33/d74/f13d x:0 0 0 2024-02-22T00:33:32.661 INFO:tasks.workunit.client.1.smithi161.stdout:7/988: write d3/df/d33/d35/d55/d63/d7b/d50/f83 [2051592,121667] 0 2024-02-22T00:33:32.662 INFO:tasks.workunit.client.1.smithi161.stdout:7/989: stat d3/dbf/fd5 0 2024-02-22T00:33:32.664 INFO:tasks.workunit.client.1.smithi161.stdout:7/990: write d3/df/d33/d35/d55/d63/d7b/d30/dc0/ff9 [553560,42815] 0 2024-02-22T00:33:32.666 INFO:tasks.workunit.client.1.smithi161.stdout:7/991: creat d3/df/dba/f13e x:0 0 0 2024-02-22T00:33:32.672 INFO:tasks.workunit.client.1.smithi161.stdout:7/992: dwrite d3/dd/f1d [0,4194304] 0 2024-02-22T00:33:32.672 INFO:tasks.workunit.client.1.smithi161.stdout:9/971: truncate d1/d5/f12f 1304189 0 2024-02-22T00:33:32.673 INFO:tasks.workunit.client.1.smithi161.stdout:9/972: stat d1/d2/d7/da/f17 0 2024-02-22T00:33:32.676 INFO:tasks.workunit.client.1.smithi161.stdout:7/993: symlink d3/df/d33/d35/d55/d63/d7b/d8f/dd2/d100/l13f 0 2024-02-22T00:33:32.677 INFO:tasks.workunit.client.1.smithi161.stdout:7/994: write d3/dd/ff1 [663264,124369] 0 2024-02-22T00:33:32.679 INFO:tasks.workunit.client.1.smithi161.stdout:9/973: write d1/d25/dc4/d4f/f84 [291976,130093] 0 2024-02-22T00:33:32.681 INFO:tasks.workunit.client.1.smithi161.stdout:9/974: readlink d1/d5/d9/lf6 0 2024-02-22T00:33:32.682 INFO:tasks.workunit.client.1.smithi161.stdout:7/995: rename d3/df/d33/d35/d55/d63/d7b/d30/dc0/c11f to d3/df/d33/d74/df2/c140 0 2024-02-22T00:33:32.683 INFO:tasks.workunit.client.1.smithi161.stdout:9/975: creat d1/d25/dc4/d4f/da3/f145 x:0 0 0 2024-02-22T00:33:32.688 INFO:tasks.workunit.client.1.smithi161.stdout:7/996: dread d3/f7 [4194304,4194304] 0 2024-02-22T00:33:32.691 INFO:tasks.workunit.client.1.smithi161.stdout:7/997: mkdir d3/df/d33/d53/d141 0 2024-02-22T00:33:32.692 INFO:tasks.workunit.client.1.smithi161.stdout:7/998: chown d3/df/c5a 1374226 1 2024-02-22T00:33:32.694 INFO:tasks.workunit.client.1.smithi161.stdout:7/999: unlink d3/df/d33/d35/d55/d63/d7b/d30/dc0/c12d 0 2024-02-22T00:33:32.695 INFO:tasks.workunit.client.1.smithi161.stdout:4/973: sync 2024-02-22T00:33:32.695 INFO:tasks.workunit.client.1.smithi161.stdout:0/946: sync 2024-02-22T00:33:32.696 INFO:tasks.workunit.client.1.smithi161.stdout:0/947: stat d14/d44/dbf/deb 0 2024-02-22T00:33:32.696 INFO:tasks.workunit.client.1.smithi161.stdout:0/948: fdatasync d14/d1a/f79 0 2024-02-22T00:33:32.700 INFO:tasks.workunit.client.1.smithi161.stdout:0/949: read d14/d1a/f63 [1599287,122565] 0 2024-02-22T00:33:32.707 INFO:tasks.workunit.client.1.smithi161.stdout:0/950: dwrite d14/d37/d42/d8e/d122/f121 [0,4194304] 0 2024-02-22T00:33:32.709 INFO:tasks.workunit.client.1.smithi161.stdout:0/951: fdatasync d14/d1a/d3f/d96/da1/f138 0 2024-02-22T00:33:32.714 INFO:tasks.workunit.client.1.smithi161.stdout:4/974: dread d5/d8/d41/d53/d6c/d72/d167/d14/f29 [0,4194304] 0 2024-02-22T00:33:32.715 INFO:tasks.workunit.client.1.smithi161.stdout:0/952: dwrite d14/d37/d10b/f128 [0,4194304] 0 2024-02-22T00:33:32.716 INFO:tasks.workunit.client.1.smithi161.stdout:4/975: dread - d5/d8/d41/d57/dbe/d28/d63/d65/faf zero size 2024-02-22T00:33:32.716 INFO:tasks.workunit.client.1.smithi161.stdout:0/953: chown d14/d1a/d3f/d96 5357212 1 2024-02-22T00:33:32.720 INFO:tasks.workunit.client.1.smithi161.stdout:0/954: mkdir d14/d1a/d3f/d96/da1/d139 0 2024-02-22T00:33:32.721 INFO:tasks.workunit.client.1.smithi161.stdout:0/955: write d14/d1a/d3f/d96/dbc/dc5/f107 [2139392,19445] 0 2024-02-22T00:33:32.727 INFO:tasks.workunit.client.1.smithi161.stdout:8/984: sync 2024-02-22T00:33:32.727 INFO:tasks.workunit.client.1.smithi161.stdout:0/956: rmdir d14/d37/d42/d73/dc7/de0/de5 39 2024-02-22T00:33:32.728 INFO:tasks.workunit.client.1.smithi161.stdout:9/976: write d1/d5/d9/f4a [2494633,105325] 0 2024-02-22T00:33:32.730 INFO:tasks.workunit.client.1.smithi161.stdout:9/977: truncate d1/d2/d4/f3b 4529052 0 2024-02-22T00:33:32.734 INFO:tasks.workunit.client.1.smithi161.stdout:9/978: mknod d1/d5/d9/da5/dbc/d115/d138/c146 0 2024-02-22T00:33:32.739 INFO:tasks.workunit.client.1.smithi161.stdout:4/976: dread d5/d8/d41/d57/dbe/d28/d38/f85 [0,4194304] 0 2024-02-22T00:33:32.743 INFO:tasks.workunit.client.1.smithi161.stdout:9/979: dwrite d1/d25/dc4/d4f/f6c [0,4194304] 0 2024-02-22T00:33:32.744 INFO:tasks.workunit.client.1.smithi161.stdout:0/957: dwrite d14/d1a/d3f/d96/fc4 [0,4194304] 0 2024-02-22T00:33:32.745 INFO:tasks.workunit.client.1.smithi161.stdout:9/980: chown d1/d2/f7f 128146 1 2024-02-22T00:33:32.748 INFO:tasks.workunit.client.1.smithi161.stdout:9/981: write d1/d2/d7/f91 [154640,128357] 0 2024-02-22T00:33:32.748 INFO:tasks.workunit.client.1.smithi161.stdout:8/985: dread d1/d2f/f110 [0,4194304] 0 2024-02-22T00:33:32.749 INFO:tasks.workunit.client.1.smithi161.stdout:4/977: symlink d5/d8/d41/d53/d6c/d72/dfb/l169 0 2024-02-22T00:33:32.755 INFO:tasks.workunit.client.1.smithi161.stdout:0/958: rename d14/d37/d42/d8e/cb1 to d14/d44/dbf/c13a 0 2024-02-22T00:33:32.757 INFO:tasks.workunit.client.1.smithi161.stdout:9/982: symlink d1/d5/d9/d9c/d11c/l147 0 2024-02-22T00:33:32.758 INFO:tasks.workunit.client.1.smithi161.stdout:4/978: mkdir d5/d8/d41/d57/dbe/d28/d63/d65/dcd/d123/d16a 0 2024-02-22T00:33:32.759 INFO:tasks.workunit.client.1.smithi161.stdout:0/959: mknod d14/d1a/d3f/d108/d10c/d126/da5/dcd/c13b 0 2024-02-22T00:33:32.760 INFO:tasks.workunit.client.1.smithi161.stdout:9/983: read d1/d2/d4/d1f/dab/ffc [3562216,85843] 0 2024-02-22T00:33:32.761 INFO:tasks.workunit.client.1.smithi161.stdout:0/960: write d14/d1a/d3f/d108/d10c/d126/fd6 [583206,41320] 0 2024-02-22T00:33:32.761 INFO:tasks.workunit.client.1.smithi161.stdout:4/979: mknod d5/d8/d41/d57/dbe/d28/d63/d65/c16b 0 2024-02-22T00:33:32.762 INFO:tasks.workunit.client.1.smithi161.stdout:0/961: stat d14/d44/dbf/lce 0 2024-02-22T00:33:32.765 INFO:tasks.workunit.client.1.smithi161.stdout:4/980: mkdir d5/d8/d41/d16c 0 2024-02-22T00:33:32.765 INFO:tasks.workunit.client.1.smithi161.stdout:0/962: fsync d14/d1a/d3f/d96/fc4 0 2024-02-22T00:33:32.766 INFO:tasks.workunit.client.1.smithi161.stdout:4/981: write d5/d17/f4a [2070724,24561] 0 2024-02-22T00:33:32.770 INFO:tasks.workunit.client.1.smithi161.stdout:4/982: symlink d5/d8/d41/d53/d6c/l16d 0 2024-02-22T00:33:32.771 INFO:tasks.workunit.client.1.smithi161.stdout:8/986: dread d1/d1c/d20/de6/d11a/f133 [0,4194304] 0 2024-02-22T00:33:32.772 INFO:tasks.workunit.client.1.smithi161.stdout:0/963: dwrite d14/f18 [4194304,4194304] 0 2024-02-22T00:33:32.773 INFO:tasks.workunit.client.1.smithi161.stdout:9/984: write d1/d2/d7/da/f80 [2043550,31860] 0 2024-02-22T00:33:32.774 INFO:tasks.workunit.client.1.smithi161.stdout:6/974: sync 2024-02-22T00:33:32.774 INFO:tasks.workunit.client.1.smithi161.stdout:3/930: sync 2024-02-22T00:33:32.779 INFO:tasks.workunit.client.1.smithi161.stdout:3/931: fsync da/dc/f2b 0 2024-02-22T00:33:32.779 INFO:tasks.workunit.client.1.smithi161.stdout:4/983: dread d5/d8/d41/fa3 [0,4194304] 0 2024-02-22T00:33:32.779 INFO:tasks.workunit.client.1.smithi161.stdout:9/985: read d1/d2/d4/d1f/fca [690273,113657] 0 2024-02-22T00:33:32.779 INFO:tasks.workunit.client.1.smithi161.stdout:0/964: creat d14/d37/d42/d73/f13c x:0 0 0 2024-02-22T00:33:32.782 INFO:tasks.workunit.client.1.smithi161.stdout:6/975: rename d3/d7c/da6/c109 to d3/d10/d72/dc5/c13a 0 2024-02-22T00:33:32.785 INFO:tasks.workunit.client.1.smithi161.stdout:4/984: fdatasync d5/d8/d41/d57/dbe/d28/d38/f85 0 2024-02-22T00:33:32.785 INFO:tasks.workunit.client.1.smithi161.stdout:6/976: truncate d3/d7c/fce 4873015 0 2024-02-22T00:33:32.785 INFO:tasks.workunit.client.1.smithi161.stdout:8/987: dwrite d1/d1c/d20/d22/d28/d7f/d92/d95/fe3 [0,4194304] 0 2024-02-22T00:33:32.788 INFO:tasks.workunit.client.1.smithi161.stdout:3/932: symlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff/df8/l12d 0 2024-02-22T00:33:32.793 INFO:tasks.workunit.client.1.smithi161.stdout:0/965: write d14/d1a/f66 [930786,77391] 0 2024-02-22T00:33:32.794 INFO:tasks.workunit.client.1.smithi161.stdout:9/986: write d1/d2/d7/da/fa0 [2489797,10398] 0 2024-02-22T00:33:32.794 INFO:tasks.workunit.client.1.smithi161.stdout:6/977: write d3/d10/d1b/da5/f8d [1643942,32748] 0 2024-02-22T00:33:32.798 INFO:tasks.workunit.client.1.smithi161.stdout:9/987: chown d1/d5/d9/da5/d109 63439 1 2024-02-22T00:33:32.799 INFO:tasks.workunit.client.1.smithi161.stdout:6/978: chown d3/ff5 169126 1 2024-02-22T00:33:32.800 INFO:tasks.workunit.client.1.smithi161.stdout:3/933: dwrite da/dc/d11/fab [0,4194304] 0 2024-02-22T00:33:32.802 INFO:tasks.workunit.client.1.smithi161.stdout:4/985: dwrite d5/d8/d41/d53/d6c/d72/d167/d14/f29 [0,4194304] 0 2024-02-22T00:33:32.804 INFO:tasks.workunit.client.1.smithi161.stdout:3/934: dread - da/dc/d11/d26/fd5 zero size 2024-02-22T00:33:32.805 INFO:tasks.workunit.client.1.smithi161.stdout:6/979: mknod d3/d10/c13b 0 2024-02-22T00:33:32.805 INFO:tasks.workunit.client.1.smithi161.stdout:0/966: write d14/d37/d42/d73/f99 [731770,107796] 0 2024-02-22T00:33:32.810 INFO:tasks.workunit.client.1.smithi161.stdout:0/967: creat d14/d1a/d9d/dba/f13d x:0 0 0 2024-02-22T00:33:32.810 INFO:tasks.workunit.client.1.smithi161.stdout:9/988: getdents d1/d25/d73/d60/db0 0 2024-02-22T00:33:32.815 INFO:tasks.workunit.client.1.smithi161.stdout:6/980: rename d3/dc/f27 to d3/d10/d12/d3a/dca/f13c 0 2024-02-22T00:33:32.816 INFO:tasks.workunit.client.1.smithi161.stdout:9/989: fdatasync d1/d2/d4/d95/fb9 0 2024-02-22T00:33:32.816 INFO:tasks.workunit.client.1.smithi161.stdout:6/981: write d3/f7f [4913293,50493] 0 2024-02-22T00:33:32.816 INFO:tasks.workunit.client.1.smithi161.stdout:8/988: dread d1/d1c/d75/d18/f25 [0,4194304] 0 2024-02-22T00:33:32.817 INFO:tasks.workunit.client.1.smithi161.stdout:0/968: creat d14/d1a/d3f/d96/dad/f13e x:0 0 0 2024-02-22T00:33:32.820 INFO:tasks.workunit.client.1.smithi161.stdout:4/986: truncate d5/d8/d41/d53/d6c/d72/d167/d14/d4f/ff3 1784298 0 2024-02-22T00:33:32.821 INFO:tasks.workunit.client.1.smithi161.stdout:8/989: creat d1/d2f/d114/f13b x:0 0 0 2024-02-22T00:33:32.822 INFO:tasks.workunit.client.1.smithi161.stdout:6/982: stat d3/dc/df/dfd/d124/dd9/d87/cd0 0 2024-02-22T00:33:32.824 INFO:tasks.workunit.client.1.smithi161.stdout:4/987: readlink d5/d8/d41/d57/dbe/d28/d38/d6d/da5/ldb 0 2024-02-22T00:33:32.825 INFO:tasks.workunit.client.1.smithi161.stdout:6/983: fsync d3/dc/df/f69 0 2024-02-22T00:33:32.826 INFO:tasks.workunit.client.1.smithi161.stdout:3/935: fdatasync da/dc/d11/fab 0 2024-02-22T00:33:32.827 INFO:tasks.workunit.client.1.smithi161.stdout:9/990: dwrite d1/d25/dc4/d4f/da3/f144 [0,4194304] 0 2024-02-22T00:33:32.830 INFO:tasks.workunit.client.1.smithi161.stdout:6/984: stat d3/d10/d12/d2f/d7d/d5f/f70 0 2024-02-22T00:33:32.832 INFO:tasks.workunit.client.1.smithi161.stdout:8/990: creat d1/d1c/d20/d22/d28/d7f/d92/d95/f13c x:0 0 0 2024-02-22T00:33:32.833 INFO:tasks.workunit.client.1.smithi161.stdout:9/991: read d1/d2/d4/fad [218845,25422] 0 2024-02-22T00:33:32.835 INFO:tasks.workunit.client.1.smithi161.stdout:3/936: mkdir da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/de5/d12e 0 2024-02-22T00:33:32.837 INFO:tasks.workunit.client.1.smithi161.stdout:8/991: rmdir d1/d1c/dbd 39 2024-02-22T00:33:32.839 INFO:tasks.workunit.client.1.smithi161.stdout:9/992: rmdir d1/d2/d4/d1f/dab/dcd 39 2024-02-22T00:33:32.841 INFO:tasks.workunit.client.1.smithi161.stdout:0/969: dread d14/d37/d42/ffc [0,4194304] 0 2024-02-22T00:33:32.871 INFO:tasks.workunit.client.1.smithi161.stdout:3/937: rename da/dc/d91/db5 to da/dc/d11/d26/d104/d113/d12f 0 2024-02-22T00:33:32.877 INFO:tasks.workunit.client.1.smithi161.stdout:6/985: dwrite d3/d10/d72/ffc [0,4194304] 0 2024-02-22T00:33:32.896 INFO:tasks.workunit.client.1.smithi161.stdout:3/938: unlink da/d29/ca6 0 2024-02-22T00:33:32.897 INFO:tasks.workunit.client.1.smithi161.stdout:4/988: link d5/d8/d41/d141/l144 d5/d8/d41/d57/dbe/d28/d63/d64/l16e 0 2024-02-22T00:33:32.899 INFO:tasks.workunit.client.1.smithi161.stdout:6/986: creat d3/d10/d12/d2f/d7d/dab/dbe/de6/f13d x:0 0 0 2024-02-22T00:33:32.900 INFO:tasks.workunit.client.1.smithi161.stdout:8/992: dwrite d1/d1c/d20/d22/fcc [0,4194304] 0 2024-02-22T00:33:32.901 INFO:tasks.workunit.client.1.smithi161.stdout:8/993: write d1/d1c/d96/f10a [83316,110206] 0 2024-02-22T00:33:32.902 INFO:tasks.workunit.client.1.smithi161.stdout:9/993: creat d1/d2/d4/d1f/dab/f148 x:0 0 0 2024-02-22T00:33:32.904 INFO:tasks.workunit.client.1.smithi161.stdout:9/994: truncate d1/d5/d9/da5/d109/f135 302969 0 2024-02-22T00:33:32.905 INFO:tasks.workunit.client.1.smithi161.stdout:9/995: chown d1/l57 911229682 1 2024-02-22T00:33:32.906 INFO:tasks.workunit.client.1.smithi161.stdout:9/996: fsync d1/d5/d9/d9c/d11c/f12b 0 2024-02-22T00:33:32.909 INFO:tasks.workunit.client.1.smithi161.stdout:8/994: symlink d1/d1c/d20/d22/d28/d7f/d92/d93/l13d 0 2024-02-22T00:33:32.910 INFO:tasks.workunit.client.1.smithi161.stdout:0/970: link d14/d1a/d9d/dba/cbb d14/d1a/c13f 0 2024-02-22T00:33:32.910 INFO:tasks.workunit.client.1.smithi161.stdout:8/995: fdatasync d1/d1c/d75/d18/f12d 0 2024-02-22T00:33:32.915 INFO:tasks.workunit.client.1.smithi161.stdout:6/987: link d3/d10/f38 d3/d10/d72/dc5/f13e 0 2024-02-22T00:33:32.917 INFO:tasks.workunit.client.1.smithi161.stdout:8/996: dwrite d1/d1c/d20/d22/d28/d7f/db4/d11d/f122 [0,4194304] 0 2024-02-22T00:33:32.918 INFO:tasks.workunit.client.1.smithi161.stdout:3/939: write da/dc/f9b [1052949,94694] 0 2024-02-22T00:33:32.919 INFO:tasks.workunit.client.1.smithi161.stdout:4/989: write d5/d8/f80 [1030161,22749] 0 2024-02-22T00:33:32.920 INFO:tasks.workunit.client.1.smithi161.stdout:3/940: read f0 [4477660,533] 0 2024-02-22T00:33:32.924 INFO:tasks.workunit.client.1.smithi161.stdout:8/997: creat d1/d1c/d20/d22/dfe/f13e x:0 0 0 2024-02-22T00:33:32.927 INFO:tasks.workunit.client.1.smithi161.stdout:0/971: read d14/d37/f76 [540700,31696] 0 2024-02-22T00:33:32.927 INFO:tasks.workunit.client.1.smithi161.stdout:3/941: mkdir da/dc/d11/d26/d104/d113/d12f/d130 0 2024-02-22T00:33:32.928 INFO:tasks.workunit.client.1.smithi161.stdout:9/997: write d1/d2/f3d [964382,123353] 0 2024-02-22T00:33:32.929 INFO:tasks.workunit.client.1.smithi161.stdout:8/998: creat d1/d1c/d96/df7/f13f x:0 0 0 2024-02-22T00:33:32.931 INFO:tasks.workunit.client.1.smithi161.stdout:0/972: mknod d14/d37/d42/da2/c140 0 2024-02-22T00:33:32.932 INFO:tasks.workunit.client.1.smithi161.stdout:4/990: rename d5/d8/d41/d57/dbe/d28/d38/d6d/fc9 to d5/d8/d41/d57/dbe/f16f 0 2024-02-22T00:33:32.935 INFO:tasks.workunit.client.1.smithi161.stdout:0/973: write d14/d1a/d3f/d5d/f8a [2320977,56062] 0 2024-02-22T00:33:32.935 INFO:tasks.workunit.client.1.smithi161.stdout:9/998: dread d1/d2/d7/f91 [0,4194304] 0 2024-02-22T00:33:32.936 INFO:tasks.workunit.client.1.smithi161.stdout:3/942: read da/dc/d11/d26/d80/dc7/d59/d93/daa/fe2 [4208818,49484] 0 2024-02-22T00:33:32.937 INFO:tasks.workunit.client.1.smithi161.stdout:6/988: dwrite d3/dc/df/dfd/d124/f10a [0,4194304] 0 2024-02-22T00:33:32.939 INFO:tasks.workunit.client.1.smithi161.stdout:0/974: write d14/d37/d42/d8e/d122/f121 [1953370,22178] 0 2024-02-22T00:33:32.940 INFO:tasks.workunit.client.1.smithi161.stdout:9/999: chown d1/d5/d9/da5/dbc/d115/d138/d21/c10f 0 1 2024-02-22T00:33:32.941 INFO:tasks.workunit.client.1.smithi161.stdout:6/989: readlink d3/d10/d1b/da5/lb8 0 2024-02-22T00:33:32.942 INFO:tasks.workunit.client.1.smithi161.stdout:6/990: fdatasync d3/d10/d12/d2f/d7d/d5f/fe3 0 2024-02-22T00:33:32.943 INFO:tasks.workunit.client.1.smithi161.stdout:0/975: truncate d14/d37/d42/d8e/fcc 951000 0 2024-02-22T00:33:32.943 INFO:tasks.workunit.client.1.smithi161.stdout:3/943: symlink da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/l131 0 2024-02-22T00:33:32.944 INFO:tasks.workunit.client.1.smithi161.stdout:6/991: truncate d3/d10/d72/dc5/f102 78738 0 2024-02-22T00:33:32.945 INFO:tasks.workunit.client.1.smithi161.stdout:3/944: chown da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f58 27 1 2024-02-22T00:33:32.947 INFO:tasks.workunit.client.1.smithi161.stdout:6/992: unlink d3/d10/d12/d2f/f3c 0 2024-02-22T00:33:32.947 INFO:tasks.workunit.client.1.smithi161.stdout:3/945: dread - da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff/fe4 zero size 2024-02-22T00:33:32.947 INFO:tasks.workunit.client.1.smithi161.stdout:6/993: chown d3/dc/df/l24 265698153 1 2024-02-22T00:33:32.949 INFO:tasks.workunit.client.1.smithi161.stdout:3/946: truncate da/dc/d11/d26/d80/d92/f123 1042024 0 2024-02-22T00:33:32.953 INFO:tasks.workunit.client.1.smithi161.stdout:3/947: write da/dc/d11/d26/d80/dc7/d108/f11b [689632,87483] 0 2024-02-22T00:33:32.956 INFO:tasks.workunit.client.1.smithi161.stdout:0/976: dwrite d14/d1a/d3f/d5d/fb0 [0,4194304] 0 2024-02-22T00:33:32.962 INFO:tasks.workunit.client.1.smithi161.stdout:0/977: creat d14/d37/d42/d8e/d122/f141 x:0 0 0 2024-02-22T00:33:32.962 INFO:tasks.workunit.client.1.smithi161.stdout:3/948: dwrite da/dc/d11/d26/d80/dc7/d108/f11b [0,4194304] 0 2024-02-22T00:33:32.965 INFO:tasks.workunit.client.1.smithi161.stdout:0/978: read - d14/d1a/d3f/d96/dad/f117 zero size 2024-02-22T00:33:32.965 INFO:tasks.workunit.client.1.smithi161.stdout:6/994: dread d3/d10/d72/dc5/f13e [0,4194304] 0 2024-02-22T00:33:32.968 INFO:tasks.workunit.client.1.smithi161.stdout:8/999: dread d1/d1c/d20/f2b [0,4194304] 0 2024-02-22T00:33:32.973 INFO:tasks.workunit.client.1.smithi161.stdout:0/979: rmdir d14/d1a/d3f/d96/da1/d139 0 2024-02-22T00:33:32.974 INFO:tasks.workunit.client.1.smithi161.stdout:6/995: getdents d3/d10/d12/d2f/d7d/dab 0 2024-02-22T00:33:32.976 INFO:tasks.workunit.client.1.smithi161.stdout:6/996: write d3/dc/df/dfd/d124/de5/f127 [401748,24948] 0 2024-02-22T00:33:32.976 INFO:tasks.workunit.client.1.smithi161.stdout:0/980: creat d14/d44/dbf/deb/f142 x:0 0 0 2024-02-22T00:33:32.978 INFO:tasks.workunit.client.1.smithi161.stdout:6/997: chown d3/d10/d12/d95/l103 9800 1 2024-02-22T00:33:32.979 INFO:tasks.workunit.client.1.smithi161.stdout:0/981: symlink d14/d1a/d9d/dba/l143 0 2024-02-22T00:33:32.980 INFO:tasks.workunit.client.1.smithi161.stdout:6/998: mknod d3/c13f 0 2024-02-22T00:33:32.986 INFO:tasks.workunit.client.1.smithi161.stdout:0/982: dwrite d14/d1a/d3f/d5d/fb0 [0,4194304] 0 2024-02-22T00:33:32.987 INFO:tasks.workunit.client.1.smithi161.stdout:6/999: getdents d3/d10/d12/d2f/d7d/d97/ddc 0 2024-02-22T00:33:32.989 INFO:tasks.workunit.client.1.smithi161.stdout:3/949: dread da/dc/d11/d26/f45 [0,4194304] 0 2024-02-22T00:33:32.989 INFO:tasks.workunit.client.1.smithi161.stdout:0/983: mknod d14/d44/dbe/c144 0 2024-02-22T00:33:32.991 INFO:tasks.workunit.client.1.smithi161.stdout:3/950: unlink da/dc/d11/d26/d80/dc7/dfe/lec 0 2024-02-22T00:33:32.992 INFO:tasks.workunit.client.1.smithi161.stdout:0/984: mknod d14/d44/dbe/c145 0 2024-02-22T00:33:32.996 INFO:tasks.workunit.client.1.smithi161.stdout:3/951: rename da/dc/d11/d26/d80/dc7/d59/d93/ccb to da/dc/d11/d26/d80/dc7/d108/c132 0 2024-02-22T00:33:33.000 INFO:tasks.workunit.client.1.smithi161.stdout:0/985: dwrite d14/d44/dbf/deb/f142 [0,4194304] 0 2024-02-22T00:33:33.000 INFO:tasks.workunit.client.1.smithi161.stdout:3/952: symlink da/dc/d11/d26/d80/dc7/d59/d93/daa/l133 0 2024-02-22T00:33:33.004 INFO:tasks.workunit.client.1.smithi161.stdout:3/953: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/fb2 [3714708,72095] 0 2024-02-22T00:33:33.006 INFO:tasks.workunit.client.1.smithi161.stdout:0/986: rename d14/d1a/d9d/dba/fc2 to d14/d1a/d3f/d108/d10c/d126/f146 0 2024-02-22T00:33:33.008 INFO:tasks.workunit.client.1.smithi161.stdout:0/987: creat d14/d37/d42/da2/f147 x:0 0 0 2024-02-22T00:33:33.009 INFO:tasks.workunit.client.1.smithi161.stdout:0/988: chown d14/d1a/f38 245772068 1 2024-02-22T00:33:33.010 INFO:tasks.workunit.client.1.smithi161.stdout:0/989: mknod d14/d1a/c148 0 2024-02-22T00:33:33.011 INFO:tasks.workunit.client.1.smithi161.stdout:0/990: mknod d14/d1a/d9d/dba/c149 0 2024-02-22T00:33:33.013 INFO:tasks.workunit.client.1.smithi161.stdout:0/991: dread - d14/d1a/d3f/d96/dbc/dc5/ff3 zero size 2024-02-22T00:33:33.016 INFO:tasks.workunit.client.1.smithi161.stdout:0/992: getdents d14/d1a/d3f/d96/da1 0 2024-02-22T00:33:33.033 INFO:tasks.workunit.client.1.smithi161.stdout:0/993: rmdir d14/d37/d42/d73/dc7/de0 39 2024-02-22T00:33:33.035 INFO:tasks.workunit.client.1.smithi161.stdout:0/994: unlink d14/d1a/f79 0 2024-02-22T00:33:33.037 INFO:tasks.workunit.client.1.smithi161.stdout:0/995: unlink d14/d1a/c43 0 2024-02-22T00:33:33.038 INFO:tasks.workunit.client.1.smithi161.stdout:0/996: write d14/d1a/d3f/d5d/fb0 [3451412,71988] 0 2024-02-22T00:33:33.039 INFO:tasks.workunit.client.1.smithi161.stdout:0/997: readlink d14/d1a/d3f/d108/d10c/d126/da5/dcd/l10f 0 2024-02-22T00:33:33.042 INFO:tasks.workunit.client.1.smithi161.stdout:0/998: symlink d14/d37/d42/d73/dc7/de0/l14a 0 2024-02-22T00:33:33.051 INFO:tasks.workunit.client.1.smithi161.stdout:0/999: write d14/d44/dbf/deb/fd5 [159884,94716] 0 2024-02-22T00:33:33.059 INFO:tasks.workunit.client.1.smithi161.stdout:4/991: sync 2024-02-22T00:33:33.062 INFO:tasks.workunit.client.1.smithi161.stdout:4/992: rename d5/d8/f151 to d5/d8/d41/d53/d6c/d72/d167/d75/f170 0 2024-02-22T00:33:33.065 INFO:tasks.workunit.client.1.smithi161.stdout:4/993: mknod d5/d8/d41/d53/d6c/dd8/c171 0 2024-02-22T00:33:33.065 INFO:tasks.workunit.client.1.smithi161.stdout:4/994: truncate d5/db0/fc8 5252644 0 2024-02-22T00:33:33.068 INFO:tasks.workunit.client.1.smithi161.stdout:4/995: symlink d5/d8/d41/d57/dbe/d28/d63/d65/l172 0 2024-02-22T00:33:33.069 INFO:tasks.workunit.client.1.smithi161.stdout:4/996: read d5/d8/d41/f8b [1126838,24627] 0 2024-02-22T00:33:33.075 INFO:tasks.workunit.client.1.smithi161.stdout:4/997: readlink d5/lf6 0 2024-02-22T00:33:33.076 INFO:tasks.workunit.client.1.smithi161.stdout:4/998: stat d5/d8/d41/d53/fdf 0 2024-02-22T00:33:33.104 INFO:tasks.workunit.client.1.smithi161.stdout:4/999: write d5/d8/d41/d57/dbe/d28/d63/d65/fc7 [817140,29294] 0 2024-02-22T00:33:33.118 INFO:tasks.workunit.client.1.smithi161.stdout:3/954: sync 2024-02-22T00:33:33.119 INFO:tasks.workunit.client.1.smithi161.stdout:3/955: write da/dc/d11/d26/f45 [8998129,100197] 0 2024-02-22T00:33:33.125 INFO:tasks.workunit.client.1.smithi161.stdout:3/956: dwrite da/dc/d5f/d66/f101 [0,4194304] 0 2024-02-22T00:33:33.128 INFO:tasks.workunit.client.1.smithi161.stdout:3/957: symlink da/dc/d11/d26/d80/dc7/d108/l134 0 2024-02-22T00:33:33.130 INFO:tasks.workunit.client.1.smithi161.stdout:3/958: creat da/dc/d5f/dfc/f135 x:0 0 0 2024-02-22T00:33:33.132 INFO:tasks.workunit.client.1.smithi161.stdout:3/959: write da/dc/d11/d26/d80/dc7/dfe/ff6 [1651213,56097] 0 2024-02-22T00:33:33.133 INFO:tasks.workunit.client.1.smithi161.stdout:3/960: fdatasync da/dc/d11/d26/f21 0 2024-02-22T00:33:33.139 INFO:tasks.workunit.client.1.smithi161.stdout:3/961: write f0 [171242,5124] 0 2024-02-22T00:33:33.141 INFO:tasks.workunit.client.1.smithi161.stdout:3/962: mknod da/dc/d11/d26/d80/c136 0 2024-02-22T00:33:33.146 INFO:tasks.workunit.client.1.smithi161.stdout:3/963: dwrite da/dc/d11/d26/fd5 [0,4194304] 0 2024-02-22T00:33:33.164 INFO:tasks.workunit.client.1.smithi161.stdout:3/964: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/f85 [0,4194304] 0 2024-02-22T00:33:33.168 INFO:tasks.workunit.client.1.smithi161.stdout:3/965: truncate da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/f42 518743 0 2024-02-22T00:33:33.177 INFO:tasks.workunit.client.1.smithi161.stdout:3/966: dwrite da/f27 [0,4194304] 0 2024-02-22T00:33:33.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:31.759542+0000 mgr.smithi161.sazlam (mgr.24369) 44 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 89 MiB/s rd, 268 MiB/s wr, 613 op/s 2024-02-22T00:33:33.187 INFO:tasks.workunit.client.1.smithi161.stdout:3/967: dread - da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/fd0 zero size 2024-02-22T00:33:33.187 INFO:tasks.workunit.client.1.smithi161.stdout:3/968: chown da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/dff/d100 891357 1 2024-02-22T00:33:33.189 INFO:tasks.workunit.client.1.smithi161.stdout:3/969: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/f137 x:0 0 0 2024-02-22T00:33:33.194 INFO:tasks.workunit.client.1.smithi161.stdout:3/970: rename da/dc/d5f/d66/ld4 to da/dc/d11/d26/d80/dc7/d108/d12a/l138 0 2024-02-22T00:33:33.204 INFO:tasks.workunit.client.1.smithi161.stdout:3/971: dread da/dc/d11/d26/d80/d92/fcc [0,4194304] 0 2024-02-22T00:33:33.218 INFO:tasks.workunit.client.1.smithi161.stdout:3/972: dread da/dc/f51 [0,4194304] 0 2024-02-22T00:33:33.230 INFO:tasks.workunit.client.1.smithi161.stdout:3/973: dread da/fbd [0,4194304] 0 2024-02-22T00:33:33.232 INFO:tasks.workunit.client.1.smithi161.stdout:3/974: fsync da/fb3 0 2024-02-22T00:33:33.233 INFO:tasks.workunit.client.1.smithi161.stdout:3/975: write da/dc/d11/d26/d80/dc7/dfe/ff6 [1890466,48687] 0 2024-02-22T00:33:33.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:31.759542+0000 mgr.smithi161.sazlam (mgr.24369) 44 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 89 MiB/s rd, 268 MiB/s wr, 613 op/s 2024-02-22T00:33:33.318 INFO:tasks.workunit.client.1.smithi161.stdout:3/976: sync 2024-02-22T00:33:33.319 INFO:tasks.workunit.client.1.smithi161.stdout:3/977: chown da/dc/d11/d26/d80/dc7/d108/d10d 4 1 2024-02-22T00:33:33.320 INFO:tasks.workunit.client.1.smithi161.stdout:3/978: write da/dc/d10b/f110 [984534,125197] 0 2024-02-22T00:33:33.326 INFO:tasks.workunit.client.1.smithi161.stdout:3/979: write da/dc/d11/d26/d80/dc7/d59/d93/daa/fca [1120401,66824] 0 2024-02-22T00:33:33.329 INFO:tasks.workunit.client.1.smithi161.stdout:3/980: mkdir da/dc/d11/d26/d104/d113/d12f/d139 0 2024-02-22T00:33:33.329 INFO:tasks.workunit.client.1.smithi161.stdout:3/981: write da/f27 [1381826,51365] 0 2024-02-22T00:33:33.331 INFO:tasks.workunit.client.1.smithi161.stdout:3/982: chown da/dc/d11/d26/d80/dc7/d59/d93/daa/fe2 117520996 1 2024-02-22T00:33:33.332 INFO:tasks.workunit.client.1.smithi161.stdout:3/983: write da/dc/d11/d26/d80/dc7/d59/fa0 [512848,112785] 0 2024-02-22T00:33:33.334 INFO:tasks.workunit.client.1.smithi161.stdout:3/984: symlink da/dc/d11/d26/d80/dc7/d108/d12a/l13a 0 2024-02-22T00:33:33.337 INFO:tasks.workunit.client.1.smithi161.stdout:3/985: creat da/dc/d11/d26/d80/dc7/d108/d10d/dc1/dce/f13b x:0 0 0 2024-02-22T00:33:33.338 INFO:tasks.workunit.client.1.smithi161.stdout:3/986: truncate da/dc/d11/d26/d104/d113/d12f/fcd 161529 0 2024-02-22T00:33:33.340 INFO:tasks.workunit.client.1.smithi161.stdout:3/987: readlink da/dc/l94 0 2024-02-22T00:33:33.342 INFO:tasks.workunit.client.1.smithi161.stdout:3/988: mkdir da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d103/d13c 0 2024-02-22T00:33:33.346 INFO:tasks.workunit.client.1.smithi161.stdout:3/989: rename da/dc/d11/d26/d80/dc7/d108/d10d/dc1/fc5 to da/dc/d5f/d66/df9/f13d 0 2024-02-22T00:33:33.348 INFO:tasks.workunit.client.1.smithi161.stdout:3/990: mknod da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/c13e 0 2024-02-22T00:33:33.351 INFO:tasks.workunit.client.1.smithi161.stdout:3/991: creat da/dc/d11/d26/d80/dc7/d60/f13f x:0 0 0 2024-02-22T00:33:33.353 INFO:tasks.workunit.client.1.smithi161.stdout:3/992: symlink da/dc/d5f/d68/l140 0 2024-02-22T00:33:33.357 INFO:tasks.workunit.client.1.smithi161.stdout:3/993: write da/dc/d5f/d68/f6d [209276,108873] 0 2024-02-22T00:33:33.363 INFO:tasks.workunit.client.1.smithi161.stdout:3/994: dwrite da/dc/d11/d26/d80/dc7/d59/d93/daa/fca [0,4194304] 0 2024-02-22T00:33:33.364 INFO:tasks.workunit.client.1.smithi161.stdout:3/995: write da/dc/d11/d26/f19 [454856,79731] 0 2024-02-22T00:33:33.366 INFO:tasks.workunit.client.1.smithi161.stdout:3/996: rmdir da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37 39 2024-02-22T00:33:33.371 INFO:tasks.workunit.client.1.smithi161.stdout:3/997: creat da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/f141 x:0 0 0 2024-02-22T00:33:33.373 INFO:tasks.workunit.client.1.smithi161.stdout:3/998: getdents da/df1 0 2024-02-22T00:33:33.375 INFO:tasks.workunit.client.1.smithi161.stdout:3/999: write da/dc/d11/d26/d80/dc7/d59/d93/daa/dc4/d37/d39/fac [876916,128875] 0 2024-02-22T00:33:33.378 INFO:tasks.workunit.client.1.smithi161.stderr:+ rm -rf -- ./tmp.TB2r9i9K8m 2024-02-22T00:33:35.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:33.759847+0000 mgr.smithi161.sazlam (mgr.24369) 45 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 188 MiB/s wr, 403 op/s 2024-02-22T00:33:35.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:34.840248+0000 mon.smithi161 (mon.1) 63 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:33:35.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:33.759847+0000 mgr.smithi161.sazlam (mgr.24369) 45 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 2.0 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 188 MiB/s wr, 403 op/s 2024-02-22T00:33:35.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:34.840248+0000 mon.smithi161 (mon.1) 63 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:33:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:35.760139+0000 mgr.smithi161.sazlam (mgr.24369) 46 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 70 MiB/s rd, 194 MiB/s wr, 415 op/s 2024-02-22T00:33:37.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:35.760139+0000 mgr.smithi161.sazlam (mgr.24369) 46 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 2.1 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 70 MiB/s rd, 194 MiB/s wr, 415 op/s 2024-02-22T00:33:39.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:37.761169+0000 mgr.smithi161.sazlam (mgr.24369) 47 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 84 MiB/s rd, 212 MiB/s wr, 491 op/s 2024-02-22T00:33:39.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:37.761169+0000 mgr.smithi161.sazlam (mgr.24369) 47 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 84 MiB/s rd, 212 MiB/s wr, 491 op/s 2024-02-22T00:33:41.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:39.761731+0000 mgr.smithi161.sazlam (mgr.24369) 48 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 62 MiB/s rd, 137 MiB/s wr, 306 op/s 2024-02-22T00:33:41.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:39.761731+0000 mgr.smithi161.sazlam (mgr.24369) 48 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 62 MiB/s rd, 137 MiB/s wr, 306 op/s 2024-02-22T00:33:43.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:41.762306+0000 mgr.smithi161.sazlam (mgr.24369) 49 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 1.4 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 62 MiB/s rd, 137 MiB/s wr, 368 op/s 2024-02-22T00:33:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:41.762306+0000 mgr.smithi161.sazlam (mgr.24369) 49 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 1.4 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 62 MiB/s rd, 137 MiB/s wr, 368 op/s 2024-02-22T00:33:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.638+0000 7fb7e1a90700 1 -- 172.21.15.49:0/3317596622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 msgr2=0x7fb7dc0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.638+0000 7fb7e1a90700 1 --2- 172.21.15.49:0/3317596622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 0x7fb7dc0f6b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fb7cc0047f0 tx=0x7fb7cc009cb0).stop 2024-02-22T00:33:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.638+0000 7fb7e1a90700 1 -- 172.21.15.49:0/3317596622 shutdown_connections 2024-02-22T00:33:43.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.638+0000 7fb7e1a90700 1 --2- 172.21.15.49:0/3317596622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7dc0f7990 0x7fb7dc0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.638+0000 7fb7e1a90700 1 --2- 172.21.15.49:0/3317596622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 0x7fb7dc0f6b10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.638+0000 7fb7e1a90700 1 -- 172.21.15.49:0/3317596622 >> 172.21.15.49:0/3317596622 conn(0x7fb7dc0f1e50 msgr2=0x7fb7dc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.638+0000 7fb7e1a90700 1 -- 172.21.15.49:0/3317596622 shutdown_connections 2024-02-22T00:33:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.638+0000 7fb7e1a90700 1 -- 172.21.15.49:0/3317596622 wait complete. 2024-02-22T00:33:43.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.639+0000 7fb7e1a90700 1 Processor -- start 2024-02-22T00:33:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.639+0000 7fb7e1a90700 1 -- start start 2024-02-22T00:33:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.639+0000 7fb7e1a90700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 0x7fb7dc105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.639+0000 7fb7e1a90700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7dc0f7990 0x7fb7dc106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.639+0000 7fb7e1a90700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc106900 con 0x7fb7dc0f66f0 2024-02-22T00:33:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.639+0000 7fb7e1a90700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc106a40 con 0x7fb7dc0f7990 2024-02-22T00:33:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 0x7fb7dc105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7daffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7dc0f7990 0x7fb7dc106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:43.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7db7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 0x7fb7dc105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43994/0 (socket says 172.21.15.49:43994) 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7db7fe700 1 -- 172.21.15.49:0/2555992171 learned_addr learned my addr 172.21.15.49:0/2555992171 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7daffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7dc0f7990 0x7fb7dc106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:48240/0 (socket says 172.21.15.49:48240) 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7daffd700 1 -- 172.21.15.49:0/2555992171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 msgr2=0x7fb7dc105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7daffd700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 0x7fb7dc105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7daffd700 1 -- 172.21.15.49:0/2555992171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d0005040 con 0x7fb7dc0f7990 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7db7fe700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 0x7fb7dc105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7daffd700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7dc0f7990 0x7fb7dc106350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb7d00048a0 tx=0x7fb7d0009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7d8f74700 1 -- 172.21.15.49:0/2555992171 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7d000e030 con 0x7fb7dc0f7990 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc005040 con 0x7fb7dc0f7990 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7d8f74700 1 -- 172.21.15.49:0/2555992171 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7d000f040 con 0x7fb7dc0f7990 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7d8f74700 1 -- 172.21.15.49:0/2555992171 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7d0014870 con 0x7fb7dc0f7990 2024-02-22T00:33:43.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.640+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc10b910 con 0x7fb7dc0f7990 2024-02-22T00:33:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.641+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc0feeb0 con 0x7fb7dc0f7990 2024-02-22T00:33:43.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.643+0000 7fb7d8f74700 1 -- 172.21.15.49:0/2555992171 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7fb7d0014ae0 con 0x7fb7dc0f7990 2024-02-22T00:33:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.643+0000 7fb7d8f74700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fb7c4066dc0 0x7fb7c4069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.643+0000 7fb7d8f74700 1 -- 172.21.15.49:0/2555992171 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fb7d0084260 con 0x7fb7dc0f7990 2024-02-22T00:33:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.643+0000 7fb7db7fe700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fb7c4066dc0 0x7fb7c4069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:43.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.644+0000 7fb7db7fe700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fb7c4066dc0 0x7fb7c4069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb7cc009bc0 tx=0x7fb7cc00b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:43.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.647+0000 7fb7d8f74700 1 -- 172.21.15.49:0/2555992171 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fb7d0052380 con 0x7fb7dc0f7990 2024-02-22T00:33:43.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.973+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7dc0fbbd0 con 0x7fb7c4066dc0 2024-02-22T00:33:43.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.975+0000 7fb7d8f74700 1 -- 172.21.15.49:0/2555992171 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb7dc0fbbd0 con 0x7fb7c4066dc0 2024-02-22T00:33:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fb7c4066dc0 msgr2=0x7fb7c4069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fb7c4066dc0 0x7fb7c4069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb7cc009bc0 tx=0x7fb7cc00b040).stop 2024-02-22T00:33:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7dc0f7990 msgr2=0x7fb7dc106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7dc0f7990 0x7fb7dc106350 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb7d00048a0 tx=0x7fb7d0009cb0).stop 2024-02-22T00:33:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 shutdown_connections 2024-02-22T00:33:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fb7c4066dc0 0x7fb7c4069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7dc0f66f0 0x7fb7dc105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 --2- 172.21.15.49:0/2555992171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7dc0f7990 0x7fb7dc106350 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 >> 172.21.15.49:0/2555992171 conn(0x7fb7dc0f1e50 msgr2=0x7fb7dc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 shutdown_connections 2024-02-22T00:33:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:43.977+0000 7fb7e1a90700 1 -- 172.21.15.49:0/2555992171 wait complete. 2024-02-22T00:33:44.034 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:33:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.083+0000 7f9e29a59700 1 -- 172.21.15.49:0/2657723748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 msgr2=0x7f9e240f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.083+0000 7f9e29a59700 1 --2- 172.21.15.49:0/2657723748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 0x7f9e240f7c20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9e140047f0 tx=0x7f9e14009cb0).stop 2024-02-22T00:33:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.083+0000 7f9e29a59700 1 -- 172.21.15.49:0/2657723748 shutdown_connections 2024-02-22T00:33:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.083+0000 7f9e29a59700 1 --2- 172.21.15.49:0/2657723748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e240f8aa0 0x7f9e240f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.083+0000 7f9e29a59700 1 --2- 172.21.15.49:0/2657723748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 0x7f9e240f7c20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.083+0000 7f9e29a59700 1 -- 172.21.15.49:0/2657723748 >> 172.21.15.49:0/2657723748 conn(0x7f9e240f2f80 msgr2=0x7f9e240f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:44.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.083+0000 7f9e29a59700 1 -- 172.21.15.49:0/2657723748 shutdown_connections 2024-02-22T00:33:44.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.083+0000 7f9e29a59700 1 -- 172.21.15.49:0/2657723748 wait complete. 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.084+0000 7f9e29a59700 1 Processor -- start 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.084+0000 7f9e29a59700 1 -- start start 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.084+0000 7f9e29a59700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 0x7f9e24108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.084+0000 7f9e29a59700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e240f8aa0 0x7f9e24108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.084+0000 7f9e29a59700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24108ae0 con 0x7f9e240f7800 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.084+0000 7f9e29a59700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24108c20 con 0x7f9e240f8aa0 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e22ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 0x7f9e24108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e22ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 0x7f9e24108040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44022/0 (socket says 172.21.15.49:44022) 2024-02-22T00:33:44.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e227fc700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e240f8aa0 0x7f9e24108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e22ffd700 1 -- 172.21.15.49:0/4211519795 learned_addr learned my addr 172.21.15.49:0/4211519795 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e227fc700 1 -- 172.21.15.49:0/4211519795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 msgr2=0x7f9e24108040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e227fc700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 0x7f9e24108040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e227fc700 1 -- 172.21.15.49:0/4211519795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e14005040 con 0x7f9e240f8aa0 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e227fc700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e240f8aa0 0x7f9e24108530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9e1800e870 tx=0x7f9e1800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e0bfff700 1 -- 172.21.15.49:0/4211519795 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e18007b40 con 0x7f9e240f8aa0 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e0bfff700 1 -- 172.21.15.49:0/4211519795 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e1800f040 con 0x7f9e240f8aa0 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e0bfff700 1 -- 172.21.15.49:0/4211519795 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e180147e0 con 0x7f9e240f8aa0 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2410d6c0 con 0x7f9e240f8aa0 2024-02-22T00:33:44.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.085+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2410dc80 con 0x7f9e240f8aa0 2024-02-22T00:33:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.086+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e240fffc0 con 0x7f9e240f8aa0 2024-02-22T00:33:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.087+0000 7f9e0bfff700 1 -- 172.21.15.49:0/4211519795 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f9e18007ca0 con 0x7f9e240f8aa0 2024-02-22T00:33:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.087+0000 7f9e0bfff700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9e0c066dc0 0x7f9e0c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.087+0000 7f9e0bfff700 1 -- 172.21.15.49:0/4211519795 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f9e18083d20 con 0x7f9e240f8aa0 2024-02-22T00:33:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.087+0000 7f9e22ffd700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9e0c066dc0 0x7f9e0c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:44.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.088+0000 7f9e22ffd700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9e0c066dc0 0x7f9e0c069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9e14004540 tx=0x7f9e1400b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:44.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.092+0000 7f9e0bfff700 1 -- 172.21.15.49:0/4211519795 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f9e18051e70 con 0x7f9e240f8aa0 2024-02-22T00:33:44.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.318+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e24059120 con 0x7f9e0c066dc0 2024-02-22T00:33:44.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.319+0000 7f9e0bfff700 1 -- 172.21.15.49:0/4211519795 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f9e24059120 con 0x7f9e0c066dc0 2024-02-22T00:33:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9e0c066dc0 msgr2=0x7f9e0c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9e0c066dc0 0x7f9e0c069280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f9e14004540 tx=0x7f9e1400b040).stop 2024-02-22T00:33:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e240f8aa0 msgr2=0x7f9e24108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e240f8aa0 0x7f9e24108530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9e1800e870 tx=0x7f9e1800b040).stop 2024-02-22T00:33:44.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 shutdown_connections 2024-02-22T00:33:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9e0c066dc0 0x7f9e0c069280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e240f7800 0x7f9e24108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 --2- 172.21.15.49:0/4211519795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e240f8aa0 0x7f9e24108530 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 >> 172.21.15.49:0/4211519795 conn(0x7f9e240f2f80 msgr2=0x7f9e240fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 shutdown_connections 2024-02-22T00:33:44.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.322+0000 7f9e29a59700 1 -- 172.21.15.49:0/4211519795 wait complete. 2024-02-22T00:33:44.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.445+0000 7f3bc8137700 1 -- 172.21.15.49:0/1895346524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 msgr2=0x7f3bc00f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.445+0000 7f3bc8137700 1 --2- 172.21.15.49:0/1895346524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 0x7f3bc00f7c20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f3bbc0047f0 tx=0x7f3bbc009cb0).stop 2024-02-22T00:33:44.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.445+0000 7f3bc8137700 1 -- 172.21.15.49:0/1895346524 shutdown_connections 2024-02-22T00:33:44.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.445+0000 7f3bc8137700 1 --2- 172.21.15.49:0/1895346524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc00f8aa0 0x7f3bc00f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.445+0000 7f3bc8137700 1 --2- 172.21.15.49:0/1895346524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 0x7f3bc00f7c20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.445+0000 7f3bc8137700 1 -- 172.21.15.49:0/1895346524 >> 172.21.15.49:0/1895346524 conn(0x7f3bc00f2f80 msgr2=0x7f3bc00f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:44.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.446+0000 7f3bc8137700 1 -- 172.21.15.49:0/1895346524 shutdown_connections 2024-02-22T00:33:44.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.446+0000 7f3bc8137700 1 -- 172.21.15.49:0/1895346524 wait complete. 2024-02-22T00:33:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.446+0000 7f3bc8137700 1 Processor -- start 2024-02-22T00:33:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.446+0000 7f3bc8137700 1 -- start start 2024-02-22T00:33:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc8137700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 0x7f3bc006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc8137700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc00f8aa0 0x7f3bc006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc8137700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc006cf80 con 0x7f3bc00f7800 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc8137700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc006b520 con 0x7f3bc00f8aa0 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc5ed3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 0x7f3bc006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc5ed3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 0x7f3bc006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44042/0 (socket says 172.21.15.49:44042) 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc5ed3700 1 -- 172.21.15.49:0/3145426208 learned_addr learned my addr 172.21.15.49:0/3145426208 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc56d2700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc00f8aa0 0x7f3bc006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc5ed3700 1 -- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc00f8aa0 msgr2=0x7f3bc006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc5ed3700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc00f8aa0 0x7f3bc006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc5ed3700 1 -- 172.21.15.49:0/3145426208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc005040 con 0x7f3bc00f7800 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc56d2700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc00f8aa0 0x7f3bc006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc5ed3700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 0x7f3bc006c9d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f3bbc004e60 tx=0x7f3bbc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bb6ffd700 1 -- 172.21.15.49:0/3145426208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bbc018070 con 0x7f3bc00f7800 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bb6ffd700 1 -- 172.21.15.49:0/3145426208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3bbc007e90 con 0x7f3bc00f7800 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc006b740 con 0x7f3bc00f7800 2024-02-22T00:33:44.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.447+0000 7f3bb6ffd700 1 -- 172.21.15.49:0/3145426208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bbc012400 con 0x7f3bc00f7800 2024-02-22T00:33:44.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.448+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc006bca0 con 0x7f3bc00f7800 2024-02-22T00:33:44.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.449+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc0047540 con 0x7f3bc00f7800 2024-02-22T00:33:44.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.449+0000 7f3bb6ffd700 1 -- 172.21.15.49:0/3145426208 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f3bbc01d420 con 0x7f3bc00f7800 2024-02-22T00:33:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.450+0000 7f3bb6ffd700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f3bac066e10 0x7f3bac0692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.450+0000 7f3bb6ffd700 1 -- 172.21.15.49:0/3145426208 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f3bbc0859d0 con 0x7f3bc00f7800 2024-02-22T00:33:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.450+0000 7f3bc56d2700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f3bac066e10 0x7f3bac0692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:44.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.450+0000 7f3bc56d2700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f3bac066e10 0x7f3bac0692d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3bb0007bf0 tx=0x7f3bb000b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:44.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.456+0000 7f3bb6ffd700 1 -- 172.21.15.49:0/3145426208 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f3bbc0539b0 con 0x7f3bc00f7800 2024-02-22T00:33:44.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.694+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bc0059120 con 0x7f3bac066e10 2024-02-22T00:33:44.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.709+0000 7f3bb6ffd700 1 -- 172.21.15.49:0/3145426208 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3bc0059120 con 0x7f3bac066e10 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (6m) 37s ago 8m 24.4M - 0.23.0 ba2b418f427c 05fc98ae8941 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (8m) 37s ago 8m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (7m) 39s ago 7m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (6m) 37s ago 7m 54.7M - 8.3.5 dad864ee21e9 d07a1ce3ae93 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (2m) 37s ago 2m 13.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (3m) 37s ago 3m 96.8M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (2m) 39s ago 2m 13.3M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:33:44.714 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (3m) 39s ago 3m 75.0M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:9283 running (9m) 37s ago 9m 182M - 16.2.14-550-geb66ed92 7403d1862307 c15a70e0a1be 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 running (65s) 39s ago 7m 483M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d128d026ba47 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 37s ago 9m 50.4M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (7m) 39s ago 7m 43.5M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (7m) 37s ago 7m 22.8M - 1.3.1 1dbe0e931976 22b6c923dd53 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (7m) 39s ago 7m 21.5M - 1.3.1 1dbe0e931976 3bd6815e682e 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 37s ago 6m 93.7M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6m) 37s ago 6m 103M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 37s ago 5m 85.9M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (5m) 39s ago 5m 102M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (4m) 39s ago 4m 96.4M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (4m) 39s ago 4m 90.7M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:33:44.715 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (7m) 39s ago 7m 60.3M - 2.33.4 514e6a882f6e 0880324bb723 2024-02-22T00:33:44.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.713+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f3bac066e10 msgr2=0x7f3bac0692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.713+0000 7f3bc8137700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f3bac066e10 0x7f3bac0692d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3bb0007bf0 tx=0x7f3bb000b040).stop 2024-02-22T00:33:44.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.713+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 msgr2=0x7f3bc006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.713+0000 7f3bc8137700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 0x7f3bc006c9d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f3bbc004e60 tx=0x7f3bbc009cb0).stop 2024-02-22T00:33:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.714+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 shutdown_connections 2024-02-22T00:33:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.714+0000 7f3bc8137700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f3bac066e10 0x7f3bac0692d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.714+0000 7f3bc8137700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bc00f7800 0x7f3bc006c9d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.714+0000 7f3bc8137700 1 --2- 172.21.15.49:0/3145426208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bc00f8aa0 0x7f3bc006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.714+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 >> 172.21.15.49:0/3145426208 conn(0x7f3bc00f2f80 msgr2=0x7f3bc00fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.714+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 shutdown_connections 2024-02-22T00:33:44.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.714+0000 7f3bc8137700 1 -- 172.21.15.49:0/3145426208 wait complete. 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1568381664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f7800 msgr2=0x7fbd940f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 --2- 172.21.15.49:0/1568381664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f7800 0x7fbd940f7c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fbd840047f0 tx=0x7fbd84009cb0).stop 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1568381664 shutdown_connections 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 --2- 172.21.15.49:0/1568381664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd940f8aa0 0x7fbd940f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 --2- 172.21.15.49:0/1568381664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f7800 0x7fbd940f7c20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1568381664 >> 172.21.15.49:0/1568381664 conn(0x7fbd940f2f80 msgr2=0x7fbd940f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1568381664 shutdown_connections 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1568381664 wait complete. 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 Processor -- start 2024-02-22T00:33:44.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.861+0000 7fbd9a5eb700 1 -- start start 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd9a5eb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd940f7800 0x7fbd9406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd9a5eb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f8aa0 0x7fbd9406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd9a5eb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9406cf80 con 0x7fbd940f8aa0 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd9a5eb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9406b520 con 0x7fbd940f7800 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f8aa0 0x7fbd9406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f8aa0 0x7fbd9406b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44070/0 (socket says 172.21.15.49:44070) 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd937fe700 1 -- 172.21.15.49:0/1661026501 learned_addr learned my addr 172.21.15.49:0/1661026501 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd93fff700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd940f7800 0x7fbd9406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd937fe700 1 -- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd940f7800 msgr2=0x7fbd9406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd937fe700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd940f7800 0x7fbd9406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd937fe700 1 -- 172.21.15.49:0/1661026501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd88005040 con 0x7fbd940f8aa0 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd93fff700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd940f7800 0x7fbd9406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd937fe700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f8aa0 0x7fbd9406b030 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fbd88004870 tx=0x7fbd88009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:44.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd917fa700 1 -- 172.21.15.49:0/1661026501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd8800e5e0 con 0x7fbd940f8aa0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd84005040 con 0x7fbd940f8aa0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd917fa700 1 -- 172.21.15.49:0/1661026501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd8800f040 con 0x7fbd940f8aa0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.862+0000 7fbd917fa700 1 -- 172.21.15.49:0/1661026501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd88014b30 con 0x7fbd940f8aa0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.863+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9406bbd0 con 0x7fbd940f8aa0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.863+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9406bdf0 con 0x7fbd940f8aa0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.864+0000 7fbd917fa700 1 -- 172.21.15.49:0/1661026501 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7fbd8800e740 con 0x7fbd940f8aa0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.864+0000 7fbd917fa700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fbd7c066dc0 0x7fbd7c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.864+0000 7fbd917fa700 1 -- 172.21.15.49:0/1661026501 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fbd88083f50 con 0x7fbd940f8aa0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.865+0000 7fbd93fff700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fbd7c066dc0 0x7fbd7c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.865+0000 7fbd93fff700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fbd7c066dc0 0x7fbd7c069280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fbd84004e60 tx=0x7fbd8400b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:44.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:44.869+0000 7fbd917fa700 1 -- 172.21.15.49:0/1661026501 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fbd88051f30 con 0x7fbd940f8aa0 2024-02-22T00:33:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.162+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbd94100120 con 0x7fbd940f8aa0 2024-02-22T00:33:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.163+0000 7fbd917fa700 1 -- 172.21.15.49:0/1661026501 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+858 (secure 0 0 0) 0x7fbd88051b20 con 0x7fbd940f8aa0 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1, 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:33:45.166 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:33:45.167 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:33:45.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:33:45.167 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:33:45.167 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 13, 2024-02-22T00:33:45.167 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:33:45.167 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:33:45.167 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fbd7c066dc0 msgr2=0x7fbd7c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fbd7c066dc0 0x7fbd7c069280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fbd84004e60 tx=0x7fbd8400b040).stop 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f8aa0 msgr2=0x7fbd9406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f8aa0 0x7fbd9406b030 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fbd88004870 tx=0x7fbd88009cb0).stop 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 shutdown_connections 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fbd7c066dc0 0x7fbd7c069280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd940f7800 0x7fbd9406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 --2- 172.21.15.49:0/1661026501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd940f8aa0 0x7fbd9406b030 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 >> 172.21.15.49:0/1661026501 conn(0x7fbd940f2f80 msgr2=0x7fbd940fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 shutdown_connections 2024-02-22T00:33:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.165+0000 7fbd9a5eb700 1 -- 172.21.15.49:0/1661026501 wait complete. 2024-02-22T00:33:45.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:43.762611+0000 mgr.smithi161.sazlam (mgr.24369) 50 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 1.4 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 26 MiB/s rd, 43 MiB/s wr, 181 op/s 2024-02-22T00:33:45.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:43.975625+0000 mgr.smithi161.sazlam (mgr.24369) 51 : audit [DBG] from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:45.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:43.762611+0000 mgr.smithi161.sazlam (mgr.24369) 50 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 1.4 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 26 MiB/s rd, 43 MiB/s wr, 181 op/s 2024-02-22T00:33:45.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:43.975625+0000 mgr.smithi161.sazlam (mgr.24369) 51 : audit [DBG] from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:45.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.289+0000 7f778213f700 1 -- 172.21.15.49:0/1239724594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 msgr2=0x7f777c0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.289+0000 7f778213f700 1 --2- 172.21.15.49:0/1239724594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 0x7f777c0fcda0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f77700047f0 tx=0x7f7770009cb0).stop 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.289+0000 7f778213f700 1 -- 172.21.15.49:0/1239724594 shutdown_connections 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.289+0000 7f778213f700 1 --2- 172.21.15.49:0/1239724594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 0x7f777c0fcda0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.289+0000 7f778213f700 1 --2- 172.21.15.49:0/1239724594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f777c061280 0x7f777c0fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.289+0000 7f778213f700 1 -- 172.21.15.49:0/1239724594 >> 172.21.15.49:0/1239724594 conn(0x7f777c0f1e50 msgr2=0x7f777c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.289+0000 7f778213f700 1 -- 172.21.15.49:0/1239724594 shutdown_connections 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.289+0000 7f778213f700 1 -- 172.21.15.49:0/1239724594 wait complete. 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.290+0000 7f778213f700 1 Processor -- start 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.290+0000 7f778213f700 1 -- start start 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.290+0000 7f778213f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f777c061280 0x7f777c0f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:45.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.290+0000 7f778213f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 0x7f777c0f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.290+0000 7f778213f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c0f8220 con 0x7f777c0fa950 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.290+0000 7f778213f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c0f67c0 con 0x7f777c061280 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f777affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 0x7f777c0f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f777affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 0x7f777c0f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44086/0 (socket says 172.21.15.49:44086) 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f777b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f777c061280 0x7f777c0f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f777affd700 1 -- 172.21.15.49:0/975219424 learned_addr learned my addr 172.21.15.49:0/975219424 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f777affd700 1 -- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f777c061280 msgr2=0x7f777c0f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f777affd700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f777c061280 0x7f777c0f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f777affd700 1 -- 172.21.15.49:0/975219424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770005040 con 0x7f777c0fa950 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f777affd700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 0x7f777c0f62d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f7770013560 tx=0x7f7770009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f7778ff9700 1 -- 172.21.15.49:0/975219424 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7770018070 con 0x7f777c0fa950 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f7778ff9700 1 -- 172.21.15.49:0/975219424 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7770007e90 con 0x7f777c0fa950 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f7778ff9700 1 -- 172.21.15.49:0/975219424 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f777001c380 con 0x7f777c0fa950 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c0f69e0 con 0x7f777c0fa950 2024-02-22T00:33:45.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.291+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c0f6f40 con 0x7f777c0fa950 2024-02-22T00:33:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.292+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777c047540 con 0x7f777c0fa950 2024-02-22T00:33:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.293+0000 7f7778ff9700 1 -- 172.21.15.49:0/975219424 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f77700123c0 con 0x7f777c0fa950 2024-02-22T00:33:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.293+0000 7f7778ff9700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f7764066dc0 0x7f7764069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:33:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.293+0000 7f7778ff9700 1 -- 172.21.15.49:0/975219424 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f77700850b0 con 0x7f777c0fa950 2024-02-22T00:33:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.293+0000 7f777b7fe700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f7764066dc0 0x7f7764069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:33:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.294+0000 7f777b7fe700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f7764066dc0 0x7f7764069280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f776c0048b0 tx=0x7f776c00b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:33:45.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.298+0000 7f7778ff9700 1 -- 172.21.15.49:0/975219424 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f7770053150 con 0x7f777c0fa950 2024-02-22T00:33:45.325 INFO:tasks.workunit.client.0.smithi049.stdout:3/5: sync 2024-02-22T00:33:45.326 INFO:tasks.workunit.client.0.smithi049.stdout:9/1: sync 2024-02-22T00:33:45.326 INFO:tasks.workunit.client.0.smithi049.stdout:1/13: sync 2024-02-22T00:33:45.326 INFO:tasks.workunit.client.0.smithi049.stdout:0/37: sync 2024-02-22T00:33:45.326 INFO:tasks.workunit.client.0.smithi049.stdout:0/38: dread - no filename 2024-02-22T00:33:45.326 INFO:tasks.workunit.client.0.smithi049.stdout:0/39: read - no filename 2024-02-22T00:33:45.326 INFO:tasks.workunit.client.0.smithi049.stdout:0/40: dwrite - no filename 2024-02-22T00:33:45.327 INFO:tasks.workunit.client.0.smithi049.stdout:1/14: stat d2/f3 0 2024-02-22T00:33:45.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/41: chown c0 25382 1 2024-02-22T00:33:45.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/42: truncate - no filename 2024-02-22T00:33:45.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/43: write - no filename 2024-02-22T00:33:45.329 INFO:tasks.workunit.client.0.smithi049.stdout:9/2: rename f0 to f1 0 2024-02-22T00:33:45.329 INFO:tasks.workunit.client.0.smithi049.stdout:1/15: read - d2/f4 zero size 2024-02-22T00:33:45.330 INFO:tasks.workunit.client.0.smithi049.stdout:0/44: creat d3/d6/f9 x:0 0 0 2024-02-22T00:33:45.331 INFO:tasks.workunit.client.0.smithi049.stdout:9/3: creat f2 x:0 0 0 2024-02-22T00:33:45.332 INFO:tasks.workunit.client.0.smithi049.stdout:1/16: rename d2/c5 to d2/c7 0 2024-02-22T00:33:45.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/45: unlink c1 0 2024-02-22T00:33:45.333 INFO:tasks.workunit.client.0.smithi049.stdout:9/4: symlink l3 0 2024-02-22T00:33:45.334 INFO:tasks.workunit.client.0.smithi049.stdout:0/46: write d3/d6/f9 [542271,72936] 0 2024-02-22T00:33:45.559 INFO:tasks.workunit.client.0.smithi049.stdout:9/5: unlink l3 0 2024-02-22T00:33:45.559 INFO:tasks.workunit.client.0.smithi049.stdout:1/17: rmdir d2 39 2024-02-22T00:33:45.560 INFO:tasks.workunit.client.0.smithi049.stdout:9/6: dread - f1 zero size 2024-02-22T00:33:45.561 INFO:tasks.workunit.client.0.smithi049.stdout:0/47: symlink d3/d6/d8/la 0 2024-02-22T00:33:45.562 INFO:tasks.workunit.client.0.smithi049.stdout:1/18: mkdir d2/d8 0 2024-02-22T00:33:45.563 INFO:tasks.workunit.client.0.smithi049.stdout:0/48: read d3/d6/f9 [4323,39018] 0 2024-02-22T00:33:45.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/7: link f2 f4 0 2024-02-22T00:33:45.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/8: chown f2 42264729 1 2024-02-22T00:33:45.568 INFO:tasks.workunit.client.0.smithi049.stdout:0/49: mknod d3/d6/cb 0 2024-02-22T00:33:45.568 INFO:tasks.workunit.client.0.smithi049.stdout:1/19: creat d2/d8/f9 x:0 0 0 2024-02-22T00:33:45.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/9: mknod c5 0 2024-02-22T00:33:45.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/10: chown f2 4 1 2024-02-22T00:33:45.569 INFO:tasks.workunit.client.0.smithi049.stdout:9/11: symlink l6 0 2024-02-22T00:33:45.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/12: fsync f1 0 2024-02-22T00:33:45.574 INFO:tasks.workunit.client.0.smithi049.stdout:9/13: unlink f2 0 2024-02-22T00:33:45.576 INFO:tasks.workunit.client.0.smithi049.stdout:0/50: dwrite d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:45.577 INFO:tasks.workunit.client.0.smithi049.stdout:9/14: creat f7 x:0 0 0 2024-02-22T00:33:45.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/15: rename f1 to f8 0 2024-02-22T00:33:45.588 INFO:tasks.workunit.client.0.smithi049.stdout:1/20: dwrite d2/f3 [0,4194304] 0 2024-02-22T00:33:45.591 INFO:tasks.workunit.client.0.smithi049.stdout:0/51: dwrite d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:45.595 INFO:tasks.workunit.client.0.smithi049.stdout:0/52: mknod d3/cc 0 2024-02-22T00:33:45.595 INFO:tasks.workunit.client.0.smithi049.stdout:1/21: dread d2/f3 [0,4194304] 0 2024-02-22T00:33:45.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/22: mkdir d2/d8/da 0 2024-02-22T00:33:45.602 INFO:tasks.workunit.client.0.smithi049.stdout:9/16: chown f4 6 1 2024-02-22T00:33:45.602 INFO:tasks.workunit.client.0.smithi049.stdout:9/17: dread - f4 zero size 2024-02-22T00:33:45.604 INFO:tasks.workunit.client.0.smithi049.stdout:9/18: chown f4 1517881 1 2024-02-22T00:33:45.605 INFO:tasks.workunit.client.0.smithi049.stdout:9/19: dread - f4 zero size 2024-02-22T00:33:45.606 INFO:tasks.workunit.client.0.smithi049.stdout:0/53: dwrite d3/d6/f9 [4194304,4194304] 0 2024-02-22T00:33:45.609 INFO:tasks.workunit.client.0.smithi049.stdout:1/23: mkdir d2/d8/db 0 2024-02-22T00:33:45.610 INFO:tasks.workunit.client.0.smithi049.stdout:1/24: chown d2/d8/da 315 1 2024-02-22T00:33:45.615 INFO:tasks.workunit.client.0.smithi049.stdout:0/54: dread d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:45.615 INFO:tasks.workunit.client.0.smithi049.stdout:9/20: creat f9 x:0 0 0 2024-02-22T00:33:45.616 INFO:tasks.workunit.client.0.smithi049.stdout:0/55: read d3/d6/f9 [2488548,74545] 0 2024-02-22T00:33:45.618 INFO:tasks.workunit.client.0.smithi049.stdout:9/21: mknod ca 0 2024-02-22T00:33:45.620 INFO:tasks.workunit.client.0.smithi049.stdout:9/22: write f7 [356000,128539] 0 2024-02-22T00:33:45.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/56: link l2 d3/d6/d8/ld 0 2024-02-22T00:33:45.621 INFO:tasks.workunit.client.0.smithi049.stdout:5/13: sync 2024-02-22T00:33:45.621 INFO:tasks.workunit.client.0.smithi049.stdout:2/12: sync 2024-02-22T00:33:45.622 INFO:tasks.workunit.client.0.smithi049.stdout:9/23: mknod cb 0 2024-02-22T00:33:45.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.620+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f777c102010 con 0x7f7764066dc0 2024-02-22T00:33:45.624 INFO:tasks.workunit.client.0.smithi049.stdout:5/14: read - d0/f4 zero size 2024-02-22T00:33:45.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.622+0000 7f7778ff9700 1 -- 172.21.15.49:0/975219424 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f776c00f040 con 0x7f7764066dc0 2024-02-22T00:33:45.625 INFO:tasks.workunit.client.0.smithi049.stdout:2/13: creat d2/f4 x:0 0 0 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "1/2 daemons upgraded", 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:33:45.626 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f7764066dc0 msgr2=0x7f7764069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f7764066dc0 0x7f7764069280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f776c0048b0 tx=0x7f776c00b040).stop 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 msgr2=0x7f777c0f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 0x7f777c0f62d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f7770013560 tx=0x7f7770009cb0).stop 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 shutdown_connections 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f7764066dc0 0x7f7764069280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f777c061280 0x7f777c0f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 --2- 172.21.15.49:0/975219424 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f777c0fa950 0x7f777c0f62d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:33:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.625+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 >> 172.21.15.49:0/975219424 conn(0x7f777c0f1e50 msgr2=0x7f777c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:33:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.626+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 shutdown_connections 2024-02-22T00:33:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:33:45.626+0000 7f778213f700 1 -- 172.21.15.49:0/975219424 wait complete. 2024-02-22T00:33:45.630 INFO:tasks.workunit.client.0.smithi049.stdout:5/15: getdents d0/d1 0 2024-02-22T00:33:45.632 INFO:tasks.workunit.client.0.smithi049.stdout:5/16: chown d0 26 1 2024-02-22T00:33:45.646 INFO:tasks.workunit.client.0.smithi049.stdout:5/17: getdents d0/d1 0 2024-02-22T00:33:45.647 INFO:tasks.workunit.client.0.smithi049.stdout:0/57: dwrite d3/d6/f9 [4194304,4194304] 0 2024-02-22T00:33:45.652 INFO:tasks.workunit.client.0.smithi049.stdout:9/24: dwrite f7 [0,4194304] 0 2024-02-22T00:33:45.652 INFO:tasks.workunit.client.0.smithi049.stdout:1/25: dwrite d2/f4 [0,4194304] 0 2024-02-22T00:33:45.656 INFO:tasks.workunit.client.0.smithi049.stdout:9/25: dread - f8 zero size 2024-02-22T00:33:45.657 INFO:tasks.workunit.client.0.smithi049.stdout:1/26: dread - d2/d8/f9 zero size 2024-02-22T00:33:45.658 INFO:tasks.workunit.client.0.smithi049.stdout:2/14: dwrite d2/f4 [0,4194304] 0 2024-02-22T00:33:45.658 INFO:tasks.workunit.client.0.smithi049.stdout:1/27: chown d2 138200552 1 2024-02-22T00:33:45.659 INFO:tasks.workunit.client.0.smithi049.stdout:5/18: mkdir d0/d1/d6 0 2024-02-22T00:33:45.661 INFO:tasks.workunit.client.0.smithi049.stdout:9/26: unlink f9 0 2024-02-22T00:33:45.661 INFO:tasks.workunit.client.0.smithi049.stdout:1/28: rename d2/d8/db to d2/d8/db/dc 22 2024-02-22T00:33:45.663 INFO:tasks.workunit.client.0.smithi049.stdout:1/29: read d2/f3 [2197156,37994] 0 2024-02-22T00:33:45.663 INFO:tasks.workunit.client.0.smithi049.stdout:2/15: mknod d2/c5 0 2024-02-22T00:33:45.663 INFO:tasks.workunit.client.0.smithi049.stdout:1/30: chown d2/d8/f9 303186 1 2024-02-22T00:33:45.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/16: creat d2/f6 x:0 0 0 2024-02-22T00:33:45.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/27: creat fc x:0 0 0 2024-02-22T00:33:45.669 INFO:tasks.workunit.client.0.smithi049.stdout:2/17: write d2/f6 [517756,75974] 0 2024-02-22T00:33:45.672 INFO:tasks.workunit.client.0.smithi049.stdout:2/18: creat d2/f7 x:0 0 0 2024-02-22T00:33:45.673 INFO:tasks.workunit.client.0.smithi049.stdout:9/28: mknod cd 0 2024-02-22T00:33:45.674 INFO:tasks.workunit.client.0.smithi049.stdout:2/19: write d2/f4 [1822653,94102] 0 2024-02-22T00:33:45.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/29: readlink l6 0 2024-02-22T00:33:45.680 INFO:tasks.workunit.client.0.smithi049.stdout:9/30: dread - fc zero size 2024-02-22T00:33:45.681 INFO:tasks.workunit.client.0.smithi049.stdout:5/19: write d0/f4 [8649,116510] 0 2024-02-22T00:33:45.681 INFO:tasks.workunit.client.0.smithi049.stdout:0/58: truncate d3/d6/f9 996065 0 2024-02-22T00:33:45.686 INFO:tasks.workunit.client.0.smithi049.stdout:5/20: truncate d0/f4 825210 0 2024-02-22T00:33:45.686 INFO:tasks.workunit.client.0.smithi049.stdout:2/20: dread d2/f6 [0,4194304] 0 2024-02-22T00:33:45.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/21: write d2/f7 [384023,95140] 0 2024-02-22T00:33:45.689 INFO:tasks.workunit.client.0.smithi049.stdout:9/31: symlink le 0 2024-02-22T00:33:45.694 INFO:tasks.workunit.client.0.smithi049.stdout:2/22: symlink d2/l8 0 2024-02-22T00:33:45.695 INFO:tasks.workunit.client.0.smithi049.stdout:9/32: truncate f8 257670 0 2024-02-22T00:33:45.702 INFO:tasks.workunit.client.0.smithi049.stdout:5/21: symlink d0/d1/d6/l7 0 2024-02-22T00:33:45.702 INFO:tasks.workunit.client.0.smithi049.stdout:2/23: unlink d2/c5 0 2024-02-22T00:33:45.703 INFO:tasks.workunit.client.0.smithi049.stdout:2/24: mkdir d2/d9 0 2024-02-22T00:33:45.708 INFO:tasks.workunit.client.0.smithi049.stdout:9/33: mknod cf 0 2024-02-22T00:33:45.708 INFO:tasks.workunit.client.0.smithi049.stdout:5/22: dread d0/f4 [0,4194304] 0 2024-02-22T00:33:45.708 INFO:tasks.workunit.client.0.smithi049.stdout:2/25: creat d2/d9/fa x:0 0 0 2024-02-22T00:33:45.710 INFO:tasks.workunit.client.0.smithi049.stdout:5/23: creat d0/f8 x:0 0 0 2024-02-22T00:33:45.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/26: dread d2/f6 [0,4194304] 0 2024-02-22T00:33:45.714 INFO:tasks.workunit.client.0.smithi049.stdout:9/34: creat f10 x:0 0 0 2024-02-22T00:33:45.715 INFO:tasks.workunit.client.0.smithi049.stdout:5/24: symlink d0/l9 0 2024-02-22T00:33:45.719 INFO:tasks.workunit.client.0.smithi049.stdout:9/35: truncate f10 514707 0 2024-02-22T00:33:45.722 INFO:tasks.workunit.client.0.smithi049.stdout:9/36: truncate f10 896236 0 2024-02-22T00:33:45.727 INFO:tasks.workunit.client.0.smithi049.stdout:2/27: dwrite d2/d9/fa [0,4194304] 0 2024-02-22T00:33:45.732 INFO:tasks.workunit.client.0.smithi049.stdout:0/59: dwrite d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:45.734 INFO:tasks.workunit.client.0.smithi049.stdout:9/37: rename f7 to f11 0 2024-02-22T00:33:45.736 INFO:tasks.workunit.client.0.smithi049.stdout:2/28: mknod d2/cb 0 2024-02-22T00:33:45.739 INFO:tasks.workunit.client.0.smithi049.stdout:0/60: write d3/d6/f9 [2690470,40305] 0 2024-02-22T00:33:45.741 INFO:tasks.workunit.client.0.smithi049.stdout:2/29: read d2/f6 [539547,83859] 0 2024-02-22T00:33:45.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/25: dwrite d0/f4 [0,4194304] 0 2024-02-22T00:33:45.744 INFO:tasks.workunit.client.0.smithi049.stdout:9/38: rename fc to f12 0 2024-02-22T00:33:45.744 INFO:tasks.workunit.client.0.smithi049.stdout:5/26: truncate d0/f4 4752236 0 2024-02-22T00:33:45.752 INFO:tasks.workunit.client.0.smithi049.stdout:2/30: symlink d2/lc 0 2024-02-22T00:33:45.753 INFO:tasks.workunit.client.0.smithi049.stdout:9/39: write f12 [976774,80947] 0 2024-02-22T00:33:45.755 INFO:tasks.workunit.client.0.smithi049.stdout:0/61: rename l2 to d3/d6/d8/le 0 2024-02-22T00:33:45.756 INFO:tasks.workunit.client.0.smithi049.stdout:2/31: mkdir d2/d9/dd 0 2024-02-22T00:33:45.757 INFO:tasks.workunit.client.0.smithi049.stdout:9/40: chown f8 2119502403 1 2024-02-22T00:33:45.759 INFO:tasks.workunit.client.0.smithi049.stdout:5/27: rename d0/f4 to d0/d1/d6/fa 0 2024-02-22T00:33:45.760 INFO:tasks.workunit.client.0.smithi049.stdout:9/41: dread - f4 zero size 2024-02-22T00:33:45.762 INFO:tasks.workunit.client.0.smithi049.stdout:5/28: creat d0/d1/fb x:0 0 0 2024-02-22T00:33:45.763 INFO:tasks.workunit.client.0.smithi049.stdout:5/29: chown d0/d1 1207 1 2024-02-22T00:33:45.763 INFO:tasks.workunit.client.0.smithi049.stdout:9/42: unlink cd 0 2024-02-22T00:33:45.763 INFO:tasks.workunit.client.0.smithi049.stdout:9/43: rmdir - no directory 2024-02-22T00:33:45.763 INFO:tasks.workunit.client.0.smithi049.stdout:9/44: rmdir - no directory 2024-02-22T00:33:45.764 INFO:tasks.workunit.client.0.smithi049.stdout:2/32: getdents d2/d9/dd 0 2024-02-22T00:33:45.767 INFO:tasks.workunit.client.0.smithi049.stdout:5/30: rename d0/f8 to d0/d1/fc 0 2024-02-22T00:33:45.767 INFO:tasks.workunit.client.0.smithi049.stdout:0/62: fsync d3/d6/f9 0 2024-02-22T00:33:45.768 INFO:tasks.workunit.client.0.smithi049.stdout:2/33: mkdir d2/d9/de 0 2024-02-22T00:33:45.769 INFO:tasks.workunit.client.0.smithi049.stdout:2/34: stat d2/d9/de 0 2024-02-22T00:33:45.769 INFO:tasks.workunit.client.0.smithi049.stdout:9/45: creat f13 x:0 0 0 2024-02-22T00:33:45.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/35: chown d2/f7 1112 1 2024-02-22T00:33:45.772 INFO:tasks.workunit.client.0.smithi049.stdout:5/31: write d0/d1/fc [961117,116868] 0 2024-02-22T00:33:45.772 INFO:tasks.workunit.client.0.smithi049.stdout:0/63: mkdir d3/df 0 2024-02-22T00:33:45.786 INFO:tasks.workunit.client.0.smithi049.stdout:0/64: dwrite d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:45.788 INFO:tasks.workunit.client.0.smithi049.stdout:2/36: dread d2/d9/fa [0,4194304] 0 2024-02-22T00:33:45.799 INFO:tasks.workunit.client.0.smithi049.stdout:2/37: creat d2/d9/dd/ff x:0 0 0 2024-02-22T00:33:45.800 INFO:tasks.workunit.client.0.smithi049.stdout:9/46: getdents . 0 2024-02-22T00:33:45.801 INFO:tasks.workunit.client.0.smithi049.stdout:0/65: dread d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:45.802 INFO:tasks.workunit.client.0.smithi049.stdout:9/47: write f11 [754544,10378] 0 2024-02-22T00:33:45.804 INFO:tasks.workunit.client.0.smithi049.stdout:2/38: chown d2/f7 1 1 2024-02-22T00:33:45.805 INFO:tasks.workunit.client.0.smithi049.stdout:9/48: creat f14 x:0 0 0 2024-02-22T00:33:45.805 INFO:tasks.workunit.client.0.smithi049.stdout:2/39: chown d2/l3 0 1 2024-02-22T00:33:45.806 INFO:tasks.workunit.client.0.smithi049.stdout:0/66: write d3/d6/f9 [5033957,47659] 0 2024-02-22T00:33:45.809 INFO:tasks.workunit.client.0.smithi049.stdout:5/32: truncate d0/d1/d6/fa 1900743 0 2024-02-22T00:33:45.811 INFO:tasks.workunit.client.0.smithi049.stdout:5/33: write d0/d1/fc [2053542,129459] 0 2024-02-22T00:33:45.812 INFO:tasks.workunit.client.0.smithi049.stdout:2/40: mkdir d2/d9/de/d10 0 2024-02-22T00:33:45.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/67: dread d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:45.820 INFO:tasks.workunit.client.0.smithi049.stdout:2/41: link d2/d9/fa d2/f11 0 2024-02-22T00:33:45.820 INFO:tasks.workunit.client.0.smithi049.stdout:6/70: sync 2024-02-22T00:33:45.820 INFO:tasks.workunit.client.0.smithi049.stdout:4/39: sync 2024-02-22T00:33:45.823 INFO:tasks.workunit.client.0.smithi049.stdout:2/42: chown d2/cb 3 1 2024-02-22T00:33:45.824 INFO:tasks.workunit.client.0.smithi049.stdout:9/49: rename c5 to c15 0 2024-02-22T00:33:45.827 INFO:tasks.workunit.client.0.smithi049.stdout:4/40: creat d3/fb x:0 0 0 2024-02-22T00:33:45.827 INFO:tasks.workunit.client.0.smithi049.stdout:0/68: dread d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:45.835 INFO:tasks.workunit.client.0.smithi049.stdout:9/50: mknod c16 0 2024-02-22T00:33:45.836 INFO:tasks.workunit.client.0.smithi049.stdout:2/43: creat d2/d9/de/d10/f12 x:0 0 0 2024-02-22T00:33:45.837 INFO:tasks.workunit.client.0.smithi049.stdout:6/71: write d3/f8 [1128798,88749] 0 2024-02-22T00:33:45.838 INFO:tasks.workunit.client.0.smithi049.stdout:0/69: mknod d3/df/c10 0 2024-02-22T00:33:45.841 INFO:tasks.workunit.client.0.smithi049.stdout:9/51: chown cb 386 1 2024-02-22T00:33:45.841 INFO:tasks.workunit.client.0.smithi049.stdout:4/41: getdents d3/d8 0 2024-02-22T00:33:45.841 INFO:tasks.workunit.client.0.smithi049.stdout:5/34: dwrite d0/d1/d6/fa [0,4194304] 0 2024-02-22T00:33:45.842 INFO:tasks.workunit.client.0.smithi049.stdout:6/72: chown d3/f6 105262 1 2024-02-22T00:33:45.843 INFO:tasks.workunit.client.0.smithi049.stdout:5/35: write d0/d1/d6/fa [2711059,129052] 0 2024-02-22T00:33:45.844 INFO:tasks.workunit.client.0.smithi049.stdout:2/44: symlink d2/d9/de/d10/l13 0 2024-02-22T00:33:45.845 INFO:tasks.workunit.client.0.smithi049.stdout:0/70: write d3/d6/f9 [5660909,4886] 0 2024-02-22T00:33:45.853 INFO:tasks.workunit.client.0.smithi049.stdout:9/52: dread - f13 zero size 2024-02-22T00:33:45.855 INFO:tasks.workunit.client.0.smithi049.stdout:5/36: link d0/d1/fb d0/d1/d6/fd 0 2024-02-22T00:33:45.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/42: truncate f1 548995 0 2024-02-22T00:33:45.858 INFO:tasks.workunit.client.0.smithi049.stdout:6/73: creat d3/f15 x:0 0 0 2024-02-22T00:33:45.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/71: dread d3/d6/f9 [4194304,4194304] 0 2024-02-22T00:33:45.859 INFO:tasks.workunit.client.0.smithi049.stdout:4/43: readlink d3/d8/l9 0 2024-02-22T00:33:45.862 INFO:tasks.workunit.client.0.smithi049.stdout:6/74: mkdir d3/d16 0 2024-02-22T00:33:45.863 INFO:tasks.workunit.client.0.smithi049.stdout:5/37: write d0/d1/d6/fa [3184847,67425] 0 2024-02-22T00:33:45.864 INFO:tasks.workunit.client.0.smithi049.stdout:4/44: creat d3/d8/fc x:0 0 0 2024-02-22T00:33:45.865 INFO:tasks.workunit.client.0.smithi049.stdout:0/72: chown d3/d6/d8/la 0 1 2024-02-22T00:33:45.870 INFO:tasks.workunit.client.0.smithi049.stdout:9/53: dwrite f14 [0,4194304] 0 2024-02-22T00:33:45.871 INFO:tasks.workunit.client.0.smithi049.stdout:2/45: dwrite d2/f11 [4194304,4194304] 0 2024-02-22T00:33:45.872 INFO:tasks.workunit.client.0.smithi049.stdout:6/75: dread d3/f8 [0,4194304] 0 2024-02-22T00:33:45.872 INFO:tasks.workunit.client.0.smithi049.stdout:4/45: creat d3/d8/fd x:0 0 0 2024-02-22T00:33:45.873 INFO:tasks.workunit.client.0.smithi049.stdout:5/38: unlink d0/d1/d6/fa 0 2024-02-22T00:33:45.874 INFO:tasks.workunit.client.0.smithi049.stdout:0/73: creat d3/df/f11 x:0 0 0 2024-02-22T00:33:45.880 INFO:tasks.workunit.client.0.smithi049.stdout:4/46: symlink d3/le 0 2024-02-22T00:33:45.883 INFO:tasks.workunit.client.0.smithi049.stdout:0/74: write d3/d6/f9 [1698609,108983] 0 2024-02-22T00:33:45.886 INFO:tasks.workunit.client.0.smithi049.stdout:5/39: rename d0/d1 to d0/de 0 2024-02-22T00:33:45.887 INFO:tasks.workunit.client.0.smithi049.stdout:9/54: mkdir d17 0 2024-02-22T00:33:45.889 INFO:tasks.workunit.client.0.smithi049.stdout:6/76: unlink d3/fa 0 2024-02-22T00:33:45.893 INFO:tasks.workunit.client.0.smithi049.stdout:0/75: symlink d3/l12 0 2024-02-22T00:33:45.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/40: mknod d0/de/d6/cf 0 2024-02-22T00:33:45.894 INFO:tasks.workunit.client.0.smithi049.stdout:5/41: fdatasync d0/de/fc 0 2024-02-22T00:33:45.895 INFO:tasks.workunit.client.0.smithi049.stdout:2/46: link d2/cb d2/d9/dd/c14 0 2024-02-22T00:33:45.895 INFO:tasks.workunit.client.0.smithi049.stdout:0/76: chown d3/d6/d8/ld 14768 1 2024-02-22T00:33:45.896 INFO:tasks.workunit.client.0.smithi049.stdout:9/55: creat d17/f18 x:0 0 0 2024-02-22T00:33:45.896 INFO:tasks.workunit.client.0.smithi049.stdout:0/77: readlink d3/l12 0 2024-02-22T00:33:45.897 INFO:tasks.workunit.client.0.smithi049.stdout:6/77: fsync d3/f10 0 2024-02-22T00:33:45.899 INFO:tasks.workunit.client.0.smithi049.stdout:5/42: mknod d0/c10 0 2024-02-22T00:33:45.900 INFO:tasks.workunit.client.0.smithi049.stdout:9/56: mknod d17/c19 0 2024-02-22T00:33:45.901 INFO:tasks.workunit.client.0.smithi049.stdout:5/43: dread - d0/de/fb zero size 2024-02-22T00:33:45.902 INFO:tasks.workunit.client.0.smithi049.stdout:0/78: creat d3/f13 x:0 0 0 2024-02-22T00:33:45.904 INFO:tasks.workunit.client.0.smithi049.stdout:6/78: readlink d3/l9 0 2024-02-22T00:33:45.905 INFO:tasks.workunit.client.0.smithi049.stdout:0/79: read - d3/df/f11 zero size 2024-02-22T00:33:45.906 INFO:tasks.workunit.client.0.smithi049.stdout:5/44: readlink d0/de/d6/l7 0 2024-02-22T00:33:45.907 INFO:tasks.workunit.client.0.smithi049.stdout:2/47: dwrite d2/d9/dd/ff [0,4194304] 0 2024-02-22T00:33:45.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/79: mknod d3/c17 0 2024-02-22T00:33:45.915 INFO:tasks.workunit.client.0.smithi049.stdout:2/48: mkdir d2/d9/de/d15 0 2024-02-22T00:33:45.915 INFO:tasks.workunit.client.0.smithi049.stdout:6/80: dread - d3/f10 zero size 2024-02-22T00:33:45.917 INFO:tasks.workunit.client.0.smithi049.stdout:9/57: dwrite d17/f18 [0,4194304] 0 2024-02-22T00:33:45.919 INFO:tasks.workunit.client.0.smithi049.stdout:0/80: link d3/cc d3/d6/d8/c14 0 2024-02-22T00:33:45.924 INFO:tasks.workunit.client.0.smithi049.stdout:4/47: dwrite f2 [0,4194304] 0 2024-02-22T00:33:45.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/81: mknod d3/c15 0 2024-02-22T00:33:45.925 INFO:tasks.workunit.client.0.smithi049.stdout:4/48: write d3/d8/fc [254906,63194] 0 2024-02-22T00:33:45.925 INFO:tasks.workunit.client.0.smithi049.stdout:9/58: unlink c15 0 2024-02-22T00:33:45.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/82: rmdir d3/d6 39 2024-02-22T00:33:45.929 INFO:tasks.workunit.client.0.smithi049.stdout:4/49: symlink d3/lf 0 2024-02-22T00:33:45.931 INFO:tasks.workunit.client.0.smithi049.stdout:9/59: creat d17/f1a x:0 0 0 2024-02-22T00:33:45.931 INFO:tasks.workunit.client.0.smithi049.stdout:0/83: chown d3/f13 3285 1 2024-02-22T00:33:45.933 INFO:tasks.workunit.client.0.smithi049.stdout:4/50: mkdir d3/d8/d10 0 2024-02-22T00:33:45.934 INFO:tasks.workunit.client.0.smithi049.stdout:2/49: getdents d2/d9/de/d10 0 2024-02-22T00:33:45.937 INFO:tasks.workunit.client.0.smithi049.stdout:6/81: dwrite d3/fb [0,4194304] 0 2024-02-22T00:33:45.937 INFO:tasks.workunit.client.0.smithi049.stdout:9/60: symlink d17/l1b 0 2024-02-22T00:33:45.937 INFO:tasks.workunit.client.0.smithi049.stdout:4/51: write d3/d8/fd [957748,100162] 0 2024-02-22T00:33:45.946 INFO:tasks.workunit.client.0.smithi049.stdout:0/84: link d3/d6/f9 d3/df/f16 0 2024-02-22T00:33:45.947 INFO:tasks.workunit.client.0.smithi049.stdout:4/52: creat d3/d8/d10/f11 x:0 0 0 2024-02-22T00:33:45.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/82: unlink d3/f12 0 2024-02-22T00:33:45.953 INFO:tasks.workunit.client.0.smithi049.stdout:0/85: rmdir d3/d6/d8 39 2024-02-22T00:33:45.956 INFO:tasks.workunit.client.0.smithi049.stdout:6/83: creat d3/f18 x:0 0 0 2024-02-22T00:33:45.957 INFO:tasks.workunit.client.0.smithi049.stdout:0/86: mkdir d3/df/d17 0 2024-02-22T00:33:45.957 INFO:tasks.workunit.client.0.smithi049.stdout:2/50: dwrite d2/d9/de/d10/f12 [0,4194304] 0 2024-02-22T00:33:45.959 INFO:tasks.workunit.client.0.smithi049.stdout:9/61: dwrite f13 [0,4194304] 0 2024-02-22T00:33:45.967 INFO:tasks.workunit.client.0.smithi049.stdout:9/62: mkdir d17/d1c 0 2024-02-22T00:33:45.968 INFO:tasks.workunit.client.0.smithi049.stdout:6/84: creat d3/d16/f19 x:0 0 0 2024-02-22T00:33:45.969 INFO:tasks.workunit.client.0.smithi049.stdout:2/51: creat d2/d9/de/d15/f16 x:0 0 0 2024-02-22T00:33:45.970 INFO:tasks.workunit.client.0.smithi049.stdout:4/53: dwrite d3/d8/fd [0,4194304] 0 2024-02-22T00:33:45.970 INFO:tasks.workunit.client.0.smithi049.stdout:0/87: mknod d3/d6/c18 0 2024-02-22T00:33:45.971 INFO:tasks.workunit.client.0.smithi049.stdout:4/54: readlink d3/d8/la 0 2024-02-22T00:33:45.971 INFO:tasks.workunit.client.0.smithi049.stdout:9/63: mknod d17/c1d 0 2024-02-22T00:33:45.972 INFO:tasks.workunit.client.0.smithi049.stdout:9/64: read f13 [3201870,121911] 0 2024-02-22T00:33:45.975 INFO:tasks.workunit.client.0.smithi049.stdout:4/55: mkdir d3/d8/d10/d12 0 2024-02-22T00:33:45.977 INFO:tasks.workunit.client.0.smithi049.stdout:0/88: mknod d3/d6/d8/c19 0 2024-02-22T00:33:45.978 INFO:tasks.workunit.client.0.smithi049.stdout:6/85: creat d3/f1a x:0 0 0 2024-02-22T00:33:45.980 INFO:tasks.workunit.client.0.smithi049.stdout:4/56: unlink d3/d8/l9 0 2024-02-22T00:33:45.981 INFO:tasks.workunit.client.0.smithi049.stdout:0/89: dread d3/d6/f9 [4194304,4194304] 0 2024-02-22T00:33:45.982 INFO:tasks.workunit.client.0.smithi049.stdout:9/65: creat d17/d1c/f1e x:0 0 0 2024-02-22T00:33:45.983 INFO:tasks.workunit.client.0.smithi049.stdout:0/90: write d3/f13 [403867,71500] 0 2024-02-22T00:33:45.986 INFO:tasks.workunit.client.0.smithi049.stdout:2/52: rmdir d2 39 2024-02-22T00:33:45.987 INFO:tasks.workunit.client.0.smithi049.stdout:9/66: creat d17/f1f x:0 0 0 2024-02-22T00:33:45.988 INFO:tasks.workunit.client.0.smithi049.stdout:4/57: truncate f1 328303 0 2024-02-22T00:33:45.989 INFO:tasks.workunit.client.0.smithi049.stdout:0/91: readlink d3/l7 0 2024-02-22T00:33:45.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/86: creat d3/f1b x:0 0 0 2024-02-22T00:33:45.993 INFO:tasks.workunit.client.0.smithi049.stdout:4/58: fdatasync d3/d8/fd 0 2024-02-22T00:33:45.994 INFO:tasks.workunit.client.0.smithi049.stdout:2/53: mkdir d2/d9/d17 0 2024-02-22T00:33:45.996 INFO:tasks.workunit.client.0.smithi049.stdout:6/87: creat d3/d16/f1c x:0 0 0 2024-02-22T00:33:45.998 INFO:tasks.workunit.client.0.smithi049.stdout:0/92: truncate d3/d6/f9 5263664 0 2024-02-22T00:33:46.000 INFO:tasks.workunit.client.0.smithi049.stdout:9/67: dwrite d17/d1c/f1e [0,4194304] 0 2024-02-22T00:33:46.002 INFO:tasks.workunit.client.0.smithi049.stdout:2/54: creat d2/d9/d17/f18 x:0 0 0 2024-02-22T00:33:46.003 INFO:tasks.workunit.client.0.smithi049.stdout:0/93: rmdir d3/d6 39 2024-02-22T00:33:46.004 INFO:tasks.workunit.client.0.smithi049.stdout:0/94: write d3/f13 [1519186,52299] 0 2024-02-22T00:33:46.004 INFO:tasks.workunit.client.0.smithi049.stdout:4/59: truncate d3/d8/fd 319494 0 2024-02-22T00:33:46.005 INFO:tasks.workunit.client.0.smithi049.stdout:9/68: readlink l6 0 2024-02-22T00:33:46.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/88: creat d3/f1d x:0 0 0 2024-02-22T00:33:46.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/55: rename d2/f11 to d2/d9/de/d10/f19 0 2024-02-22T00:33:46.011 INFO:tasks.workunit.client.0.smithi049.stdout:4/60: dread f2 [0,4194304] 0 2024-02-22T00:33:46.012 INFO:tasks.workunit.client.0.smithi049.stdout:2/56: stat d2/l8 0 2024-02-22T00:33:46.013 INFO:tasks.workunit.client.0.smithi049.stdout:9/69: creat d17/f20 x:0 0 0 2024-02-22T00:33:46.017 INFO:tasks.workunit.client.0.smithi049.stdout:2/57: dread d2/d9/dd/ff [0,4194304] 0 2024-02-22T00:33:46.019 INFO:tasks.workunit.client.0.smithi049.stdout:6/89: truncate d3/f13 410584 0 2024-02-22T00:33:46.019 INFO:tasks.workunit.client.0.smithi049.stdout:9/70: chown f4 11680095 1 2024-02-22T00:33:46.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/71: chown d17/c19 6 1 2024-02-22T00:33:46.023 INFO:tasks.workunit.client.0.smithi049.stdout:4/61: dwrite f2 [0,4194304] 0 2024-02-22T00:33:46.024 INFO:tasks.workunit.client.0.smithi049.stdout:2/58: rename d2/lc to d2/d9/de/d15/l1a 0 2024-02-22T00:33:46.025 INFO:tasks.workunit.client.0.smithi049.stdout:9/72: mkdir d17/d21 0 2024-02-22T00:33:46.025 INFO:tasks.workunit.client.0.smithi049.stdout:2/59: dread - d2/d9/d17/f18 zero size 2024-02-22T00:33:46.026 INFO:tasks.workunit.client.0.smithi049.stdout:6/90: fsync d3/f14 0 2024-02-22T00:33:46.028 INFO:tasks.workunit.client.0.smithi049.stdout:9/73: creat d17/d1c/f22 x:0 0 0 2024-02-22T00:33:46.031 INFO:tasks.workunit.client.0.smithi049.stdout:4/62: unlink d3/l7 0 2024-02-22T00:33:46.032 INFO:tasks.workunit.client.0.smithi049.stdout:4/63: chown d3/l6 29379 1 2024-02-22T00:33:46.033 INFO:tasks.workunit.client.0.smithi049.stdout:4/64: read - d3/d8/d10/f11 zero size 2024-02-22T00:33:46.034 INFO:tasks.workunit.client.0.smithi049.stdout:4/65: chown d3/d8/d10 1223135 1 2024-02-22T00:33:46.034 INFO:tasks.workunit.client.0.smithi049.stdout:2/60: mkdir d2/d9/de/d15/d1b 0 2024-02-22T00:33:46.035 INFO:tasks.workunit.client.0.smithi049.stdout:4/66: fdatasync d3/d8/fc 0 2024-02-22T00:33:46.036 INFO:tasks.workunit.client.0.smithi049.stdout:4/67: chown d3/c5 179 1 2024-02-22T00:33:46.037 INFO:tasks.workunit.client.0.smithi049.stdout:0/95: truncate d3/d6/f9 2016070 0 2024-02-22T00:33:46.039 INFO:tasks.workunit.client.0.smithi049.stdout:2/61: rmdir d2/d9 39 2024-02-22T00:33:46.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/96: rmdir d3/d6/d8 39 2024-02-22T00:33:46.041 INFO:tasks.workunit.client.0.smithi049.stdout:4/68: dread d3/d8/fd [0,4194304] 0 2024-02-22T00:33:46.046 INFO:tasks.workunit.client.0.smithi049.stdout:4/69: mkdir d3/d13 0 2024-02-22T00:33:46.046 INFO:tasks.workunit.client.0.smithi049.stdout:6/91: write d3/f11 [3308187,29048] 0 2024-02-22T00:33:46.049 INFO:tasks.workunit.client.0.smithi049.stdout:9/74: truncate f10 298931 0 2024-02-22T00:33:46.049 INFO:tasks.workunit.client.0.smithi049.stdout:4/70: truncate d3/d8/fc 961561 0 2024-02-22T00:33:46.050 INFO:tasks.workunit.client.0.smithi049.stdout:2/62: creat d2/f1c x:0 0 0 2024-02-22T00:33:46.050 INFO:tasks.workunit.client.0.smithi049.stdout:4/71: write d3/fb [52119,35147] 0 2024-02-22T00:33:46.051 INFO:tasks.workunit.client.0.smithi049.stdout:4/72: stat d3/l6 0 2024-02-22T00:33:46.052 INFO:tasks.workunit.client.0.smithi049.stdout:9/75: rmdir d17 39 2024-02-22T00:33:46.054 INFO:tasks.workunit.client.0.smithi049.stdout:0/97: getdents d3/df 0 2024-02-22T00:33:46.058 INFO:tasks.workunit.client.0.smithi049.stdout:2/63: dread - d2/d9/de/d15/f16 zero size 2024-02-22T00:33:46.059 INFO:tasks.workunit.client.0.smithi049.stdout:4/73: creat d3/d8/f14 x:0 0 0 2024-02-22T00:33:46.059 INFO:tasks.workunit.client.0.smithi049.stdout:4/74: chown d3/lf 14800601 1 2024-02-22T00:33:46.060 INFO:tasks.workunit.client.0.smithi049.stdout:9/76: fsync d17/f18 0 2024-02-22T00:33:46.061 INFO:tasks.workunit.client.0.smithi049.stdout:0/98: chown d3/d6/d8 1144364163 1 2024-02-22T00:33:46.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/92: link d3/l9 d3/d16/l1e 0 2024-02-22T00:33:46.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/93: chown d3/d16/f19 206 1 2024-02-22T00:33:46.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/94: chown d3/f1d 13543856 1 2024-02-22T00:33:46.064 INFO:tasks.workunit.client.0.smithi049.stdout:2/64: unlink d2/f4 0 2024-02-22T00:33:46.068 INFO:tasks.workunit.client.0.smithi049.stdout:4/75: fsync d3/d8/fd 0 2024-02-22T00:33:46.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/65: dread d2/f7 [0,4194304] 0 2024-02-22T00:33:46.068 INFO:tasks.workunit.client.0.smithi049.stdout:4/76: fsync d3/d8/d10/f11 0 2024-02-22T00:33:46.068 INFO:tasks.workunit.client.0.smithi049.stdout:6/95: mkdir d3/d16/d1f 0 2024-02-22T00:33:46.072 INFO:tasks.workunit.client.0.smithi049.stdout:4/77: creat d3/d8/d10/f15 x:0 0 0 2024-02-22T00:33:46.076 INFO:tasks.workunit.client.0.smithi049.stdout:4/78: chown d3/l4 40 1 2024-02-22T00:33:46.079 INFO:tasks.workunit.client.0.smithi049.stdout:2/66: link d2/d9/de/d10/l13 d2/d9/de/d15/d1b/l1d 0 2024-02-22T00:33:46.081 INFO:tasks.workunit.client.0.smithi049.stdout:4/79: mknod d3/d13/c16 0 2024-02-22T00:33:46.084 INFO:tasks.workunit.client.0.smithi049.stdout:4/80: unlink d3/d8/fc 0 2024-02-22T00:33:46.084 INFO:tasks.workunit.client.0.smithi049.stdout:2/67: dread d2/d9/fa [0,4194304] 0 2024-02-22T00:33:46.084 INFO:tasks.workunit.client.0.smithi049.stdout:2/68: readlink d2/l3 0 2024-02-22T00:33:46.084 INFO:tasks.workunit.client.0.smithi049.stdout:4/81: fdatasync d3/d8/f14 0 2024-02-22T00:33:46.086 INFO:tasks.workunit.client.0.smithi049.stdout:4/82: rmdir d3/d13 39 2024-02-22T00:33:46.088 INFO:tasks.workunit.client.0.smithi049.stdout:7/74: sync 2024-02-22T00:33:46.088 INFO:tasks.workunit.client.0.smithi049.stdout:8/69: sync 2024-02-22T00:33:46.090 INFO:tasks.workunit.client.0.smithi049.stdout:8/70: chown d1/d2/d5 11284811 1 2024-02-22T00:33:46.091 INFO:tasks.workunit.client.0.smithi049.stdout:4/83: creat d3/d8/f17 x:0 0 0 2024-02-22T00:33:46.093 INFO:tasks.workunit.client.0.smithi049.stdout:7/75: mkdir d1/df/d12/d1c 0 2024-02-22T00:33:46.093 INFO:tasks.workunit.client.0.smithi049.stdout:4/84: dread - d3/d8/f14 zero size 2024-02-22T00:33:46.093 INFO:tasks.workunit.client.0.smithi049.stdout:6/96: dwrite d3/f13 [0,4194304] 0 2024-02-22T00:33:46.095 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-22T00:33:46.095 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-22T00:33:46.096 INFO:tasks.workunit.client.0.smithi049.stdout:2/69: dread d2/d9/de/d10/f12 [0,4194304] 0 2024-02-22T00:33:46.099 INFO:tasks.workunit.client.0.smithi049.stdout:4/85: mknod d3/d13/c18 0 2024-02-22T00:33:46.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/71: write d1/fa [115021,118257] 0 2024-02-22T00:33:46.100 INFO:tasks.workunit.client.0.smithi049.stdout:7/76: write d1/df/d12/f11 [520049,104722] 0 2024-02-22T00:33:46.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/97: creat d3/f20 x:0 0 0 2024-02-22T00:33:46.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/86: dread - d3/d8/d10/f15 zero size 2024-02-22T00:33:46.102 INFO:tasks.workunit.client.0.smithi049.stdout:8/72: stat d1/d2/db/d1c 0 2024-02-22T00:33:46.104 INFO:tasks.workunit.client.0.smithi049.stdout:8/73: readlink d1/d2/d5/l13 0 2024-02-22T00:33:46.104 INFO:tasks.workunit.client.0.smithi049.stdout:2/70: dread d2/d9/de/d10/f19 [4194304,4194304] 0 2024-02-22T00:33:46.106 INFO:tasks.workunit.client.0.smithi049.stdout:4/87: symlink d3/l19 0 2024-02-22T00:33:46.106 INFO:tasks.workunit.client.0.smithi049.stdout:6/98: write d3/f8 [611562,39693] 0 2024-02-22T00:33:46.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/74: dread - d1/d2/db/d15/f10 zero size 2024-02-22T00:33:46.107 INFO:tasks.workunit.client.0.smithi049.stdout:2/71: creat d2/d9/d17/f1e x:0 0 0 2024-02-22T00:33:46.109 INFO:tasks.workunit.client.0.smithi049.stdout:4/88: dread d3/fb [0,4194304] 0 2024-02-22T00:33:46.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/99: mknod d3/d16/d1f/c21 0 2024-02-22T00:33:46.112 INFO:tasks.workunit.client.0.smithi049.stdout:4/89: creat d3/d8/f1a x:0 0 0 2024-02-22T00:33:46.114 INFO:tasks.workunit.client.0.smithi049.stdout:8/75: write d1/f12 [2279211,26293] 0 2024-02-22T00:33:46.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/100: getdents d3 0 2024-02-22T00:33:46.120 INFO:tasks.workunit.client.0.smithi049.stdout:4/90: getdents d3/d8/d10/d12 0 2024-02-22T00:33:46.122 INFO:tasks.workunit.client.0.smithi049.stdout:2/72: dwrite d2/f6 [0,4194304] 0 2024-02-22T00:33:46.124 INFO:tasks.workunit.client.0.smithi049.stdout:2/73: stat d2/d9/dd 0 2024-02-22T00:33:46.125 INFO:tasks.workunit.client.0.smithi049.stdout:4/91: mknod d3/d8/d10/c1b 0 2024-02-22T00:33:46.126 INFO:tasks.workunit.client.0.smithi049.stdout:7/77: dwrite d1/df/f13 [0,4194304] 0 2024-02-22T00:33:46.126 INFO:tasks.workunit.client.0.smithi049.stdout:8/76: truncate d1/d2/db/f16 392472 0 2024-02-22T00:33:46.133 INFO:tasks.workunit.client.0.smithi049.stdout:6/101: link d3/f5 d3/d16/d1f/f22 0 2024-02-22T00:33:46.135 INFO:tasks.workunit.client.0.smithi049.stdout:7/78: mkdir d1/df/d12/d1c/d1d 0 2024-02-22T00:33:46.138 INFO:tasks.workunit.client.0.smithi049.stdout:2/74: dwrite d2/d9/d17/f1e [0,4194304] 0 2024-02-22T00:33:46.139 INFO:tasks.workunit.client.0.smithi049.stdout:8/77: getdents d1/d2/d5 0 2024-02-22T00:33:46.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/75: creat d2/d9/de/d15/d1b/f1f x:0 0 0 2024-02-22T00:33:46.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/76: stat d2/f6 0 2024-02-22T00:33:46.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/77: stat d2/d9/fa 0 2024-02-22T00:33:46.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/78: mknod d1/d2/db/c1f 0 2024-02-22T00:33:46.149 INFO:tasks.workunit.client.0.smithi049.stdout:2/78: creat d2/d9/de/d15/d1b/f20 x:0 0 0 2024-02-22T00:33:46.150 INFO:tasks.workunit.client.0.smithi049.stdout:6/102: rmdir d3/d16 39 2024-02-22T00:33:46.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/92: write f1 [612125,91715] 0 2024-02-22T00:33:46.152 INFO:tasks.workunit.client.0.smithi049.stdout:7/79: getdents d1/df 0 2024-02-22T00:33:46.153 INFO:tasks.workunit.client.0.smithi049.stdout:4/93: dread d3/fb [0,4194304] 0 2024-02-22T00:33:46.154 INFO:tasks.workunit.client.0.smithi049.stdout:2/79: chown d2/l3 360884 1 2024-02-22T00:33:46.155 INFO:tasks.workunit.client.0.smithi049.stdout:8/79: fdatasync d1/d2/db/f16 0 2024-02-22T00:33:46.158 INFO:tasks.workunit.client.0.smithi049.stdout:2/80: mknod d2/d9/dd/c21 0 2024-02-22T00:33:46.159 INFO:tasks.workunit.client.0.smithi049.stdout:8/80: dread d1/fa [0,4194304] 0 2024-02-22T00:33:46.160 INFO:tasks.workunit.client.0.smithi049.stdout:7/80: creat d1/df/d1b/f1e x:0 0 0 2024-02-22T00:33:46.161 INFO:tasks.workunit.client.0.smithi049.stdout:6/103: mknod d3/d16/c23 0 2024-02-22T00:33:46.163 INFO:tasks.workunit.client.0.smithi049.stdout:2/81: write d2/d9/fa [1072466,14334] 0 2024-02-22T00:33:46.165 INFO:tasks.workunit.client.0.smithi049.stdout:8/81: fsync d1/d2/d5/f18 0 2024-02-22T00:33:46.167 INFO:tasks.workunit.client.0.smithi049.stdout:2/82: creat d2/d9/de/f22 x:0 0 0 2024-02-22T00:33:46.169 INFO:tasks.workunit.client.0.smithi049.stdout:4/94: dwrite d3/d8/fd [0,4194304] 0 2024-02-22T00:33:46.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/95: write f2 [4498138,98495] 0 2024-02-22T00:33:46.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:44.320464+0000 mgr.smithi161.sazlam (mgr.24369) 52 : audit [DBG] from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:46.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:44.696293+0000 mgr.smithi161.sazlam (mgr.24369) 53 : audit [DBG] from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:46.172 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:45.164233+0000 mon.smithi049 (mon.0) 701 : audit [DBG] from='client.? 172.21.15.49:0/1661026501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:33:46.173 INFO:tasks.workunit.client.0.smithi049.stdout:2/83: unlink d2/d9/dd/ff 0 2024-02-22T00:33:46.177 INFO:tasks.workunit.client.0.smithi049.stdout:8/82: creat d1/d2/db/d1c/f20 x:0 0 0 2024-02-22T00:33:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:44.320464+0000 mgr.smithi161.sazlam (mgr.24369) 52 : audit [DBG] from='client.24435 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:44.696293+0000 mgr.smithi161.sazlam (mgr.24369) 53 : audit [DBG] from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:45.164233+0000 mon.smithi049 (mon.0) 701 : audit [DBG] from='client.? 172.21.15.49:0/1661026501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:33:46.181 INFO:tasks.workunit.client.0.smithi049.stdout:4/96: link f1 d3/d8/d10/f1c 0 2024-02-22T00:33:46.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/104: write d3/f6 [713550,110542] 0 2024-02-22T00:33:46.183 INFO:tasks.workunit.client.0.smithi049.stdout:4/97: chown f1 48 1 2024-02-22T00:33:46.186 INFO:tasks.workunit.client.0.smithi049.stdout:2/84: dwrite d2/f1c [0,4194304] 0 2024-02-22T00:33:46.188 INFO:tasks.workunit.client.0.smithi049.stdout:7/81: dwrite d1/fe [0,4194304] 0 2024-02-22T00:33:46.194 INFO:tasks.workunit.client.0.smithi049.stdout:6/105: creat d3/d16/f24 x:0 0 0 2024-02-22T00:33:46.194 INFO:tasks.workunit.client.0.smithi049.stdout:8/83: link d1/d2/db/d1c/f20 d1/d2/db/f21 0 2024-02-22T00:33:46.195 INFO:tasks.workunit.client.0.smithi049.stdout:2/85: creat d2/d9/de/d10/f23 x:0 0 0 2024-02-22T00:33:46.195 INFO:tasks.workunit.client.0.smithi049.stdout:4/98: write d3/fb [115841,104441] 0 2024-02-22T00:33:46.197 INFO:tasks.workunit.client.0.smithi049.stdout:7/82: read f0 [2763209,128191] 0 2024-02-22T00:33:46.202 INFO:tasks.workunit.client.0.smithi049.stdout:7/83: rmdir d1/df 39 2024-02-22T00:33:46.207 INFO:tasks.workunit.client.0.smithi049.stdout:6/106: dread d3/fb [0,4194304] 0 2024-02-22T00:33:46.207 INFO:tasks.workunit.client.0.smithi049.stdout:2/86: dwrite d2/f1c [0,4194304] 0 2024-02-22T00:33:46.216 INFO:tasks.workunit.client.0.smithi049.stdout:2/87: symlink d2/l24 0 2024-02-22T00:33:46.217 INFO:tasks.workunit.client.0.smithi049.stdout:6/107: chown d3/d16/d1f/f22 69009894 1 2024-02-22T00:33:46.217 INFO:tasks.workunit.client.0.smithi049.stdout:4/99: dwrite d3/d8/f17 [0,4194304] 0 2024-02-22T00:33:46.220 INFO:tasks.workunit.client.0.smithi049.stdout:4/100: chown d3/d8 36929 1 2024-02-22T00:33:46.221 INFO:tasks.workunit.client.0.smithi049.stdout:2/88: fsync d2/d9/de/d15/d1b/f1f 0 2024-02-22T00:33:46.222 INFO:tasks.workunit.client.0.smithi049.stdout:6/108: readlink d3/d16/l1e 0 2024-02-22T00:33:46.222 INFO:tasks.workunit.client.0.smithi049.stdout:7/84: dwrite d1/df/d12/f11 [0,4194304] 0 2024-02-22T00:33:46.229 INFO:tasks.workunit.client.0.smithi049.stdout:6/109: dread d3/f8 [0,4194304] 0 2024-02-22T00:33:46.230 INFO:tasks.workunit.client.0.smithi049.stdout:6/110: chown d3/d16/d1f 1107 1 2024-02-22T00:33:46.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/89: getdents d2 0 2024-02-22T00:33:46.233 INFO:tasks.workunit.client.0.smithi049.stdout:6/111: creat d3/d16/f25 x:0 0 0 2024-02-22T00:33:46.234 INFO:tasks.workunit.client.0.smithi049.stdout:2/90: readlink d2/d9/de/d15/d1b/l1d 0 2024-02-22T00:33:46.235 INFO:tasks.workunit.client.0.smithi049.stdout:4/101: fsync d3/d8/f17 0 2024-02-22T00:33:46.236 INFO:tasks.workunit.client.0.smithi049.stdout:6/112: creat d3/d16/d1f/f26 x:0 0 0 2024-02-22T00:33:46.236 INFO:tasks.workunit.client.0.smithi049.stdout:2/91: chown d2/d9/de/d15/d1b/l1d 236125 1 2024-02-22T00:33:46.236 INFO:tasks.workunit.client.0.smithi049.stdout:7/85: write d1/fa [751319,62287] 0 2024-02-22T00:33:46.238 INFO:tasks.workunit.client.0.smithi049.stdout:4/102: symlink d3/d8/l1d 0 2024-02-22T00:33:46.240 INFO:tasks.workunit.client.0.smithi049.stdout:7/86: mknod d1/df/d1b/c1f 0 2024-02-22T00:33:46.240 INFO:tasks.workunit.client.0.smithi049.stdout:6/113: mknod d3/c27 0 2024-02-22T00:33:46.242 INFO:tasks.workunit.client.0.smithi049.stdout:7/87: creat d1/df/d1b/f20 x:0 0 0 2024-02-22T00:33:46.244 INFO:tasks.workunit.client.0.smithi049.stdout:4/103: rename d3/d8/la to d3/l1e 0 2024-02-22T00:33:46.251 INFO:tasks.workunit.client.0.smithi049.stdout:4/104: mknod d3/d8/d10/d12/c1f 0 2024-02-22T00:33:46.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/114: dwrite d3/f1b [0,4194304] 0 2024-02-22T00:33:46.260 INFO:tasks.workunit.client.0.smithi049.stdout:2/92: dwrite d2/f7 [0,4194304] 0 2024-02-22T00:33:46.261 INFO:tasks.workunit.client.0.smithi049.stdout:4/105: mkdir d3/d8/d20 0 2024-02-22T00:33:46.262 INFO:tasks.workunit.client.0.smithi049.stdout:6/115: mknod d3/d16/d1f/c28 0 2024-02-22T00:33:46.269 INFO:tasks.workunit.client.0.smithi049.stdout:7/88: dwrite d1/f17 [0,4194304] 0 2024-02-22T00:33:46.273 INFO:tasks.workunit.client.0.smithi049.stdout:2/93: link d2/d9/de/d10/f19 d2/d9/de/d15/d1b/f25 0 2024-02-22T00:33:46.273 INFO:tasks.workunit.client.0.smithi049.stdout:7/89: mknod d1/df/c21 0 2024-02-22T00:33:46.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/106: dwrite d3/fb [0,4194304] 0 2024-02-22T00:33:46.279 INFO:tasks.workunit.client.0.smithi049.stdout:6/116: dread d3/f13 [0,4194304] 0 2024-02-22T00:33:46.280 INFO:tasks.workunit.client.0.smithi049.stdout:4/107: chown d3/d8/f14 163 1 2024-02-22T00:33:46.282 INFO:tasks.workunit.client.0.smithi049.stdout:2/94: getdents d2/d9/de 0 2024-02-22T00:33:46.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/90: dread d1/df/d12/f11 [0,4194304] 0 2024-02-22T00:33:46.285 INFO:tasks.workunit.client.0.smithi049.stdout:4/108: creat d3/f21 x:0 0 0 2024-02-22T00:33:46.286 INFO:tasks.workunit.client.0.smithi049.stdout:4/109: read f1 [676857,56333] 0 2024-02-22T00:33:46.289 INFO:tasks.workunit.client.0.smithi049.stdout:2/95: dread d2/f1c [0,4194304] 0 2024-02-22T00:33:46.291 INFO:tasks.workunit.client.0.smithi049.stdout:7/91: rmdir d1/df/d12/d1c 39 2024-02-22T00:33:46.294 INFO:tasks.workunit.client.0.smithi049.stdout:4/110: unlink d3/fb 0 2024-02-22T00:33:46.295 INFO:tasks.workunit.client.0.smithi049.stdout:4/111: chown d3/d8/d10/f15 2335 1 2024-02-22T00:33:46.295 INFO:tasks.workunit.client.0.smithi049.stdout:2/96: creat d2/d9/de/f26 x:0 0 0 2024-02-22T00:33:46.296 INFO:tasks.workunit.client.0.smithi049.stdout:2/97: chown d2/l3 2739283 1 2024-02-22T00:33:46.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/98: chown d2/f7 903 1 2024-02-22T00:33:46.298 INFO:tasks.workunit.client.0.smithi049.stdout:7/92: symlink d1/df/d12/d1c/l22 0 2024-02-22T00:33:46.300 INFO:tasks.workunit.client.0.smithi049.stdout:1/31: sync 2024-02-22T00:33:46.300 INFO:tasks.workunit.client.0.smithi049.stdout:3/6: sync 2024-02-22T00:33:46.301 INFO:tasks.workunit.client.0.smithi049.stdout:2/99: mknod d2/d9/de/d15/c27 0 2024-02-22T00:33:46.305 INFO:tasks.workunit.client.0.smithi049.stdout:1/32: chown d2/d8/da 2303261 1 2024-02-22T00:33:46.305 INFO:tasks.workunit.client.0.smithi049.stdout:7/93: truncate d1/f6 4201123 0 2024-02-22T00:33:46.306 INFO:tasks.workunit.client.0.smithi049.stdout:3/7: getdents . 0 2024-02-22T00:33:46.306 INFO:tasks.workunit.client.0.smithi049.stdout:3/8: write - no filename 2024-02-22T00:33:46.306 INFO:tasks.workunit.client.0.smithi049.stdout:3/9: write - no filename 2024-02-22T00:33:46.306 INFO:tasks.workunit.client.0.smithi049.stdout:3/10: write - no filename 2024-02-22T00:33:46.307 INFO:tasks.workunit.client.0.smithi049.stdout:7/94: readlink d1/df/d12/d1c/l22 0 2024-02-22T00:33:46.308 INFO:tasks.workunit.client.0.smithi049.stdout:2/100: unlink d2/d9/de/d15/f16 0 2024-02-22T00:33:46.308 INFO:tasks.workunit.client.0.smithi049.stdout:4/112: dwrite d3/d8/fd [0,4194304] 0 2024-02-22T00:33:46.308 INFO:tasks.workunit.client.0.smithi049.stdout:1/33: fdatasync d2/f3 0 2024-02-22T00:33:46.309 INFO:tasks.workunit.client.0.smithi049.stdout:7/95: chown d1/df 7 1 2024-02-22T00:33:46.310 INFO:tasks.workunit.client.0.smithi049.stdout:3/11: mkdir d0 0 2024-02-22T00:33:46.310 INFO:tasks.workunit.client.0.smithi049.stdout:3/12: dread - no filename 2024-02-22T00:33:46.310 INFO:tasks.workunit.client.0.smithi049.stdout:3/13: truncate - no filename 2024-02-22T00:33:46.311 INFO:tasks.workunit.client.0.smithi049.stdout:2/101: fsync d2/d9/fa 0 2024-02-22T00:33:46.313 INFO:tasks.workunit.client.0.smithi049.stdout:4/113: mkdir d3/d22 0 2024-02-22T00:33:46.314 INFO:tasks.workunit.client.0.smithi049.stdout:2/102: creat d2/d9/d17/f28 x:0 0 0 2024-02-22T00:33:46.315 INFO:tasks.workunit.client.0.smithi049.stdout:2/103: chown d2/f1c 1 1 2024-02-22T00:33:46.316 INFO:tasks.workunit.client.0.smithi049.stdout:3/14: mkdir d0/d1 0 2024-02-22T00:33:46.316 INFO:tasks.workunit.client.0.smithi049.stdout:3/15: readlink - no filename 2024-02-22T00:33:46.317 INFO:tasks.workunit.client.0.smithi049.stdout:2/104: write d2/d9/d17/f1e [814546,88477] 0 2024-02-22T00:33:46.319 INFO:tasks.workunit.client.0.smithi049.stdout:7/96: creat d1/df/d12/f23 x:0 0 0 2024-02-22T00:33:46.320 INFO:tasks.workunit.client.0.smithi049.stdout:2/105: write d2/d9/de/d10/f23 [135447,26766] 0 2024-02-22T00:33:46.321 INFO:tasks.workunit.client.0.smithi049.stdout:1/34: link d2/d8/f9 d2/d8/da/fd 0 2024-02-22T00:33:46.322 INFO:tasks.workunit.client.0.smithi049.stdout:4/114: creat d3/d8/d10/d12/f23 x:0 0 0 2024-02-22T00:33:46.325 INFO:tasks.workunit.client.0.smithi049.stdout:1/35: truncate d2/d8/da/fd 649533 0 2024-02-22T00:33:46.326 INFO:tasks.workunit.client.0.smithi049.stdout:1/36: stat d2/d8 0 2024-02-22T00:33:46.327 INFO:tasks.workunit.client.0.smithi049.stdout:7/97: mkdir d1/df/d12/d1c/d24 0 2024-02-22T00:33:46.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/16: creat d0/d1/f2 x:0 0 0 2024-02-22T00:33:46.328 INFO:tasks.workunit.client.0.smithi049.stdout:4/115: mkdir d3/d22/d24 0 2024-02-22T00:33:46.331 INFO:tasks.workunit.client.0.smithi049.stdout:2/106: link d2/d9/de/f22 d2/d9/de/d10/f29 0 2024-02-22T00:33:46.333 INFO:tasks.workunit.client.0.smithi049.stdout:7/98: mknod d1/df/d12/d1c/d24/c25 0 2024-02-22T00:33:46.334 INFO:tasks.workunit.client.0.smithi049.stdout:3/17: truncate d0/d1/f2 855602 0 2024-02-22T00:33:46.335 INFO:tasks.workunit.client.0.smithi049.stdout:4/116: write d3/f21 [240918,30147] 0 2024-02-22T00:33:46.336 INFO:tasks.workunit.client.0.smithi049.stdout:4/117: chown d3/d8/d10 12093478 1 2024-02-22T00:33:46.337 INFO:tasks.workunit.client.0.smithi049.stdout:2/107: creat d2/d9/f2a x:0 0 0 2024-02-22T00:33:46.338 INFO:tasks.workunit.client.0.smithi049.stdout:2/108: fsync d2/d9/de/d15/d1b/f20 0 2024-02-22T00:33:46.339 INFO:tasks.workunit.client.0.smithi049.stdout:1/37: fsync d2/d8/da/fd 0 2024-02-22T00:33:46.341 INFO:tasks.workunit.client.0.smithi049.stdout:4/118: mkdir d3/d8/d25 0 2024-02-22T00:33:46.342 INFO:tasks.workunit.client.0.smithi049.stdout:3/18: dread d0/d1/f2 [0,4194304] 0 2024-02-22T00:33:46.342 INFO:tasks.workunit.client.0.smithi049.stdout:1/38: write d2/f3 [2326466,114837] 0 2024-02-22T00:33:46.344 INFO:tasks.workunit.client.0.smithi049.stdout:7/99: symlink d1/df/d12/d1c/d1d/l26 0 2024-02-22T00:33:46.344 INFO:tasks.workunit.client.0.smithi049.stdout:2/109: creat d2/d9/de/f2b x:0 0 0 2024-02-22T00:33:46.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/19: fsync d0/d1/f2 0 2024-02-22T00:33:46.345 INFO:tasks.workunit.client.0.smithi049.stdout:1/39: mknod d2/d8/db/ce 0 2024-02-22T00:33:46.347 INFO:tasks.workunit.client.0.smithi049.stdout:3/20: chown d0 2 1 2024-02-22T00:33:46.347 INFO:tasks.workunit.client.0.smithi049.stdout:4/119: truncate d3/d8/f17 3357256 0 2024-02-22T00:33:46.348 INFO:tasks.workunit.client.0.smithi049.stdout:1/40: write d2/f4 [1766736,69641] 0 2024-02-22T00:33:46.349 INFO:tasks.workunit.client.0.smithi049.stdout:4/120: chown d3/lf 3997352 1 2024-02-22T00:33:46.351 INFO:tasks.workunit.client.0.smithi049.stdout:1/41: chown d2/d8/da/fd 0 1 2024-02-22T00:33:46.354 INFO:tasks.workunit.client.0.smithi049.stdout:4/121: write d3/d8/f14 [301997,90097] 0 2024-02-22T00:33:46.354 INFO:tasks.workunit.client.0.smithi049.stdout:3/21: creat d0/d1/f3 x:0 0 0 2024-02-22T00:33:46.358 INFO:tasks.workunit.client.0.smithi049.stdout:4/122: dread - d3/d8/f1a zero size 2024-02-22T00:33:46.358 INFO:tasks.workunit.client.0.smithi049.stdout:3/22: rmdir d0 39 2024-02-22T00:33:46.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/100: dwrite d1/df/d12/f11 [4194304,4194304] 0 2024-02-22T00:33:46.363 INFO:tasks.workunit.client.0.smithi049.stdout:3/23: write d0/d1/f2 [1047589,112620] 0 2024-02-22T00:33:46.364 INFO:tasks.workunit.client.0.smithi049.stdout:4/123: write d3/d8/d10/d12/f23 [265580,59467] 0 2024-02-22T00:33:46.366 INFO:tasks.workunit.client.0.smithi049.stdout:1/42: dread d2/f3 [0,4194304] 0 2024-02-22T00:33:46.368 INFO:tasks.workunit.client.0.smithi049.stdout:7/101: chown d1/df/d12/d1c/d1d/l26 252728 1 2024-02-22T00:33:46.371 INFO:tasks.workunit.client.0.smithi049.stdout:7/102: write d1/df/f18 [4627150,115578] 0 2024-02-22T00:33:46.371 INFO:tasks.workunit.client.0.smithi049.stdout:1/43: creat d2/d8/ff x:0 0 0 2024-02-22T00:33:46.374 INFO:tasks.workunit.client.0.smithi049.stdout:2/110: dwrite d2/d9/fa [0,4194304] 0 2024-02-22T00:33:46.382 INFO:tasks.workunit.client.0.smithi049.stdout:7/103: creat d1/f27 x:0 0 0 2024-02-22T00:33:46.389 INFO:tasks.workunit.client.0.smithi049.stdout:2/111: truncate d2/d9/d17/f28 534690 0 2024-02-22T00:33:46.391 INFO:tasks.workunit.client.0.smithi049.stdout:3/24: dwrite d0/d1/f2 [0,4194304] 0 2024-02-22T00:33:46.400 INFO:tasks.workunit.client.0.smithi049.stdout:4/124: dwrite d3/d8/f1a [0,4194304] 0 2024-02-22T00:33:46.405 INFO:tasks.workunit.client.0.smithi049.stdout:1/44: dwrite d2/d8/ff [0,4194304] 0 2024-02-22T00:33:46.408 INFO:tasks.workunit.client.0.smithi049.stdout:3/25: rename d0/d1/f2 to d0/d1/f4 0 2024-02-22T00:33:46.410 INFO:tasks.workunit.client.0.smithi049.stdout:3/26: chown d0/d1 125242727 1 2024-02-22T00:33:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:1/45: creat d2/f10 x:0 0 0 2024-02-22T00:33:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:7/104: dwrite d1/df/f13 [4194304,4194304] 0 2024-02-22T00:33:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:4/125: getdents d3/d8/d10/d12 0 2024-02-22T00:33:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:2/112: dwrite d2/d9/fa [0,4194304] 0 2024-02-22T00:33:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:7/105: mkdir d1/df/d1b/d28 0 2024-02-22T00:33:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:4/126: unlink d3/lf 0 2024-02-22T00:33:46.433 INFO:tasks.workunit.client.0.smithi049.stdout:2/113: link d2/d9/de/d15/l1a d2/d9/de/d10/l2c 0 2024-02-22T00:33:46.433 INFO:tasks.workunit.client.0.smithi049.stdout:1/46: dwrite d2/d8/f9 [0,4194304] 0 2024-02-22T00:33:46.433 INFO:tasks.workunit.client.0.smithi049.stdout:7/106: dread d1/df/f18 [0,4194304] 0 2024-02-22T00:33:46.433 INFO:tasks.workunit.client.0.smithi049.stdout:4/127: link d3/f21 d3/d8/f26 0 2024-02-22T00:33:46.436 INFO:tasks.workunit.client.0.smithi049.stdout:4/128: read d3/d8/f17 [2899970,4319] 0 2024-02-22T00:33:46.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/129: readlink d3/l19 0 2024-02-22T00:33:46.439 INFO:tasks.workunit.client.0.smithi049.stdout:2/114: getdents d2/d9/d17 0 2024-02-22T00:33:46.441 INFO:tasks.workunit.client.0.smithi049.stdout:1/47: link d2/c7 d2/d8/da/c11 0 2024-02-22T00:33:46.449 INFO:tasks.workunit.client.0.smithi049.stdout:4/130: link d3/le d3/d22/d24/l27 0 2024-02-22T00:33:46.450 INFO:tasks.workunit.client.0.smithi049.stdout:1/48: creat d2/d8/db/f12 x:0 0 0 2024-02-22T00:33:46.451 INFO:tasks.workunit.client.0.smithi049.stdout:7/107: dwrite d1/df/d12/f23 [0,4194304] 0 2024-02-22T00:33:46.452 INFO:tasks.workunit.client.0.smithi049.stdout:2/115: dread d2/f1c [0,4194304] 0 2024-02-22T00:33:46.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/49: unlink d2/c7 0 2024-02-22T00:33:46.456 INFO:tasks.workunit.client.0.smithi049.stdout:2/116: mknod d2/d9/d17/c2d 0 2024-02-22T00:33:46.463 INFO:tasks.workunit.client.0.smithi049.stdout:1/50: chown d2/d8/da/c11 52734 1 2024-02-22T00:33:46.465 INFO:tasks.workunit.client.0.smithi049.stdout:7/108: dwrite d1/df/d1b/f1e [0,4194304] 0 2024-02-22T00:33:46.472 INFO:tasks.workunit.client.0.smithi049.stdout:1/51: chown d2/d8/da/c11 0 1 2024-02-22T00:33:46.473 INFO:tasks.workunit.client.0.smithi049.stdout:7/109: symlink d1/l29 0 2024-02-22T00:33:46.476 INFO:tasks.workunit.client.0.smithi049.stdout:2/117: dwrite d2/d9/de/f26 [0,4194304] 0 2024-02-22T00:33:46.476 INFO:tasks.workunit.client.0.smithi049.stdout:4/131: dwrite f1 [0,4194304] 0 2024-02-22T00:33:46.482 INFO:tasks.workunit.client.0.smithi049.stdout:4/132: write f2 [5320198,13273] 0 2024-02-22T00:33:46.483 INFO:tasks.workunit.client.0.smithi049.stdout:1/52: link d2/d8/ff d2/d8/f13 0 2024-02-22T00:33:46.485 INFO:tasks.workunit.client.0.smithi049.stdout:7/110: rename d1/df/d1b/f1e to d1/df/d12/d1c/f2a 0 2024-02-22T00:33:46.486 INFO:tasks.workunit.client.0.smithi049.stdout:4/133: symlink d3/d8/l28 0 2024-02-22T00:33:46.489 INFO:tasks.workunit.client.0.smithi049.stdout:2/118: dwrite d2/d9/d17/f28 [0,4194304] 0 2024-02-22T00:33:46.493 INFO:tasks.workunit.client.0.smithi049.stdout:2/119: chown d2/d9/fa 10966819 1 2024-02-22T00:33:46.497 INFO:tasks.workunit.client.0.smithi049.stdout:2/120: read d2/d9/fa [6547919,884] 0 2024-02-22T00:33:46.501 INFO:tasks.workunit.client.0.smithi049.stdout:7/111: dwrite d1/df/f13 [8388608,4194304] 0 2024-02-22T00:33:46.502 INFO:tasks.workunit.client.0.smithi049.stdout:4/134: dwrite f1 [0,4194304] 0 2024-02-22T00:33:46.503 INFO:tasks.workunit.client.0.smithi049.stdout:4/135: chown f2 9107 1 2024-02-22T00:33:46.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/53: truncate d2/d8/f9 927483 0 2024-02-22T00:33:46.506 INFO:tasks.workunit.client.0.smithi049.stdout:7/112: write d1/f17 [5099413,35230] 0 2024-02-22T00:33:46.507 INFO:tasks.workunit.client.0.smithi049.stdout:4/136: truncate d3/d8/d10/d12/f23 1235564 0 2024-02-22T00:33:46.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/54: read d2/f3 [2402486,101712] 0 2024-02-22T00:33:46.508 INFO:tasks.workunit.client.0.smithi049.stdout:7/113: truncate d1/fa 1636129 0 2024-02-22T00:33:46.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/137: chown d3/d8/d10/d12/c1f 31689742 1 2024-02-22T00:33:46.510 INFO:tasks.workunit.client.0.smithi049.stdout:2/121: dread d2/d9/de/d15/d1b/f25 [4194304,4194304] 0 2024-02-22T00:33:46.512 INFO:tasks.workunit.client.0.smithi049.stdout:7/114: unlink d1/f17 0 2024-02-22T00:33:46.513 INFO:tasks.workunit.client.0.smithi049.stdout:7/115: chown d1/df/d12/f23 1067912771 1 2024-02-22T00:33:46.514 INFO:tasks.workunit.client.0.smithi049.stdout:4/138: creat d3/d22/f29 x:0 0 0 2024-02-22T00:33:46.515 INFO:tasks.workunit.client.0.smithi049.stdout:4/139: fdatasync d3/d8/d10/f15 0 2024-02-22T00:33:46.516 INFO:tasks.workunit.client.0.smithi049.stdout:2/122: mkdir d2/d9/de/d10/d2e 0 2024-02-22T00:33:46.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/123: symlink d2/d9/de/d15/l2f 0 2024-02-22T00:33:46.520 INFO:tasks.workunit.client.0.smithi049.stdout:2/124: chown d2/d9/de/d10 2041 1 2024-02-22T00:33:46.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/116: dwrite d1/df/d12/d1c/f2a [0,4194304] 0 2024-02-22T00:33:46.526 INFO:tasks.workunit.client.0.smithi049.stdout:4/140: dwrite d3/d8/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:46.527 INFO:tasks.workunit.client.0.smithi049.stdout:7/117: truncate d1/f27 59489 0 2024-02-22T00:33:46.529 INFO:tasks.workunit.client.0.smithi049.stdout:4/141: mknod d3/d8/d10/c2a 0 2024-02-22T00:33:46.529 INFO:tasks.workunit.client.0.smithi049.stdout:5/45: sync 2024-02-22T00:33:46.530 INFO:tasks.workunit.client.0.smithi049.stdout:4/142: chown d3/d8/l28 41006391 1 2024-02-22T00:33:46.531 INFO:tasks.workunit.client.0.smithi049.stdout:5/46: chown d0/de/d6/cf 0 1 2024-02-22T00:33:46.531 INFO:tasks.workunit.client.0.smithi049.stdout:7/118: rmdir d1/df/d12 39 2024-02-22T00:33:46.539 INFO:tasks.workunit.client.0.smithi049.stdout:4/143: mknod d3/d8/d20/c2b 0 2024-02-22T00:33:46.539 INFO:tasks.workunit.client.0.smithi049.stdout:1/55: dread d2/d8/da/fd [0,4194304] 0 2024-02-22T00:33:46.542 INFO:tasks.workunit.client.0.smithi049.stdout:2/125: rmdir d2/d9/de/d10 39 2024-02-22T00:33:46.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/119: mknod d1/df/d12/c2b 0 2024-02-22T00:33:46.548 INFO:tasks.workunit.client.0.smithi049.stdout:2/126: rename d2/d9/d17/f1e to d2/d9/f30 0 2024-02-22T00:33:46.551 INFO:tasks.workunit.client.0.smithi049.stdout:1/56: creat d2/d8/da/f14 x:0 0 0 2024-02-22T00:33:46.555 INFO:tasks.workunit.client.0.smithi049.stdout:1/57: fsync d2/d8/f9 0 2024-02-22T00:33:46.557 INFO:tasks.workunit.client.0.smithi049.stdout:1/58: dread - d2/f10 zero size 2024-02-22T00:33:46.558 INFO:tasks.workunit.client.0.smithi049.stdout:2/127: creat d2/d9/de/d10/f31 x:0 0 0 2024-02-22T00:33:46.559 INFO:tasks.workunit.client.0.smithi049.stdout:5/47: dwrite d0/de/fb [0,4194304] 0 2024-02-22T00:33:46.560 INFO:tasks.workunit.client.0.smithi049.stdout:4/144: truncate d3/d8/fd 377328 0 2024-02-22T00:33:46.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/145: chown d3/d8/d20 82497 1 2024-02-22T00:33:46.564 INFO:tasks.workunit.client.0.smithi049.stdout:1/59: symlink d2/l15 0 2024-02-22T00:33:46.567 INFO:tasks.workunit.client.0.smithi049.stdout:2/128: unlink d2/d9/de/f22 0 2024-02-22T00:33:46.570 INFO:tasks.workunit.client.0.smithi049.stdout:7/120: write d1/df/f16 [1364651,59583] 0 2024-02-22T00:33:46.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/129: mknod d2/d9/dd/c32 0 2024-02-22T00:33:46.572 INFO:tasks.workunit.client.0.smithi049.stdout:4/146: dwrite d3/d8/d10/f1c [0,4194304] 0 2024-02-22T00:33:46.572 INFO:tasks.workunit.client.0.smithi049.stdout:1/60: dread d2/f3 [0,4194304] 0 2024-02-22T00:33:46.573 INFO:tasks.workunit.client.0.smithi049.stdout:2/130: stat d2/d9/d17 0 2024-02-22T00:33:46.574 INFO:tasks.workunit.client.0.smithi049.stdout:4/147: chown f2 536 1 2024-02-22T00:33:46.575 INFO:tasks.workunit.client.0.smithi049.stdout:7/121: rename d1/df/d1b to d1/df/d1b/d2c 22 2024-02-22T00:33:46.576 INFO:tasks.workunit.client.0.smithi049.stdout:2/131: mkdir d2/d9/de/d10/d33 0 2024-02-22T00:33:46.577 INFO:tasks.workunit.client.0.smithi049.stdout:1/61: mknod d2/d8/db/c16 0 2024-02-22T00:33:46.578 INFO:tasks.workunit.client.0.smithi049.stdout:2/132: fsync d2/d9/de/d15/d1b/f20 0 2024-02-22T00:33:46.579 INFO:tasks.workunit.client.0.smithi049.stdout:1/62: dread - d2/d8/da/f14 zero size 2024-02-22T00:33:46.584 INFO:tasks.workunit.client.0.smithi049.stdout:1/63: creat d2/f17 x:0 0 0 2024-02-22T00:33:46.588 INFO:tasks.workunit.client.0.smithi049.stdout:5/48: dread d0/de/fc [0,4194304] 0 2024-02-22T00:33:46.590 INFO:tasks.workunit.client.0.smithi049.stdout:1/64: truncate d2/d8/f9 271304 0 2024-02-22T00:33:46.591 INFO:tasks.workunit.client.0.smithi049.stdout:1/65: fsync d2/d8/da/f14 0 2024-02-22T00:33:46.594 INFO:tasks.workunit.client.0.smithi049.stdout:4/148: write d3/d8/f17 [3991455,38360] 0 2024-02-22T00:33:46.601 INFO:tasks.workunit.client.0.smithi049.stdout:1/66: dwrite d2/f4 [0,4194304] 0 2024-02-22T00:33:46.601 INFO:tasks.workunit.client.0.smithi049.stdout:7/122: link d1/cc d1/df/d12/c2d 0 2024-02-22T00:33:46.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/149: rmdir d3/d22/d24 39 2024-02-22T00:33:46.603 INFO:tasks.workunit.client.0.smithi049.stdout:5/49: link d0/l9 d0/de/d6/l11 0 2024-02-22T00:33:46.604 INFO:tasks.workunit.client.0.smithi049.stdout:7/123: chown d1/l29 412583 1 2024-02-22T00:33:46.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/150: write d3/d8/d10/f11 [75277,110447] 0 2024-02-22T00:33:46.608 INFO:tasks.workunit.client.0.smithi049.stdout:2/133: dwrite d2/d9/de/d10/f29 [0,4194304] 0 2024-02-22T00:33:46.609 INFO:tasks.workunit.client.0.smithi049.stdout:7/124: rmdir d1/df/d1b 39 2024-02-22T00:33:46.612 INFO:tasks.workunit.client.0.smithi049.stdout:4/151: creat d3/d22/d24/f2c x:0 0 0 2024-02-22T00:33:46.614 INFO:tasks.workunit.client.0.smithi049.stdout:7/125: unlink d1/f27 0 2024-02-22T00:33:46.619 INFO:tasks.workunit.client.0.smithi049.stdout:5/50: dwrite d0/de/fc [0,4194304] 0 2024-02-22T00:33:46.620 INFO:tasks.workunit.client.0.smithi049.stdout:4/152: unlink d3/d8/d10/f1c 0 2024-02-22T00:33:46.622 INFO:tasks.workunit.client.0.smithi049.stdout:4/153: write d3/d8/d10/f11 [717313,68235] 0 2024-02-22T00:33:46.624 INFO:tasks.workunit.client.0.smithi049.stdout:2/134: rename d2/d9/f30 to d2/d9/de/d10/d33/f34 0 2024-02-22T00:33:46.626 INFO:tasks.workunit.client.0.smithi049.stdout:7/126: dread d1/df/d12/d1c/f2a [0,4194304] 0 2024-02-22T00:33:46.627 INFO:tasks.workunit.client.0.smithi049.stdout:5/51: creat d0/de/d6/f12 x:0 0 0 2024-02-22T00:33:46.631 INFO:tasks.workunit.client.0.smithi049.stdout:2/135: unlink d2/d9/de/d15/d1b/l1d 0 2024-02-22T00:33:46.632 INFO:tasks.workunit.client.0.smithi049.stdout:7/127: mkdir d1/df/d12/d1c/d24/d2e 0 2024-02-22T00:33:46.633 INFO:tasks.workunit.client.0.smithi049.stdout:5/52: creat d0/de/d6/f13 x:0 0 0 2024-02-22T00:33:46.634 INFO:tasks.workunit.client.0.smithi049.stdout:5/53: dread - d0/de/d6/f13 zero size 2024-02-22T00:33:46.637 INFO:tasks.workunit.client.0.smithi049.stdout:7/128: rename d1/l29 to d1/df/d12/d1c/d1d/l2f 0 2024-02-22T00:33:46.638 INFO:tasks.workunit.client.0.smithi049.stdout:2/136: symlink d2/d9/de/d10/d2e/l35 0 2024-02-22T00:33:46.639 INFO:tasks.workunit.client.0.smithi049.stdout:4/154: rmdir d3/d8/d10 39 2024-02-22T00:33:46.640 INFO:tasks.workunit.client.0.smithi049.stdout:5/54: mknod d0/c14 0 2024-02-22T00:33:46.640 INFO:tasks.workunit.client.0.smithi049.stdout:4/155: dread - d3/d22/d24/f2c zero size 2024-02-22T00:33:46.642 INFO:tasks.workunit.client.0.smithi049.stdout:5/55: write d0/de/fb [3139111,84094] 0 2024-02-22T00:33:46.643 INFO:tasks.workunit.client.0.smithi049.stdout:5/56: readlink d0/de/d6/l7 0 2024-02-22T00:33:46.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/129: dread f0 [0,4194304] 0 2024-02-22T00:33:46.645 INFO:tasks.workunit.client.0.smithi049.stdout:4/156: unlink d3/l19 0 2024-02-22T00:33:46.646 INFO:tasks.workunit.client.0.smithi049.stdout:2/137: link d2/d9/f2a d2/f36 0 2024-02-22T00:33:46.647 INFO:tasks.workunit.client.0.smithi049.stdout:5/57: symlink d0/l15 0 2024-02-22T00:33:46.648 INFO:tasks.workunit.client.0.smithi049.stdout:5/58: chown d0/de/d6/fd 3776328 1 2024-02-22T00:33:46.652 INFO:tasks.workunit.client.0.smithi049.stdout:5/59: symlink d0/de/l16 0 2024-02-22T00:33:46.653 INFO:tasks.workunit.client.0.smithi049.stdout:7/130: truncate d1/f6 3434554 0 2024-02-22T00:33:46.657 INFO:tasks.workunit.client.0.smithi049.stdout:7/131: creat d1/df/d12/f30 x:0 0 0 2024-02-22T00:33:46.661 INFO:tasks.workunit.client.0.smithi049.stdout:5/60: dwrite d0/de/d6/f12 [0,4194304] 0 2024-02-22T00:33:46.666 INFO:tasks.workunit.client.0.smithi049.stdout:5/61: rename d0/l15 to d0/l17 0 2024-02-22T00:33:46.668 INFO:tasks.workunit.client.0.smithi049.stdout:2/138: creat d2/d9/de/d10/d33/f37 x:0 0 0 2024-02-22T00:33:46.672 INFO:tasks.workunit.client.0.smithi049.stdout:5/62: truncate d0/de/fc 4674021 0 2024-02-22T00:33:46.672 INFO:tasks.workunit.client.0.smithi049.stdout:4/157: dwrite d3/d8/fd [0,4194304] 0 2024-02-22T00:33:46.675 INFO:tasks.workunit.client.0.smithi049.stdout:5/63: mknod d0/c18 0 2024-02-22T00:33:46.676 INFO:tasks.workunit.client.0.smithi049.stdout:7/132: dread d1/df/f13 [8388608,4194304] 0 2024-02-22T00:33:46.679 INFO:tasks.workunit.client.0.smithi049.stdout:2/139: dread d2/d9/de/d10/f23 [0,4194304] 0 2024-02-22T00:33:46.679 INFO:tasks.workunit.client.0.smithi049.stdout:5/64: write d0/de/fc [5188334,37055] 0 2024-02-22T00:33:46.680 INFO:tasks.workunit.client.0.smithi049.stdout:7/133: truncate d1/df/d12/f30 529619 0 2024-02-22T00:33:46.682 INFO:tasks.workunit.client.0.smithi049.stdout:2/140: chown d2/d9/de/d10/f19 446919545 1 2024-02-22T00:33:46.683 INFO:tasks.workunit.client.0.smithi049.stdout:5/65: mknod d0/de/c19 0 2024-02-22T00:33:46.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/66: chown d0/de 199893 1 2024-02-22T00:33:46.685 INFO:tasks.workunit.client.0.smithi049.stdout:7/134: stat d1/df/f16 0 2024-02-22T00:33:46.691 INFO:tasks.workunit.client.0.smithi049.stdout:2/141: stat d2/d9/de/d10/f29 0 2024-02-22T00:33:46.691 INFO:tasks.workunit.client.0.smithi049.stdout:5/67: mkdir d0/d1a 0 2024-02-22T00:33:46.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/158: link d3/l1e d3/d13/l2d 0 2024-02-22T00:33:46.692 INFO:tasks.workunit.client.0.smithi049.stdout:4/159: readlink l0 0 2024-02-22T00:33:46.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/135: dwrite d1/df/d12/f23 [0,4194304] 0 2024-02-22T00:33:46.694 INFO:tasks.workunit.client.0.smithi049.stdout:4/160: dread - d3/d22/d24/f2c zero size 2024-02-22T00:33:46.697 INFO:tasks.workunit.client.0.smithi049.stdout:4/161: fsync f2 0 2024-02-22T00:33:46.698 INFO:tasks.workunit.client.0.smithi049.stdout:2/142: write d2/d9/de/d10/f12 [842429,62250] 0 2024-02-22T00:33:46.700 INFO:tasks.workunit.client.0.smithi049.stdout:4/162: chown d3/d22/f29 444475297 1 2024-02-22T00:33:46.710 INFO:tasks.workunit.client.0.smithi049.stdout:2/143: rename d2/l3 to d2/d9/l38 0 2024-02-22T00:33:46.713 INFO:tasks.workunit.client.0.smithi049.stdout:7/136: dread d1/df/f16 [0,4194304] 0 2024-02-22T00:33:46.720 INFO:tasks.workunit.client.0.smithi049.stdout:7/137: symlink d1/df/d12/d1c/d24/d2e/l31 0 2024-02-22T00:33:46.722 INFO:tasks.workunit.client.0.smithi049.stdout:4/163: dwrite f1 [0,4194304] 0 2024-02-22T00:33:46.723 INFO:tasks.workunit.client.0.smithi049.stdout:2/144: mknod d2/d9/de/d15/d1b/c39 0 2024-02-22T00:33:46.724 INFO:tasks.workunit.client.0.smithi049.stdout:7/138: dread - d1/df/d1b/f20 zero size 2024-02-22T00:33:46.728 INFO:tasks.workunit.client.0.smithi049.stdout:2/145: chown d2/d9/de/d10/d33/f34 751483 1 2024-02-22T00:33:46.734 INFO:tasks.workunit.client.0.smithi049.stdout:4/164: dwrite d3/d8/f17 [0,4194304] 0 2024-02-22T00:33:46.734 INFO:tasks.workunit.client.0.smithi049.stdout:7/139: creat d1/df/d12/d1c/d24/f32 x:0 0 0 2024-02-22T00:33:46.747 INFO:tasks.workunit.client.0.smithi049.stdout:2/146: truncate d2/d9/d17/f28 160772 0 2024-02-22T00:33:46.749 INFO:tasks.workunit.client.0.smithi049.stdout:4/165: dwrite d3/d22/f29 [0,4194304] 0 2024-02-22T00:33:46.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/140: dwrite d1/df/f18 [0,4194304] 0 2024-02-22T00:33:46.754 INFO:tasks.workunit.client.0.smithi049.stdout:2/147: unlink d2/d9/de/d10/f23 0 2024-02-22T00:33:46.754 INFO:tasks.workunit.client.0.smithi049.stdout:7/141: chown d1/df/d12/d1c/d24/d2e/l31 27180870 1 2024-02-22T00:33:46.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/142: stat d1/df/d12/d1c/d24 0 2024-02-22T00:33:46.757 INFO:tasks.workunit.client.0.smithi049.stdout:2/148: fsync d2/f7 0 2024-02-22T00:33:46.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/143: dwrite d1/df/d12/f23 [0,4194304] 0 2024-02-22T00:33:46.771 INFO:tasks.workunit.client.0.smithi049.stdout:7/144: rmdir d1/df/d12/d1c/d24/d2e 39 2024-02-22T00:33:46.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/145: mknod d1/c33 0 2024-02-22T00:33:46.776 INFO:tasks.workunit.client.0.smithi049.stdout:7/146: creat d1/df/d12/d1c/d1d/f34 x:0 0 0 2024-02-22T00:33:46.778 INFO:tasks.workunit.client.0.smithi049.stdout:7/147: truncate d1/df/d12/f23 4560072 0 2024-02-22T00:33:46.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/148: dread d1/df/f16 [0,4194304] 0 2024-02-22T00:33:46.785 INFO:tasks.workunit.client.0.smithi049.stdout:2/149: getdents d2/d9/de/d10 0 2024-02-22T00:33:46.786 INFO:tasks.workunit.client.0.smithi049.stdout:4/166: truncate d3/d8/fd 3174803 0 2024-02-22T00:33:46.787 INFO:tasks.workunit.client.0.smithi049.stdout:4/167: chown d3/d13 0 1 2024-02-22T00:33:46.842 INFO:tasks.workunit.client.0.smithi049.stdout:9/77: sync 2024-02-22T00:33:46.842 INFO:tasks.workunit.client.0.smithi049.stdout:0/99: sync 2024-02-22T00:33:46.846 INFO:tasks.workunit.client.0.smithi049.stdout:7/149: mkdir d1/df/d1b/d28/d35 0 2024-02-22T00:33:46.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/117: sync 2024-02-22T00:33:46.846 INFO:tasks.workunit.client.0.smithi049.stdout:8/84: sync 2024-02-22T00:33:46.846 INFO:tasks.workunit.client.0.smithi049.stdout:3/27: sync 2024-02-22T00:33:46.848 INFO:tasks.workunit.client.0.smithi049.stdout:9/78: dread - d17/f1f zero size 2024-02-22T00:33:46.850 INFO:tasks.workunit.client.0.smithi049.stdout:3/28: rmdir d0/d1 39 2024-02-22T00:33:46.855 INFO:tasks.workunit.client.0.smithi049.stdout:0/100: fsync d3/d6/f9 0 2024-02-22T00:33:46.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/168: write d3/d8/f26 [1029296,17816] 0 2024-02-22T00:33:46.857 INFO:tasks.workunit.client.0.smithi049.stdout:7/150: dwrite d1/df/d12/f11 [4194304,4194304] 0 2024-02-22T00:33:46.858 INFO:tasks.workunit.client.0.smithi049.stdout:9/79: write f13 [1948308,44349] 0 2024-02-22T00:33:46.859 INFO:tasks.workunit.client.0.smithi049.stdout:8/85: mknod d1/d2/db/d1c/c22 0 2024-02-22T00:33:46.864 INFO:tasks.workunit.client.0.smithi049.stdout:7/151: chown d1/df/d1b/c1f 199 1 2024-02-22T00:33:46.867 INFO:tasks.workunit.client.0.smithi049.stdout:0/101: creat d3/d6/d8/f1a x:0 0 0 2024-02-22T00:33:46.868 INFO:tasks.workunit.client.0.smithi049.stdout:9/80: fsync f4 0 2024-02-22T00:33:46.869 INFO:tasks.workunit.client.0.smithi049.stdout:6/118: dwrite d3/f10 [0,4194304] 0 2024-02-22T00:33:46.869 INFO:tasks.workunit.client.0.smithi049.stdout:2/150: rename d2/d9/de/d10/d33 to d2/d9/de/d3a 0 2024-02-22T00:33:46.871 INFO:tasks.workunit.client.0.smithi049.stdout:8/86: creat d1/d2/db/d15/f23 x:0 0 0 2024-02-22T00:33:46.871 INFO:tasks.workunit.client.0.smithi049.stdout:4/169: mknod d3/d8/d25/c2e 0 2024-02-22T00:33:46.872 INFO:tasks.workunit.client.0.smithi049.stdout:0/102: write d3/df/f11 [108447,1654] 0 2024-02-22T00:33:46.874 INFO:tasks.workunit.client.0.smithi049.stdout:2/151: dread - d2/d9/d17/f18 zero size 2024-02-22T00:33:46.875 INFO:tasks.workunit.client.0.smithi049.stdout:9/81: chown f10 85786 1 2024-02-22T00:33:46.875 INFO:tasks.workunit.client.0.smithi049.stdout:0/103: dread - d3/d6/d8/f1a zero size 2024-02-22T00:33:46.876 INFO:tasks.workunit.client.0.smithi049.stdout:7/152: chown d1/df/c15 906718783 1 2024-02-22T00:33:46.879 INFO:tasks.workunit.client.0.smithi049.stdout:6/119: write d3/f11 [837224,61363] 0 2024-02-22T00:33:46.882 INFO:tasks.workunit.client.0.smithi049.stdout:2/152: fsync d2/d9/fa 0 2024-02-22T00:33:46.884 INFO:tasks.workunit.client.0.smithi049.stdout:0/104: mkdir d3/df/d17/d1b 0 2024-02-22T00:33:46.885 INFO:tasks.workunit.client.0.smithi049.stdout:9/82: creat d17/d21/f23 x:0 0 0 2024-02-22T00:33:46.886 INFO:tasks.workunit.client.0.smithi049.stdout:2/153: stat d2/f6 0 2024-02-22T00:33:46.886 INFO:tasks.workunit.client.0.smithi049.stdout:7/153: write d1/df/f13 [12252374,112902] 0 2024-02-22T00:33:46.887 INFO:tasks.workunit.client.0.smithi049.stdout:3/29: dwrite d0/d1/f4 [0,4194304] 0 2024-02-22T00:33:46.887 INFO:tasks.workunit.client.0.smithi049.stdout:9/83: readlink l6 0 2024-02-22T00:33:46.890 INFO:tasks.workunit.client.0.smithi049.stdout:9/84: readlink l6 0 2024-02-22T00:33:46.896 INFO:tasks.workunit.client.0.smithi049.stdout:3/30: read d0/d1/f4 [62248,54018] 0 2024-02-22T00:33:46.897 INFO:tasks.workunit.client.0.smithi049.stdout:8/87: dwrite d1/f12 [4194304,4194304] 0 2024-02-22T00:33:46.898 INFO:tasks.workunit.client.0.smithi049.stdout:4/170: write d3/d8/d10/d12/f23 [4270604,44498] 0 2024-02-22T00:33:46.898 INFO:tasks.workunit.client.0.smithi049.stdout:9/85: mkdir d17/d21/d24 0 2024-02-22T00:33:46.901 INFO:tasks.workunit.client.0.smithi049.stdout:7/154: creat d1/df/d1b/d28/f36 x:0 0 0 2024-02-22T00:33:46.902 INFO:tasks.workunit.client.0.smithi049.stdout:2/154: truncate d2/d9/fa 6699539 0 2024-02-22T00:33:46.904 INFO:tasks.workunit.client.0.smithi049.stdout:0/105: rename d3/df/c10 to d3/d6/c1c 0 2024-02-22T00:33:46.905 INFO:tasks.workunit.client.0.smithi049.stdout:6/120: dwrite d3/f1a [0,4194304] 0 2024-02-22T00:33:46.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/106: readlink d3/l12 0 2024-02-22T00:33:46.908 INFO:tasks.workunit.client.0.smithi049.stdout:0/107: chown d3/df/f11 25966665 1 2024-02-22T00:33:46.909 INFO:tasks.workunit.client.0.smithi049.stdout:3/31: mknod d0/c5 0 2024-02-22T00:33:46.911 INFO:tasks.workunit.client.0.smithi049.stdout:3/32: chown d0/d1/f3 313664362 1 2024-02-22T00:33:46.913 INFO:tasks.workunit.client.0.smithi049.stdout:4/171: dread d3/d8/f1a [0,4194304] 0 2024-02-22T00:33:46.913 INFO:tasks.workunit.client.0.smithi049.stdout:7/155: symlink d1/l37 0 2024-02-22T00:33:46.913 INFO:tasks.workunit.client.0.smithi049.stdout:2/155: dread d2/d9/d17/f28 [0,4194304] 0 2024-02-22T00:33:46.916 INFO:tasks.workunit.client.0.smithi049.stdout:6/121: dread d3/fb [0,4194304] 0 2024-02-22T00:33:46.918 INFO:tasks.workunit.client.0.smithi049.stdout:0/108: unlink d3/d6/d8/ld 0 2024-02-22T00:33:46.919 INFO:tasks.workunit.client.0.smithi049.stdout:8/88: rename d1/d2/l4 to d1/d2/l24 0 2024-02-22T00:33:46.925 INFO:tasks.workunit.client.0.smithi049.stdout:7/156: rename d1/df/d12/d1c/d24/c25 to d1/df/d1b/d28/c38 0 2024-02-22T00:33:46.925 INFO:tasks.workunit.client.0.smithi049.stdout:8/89: dread d1/d2/f3 [0,4194304] 0 2024-02-22T00:33:46.927 INFO:tasks.workunit.client.0.smithi049.stdout:9/86: getdents d17/d1c 0 2024-02-22T00:33:46.927 INFO:tasks.workunit.client.0.smithi049.stdout:0/109: dread d3/f13 [0,4194304] 0 2024-02-22T00:33:46.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/33: creat d0/f6 x:0 0 0 2024-02-22T00:33:46.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/172: creat d3/f2f x:0 0 0 2024-02-22T00:33:46.930 INFO:tasks.workunit.client.0.smithi049.stdout:0/110: read - d3/d6/d8/f1a zero size 2024-02-22T00:33:46.930 INFO:tasks.workunit.client.0.smithi049.stdout:9/87: mkdir d17/d1c/d25 0 2024-02-22T00:33:46.931 INFO:tasks.workunit.client.0.smithi049.stdout:0/111: chown d3/c15 32 1 2024-02-22T00:33:46.934 INFO:tasks.workunit.client.0.smithi049.stdout:9/88: unlink f13 0 2024-02-22T00:33:46.937 INFO:tasks.workunit.client.0.smithi049.stdout:8/90: creat d1/d2/f25 x:0 0 0 2024-02-22T00:33:46.937 INFO:tasks.workunit.client.0.smithi049.stdout:2/156: getdents d2/d9/de/d10/d2e 0 2024-02-22T00:33:46.938 INFO:tasks.workunit.client.0.smithi049.stdout:4/173: dwrite d3/d8/f26 [0,4194304] 0 2024-02-22T00:33:46.945 INFO:tasks.workunit.client.0.smithi049.stdout:8/91: mknod d1/d2/db/d15/c26 0 2024-02-22T00:33:46.947 INFO:tasks.workunit.client.0.smithi049.stdout:4/174: creat d3/d8/d20/f30 x:0 0 0 2024-02-22T00:33:46.948 INFO:tasks.workunit.client.0.smithi049.stdout:4/175: dread - d3/d22/d24/f2c zero size 2024-02-22T00:33:46.949 INFO:tasks.workunit.client.0.smithi049.stdout:0/112: rename d3/d6/d8/c14 to d3/df/d17/c1d 0 2024-02-22T00:33:46.949 INFO:tasks.workunit.client.0.smithi049.stdout:7/157: truncate d1/df/f13 273129 0 2024-02-22T00:33:46.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/89: truncate f8 1104982 0 2024-02-22T00:33:46.951 INFO:tasks.workunit.client.0.smithi049.stdout:2/157: mknod d2/c3b 0 2024-02-22T00:33:46.952 INFO:tasks.workunit.client.0.smithi049.stdout:9/90: rename d17/d1c to d17/d1c/d26 22 2024-02-22T00:33:46.954 INFO:tasks.workunit.client.0.smithi049.stdout:4/176: creat d3/d8/d10/d12/f31 x:0 0 0 2024-02-22T00:33:46.955 INFO:tasks.workunit.client.0.smithi049.stdout:3/34: truncate d0/d1/f4 1447298 0 2024-02-22T00:33:46.958 INFO:tasks.workunit.client.0.smithi049.stdout:9/91: creat d17/f27 x:0 0 0 2024-02-22T00:33:46.959 INFO:tasks.workunit.client.0.smithi049.stdout:2/158: creat d2/d9/f3c x:0 0 0 2024-02-22T00:33:46.961 INFO:tasks.workunit.client.0.smithi049.stdout:7/158: dwrite d1/fe [0,4194304] 0 2024-02-22T00:33:46.967 INFO:tasks.workunit.client.0.smithi049.stdout:8/92: link d1/d2/db/f21 d1/d2/f27 0 2024-02-22T00:33:46.967 INFO:tasks.workunit.client.0.smithi049.stdout:3/35: stat d0/d1/f4 0 2024-02-22T00:33:46.967 INFO:tasks.workunit.client.0.smithi049.stdout:3/36: read - d0/d1/f3 zero size 2024-02-22T00:33:46.968 INFO:tasks.workunit.client.0.smithi049.stdout:9/92: rename d17/d1c/f22 to d17/d21/f28 0 2024-02-22T00:33:46.970 INFO:tasks.workunit.client.0.smithi049.stdout:4/177: creat d3/f32 x:0 0 0 2024-02-22T00:33:46.976 INFO:tasks.workunit.client.0.smithi049.stdout:0/113: dwrite d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:46.977 INFO:tasks.workunit.client.0.smithi049.stdout:8/93: rename d1/fa to d1/d2/db/f28 0 2024-02-22T00:33:46.980 INFO:tasks.workunit.client.0.smithi049.stdout:7/159: rmdir d1/df/d1b/d28/d35 0 2024-02-22T00:33:46.982 INFO:tasks.workunit.client.0.smithi049.stdout:4/178: unlink d3/d13/l2d 0 2024-02-22T00:33:46.983 INFO:tasks.workunit.client.0.smithi049.stdout:8/94: dread d1/f12 [4194304,4194304] 0 2024-02-22T00:33:46.983 INFO:tasks.workunit.client.0.smithi049.stdout:0/114: dread d3/df/f11 [0,4194304] 0 2024-02-22T00:33:46.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/179: write d3/d8/f26 [2593100,64546] 0 2024-02-22T00:33:46.985 INFO:tasks.workunit.client.0.smithi049.stdout:0/115: chown d3/d6/d8/la 6 1 2024-02-22T00:33:46.986 INFO:tasks.workunit.client.0.smithi049.stdout:4/180: chown d3/l6 9773 1 2024-02-22T00:33:46.986 INFO:tasks.workunit.client.0.smithi049.stdout:3/37: creat d0/f7 x:0 0 0 2024-02-22T00:33:46.989 INFO:tasks.workunit.client.0.smithi049.stdout:8/95: dread d1/fe [0,4194304] 0 2024-02-22T00:33:46.991 INFO:tasks.workunit.client.0.smithi049.stdout:8/96: write d1/d2/db/d15/f23 [769052,130780] 0 2024-02-22T00:33:46.991 INFO:tasks.workunit.client.0.smithi049.stdout:7/160: creat d1/df/d1b/d28/f39 x:0 0 0 2024-02-22T00:33:46.992 INFO:tasks.workunit.client.0.smithi049.stdout:9/93: rmdir d17 39 2024-02-22T00:33:46.995 INFO:tasks.workunit.client.0.smithi049.stdout:0/116: write d3/f13 [2039979,113867] 0 2024-02-22T00:33:46.996 INFO:tasks.workunit.client.0.smithi049.stdout:0/117: fsync d3/d6/f9 0 2024-02-22T00:33:46.998 INFO:tasks.workunit.client.0.smithi049.stdout:7/161: dread d1/fa [0,4194304] 0 2024-02-22T00:33:47.002 INFO:tasks.workunit.client.0.smithi049.stdout:8/97: fdatasync d1/d2/f3 0 2024-02-22T00:33:47.009 INFO:tasks.workunit.client.0.smithi049.stdout:7/162: symlink d1/df/d12/d1c/d1d/l3a 0 2024-02-22T00:33:47.010 INFO:tasks.workunit.client.0.smithi049.stdout:7/163: dread - d1/df/d1b/f20 zero size 2024-02-22T00:33:47.010 INFO:tasks.workunit.client.0.smithi049.stdout:9/94: creat d17/d21/f29 x:0 0 0 2024-02-22T00:33:47.010 INFO:tasks.workunit.client.0.smithi049.stdout:9/95: stat c16 0 2024-02-22T00:33:47.011 INFO:tasks.workunit.client.0.smithi049.stdout:7/164: fsync d1/df/d1b/d28/f36 0 2024-02-22T00:33:47.013 INFO:tasks.workunit.client.0.smithi049.stdout:0/118: mkdir d3/d1e 0 2024-02-22T00:33:47.015 INFO:tasks.workunit.client.0.smithi049.stdout:9/96: symlink d17/d1c/l2a 0 2024-02-22T00:33:47.016 INFO:tasks.workunit.client.0.smithi049.stdout:0/119: dread d3/f13 [0,4194304] 0 2024-02-22T00:33:47.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/181: getdents d3/d8/d25 0 2024-02-22T00:33:47.018 INFO:tasks.workunit.client.0.smithi049.stdout:7/165: creat d1/df/d1b/f3b x:0 0 0 2024-02-22T00:33:47.018 INFO:tasks.workunit.client.0.smithi049.stdout:3/38: dread d0/d1/f4 [0,4194304] 0 2024-02-22T00:33:47.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/97: creat d17/d1c/f2b x:0 0 0 2024-02-22T00:33:47.025 INFO:tasks.workunit.client.0.smithi049.stdout:4/182: mkdir d3/d33 0 2024-02-22T00:33:47.028 INFO:tasks.workunit.client.0.smithi049.stdout:7/166: symlink d1/df/d12/d1c/d24/d2e/l3c 0 2024-02-22T00:33:47.029 INFO:tasks.workunit.client.0.smithi049.stdout:9/98: creat d17/d1c/f2c x:0 0 0 2024-02-22T00:33:47.034 INFO:tasks.workunit.client.0.smithi049.stdout:0/120: dwrite d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:47.035 INFO:tasks.workunit.client.0.smithi049.stdout:3/39: dwrite d0/f7 [0,4194304] 0 2024-02-22T00:33:47.037 INFO:tasks.workunit.client.0.smithi049.stdout:9/99: truncate f4 793038 0 2024-02-22T00:33:47.038 INFO:tasks.workunit.client.0.smithi049.stdout:4/183: creat d3/d22/f34 x:0 0 0 2024-02-22T00:33:47.038 INFO:tasks.workunit.client.0.smithi049.stdout:7/167: creat d1/f3d x:0 0 0 2024-02-22T00:33:47.043 INFO:tasks.workunit.client.0.smithi049.stdout:8/98: dwrite d1/d2/f27 [0,4194304] 0 2024-02-22T00:33:47.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/168: dread - d1/f3d zero size 2024-02-22T00:33:47.047 INFO:tasks.workunit.client.0.smithi049.stdout:4/184: mkdir d3/d22/d24/d35 0 2024-02-22T00:33:47.049 INFO:tasks.workunit.client.0.smithi049.stdout:9/100: write d17/f1f [574588,31343] 0 2024-02-22T00:33:47.049 INFO:tasks.workunit.client.0.smithi049.stdout:3/40: dread d0/d1/f4 [0,4194304] 0 2024-02-22T00:33:47.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/41: dread - d0/f6 zero size 2024-02-22T00:33:47.054 INFO:tasks.workunit.client.0.smithi049.stdout:7/169: link d1/df/d12/f11 d1/df/d1b/f3e 0 2024-02-22T00:33:47.056 INFO:tasks.workunit.client.0.smithi049.stdout:8/99: dwrite d1/d2/db/f21 [0,4194304] 0 2024-02-22T00:33:47.059 INFO:tasks.workunit.client.0.smithi049.stdout:9/101: mknod d17/d21/d24/c2d 0 2024-02-22T00:33:47.060 INFO:tasks.workunit.client.0.smithi049.stdout:3/42: symlink d0/d1/l8 0 2024-02-22T00:33:47.061 INFO:tasks.workunit.client.0.smithi049.stdout:9/102: write d17/f1a [686102,4212] 0 2024-02-22T00:33:47.063 INFO:tasks.workunit.client.0.smithi049.stdout:9/103: stat d17/d21/f29 0 2024-02-22T00:33:47.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/43: dread d0/d1/f4 [0,4194304] 0 2024-02-22T00:33:47.065 INFO:tasks.workunit.client.0.smithi049.stdout:8/100: symlink d1/d2/d5/d1b/l29 0 2024-02-22T00:33:47.066 INFO:tasks.workunit.client.0.smithi049.stdout:7/170: rmdir d1/df/d12 39 2024-02-22T00:33:47.067 INFO:tasks.workunit.client.0.smithi049.stdout:4/185: write d3/d8/fd [3701585,40027] 0 2024-02-22T00:33:47.068 INFO:tasks.workunit.client.0.smithi049.stdout:9/104: symlink d17/d1c/l2e 0 2024-02-22T00:33:47.070 INFO:tasks.workunit.client.0.smithi049.stdout:3/44: write d0/f6 [893490,81200] 0 2024-02-22T00:33:47.071 INFO:tasks.workunit.client.0.smithi049.stdout:9/105: fdatasync d17/f1f 0 2024-02-22T00:33:47.073 INFO:tasks.workunit.client.0.smithi049.stdout:0/121: dwrite d3/f13 [0,4194304] 0 2024-02-22T00:33:47.074 INFO:tasks.workunit.client.0.smithi049.stdout:8/101: fsync d1/d2/db/f28 0 2024-02-22T00:33:47.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/45: read - d0/d1/f3 zero size 2024-02-22T00:33:47.079 INFO:tasks.workunit.client.0.smithi049.stdout:8/102: fsync d1/d2/f25 0 2024-02-22T00:33:47.081 INFO:tasks.workunit.client.0.smithi049.stdout:9/106: write d17/d1c/f1e [4319671,78446] 0 2024-02-22T00:33:47.083 INFO:tasks.workunit.client.0.smithi049.stdout:3/46: unlink d0/f7 0 2024-02-22T00:33:47.084 INFO:tasks.workunit.client.0.smithi049.stdout:7/171: chown d1/df/d12/d1c/d1d/l2f 24854 1 2024-02-22T00:33:47.084 INFO:tasks.workunit.client.0.smithi049.stdout:8/103: mknod d1/d2/db/d1c/c2a 0 2024-02-22T00:33:47.086 INFO:tasks.workunit.client.0.smithi049.stdout:9/107: truncate f10 557483 0 2024-02-22T00:33:47.092 INFO:tasks.workunit.client.0.smithi049.stdout:9/108: write f11 [1249151,34961] 0 2024-02-22T00:33:47.092 INFO:tasks.workunit.client.0.smithi049.stdout:0/122: dwrite d3/f13 [0,4194304] 0 2024-02-22T00:33:47.092 INFO:tasks.workunit.client.0.smithi049.stdout:4/186: dwrite d3/d22/f34 [0,4194304] 0 2024-02-22T00:33:47.092 INFO:tasks.workunit.client.0.smithi049.stdout:4/187: chown d3/d8 4793563 1 2024-02-22T00:33:47.095 INFO:tasks.workunit.client.0.smithi049.stdout:7/172: creat d1/df/d12/f3f x:0 0 0 2024-02-22T00:33:47.095 INFO:tasks.workunit.client.0.smithi049.stdout:0/123: chown d3/d6/cb 112 1 2024-02-22T00:33:47.095 INFO:tasks.workunit.client.0.smithi049.stdout:8/104: truncate d1/d2/db/d15/f10 863796 0 2024-02-22T00:33:47.097 INFO:tasks.workunit.client.0.smithi049.stdout:9/109: mknod d17/d1c/d25/c2f 0 2024-02-22T00:33:47.100 INFO:tasks.workunit.client.0.smithi049.stdout:8/105: symlink d1/d2/db/l2b 0 2024-02-22T00:33:47.102 INFO:tasks.workunit.client.0.smithi049.stdout:9/110: stat f8 0 2024-02-22T00:33:47.107 INFO:tasks.workunit.client.0.smithi049.stdout:9/111: chown d17/d1c/f2b 32588203 1 2024-02-22T00:33:47.113 INFO:tasks.workunit.client.0.smithi049.stdout:4/188: dwrite d3/d8/d10/d12/f31 [0,4194304] 0 2024-02-22T00:33:47.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/106: truncate d1/d2/db/d1c/f20 4905205 0 2024-02-22T00:33:47.114 INFO:tasks.workunit.client.0.smithi049.stdout:7/173: dwrite d1/df/d1b/d28/f36 [0,4194304] 0 2024-02-22T00:33:47.115 INFO:tasks.workunit.client.0.smithi049.stdout:0/124: dwrite d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:47.115 INFO:tasks.workunit.client.0.smithi049.stdout:9/112: creat d17/d21/f30 x:0 0 0 2024-02-22T00:33:47.122 INFO:tasks.workunit.client.0.smithi049.stdout:8/107: creat d1/d2/d5/f2c x:0 0 0 2024-02-22T00:33:47.122 INFO:tasks.workunit.client.0.smithi049.stdout:4/189: creat d3/d22/d24/f36 x:0 0 0 2024-02-22T00:33:47.156 INFO:tasks.workunit.client.0.smithi049.stdout:1/67: sync 2024-02-22T00:33:47.157 INFO:tasks.workunit.client.0.smithi049.stdout:8/108: mkdir d1/d2/db/d15/d2d 0 2024-02-22T00:33:47.161 INFO:tasks.workunit.client.0.smithi049.stdout:4/190: creat d3/d8/d25/f37 x:0 0 0 2024-02-22T00:33:47.162 INFO:tasks.workunit.client.0.smithi049.stdout:9/113: rename cf to d17/d1c/c31 0 2024-02-22T00:33:47.163 INFO:tasks.workunit.client.0.smithi049.stdout:0/125: mknod d3/df/d17/d1b/c1f 0 2024-02-22T00:33:47.163 INFO:tasks.workunit.client.0.smithi049.stdout:1/68: write d2/d8/da/f14 [801570,111729] 0 2024-02-22T00:33:47.164 INFO:tasks.workunit.client.0.smithi049.stdout:4/191: write f2 [5708927,16149] 0 2024-02-22T00:33:47.164 INFO:tasks.workunit.client.0.smithi049.stdout:9/114: chown d17/d1c/l2a 845095 1 2024-02-22T00:33:47.166 INFO:tasks.workunit.client.0.smithi049.stdout:8/109: unlink d1/d2/d5/l13 0 2024-02-22T00:33:47.167 INFO:tasks.workunit.client.0.smithi049.stdout:7/174: creat d1/df/d12/d1c/d24/f40 x:0 0 0 2024-02-22T00:33:47.169 INFO:tasks.workunit.client.0.smithi049.stdout:9/115: fsync f12 0 2024-02-22T00:33:47.171 INFO:tasks.workunit.client.0.smithi049.stdout:1/69: mknod d2/d8/db/c18 0 2024-02-22T00:33:47.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/116: dread - d17/f27 zero size 2024-02-22T00:33:47.173 INFO:tasks.workunit.client.0.smithi049.stdout:4/192: dread d3/d8/f14 [0,4194304] 0 2024-02-22T00:33:47.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/117: dread - d17/f27 zero size 2024-02-22T00:33:47.176 INFO:tasks.workunit.client.0.smithi049.stdout:7/175: rename d1/df/d1b to d1/d41 0 2024-02-22T00:33:47.176 INFO:tasks.workunit.client.0.smithi049.stdout:8/110: dread d1/d2/db/d15/f23 [0,4194304] 0 2024-02-22T00:33:47.178 INFO:tasks.workunit.client.0.smithi049.stdout:0/126: dwrite d3/df/f16 [0,4194304] 0 2024-02-22T00:33:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:45.622819+0000 mgr.smithi161.sazlam (mgr.24369) 54 : audit [DBG] from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:45.762958+0000 mgr.smithi161.sazlam (mgr.24369) 55 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 965 MiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 26 MiB/s rd, 45 MiB/s wr, 199 op/s 2024-02-22T00:33:47.181 INFO:tasks.workunit.client.0.smithi049.stdout:4/193: creat d3/d8/d10/d12/f38 x:0 0 0 2024-02-22T00:33:47.182 INFO:tasks.workunit.client.0.smithi049.stdout:1/70: link d2/d8/f13 d2/d8/db/f19 0 2024-02-22T00:33:47.190 INFO:tasks.workunit.client.0.smithi049.stdout:7/176: rename d1/df/d12/f3f to d1/df/d12/d1c/d24/d2e/f42 0 2024-02-22T00:33:47.191 INFO:tasks.workunit.client.0.smithi049.stdout:9/118: dwrite d17/d21/f30 [0,4194304] 0 2024-02-22T00:33:47.195 INFO:tasks.workunit.client.0.smithi049.stdout:8/111: rmdir d1/d2/db/d15/d2d 0 2024-02-22T00:33:47.195 INFO:tasks.workunit.client.0.smithi049.stdout:0/127: dwrite d3/df/f16 [0,4194304] 0 2024-02-22T00:33:47.198 INFO:tasks.workunit.client.0.smithi049.stdout:9/119: write d17/d21/f28 [239482,42913] 0 2024-02-22T00:33:47.199 INFO:tasks.workunit.client.0.smithi049.stdout:8/112: read d1/d2/db/d1c/f20 [799714,95522] 0 2024-02-22T00:33:47.201 INFO:tasks.workunit.client.0.smithi049.stdout:4/194: dread f2 [4194304,4194304] 0 2024-02-22T00:33:47.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/128: rename d3/df/f16 to d3/df/d17/f20 0 2024-02-22T00:33:47.205 INFO:tasks.workunit.client.0.smithi049.stdout:0/129: write d3/f13 [2163389,35589] 0 2024-02-22T00:33:47.206 INFO:tasks.workunit.client.0.smithi049.stdout:1/71: truncate d2/d8/f13 3678829 0 2024-02-22T00:33:47.208 INFO:tasks.workunit.client.0.smithi049.stdout:1/72: read d2/f3 [2095890,7488] 0 2024-02-22T00:33:47.209 INFO:tasks.workunit.client.0.smithi049.stdout:7/177: getdents d1/df/d12/d1c 0 2024-02-22T00:33:47.210 INFO:tasks.workunit.client.0.smithi049.stdout:9/120: dwrite f11 [0,4194304] 0 2024-02-22T00:33:47.211 INFO:tasks.workunit.client.0.smithi049.stdout:9/121: readlink d17/l1b 0 2024-02-22T00:33:47.212 INFO:tasks.workunit.client.0.smithi049.stdout:4/195: rename d3/d8/d25 to d3/d8/d10/d39 0 2024-02-22T00:33:47.213 INFO:tasks.workunit.client.0.smithi049.stdout:4/196: chown l0 203462 1 2024-02-22T00:33:47.213 INFO:tasks.workunit.client.0.smithi049.stdout:1/73: creat d2/d8/db/f1a x:0 0 0 2024-02-22T00:33:47.217 INFO:tasks.workunit.client.0.smithi049.stdout:0/130: unlink c0 0 2024-02-22T00:33:47.219 INFO:tasks.workunit.client.0.smithi049.stdout:8/113: creat d1/d2/f2e x:0 0 0 2024-02-22T00:33:47.225 INFO:tasks.workunit.client.0.smithi049.stdout:4/197: getdents d3/d22/d24 0 2024-02-22T00:33:47.225 INFO:tasks.workunit.client.0.smithi049.stdout:1/74: dwrite d2/f4 [0,4194304] 0 2024-02-22T00:33:47.230 INFO:tasks.workunit.client.0.smithi049.stdout:1/75: write d2/d8/db/f1a [4268,54850] 0 2024-02-22T00:33:47.232 INFO:tasks.workunit.client.0.smithi049.stdout:0/131: dwrite d3/f13 [0,4194304] 0 2024-02-22T00:33:47.237 INFO:tasks.workunit.client.0.smithi049.stdout:0/132: mknod d3/df/c21 0 2024-02-22T00:33:47.238 INFO:tasks.workunit.client.0.smithi049.stdout:1/76: write d2/d8/db/f1a [234264,102504] 0 2024-02-22T00:33:47.247 INFO:tasks.workunit.client.0.smithi049.stdout:0/133: write d3/d6/f9 [474700,57207] 0 2024-02-22T00:33:47.252 INFO:tasks.workunit.client.0.smithi049.stdout:1/77: mknod d2/d8/c1b 0 2024-02-22T00:33:47.254 INFO:tasks.workunit.client.0.smithi049.stdout:9/122: dwrite f8 [0,4194304] 0 2024-02-22T00:33:47.257 INFO:tasks.workunit.client.0.smithi049.stdout:4/198: dwrite d3/d8/d10/f11 [0,4194304] 0 2024-02-22T00:33:47.258 INFO:tasks.workunit.client.0.smithi049.stdout:8/114: dwrite d1/d2/db/f28 [0,4194304] 0 2024-02-22T00:33:47.258 INFO:tasks.workunit.client.0.smithi049.stdout:7/178: dwrite d1/df/d12/f11 [4194304,4194304] 0 2024-02-22T00:33:47.266 INFO:tasks.workunit.client.0.smithi049.stdout:9/123: chown ca 61 1 2024-02-22T00:33:47.266 INFO:tasks.workunit.client.0.smithi049.stdout:4/199: readlink d3/l1e 0 2024-02-22T00:33:47.266 INFO:tasks.workunit.client.0.smithi049.stdout:1/78: creat d2/d8/db/f1c x:0 0 0 2024-02-22T00:33:47.266 INFO:tasks.workunit.client.0.smithi049.stdout:9/124: dread - d17/f27 zero size 2024-02-22T00:33:47.267 INFO:tasks.workunit.client.0.smithi049.stdout:9/125: readlink d17/l1b 0 2024-02-22T00:33:47.267 INFO:tasks.workunit.client.0.smithi049.stdout:8/115: rename d1/d2/d5/c1d to d1/d2/d5/d1b/c2f 0 2024-02-22T00:33:47.269 INFO:tasks.workunit.client.0.smithi049.stdout:0/134: dread d3/f13 [0,4194304] 0 2024-02-22T00:33:47.270 INFO:tasks.workunit.client.0.smithi049.stdout:4/200: unlink d3/d8/d20/f30 0 2024-02-22T00:33:47.274 INFO:tasks.workunit.client.0.smithi049.stdout:1/79: rename d2/d8/db/ce to d2/d8/c1d 0 2024-02-22T00:33:47.274 INFO:tasks.workunit.client.0.smithi049.stdout:9/126: creat d17/d21/d24/f32 x:0 0 0 2024-02-22T00:33:47.275 INFO:tasks.workunit.client.0.smithi049.stdout:0/135: symlink d3/df/d17/d1b/l22 0 2024-02-22T00:33:47.278 INFO:tasks.workunit.client.0.smithi049.stdout:0/136: creat d3/df/d17/d1b/f23 x:0 0 0 2024-02-22T00:33:47.279 INFO:tasks.workunit.client.0.smithi049.stdout:4/201: mknod d3/c3a 0 2024-02-22T00:33:47.282 INFO:tasks.workunit.client.0.smithi049.stdout:1/80: rename d2/f17 to d2/d8/da/f1e 0 2024-02-22T00:33:47.285 INFO:tasks.workunit.client.0.smithi049.stdout:4/202: chown d3/d8/d10/d12/f31 1795366518 1 2024-02-22T00:33:47.286 INFO:tasks.workunit.client.0.smithi049.stdout:1/81: symlink d2/d8/l1f 0 2024-02-22T00:33:47.286 INFO:tasks.workunit.client.0.smithi049.stdout:9/127: dwrite d17/d21/f29 [0,4194304] 0 2024-02-22T00:33:47.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/179: truncate d1/df/f18 3777835 0 2024-02-22T00:33:47.288 INFO:tasks.workunit.client.0.smithi049.stdout:0/137: dread d3/df/d17/f20 [0,4194304] 0 2024-02-22T00:33:47.290 INFO:tasks.workunit.client.0.smithi049.stdout:1/82: stat d2/d8/db/f12 0 2024-02-22T00:33:47.290 INFO:tasks.workunit.client.0.smithi049.stdout:9/128: chown d17/d21/d24/f32 5 1 2024-02-22T00:33:47.295 INFO:tasks.workunit.client.0.smithi049.stdout:7/180: symlink d1/d41/d28/l43 0 2024-02-22T00:33:47.295 INFO:tasks.workunit.client.0.smithi049.stdout:0/138: write d3/d6/d8/f1a [4199903,114980] 0 2024-02-22T00:33:47.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:45.622819+0000 mgr.smithi161.sazlam (mgr.24369) 54 : audit [DBG] from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:33:47.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:45.762958+0000 mgr.smithi161.sazlam (mgr.24369) 55 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 965 MiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 26 MiB/s rd, 45 MiB/s wr, 199 op/s 2024-02-22T00:33:47.296 INFO:tasks.workunit.client.0.smithi049.stdout:1/83: symlink d2/d8/db/l20 0 2024-02-22T00:33:47.297 INFO:tasks.workunit.client.0.smithi049.stdout:9/129: dread d17/d21/f28 [0,4194304] 0 2024-02-22T00:33:47.297 INFO:tasks.workunit.client.0.smithi049.stdout:1/84: stat d2/f4 0 2024-02-22T00:33:47.298 INFO:tasks.workunit.client.0.smithi049.stdout:4/203: dread d3/d8/f17 [0,4194304] 0 2024-02-22T00:33:47.299 INFO:tasks.workunit.client.0.smithi049.stdout:7/181: symlink d1/d41/d28/l44 0 2024-02-22T00:33:47.303 INFO:tasks.workunit.client.0.smithi049.stdout:8/116: dwrite d1/d2/f27 [0,4194304] 0 2024-02-22T00:33:47.306 INFO:tasks.workunit.client.0.smithi049.stdout:0/139: write d3/f13 [1774338,2753] 0 2024-02-22T00:33:47.306 INFO:tasks.workunit.client.0.smithi049.stdout:9/130: rmdir d17/d21/d24 39 2024-02-22T00:33:47.307 INFO:tasks.workunit.client.0.smithi049.stdout:8/117: stat d1/d2/d5/d1b/l29 0 2024-02-22T00:33:47.308 INFO:tasks.workunit.client.0.smithi049.stdout:9/131: chown f11 71 1 2024-02-22T00:33:47.309 INFO:tasks.workunit.client.0.smithi049.stdout:7/182: chown d1/df/d12/d1c/d24/d2e/l31 97348 1 2024-02-22T00:33:47.311 INFO:tasks.workunit.client.0.smithi049.stdout:8/118: truncate d1/d2/d5/f2c 307255 0 2024-02-22T00:33:47.312 INFO:tasks.workunit.client.0.smithi049.stdout:8/119: readlink d1/d2/d5/d1b/l29 0 2024-02-22T00:33:47.316 INFO:tasks.workunit.client.0.smithi049.stdout:4/204: link d3/d8/d10/d39/c2e d3/c3b 0 2024-02-22T00:33:47.317 INFO:tasks.workunit.client.0.smithi049.stdout:0/140: getdents d3/df/d17 0 2024-02-22T00:33:47.318 INFO:tasks.workunit.client.0.smithi049.stdout:8/120: mkdir d1/d2/db/d15/d30 0 2024-02-22T00:33:47.318 INFO:tasks.workunit.client.0.smithi049.stdout:9/132: dwrite d17/d21/f30 [0,4194304] 0 2024-02-22T00:33:47.322 INFO:tasks.workunit.client.0.smithi049.stdout:5/68: sync 2024-02-22T00:33:47.326 INFO:tasks.workunit.client.0.smithi049.stdout:7/183: link d1/df/d12/f30 d1/df/f45 0 2024-02-22T00:33:47.326 INFO:tasks.workunit.client.0.smithi049.stdout:9/133: write d17/f18 [2776252,42083] 0 2024-02-22T00:33:47.332 INFO:tasks.workunit.client.0.smithi049.stdout:1/85: dwrite d2/d8/f9 [0,4194304] 0 2024-02-22T00:33:47.332 INFO:tasks.workunit.client.0.smithi049.stdout:7/184: creat d1/df/d12/d1c/d1d/f46 x:0 0 0 2024-02-22T00:33:47.340 INFO:tasks.workunit.client.0.smithi049.stdout:8/121: link d1/d2/db/d15/f10 d1/d2/f31 0 2024-02-22T00:33:47.340 INFO:tasks.workunit.client.0.smithi049.stdout:0/141: dwrite d3/df/d17/d1b/f23 [0,4194304] 0 2024-02-22T00:33:47.341 INFO:tasks.workunit.client.0.smithi049.stdout:7/185: creat d1/df/d12/d1c/d1d/f47 x:0 0 0 2024-02-22T00:33:47.341 INFO:tasks.workunit.client.0.smithi049.stdout:4/205: dwrite d3/d8/d10/d12/f31 [0,4194304] 0 2024-02-22T00:33:47.342 INFO:tasks.workunit.client.0.smithi049.stdout:1/86: fdatasync d2/d8/da/f1e 0 2024-02-22T00:33:47.343 INFO:tasks.workunit.client.0.smithi049.stdout:4/206: write f1 [2368141,68049] 0 2024-02-22T00:33:47.346 INFO:tasks.workunit.client.0.smithi049.stdout:9/134: creat d17/d21/f33 x:0 0 0 2024-02-22T00:33:47.346 INFO:tasks.workunit.client.0.smithi049.stdout:8/122: write d1/d2/db/f28 [4797604,68741] 0 2024-02-22T00:33:47.347 INFO:tasks.workunit.client.0.smithi049.stdout:0/142: read d3/df/d17/d1b/f23 [3242053,23883] 0 2024-02-22T00:33:47.347 INFO:tasks.workunit.client.0.smithi049.stdout:1/87: mknod d2/c21 0 2024-02-22T00:33:47.349 INFO:tasks.workunit.client.0.smithi049.stdout:7/186: mkdir d1/df/d12/d48 0 2024-02-22T00:33:47.355 INFO:tasks.workunit.client.0.smithi049.stdout:9/135: rename f4 to d17/d1c/d25/f34 0 2024-02-22T00:33:47.357 INFO:tasks.workunit.client.0.smithi049.stdout:4/207: dwrite d3/f32 [0,4194304] 0 2024-02-22T00:33:47.358 INFO:tasks.workunit.client.0.smithi049.stdout:4/208: stat d3/d13/c18 0 2024-02-22T00:33:47.361 INFO:tasks.workunit.client.0.smithi049.stdout:7/187: mkdir d1/d49 0 2024-02-22T00:33:47.361 INFO:tasks.workunit.client.0.smithi049.stdout:5/69: truncate d0/de/fb 2237098 0 2024-02-22T00:33:47.362 INFO:tasks.workunit.client.0.smithi049.stdout:0/143: dwrite d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:47.363 INFO:tasks.workunit.client.0.smithi049.stdout:1/88: creat d2/d8/da/f22 x:0 0 0 2024-02-22T00:33:47.367 INFO:tasks.workunit.client.0.smithi049.stdout:5/70: symlink d0/de/l1b 0 2024-02-22T00:33:47.369 INFO:tasks.workunit.client.0.smithi049.stdout:0/144: creat d3/df/d17/f24 x:0 0 0 2024-02-22T00:33:47.374 INFO:tasks.workunit.client.0.smithi049.stdout:9/136: rename d17/d21/d24/f32 to d17/f35 0 2024-02-22T00:33:47.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/145: symlink d3/df/d17/l25 0 2024-02-22T00:33:47.376 INFO:tasks.workunit.client.0.smithi049.stdout:7/188: creat d1/f4a x:0 0 0 2024-02-22T00:33:47.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/209: getdents d3/d8/d10/d39 0 2024-02-22T00:33:47.378 INFO:tasks.workunit.client.0.smithi049.stdout:7/189: dread - d1/df/d12/d1c/d24/d2e/f42 zero size 2024-02-22T00:33:47.378 INFO:tasks.workunit.client.0.smithi049.stdout:5/71: creat d0/d1a/f1c x:0 0 0 2024-02-22T00:33:47.379 INFO:tasks.workunit.client.0.smithi049.stdout:7/190: chown d1/d41/f20 581 1 2024-02-22T00:33:47.381 INFO:tasks.workunit.client.0.smithi049.stdout:4/210: creat d3/d8/d20/f3c x:0 0 0 2024-02-22T00:33:47.382 INFO:tasks.workunit.client.0.smithi049.stdout:5/72: write d0/de/d6/f12 [1074493,4417] 0 2024-02-22T00:33:47.383 INFO:tasks.workunit.client.0.smithi049.stdout:0/146: creat d3/d6/f26 x:0 0 0 2024-02-22T00:33:47.384 INFO:tasks.workunit.client.0.smithi049.stdout:5/73: fdatasync d0/d1a/f1c 0 2024-02-22T00:33:47.385 INFO:tasks.workunit.client.0.smithi049.stdout:7/191: write d1/df/d12/d1c/d1d/f34 [122509,28126] 0 2024-02-22T00:33:47.387 INFO:tasks.workunit.client.0.smithi049.stdout:0/147: mkdir d3/df/d17/d27 0 2024-02-22T00:33:47.388 INFO:tasks.workunit.client.0.smithi049.stdout:5/74: fdatasync d0/de/d6/f13 0 2024-02-22T00:33:47.388 INFO:tasks.workunit.client.0.smithi049.stdout:4/211: getdents d3/d22 0 2024-02-22T00:33:47.389 INFO:tasks.workunit.client.0.smithi049.stdout:8/123: dwrite d1/f12 [0,4194304] 0 2024-02-22T00:33:47.391 INFO:tasks.workunit.client.0.smithi049.stdout:4/212: truncate d3/f32 5130929 0 2024-02-22T00:33:47.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/75: write d0/de/d6/f13 [599473,11972] 0 2024-02-22T00:33:47.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/148: creat d3/df/d17/d1b/f28 x:0 0 0 2024-02-22T00:33:47.394 INFO:tasks.workunit.client.0.smithi049.stdout:8/124: unlink d1/d2/d5/l14 0 2024-02-22T00:33:47.396 INFO:tasks.workunit.client.0.smithi049.stdout:4/213: chown d3/d22/d24/l27 40 1 2024-02-22T00:33:47.397 INFO:tasks.workunit.client.0.smithi049.stdout:1/89: rmdir d2/d8/da 39 2024-02-22T00:33:47.399 INFO:tasks.workunit.client.0.smithi049.stdout:9/137: truncate d17/d1c/d25/f34 1155158 0 2024-02-22T00:33:47.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/125: creat d1/d2/d5/d1b/f32 x:0 0 0 2024-02-22T00:33:47.402 INFO:tasks.workunit.client.0.smithi049.stdout:4/214: mkdir d3/d22/d3d 0 2024-02-22T00:33:47.405 INFO:tasks.workunit.client.0.smithi049.stdout:9/138: rmdir d17/d21 39 2024-02-22T00:33:47.407 INFO:tasks.workunit.client.0.smithi049.stdout:4/215: dread d3/d8/f26 [0,4194304] 0 2024-02-22T00:33:47.409 INFO:tasks.workunit.client.0.smithi049.stdout:1/90: fdatasync d2/d8/ff 0 2024-02-22T00:33:47.409 INFO:tasks.workunit.client.0.smithi049.stdout:7/192: write d1/f8 [4266340,26270] 0 2024-02-22T00:33:47.411 INFO:tasks.workunit.client.0.smithi049.stdout:1/91: dread - d2/d8/db/f12 zero size 2024-02-22T00:33:47.415 INFO:tasks.workunit.client.0.smithi049.stdout:7/193: rmdir d1/df/d12/d1c/d1d 39 2024-02-22T00:33:47.418 INFO:tasks.workunit.client.0.smithi049.stdout:1/92: rename d2/d8/f9 to d2/f23 0 2024-02-22T00:33:47.420 INFO:tasks.workunit.client.0.smithi049.stdout:0/149: truncate d3/df/d17/d1b/f23 3602331 0 2024-02-22T00:33:47.422 INFO:tasks.workunit.client.0.smithi049.stdout:4/216: creat d3/f3e x:0 0 0 2024-02-22T00:33:47.424 INFO:tasks.workunit.client.0.smithi049.stdout:1/93: mknod d2/c24 0 2024-02-22T00:33:47.425 INFO:tasks.workunit.client.0.smithi049.stdout:8/126: dwrite d1/f1e [0,4194304] 0 2024-02-22T00:33:47.427 INFO:tasks.workunit.client.0.smithi049.stdout:1/94: readlink d2/l15 0 2024-02-22T00:33:47.430 INFO:tasks.workunit.client.0.smithi049.stdout:7/194: creat d1/df/d12/d1c/d24/f4b x:0 0 0 2024-02-22T00:33:47.430 INFO:tasks.workunit.client.0.smithi049.stdout:8/127: chown d1/fe 30 1 2024-02-22T00:33:47.433 INFO:tasks.workunit.client.0.smithi049.stdout:1/95: chown d2/d8/f13 9076 1 2024-02-22T00:33:47.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/128: chown d1/d2/d5/f2c 2803151 1 2024-02-22T00:33:47.440 INFO:tasks.workunit.client.0.smithi049.stdout:0/150: dwrite d3/d6/f26 [0,4194304] 0 2024-02-22T00:33:47.441 INFO:tasks.workunit.client.0.smithi049.stdout:1/96: mkdir d2/d8/db/d25 0 2024-02-22T00:33:47.443 INFO:tasks.workunit.client.0.smithi049.stdout:4/217: dwrite d3/d8/d10/d12/f38 [0,4194304] 0 2024-02-22T00:33:47.443 INFO:tasks.workunit.client.0.smithi049.stdout:8/129: mkdir d1/d2/db/d15/d33 0 2024-02-22T00:33:47.445 INFO:tasks.workunit.client.0.smithi049.stdout:0/151: write d3/d6/f26 [1379945,73740] 0 2024-02-22T00:33:47.450 INFO:tasks.workunit.client.0.smithi049.stdout:1/97: creat d2/d8/db/f26 x:0 0 0 2024-02-22T00:33:47.453 INFO:tasks.workunit.client.0.smithi049.stdout:5/76: dwrite d0/de/d6/fd [0,4194304] 0 2024-02-22T00:33:47.454 INFO:tasks.workunit.client.0.smithi049.stdout:7/195: rename d1/df/d12/d1c/d1d/l3a to d1/df/d12/l4c 0 2024-02-22T00:33:47.455 INFO:tasks.workunit.client.0.smithi049.stdout:4/218: unlink d3/d13/c18 0 2024-02-22T00:33:47.457 INFO:tasks.workunit.client.0.smithi049.stdout:1/98: fsync d2/d8/da/f1e 0 2024-02-22T00:33:47.458 INFO:tasks.workunit.client.0.smithi049.stdout:0/152: mkdir d3/d6/d29 0 2024-02-22T00:33:47.459 INFO:tasks.workunit.client.0.smithi049.stdout:5/77: creat d0/f1d x:0 0 0 2024-02-22T00:33:47.460 INFO:tasks.workunit.client.0.smithi049.stdout:8/130: dwrite d1/f12 [0,4194304] 0 2024-02-22T00:33:47.461 INFO:tasks.workunit.client.0.smithi049.stdout:4/219: write d3/d8/f14 [402170,61459] 0 2024-02-22T00:33:47.465 INFO:tasks.workunit.client.0.smithi049.stdout:0/153: symlink d3/d1e/l2a 0 2024-02-22T00:33:47.465 INFO:tasks.workunit.client.0.smithi049.stdout:5/78: creat d0/de/d6/f1e x:0 0 0 2024-02-22T00:33:47.466 INFO:tasks.workunit.client.0.smithi049.stdout:1/99: creat d2/d8/f27 x:0 0 0 2024-02-22T00:33:47.467 INFO:tasks.workunit.client.0.smithi049.stdout:4/220: mkdir d3/d8/d10/d12/d3f 0 2024-02-22T00:33:47.471 INFO:tasks.workunit.client.0.smithi049.stdout:0/154: unlink d3/d6/cb 0 2024-02-22T00:33:47.474 INFO:tasks.workunit.client.0.smithi049.stdout:0/155: write d3/f13 [1925806,93950] 0 2024-02-22T00:33:47.477 INFO:tasks.workunit.client.0.smithi049.stdout:1/100: dread d2/d8/da/fd [0,4194304] 0 2024-02-22T00:33:47.478 INFO:tasks.workunit.client.0.smithi049.stdout:5/79: dwrite d0/de/fc [0,4194304] 0 2024-02-22T00:33:47.480 INFO:tasks.workunit.client.0.smithi049.stdout:5/80: read - d0/d1a/f1c zero size 2024-02-22T00:33:47.482 INFO:tasks.workunit.client.0.smithi049.stdout:4/221: dread d3/d22/f29 [0,4194304] 0 2024-02-22T00:33:47.484 INFO:tasks.workunit.client.0.smithi049.stdout:5/81: rmdir d0/de/d6 39 2024-02-22T00:33:47.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/156: getdents d3 0 2024-02-22T00:33:47.490 INFO:tasks.workunit.client.0.smithi049.stdout:8/131: truncate d1/d2/d5/f2c 55891 0 2024-02-22T00:33:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:4/222: dwrite d3/d8/d10/f11 [0,4194304] 0 2024-02-22T00:33:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:0/157: write d3/d6/f26 [698180,47952] 0 2024-02-22T00:33:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:4/223: read - d3/f2f zero size 2024-02-22T00:33:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:5/82: fsync d0/de/d6/fd 0 2024-02-22T00:33:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:8/132: rename d1/d2/db/d1c/f20 to d1/d2/d5/f34 0 2024-02-22T00:33:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:5/83: creat d0/de/d6/f1f x:0 0 0 2024-02-22T00:33:47.502 INFO:tasks.workunit.client.0.smithi049.stdout:5/84: write d0/de/d6/f12 [1646520,128335] 0 2024-02-22T00:33:47.502 INFO:tasks.workunit.client.0.smithi049.stdout:0/158: getdents d3/d6/d29 0 2024-02-22T00:33:47.503 INFO:tasks.workunit.client.0.smithi049.stdout:1/101: truncate d2/d8/da/fd 2878641 0 2024-02-22T00:33:47.504 INFO:tasks.workunit.client.0.smithi049.stdout:6/122: sync 2024-02-22T00:33:47.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/102: dread - d2/d8/da/f1e zero size 2024-02-22T00:33:47.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/103: chown d2/l15 4 1 2024-02-22T00:33:47.508 INFO:tasks.workunit.client.0.smithi049.stdout:5/85: dread d0/de/fc [0,4194304] 0 2024-02-22T00:33:47.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/224: creat d3/d22/d24/d35/f40 x:0 0 0 2024-02-22T00:33:47.510 INFO:tasks.workunit.client.0.smithi049.stdout:8/133: dread d1/d2/f31 [0,4194304] 0 2024-02-22T00:33:47.510 INFO:tasks.workunit.client.0.smithi049.stdout:1/104: unlink d2/d8/ff 0 2024-02-22T00:33:47.513 INFO:tasks.workunit.client.0.smithi049.stdout:5/86: stat d0/l9 0 2024-02-22T00:33:47.514 INFO:tasks.workunit.client.0.smithi049.stdout:5/87: dread - d0/d1a/f1c zero size 2024-02-22T00:33:47.515 INFO:tasks.workunit.client.0.smithi049.stdout:4/225: rename d3/f21 to d3/d8/d10/d39/f41 0 2024-02-22T00:33:47.516 INFO:tasks.workunit.client.0.smithi049.stdout:4/226: write d3/d8/d20/f3c [857772,87943] 0 2024-02-22T00:33:47.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/123: creat d3/f29 x:0 0 0 2024-02-22T00:33:47.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/134: symlink d1/d2/db/d1c/l35 0 2024-02-22T00:33:47.520 INFO:tasks.workunit.client.0.smithi049.stdout:0/159: write d3/df/f11 [622236,89417] 0 2024-02-22T00:33:47.521 INFO:tasks.workunit.client.0.smithi049.stdout:5/88: mkdir d0/d20 0 2024-02-22T00:33:47.523 INFO:tasks.workunit.client.0.smithi049.stdout:0/160: write d3/df/d17/f20 [1787753,109400] 0 2024-02-22T00:33:47.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/89: write d0/f1d [259992,97038] 0 2024-02-22T00:33:47.523 INFO:tasks.workunit.client.0.smithi049.stdout:4/227: write d3/d8/f1a [1689239,121391] 0 2024-02-22T00:33:47.525 INFO:tasks.workunit.client.0.smithi049.stdout:4/228: readlink d3/l4 0 2024-02-22T00:33:47.526 INFO:tasks.workunit.client.0.smithi049.stdout:6/124: truncate d3/f18 492730 0 2024-02-22T00:33:47.528 INFO:tasks.workunit.client.0.smithi049.stdout:8/135: mkdir d1/d2/db/d15/d30/d36 0 2024-02-22T00:33:47.534 INFO:tasks.workunit.client.0.smithi049.stdout:5/90: dwrite d0/de/d6/f13 [0,4194304] 0 2024-02-22T00:33:47.539 INFO:tasks.workunit.client.0.smithi049.stdout:0/161: unlink d3/cc 0 2024-02-22T00:33:47.542 INFO:tasks.workunit.client.0.smithi049.stdout:5/91: dwrite d0/de/d6/fd [0,4194304] 0 2024-02-22T00:33:47.545 INFO:tasks.workunit.client.0.smithi049.stdout:4/229: creat d3/f42 x:0 0 0 2024-02-22T00:33:47.545 INFO:tasks.workunit.client.0.smithi049.stdout:1/105: stat d2/d8/da/fd 0 2024-02-22T00:33:47.548 INFO:tasks.workunit.client.0.smithi049.stdout:1/106: mknod d2/c28 0 2024-02-22T00:33:47.552 INFO:tasks.workunit.client.0.smithi049.stdout:6/125: rename d3/f15 to d3/f2a 0 2024-02-22T00:33:47.554 INFO:tasks.workunit.client.0.smithi049.stdout:0/162: truncate d3/df/d17/d1b/f23 3510346 0 2024-02-22T00:33:47.554 INFO:tasks.workunit.client.0.smithi049.stdout:5/92: symlink d0/de/l21 0 2024-02-22T00:33:47.554 INFO:tasks.workunit.client.0.smithi049.stdout:5/93: readlink d0/de/d6/l7 0 2024-02-22T00:33:47.555 INFO:tasks.workunit.client.0.smithi049.stdout:6/126: symlink d3/d16/d1f/l2b 0 2024-02-22T00:33:47.557 INFO:tasks.workunit.client.0.smithi049.stdout:1/107: symlink d2/d8/l29 0 2024-02-22T00:33:47.558 INFO:tasks.workunit.client.0.smithi049.stdout:5/94: symlink d0/d20/l22 0 2024-02-22T00:33:47.559 INFO:tasks.workunit.client.0.smithi049.stdout:6/127: chown d3/l9 3773 1 2024-02-22T00:33:47.561 INFO:tasks.workunit.client.0.smithi049.stdout:6/128: write d3/d16/f19 [800346,14472] 0 2024-02-22T00:33:47.562 INFO:tasks.workunit.client.0.smithi049.stdout:1/108: symlink d2/d8/db/l2a 0 2024-02-22T00:33:47.564 INFO:tasks.workunit.client.0.smithi049.stdout:5/95: rename d0/de/d6/cf to d0/d20/c23 0 2024-02-22T00:33:47.565 INFO:tasks.workunit.client.0.smithi049.stdout:0/163: dwrite d3/f13 [0,4194304] 0 2024-02-22T00:33:47.565 INFO:tasks.workunit.client.0.smithi049.stdout:6/129: creat d3/d16/f2c x:0 0 0 2024-02-22T00:33:47.565 INFO:tasks.workunit.client.0.smithi049.stdout:1/109: write d2/d8/da/f22 [448982,105846] 0 2024-02-22T00:33:47.567 INFO:tasks.workunit.client.0.smithi049.stdout:5/96: chown d0/de/l1b 416765 1 2024-02-22T00:33:47.567 INFO:tasks.workunit.client.0.smithi049.stdout:1/110: readlink d2/d8/l1f 0 2024-02-22T00:33:47.570 INFO:tasks.workunit.client.0.smithi049.stdout:0/164: write d3/df/d17/f24 [597003,60928] 0 2024-02-22T00:33:47.570 INFO:tasks.workunit.client.0.smithi049.stdout:6/130: mknod d3/d16/c2d 0 2024-02-22T00:33:47.572 INFO:tasks.workunit.client.0.smithi049.stdout:6/131: write d3/f18 [1407106,68676] 0 2024-02-22T00:33:47.580 INFO:tasks.workunit.client.0.smithi049.stdout:5/97: dwrite d0/de/d6/f1f [0,4194304] 0 2024-02-22T00:33:47.583 INFO:tasks.workunit.client.0.smithi049.stdout:5/98: write d0/f1d [830737,67957] 0 2024-02-22T00:33:47.583 INFO:tasks.workunit.client.0.smithi049.stdout:0/165: creat d3/df/f2b x:0 0 0 2024-02-22T00:33:47.585 INFO:tasks.workunit.client.0.smithi049.stdout:6/132: truncate d3/d16/d1f/f22 3698272 0 2024-02-22T00:33:47.585 INFO:tasks.workunit.client.0.smithi049.stdout:5/99: chown d0/de/l21 1514383 1 2024-02-22T00:33:47.587 INFO:tasks.workunit.client.0.smithi049.stdout:6/133: write d3/d16/f25 [661996,5986] 0 2024-02-22T00:33:47.587 INFO:tasks.workunit.client.0.smithi049.stdout:5/100: chown d0/de/fb 3182 1 2024-02-22T00:33:47.588 INFO:tasks.workunit.client.0.smithi049.stdout:0/166: creat d3/d6/d29/f2c x:0 0 0 2024-02-22T00:33:47.589 INFO:tasks.workunit.client.0.smithi049.stdout:4/230: dread f2 [0,4194304] 0 2024-02-22T00:33:47.590 INFO:tasks.workunit.client.0.smithi049.stdout:5/101: write d0/f1d [391500,38544] 0 2024-02-22T00:33:47.593 INFO:tasks.workunit.client.0.smithi049.stdout:5/102: mkdir d0/d1a/d24 0 2024-02-22T00:33:47.595 INFO:tasks.workunit.client.0.smithi049.stdout:1/111: stat d2/d8/db/f19 0 2024-02-22T00:33:47.595 INFO:tasks.workunit.client.0.smithi049.stdout:5/103: rename d0 to d0/de/d6/d25 22 2024-02-22T00:33:47.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/112: chown d2/f3 863024 1 2024-02-22T00:33:47.597 INFO:tasks.workunit.client.0.smithi049.stdout:4/231: mkdir d3/d8/d10/d43 0 2024-02-22T00:33:47.598 INFO:tasks.workunit.client.0.smithi049.stdout:4/232: dread - d3/f42 zero size 2024-02-22T00:33:47.599 INFO:tasks.workunit.client.0.smithi049.stdout:5/104: mkdir d0/d26 0 2024-02-22T00:33:47.599 INFO:tasks.workunit.client.0.smithi049.stdout:6/134: dwrite d3/d16/f2c [0,4194304] 0 2024-02-22T00:33:47.602 INFO:tasks.workunit.client.0.smithi049.stdout:1/113: symlink d2/d8/db/l2b 0 2024-02-22T00:33:47.605 INFO:tasks.workunit.client.0.smithi049.stdout:1/114: fdatasync d2/d8/da/f14 0 2024-02-22T00:33:47.605 INFO:tasks.workunit.client.0.smithi049.stdout:6/135: symlink d3/d16/l2e 0 2024-02-22T00:33:47.607 INFO:tasks.workunit.client.0.smithi049.stdout:4/233: rename d3/f3e to d3/d8/d10/f44 0 2024-02-22T00:33:47.608 INFO:tasks.workunit.client.0.smithi049.stdout:1/115: chown d2/f23 152 1 2024-02-22T00:33:47.608 INFO:tasks.workunit.client.0.smithi049.stdout:5/105: dread d0/de/d6/f1f [0,4194304] 0 2024-02-22T00:33:47.611 INFO:tasks.workunit.client.0.smithi049.stdout:4/234: mkdir d3/d8/d10/d45 0 2024-02-22T00:33:47.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/167: truncate d3/df/f11 312272 0 2024-02-22T00:33:47.613 INFO:tasks.workunit.client.0.smithi049.stdout:5/106: dread d0/de/d6/fd [0,4194304] 0 2024-02-22T00:33:47.613 INFO:tasks.workunit.client.0.smithi049.stdout:0/168: fsync d3/d6/f26 0 2024-02-22T00:33:47.614 INFO:tasks.workunit.client.0.smithi049.stdout:0/169: stat d3/d1e/l2a 0 2024-02-22T00:33:47.615 INFO:tasks.workunit.client.0.smithi049.stdout:0/170: truncate d3/f13 5233743 0 2024-02-22T00:33:47.615 INFO:tasks.workunit.client.0.smithi049.stdout:4/235: rmdir d3/d8/d10/d39 39 2024-02-22T00:33:47.618 INFO:tasks.workunit.client.0.smithi049.stdout:5/107: symlink d0/l27 0 2024-02-22T00:33:47.620 INFO:tasks.workunit.client.0.smithi049.stdout:6/136: rename d3/f1b to d3/f2f 0 2024-02-22T00:33:47.621 INFO:tasks.workunit.client.0.smithi049.stdout:6/137: write d3/d16/f1c [310213,57172] 0 2024-02-22T00:33:47.622 INFO:tasks.workunit.client.0.smithi049.stdout:4/236: fdatasync d3/d8/d10/d39/f37 0 2024-02-22T00:33:47.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/237: dread - d3/d22/d24/f36 zero size 2024-02-22T00:33:47.626 INFO:tasks.workunit.client.0.smithi049.stdout:0/171: write d3/df/d17/d1b/f28 [124237,54837] 0 2024-02-22T00:33:47.626 INFO:tasks.workunit.client.0.smithi049.stdout:1/116: getdents d2 0 2024-02-22T00:33:47.626 INFO:tasks.workunit.client.0.smithi049.stdout:6/138: creat d3/d16/f30 x:0 0 0 2024-02-22T00:33:47.627 INFO:tasks.workunit.client.0.smithi049.stdout:6/139: readlink d3/d16/d1f/l2b 0 2024-02-22T00:33:47.628 INFO:tasks.workunit.client.0.smithi049.stdout:4/238: creat d3/d33/f46 x:0 0 0 2024-02-22T00:33:47.631 INFO:tasks.workunit.client.0.smithi049.stdout:6/140: mknod d3/d16/d1f/c31 0 2024-02-22T00:33:47.637 INFO:tasks.workunit.client.0.smithi049.stdout:1/117: creat d2/d8/db/d25/f2c x:0 0 0 2024-02-22T00:33:47.638 INFO:tasks.workunit.client.0.smithi049.stdout:6/141: write d3/f10 [2370188,64245] 0 2024-02-22T00:33:47.641 INFO:tasks.workunit.client.0.smithi049.stdout:1/118: dread - d2/d8/f27 zero size 2024-02-22T00:33:47.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/239: dwrite d3/f32 [4194304,4194304] 0 2024-02-22T00:33:47.641 INFO:tasks.workunit.client.0.smithi049.stdout:0/172: dwrite d3/df/d17/f24 [0,4194304] 0 2024-02-22T00:33:47.643 INFO:tasks.workunit.client.0.smithi049.stdout:6/142: mkdir d3/d16/d32 0 2024-02-22T00:33:47.646 INFO:tasks.workunit.client.0.smithi049.stdout:4/240: symlink d3/d22/d24/l47 0 2024-02-22T00:33:47.648 INFO:tasks.workunit.client.0.smithi049.stdout:0/173: dread d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:47.649 INFO:tasks.workunit.client.0.smithi049.stdout:4/241: mkdir d3/d13/d48 0 2024-02-22T00:33:47.652 INFO:tasks.workunit.client.0.smithi049.stdout:1/119: rename d2/f23 to d2/d8/db/f2d 0 2024-02-22T00:33:47.659 INFO:tasks.workunit.client.0.smithi049.stdout:4/242: unlink d3/d22/f29 0 2024-02-22T00:33:47.659 INFO:tasks.workunit.client.0.smithi049.stdout:1/120: mknod d2/d8/c2e 0 2024-02-22T00:33:47.660 INFO:tasks.workunit.client.0.smithi049.stdout:4/243: chown d3/d8/d10/d12/f23 4008160 1 2024-02-22T00:33:47.662 INFO:tasks.workunit.client.0.smithi049.stdout:0/174: dwrite d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:47.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/159: sync 2024-02-22T00:33:47.667 INFO:tasks.workunit.client.0.smithi049.stdout:3/47: sync 2024-02-22T00:33:47.671 INFO:tasks.workunit.client.0.smithi049.stdout:1/121: dwrite d2/f3 [0,4194304] 0 2024-02-22T00:33:47.672 INFO:tasks.workunit.client.0.smithi049.stdout:6/143: getdents d3/d16 0 2024-02-22T00:33:47.675 INFO:tasks.workunit.client.0.smithi049.stdout:3/48: creat d0/d1/f9 x:0 0 0 2024-02-22T00:33:47.679 INFO:tasks.workunit.client.0.smithi049.stdout:3/49: dread - d0/d1/f3 zero size 2024-02-22T00:33:47.681 INFO:tasks.workunit.client.0.smithi049.stdout:1/122: stat d2/d8/da/fd 0 2024-02-22T00:33:47.688 INFO:tasks.workunit.client.0.smithi049.stdout:0/175: dwrite d3/d6/d29/f2c [0,4194304] 0 2024-02-22T00:33:47.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/160: creat d2/d9/de/d10/f3d x:0 0 0 2024-02-22T00:33:47.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/161: readlink d2/l24 0 2024-02-22T00:33:47.689 INFO:tasks.workunit.client.0.smithi049.stdout:6/144: dread d3/fb [0,4194304] 0 2024-02-22T00:33:47.689 INFO:tasks.workunit.client.0.smithi049.stdout:1/123: symlink d2/d8/db/d25/l2f 0 2024-02-22T00:33:47.694 INFO:tasks.workunit.client.0.smithi049.stdout:6/145: symlink d3/d16/l33 0 2024-02-22T00:33:47.697 INFO:tasks.workunit.client.0.smithi049.stdout:0/176: dwrite d3/df/f2b [0,4194304] 0 2024-02-22T00:33:47.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/177: chown d3/f13 75647753 1 2024-02-22T00:33:47.703 INFO:tasks.workunit.client.0.smithi049.stdout:6/146: getdents d3/d16/d32 0 2024-02-22T00:33:47.703 INFO:tasks.workunit.client.0.smithi049.stdout:1/124: getdents d2/d8 0 2024-02-22T00:33:47.706 INFO:tasks.workunit.client.0.smithi049.stdout:2/162: getdents d2/d9/de 0 2024-02-22T00:33:47.707 INFO:tasks.workunit.client.0.smithi049.stdout:1/125: fdatasync d2/d8/da/fd 0 2024-02-22T00:33:47.709 INFO:tasks.workunit.client.0.smithi049.stdout:2/163: stat d2/d9/d17/f18 0 2024-02-22T00:33:47.710 INFO:tasks.workunit.client.0.smithi049.stdout:6/147: symlink d3/l34 0 2024-02-22T00:33:47.711 INFO:tasks.workunit.client.0.smithi049.stdout:6/148: stat d3/d16/d1f/c28 0 2024-02-22T00:33:47.712 INFO:tasks.workunit.client.0.smithi049.stdout:1/126: creat d2/f30 x:0 0 0 2024-02-22T00:33:47.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/178: truncate d3/df/d17/d1b/f23 2622290 0 2024-02-22T00:33:47.715 INFO:tasks.workunit.client.0.smithi049.stdout:6/149: rmdir d3/d16 39 2024-02-22T00:33:47.716 INFO:tasks.workunit.client.0.smithi049.stdout:6/150: fsync d3/f6 0 2024-02-22T00:33:47.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/127: unlink d2/d8/l1f 0 2024-02-22T00:33:47.718 INFO:tasks.workunit.client.0.smithi049.stdout:2/164: write d2/f1c [881682,98679] 0 2024-02-22T00:33:47.718 INFO:tasks.workunit.client.0.smithi049.stdout:0/179: mknod d3/d6/d8/c2d 0 2024-02-22T00:33:47.719 INFO:tasks.workunit.client.0.smithi049.stdout:6/151: read - d3/d16/f30 zero size 2024-02-22T00:33:47.724 INFO:tasks.workunit.client.0.smithi049.stdout:0/180: symlink d3/d1e/l2e 0 2024-02-22T00:33:47.725 INFO:tasks.workunit.client.0.smithi049.stdout:2/165: symlink d2/l3e 0 2024-02-22T00:33:47.726 INFO:tasks.workunit.client.0.smithi049.stdout:6/152: creat d3/d16/d1f/f35 x:0 0 0 2024-02-22T00:33:47.726 INFO:tasks.workunit.client.0.smithi049.stdout:2/166: chown d2/d9/de/d10 14253 1 2024-02-22T00:33:47.728 INFO:tasks.workunit.client.0.smithi049.stdout:2/167: chown d2/f36 5165355 1 2024-02-22T00:33:47.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/153: dread - d3/d16/f24 zero size 2024-02-22T00:33:47.734 INFO:tasks.workunit.client.0.smithi049.stdout:1/128: chown d2/d8/db/d25 427 1 2024-02-22T00:33:47.737 INFO:tasks.workunit.client.0.smithi049.stdout:2/168: symlink d2/l3f 0 2024-02-22T00:33:47.738 INFO:tasks.workunit.client.0.smithi049.stdout:6/154: mkdir d3/d36 0 2024-02-22T00:33:47.739 INFO:tasks.workunit.client.0.smithi049.stdout:6/155: readlink d3/d16/l2e 0 2024-02-22T00:33:47.743 INFO:tasks.workunit.client.0.smithi049.stdout:1/129: dread d2/d8/db/f2d [0,4194304] 0 2024-02-22T00:33:47.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/181: dread d3/df/d17/d1b/f23 [0,4194304] 0 2024-02-22T00:33:47.746 INFO:tasks.workunit.client.0.smithi049.stdout:2/169: rename d2/d9/dd/c14 to d2/d9/d17/c40 0 2024-02-22T00:33:47.748 INFO:tasks.workunit.client.0.smithi049.stdout:6/156: mkdir d3/d37 0 2024-02-22T00:33:47.749 INFO:tasks.workunit.client.0.smithi049.stdout:1/130: creat d2/f31 x:0 0 0 2024-02-22T00:33:47.751 INFO:tasks.workunit.client.0.smithi049.stdout:2/170: fsync d2/d9/de/d3a/f34 0 2024-02-22T00:33:47.762 INFO:tasks.workunit.client.0.smithi049.stdout:6/157: rename d3/f8 to d3/f38 0 2024-02-22T00:33:47.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/182: dread d3/df/f2b [0,4194304] 0 2024-02-22T00:33:47.765 INFO:tasks.workunit.client.0.smithi049.stdout:1/131: creat d2/d8/da/f32 x:0 0 0 2024-02-22T00:33:47.769 INFO:tasks.workunit.client.0.smithi049.stdout:6/158: creat d3/d16/f39 x:0 0 0 2024-02-22T00:33:47.770 INFO:tasks.workunit.client.0.smithi049.stdout:1/132: readlink d2/d8/l29 0 2024-02-22T00:33:47.771 INFO:tasks.workunit.client.0.smithi049.stdout:2/171: dwrite d2/d9/d17/f18 [0,4194304] 0 2024-02-22T00:33:47.773 INFO:tasks.workunit.client.0.smithi049.stdout:2/172: stat d2/d9/f2a 0 2024-02-22T00:33:47.777 INFO:tasks.workunit.client.0.smithi049.stdout:0/183: creat d3/df/d17/f2f x:0 0 0 2024-02-22T00:33:47.780 INFO:tasks.workunit.client.0.smithi049.stdout:6/159: dread d3/d16/f19 [0,4194304] 0 2024-02-22T00:33:47.789 INFO:tasks.workunit.client.0.smithi049.stdout:0/184: read d3/df/f11 [169038,107460] 0 2024-02-22T00:33:47.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/160: write d3/fb [1923718,50427] 0 2024-02-22T00:33:47.794 INFO:tasks.workunit.client.0.smithi049.stdout:1/133: dwrite d2/d8/da/f22 [0,4194304] 0 2024-02-22T00:33:47.796 INFO:tasks.workunit.client.0.smithi049.stdout:2/173: dwrite d2/d9/d17/f18 [4194304,4194304] 0 2024-02-22T00:33:47.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/161: write d3/d16/f30 [82860,82695] 0 2024-02-22T00:33:47.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/134: mknod d2/c33 0 2024-02-22T00:33:47.803 INFO:tasks.workunit.client.0.smithi049.stdout:0/185: link d3/df/d17/d1b/c1f d3/d1e/c30 0 2024-02-22T00:33:47.804 INFO:tasks.workunit.client.0.smithi049.stdout:6/162: mknod d3/d16/c3a 0 2024-02-22T00:33:47.805 INFO:tasks.workunit.client.0.smithi049.stdout:2/174: symlink d2/d9/dd/l41 0 2024-02-22T00:33:47.806 INFO:tasks.workunit.client.0.smithi049.stdout:6/163: stat d3/l34 0 2024-02-22T00:33:47.806 INFO:tasks.workunit.client.0.smithi049.stdout:6/164: chown d3/d37 75 1 2024-02-22T00:33:47.806 INFO:tasks.workunit.client.0.smithi049.stdout:0/186: chown d3/d6/c1c 761993599 1 2024-02-22T00:33:47.808 INFO:tasks.workunit.client.0.smithi049.stdout:0/187: write d3/df/d17/f2f [185410,7833] 0 2024-02-22T00:33:47.809 INFO:tasks.workunit.client.0.smithi049.stdout:2/175: mkdir d2/d9/de/d10/d2e/d42 0 2024-02-22T00:33:47.817 INFO:tasks.workunit.client.0.smithi049.stdout:2/176: rename d2/f7 to d2/d9/de/d10/d2e/d42/f43 0 2024-02-22T00:33:47.818 INFO:tasks.workunit.client.0.smithi049.stdout:6/165: dwrite d3/f11 [0,4194304] 0 2024-02-22T00:33:47.823 INFO:tasks.workunit.client.0.smithi049.stdout:6/166: mkdir d3/d16/d3b 0 2024-02-22T00:33:47.823 INFO:tasks.workunit.client.0.smithi049.stdout:0/188: dwrite d3/df/d17/f24 [0,4194304] 0 2024-02-22T00:33:47.827 INFO:tasks.workunit.client.0.smithi049.stdout:6/167: creat d3/d16/f3c x:0 0 0 2024-02-22T00:33:47.828 INFO:tasks.workunit.client.0.smithi049.stdout:0/189: creat d3/df/d17/d1b/f31 x:0 0 0 2024-02-22T00:33:47.831 INFO:tasks.workunit.client.0.smithi049.stdout:2/177: dwrite d2/d9/de/d3a/f37 [0,4194304] 0 2024-02-22T00:33:47.834 INFO:tasks.workunit.client.0.smithi049.stdout:6/168: mkdir d3/d16/d3b/d3d 0 2024-02-22T00:33:47.834 INFO:tasks.workunit.client.0.smithi049.stdout:6/169: stat d3/d16 0 2024-02-22T00:33:47.836 INFO:tasks.workunit.client.0.smithi049.stdout:2/178: rmdir d2/d9/de/d10 39 2024-02-22T00:33:47.837 INFO:tasks.workunit.client.0.smithi049.stdout:0/190: mknod d3/df/d17/d27/c32 0 2024-02-22T00:33:47.841 INFO:tasks.workunit.client.0.smithi049.stdout:6/170: dwrite d3/f18 [0,4194304] 0 2024-02-22T00:33:47.843 INFO:tasks.workunit.client.0.smithi049.stdout:0/191: dread d3/df/f2b [0,4194304] 0 2024-02-22T00:33:47.844 INFO:tasks.workunit.client.0.smithi049.stdout:0/192: write d3/f13 [2435833,14343] 0 2024-02-22T00:33:47.848 INFO:tasks.workunit.client.0.smithi049.stdout:9/139: sync 2024-02-22T00:33:47.849 INFO:tasks.workunit.client.0.smithi049.stdout:7/196: sync 2024-02-22T00:33:47.849 INFO:tasks.workunit.client.0.smithi049.stdout:9/140: truncate d17/f1f 1113518 0 2024-02-22T00:33:47.850 INFO:tasks.workunit.client.0.smithi049.stdout:9/141: readlink d17/d1c/l2e 0 2024-02-22T00:33:47.852 INFO:tasks.workunit.client.0.smithi049.stdout:7/197: mkdir d1/d49/d4d 0 2024-02-22T00:33:47.857 INFO:tasks.workunit.client.0.smithi049.stdout:7/198: rmdir d1/df/d12 39 2024-02-22T00:33:47.859 INFO:tasks.workunit.client.0.smithi049.stdout:0/193: truncate d3/df/f2b 904063 0 2024-02-22T00:33:47.864 INFO:tasks.workunit.client.0.smithi049.stdout:0/194: rename d3/df/d17/d27/c32 to d3/df/c33 0 2024-02-22T00:33:47.865 INFO:tasks.workunit.client.0.smithi049.stdout:7/199: mknod d1/df/d12/d48/c4e 0 2024-02-22T00:33:47.866 INFO:tasks.workunit.client.0.smithi049.stdout:0/195: mknod d3/c34 0 2024-02-22T00:33:47.866 INFO:tasks.workunit.client.0.smithi049.stdout:0/196: stat d3/c15 0 2024-02-22T00:33:47.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/142: truncate d17/d21/f29 101151 0 2024-02-22T00:33:47.868 INFO:tasks.workunit.client.0.smithi049.stdout:0/197: symlink d3/d1e/l35 0 2024-02-22T00:33:47.868 INFO:tasks.workunit.client.0.smithi049.stdout:9/143: rename d17 to d17/d36 22 2024-02-22T00:33:47.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/200: getdents d1/df 0 2024-02-22T00:33:47.870 INFO:tasks.workunit.client.0.smithi049.stdout:9/144: mknod d17/d1c/c37 0 2024-02-22T00:33:47.873 INFO:tasks.workunit.client.0.smithi049.stdout:7/201: write d1/df/d12/d1c/d24/d2e/f42 [571056,57611] 0 2024-02-22T00:33:47.876 INFO:tasks.workunit.client.0.smithi049.stdout:7/202: chown d1/d41/d28/f39 835479 1 2024-02-22T00:33:47.879 INFO:tasks.workunit.client.0.smithi049.stdout:0/198: dwrite d3/df/d17/d1b/f28 [0,4194304] 0 2024-02-22T00:33:47.883 INFO:tasks.workunit.client.0.smithi049.stdout:9/145: dwrite d17/f20 [0,4194304] 0 2024-02-22T00:33:47.883 INFO:tasks.workunit.client.0.smithi049.stdout:6/171: dread d3/f13 [0,4194304] 0 2024-02-22T00:33:47.884 INFO:tasks.workunit.client.0.smithi049.stdout:0/199: mkdir d3/d6/d8/d36 0 2024-02-22T00:33:47.886 INFO:tasks.workunit.client.0.smithi049.stdout:9/146: mkdir d17/d1c/d38 0 2024-02-22T00:33:47.887 INFO:tasks.workunit.client.0.smithi049.stdout:9/147: fsync d17/d1c/f2c 0 2024-02-22T00:33:47.890 INFO:tasks.workunit.client.0.smithi049.stdout:0/200: dread d3/f13 [0,4194304] 0 2024-02-22T00:33:47.892 INFO:tasks.workunit.client.0.smithi049.stdout:9/148: mkdir d17/d1c/d25/d39 0 2024-02-22T00:33:47.897 INFO:tasks.workunit.client.0.smithi049.stdout:9/149: unlink f12 0 2024-02-22T00:33:47.901 INFO:tasks.workunit.client.0.smithi049.stdout:0/201: dwrite d3/df/d17/d1b/f31 [0,4194304] 0 2024-02-22T00:33:47.902 INFO:tasks.workunit.client.0.smithi049.stdout:7/203: write d1/f6 [303759,6987] 0 2024-02-22T00:33:47.908 INFO:tasks.workunit.client.0.smithi049.stdout:9/150: creat d17/d1c/d25/d39/f3a x:0 0 0 2024-02-22T00:33:47.908 INFO:tasks.workunit.client.0.smithi049.stdout:9/151: stat d17/f35 0 2024-02-22T00:33:47.909 INFO:tasks.workunit.client.0.smithi049.stdout:9/152: write f8 [3502970,105276] 0 2024-02-22T00:33:47.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/204: dwrite d1/d41/f3b [0,4194304] 0 2024-02-22T00:33:47.912 INFO:tasks.workunit.client.0.smithi049.stdout:9/153: chown d17/d1c/d25/c2f 155 1 2024-02-22T00:33:47.916 INFO:tasks.workunit.client.0.smithi049.stdout:9/154: chown d17/f35 4 1 2024-02-22T00:33:47.918 INFO:tasks.workunit.client.0.smithi049.stdout:6/172: truncate d3/f38 1176930 0 2024-02-22T00:33:47.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/155: write d17/f27 [292816,58334] 0 2024-02-22T00:33:47.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/173: read - d3/d16/f24 zero size 2024-02-22T00:33:47.924 INFO:tasks.workunit.client.0.smithi049.stdout:7/205: dwrite d1/d41/d28/f36 [0,4194304] 0 2024-02-22T00:33:47.925 INFO:tasks.workunit.client.0.smithi049.stdout:6/174: rename d3/d16/d1f/l2b to d3/d16/d3b/l3e 0 2024-02-22T00:33:47.926 INFO:tasks.workunit.client.0.smithi049.stdout:9/156: write d17/f35 [662816,33925] 0 2024-02-22T00:33:47.932 INFO:tasks.workunit.client.0.smithi049.stdout:9/157: dread d17/f1a [0,4194304] 0 2024-02-22T00:33:47.932 INFO:tasks.workunit.client.0.smithi049.stdout:6/175: link d3/d16/l1e d3/d16/l3f 0 2024-02-22T00:33:47.936 INFO:tasks.workunit.client.0.smithi049.stdout:9/158: creat d17/d1c/f3b x:0 0 0 2024-02-22T00:33:47.937 INFO:tasks.workunit.client.0.smithi049.stdout:0/202: write d3/df/f2b [913955,106635] 0 2024-02-22T00:33:47.937 INFO:tasks.workunit.client.0.smithi049.stdout:9/159: readlink d17/d1c/l2a 0 2024-02-22T00:33:47.939 INFO:tasks.workunit.client.0.smithi049.stdout:7/206: write d1/df/d12/d1c/f2a [755399,48746] 0 2024-02-22T00:33:47.942 INFO:tasks.workunit.client.0.smithi049.stdout:6/176: link d3/d16/d1f/c28 d3/d16/c40 0 2024-02-22T00:33:47.944 INFO:tasks.workunit.client.0.smithi049.stdout:9/160: mkdir d17/d21/d3c 0 2024-02-22T00:33:47.946 INFO:tasks.workunit.client.0.smithi049.stdout:7/207: creat d1/df/f4f x:0 0 0 2024-02-22T00:33:47.950 INFO:tasks.workunit.client.0.smithi049.stdout:6/177: dwrite d3/f10 [0,4194304] 0 2024-02-22T00:33:47.951 INFO:tasks.workunit.client.0.smithi049.stdout:9/161: creat d17/d21/d3c/f3d x:0 0 0 2024-02-22T00:33:47.953 INFO:tasks.workunit.client.0.smithi049.stdout:9/162: readlink d17/d1c/l2a 0 2024-02-22T00:33:47.953 INFO:tasks.workunit.client.0.smithi049.stdout:6/178: write d3/d16/f30 [741767,50733] 0 2024-02-22T00:33:47.956 INFO:tasks.workunit.client.0.smithi049.stdout:0/203: dwrite d3/df/f11 [0,4194304] 0 2024-02-22T00:33:47.957 INFO:tasks.workunit.client.0.smithi049.stdout:0/204: readlink d3/d1e/l2a 0 2024-02-22T00:33:47.958 INFO:tasks.workunit.client.0.smithi049.stdout:9/163: mknod d17/d21/d3c/c3e 0 2024-02-22T00:33:47.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/179: read d3/d16/f30 [164652,79762] 0 2024-02-22T00:33:47.964 INFO:tasks.workunit.client.0.smithi049.stdout:9/164: truncate d17/d1c/d25/f34 932709 0 2024-02-22T00:33:47.965 INFO:tasks.workunit.client.0.smithi049.stdout:0/205: dread d3/df/d17/d1b/f28 [0,4194304] 0 2024-02-22T00:33:47.968 INFO:tasks.workunit.client.0.smithi049.stdout:9/165: unlink f8 0 2024-02-22T00:33:47.969 INFO:tasks.workunit.client.0.smithi049.stdout:9/166: chown d17/c1d 5433 1 2024-02-22T00:33:47.974 INFO:tasks.workunit.client.0.smithi049.stdout:9/167: creat d17/d21/d3c/f3f x:0 0 0 2024-02-22T00:33:47.977 INFO:tasks.workunit.client.0.smithi049.stdout:0/206: dwrite d3/df/d17/d1b/f23 [0,4194304] 0 2024-02-22T00:33:47.977 INFO:tasks.workunit.client.0.smithi049.stdout:9/168: creat d17/d21/d3c/f40 x:0 0 0 2024-02-22T00:33:47.981 INFO:tasks.workunit.client.0.smithi049.stdout:9/169: write d17/d21/f28 [325533,95340] 0 2024-02-22T00:33:47.984 INFO:tasks.workunit.client.0.smithi049.stdout:6/180: write d3/f38 [1833337,81790] 0 2024-02-22T00:33:47.985 INFO:tasks.workunit.client.0.smithi049.stdout:7/208: dread f0 [0,4194304] 0 2024-02-22T00:33:47.988 INFO:tasks.workunit.client.0.smithi049.stdout:0/207: rmdir d3/df/d17/d27 0 2024-02-22T00:33:47.988 INFO:tasks.workunit.client.0.smithi049.stdout:0/208: write d3/d6/f26 [5136322,72519] 0 2024-02-22T00:33:47.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/181: rename d3/f2f to d3/d16/d3b/f41 0 2024-02-22T00:33:47.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/182: readlink d3/d16/l2e 0 2024-02-22T00:33:47.992 INFO:tasks.workunit.client.0.smithi049.stdout:9/170: link cb d17/d21/d24/c41 0 2024-02-22T00:33:47.993 INFO:tasks.workunit.client.0.smithi049.stdout:9/171: write f11 [3035374,107118] 0 2024-02-22T00:33:47.993 INFO:tasks.workunit.client.0.smithi049.stdout:0/209: unlink d3/df/d17/d1b/f23 0 2024-02-22T00:33:47.995 INFO:tasks.workunit.client.0.smithi049.stdout:7/209: chown d1/df/d12/d48/c4e 1491257 1 2024-02-22T00:33:47.999 INFO:tasks.workunit.client.0.smithi049.stdout:6/183: creat d3/d16/d32/f42 x:0 0 0 2024-02-22T00:33:48.003 INFO:tasks.workunit.client.0.smithi049.stdout:6/184: write d3/d16/f19 [67467,58481] 0 2024-02-22T00:33:48.004 INFO:tasks.workunit.client.0.smithi049.stdout:0/210: rename d3/d6/d29/f2c to d3/df/d17/f37 0 2024-02-22T00:33:48.006 INFO:tasks.workunit.client.0.smithi049.stdout:6/185: read - d3/d16/f39 zero size 2024-02-22T00:33:48.007 INFO:tasks.workunit.client.0.smithi049.stdout:7/210: dread d1/df/f13 [0,4194304] 0 2024-02-22T00:33:48.009 INFO:tasks.workunit.client.0.smithi049.stdout:9/172: dwrite d17/f1a [0,4194304] 0 2024-02-22T00:33:48.012 INFO:tasks.workunit.client.0.smithi049.stdout:0/211: dread d3/df/f2b [0,4194304] 0 2024-02-22T00:33:48.017 INFO:tasks.workunit.client.0.smithi049.stdout:7/211: dread d1/d41/f3e [4194304,4194304] 0 2024-02-22T00:33:48.019 INFO:tasks.workunit.client.0.smithi049.stdout:7/212: unlink d1/fa 0 2024-02-22T00:33:48.022 INFO:tasks.workunit.client.0.smithi049.stdout:6/186: dwrite d3/d16/d1f/f22 [0,4194304] 0 2024-02-22T00:33:48.024 INFO:tasks.workunit.client.0.smithi049.stdout:0/212: truncate d3/d6/d8/f1a 3032214 0 2024-02-22T00:33:48.025 INFO:tasks.workunit.client.0.smithi049.stdout:6/187: stat d3/d16/d1f/c28 0 2024-02-22T00:33:48.027 INFO:tasks.workunit.client.0.smithi049.stdout:6/188: write d3/d16/f3c [303725,64349] 0 2024-02-22T00:33:48.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/136: sync 2024-02-22T00:33:48.033 INFO:tasks.workunit.client.0.smithi049.stdout:5/108: sync 2024-02-22T00:33:48.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/189: dwrite d3/f10 [0,4194304] 0 2024-02-22T00:33:48.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/190: dread - d3/f1d zero size 2024-02-22T00:33:48.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/109: read d0/de/d6/f12 [1329671,16322] 0 2024-02-22T00:33:48.039 INFO:tasks.workunit.client.0.smithi049.stdout:8/137: creat d1/d2/db/d15/d33/f37 x:0 0 0 2024-02-22T00:33:48.041 INFO:tasks.workunit.client.0.smithi049.stdout:5/110: fdatasync d0/de/d6/f1f 0 2024-02-22T00:33:48.041 INFO:tasks.workunit.client.0.smithi049.stdout:0/213: write d3/d6/d8/f1a [2915150,52982] 0 2024-02-22T00:33:48.042 INFO:tasks.workunit.client.0.smithi049.stdout:0/214: read d3/df/f2b [958563,108418] 0 2024-02-22T00:33:48.056 INFO:tasks.workunit.client.0.smithi049.stdout:5/111: mknod d0/c28 0 2024-02-22T00:33:48.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/215: symlink d3/d6/d29/l38 0 2024-02-22T00:33:48.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/191: creat d3/f43 x:0 0 0 2024-02-22T00:33:48.058 INFO:tasks.workunit.client.0.smithi049.stdout:8/138: creat d1/d2/f38 x:0 0 0 2024-02-22T00:33:48.058 INFO:tasks.workunit.client.0.smithi049.stdout:0/216: chown d3/d6/d8 72438 1 2024-02-22T00:33:48.059 INFO:tasks.workunit.client.0.smithi049.stdout:5/112: mknod d0/d1a/c29 0 2024-02-22T00:33:48.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/192: mknod d3/c44 0 2024-02-22T00:33:48.061 INFO:tasks.workunit.client.0.smithi049.stdout:5/113: symlink d0/d20/l2a 0 2024-02-22T00:33:48.063 INFO:tasks.workunit.client.0.smithi049.stdout:6/193: read - d3/d16/d1f/f35 zero size 2024-02-22T00:33:48.063 INFO:tasks.workunit.client.0.smithi049.stdout:5/114: chown d0/de/l21 3 1 2024-02-22T00:33:48.065 INFO:tasks.workunit.client.0.smithi049.stdout:5/115: rename d0 to d0/d1a/d24/d2b 22 2024-02-22T00:33:48.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/194: mkdir d3/d16/d45 0 2024-02-22T00:33:48.067 INFO:tasks.workunit.client.0.smithi049.stdout:8/139: dwrite d1/d2/f2e [0,4194304] 0 2024-02-22T00:33:48.069 INFO:tasks.workunit.client.0.smithi049.stdout:6/195: symlink d3/d16/d1f/l46 0 2024-02-22T00:33:48.071 INFO:tasks.workunit.client.0.smithi049.stdout:5/116: mknod d0/d1a/d24/c2c 0 2024-02-22T00:33:48.073 INFO:tasks.workunit.client.0.smithi049.stdout:5/117: truncate d0/d1a/f1c 834422 0 2024-02-22T00:33:48.074 INFO:tasks.workunit.client.0.smithi049.stdout:5/118: read d0/de/fc [4534270,7649] 0 2024-02-22T00:33:48.081 INFO:tasks.workunit.client.0.smithi049.stdout:8/140: dwrite d1/d2/f3 [0,4194304] 0 2024-02-22T00:33:48.084 INFO:tasks.workunit.client.0.smithi049.stdout:5/119: dwrite d0/f1d [0,4194304] 0 2024-02-22T00:33:48.086 INFO:tasks.workunit.client.0.smithi049.stdout:8/141: chown d1/d2/d5/f2c 102086 1 2024-02-22T00:33:48.090 INFO:tasks.workunit.client.0.smithi049.stdout:5/120: rename d0/de/l21 to d0/de/l2d 0 2024-02-22T00:33:48.090 INFO:tasks.workunit.client.0.smithi049.stdout:8/142: mkdir d1/d2/d5/d1b/d39 0 2024-02-22T00:33:48.091 INFO:tasks.workunit.client.0.smithi049.stdout:8/143: fsync d1/d2/f2e 0 2024-02-22T00:33:48.093 INFO:tasks.workunit.client.0.smithi049.stdout:5/121: dread d0/f1d [0,4194304] 0 2024-02-22T00:33:48.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/122: symlink d0/d26/l2e 0 2024-02-22T00:33:48.098 INFO:tasks.workunit.client.0.smithi049.stdout:5/123: creat d0/d1a/d24/f2f x:0 0 0 2024-02-22T00:33:48.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/124: mknod d0/d1a/c30 0 2024-02-22T00:33:48.100 INFO:tasks.workunit.client.0.smithi049.stdout:5/125: chown d0/d1a/d24/c2c 211 1 2024-02-22T00:33:48.103 INFO:tasks.workunit.client.0.smithi049.stdout:5/126: dread d0/d1a/f1c [0,4194304] 0 2024-02-22T00:33:48.105 INFO:tasks.workunit.client.0.smithi049.stdout:5/127: truncate d0/de/fc 5227861 0 2024-02-22T00:33:48.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/144: truncate d1/f1e 122354 0 2024-02-22T00:33:48.106 INFO:tasks.workunit.client.0.smithi049.stdout:5/128: symlink d0/d26/l31 0 2024-02-22T00:33:48.108 INFO:tasks.workunit.client.0.smithi049.stdout:6/196: dread d3/d16/d3b/f41 [0,4194304] 0 2024-02-22T00:33:48.112 INFO:tasks.workunit.client.0.smithi049.stdout:5/129: creat d0/f32 x:0 0 0 2024-02-22T00:33:48.112 INFO:tasks.workunit.client.0.smithi049.stdout:6/197: mknod d3/d16/d3b/c47 0 2024-02-22T00:33:48.113 INFO:tasks.workunit.client.0.smithi049.stdout:6/198: symlink d3/d16/d3b/l48 0 2024-02-22T00:33:48.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/145: dwrite d1/d2/db/f28 [0,4194304] 0 2024-02-22T00:33:48.115 INFO:tasks.workunit.client.0.smithi049.stdout:5/130: dread d0/de/d6/f1f [0,4194304] 0 2024-02-22T00:33:48.118 INFO:tasks.workunit.client.0.smithi049.stdout:6/199: creat d3/d16/d45/f49 x:0 0 0 2024-02-22T00:33:48.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/200: read - d3/f2a zero size 2024-02-22T00:33:48.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/201: write d3/d16/f30 [1212746,63023] 0 2024-02-22T00:33:48.125 INFO:tasks.workunit.client.0.smithi049.stdout:5/131: rmdir d0 39 2024-02-22T00:33:48.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/146: write d1/f1e [549632,20014] 0 2024-02-22T00:33:48.129 INFO:tasks.workunit.client.0.smithi049.stdout:5/132: chown d0/de/d6/fd 63 1 2024-02-22T00:33:48.129 INFO:tasks.workunit.client.0.smithi049.stdout:6/202: truncate d3/f6 84888 0 2024-02-22T00:33:48.130 INFO:tasks.workunit.client.0.smithi049.stdout:8/147: symlink d1/l3a 0 2024-02-22T00:33:48.131 INFO:tasks.workunit.client.0.smithi049.stdout:5/133: rmdir d0/d1a/d24 39 2024-02-22T00:33:48.132 INFO:tasks.workunit.client.0.smithi049.stdout:5/134: chown d0/d26/l2e 141048 1 2024-02-22T00:33:48.132 INFO:tasks.workunit.client.0.smithi049.stdout:6/203: mkdir d3/d16/d4a 0 2024-02-22T00:33:48.135 INFO:tasks.workunit.client.0.smithi049.stdout:8/148: dread d1/d2/db/d15/f23 [0,4194304] 0 2024-02-22T00:33:48.140 INFO:tasks.workunit.client.0.smithi049.stdout:5/135: truncate d0/f1d 685130 0 2024-02-22T00:33:48.140 INFO:tasks.workunit.client.0.smithi049.stdout:6/204: dread d3/d16/d1f/f22 [0,4194304] 0 2024-02-22T00:33:48.143 INFO:tasks.workunit.client.0.smithi049.stdout:8/149: dwrite d1/d2/f25 [0,4194304] 0 2024-02-22T00:33:48.145 INFO:tasks.workunit.client.0.smithi049.stdout:5/136: rename d0/d1a/f1c to d0/f33 0 2024-02-22T00:33:48.148 INFO:tasks.workunit.client.0.smithi049.stdout:6/205: unlink d3/d16/d3b/f41 0 2024-02-22T00:33:48.149 INFO:tasks.workunit.client.0.smithi049.stdout:8/150: mkdir d1/d2/db/d1c/d3b 0 2024-02-22T00:33:48.154 INFO:tasks.workunit.client.0.smithi049.stdout:8/151: mknod d1/d2/d5/d1b/d39/c3c 0 2024-02-22T00:33:48.155 INFO:tasks.workunit.client.0.smithi049.stdout:8/152: dread - d1/d2/f38 zero size 2024-02-22T00:33:48.166 INFO:tasks.workunit.client.0.smithi049.stdout:8/153: dwrite d1/d2/f27 [0,4194304] 0 2024-02-22T00:33:48.171 INFO:tasks.workunit.client.0.smithi049.stdout:8/154: dread d1/d2/d5/f18 [0,4194304] 0 2024-02-22T00:33:48.171 INFO:tasks.workunit.client.0.smithi049.stdout:5/137: dwrite d0/de/fb [0,4194304] 0 2024-02-22T00:33:48.180 INFO:tasks.workunit.client.0.smithi049.stdout:8/155: write d1/d2/db/f16 [1383528,44275] 0 2024-02-22T00:33:48.180 INFO:tasks.workunit.client.0.smithi049.stdout:5/138: dwrite d0/de/d6/f12 [0,4194304] 0 2024-02-22T00:33:48.184 INFO:tasks.workunit.client.0.smithi049.stdout:8/156: mknod d1/d2/db/d1c/d3b/c3d 0 2024-02-22T00:33:48.188 INFO:tasks.workunit.client.0.smithi049.stdout:4/244: sync 2024-02-22T00:33:48.188 INFO:tasks.workunit.client.0.smithi049.stdout:2/179: sync 2024-02-22T00:33:48.188 INFO:tasks.workunit.client.0.smithi049.stdout:1/135: sync 2024-02-22T00:33:48.188 INFO:tasks.workunit.client.0.smithi049.stdout:3/50: sync 2024-02-22T00:33:48.189 INFO:tasks.workunit.client.0.smithi049.stdout:5/139: dwrite d0/de/fb [0,4194304] 0 2024-02-22T00:33:48.189 INFO:tasks.workunit.client.0.smithi049.stdout:8/157: rename d1/lc to d1/d2/db/d1c/d3b/l3e 0 2024-02-22T00:33:48.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/51: mknod d0/d1/ca 0 2024-02-22T00:33:48.194 INFO:tasks.workunit.client.0.smithi049.stdout:4/245: mkdir d3/d22/d49 0 2024-02-22T00:33:48.194 INFO:tasks.workunit.client.0.smithi049.stdout:8/158: symlink d1/d2/d5/l3f 0 2024-02-22T00:33:48.196 INFO:tasks.workunit.client.0.smithi049.stdout:2/180: read d2/d9/de/d3a/f37 [35547,13414] 0 2024-02-22T00:33:48.198 INFO:tasks.workunit.client.0.smithi049.stdout:4/246: rmdir d3/d13 39 2024-02-22T00:33:48.198 INFO:tasks.workunit.client.0.smithi049.stdout:1/136: truncate d2/d8/db/f19 1657148 0 2024-02-22T00:33:48.199 INFO:tasks.workunit.client.0.smithi049.stdout:4/247: dread - d3/f2f zero size 2024-02-22T00:33:48.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/137: write d2/f3 [1232833,111824] 0 2024-02-22T00:33:48.203 INFO:tasks.workunit.client.0.smithi049.stdout:3/52: dwrite d0/f6 [0,4194304] 0 2024-02-22T00:33:48.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/53: fdatasync d0/d1/f3 0 2024-02-22T00:33:48.210 INFO:tasks.workunit.client.0.smithi049.stdout:2/181: link d2/f1c d2/d9/de/d3a/f44 0 2024-02-22T00:33:48.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/159: dwrite d1/d2/f3 [0,4194304] 0 2024-02-22T00:33:48.212 INFO:tasks.workunit.client.0.smithi049.stdout:8/160: chown d1/d2/db/c1f 18491 1 2024-02-22T00:33:48.216 INFO:tasks.workunit.client.0.smithi049.stdout:1/138: creat d2/d8/db/f34 x:0 0 0 2024-02-22T00:33:48.218 INFO:tasks.workunit.client.0.smithi049.stdout:2/182: symlink d2/l45 0 2024-02-22T00:33:48.218 INFO:tasks.workunit.client.0.smithi049.stdout:1/139: creat d2/f35 x:0 0 0 2024-02-22T00:33:48.221 INFO:tasks.workunit.client.0.smithi049.stdout:8/161: truncate d1/d2/f2e 1697417 0 2024-02-22T00:33:48.222 INFO:tasks.workunit.client.0.smithi049.stdout:1/140: read - d2/d8/db/f26 zero size 2024-02-22T00:33:48.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/162: creat d1/d2/d5/d1b/d39/f40 x:0 0 0 2024-02-22T00:33:48.224 INFO:tasks.workunit.client.0.smithi049.stdout:2/183: mkdir d2/d9/de/d10/d46 0 2024-02-22T00:33:48.225 INFO:tasks.workunit.client.0.smithi049.stdout:8/163: chown d1/d2/db/d1c/d3b/c3d 645071 1 2024-02-22T00:33:48.227 INFO:tasks.workunit.client.0.smithi049.stdout:2/184: symlink d2/d9/de/d10/d2e/l47 0 2024-02-22T00:33:48.227 INFO:tasks.workunit.client.0.smithi049.stdout:8/164: write d1/d2/f38 [393253,102756] 0 2024-02-22T00:33:48.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/141: rename d2/d8/db/c16 to d2/d8/da/c36 0 2024-02-22T00:33:48.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/165: fdatasync d1/d2/d5/f2c 0 2024-02-22T00:33:48.230 INFO:tasks.workunit.client.0.smithi049.stdout:8/166: readlink d1/d2/d5/l3f 0 2024-02-22T00:33:48.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/185: symlink d2/d9/de/l48 0 2024-02-22T00:33:48.232 INFO:tasks.workunit.client.0.smithi049.stdout:8/167: dread - d1/d2/d5/d1b/f32 zero size 2024-02-22T00:33:48.232 INFO:tasks.workunit.client.0.smithi049.stdout:1/142: mknod d2/d8/db/c37 0 2024-02-22T00:33:48.233 INFO:tasks.workunit.client.0.smithi049.stdout:2/186: creat d2/d9/de/d10/d2e/f49 x:0 0 0 2024-02-22T00:33:48.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/143: chown d2/d8/db/l20 25346 1 2024-02-22T00:33:48.237 INFO:tasks.workunit.client.0.smithi049.stdout:1/144: symlink d2/d8/db/d25/l38 0 2024-02-22T00:33:48.239 INFO:tasks.workunit.client.0.smithi049.stdout:1/145: chown d2/d8/db/d25/f2c 80990 1 2024-02-22T00:33:48.242 INFO:tasks.workunit.client.0.smithi049.stdout:2/187: dwrite d2/d9/de/d15/d1b/f1f [0,4194304] 0 2024-02-22T00:33:48.244 INFO:tasks.workunit.client.0.smithi049.stdout:1/146: dread d2/d8/da/fd [0,4194304] 0 2024-02-22T00:33:48.248 INFO:tasks.workunit.client.0.smithi049.stdout:2/188: rename d2/d9/de/d3a/f34 to d2/d9/de/d15/f4a 0 2024-02-22T00:33:48.249 INFO:tasks.workunit.client.0.smithi049.stdout:2/189: dread - d2/f36 zero size 2024-02-22T00:33:48.250 INFO:tasks.workunit.client.0.smithi049.stdout:2/190: stat d2/d9/de/d15/d1b/f1f 0 2024-02-22T00:33:48.252 INFO:tasks.workunit.client.0.smithi049.stdout:1/147: creat d2/d8/da/f39 x:0 0 0 2024-02-22T00:33:48.253 INFO:tasks.workunit.client.0.smithi049.stdout:1/148: dread - d2/d8/da/f1e zero size 2024-02-22T00:33:48.253 INFO:tasks.workunit.client.0.smithi049.stdout:2/191: write d2/d9/de/d3a/f44 [2862664,75646] 0 2024-02-22T00:33:48.256 INFO:tasks.workunit.client.0.smithi049.stdout:1/149: rename d2/c24 to d2/c3a 0 2024-02-22T00:33:48.258 INFO:tasks.workunit.client.0.smithi049.stdout:1/150: stat d2/d8/db/l2a 0 2024-02-22T00:33:48.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/151: truncate d2/d8/da/f32 782278 0 2024-02-22T00:33:48.262 INFO:tasks.workunit.client.0.smithi049.stdout:2/192: dwrite d2/d9/de/f2b [0,4194304] 0 2024-02-22T00:33:48.263 INFO:tasks.workunit.client.0.smithi049.stdout:1/152: write d2/f30 [743762,57321] 0 2024-02-22T00:33:48.268 INFO:tasks.workunit.client.0.smithi049.stdout:1/153: stat d2/d8/c1b 0 2024-02-22T00:33:48.268 INFO:tasks.workunit.client.0.smithi049.stdout:1/154: stat d2/d8/c1b 0 2024-02-22T00:33:48.268 INFO:tasks.workunit.client.0.smithi049.stdout:2/193: link d2/d9/de/d15/d1b/f1f d2/d9/de/d15/f4b 0 2024-02-22T00:33:48.270 INFO:tasks.workunit.client.0.smithi049.stdout:2/194: fsync d2/d9/de/d10/f12 0 2024-02-22T00:33:48.271 INFO:tasks.workunit.client.0.smithi049.stdout:1/155: creat d2/d8/da/f3b x:0 0 0 2024-02-22T00:33:48.271 INFO:tasks.workunit.client.0.smithi049.stdout:1/156: readlink d2/d8/l29 0 2024-02-22T00:33:48.276 INFO:tasks.workunit.client.0.smithi049.stdout:2/195: rename d2/c3b to d2/d9/de/d10/d2e/d42/c4c 0 2024-02-22T00:33:48.279 INFO:tasks.workunit.client.0.smithi049.stdout:2/196: mkdir d2/d9/dd/d4d 0 2024-02-22T00:33:48.282 INFO:tasks.workunit.client.0.smithi049.stdout:2/197: creat d2/d9/dd/d4d/f4e x:0 0 0 2024-02-22T00:33:48.287 INFO:tasks.workunit.client.0.smithi049.stdout:3/54: dwrite d0/d1/f4 [0,4194304] 0 2024-02-22T00:33:48.287 INFO:tasks.workunit.client.0.smithi049.stdout:2/198: truncate d2/d9/de/d15/d1b/f20 1014261 0 2024-02-22T00:33:48.289 INFO:tasks.workunit.client.0.smithi049.stdout:2/199: dread - d2/d9/dd/d4d/f4e zero size 2024-02-22T00:33:48.293 INFO:tasks.workunit.client.0.smithi049.stdout:2/200: fsync d2/d9/de/f26 0 2024-02-22T00:33:48.296 INFO:tasks.workunit.client.0.smithi049.stdout:3/55: dread d0/d1/f4 [0,4194304] 0 2024-02-22T00:33:48.297 INFO:tasks.workunit.client.0.smithi049.stdout:3/56: chown d0/d1/f4 246128141 1 2024-02-22T00:33:48.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/168: dwrite d1/d2/db/f19 [0,4194304] 0 2024-02-22T00:33:48.304 INFO:tasks.workunit.client.0.smithi049.stdout:3/57: dread d0/f6 [0,4194304] 0 2024-02-22T00:33:48.304 INFO:tasks.workunit.client.0.smithi049.stdout:8/169: mknod d1/d2/db/d15/d33/c41 0 2024-02-22T00:33:48.307 INFO:tasks.workunit.client.0.smithi049.stdout:8/170: creat d1/f42 x:0 0 0 2024-02-22T00:33:48.315 INFO:tasks.workunit.client.0.smithi049.stdout:3/58: dwrite d0/f6 [0,4194304] 0 2024-02-22T00:33:48.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/171: dread d1/d2/db/f19 [0,4194304] 0 2024-02-22T00:33:48.317 INFO:tasks.workunit.client.0.smithi049.stdout:2/201: dread d2/f6 [0,4194304] 0 2024-02-22T00:33:48.325 INFO:tasks.workunit.client.0.smithi049.stdout:2/202: rmdir d2/d9/dd/d4d 39 2024-02-22T00:33:48.325 INFO:tasks.workunit.client.0.smithi049.stdout:8/172: write d1/d2/db/d15/f10 [1295100,104975] 0 2024-02-22T00:33:48.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/59: dwrite d0/d1/f4 [0,4194304] 0 2024-02-22T00:33:48.332 INFO:tasks.workunit.client.0.smithi049.stdout:3/60: chown d0/d1/f4 28984431 1 2024-02-22T00:33:48.332 INFO:tasks.workunit.client.0.smithi049.stdout:2/203: mkdir d2/d9/de/d15/d4f 0 2024-02-22T00:33:48.335 INFO:tasks.workunit.client.0.smithi049.stdout:3/61: mknod d0/cb 0 2024-02-22T00:33:48.335 INFO:tasks.workunit.client.0.smithi049.stdout:2/204: mknod d2/d9/de/d3a/c50 0 2024-02-22T00:33:48.339 INFO:tasks.workunit.client.0.smithi049.stdout:9/173: sync 2024-02-22T00:33:48.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/174: write d17/d21/f28 [125605,24564] 0 2024-02-22T00:33:48.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/62: dwrite d0/d1/f3 [0,4194304] 0 2024-02-22T00:33:48.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/205: dwrite d2/f36 [0,4194304] 0 2024-02-22T00:33:48.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/175: link d17/d1c/l2a d17/d21/d3c/l42 0 2024-02-22T00:33:48.354 INFO:tasks.workunit.client.0.smithi049.stdout:3/63: link d0/d1/f9 d0/fc 0 2024-02-22T00:33:48.355 INFO:tasks.workunit.client.0.smithi049.stdout:2/206: mkdir d2/d9/de/d15/d51 0 2024-02-22T00:33:48.355 INFO:tasks.workunit.client.0.smithi049.stdout:8/173: dread d1/f12 [4194304,4194304] 0 2024-02-22T00:33:48.361 INFO:tasks.workunit.client.0.smithi049.stdout:9/176: creat d17/d21/f43 x:0 0 0 2024-02-22T00:33:48.363 INFO:tasks.workunit.client.0.smithi049.stdout:9/177: write d17/d1c/f3b [399952,125142] 0 2024-02-22T00:33:48.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/178: fdatasync d17/f1f 0 2024-02-22T00:33:48.366 INFO:tasks.workunit.client.0.smithi049.stdout:2/207: creat d2/f52 x:0 0 0 2024-02-22T00:33:48.367 INFO:tasks.workunit.client.0.smithi049.stdout:2/208: chown d2/d9/f3c 1476 1 2024-02-22T00:33:48.368 INFO:tasks.workunit.client.0.smithi049.stdout:3/64: dwrite d0/d1/f9 [0,4194304] 0 2024-02-22T00:33:48.369 INFO:tasks.workunit.client.0.smithi049.stdout:2/209: chown d2/d9/de/d10/d2e/l47 45936832 1 2024-02-22T00:33:48.370 INFO:tasks.workunit.client.0.smithi049.stdout:9/179: link c16 d17/d1c/d38/c44 0 2024-02-22T00:33:48.370 INFO:tasks.workunit.client.0.smithi049.stdout:2/210: read - d2/f52 zero size 2024-02-22T00:33:48.371 INFO:tasks.workunit.client.0.smithi049.stdout:9/180: write d17/f18 [3042963,18883] 0 2024-02-22T00:33:48.377 INFO:tasks.workunit.client.0.smithi049.stdout:3/65: rename d0/d1 to d0/dd 0 2024-02-22T00:33:48.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/211: mknod d2/d9/de/d15/d4f/c53 0 2024-02-22T00:33:48.381 INFO:tasks.workunit.client.0.smithi049.stdout:2/212: creat d2/d9/de/d3a/f54 x:0 0 0 2024-02-22T00:33:48.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/213: mknod d2/d9/de/d15/d1b/c55 0 2024-02-22T00:33:48.385 INFO:tasks.workunit.client.0.smithi049.stdout:2/214: fdatasync d2/d9/de/d15/d1b/f25 0 2024-02-22T00:33:48.386 INFO:tasks.workunit.client.0.smithi049.stdout:2/215: truncate d2/d9/f3c 241714 0 2024-02-22T00:33:48.387 INFO:tasks.workunit.client.0.smithi049.stdout:2/216: read - d2/d9/de/d10/d2e/f49 zero size 2024-02-22T00:33:48.389 INFO:tasks.workunit.client.0.smithi049.stdout:2/217: creat d2/d9/de/d3a/f56 x:0 0 0 2024-02-22T00:33:48.391 INFO:tasks.workunit.client.0.smithi049.stdout:9/181: truncate d17/f20 3641911 0 2024-02-22T00:33:48.393 INFO:tasks.workunit.client.0.smithi049.stdout:3/66: truncate d0/dd/f9 479798 0 2024-02-22T00:33:48.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/67: rename d0/cb to d0/dd/ce 0 2024-02-22T00:33:48.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/182: rename d17/l1b to d17/l45 0 2024-02-22T00:33:48.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/183: chown f14 1701945217 1 2024-02-22T00:33:48.398 INFO:tasks.workunit.client.0.smithi049.stdout:2/218: link d2/d9/de/d10/f29 d2/d9/de/f57 0 2024-02-22T00:33:48.400 INFO:tasks.workunit.client.0.smithi049.stdout:2/219: mknod d2/d9/de/c58 0 2024-02-22T00:33:48.404 INFO:tasks.workunit.client.0.smithi049.stdout:3/68: write d0/fc [435462,14539] 0 2024-02-22T00:33:48.404 INFO:tasks.workunit.client.0.smithi049.stdout:9/184: dwrite d17/d21/d3c/f40 [0,4194304] 0 2024-02-22T00:33:48.408 INFO:tasks.workunit.client.0.smithi049.stdout:2/220: mkdir d2/d9/de/d10/d59 0 2024-02-22T00:33:48.410 INFO:tasks.workunit.client.0.smithi049.stdout:3/69: creat d0/dd/ff x:0 0 0 2024-02-22T00:33:48.413 INFO:tasks.workunit.client.0.smithi049.stdout:2/221: fsync d2/d9/de/d3a/f37 0 2024-02-22T00:33:48.415 INFO:tasks.workunit.client.0.smithi049.stdout:9/185: getdents d17/d1c/d38 0 2024-02-22T00:33:48.415 INFO:tasks.workunit.client.0.smithi049.stdout:9/186: stat d17/d21/f23 0 2024-02-22T00:33:48.417 INFO:tasks.workunit.client.0.smithi049.stdout:3/70: creat d0/f10 x:0 0 0 2024-02-22T00:33:48.418 INFO:tasks.workunit.client.0.smithi049.stdout:3/71: write d0/f10 [957956,77177] 0 2024-02-22T00:33:48.418 INFO:tasks.workunit.client.0.smithi049.stdout:9/187: rmdir d17/d21/d24 39 2024-02-22T00:33:48.420 INFO:tasks.workunit.client.0.smithi049.stdout:2/222: mkdir d2/d9/dd/d4d/d5a 0 2024-02-22T00:33:48.422 INFO:tasks.workunit.client.0.smithi049.stdout:9/188: readlink d17/d1c/l2a 0 2024-02-22T00:33:48.423 INFO:tasks.workunit.client.0.smithi049.stdout:2/223: readlink d2/l8 0 2024-02-22T00:33:48.426 INFO:tasks.workunit.client.0.smithi049.stdout:3/72: rename d0/f10 to d0/f11 0 2024-02-22T00:33:48.429 INFO:tasks.workunit.client.0.smithi049.stdout:2/224: symlink d2/d9/de/d10/d59/l5b 0 2024-02-22T00:33:48.429 INFO:tasks.workunit.client.0.smithi049.stdout:9/189: dwrite d17/f27 [0,4194304] 0 2024-02-22T00:33:48.432 INFO:tasks.workunit.client.0.smithi049.stdout:9/190: truncate d17/d21/f43 694806 0 2024-02-22T00:33:48.432 INFO:tasks.workunit.client.0.smithi049.stdout:2/225: creat d2/d9/f5c x:0 0 0 2024-02-22T00:33:48.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/73: dwrite d0/dd/ff [0,4194304] 0 2024-02-22T00:33:48.437 INFO:tasks.workunit.client.0.smithi049.stdout:9/191: creat d17/d21/f46 x:0 0 0 2024-02-22T00:33:48.439 INFO:tasks.workunit.client.0.smithi049.stdout:9/192: chown d17/d21/f28 11220283 1 2024-02-22T00:33:48.439 INFO:tasks.workunit.client.0.smithi049.stdout:2/226: getdents d2/d9/de/d15/d51 0 2024-02-22T00:33:48.440 INFO:tasks.workunit.client.0.smithi049.stdout:3/74: symlink d0/l12 0 2024-02-22T00:33:48.445 INFO:tasks.workunit.client.0.smithi049.stdout:9/193: read d17/d1c/f1e [425697,130147] 0 2024-02-22T00:33:48.445 INFO:tasks.workunit.client.0.smithi049.stdout:2/227: mkdir d2/d9/de/d10/d46/d5d 0 2024-02-22T00:33:48.447 INFO:tasks.workunit.client.0.smithi049.stdout:9/194: dread d17/d21/f43 [0,4194304] 0 2024-02-22T00:33:48.447 INFO:tasks.workunit.client.0.smithi049.stdout:2/228: mknod d2/d9/dd/c5e 0 2024-02-22T00:33:48.448 INFO:tasks.workunit.client.0.smithi049.stdout:2/229: truncate d2/d9/f5c 594444 0 2024-02-22T00:33:48.449 INFO:tasks.workunit.client.0.smithi049.stdout:9/195: mkdir d17/d21/d47 0 2024-02-22T00:33:48.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/230: symlink d2/d9/de/d15/l5f 0 2024-02-22T00:33:48.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/196: write d17/f1f [1016929,39010] 0 2024-02-22T00:33:48.451 INFO:tasks.workunit.client.0.smithi049.stdout:2/231: write d2/f36 [4680937,62534] 0 2024-02-22T00:33:48.453 INFO:tasks.workunit.client.0.smithi049.stdout:9/197: mknod d17/d21/d3c/c48 0 2024-02-22T00:33:48.454 INFO:tasks.workunit.client.0.smithi049.stdout:2/232: mknod d2/d9/de/d10/d46/d5d/c60 0 2024-02-22T00:33:48.456 INFO:tasks.workunit.client.0.smithi049.stdout:2/233: read d2/d9/de/d3a/f44 [2486864,38705] 0 2024-02-22T00:33:48.456 INFO:tasks.workunit.client.0.smithi049.stdout:9/198: symlink d17/l49 0 2024-02-22T00:33:48.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/234: fsync d2/d9/d17/f18 0 2024-02-22T00:33:48.463 INFO:tasks.workunit.client.0.smithi049.stdout:9/199: truncate d17/f20 4465888 0 2024-02-22T00:33:48.465 INFO:tasks.workunit.client.0.smithi049.stdout:9/200: creat d17/d21/d3c/f4a x:0 0 0 2024-02-22T00:33:48.468 INFO:tasks.workunit.client.0.smithi049.stdout:9/201: mkdir d17/d21/d24/d4b 0 2024-02-22T00:33:48.468 INFO:tasks.workunit.client.0.smithi049.stdout:2/235: write d2/d9/de/d15/d1b/f25 [1081549,93219] 0 2024-02-22T00:33:48.470 INFO:tasks.workunit.client.0.smithi049.stdout:2/236: chown d2/d9/de/d10/f12 100539 1 2024-02-22T00:33:48.471 INFO:tasks.workunit.client.0.smithi049.stdout:9/202: symlink d17/l4c 0 2024-02-22T00:33:48.471 INFO:tasks.workunit.client.0.smithi049.stdout:2/237: creat d2/d9/de/d3a/f61 x:0 0 0 2024-02-22T00:33:48.475 INFO:tasks.workunit.client.0.smithi049.stdout:9/203: getdents d17/d1c/d25 0 2024-02-22T00:33:48.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/204: chown l6 100 1 2024-02-22T00:33:48.480 INFO:tasks.workunit.client.0.smithi049.stdout:2/238: write d2/d9/de/d3a/f37 [1871268,72476] 0 2024-02-22T00:33:48.481 INFO:tasks.workunit.client.0.smithi049.stdout:9/205: write d17/d21/f29 [233096,20626] 0 2024-02-22T00:33:48.483 INFO:tasks.workunit.client.0.smithi049.stdout:9/206: rmdir d17/d1c/d38 39 2024-02-22T00:33:48.485 INFO:tasks.workunit.client.0.smithi049.stdout:2/239: write d2/d9/de/d3a/f44 [2700944,97288] 0 2024-02-22T00:33:48.486 INFO:tasks.workunit.client.0.smithi049.stdout:9/207: getdents d17/d1c/d38 0 2024-02-22T00:33:48.486 INFO:tasks.workunit.client.0.smithi049.stdout:2/240: chown d2/f6 8088 1 2024-02-22T00:33:48.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/241: readlink d2/d9/de/d15/l5f 0 2024-02-22T00:33:48.488 INFO:tasks.workunit.client.0.smithi049.stdout:9/208: creat d17/d21/d24/f4d x:0 0 0 2024-02-22T00:33:48.490 INFO:tasks.workunit.client.0.smithi049.stdout:2/242: dread d2/d9/de/d15/d1b/f20 [0,4194304] 0 2024-02-22T00:33:48.491 INFO:tasks.workunit.client.0.smithi049.stdout:2/243: fdatasync d2/d9/de/d15/d1b/f25 0 2024-02-22T00:33:48.493 INFO:tasks.workunit.client.0.smithi049.stdout:9/209: dread d17/f1f [0,4194304] 0 2024-02-22T00:33:48.494 INFO:tasks.workunit.client.0.smithi049.stdout:9/210: truncate d17/d21/f23 253909 0 2024-02-22T00:33:48.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/211: rename d17/d21/d24 to d17/d21/d4e 0 2024-02-22T00:33:48.501 INFO:tasks.workunit.client.0.smithi049.stdout:2/244: truncate d2/d9/fa 4140539 0 2024-02-22T00:33:48.502 INFO:tasks.workunit.client.0.smithi049.stdout:2/245: chown d2/d9/de/d15/d1b/f1f 871378 1 2024-02-22T00:33:48.502 INFO:tasks.workunit.client.0.smithi049.stdout:9/212: creat d17/d21/f4f x:0 0 0 2024-02-22T00:33:48.503 INFO:tasks.workunit.client.0.smithi049.stdout:2/246: dread - d2/d9/de/d3a/f61 zero size 2024-02-22T00:33:48.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/213: link d17/d1c/f1e d17/d21/f50 0 2024-02-22T00:33:48.512 INFO:tasks.workunit.client.0.smithi049.stdout:0/217: sync 2024-02-22T00:33:48.513 INFO:tasks.workunit.client.0.smithi049.stdout:7/213: sync 2024-02-22T00:33:48.513 INFO:tasks.workunit.client.0.smithi049.stdout:0/218: chown d3/df/d17/d1b 0 1 2024-02-22T00:33:48.514 INFO:tasks.workunit.client.0.smithi049.stdout:7/214: write d1/f8 [4979927,94189] 0 2024-02-22T00:33:48.515 INFO:tasks.workunit.client.0.smithi049.stdout:0/219: chown d3/df/d17/d1b/l22 3973 1 2024-02-22T00:33:48.516 INFO:tasks.workunit.client.0.smithi049.stdout:7/215: creat d1/d49/f50 x:0 0 0 2024-02-22T00:33:48.516 INFO:tasks.workunit.client.0.smithi049.stdout:0/220: fsync d3/df/d17/f20 0 2024-02-22T00:33:48.518 INFO:tasks.workunit.client.0.smithi049.stdout:0/221: truncate d3/f13 1629443 0 2024-02-22T00:33:48.532 INFO:tasks.workunit.client.0.smithi049.stdout:2/247: dread d2/d9/de/d10/d2e/d42/f43 [0,4194304] 0 2024-02-22T00:33:48.532 INFO:tasks.workunit.client.0.smithi049.stdout:7/216: dwrite d1/df/f45 [0,4194304] 0 2024-02-22T00:33:48.534 INFO:tasks.workunit.client.0.smithi049.stdout:2/248: write d2/d9/f2a [4292667,85909] 0 2024-02-22T00:33:48.583 INFO:tasks.workunit.client.0.smithi049.stdout:7/217: rename d1/df/c15 to d1/df/d12/d1c/d24/c51 0 2024-02-22T00:33:48.583 INFO:tasks.workunit.client.0.smithi049.stdout:7/218: write d1/f8 [1675119,21334] 0 2024-02-22T00:33:48.584 INFO:tasks.workunit.client.0.smithi049.stdout:7/219: stat d1/f8 0 2024-02-22T00:33:48.586 INFO:tasks.workunit.client.0.smithi049.stdout:0/222: dread d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:48.586 INFO:tasks.workunit.client.0.smithi049.stdout:2/249: write d2/d9/de/d15/d1b/f25 [2603721,59508] 0 2024-02-22T00:33:48.586 INFO:tasks.workunit.client.0.smithi049.stdout:7/220: fdatasync d1/d49/f50 0 2024-02-22T00:33:48.587 INFO:tasks.workunit.client.0.smithi049.stdout:7/221: read - d1/d49/f50 zero size 2024-02-22T00:33:48.588 INFO:tasks.workunit.client.0.smithi049.stdout:2/250: unlink d2/f1c 0 2024-02-22T00:33:48.588 INFO:tasks.workunit.client.0.smithi049.stdout:7/222: read - d1/d41/d28/f39 zero size 2024-02-22T00:33:48.590 INFO:tasks.workunit.client.0.smithi049.stdout:0/223: stat d3/df/d17/c1d 0 2024-02-22T00:33:48.591 INFO:tasks.workunit.client.0.smithi049.stdout:2/251: mkdir d2/d9/d17/d62 0 2024-02-22T00:33:48.592 INFO:tasks.workunit.client.0.smithi049.stdout:2/252: readlink d2/l3f 0 2024-02-22T00:33:48.592 INFO:tasks.workunit.client.0.smithi049.stdout:2/253: fdatasync d2/d9/f5c 0 2024-02-22T00:33:48.593 INFO:tasks.workunit.client.0.smithi049.stdout:2/254: fdatasync d2/d9/f5c 0 2024-02-22T00:33:48.593 INFO:tasks.workunit.client.0.smithi049.stdout:0/224: unlink d3/d1e/l35 0 2024-02-22T00:33:48.595 INFO:tasks.workunit.client.0.smithi049.stdout:0/225: read d3/df/d17/f2f [60512,24097] 0 2024-02-22T00:33:48.598 INFO:tasks.workunit.client.0.smithi049.stdout:0/226: read d3/f13 [1031502,125440] 0 2024-02-22T00:33:48.598 INFO:tasks.workunit.client.0.smithi049.stdout:2/255: truncate d2/d9/de/d15/d1b/f20 1323349 0 2024-02-22T00:33:48.605 INFO:tasks.workunit.client.0.smithi049.stdout:7/223: truncate d1/f6 1903311 0 2024-02-22T00:33:48.605 INFO:tasks.workunit.client.0.smithi049.stdout:2/256: dread d2/d9/de/f2b [0,4194304] 0 2024-02-22T00:33:48.606 INFO:tasks.workunit.client.0.smithi049.stdout:0/227: dwrite d3/df/d17/f20 [0,4194304] 0 2024-02-22T00:33:48.608 INFO:tasks.workunit.client.0.smithi049.stdout:7/224: truncate d1/f3d 434573 0 2024-02-22T00:33:48.609 INFO:tasks.workunit.client.0.smithi049.stdout:0/228: mknod d3/df/c39 0 2024-02-22T00:33:48.613 INFO:tasks.workunit.client.0.smithi049.stdout:0/229: mknod d3/c3a 0 2024-02-22T00:33:48.614 INFO:tasks.workunit.client.0.smithi049.stdout:0/230: chown d3/d6/d29 16 1 2024-02-22T00:33:48.616 INFO:tasks.workunit.client.0.smithi049.stdout:7/225: dwrite d1/d49/f50 [0,4194304] 0 2024-02-22T00:33:48.623 INFO:tasks.workunit.client.0.smithi049.stdout:2/257: truncate d2/d9/fa 1456161 0 2024-02-22T00:33:48.628 INFO:tasks.workunit.client.0.smithi049.stdout:0/231: link d3/df/c33 d3/d6/d8/d36/c3b 0 2024-02-22T00:33:48.629 INFO:tasks.workunit.client.0.smithi049.stdout:2/258: dwrite d2/f36 [0,4194304] 0 2024-02-22T00:33:48.631 INFO:tasks.workunit.client.0.smithi049.stdout:7/226: creat d1/df/d12/d1c/d24/f52 x:0 0 0 2024-02-22T00:33:48.631 INFO:tasks.workunit.client.0.smithi049.stdout:2/259: mkdir d2/d9/de/d10/d46/d63 0 2024-02-22T00:33:48.633 INFO:tasks.workunit.client.0.smithi049.stdout:7/227: truncate d1/d41/d28/f39 438844 0 2024-02-22T00:33:48.636 INFO:tasks.workunit.client.0.smithi049.stdout:7/228: unlink d1/l37 0 2024-02-22T00:33:48.639 INFO:tasks.workunit.client.0.smithi049.stdout:7/229: truncate d1/df/f13 153533 0 2024-02-22T00:33:48.640 INFO:tasks.workunit.client.0.smithi049.stdout:7/230: fdatasync d1/d41/d28/f39 0 2024-02-22T00:33:48.643 INFO:tasks.workunit.client.0.smithi049.stdout:2/260: dread d2/d9/de/d10/f12 [0,4194304] 0 2024-02-22T00:33:48.645 INFO:tasks.workunit.client.0.smithi049.stdout:2/261: symlink d2/d9/d17/l64 0 2024-02-22T00:33:48.645 INFO:tasks.workunit.client.0.smithi049.stdout:2/262: truncate d2/d9/f3c 1012512 0 2024-02-22T00:33:48.646 INFO:tasks.workunit.client.0.smithi049.stdout:4/248: sync 2024-02-22T00:33:48.647 INFO:tasks.workunit.client.0.smithi049.stdout:4/249: dread - d3/d22/d24/f36 zero size 2024-02-22T00:33:48.652 INFO:tasks.workunit.client.0.smithi049.stdout:4/250: rmdir d3 39 2024-02-22T00:33:48.654 INFO:tasks.workunit.client.0.smithi049.stdout:7/231: dread d1/f8 [0,4194304] 0 2024-02-22T00:33:48.655 INFO:tasks.workunit.client.0.smithi049.stdout:4/251: chown d3/d8/d20/c2b 5684 1 2024-02-22T00:33:48.656 INFO:tasks.workunit.client.0.smithi049.stdout:4/252: fdatasync d3/d8/d10/d12/f38 0 2024-02-22T00:33:48.657 INFO:tasks.workunit.client.0.smithi049.stdout:7/232: creat d1/d49/f53 x:0 0 0 2024-02-22T00:33:48.658 INFO:tasks.workunit.client.0.smithi049.stdout:7/233: readlink d1/d41/d28/l43 0 2024-02-22T00:33:48.661 INFO:tasks.workunit.client.0.smithi049.stdout:7/234: symlink d1/df/d12/d48/l54 0 2024-02-22T00:33:48.665 INFO:tasks.workunit.client.0.smithi049.stdout:2/263: write d2/d9/de/d15/d1b/f25 [796739,63955] 0 2024-02-22T00:33:48.667 INFO:tasks.workunit.client.0.smithi049.stdout:7/235: truncate d1/df/d12/d1c/d1d/f46 631533 0 2024-02-22T00:33:48.667 INFO:tasks.workunit.client.0.smithi049.stdout:4/253: dwrite d3/d8/d10/f44 [0,4194304] 0 2024-02-22T00:33:48.668 INFO:tasks.workunit.client.0.smithi049.stdout:7/236: readlink d1/d41/d28/l43 0 2024-02-22T00:33:48.672 INFO:tasks.workunit.client.0.smithi049.stdout:2/264: creat d2/d9/de/d15/d4f/f65 x:0 0 0 2024-02-22T00:33:48.672 INFO:tasks.workunit.client.0.smithi049.stdout:2/265: readlink d2/l45 0 2024-02-22T00:33:48.672 INFO:tasks.workunit.client.0.smithi049.stdout:7/237: readlink d1/df/l14 0 2024-02-22T00:33:48.673 INFO:tasks.workunit.client.0.smithi049.stdout:7/238: mkdir d1/d41/d55 0 2024-02-22T00:33:48.676 INFO:tasks.workunit.client.0.smithi049.stdout:2/266: dread d2/d9/de/d15/d1b/f20 [0,4194304] 0 2024-02-22T00:33:48.677 INFO:tasks.workunit.client.0.smithi049.stdout:7/239: symlink d1/df/l56 0 2024-02-22T00:33:48.680 INFO:tasks.workunit.client.0.smithi049.stdout:7/240: read d1/df/d12/d1c/d1d/f46 [199262,122752] 0 2024-02-22T00:33:48.681 INFO:tasks.workunit.client.0.smithi049.stdout:2/267: getdents d2/d9/de/d10/d46/d63 0 2024-02-22T00:33:48.681 INFO:tasks.workunit.client.0.smithi049.stdout:7/241: chown d1/df/l14 3 1 2024-02-22T00:33:48.682 INFO:tasks.workunit.client.0.smithi049.stdout:4/254: truncate d3/d8/d20/f3c 309566 0 2024-02-22T00:33:48.684 INFO:tasks.workunit.client.0.smithi049.stdout:2/268: symlink d2/d9/de/d15/d4f/l66 0 2024-02-22T00:33:48.685 INFO:tasks.workunit.client.0.smithi049.stdout:4/255: symlink d3/d8/d10/d39/l4a 0 2024-02-22T00:33:48.686 INFO:tasks.workunit.client.0.smithi049.stdout:2/269: chown d2/d9/dd/l41 7726133 1 2024-02-22T00:33:48.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/242: getdents d1 0 2024-02-22T00:33:48.689 INFO:tasks.workunit.client.0.smithi049.stdout:2/270: fsync d2/d9/de/d3a/f54 0 2024-02-22T00:33:48.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/256: creat d3/f4b x:0 0 0 2024-02-22T00:33:48.692 INFO:tasks.workunit.client.0.smithi049.stdout:4/257: dread - d3/f42 zero size 2024-02-22T00:33:48.692 INFO:tasks.workunit.client.0.smithi049.stdout:7/243: dread f0 [0,4194304] 0 2024-02-22T00:33:48.693 INFO:tasks.workunit.client.0.smithi049.stdout:4/258: read - d3/f42 zero size 2024-02-22T00:33:48.695 INFO:tasks.workunit.client.0.smithi049.stdout:4/259: rmdir d3/d22 39 2024-02-22T00:33:48.699 INFO:tasks.workunit.client.0.smithi049.stdout:4/260: symlink d3/d33/l4c 0 2024-02-22T00:33:48.702 INFO:tasks.workunit.client.0.smithi049.stdout:2/271: dwrite d2/d9/de/d10/f19 [0,4194304] 0 2024-02-22T00:33:48.715 INFO:tasks.workunit.client.0.smithi049.stdout:2/272: dwrite d2/d9/de/d15/d1b/f25 [0,4194304] 0 2024-02-22T00:33:48.724 INFO:tasks.workunit.client.0.smithi049.stdout:2/273: rename d2/f36 to d2/d9/de/d10/d46/f67 0 2024-02-22T00:33:48.725 INFO:tasks.workunit.client.0.smithi049.stdout:2/274: chown d2/d9/de/d15/d51 504733 1 2024-02-22T00:33:48.733 INFO:tasks.workunit.client.0.smithi049.stdout:7/244: dread d1/df/d12/d1c/f2a [0,4194304] 0 2024-02-22T00:33:48.734 INFO:tasks.workunit.client.0.smithi049.stdout:7/245: chown d1/df/d12/d1c/d1d/f46 2387322 1 2024-02-22T00:33:48.738 INFO:tasks.workunit.client.0.smithi049.stdout:4/261: dread d3/d8/fd [0,4194304] 0 2024-02-22T00:33:48.738 INFO:tasks.workunit.client.0.smithi049.stdout:2/275: link d2/d9/fa d2/d9/de/d10/d46/f68 0 2024-02-22T00:33:48.742 INFO:tasks.workunit.client.0.smithi049.stdout:7/246: unlink d1/df/d12/c19 0 2024-02-22T00:33:48.742 INFO:tasks.workunit.client.0.smithi049.stdout:2/276: write d2/d9/de/d10/f12 [3314061,62394] 0 2024-02-22T00:33:48.744 INFO:tasks.workunit.client.0.smithi049.stdout:7/247: fsync d1/d49/f50 0 2024-02-22T00:33:48.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/262: mkdir d3/d8/d10/d43/d4d 0 2024-02-22T00:33:48.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/263: chown d3/d13/c16 19414563 1 2024-02-22T00:33:48.751 INFO:tasks.workunit.client.0.smithi049.stdout:7/248: mkdir d1/df/d12/d57 0 2024-02-22T00:33:48.753 INFO:tasks.workunit.client.0.smithi049.stdout:7/249: write d1/f4a [854436,75077] 0 2024-02-22T00:33:48.755 INFO:tasks.workunit.client.0.smithi049.stdout:2/277: dwrite d2/d9/de/d3a/f56 [0,4194304] 0 2024-02-22T00:33:48.758 INFO:tasks.workunit.client.0.smithi049.stdout:4/264: getdents d3/d8/d10/d12/d3f 0 2024-02-22T00:33:48.767 INFO:tasks.workunit.client.0.smithi049.stdout:2/278: rename d2/d9/de/d10/d46/d5d/c60 to d2/d9/de/d10/d46/d5d/c69 0 2024-02-22T00:33:48.768 INFO:tasks.workunit.client.0.smithi049.stdout:7/250: truncate d1/df/d12/f23 3155751 0 2024-02-22T00:33:48.768 INFO:tasks.workunit.client.0.smithi049.stdout:4/265: dwrite d3/d8/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:48.769 INFO:tasks.workunit.client.0.smithi049.stdout:2/279: read d2/d9/de/d15/d1b/f20 [660356,79794] 0 2024-02-22T00:33:48.774 INFO:tasks.workunit.client.0.smithi049.stdout:4/266: creat d3/d13/f4e x:0 0 0 2024-02-22T00:33:48.776 INFO:tasks.workunit.client.0.smithi049.stdout:2/280: write d2/d9/f5c [1442505,49020] 0 2024-02-22T00:33:48.780 INFO:tasks.workunit.client.0.smithi049.stdout:2/281: fsync d2/d9/dd/d4d/f4e 0 2024-02-22T00:33:48.783 INFO:tasks.workunit.client.0.smithi049.stdout:7/251: dwrite d1/df/f45 [0,4194304] 0 2024-02-22T00:33:48.790 INFO:tasks.workunit.client.0.smithi049.stdout:7/252: symlink d1/d41/d55/l58 0 2024-02-22T00:33:48.791 INFO:tasks.workunit.client.0.smithi049.stdout:2/282: link d2/d9/de/d15/d1b/f25 d2/d9/dd/d4d/f6a 0 2024-02-22T00:33:48.793 INFO:tasks.workunit.client.0.smithi049.stdout:4/267: dwrite d3/d22/d24/d35/f40 [0,4194304] 0 2024-02-22T00:33:48.798 INFO:tasks.workunit.client.0.smithi049.stdout:7/253: dread d1/d41/d28/f36 [0,4194304] 0 2024-02-22T00:33:48.802 INFO:tasks.workunit.client.0.smithi049.stdout:2/283: write d2/d9/de/d10/f29 [385315,8094] 0 2024-02-22T00:33:48.803 INFO:tasks.workunit.client.0.smithi049.stdout:4/268: dwrite d3/d22/d24/f2c [0,4194304] 0 2024-02-22T00:33:48.807 INFO:tasks.workunit.client.0.smithi049.stdout:4/269: symlink d3/d8/l4f 0 2024-02-22T00:33:48.812 INFO:tasks.workunit.client.0.smithi049.stdout:2/284: dwrite d2/d9/d17/f18 [0,4194304] 0 2024-02-22T00:33:48.813 INFO:tasks.workunit.client.0.smithi049.stdout:4/270: creat d3/d22/f50 x:0 0 0 2024-02-22T00:33:48.814 INFO:tasks.workunit.client.0.smithi049.stdout:6/206: sync 2024-02-22T00:33:48.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/140: sync 2024-02-22T00:33:48.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/157: sync 2024-02-22T00:33:48.816 INFO:tasks.workunit.client.0.smithi049.stdout:1/158: write d2/d8/da/f22 [804083,128287] 0 2024-02-22T00:33:48.820 INFO:tasks.workunit.client.0.smithi049.stdout:4/271: mkdir d3/d22/d51 0 2024-02-22T00:33:48.822 INFO:tasks.workunit.client.0.smithi049.stdout:6/207: fdatasync d3/ff 0 2024-02-22T00:33:48.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/141: dwrite d0/de/d6/f13 [0,4194304] 0 2024-02-22T00:33:48.825 INFO:tasks.workunit.client.0.smithi049.stdout:5/142: readlink d0/l27 0 2024-02-22T00:33:48.827 INFO:tasks.workunit.client.0.smithi049.stdout:1/159: symlink d2/d8/l3c 0 2024-02-22T00:33:48.829 INFO:tasks.workunit.client.0.smithi049.stdout:2/285: dwrite d2/d9/de/d10/f31 [0,4194304] 0 2024-02-22T00:33:48.829 INFO:tasks.workunit.client.0.smithi049.stdout:5/143: rmdir d0/d1a 39 2024-02-22T00:33:48.833 INFO:tasks.workunit.client.0.smithi049.stdout:4/272: creat d3/d22/f52 x:0 0 0 2024-02-22T00:33:48.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/273: write d3/f4b [210111,9579] 0 2024-02-22T00:33:48.836 INFO:tasks.workunit.client.0.smithi049.stdout:5/144: mknod d0/d20/c34 0 2024-02-22T00:33:48.836 INFO:tasks.workunit.client.0.smithi049.stdout:4/274: chown d3/d22/f50 176509 1 2024-02-22T00:33:48.837 INFO:tasks.workunit.client.0.smithi049.stdout:4/275: truncate d3/f2f 42323 0 2024-02-22T00:33:48.838 INFO:tasks.workunit.client.0.smithi049.stdout:6/208: link d3/d16/l3f d3/d36/l4b 0 2024-02-22T00:33:48.840 INFO:tasks.workunit.client.0.smithi049.stdout:4/276: mknod d3/d22/d24/d35/c53 0 2024-02-22T00:33:48.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/160: rename d2/d8/db/f19 to d2/d8/da/f3d 0 2024-02-22T00:33:48.843 INFO:tasks.workunit.client.0.smithi049.stdout:4/277: symlink d3/d8/d10/d43/l54 0 2024-02-22T00:33:48.844 INFO:tasks.workunit.client.0.smithi049.stdout:4/278: chown d3/d13/c16 5870 1 2024-02-22T00:33:48.845 INFO:tasks.workunit.client.0.smithi049.stdout:4/279: dread - d3/d22/d24/f36 zero size 2024-02-22T00:33:48.846 INFO:tasks.workunit.client.0.smithi049.stdout:5/145: rename d0/l17 to d0/d20/l35 0 2024-02-22T00:33:48.846 INFO:tasks.workunit.client.0.smithi049.stdout:1/161: mknod d2/d8/db/c3e 0 2024-02-22T00:33:48.848 INFO:tasks.workunit.client.0.smithi049.stdout:5/146: write d0/de/d6/f12 [4358659,108182] 0 2024-02-22T00:33:48.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/209: rename d3/l9 to d3/d16/d4a/l4c 0 2024-02-22T00:33:48.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/210: readlink d3/l34 0 2024-02-22T00:33:48.852 INFO:tasks.workunit.client.0.smithi049.stdout:1/162: creat d2/d8/da/f3f x:0 0 0 2024-02-22T00:33:48.853 INFO:tasks.workunit.client.0.smithi049.stdout:1/163: truncate d2/d8/db/f26 803164 0 2024-02-22T00:33:48.854 INFO:tasks.workunit.client.0.smithi049.stdout:6/211: unlink d3/fb 0 2024-02-22T00:33:48.854 INFO:tasks.workunit.client.0.smithi049.stdout:6/212: dread - d3/f1d zero size 2024-02-22T00:33:48.855 INFO:tasks.workunit.client.0.smithi049.stdout:4/280: rename d3/d8/f26 to d3/d8/d10/d45/f55 0 2024-02-22T00:33:48.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/281: dread - d3/d22/d24/f36 zero size 2024-02-22T00:33:48.857 INFO:tasks.workunit.client.0.smithi049.stdout:1/164: chown d2/d8/f27 808357 1 2024-02-22T00:33:48.857 INFO:tasks.workunit.client.0.smithi049.stdout:6/213: stat d3/f14 0 2024-02-22T00:33:48.858 INFO:tasks.workunit.client.0.smithi049.stdout:5/147: creat d0/d1a/f36 x:0 0 0 2024-02-22T00:33:48.859 INFO:tasks.workunit.client.0.smithi049.stdout:6/214: mkdir d3/d16/d4a/d4d 0 2024-02-22T00:33:48.860 INFO:tasks.workunit.client.0.smithi049.stdout:1/165: mkdir d2/d8/db/d25/d40 0 2024-02-22T00:33:48.862 INFO:tasks.workunit.client.0.smithi049.stdout:5/148: read d0/de/fc [455497,4841] 0 2024-02-22T00:33:48.863 INFO:tasks.workunit.client.0.smithi049.stdout:1/166: write d2/f31 [890405,20977] 0 2024-02-22T00:33:48.867 INFO:tasks.workunit.client.0.smithi049.stdout:5/149: creat d0/f37 x:0 0 0 2024-02-22T00:33:48.867 INFO:tasks.workunit.client.0.smithi049.stdout:4/282: dwrite d3/d33/f46 [0,4194304] 0 2024-02-22T00:33:48.872 INFO:tasks.workunit.client.0.smithi049.stdout:6/215: dwrite d3/d16/f19 [0,4194304] 0 2024-02-22T00:33:48.873 INFO:tasks.workunit.client.0.smithi049.stdout:5/150: write d0/d1a/d24/f2f [670558,9137] 0 2024-02-22T00:33:48.873 INFO:tasks.workunit.client.0.smithi049.stdout:5/151: readlink d0/de/l16 0 2024-02-22T00:33:48.874 INFO:tasks.workunit.client.0.smithi049.stdout:4/283: mknod d3/d8/d10/d12/c56 0 2024-02-22T00:33:48.876 INFO:tasks.workunit.client.0.smithi049.stdout:5/152: write d0/d1a/f36 [440421,85127] 0 2024-02-22T00:33:48.877 INFO:tasks.workunit.client.0.smithi049.stdout:6/216: write d3/f20 [851838,60710] 0 2024-02-22T00:33:48.884 INFO:tasks.workunit.client.0.smithi049.stdout:5/153: dread d0/d1a/f36 [0,4194304] 0 2024-02-22T00:33:48.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/167: getdents d2/d8/db/d25 0 2024-02-22T00:33:48.890 INFO:tasks.workunit.client.0.smithi049.stdout:5/154: read d0/f1d [14894,31324] 0 2024-02-22T00:33:48.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/217: creat d3/d36/f4e x:0 0 0 2024-02-22T00:33:48.891 INFO:tasks.workunit.client.0.smithi049.stdout:4/284: write d3/d8/d20/f3c [751089,114036] 0 2024-02-22T00:33:48.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/155: write d0/de/fc [3752360,97744] 0 2024-02-22T00:33:48.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/168: dwrite d2/f4 [0,4194304] 0 2024-02-22T00:33:48.897 INFO:tasks.workunit.client.0.smithi049.stdout:4/285: mkdir d3/d22/d49/d57 0 2024-02-22T00:33:48.898 INFO:tasks.workunit.client.0.smithi049.stdout:6/218: creat d3/d16/f4f x:0 0 0 2024-02-22T00:33:48.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/169: write d2/d8/da/f32 [107720,104770] 0 2024-02-22T00:33:48.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/170: readlink d2/d8/db/l2b 0 2024-02-22T00:33:48.903 INFO:tasks.workunit.client.0.smithi049.stdout:6/219: read - d3/f1d zero size 2024-02-22T00:33:48.904 INFO:tasks.workunit.client.0.smithi049.stdout:5/156: dwrite d0/f37 [0,4194304] 0 2024-02-22T00:33:48.905 INFO:tasks.workunit.client.0.smithi049.stdout:4/286: link d3/d8/d10/f15 d3/d22/d24/d35/f58 0 2024-02-22T00:33:48.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/171: chown d2/d8/db/c18 287 1 2024-02-22T00:33:48.907 INFO:tasks.workunit.client.0.smithi049.stdout:1/172: dread - d2/d8/f27 zero size 2024-02-22T00:33:48.908 INFO:tasks.workunit.client.0.smithi049.stdout:1/173: read - d2/d8/da/f3f zero size 2024-02-22T00:33:48.910 INFO:tasks.workunit.client.0.smithi049.stdout:6/220: creat d3/d16/d3b/d3d/f50 x:0 0 0 2024-02-22T00:33:48.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/287: dread d3/d8/d20/f3c [0,4194304] 0 2024-02-22T00:33:48.914 INFO:tasks.workunit.client.0.smithi049.stdout:5/157: creat d0/d1a/f38 x:0 0 0 2024-02-22T00:33:48.916 INFO:tasks.workunit.client.0.smithi049.stdout:6/221: dread d3/d16/f19 [0,4194304] 0 2024-02-22T00:33:48.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/158: write d0/de/d6/f12 [1207869,40833] 0 2024-02-22T00:33:48.917 INFO:tasks.workunit.client.0.smithi049.stdout:1/174: mkdir d2/d8/db/d25/d40/d41 0 2024-02-22T00:33:48.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/159: write d0/f37 [1755490,65818] 0 2024-02-22T00:33:48.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/160: write d0/d1a/f38 [247983,111097] 0 2024-02-22T00:33:48.924 INFO:tasks.workunit.client.0.smithi049.stdout:5/161: write d0/d1a/f36 [737780,6211] 0 2024-02-22T00:33:48.929 INFO:tasks.workunit.client.0.smithi049.stdout:5/162: rename d0/de to d0/d39 0 2024-02-22T00:33:48.931 INFO:tasks.workunit.client.0.smithi049.stdout:4/288: dread d3/d8/d10/d12/f38 [0,4194304] 0 2024-02-22T00:33:48.935 INFO:tasks.workunit.client.0.smithi049.stdout:5/163: creat d0/d1a/d24/f3a x:0 0 0 2024-02-22T00:33:48.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/164: stat d0/d39/c19 0 2024-02-22T00:33:48.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/222: dread d3/f18 [0,4194304] 0 2024-02-22T00:33:48.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/165: write d0/d1a/d24/f2f [521781,112162] 0 2024-02-22T00:33:48.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/166: mkdir d0/d1a/d24/d3b 0 2024-02-22T00:33:48.942 INFO:tasks.workunit.client.0.smithi049.stdout:5/167: creat d0/d26/f3c x:0 0 0 2024-02-22T00:33:48.944 INFO:tasks.workunit.client.0.smithi049.stdout:6/223: dwrite d3/d16/d32/f42 [0,4194304] 0 2024-02-22T00:33:48.946 INFO:tasks.workunit.client.0.smithi049.stdout:6/224: symlink d3/d16/d1f/l51 0 2024-02-22T00:33:48.949 INFO:tasks.workunit.client.0.smithi049.stdout:6/225: symlink d3/d16/d32/l52 0 2024-02-22T00:33:48.953 INFO:tasks.workunit.client.0.smithi049.stdout:5/168: getdents d0/d39/d6 0 2024-02-22T00:33:48.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/169: getdents d0/d1a 0 2024-02-22T00:33:48.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/226: dwrite d3/d16/f19 [0,4194304] 0 2024-02-22T00:33:48.961 INFO:tasks.workunit.client.0.smithi049.stdout:6/227: write d3/d16/f25 [154385,122960] 0 2024-02-22T00:33:48.961 INFO:tasks.workunit.client.0.smithi049.stdout:5/170: unlink d0/d39/fc 0 2024-02-22T00:33:48.967 INFO:tasks.workunit.client.0.smithi049.stdout:5/171: mknod d0/d39/c3d 0 2024-02-22T00:33:48.968 INFO:tasks.workunit.client.0.smithi049.stdout:5/172: stat d0/d26/l31 0 2024-02-22T00:33:48.971 INFO:tasks.workunit.client.0.smithi049.stdout:5/173: read d0/d39/d6/f13 [1300907,120383] 0 2024-02-22T00:33:48.971 INFO:tasks.workunit.client.0.smithi049.stdout:6/228: dwrite d3/d16/f4f [0,4194304] 0 2024-02-22T00:33:48.973 INFO:tasks.workunit.client.0.smithi049.stdout:8/174: sync 2024-02-22T00:33:48.973 INFO:tasks.workunit.client.0.smithi049.stdout:3/75: sync 2024-02-22T00:33:48.973 INFO:tasks.workunit.client.0.smithi049.stdout:9/214: sync 2024-02-22T00:33:48.976 INFO:tasks.workunit.client.0.smithi049.stdout:9/215: fdatasync d17/d21/d3c/f40 0 2024-02-22T00:33:48.978 INFO:tasks.workunit.client.0.smithi049.stdout:3/76: unlink d0/dd/f4 0 2024-02-22T00:33:48.978 INFO:tasks.workunit.client.0.smithi049.stdout:8/175: rename d1/d2/db/d1c to d1/d2/db/d1c/d43 22 2024-02-22T00:33:48.982 INFO:tasks.workunit.client.0.smithi049.stdout:8/176: write d1/d2/f25 [2392234,99636] 0 2024-02-22T00:33:48.985 INFO:tasks.workunit.client.0.smithi049.stdout:6/229: dwrite d3/d16/d1f/f35 [0,4194304] 0 2024-02-22T00:33:48.986 INFO:tasks.workunit.client.0.smithi049.stdout:3/77: creat d0/dd/f13 x:0 0 0 2024-02-22T00:33:48.987 INFO:tasks.workunit.client.0.smithi049.stdout:6/230: dread - d3/f1d zero size 2024-02-22T00:33:48.988 INFO:tasks.workunit.client.0.smithi049.stdout:9/216: getdents d17/d1c/d25 0 2024-02-22T00:33:48.992 INFO:tasks.workunit.client.0.smithi049.stdout:5/174: dwrite d0/f33 [0,4194304] 0 2024-02-22T00:33:48.997 INFO:tasks.workunit.client.0.smithi049.stdout:6/231: truncate d3/ff 4787344 0 2024-02-22T00:33:49.000 INFO:tasks.workunit.client.0.smithi049.stdout:3/78: dread d0/dd/f3 [0,4194304] 0 2024-02-22T00:33:49.002 INFO:tasks.workunit.client.0.smithi049.stdout:5/175: dread d0/f33 [0,4194304] 0 2024-02-22T00:33:49.002 INFO:tasks.workunit.client.0.smithi049.stdout:3/79: write d0/dd/ff [1464386,121100] 0 2024-02-22T00:33:49.007 INFO:tasks.workunit.client.0.smithi049.stdout:5/176: write d0/d39/d6/f1e [484004,86880] 0 2024-02-22T00:33:49.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/232: link d3/f38 d3/d16/f53 0 2024-02-22T00:33:49.008 INFO:tasks.workunit.client.0.smithi049.stdout:6/233: chown d3/d16/d4a/d4d 36 1 2024-02-22T00:33:49.009 INFO:tasks.workunit.client.0.smithi049.stdout:3/80: mkdir d0/d14 0 2024-02-22T00:33:49.010 INFO:tasks.workunit.client.0.smithi049.stdout:5/177: symlink d0/d1a/d24/l3e 0 2024-02-22T00:33:49.014 INFO:tasks.workunit.client.0.smithi049.stdout:5/178: write d0/d39/d6/f1f [5159517,125916] 0 2024-02-22T00:33:49.015 INFO:tasks.workunit.client.0.smithi049.stdout:8/177: dread d1/f12 [0,4194304] 0 2024-02-22T00:33:49.017 INFO:tasks.workunit.client.0.smithi049.stdout:6/234: write d3/f10 [2516131,26399] 0 2024-02-22T00:33:49.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/179: write d0/d26/f3c [291297,8156] 0 2024-02-22T00:33:49.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/217: dread d17/f1a [0,4194304] 0 2024-02-22T00:33:49.023 INFO:tasks.workunit.client.0.smithi049.stdout:3/81: dwrite d0/dd/f13 [0,4194304] 0 2024-02-22T00:33:49.024 INFO:tasks.workunit.client.0.smithi049.stdout:5/180: creat d0/d1a/d24/f3f x:0 0 0 2024-02-22T00:33:49.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/82: chown d0/fc 10184923 1 2024-02-22T00:33:49.028 INFO:tasks.workunit.client.0.smithi049.stdout:5/181: readlink d0/d20/l2a 0 2024-02-22T00:33:49.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/182: symlink d0/d20/l40 0 2024-02-22T00:33:49.034 INFO:tasks.workunit.client.0.smithi049.stdout:3/83: symlink d0/l15 0 2024-02-22T00:33:49.035 INFO:tasks.workunit.client.0.smithi049.stdout:8/178: dwrite d1/d2/db/f19 [0,4194304] 0 2024-02-22T00:33:49.036 INFO:tasks.workunit.client.0.smithi049.stdout:6/235: dwrite d3/f18 [0,4194304] 0 2024-02-22T00:33:49.037 INFO:tasks.workunit.client.0.smithi049.stdout:5/183: fsync d0/d39/d6/fd 0 2024-02-22T00:33:49.040 INFO:tasks.workunit.client.0.smithi049.stdout:3/84: write d0/dd/f13 [4445594,79034] 0 2024-02-22T00:33:49.041 INFO:tasks.workunit.client.0.smithi049.stdout:9/218: dwrite d17/d21/f33 [0,4194304] 0 2024-02-22T00:33:49.042 INFO:tasks.workunit.client.0.smithi049.stdout:9/219: chown d17/d21/d3c/c3e 1084 1 2024-02-22T00:33:49.044 INFO:tasks.workunit.client.0.smithi049.stdout:8/179: mknod d1/d2/db/d1c/d3b/c44 0 2024-02-22T00:33:49.044 INFO:tasks.workunit.client.0.smithi049.stdout:9/220: truncate d17/d1c/f3b 1254128 0 2024-02-22T00:33:49.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/85: creat d0/f16 x:0 0 0 2024-02-22T00:33:49.052 INFO:tasks.workunit.client.0.smithi049.stdout:5/184: getdents d0/d20 0 2024-02-22T00:33:49.052 INFO:tasks.workunit.client.0.smithi049.stdout:3/86: dread - d0/f16 zero size 2024-02-22T00:33:49.054 INFO:tasks.workunit.client.0.smithi049.stdout:8/180: rename d1/d2/db/d15/d33/f37 to d1/d2/db/d15/d33/f45 0 2024-02-22T00:33:49.054 INFO:tasks.workunit.client.0.smithi049.stdout:6/236: getdents d3/d37 0 2024-02-22T00:33:49.055 INFO:tasks.workunit.client.0.smithi049.stdout:9/221: creat d17/f51 x:0 0 0 2024-02-22T00:33:49.055 INFO:tasks.workunit.client.0.smithi049.stdout:5/185: truncate d0/d1a/d24/f3a 880847 0 2024-02-22T00:33:49.057 INFO:tasks.workunit.client.0.smithi049.stdout:9/222: readlink d17/d21/d3c/l42 0 2024-02-22T00:33:49.058 INFO:tasks.workunit.client.0.smithi049.stdout:6/237: symlink d3/d16/d3b/l54 0 2024-02-22T00:33:49.061 INFO:tasks.workunit.client.0.smithi049.stdout:8/181: getdents d1/d2/db/d1c 0 2024-02-22T00:33:49.062 INFO:tasks.workunit.client.0.smithi049.stdout:6/238: write d3/d16/d32/f42 [3666171,62287] 0 2024-02-22T00:33:49.062 INFO:tasks.workunit.client.0.smithi049.stdout:3/87: dread d0/dd/ff [0,4194304] 0 2024-02-22T00:33:49.063 INFO:tasks.workunit.client.0.smithi049.stdout:5/186: link d0/d1a/d24/f3f d0/d39/f41 0 2024-02-22T00:33:49.065 INFO:tasks.workunit.client.0.smithi049.stdout:8/182: read d1/d2/db/f19 [131960,31162] 0 2024-02-22T00:33:49.069 INFO:tasks.workunit.client.0.smithi049.stdout:6/239: creat d3/d16/d4a/f55 x:0 0 0 2024-02-22T00:33:49.070 INFO:tasks.workunit.client.0.smithi049.stdout:9/223: dwrite d17/d1c/f2b [0,4194304] 0 2024-02-22T00:33:49.070 INFO:tasks.workunit.client.0.smithi049.stdout:9/224: dread - d17/f51 zero size 2024-02-22T00:33:49.073 INFO:tasks.workunit.client.0.smithi049.stdout:6/240: creat d3/d16/d45/f56 x:0 0 0 2024-02-22T00:33:49.074 INFO:tasks.workunit.client.0.smithi049.stdout:9/225: creat d17/d1c/d38/f52 x:0 0 0 2024-02-22T00:33:49.075 INFO:tasks.workunit.client.0.smithi049.stdout:9/226: readlink d17/d1c/l2a 0 2024-02-22T00:33:49.076 INFO:tasks.workunit.client.0.smithi049.stdout:6/241: mkdir d3/d36/d57 0 2024-02-22T00:33:49.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/242: symlink d3/d36/l58 0 2024-02-22T00:33:49.084 INFO:tasks.workunit.client.0.smithi049.stdout:5/187: write d0/f1d [1213570,77032] 0 2024-02-22T00:33:49.084 INFO:tasks.workunit.client.0.smithi049.stdout:6/243: write d3/f11 [1961016,91660] 0 2024-02-22T00:33:49.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/88: truncate d0/f11 436837 0 2024-02-22T00:33:49.085 INFO:tasks.workunit.client.0.smithi049.stdout:9/227: dwrite d17/d21/f23 [0,4194304] 0 2024-02-22T00:33:49.085 INFO:tasks.workunit.client.0.smithi049.stdout:5/188: write d0/d1a/d24/f2f [995423,70890] 0 2024-02-22T00:33:49.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/244: mkdir d3/d16/d1f/d59 0 2024-02-22T00:33:49.089 INFO:tasks.workunit.client.0.smithi049.stdout:5/189: write d0/d39/d6/fd [450728,74419] 0 2024-02-22T00:33:49.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/245: fdatasync d3/f11 0 2024-02-22T00:33:49.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/190: write d0/f37 [5191609,117405] 0 2024-02-22T00:33:49.096 INFO:tasks.workunit.client.0.smithi049.stdout:3/89: link d0/dd/f9 d0/d14/f17 0 2024-02-22T00:33:49.100 INFO:tasks.workunit.client.0.smithi049.stdout:3/90: creat d0/dd/f18 x:0 0 0 2024-02-22T00:33:49.100 INFO:tasks.workunit.client.0.smithi049.stdout:8/183: dread d1/d2/f27 [0,4194304] 0 2024-02-22T00:33:49.100 INFO:tasks.workunit.client.0.smithi049.stdout:9/228: link d17/d1c/f1e d17/d1c/d25/f53 0 2024-02-22T00:33:49.106 INFO:tasks.workunit.client.0.smithi049.stdout:9/229: dread d17/d21/f23 [0,4194304] 0 2024-02-22T00:33:49.106 INFO:tasks.workunit.client.0.smithi049.stdout:3/91: dread d0/dd/f3 [0,4194304] 0 2024-02-22T00:33:49.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/92: dread d0/d14/f17 [0,4194304] 0 2024-02-22T00:33:49.110 INFO:tasks.workunit.client.0.smithi049.stdout:9/230: rename d17/d21/d4e/c2d to d17/d21/d4e/c54 0 2024-02-22T00:33:49.112 INFO:tasks.workunit.client.0.smithi049.stdout:5/191: truncate d0/d1a/f38 70691 0 2024-02-22T00:33:49.112 INFO:tasks.workunit.client.0.smithi049.stdout:3/93: symlink d0/dd/l19 0 2024-02-22T00:33:49.112 INFO:tasks.workunit.client.0.smithi049.stdout:5/192: dread - d0/d39/f41 zero size 2024-02-22T00:33:49.112 INFO:tasks.workunit.client.0.smithi049.stdout:3/94: readlink d0/l12 0 2024-02-22T00:33:49.113 INFO:tasks.workunit.client.0.smithi049.stdout:9/231: mknod d17/d1c/d25/d39/c55 0 2024-02-22T00:33:49.114 INFO:tasks.workunit.client.0.smithi049.stdout:3/95: dread d0/dd/f9 [0,4194304] 0 2024-02-22T00:33:49.114 INFO:tasks.workunit.client.0.smithi049.stdout:9/232: read - d17/d21/d3c/f4a zero size 2024-02-22T00:33:49.115 INFO:tasks.workunit.client.0.smithi049.stdout:8/184: truncate d1/d2/db/d15/f10 1091625 0 2024-02-22T00:33:49.121 INFO:tasks.workunit.client.0.smithi049.stdout:8/185: symlink d1/d2/db/l46 0 2024-02-22T00:33:49.123 INFO:tasks.workunit.client.0.smithi049.stdout:9/233: dwrite d17/d21/f4f [0,4194304] 0 2024-02-22T00:33:49.126 INFO:tasks.workunit.client.0.smithi049.stdout:9/234: chown d17/f18 877194 1 2024-02-22T00:33:49.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/186: truncate d1/d2/d5/d1b/d39/f40 442118 0 2024-02-22T00:33:49.129 INFO:tasks.workunit.client.0.smithi049.stdout:5/193: dread d0/d39/d6/f1f [0,4194304] 0 2024-02-22T00:33:49.130 INFO:tasks.workunit.client.0.smithi049.stdout:9/235: truncate d17/d21/d3c/f3f 1026519 0 2024-02-22T00:33:49.133 INFO:tasks.workunit.client.0.smithi049.stdout:5/194: unlink d0/c14 0 2024-02-22T00:33:49.136 INFO:tasks.workunit.client.0.smithi049.stdout:8/187: write d1/d2/db/d15/f23 [84490,120813] 0 2024-02-22T00:33:49.139 INFO:tasks.workunit.client.0.smithi049.stdout:5/195: truncate d0/d39/d6/f12 4998846 0 2024-02-22T00:33:49.142 INFO:tasks.workunit.client.0.smithi049.stdout:8/188: creat d1/d2/db/d1c/d3b/f47 x:0 0 0 2024-02-22T00:33:49.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/96: dwrite d0/f11 [0,4194304] 0 2024-02-22T00:33:49.143 INFO:tasks.workunit.client.0.smithi049.stdout:5/196: creat d0/d26/f42 x:0 0 0 2024-02-22T00:33:49.147 INFO:tasks.workunit.client.0.smithi049.stdout:3/97: rmdir d0/d14 39 2024-02-22T00:33:49.147 INFO:tasks.workunit.client.0.smithi049.stdout:9/236: dwrite d17/d21/f46 [0,4194304] 0 2024-02-22T00:33:49.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/189: creat d1/d2/db/d15/d33/f48 x:0 0 0 2024-02-22T00:33:49.148 INFO:tasks.workunit.client.0.smithi049.stdout:3/98: rename d0 to d0/d1a 22 2024-02-22T00:33:49.151 INFO:tasks.workunit.client.0.smithi049.stdout:9/237: creat d17/d1c/d38/f56 x:0 0 0 2024-02-22T00:33:49.152 INFO:tasks.workunit.client.0.smithi049.stdout:9/238: chown d17/d21/d3c/c3e 1285470923 1 2024-02-22T00:33:49.152 INFO:tasks.workunit.client.0.smithi049.stdout:8/190: symlink d1/d2/db/d15/l49 0 2024-02-22T00:33:49.155 INFO:tasks.workunit.client.0.smithi049.stdout:3/99: dread d0/f11 [0,4194304] 0 2024-02-22T00:33:49.158 INFO:tasks.workunit.client.0.smithi049.stdout:9/239: read d17/f20 [262433,78498] 0 2024-02-22T00:33:49.159 INFO:tasks.workunit.client.0.smithi049.stdout:3/100: creat d0/d14/f1b x:0 0 0 2024-02-22T00:33:49.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/240: readlink d17/d21/d3c/l42 0 2024-02-22T00:33:49.159 INFO:tasks.workunit.client.0.smithi049.stdout:3/101: readlink d0/l15 0 2024-02-22T00:33:49.161 INFO:tasks.workunit.client.0.smithi049.stdout:3/102: mknod d0/dd/c1c 0 2024-02-22T00:33:49.163 INFO:tasks.workunit.client.0.smithi049.stdout:9/241: dread d17/f1a [0,4194304] 0 2024-02-22T00:33:49.163 INFO:tasks.workunit.client.0.smithi049.stdout:8/191: write d1/d2/f31 [165454,83509] 0 2024-02-22T00:33:49.173 INFO:tasks.workunit.client.0.smithi049.stdout:8/192: fdatasync d1/d2/db/f19 0 2024-02-22T00:33:49.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/103: dwrite d0/dd/ff [0,4194304] 0 2024-02-22T00:33:49.181 INFO:tasks.workunit.client.0.smithi049.stdout:3/104: creat d0/d14/f1d x:0 0 0 2024-02-22T00:33:49.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/242: dwrite d17/d1c/d25/d39/f3a [0,4194304] 0 2024-02-22T00:33:49.183 INFO:tasks.workunit.client.0.smithi049.stdout:3/105: read d0/fc [286946,120642] 0 2024-02-22T00:33:49.183 INFO:tasks.workunit.client.0.smithi049.stdout:5/197: dread d0/d39/d6/fd [0,4194304] 0 2024-02-22T00:33:49.184 INFO:tasks.workunit.client.0.smithi049.stdout:8/193: link d1/d2/d5/d1b/f32 d1/d2/db/d15/d33/f4a 0 2024-02-22T00:33:49.185 INFO:tasks.workunit.client.0.smithi049.stdout:3/106: chown d0/d14 836 1 2024-02-22T00:33:49.186 INFO:tasks.workunit.client.0.smithi049.stdout:2/286: sync 2024-02-22T00:33:49.186 INFO:tasks.workunit.client.0.smithi049.stdout:0/232: sync 2024-02-22T00:33:49.187 INFO:tasks.workunit.client.0.smithi049.stdout:5/198: symlink d0/d1a/l43 0 2024-02-22T00:33:49.187 INFO:tasks.workunit.client.0.smithi049.stdout:8/194: read - d1/d2/d5/d1b/f32 zero size 2024-02-22T00:33:49.188 INFO:tasks.workunit.client.0.smithi049.stdout:7/254: sync 2024-02-22T00:33:49.189 INFO:tasks.workunit.client.0.smithi049.stdout:3/107: mkdir d0/dd/d1e 0 2024-02-22T00:33:49.190 INFO:tasks.workunit.client.0.smithi049.stdout:9/243: dread d17/d21/d3c/f3f [0,4194304] 0 2024-02-22T00:33:49.192 INFO:tasks.workunit.client.0.smithi049.stdout:2/287: dread d2/d9/de/d15/d1b/f20 [0,4194304] 0 2024-02-22T00:33:49.192 INFO:tasks.workunit.client.0.smithi049.stdout:8/195: mkdir d1/d2/db/d15/d30/d4b 0 2024-02-22T00:33:49.265 INFO:tasks.workunit.client.0.smithi049.stdout:5/199: symlink d0/d39/l44 0 2024-02-22T00:33:49.265 INFO:tasks.workunit.client.0.smithi049.stdout:9/244: symlink d17/d1c/d25/d39/l57 0 2024-02-22T00:33:49.266 INFO:tasks.workunit.client.0.smithi049.stdout:2/288: chown d2/d9/de/d10/d46/f68 2481 1 2024-02-22T00:33:49.267 INFO:tasks.workunit.client.0.smithi049.stdout:8/196: mkdir d1/d4c 0 2024-02-22T00:33:49.267 INFO:tasks.workunit.client.0.smithi049.stdout:9/245: truncate d17/d1c/f3b 2096869 0 2024-02-22T00:33:49.271 INFO:tasks.workunit.client.0.smithi049.stdout:7/255: creat d1/df/d12/f59 x:0 0 0 2024-02-22T00:33:49.273 INFO:tasks.workunit.client.0.smithi049.stdout:9/246: write d17/f1a [4571483,97046] 0 2024-02-22T00:33:49.275 INFO:tasks.workunit.client.0.smithi049.stdout:2/289: symlink d2/d9/de/d15/d4f/l6b 0 2024-02-22T00:33:49.276 INFO:tasks.workunit.client.0.smithi049.stdout:7/256: mkdir d1/d49/d5a 0 2024-02-22T00:33:49.277 INFO:tasks.workunit.client.0.smithi049.stdout:5/200: symlink d0/d1a/d24/l45 0 2024-02-22T00:33:49.278 INFO:tasks.workunit.client.0.smithi049.stdout:0/233: dread d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:49.278 INFO:tasks.workunit.client.0.smithi049.stdout:9/247: write d17/d1c/d38/f52 [253523,106296] 0 2024-02-22T00:33:49.284 INFO:tasks.workunit.client.0.smithi049.stdout:7/257: chown d1/df/d12/d1c/d1d/f46 175984 1 2024-02-22T00:33:49.284 INFO:tasks.workunit.client.0.smithi049.stdout:0/234: unlink d3/c34 0 2024-02-22T00:33:49.288 INFO:tasks.workunit.client.0.smithi049.stdout:9/248: mknod d17/d1c/d25/d39/c58 0 2024-02-22T00:33:49.288 INFO:tasks.workunit.client.0.smithi049.stdout:0/235: read d3/df/f11 [925974,102495] 0 2024-02-22T00:33:49.289 INFO:tasks.workunit.client.0.smithi049.stdout:8/197: dwrite d1/d2/f27 [0,4194304] 0 2024-02-22T00:33:49.291 INFO:tasks.workunit.client.0.smithi049.stdout:3/108: dwrite d0/d14/f17 [0,4194304] 0 2024-02-22T00:33:49.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/201: write d0/d1a/f38 [295667,92274] 0 2024-02-22T00:33:49.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:47.763423+0000 mgr.smithi161.sazlam (mgr.24369) 56 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 612 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 40 MiB/s wr, 224 op/s 2024-02-22T00:33:49.294 INFO:tasks.workunit.client.0.smithi049.stdout:2/290: getdents d2/d9/de/d10/d46/d5d 0 2024-02-22T00:33:49.298 INFO:tasks.workunit.client.0.smithi049.stdout:3/109: write d0/f11 [4178291,98541] 0 2024-02-22T00:33:49.302 INFO:tasks.workunit.client.0.smithi049.stdout:3/110: write d0/f11 [2615791,122479] 0 2024-02-22T00:33:49.302 INFO:tasks.workunit.client.0.smithi049.stdout:5/202: rename d0/d1a to d0/d26/d46 0 2024-02-22T00:33:49.304 INFO:tasks.workunit.client.0.smithi049.stdout:7/258: dwrite d1/df/d12/d1c/d24/f52 [0,4194304] 0 2024-02-22T00:33:49.306 INFO:tasks.workunit.client.0.smithi049.stdout:3/111: write d0/dd/f18 [84038,63168] 0 2024-02-22T00:33:49.307 INFO:tasks.workunit.client.0.smithi049.stdout:9/249: write d17/d21/f50 [1102483,51393] 0 2024-02-22T00:33:49.310 INFO:tasks.workunit.client.0.smithi049.stdout:7/259: rmdir d1/d49 39 2024-02-22T00:33:49.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/198: dwrite d1/d2/f25 [0,4194304] 0 2024-02-22T00:33:49.315 INFO:tasks.workunit.client.0.smithi049.stdout:2/291: rmdir d2/d9/de/d15/d51 0 2024-02-22T00:33:49.317 INFO:tasks.workunit.client.0.smithi049.stdout:3/112: symlink d0/d14/l1f 0 2024-02-22T00:33:49.320 INFO:tasks.workunit.client.0.smithi049.stdout:7/260: readlink d1/d41/d28/l43 0 2024-02-22T00:33:49.323 INFO:tasks.workunit.client.0.smithi049.stdout:8/199: rmdir d1/d2/d5 39 2024-02-22T00:33:49.324 INFO:tasks.workunit.client.0.smithi049.stdout:2/292: chown d2/d9/de/d15/l1a 359448 1 2024-02-22T00:33:49.326 INFO:tasks.workunit.client.0.smithi049.stdout:5/203: dwrite d0/d26/d46/f38 [0,4194304] 0 2024-02-22T00:33:49.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/200: readlink d1/d2/db/d15/l11 0 2024-02-22T00:33:49.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/250: dwrite f11 [0,4194304] 0 2024-02-22T00:33:49.334 INFO:tasks.workunit.client.0.smithi049.stdout:9/251: chown d17/d21 1 1 2024-02-22T00:33:49.335 INFO:tasks.workunit.client.0.smithi049.stdout:5/204: rmdir d0/d26/d46/d24 39 2024-02-22T00:33:49.337 INFO:tasks.workunit.client.0.smithi049.stdout:2/293: creat d2/d9/de/d10/d46/d63/f6c x:0 0 0 2024-02-22T00:33:49.338 INFO:tasks.workunit.client.0.smithi049.stdout:9/252: creat d17/d21/d3c/f59 x:0 0 0 2024-02-22T00:33:49.340 INFO:tasks.workunit.client.0.smithi049.stdout:3/113: dwrite d0/d14/f1d [0,4194304] 0 2024-02-22T00:33:49.344 INFO:tasks.workunit.client.0.smithi049.stdout:9/253: chown d17/d1c/d25/f53 1104870 1 2024-02-22T00:33:49.348 INFO:tasks.workunit.client.0.smithi049.stdout:5/205: symlink d0/d26/l47 0 2024-02-22T00:33:49.349 INFO:tasks.workunit.client.0.smithi049.stdout:2/294: mkdir d2/d9/de/d3a/d6d 0 2024-02-22T00:33:49.351 INFO:tasks.workunit.client.0.smithi049.stdout:8/201: dwrite d1/d2/db/f28 [4194304,4194304] 0 2024-02-22T00:33:49.352 INFO:tasks.workunit.client.0.smithi049.stdout:7/261: link d1/df/d12/d1c/d24/c51 d1/df/d12/d48/c5b 0 2024-02-22T00:33:49.353 INFO:tasks.workunit.client.0.smithi049.stdout:0/236: dread d3/df/d17/d1b/f28 [0,4194304] 0 2024-02-22T00:33:49.353 INFO:tasks.workunit.client.0.smithi049.stdout:3/114: dread d0/dd/f13 [0,4194304] 0 2024-02-22T00:33:49.353 INFO:tasks.workunit.client.0.smithi049.stdout:9/254: rename d17/f27 to d17/d21/d4e/d4b/f5a 0 2024-02-22T00:33:49.355 INFO:tasks.workunit.client.0.smithi049.stdout:3/115: fsync d0/dd/f18 0 2024-02-22T00:33:49.358 INFO:tasks.workunit.client.0.smithi049.stdout:2/295: rename d2/f52 to d2/d9/f6e 0 2024-02-22T00:33:49.359 INFO:tasks.workunit.client.0.smithi049.stdout:9/255: stat d17/d21/d4e/c41 0 2024-02-22T00:33:49.359 INFO:tasks.workunit.client.0.smithi049.stdout:0/237: read d3/df/d17/f2f [89659,40054] 0 2024-02-22T00:33:49.360 INFO:tasks.workunit.client.0.smithi049.stdout:0/238: stat d3/c15 0 2024-02-22T00:33:49.362 INFO:tasks.workunit.client.0.smithi049.stdout:7/262: symlink d1/d49/l5c 0 2024-02-22T00:33:49.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/256: dwrite d17/f1a [4194304,4194304] 0 2024-02-22T00:33:49.368 INFO:tasks.workunit.client.0.smithi049.stdout:7/263: write d1/fe [4174433,25307] 0 2024-02-22T00:33:49.369 INFO:tasks.workunit.client.0.smithi049.stdout:3/116: rename d0/dd/ce to d0/d14/c20 0 2024-02-22T00:33:49.370 INFO:tasks.workunit.client.0.smithi049.stdout:3/117: stat d0/d14 0 2024-02-22T00:33:49.373 INFO:tasks.workunit.client.0.smithi049.stdout:9/257: write d17/d21/d3c/f3d [365614,26996] 0 2024-02-22T00:33:49.373 INFO:tasks.workunit.client.0.smithi049.stdout:3/118: write d0/f16 [999941,75476] 0 2024-02-22T00:33:49.377 INFO:tasks.workunit.client.0.smithi049.stdout:2/296: dwrite d2/d9/de/d10/d46/f67 [0,4194304] 0 2024-02-22T00:33:49.381 INFO:tasks.workunit.client.0.smithi049.stdout:0/239: write d3/df/f11 [3805544,4718] 0 2024-02-22T00:33:49.385 INFO:tasks.workunit.client.0.smithi049.stdout:2/297: creat d2/d9/f6f x:0 0 0 2024-02-22T00:33:49.388 INFO:tasks.workunit.client.0.smithi049.stdout:0/240: read d3/f13 [593123,120911] 0 2024-02-22T00:33:49.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/206: dwrite d0/d39/d6/f13 [0,4194304] 0 2024-02-22T00:33:49.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/241: chown d3 24366 1 2024-02-22T00:33:49.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/298: dread - d2/d9/de/d10/d46/d63/f6c zero size 2024-02-22T00:33:49.396 INFO:tasks.workunit.client.0.smithi049.stdout:9/258: dwrite d17/d21/f50 [0,4194304] 0 2024-02-22T00:33:49.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/119: dwrite d0/f11 [4194304,4194304] 0 2024-02-22T00:33:49.398 INFO:tasks.workunit.client.0.smithi049.stdout:8/202: dwrite d1/d2/d5/d1b/f32 [0,4194304] 0 2024-02-22T00:33:49.400 INFO:tasks.workunit.client.0.smithi049.stdout:2/299: write d2/d9/de/f57 [659831,60415] 0 2024-02-22T00:33:49.400 INFO:tasks.workunit.client.0.smithi049.stdout:9/259: write d17/d1c/f2c [209359,47410] 0 2024-02-22T00:33:49.405 INFO:tasks.workunit.client.0.smithi049.stdout:1/175: sync 2024-02-22T00:33:49.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/260: creat d17/d1c/d25/d39/f5b x:0 0 0 2024-02-22T00:33:49.411 INFO:tasks.workunit.client.0.smithi049.stdout:2/300: read d2/d9/de/f2b [2001454,37553] 0 2024-02-22T00:33:49.412 INFO:tasks.workunit.client.0.smithi049.stdout:1/176: fdatasync d2/d8/db/d25/f2c 0 2024-02-22T00:33:49.412 INFO:tasks.workunit.client.0.smithi049.stdout:9/261: readlink d17/d1c/l2e 0 2024-02-22T00:33:49.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/207: creat d0/f48 x:0 0 0 2024-02-22T00:33:49.415 INFO:tasks.workunit.client.0.smithi049.stdout:0/242: getdents d3 0 2024-02-22T00:33:49.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/262: write d17/d1c/f2b [3294757,96127] 0 2024-02-22T00:33:49.419 INFO:tasks.workunit.client.0.smithi049.stdout:1/177: mknod d2/d8/c42 0 2024-02-22T00:33:49.420 INFO:tasks.workunit.client.0.smithi049.stdout:8/203: dwrite d1/d2/db/f19 [4194304,4194304] 0 2024-02-22T00:33:49.420 INFO:tasks.workunit.client.0.smithi049.stdout:0/243: symlink d3/d6/d29/l3c 0 2024-02-22T00:33:49.423 INFO:tasks.workunit.client.0.smithi049.stdout:5/208: creat d0/d26/d46/d24/d3b/f49 x:0 0 0 2024-02-22T00:33:49.425 INFO:tasks.workunit.client.0.smithi049.stdout:0/244: symlink d3/d6/d8/l3d 0 2024-02-22T00:33:49.426 INFO:tasks.workunit.client.0.smithi049.stdout:1/178: symlink d2/d8/db/l43 0 2024-02-22T00:33:49.428 INFO:tasks.workunit.client.0.smithi049.stdout:5/209: mknod d0/d39/d6/c4a 0 2024-02-22T00:33:49.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:47.763423+0000 mgr.smithi161.sazlam (mgr.24369) 56 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 612 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 40 MiB/s wr, 224 op/s 2024-02-22T00:33:49.429 INFO:tasks.workunit.client.0.smithi049.stdout:0/245: fdatasync d3/d6/f26 0 2024-02-22T00:33:49.430 INFO:tasks.workunit.client.0.smithi049.stdout:8/204: dread d1/d2/db/d15/f10 [0,4194304] 0 2024-02-22T00:33:49.432 INFO:tasks.workunit.client.0.smithi049.stdout:1/179: symlink d2/d8/db/l44 0 2024-02-22T00:33:49.434 INFO:tasks.workunit.client.0.smithi049.stdout:9/263: dwrite d17/d1c/d25/d39/f3a [0,4194304] 0 2024-02-22T00:33:49.435 INFO:tasks.workunit.client.0.smithi049.stdout:8/205: chown d1/d2/d5/d1b/f32 8300 1 2024-02-22T00:33:49.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/206: stat d1/d2/db/d15/d33/c41 0 2024-02-22T00:33:49.439 INFO:tasks.workunit.client.0.smithi049.stdout:1/180: stat d2/d8/db/f1a 0 2024-02-22T00:33:49.441 INFO:tasks.workunit.client.0.smithi049.stdout:8/207: chown d1/d2/f25 15222696 1 2024-02-22T00:33:49.441 INFO:tasks.workunit.client.0.smithi049.stdout:5/210: dread d0/d26/d46/d24/f2f [0,4194304] 0 2024-02-22T00:33:49.441 INFO:tasks.workunit.client.0.smithi049.stdout:9/264: unlink d17/d1c/l2a 0 2024-02-22T00:33:49.442 INFO:tasks.workunit.client.0.smithi049.stdout:0/246: write d3/df/d17/f2f [202267,102276] 0 2024-02-22T00:33:49.444 INFO:tasks.workunit.client.0.smithi049.stdout:1/181: write d2/d8/db/d25/f2c [477619,58743] 0 2024-02-22T00:33:49.445 INFO:tasks.workunit.client.0.smithi049.stdout:8/208: dread - d1/d2/db/d15/d33/f45 zero size 2024-02-22T00:33:49.446 INFO:tasks.workunit.client.0.smithi049.stdout:0/247: fsync d3/df/d17/f24 0 2024-02-22T00:33:49.448 INFO:tasks.workunit.client.0.smithi049.stdout:8/209: write d1/f42 [168950,45050] 0 2024-02-22T00:33:49.448 INFO:tasks.workunit.client.0.smithi049.stdout:9/265: getdents d17/d1c/d38 0 2024-02-22T00:33:49.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/182: symlink d2/d8/db/d25/d40/l45 0 2024-02-22T00:33:49.450 INFO:tasks.workunit.client.0.smithi049.stdout:5/211: dread d0/d26/d46/f36 [0,4194304] 0 2024-02-22T00:33:49.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/266: dread f10 [0,4194304] 0 2024-02-22T00:33:49.455 INFO:tasks.workunit.client.0.smithi049.stdout:5/212: symlink d0/d26/l4b 0 2024-02-22T00:33:49.455 INFO:tasks.workunit.client.0.smithi049.stdout:0/248: link d3/d6/d29/l38 d3/d6/d29/l3e 0 2024-02-22T00:33:49.458 INFO:tasks.workunit.client.0.smithi049.stdout:5/213: fdatasync d0/f33 0 2024-02-22T00:33:49.459 INFO:tasks.workunit.client.0.smithi049.stdout:8/210: dwrite d1/d2/db/f28 [0,4194304] 0 2024-02-22T00:33:49.460 INFO:tasks.workunit.client.0.smithi049.stdout:8/211: chown d1/f1e 1253817 1 2024-02-22T00:33:49.463 INFO:tasks.workunit.client.0.smithi049.stdout:9/267: creat d17/d21/f5c x:0 0 0 2024-02-22T00:33:49.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/212: rename d1/d2/db/l46 to d1/d2/l4d 0 2024-02-22T00:33:49.475 INFO:tasks.workunit.client.0.smithi049.stdout:5/214: dwrite d0/f32 [0,4194304] 0 2024-02-22T00:33:49.476 INFO:tasks.workunit.client.0.smithi049.stdout:1/183: dwrite d2/d8/db/f2d [0,4194304] 0 2024-02-22T00:33:49.481 INFO:tasks.workunit.client.0.smithi049.stdout:8/213: creat d1/d2/db/d1c/f4e x:0 0 0 2024-02-22T00:33:49.485 INFO:tasks.workunit.client.0.smithi049.stdout:0/249: dwrite d3/df/f2b [0,4194304] 0 2024-02-22T00:33:49.487 INFO:tasks.workunit.client.0.smithi049.stdout:5/215: truncate d0/d26/d46/f36 1061872 0 2024-02-22T00:33:49.488 INFO:tasks.workunit.client.0.smithi049.stdout:5/216: read d0/d39/fb [598636,30672] 0 2024-02-22T00:33:49.489 INFO:tasks.workunit.client.0.smithi049.stdout:1/184: symlink d2/d8/db/l46 0 2024-02-22T00:33:49.491 INFO:tasks.workunit.client.0.smithi049.stdout:1/185: dread - d2/f35 zero size 2024-02-22T00:33:49.494 INFO:tasks.workunit.client.0.smithi049.stdout:5/217: write d0/d26/f3c [1313577,120587] 0 2024-02-22T00:33:49.495 INFO:tasks.workunit.client.0.smithi049.stdout:0/250: truncate d3/f13 1148851 0 2024-02-22T00:33:49.495 INFO:tasks.workunit.client.0.smithi049.stdout:9/268: dwrite d17/d21/d3c/f4a [0,4194304] 0 2024-02-22T00:33:49.497 INFO:tasks.workunit.client.0.smithi049.stdout:1/186: creat d2/f47 x:0 0 0 2024-02-22T00:33:49.499 INFO:tasks.workunit.client.0.smithi049.stdout:5/218: rmdir d0/d26/d46 39 2024-02-22T00:33:49.501 INFO:tasks.workunit.client.0.smithi049.stdout:9/269: chown d17/d1c/d25/d39/l57 1585248960 1 2024-02-22T00:33:49.501 INFO:tasks.workunit.client.0.smithi049.stdout:8/214: dwrite d1/d2/db/f21 [0,4194304] 0 2024-02-22T00:33:49.501 INFO:tasks.workunit.client.0.smithi049.stdout:5/219: fdatasync d0/d26/f42 0 2024-02-22T00:33:49.502 INFO:tasks.workunit.client.0.smithi049.stdout:1/187: creat d2/d8/db/d25/f48 x:0 0 0 2024-02-22T00:33:49.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/188: symlink d2/d8/db/d25/d40/l49 0 2024-02-22T00:33:49.508 INFO:tasks.workunit.client.0.smithi049.stdout:9/270: mkdir d17/d21/d47/d5d 0 2024-02-22T00:33:49.510 INFO:tasks.workunit.client.0.smithi049.stdout:1/189: fsync d2/d8/db/d25/f2c 0 2024-02-22T00:33:49.510 INFO:tasks.workunit.client.0.smithi049.stdout:0/251: dwrite d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:49.512 INFO:tasks.workunit.client.0.smithi049.stdout:8/215: rename d1/d2/db/d15/d33/f45 to d1/d4c/f4f 0 2024-02-22T00:33:49.512 INFO:tasks.workunit.client.0.smithi049.stdout:0/252: read d3/df/f2b [1928255,29222] 0 2024-02-22T00:33:49.515 INFO:tasks.workunit.client.0.smithi049.stdout:9/271: creat d17/d21/d47/f5e x:0 0 0 2024-02-22T00:33:49.515 INFO:tasks.workunit.client.0.smithi049.stdout:8/216: rename d1/d2/db to d1/d2/db/d15/d50 22 2024-02-22T00:33:49.519 INFO:tasks.workunit.client.0.smithi049.stdout:0/253: dread d3/df/d17/f2f [0,4194304] 0 2024-02-22T00:33:49.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/254: write d3/df/d17/f20 [2297937,25698] 0 2024-02-22T00:33:49.521 INFO:tasks.workunit.client.0.smithi049.stdout:9/272: mknod d17/d21/d47/c5f 0 2024-02-22T00:33:49.521 INFO:tasks.workunit.client.0.smithi049.stdout:8/217: rmdir d1/d2/d5 39 2024-02-22T00:33:49.522 INFO:tasks.workunit.client.0.smithi049.stdout:1/190: creat d2/d8/db/d25/d40/d41/f4a x:0 0 0 2024-02-22T00:33:49.522 INFO:tasks.workunit.client.0.smithi049.stdout:0/255: stat d3/df/d17/f37 0 2024-02-22T00:33:49.527 INFO:tasks.workunit.client.0.smithi049.stdout:9/273: creat d17/d1c/d25/f60 x:0 0 0 2024-02-22T00:33:49.528 INFO:tasks.workunit.client.0.smithi049.stdout:9/274: write f14 [2006535,12716] 0 2024-02-22T00:33:49.529 INFO:tasks.workunit.client.0.smithi049.stdout:1/191: creat d2/d8/db/d25/d40/f4b x:0 0 0 2024-02-22T00:33:49.529 INFO:tasks.workunit.client.0.smithi049.stdout:9/275: readlink l6 0 2024-02-22T00:33:49.530 INFO:tasks.workunit.client.0.smithi049.stdout:1/192: chown d2/d8/db/d25/d40/l49 5 1 2024-02-22T00:33:49.531 INFO:tasks.workunit.client.0.smithi049.stdout:0/256: rename d3/df/d17/f37 to d3/d6/d29/f3f 0 2024-02-22T00:33:49.533 INFO:tasks.workunit.client.0.smithi049.stdout:1/193: write d2/d8/db/d25/f48 [1014979,68655] 0 2024-02-22T00:33:49.536 INFO:tasks.workunit.client.0.smithi049.stdout:9/276: mknod d17/d21/d47/c61 0 2024-02-22T00:33:49.536 INFO:tasks.workunit.client.0.smithi049.stdout:1/194: stat d2/d8/c42 0 2024-02-22T00:33:49.538 INFO:tasks.workunit.client.0.smithi049.stdout:1/195: write d2/f10 [358127,41503] 0 2024-02-22T00:33:49.540 INFO:tasks.workunit.client.0.smithi049.stdout:0/257: dwrite d3/df/f11 [0,4194304] 0 2024-02-22T00:33:49.543 INFO:tasks.workunit.client.0.smithi049.stdout:0/258: write d3/d6/d8/f1a [2037926,104824] 0 2024-02-22T00:33:49.544 INFO:tasks.workunit.client.0.smithi049.stdout:0/259: write d3/df/d17/f24 [1259040,61082] 0 2024-02-22T00:33:49.545 INFO:tasks.workunit.client.0.smithi049.stdout:0/260: read d3/df/d17/f2f [204047,70332] 0 2024-02-22T00:33:49.546 INFO:tasks.workunit.client.0.smithi049.stdout:1/196: mkdir d2/d8/d4c 0 2024-02-22T00:33:49.553 INFO:tasks.workunit.client.0.smithi049.stdout:1/197: truncate d2/d8/da/f3d 778210 0 2024-02-22T00:33:49.554 INFO:tasks.workunit.client.0.smithi049.stdout:0/261: dwrite d3/df/d17/f24 [0,4194304] 0 2024-02-22T00:33:49.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/262: write d3/d6/d8/f1a [1929944,92456] 0 2024-02-22T00:33:49.558 INFO:tasks.workunit.client.0.smithi049.stdout:6/246: sync 2024-02-22T00:33:49.558 INFO:tasks.workunit.client.0.smithi049.stdout:4/289: sync 2024-02-22T00:33:49.562 INFO:tasks.workunit.client.0.smithi049.stdout:6/247: truncate d3/d16/f39 64810 0 2024-02-22T00:33:49.564 INFO:tasks.workunit.client.0.smithi049.stdout:0/263: creat d3/d6/d8/d36/f40 x:0 0 0 2024-02-22T00:33:49.565 INFO:tasks.workunit.client.0.smithi049.stdout:9/277: dwrite d17/d21/f43 [0,4194304] 0 2024-02-22T00:33:49.566 INFO:tasks.workunit.client.0.smithi049.stdout:4/290: rename d3/f42 to d3/d22/d51/f59 0 2024-02-22T00:33:49.570 INFO:tasks.workunit.client.0.smithi049.stdout:6/248: symlink d3/d16/d45/l5a 0 2024-02-22T00:33:49.571 INFO:tasks.workunit.client.0.smithi049.stdout:6/249: dread - d3/d36/f4e zero size 2024-02-22T00:33:49.572 INFO:tasks.workunit.client.0.smithi049.stdout:6/250: chown d3/d16/f3c 240 1 2024-02-22T00:33:49.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/278: dread d17/d1c/d25/f53 [0,4194304] 0 2024-02-22T00:33:49.575 INFO:tasks.workunit.client.0.smithi049.stdout:4/291: creat d3/d8/d10/d45/f5a x:0 0 0 2024-02-22T00:33:49.575 INFO:tasks.workunit.client.0.smithi049.stdout:4/292: readlink d3/l6 0 2024-02-22T00:33:49.577 INFO:tasks.workunit.client.0.smithi049.stdout:9/279: fsync d17/d21/f50 0 2024-02-22T00:33:49.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/280: fdatasync d17/d1c/d25/d39/f5b 0 2024-02-22T00:33:49.579 INFO:tasks.workunit.client.0.smithi049.stdout:6/251: rename d3/d16/d1f/l51 to d3/d16/d4a/d4d/l5b 0 2024-02-22T00:33:49.581 INFO:tasks.workunit.client.0.smithi049.stdout:6/252: write d3/d36/f4e [398394,69725] 0 2024-02-22T00:33:49.585 INFO:tasks.workunit.client.0.smithi049.stdout:4/293: rename d3/d8/d10/d39/f41 to d3/d22/d24/f5b 0 2024-02-22T00:33:49.587 INFO:tasks.workunit.client.0.smithi049.stdout:6/253: dread d3/d16/f4f [0,4194304] 0 2024-02-22T00:33:49.588 INFO:tasks.workunit.client.0.smithi049.stdout:6/254: fsync d3/d16/f19 0 2024-02-22T00:33:49.592 INFO:tasks.workunit.client.0.smithi049.stdout:6/255: rename d3/d16/d1f/c31 to d3/d16/d3b/c5c 0 2024-02-22T00:33:49.595 INFO:tasks.workunit.client.0.smithi049.stdout:6/256: dread - d3/f29 zero size 2024-02-22T00:33:49.596 INFO:tasks.workunit.client.0.smithi049.stdout:0/264: write d3/f13 [1454792,61591] 0 2024-02-22T00:33:49.597 INFO:tasks.workunit.client.0.smithi049.stdout:4/294: rename d3/d22/d24 to d3/d22/d5c 0 2024-02-22T00:33:49.599 INFO:tasks.workunit.client.0.smithi049.stdout:6/257: chown d3/cc 1508 1 2024-02-22T00:33:49.601 INFO:tasks.workunit.client.0.smithi049.stdout:6/258: write d3/d16/f39 [229122,59173] 0 2024-02-22T00:33:49.603 INFO:tasks.workunit.client.0.smithi049.stdout:1/198: dwrite d2/d8/da/f3d [0,4194304] 0 2024-02-22T00:33:49.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/295: dread d3/d8/f14 [0,4194304] 0 2024-02-22T00:33:49.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/199: mkdir d2/d8/db/d25/d40/d4d 0 2024-02-22T00:33:49.607 INFO:tasks.workunit.client.0.smithi049.stdout:4/296: stat d3/d13/f4e 0 2024-02-22T00:33:49.608 INFO:tasks.workunit.client.0.smithi049.stdout:1/200: write d2/d8/da/f39 [461222,111191] 0 2024-02-22T00:33:49.614 INFO:tasks.workunit.client.0.smithi049.stdout:4/297: rename f1 to d3/d8/d10/f5d 0 2024-02-22T00:33:49.615 INFO:tasks.workunit.client.0.smithi049.stdout:1/201: dread d2/d8/f13 [0,4194304] 0 2024-02-22T00:33:49.616 INFO:tasks.workunit.client.0.smithi049.stdout:4/298: mkdir d3/d22/d5c/d5e 0 2024-02-22T00:33:49.616 INFO:tasks.workunit.client.0.smithi049.stdout:1/202: write d2/d8/db/d25/f48 [908060,17227] 0 2024-02-22T00:33:49.617 INFO:tasks.workunit.client.0.smithi049.stdout:1/203: fdatasync d2/d8/db/f1a 0 2024-02-22T00:33:49.619 INFO:tasks.workunit.client.0.smithi049.stdout:1/204: chown d2/d8/db/l20 22 1 2024-02-22T00:33:49.620 INFO:tasks.workunit.client.0.smithi049.stdout:4/299: creat d3/d8/d10/d43/d4d/f5f x:0 0 0 2024-02-22T00:33:49.620 INFO:tasks.workunit.client.0.smithi049.stdout:1/205: dread - d2/d8/db/f12 zero size 2024-02-22T00:33:49.620 INFO:tasks.workunit.client.0.smithi049.stdout:4/300: chown d3/l4 17548819 1 2024-02-22T00:33:49.621 INFO:tasks.workunit.client.0.smithi049.stdout:4/301: readlink d3/d8/d10/d39/l4a 0 2024-02-22T00:33:49.622 INFO:tasks.workunit.client.0.smithi049.stdout:1/206: creat d2/f4e x:0 0 0 2024-02-22T00:33:49.623 INFO:tasks.workunit.client.0.smithi049.stdout:4/302: unlink d3/l4 0 2024-02-22T00:33:49.625 INFO:tasks.workunit.client.0.smithi049.stdout:1/207: creat d2/d8/da/f4f x:0 0 0 2024-02-22T00:33:49.627 INFO:tasks.workunit.client.0.smithi049.stdout:1/208: write d2/d8/da/f4f [146901,11141] 0 2024-02-22T00:33:49.629 INFO:tasks.workunit.client.0.smithi049.stdout:1/209: fsync d2/d8/da/f3f 0 2024-02-22T00:33:49.631 INFO:tasks.workunit.client.0.smithi049.stdout:4/303: dwrite d3/d22/d5c/f36 [0,4194304] 0 2024-02-22T00:33:49.634 INFO:tasks.workunit.client.0.smithi049.stdout:4/304: write d3/d22/d5c/d35/f40 [1590557,83031] 0 2024-02-22T00:33:49.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/305: unlink d3/d8/d20/f3c 0 2024-02-22T00:33:49.641 INFO:tasks.workunit.client.0.smithi049.stdout:1/210: dwrite d2/d8/da/f39 [0,4194304] 0 2024-02-22T00:33:49.642 INFO:tasks.workunit.client.0.smithi049.stdout:1/211: read d2/d8/f13 [3481977,32406] 0 2024-02-22T00:33:49.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/306: truncate d3/d8/d10/f15 26435 0 2024-02-22T00:33:49.646 INFO:tasks.workunit.client.0.smithi049.stdout:1/212: symlink d2/l50 0 2024-02-22T00:33:49.648 INFO:tasks.workunit.client.0.smithi049.stdout:4/307: mkdir d3/d13/d48/d60 0 2024-02-22T00:33:49.650 INFO:tasks.workunit.client.0.smithi049.stdout:1/213: symlink d2/d8/d4c/l51 0 2024-02-22T00:33:49.653 INFO:tasks.workunit.client.0.smithi049.stdout:1/214: creat d2/d8/d4c/f52 x:0 0 0 2024-02-22T00:33:49.654 INFO:tasks.workunit.client.0.smithi049.stdout:1/215: truncate d2/f10 535730 0 2024-02-22T00:33:49.656 INFO:tasks.workunit.client.0.smithi049.stdout:1/216: write d2/d8/db/f26 [262371,82704] 0 2024-02-22T00:33:49.664 INFO:tasks.workunit.client.0.smithi049.stdout:4/308: dread d3/d8/f1a [0,4194304] 0 2024-02-22T00:33:49.665 INFO:tasks.workunit.client.0.smithi049.stdout:1/217: dwrite d2/d8/db/d25/d40/d41/f4a [0,4194304] 0 2024-02-22T00:33:49.666 INFO:tasks.workunit.client.0.smithi049.stdout:1/218: write d2/f3 [940577,100755] 0 2024-02-22T00:33:49.667 INFO:tasks.workunit.client.0.smithi049.stdout:4/309: symlink d3/d8/d20/l61 0 2024-02-22T00:33:49.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/310: creat d3/d33/f62 x:0 0 0 2024-02-22T00:33:49.670 INFO:tasks.workunit.client.0.smithi049.stdout:1/219: write d2/d8/f13 [719552,57711] 0 2024-02-22T00:33:49.673 INFO:tasks.workunit.client.0.smithi049.stdout:4/311: symlink d3/d22/l63 0 2024-02-22T00:33:49.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/220: dread d2/d8/da/f3d [0,4194304] 0 2024-02-22T00:33:49.677 INFO:tasks.workunit.client.0.smithi049.stdout:4/312: creat d3/d22/f64 x:0 0 0 2024-02-22T00:33:49.678 INFO:tasks.workunit.client.0.smithi049.stdout:1/221: mkdir d2/d53 0 2024-02-22T00:33:49.679 INFO:tasks.workunit.client.0.smithi049.stdout:1/222: readlink d2/d8/d4c/l51 0 2024-02-22T00:33:49.680 INFO:tasks.workunit.client.0.smithi049.stdout:4/313: creat d3/d8/d10/d12/f65 x:0 0 0 2024-02-22T00:33:49.681 INFO:tasks.workunit.client.0.smithi049.stdout:4/314: write d3/d33/f46 [143463,58452] 0 2024-02-22T00:33:49.681 INFO:tasks.workunit.client.0.smithi049.stdout:1/223: creat d2/d8/db/d25/d40/f54 x:0 0 0 2024-02-22T00:33:49.684 INFO:tasks.workunit.client.0.smithi049.stdout:4/315: mknod d3/d22/d5c/d35/c66 0 2024-02-22T00:33:49.686 INFO:tasks.workunit.client.0.smithi049.stdout:4/316: creat d3/d33/f67 x:0 0 0 2024-02-22T00:33:49.691 INFO:tasks.workunit.client.0.smithi049.stdout:4/317: creat d3/d13/f68 x:0 0 0 2024-02-22T00:33:49.692 INFO:tasks.workunit.client.0.smithi049.stdout:1/224: dwrite d2/d8/db/f1a [0,4194304] 0 2024-02-22T00:33:49.696 INFO:tasks.workunit.client.0.smithi049.stdout:1/225: symlink d2/d53/l55 0 2024-02-22T00:33:49.701 INFO:tasks.workunit.client.0.smithi049.stdout:4/318: dwrite d3/f4b [0,4194304] 0 2024-02-22T00:33:49.701 INFO:tasks.workunit.client.0.smithi049.stdout:1/226: unlink d2/d8/db/d25/d40/l49 0 2024-02-22T00:33:49.703 INFO:tasks.workunit.client.0.smithi049.stdout:1/227: truncate d2/d8/d4c/f52 650719 0 2024-02-22T00:33:49.705 INFO:tasks.workunit.client.0.smithi049.stdout:4/319: symlink d3/d8/d10/d12/l69 0 2024-02-22T00:33:49.706 INFO:tasks.workunit.client.0.smithi049.stdout:1/228: truncate d2/d8/db/f12 633212 0 2024-02-22T00:33:49.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/229: dwrite d2/d8/f13 [0,4194304] 0 2024-02-22T00:33:49.723 INFO:tasks.workunit.client.0.smithi049.stdout:1/230: rmdir d2/d8/db/d25/d40/d41 39 2024-02-22T00:33:49.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/264: sync 2024-02-22T00:33:49.728 INFO:tasks.workunit.client.0.smithi049.stdout:1/231: mknod d2/d53/c56 0 2024-02-22T00:33:49.730 INFO:tasks.workunit.client.0.smithi049.stdout:1/232: write d2/d8/db/d25/d40/f54 [970378,11531] 0 2024-02-22T00:33:49.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/233: stat d2/d8/db/c37 0 2024-02-22T00:33:49.732 INFO:tasks.workunit.client.0.smithi049.stdout:4/320: dread f2 [0,4194304] 0 2024-02-22T00:33:49.741 INFO:tasks.workunit.client.0.smithi049.stdout:4/321: getdents d3/d8/d10/d43/d4d 0 2024-02-22T00:33:49.742 INFO:tasks.workunit.client.0.smithi049.stdout:4/322: chown d3/d22/l63 1300000217 1 2024-02-22T00:33:49.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/323: chown d3/d13/d48 317984149 1 2024-02-22T00:33:49.748 INFO:tasks.workunit.client.0.smithi049.stdout:1/234: dwrite d2/d8/db/f1c [0,4194304] 0 2024-02-22T00:33:49.750 INFO:tasks.workunit.client.0.smithi049.stdout:4/324: unlink d3/d22/f64 0 2024-02-22T00:33:49.750 INFO:tasks.workunit.client.0.smithi049.stdout:1/235: write d2/d8/da/f4f [130696,80953] 0 2024-02-22T00:33:49.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/236: fdatasync d2/f31 0 2024-02-22T00:33:49.756 INFO:tasks.workunit.client.0.smithi049.stdout:4/325: mknod d3/d22/c6a 0 2024-02-22T00:33:49.764 INFO:tasks.workunit.client.0.smithi049.stdout:1/237: dwrite d2/d8/db/f26 [0,4194304] 0 2024-02-22T00:33:49.786 INFO:tasks.workunit.client.0.smithi049.stdout:1/238: truncate d2/d8/db/f2d 2450398 0 2024-02-22T00:33:49.796 INFO:tasks.workunit.client.0.smithi049.stdout:1/239: dwrite d2/d8/f27 [0,4194304] 0 2024-02-22T00:33:49.802 INFO:tasks.workunit.client.0.smithi049.stdout:1/240: rename d2/f10 to d2/d8/db/f57 0 2024-02-22T00:33:49.811 INFO:tasks.workunit.client.0.smithi049.stdout:1/241: dwrite d2/d8/da/f14 [0,4194304] 0 2024-02-22T00:33:49.818 INFO:tasks.workunit.client.0.smithi049.stdout:1/242: dwrite d2/d8/da/f22 [4194304,4194304] 0 2024-02-22T00:33:49.822 INFO:tasks.workunit.client.0.smithi049.stdout:1/243: symlink d2/d8/db/l58 0 2024-02-22T00:33:49.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/244: link d2/d8/da/fd d2/d8/db/d25/d40/d41/f59 0 2024-02-22T00:33:49.837 INFO:tasks.workunit.client.0.smithi049.stdout:1/245: truncate d2/d8/da/f39 608984 0 2024-02-22T00:33:49.841 INFO:tasks.workunit.client.0.smithi049.stdout:1/246: dread d2/d8/db/d25/d40/f54 [0,4194304] 0 2024-02-22T00:33:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:1/247: dwrite d2/d8/f27 [4194304,4194304] 0 2024-02-22T00:33:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:1/248: mknod d2/d8/db/d25/c5a 0 2024-02-22T00:33:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:1/249: getdents d2/d8/db 0 2024-02-22T00:33:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:1/250: fsync d2/d8/db/d25/f2c 0 2024-02-22T00:33:49.861 INFO:tasks.workunit.client.0.smithi049.stdout:1/251: fsync d2/d8/db/f2d 0 2024-02-22T00:33:49.862 INFO:tasks.workunit.client.0.smithi049.stdout:1/252: chown d2/d8/db/f2d 3156098 1 2024-02-22T00:33:49.868 INFO:tasks.workunit.client.0.smithi049.stdout:1/253: dwrite d2/f35 [0,4194304] 0 2024-02-22T00:33:49.871 INFO:tasks.workunit.client.0.smithi049.stdout:1/254: mkdir d2/d8/db/d25/d40/d41/d5b 0 2024-02-22T00:33:49.873 INFO:tasks.workunit.client.0.smithi049.stdout:1/255: creat d2/d8/db/d25/d40/d41/f5c x:0 0 0 2024-02-22T00:33:49.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/256: mknod d2/d8/db/d25/d40/d41/c5d 0 2024-02-22T00:33:49.878 INFO:tasks.workunit.client.0.smithi049.stdout:1/257: mkdir d2/d8/d4c/d5e 0 2024-02-22T00:33:49.882 INFO:tasks.workunit.client.0.smithi049.stdout:1/258: link d2/d53/c56 d2/d8/db/d25/d40/d41/c5f 0 2024-02-22T00:33:49.883 INFO:tasks.workunit.client.0.smithi049.stdout:1/259: write d2/d8/f27 [8628815,40473] 0 2024-02-22T00:33:49.885 INFO:tasks.workunit.client.0.smithi049.stdout:1/260: read d2/d8/db/f1a [2461317,59894] 0 2024-02-22T00:33:49.886 INFO:tasks.workunit.client.0.smithi049.stdout:1/261: write d2/f4 [3411659,85649] 0 2024-02-22T00:33:49.891 INFO:tasks.workunit.client.0.smithi049.stdout:1/262: dread d2/d8/db/f1a [0,4194304] 0 2024-02-22T00:33:49.892 INFO:tasks.workunit.client.0.smithi049.stdout:2/301: sync 2024-02-22T00:33:49.892 INFO:tasks.workunit.client.0.smithi049.stdout:3/120: sync 2024-02-22T00:33:49.892 INFO:tasks.workunit.client.0.smithi049.stdout:5/220: sync 2024-02-22T00:33:49.893 INFO:tasks.workunit.client.0.smithi049.stdout:2/302: dread - d2/d9/f6e zero size 2024-02-22T00:33:49.894 INFO:tasks.workunit.client.0.smithi049.stdout:5/221: chown d0/d26/d46/d24/l45 85446 1 2024-02-22T00:33:49.895 INFO:tasks.workunit.client.0.smithi049.stdout:3/121: rename d0/f11 to d0/d14/f21 0 2024-02-22T00:33:49.897 INFO:tasks.workunit.client.0.smithi049.stdout:2/303: fdatasync d2/d9/de/d15/f4b 0 2024-02-22T00:33:49.899 INFO:tasks.workunit.client.0.smithi049.stdout:1/263: link d2/d8/db/d25/f2c d2/d8/db/d25/d40/d41/f60 0 2024-02-22T00:33:49.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/122: mknod d0/d14/c22 0 2024-02-22T00:33:49.904 INFO:tasks.workunit.client.0.smithi049.stdout:3/123: dread d0/dd/f9 [0,4194304] 0 2024-02-22T00:33:49.905 INFO:tasks.workunit.client.0.smithi049.stdout:5/222: rename d0/d39/d6/f1f to d0/f4c 0 2024-02-22T00:33:49.909 INFO:tasks.workunit.client.0.smithi049.stdout:2/304: rename d2/d9/de/d10/d2e/l47 to d2/d9/de/d3a/d6d/l70 0 2024-02-22T00:33:49.910 INFO:tasks.workunit.client.0.smithi049.stdout:5/223: mkdir d0/d26/d4d 0 2024-02-22T00:33:49.914 INFO:tasks.workunit.client.0.smithi049.stdout:2/305: chown d2/d9/de/d10/f29 4636 1 2024-02-22T00:33:49.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/224: rmdir d0 39 2024-02-22T00:33:49.918 INFO:tasks.workunit.client.0.smithi049.stdout:1/264: dwrite d2/d8/db/f2d [0,4194304] 0 2024-02-22T00:33:49.919 INFO:tasks.workunit.client.0.smithi049.stdout:3/124: dwrite d0/d14/f17 [4194304,4194304] 0 2024-02-22T00:33:49.921 INFO:tasks.workunit.client.0.smithi049.stdout:2/306: symlink d2/d9/de/d3a/d6d/l71 0 2024-02-22T00:33:49.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/125: write d0/fc [159514,91884] 0 2024-02-22T00:33:49.926 INFO:tasks.workunit.client.0.smithi049.stdout:5/225: dread d0/d39/d6/fd [0,4194304] 0 2024-02-22T00:33:49.927 INFO:tasks.workunit.client.0.smithi049.stdout:2/307: rmdir d2/d9 39 2024-02-22T00:33:49.934 INFO:tasks.workunit.client.0.smithi049.stdout:1/265: creat d2/d8/da/f61 x:0 0 0 2024-02-22T00:33:49.934 INFO:tasks.workunit.client.0.smithi049.stdout:3/126: getdents d0/dd/d1e 0 2024-02-22T00:33:49.935 INFO:tasks.workunit.client.0.smithi049.stdout:2/308: mkdir d2/d9/dd/d4d/d72 0 2024-02-22T00:33:49.936 INFO:tasks.workunit.client.0.smithi049.stdout:5/226: write d0/d26/d46/d24/f3f [922001,126412] 0 2024-02-22T00:33:49.937 INFO:tasks.workunit.client.0.smithi049.stdout:2/309: dread - d2/d9/de/d10/d2e/f49 zero size 2024-02-22T00:33:49.940 INFO:tasks.workunit.client.0.smithi049.stdout:1/266: dread d2/d8/db/f2d [0,4194304] 0 2024-02-22T00:33:49.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/267: rename d2/d53 to d2/d8/db/d25/d62 0 2024-02-22T00:33:49.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/227: creat d0/f4e x:0 0 0 2024-02-22T00:33:49.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/268: stat d2/d8/db/d25/d40/d41/c5d 0 2024-02-22T00:33:49.949 INFO:tasks.workunit.client.0.smithi049.stdout:5/228: unlink d0/d20/l22 0 2024-02-22T00:33:49.950 INFO:tasks.workunit.client.0.smithi049.stdout:5/229: rmdir d0/d26 39 2024-02-22T00:33:49.953 INFO:tasks.workunit.client.0.smithi049.stdout:2/310: truncate d2/d9/de/d10/d2e/d42/f43 920060 0 2024-02-22T00:33:49.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/230: rmdir d0/d26/d46/d24/d3b 39 2024-02-22T00:33:49.954 INFO:tasks.workunit.client.0.smithi049.stdout:5/231: chown d0/d39/d6/fd 100 1 2024-02-22T00:33:49.955 INFO:tasks.workunit.client.0.smithi049.stdout:2/311: rmdir d2/d9/de/d10 39 2024-02-22T00:33:49.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/232: mknod d0/d20/c4f 0 2024-02-22T00:33:49.958 INFO:tasks.workunit.client.0.smithi049.stdout:5/233: rmdir d0/d26/d46/d24/d3b 39 2024-02-22T00:33:49.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/234: fsync d0/d39/f41 0 2024-02-22T00:33:49.963 INFO:tasks.workunit.client.0.smithi049.stdout:5/235: rename d0/d26/d46 to d0/d20/d50 0 2024-02-22T00:33:49.967 INFO:tasks.workunit.client.0.smithi049.stdout:5/236: rename d0/d39/d6/f1e to d0/d39/d6/f51 0 2024-02-22T00:33:49.968 INFO:tasks.workunit.client.0.smithi049.stdout:5/237: fsync d0/d26/f3c 0 2024-02-22T00:33:49.969 INFO:tasks.workunit.client.0.smithi049.stdout:5/238: chown d0/f4c 16 1 2024-02-22T00:33:49.971 INFO:tasks.workunit.client.0.smithi049.stdout:2/312: dwrite d2/d9/de/d15/d1b/f20 [0,4194304] 0 2024-02-22T00:33:49.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/239: rename d0/d20/d50/d24/f3a to d0/d39/d6/f52 0 2024-02-22T00:33:49.976 INFO:tasks.workunit.client.0.smithi049.stdout:2/313: rmdir d2/d9/de/d10/d59 39 2024-02-22T00:33:49.982 INFO:tasks.workunit.client.0.smithi049.stdout:2/314: dread d2/d9/de/d15/d1b/f20 [0,4194304] 0 2024-02-22T00:33:49.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/240: dread d0/f1d [0,4194304] 0 2024-02-22T00:33:49.990 INFO:tasks.workunit.client.0.smithi049.stdout:5/241: rename d0/c28 to d0/d26/c53 0 2024-02-22T00:33:49.991 INFO:tasks.workunit.client.0.smithi049.stdout:2/315: dwrite d2/d9/fa [0,4194304] 0 2024-02-22T00:33:49.991 INFO:tasks.workunit.client.0.smithi049.stdout:5/242: stat d0/d26/f42 0 2024-02-22T00:33:49.992 INFO:tasks.workunit.client.0.smithi049.stdout:5/243: readlink d0/l27 0 2024-02-22T00:33:49.994 INFO:tasks.workunit.client.0.smithi049.stdout:2/316: rename d2 to d2/d9/de/d3a/d73 22 2024-02-22T00:33:49.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/244: unlink d0/d39/l1b 0 2024-02-22T00:33:49.997 INFO:tasks.workunit.client.0.smithi049.stdout:2/317: mkdir d2/d9/dd/d74 0 2024-02-22T00:33:50.003 INFO:tasks.workunit.client.0.smithi049.stdout:5/245: dwrite d0/f33 [0,4194304] 0 2024-02-22T00:33:50.003 INFO:tasks.workunit.client.0.smithi049.stdout:2/318: link d2/d9/de/d3a/d6d/l71 d2/l75 0 2024-02-22T00:33:50.004 INFO:tasks.workunit.client.0.smithi049.stdout:5/246: read - d0/d26/f42 zero size 2024-02-22T00:33:50.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/319: dwrite d2/d9/de/d10/d2e/f49 [0,4194304] 0 2024-02-22T00:33:50.013 INFO:tasks.workunit.client.0.smithi049.stdout:2/320: truncate d2/d9/f6f 537604 0 2024-02-22T00:33:50.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/247: getdents d0/d39 0 2024-02-22T00:33:50.016 INFO:tasks.workunit.client.0.smithi049.stdout:2/321: creat d2/d9/de/d10/d2e/f76 x:0 0 0 2024-02-22T00:33:50.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/248: mkdir d0/d20/d50/d24/d54 0 2024-02-22T00:33:50.022 INFO:tasks.workunit.client.0.smithi049.stdout:2/322: rmdir d2/d9/d17/d62 0 2024-02-22T00:33:50.024 INFO:tasks.workunit.client.0.smithi049.stdout:5/249: mknod d0/d26/d4d/c55 0 2024-02-22T00:33:50.024 INFO:tasks.workunit.client.0.smithi049.stdout:2/323: fdatasync d2/d9/f6e 0 2024-02-22T00:33:50.026 INFO:tasks.workunit.client.0.smithi049.stdout:2/324: fdatasync d2/d9/de/d15/d1b/f20 0 2024-02-22T00:33:50.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/250: rmdir d0/d20/d50/d24/d3b 39 2024-02-22T00:33:50.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/251: getdents d0/d20/d50/d24/d3b 0 2024-02-22T00:33:50.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/252: dread d0/f4c [4194304,4194304] 0 2024-02-22T00:33:50.038 INFO:tasks.workunit.client.0.smithi049.stdout:5/253: chown d0/d39/f41 457 1 2024-02-22T00:33:50.039 INFO:tasks.workunit.client.0.smithi049.stdout:5/254: dread d0/f1d [0,4194304] 0 2024-02-22T00:33:50.042 INFO:tasks.workunit.client.0.smithi049.stdout:2/325: dread d2/d9/de/d15/d1b/f1f [0,4194304] 0 2024-02-22T00:33:50.045 INFO:tasks.workunit.client.0.smithi049.stdout:2/326: fsync d2/d9/de/d15/f4b 0 2024-02-22T00:33:50.047 INFO:tasks.workunit.client.0.smithi049.stdout:5/255: dwrite d0/d39/d6/fd [0,4194304] 0 2024-02-22T00:33:50.049 INFO:tasks.workunit.client.0.smithi049.stdout:2/327: creat d2/d9/de/d10/d2e/d42/f77 x:0 0 0 2024-02-22T00:33:50.051 INFO:tasks.workunit.client.0.smithi049.stdout:5/256: symlink d0/d20/d50/l56 0 2024-02-22T00:33:50.055 INFO:tasks.workunit.client.0.smithi049.stdout:5/257: mkdir d0/d20/d50/d24/d57 0 2024-02-22T00:33:50.058 INFO:tasks.workunit.client.0.smithi049.stdout:5/258: unlink d0/d39/c3d 0 2024-02-22T00:33:50.062 INFO:tasks.workunit.client.0.smithi049.stdout:5/259: dread d0/f32 [0,4194304] 0 2024-02-22T00:33:50.066 INFO:tasks.workunit.client.0.smithi049.stdout:5/260: rename d0/f33 to d0/d39/f58 0 2024-02-22T00:33:50.067 INFO:tasks.workunit.client.0.smithi049.stdout:5/261: chown d0/d26/l2e 198176574 1 2024-02-22T00:33:50.067 INFO:tasks.workunit.client.0.smithi049.stdout:8/218: sync 2024-02-22T00:33:50.067 INFO:tasks.workunit.client.0.smithi049.stdout:9/281: sync 2024-02-22T00:33:50.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/282: write d17/d1c/f2c [1242168,19208] 0 2024-02-22T00:33:50.069 INFO:tasks.workunit.client.0.smithi049.stdout:5/262: symlink d0/d26/l59 0 2024-02-22T00:33:50.072 INFO:tasks.workunit.client.0.smithi049.stdout:9/283: write d17/d21/f23 [186526,11713] 0 2024-02-22T00:33:50.074 INFO:tasks.workunit.client.0.smithi049.stdout:5/263: creat d0/d20/d50/d24/f5a x:0 0 0 2024-02-22T00:33:50.077 INFO:tasks.workunit.client.0.smithi049.stdout:9/284: creat d17/d21/f62 x:0 0 0 2024-02-22T00:33:50.078 INFO:tasks.workunit.client.0.smithi049.stdout:8/219: dwrite d1/d2/db/f16 [0,4194304] 0 2024-02-22T00:33:50.078 INFO:tasks.workunit.client.0.smithi049.stdout:2/328: dread d2/d9/de/d3a/f56 [0,4194304] 0 2024-02-22T00:33:50.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/220: mkdir d1/d2/db/d15/d30/d4b/d51 0 2024-02-22T00:33:50.084 INFO:tasks.workunit.client.0.smithi049.stdout:9/285: creat d17/d1c/f63 x:0 0 0 2024-02-22T00:33:50.090 INFO:tasks.workunit.client.0.smithi049.stdout:9/286: mknod d17/d1c/d25/d39/c64 0 2024-02-22T00:33:50.091 INFO:tasks.workunit.client.0.smithi049.stdout:8/221: truncate d1/d2/db/d1c/f4e 452429 0 2024-02-22T00:33:50.092 INFO:tasks.workunit.client.0.smithi049.stdout:5/264: dwrite d0/d39/d6/f13 [4194304,4194304] 0 2024-02-22T00:33:50.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/329: dwrite d2/d9/f3c [0,4194304] 0 2024-02-22T00:33:50.096 INFO:tasks.workunit.client.0.smithi049.stdout:9/287: symlink d17/d21/d4e/d4b/l65 0 2024-02-22T00:33:50.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/330: dread - d2/d9/de/d15/d4f/f65 zero size 2024-02-22T00:33:50.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/265: truncate d0/d20/d50/d24/f5a 203705 0 2024-02-22T00:33:50.099 INFO:tasks.workunit.client.0.smithi049.stdout:2/331: dread - d2/d9/de/d10/f3d zero size 2024-02-22T00:33:50.102 INFO:tasks.workunit.client.0.smithi049.stdout:2/332: chown d2/d9/de/d15/d4f/l6b 14068 1 2024-02-22T00:33:50.102 INFO:tasks.workunit.client.0.smithi049.stdout:8/222: mkdir d1/d2/db/d15/d30/d36/d52 0 2024-02-22T00:33:50.105 INFO:tasks.workunit.client.0.smithi049.stdout:8/223: read d1/d2/db/d15/d33/f4a [2241426,52317] 0 2024-02-22T00:33:50.105 INFO:tasks.workunit.client.0.smithi049.stdout:9/288: unlink d17/f35 0 2024-02-22T00:33:50.108 INFO:tasks.workunit.client.0.smithi049.stdout:5/266: dwrite d0/d39/d6/f12 [0,4194304] 0 2024-02-22T00:33:50.108 INFO:tasks.workunit.client.0.smithi049.stdout:9/289: write d17/d1c/f1e [1499031,476] 0 2024-02-22T00:33:50.109 INFO:tasks.workunit.client.0.smithi049.stdout:8/224: fdatasync d1/f12 0 2024-02-22T00:33:50.113 INFO:tasks.workunit.client.0.smithi049.stdout:9/290: mknod d17/d1c/d25/c66 0 2024-02-22T00:33:50.113 INFO:tasks.workunit.client.0.smithi049.stdout:2/333: link d2/l45 d2/d9/de/d15/d1b/l78 0 2024-02-22T00:33:50.117 INFO:tasks.workunit.client.0.smithi049.stdout:9/291: mkdir d17/d1c/d25/d39/d67 0 2024-02-22T00:33:50.119 INFO:tasks.workunit.client.0.smithi049.stdout:5/267: dwrite d0/f48 [0,4194304] 0 2024-02-22T00:33:50.120 INFO:tasks.workunit.client.0.smithi049.stdout:8/225: rename d1/d2/db/d1c/d3b to d1/d2/db/d15/d30/d36/d53 0 2024-02-22T00:33:50.122 INFO:tasks.workunit.client.0.smithi049.stdout:9/292: creat d17/d21/d47/f68 x:0 0 0 2024-02-22T00:33:50.124 INFO:tasks.workunit.client.0.smithi049.stdout:9/293: chown d17/d1c/f2b 2878 1 2024-02-22T00:33:50.124 INFO:tasks.workunit.client.0.smithi049.stdout:2/334: dread d2/d9/de/d3a/f56 [0,4194304] 0 2024-02-22T00:33:50.125 INFO:tasks.workunit.client.0.smithi049.stdout:8/226: write d1/d2/d5/f34 [5661405,60641] 0 2024-02-22T00:33:50.125 INFO:tasks.workunit.client.0.smithi049.stdout:5/268: truncate d0/d20/d50/d24/d3b/f49 414254 0 2024-02-22T00:33:50.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/335: creat d2/d9/f79 x:0 0 0 2024-02-22T00:33:50.130 INFO:tasks.workunit.client.0.smithi049.stdout:5/269: mkdir d0/d20/d50/d24/d3b/d5b 0 2024-02-22T00:33:50.131 INFO:tasks.workunit.client.0.smithi049.stdout:0/265: sync 2024-02-22T00:33:50.131 INFO:tasks.workunit.client.0.smithi049.stdout:6/259: sync 2024-02-22T00:33:50.132 INFO:tasks.workunit.client.0.smithi049.stdout:8/227: truncate d1/d2/db/d15/d33/f4a 601925 0 2024-02-22T00:33:50.135 INFO:tasks.workunit.client.0.smithi049.stdout:9/294: dwrite d17/f18 [0,4194304] 0 2024-02-22T00:33:50.137 INFO:tasks.workunit.client.0.smithi049.stdout:2/336: getdents d2/d9/de/d15 0 2024-02-22T00:33:50.137 INFO:tasks.workunit.client.0.smithi049.stdout:8/228: creat d1/d2/d5/d1b/d39/f54 x:0 0 0 2024-02-22T00:33:50.140 INFO:tasks.workunit.client.0.smithi049.stdout:5/270: rename d0/d39/d6/f52 to d0/d20/d50/d24/d57/f5c 0 2024-02-22T00:33:50.141 INFO:tasks.workunit.client.0.smithi049.stdout:5/271: write d0/d39/d6/f13 [2588658,16983] 0 2024-02-22T00:33:50.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/295: dread d17/f18 [0,4194304] 0 2024-02-22T00:33:50.142 INFO:tasks.workunit.client.0.smithi049.stdout:5/272: chown d0/d26/d4d 1388220 1 2024-02-22T00:33:50.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/337: mknod d2/d9/dd/d4d/c7a 0 2024-02-22T00:33:50.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/229: rmdir d1/d2/db/d15/d30/d36 39 2024-02-22T00:33:50.148 INFO:tasks.workunit.client.0.smithi049.stdout:0/266: rename d3/d6/d8/c19 to d3/d6/d29/c41 0 2024-02-22T00:33:50.148 INFO:tasks.workunit.client.0.smithi049.stdout:6/260: write d3/f38 [1906267,36987] 0 2024-02-22T00:33:50.149 INFO:tasks.workunit.client.0.smithi049.stdout:9/296: creat d17/d21/d47/f69 x:0 0 0 2024-02-22T00:33:50.150 INFO:tasks.workunit.client.0.smithi049.stdout:2/338: mknod d2/d9/de/d10/d46/d5d/c7b 0 2024-02-22T00:33:50.151 INFO:tasks.workunit.client.0.smithi049.stdout:8/230: unlink d1/d2/db/d1c/f4e 0 2024-02-22T00:33:50.155 INFO:tasks.workunit.client.0.smithi049.stdout:0/267: stat d3/d1e/c30 0 2024-02-22T00:33:50.155 INFO:tasks.workunit.client.0.smithi049.stdout:6/261: chown d3/ce 106710 1 2024-02-22T00:33:50.160 INFO:tasks.workunit.client.0.smithi049.stdout:5/273: link d0/d20/d50/d24/l3e d0/d20/d50/d24/d57/l5d 0 2024-02-22T00:33:50.162 INFO:tasks.workunit.client.0.smithi049.stdout:6/262: creat d3/d16/d32/f5d x:0 0 0 2024-02-22T00:33:50.162 INFO:tasks.workunit.client.0.smithi049.stdout:9/297: dwrite d17/d1c/f2c [0,4194304] 0 2024-02-22T00:33:50.163 INFO:tasks.workunit.client.0.smithi049.stdout:2/339: dwrite d2/d9/f5c [0,4194304] 0 2024-02-22T00:33:50.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/298: dread - d17/d21/d47/f5e zero size 2024-02-22T00:33:50.169 INFO:tasks.workunit.client.0.smithi049.stdout:8/231: getdents d1/d2 0 2024-02-22T00:33:50.194 INFO:tasks.workunit.client.0.smithi049.stdout:2/340: rmdir d2/d9/de/d10 39 2024-02-22T00:33:50.195 INFO:tasks.workunit.client.0.smithi049.stdout:4/326: sync 2024-02-22T00:33:50.195 INFO:tasks.workunit.client.0.smithi049.stdout:7/265: sync 2024-02-22T00:33:50.195 INFO:tasks.workunit.client.0.smithi049.stdout:1/269: sync 2024-02-22T00:33:50.196 INFO:tasks.workunit.client.0.smithi049.stdout:3/127: sync 2024-02-22T00:33:50.196 INFO:tasks.workunit.client.0.smithi049.stdout:6/263: mknod d3/d16/d4a/d4d/c5e 0 2024-02-22T00:33:50.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/268: dwrite d3/d6/d29/f3f [4194304,4194304] 0 2024-02-22T00:33:50.210 INFO:tasks.workunit.client.0.smithi049.stdout:7/266: rmdir d1/d41/d55 39 2024-02-22T00:33:50.211 INFO:tasks.workunit.client.0.smithi049.stdout:6/264: write d3/d16/d3b/d3d/f50 [382980,78877] 0 2024-02-22T00:33:50.214 INFO:tasks.workunit.client.0.smithi049.stdout:4/327: write d3/d8/d10/d12/f65 [983683,72726] 0 2024-02-22T00:33:50.215 INFO:tasks.workunit.client.0.smithi049.stdout:2/341: creat d2/d9/de/d10/d2e/f7c x:0 0 0 2024-02-22T00:33:50.215 INFO:tasks.workunit.client.0.smithi049.stdout:1/270: write d2/d8/da/f4f [61986,97310] 0 2024-02-22T00:33:50.217 INFO:tasks.workunit.client.0.smithi049.stdout:9/299: link d17/d1c/d25/d39/l57 d17/d21/d47/d5d/l6a 0 2024-02-22T00:33:50.217 INFO:tasks.workunit.client.0.smithi049.stdout:0/269: fsync d3/d6/d8/d36/f40 0 2024-02-22T00:33:50.217 INFO:tasks.workunit.client.0.smithi049.stdout:7/267: write d1/df/d12/f59 [1039737,97584] 0 2024-02-22T00:33:50.218 INFO:tasks.workunit.client.0.smithi049.stdout:6/265: mkdir d3/d16/d1f/d5f 0 2024-02-22T00:33:50.222 INFO:tasks.workunit.client.0.smithi049.stdout:9/300: readlink d17/d21/d3c/l42 0 2024-02-22T00:33:50.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/232: dread d1/d2/d5/f18 [0,4194304] 0 2024-02-22T00:33:50.224 INFO:tasks.workunit.client.0.smithi049.stdout:1/271: mknod d2/d8/d4c/d5e/c63 0 2024-02-22T00:33:50.225 INFO:tasks.workunit.client.0.smithi049.stdout:6/266: mkdir d3/d16/d1f/d60 0 2024-02-22T00:33:50.227 INFO:tasks.workunit.client.0.smithi049.stdout:2/342: dread d2/d9/d17/f28 [0,4194304] 0 2024-02-22T00:33:50.229 INFO:tasks.workunit.client.0.smithi049.stdout:8/233: read d1/fe [307653,24634] 0 2024-02-22T00:33:50.231 INFO:tasks.workunit.client.0.smithi049.stdout:0/270: link d3/d6/c18 d3/df/c42 0 2024-02-22T00:33:50.236 INFO:tasks.workunit.client.0.smithi049.stdout:1/272: creat d2/d8/db/d25/d40/d4d/f64 x:0 0 0 2024-02-22T00:33:50.237 INFO:tasks.workunit.client.0.smithi049.stdout:2/343: write d2/d9/de/d15/d4f/f65 [490588,126517] 0 2024-02-22T00:33:50.238 INFO:tasks.workunit.client.0.smithi049.stdout:3/128: dread d0/dd/f13 [0,4194304] 0 2024-02-22T00:33:50.240 INFO:tasks.workunit.client.0.smithi049.stdout:7/268: dwrite d1/d41/d28/f39 [0,4194304] 0 2024-02-22T00:33:50.240 INFO:tasks.workunit.client.0.smithi049.stdout:0/271: creat d3/f43 x:0 0 0 2024-02-22T00:33:50.243 INFO:tasks.workunit.client.0.smithi049.stdout:1/273: chown d2/d8/db/d25/d40/d41/c5d 0 1 2024-02-22T00:33:50.245 INFO:tasks.workunit.client.0.smithi049.stdout:6/267: link d3/c27 d3/d16/c61 0 2024-02-22T00:33:50.245 INFO:tasks.workunit.client.0.smithi049.stdout:1/274: fsync d2/f35 0 2024-02-22T00:33:50.246 INFO:tasks.workunit.client.0.smithi049.stdout:3/129: symlink d0/d14/l23 0 2024-02-22T00:33:50.249 INFO:tasks.workunit.client.0.smithi049.stdout:2/344: chown d2/d9/de/d3a/f44 133335519 1 2024-02-22T00:33:50.249 INFO:tasks.workunit.client.0.smithi049.stdout:4/328: dread d3/d22/d5c/f5b [0,4194304] 0 2024-02-22T00:33:50.249 INFO:tasks.workunit.client.0.smithi049.stdout:0/272: chown d3/d6/c18 785102 1 2024-02-22T00:33:50.250 INFO:tasks.workunit.client.0.smithi049.stdout:1/275: rmdir d2/d8/d4c/d5e 39 2024-02-22T00:33:50.252 INFO:tasks.workunit.client.0.smithi049.stdout:8/234: truncate d1/d2/db/d15/d30/d36/d53/f47 285597 0 2024-02-22T00:33:50.256 INFO:tasks.workunit.client.0.smithi049.stdout:6/268: creat d3/f62 x:0 0 0 2024-02-22T00:33:50.261 INFO:tasks.workunit.client.0.smithi049.stdout:1/276: chown d2/d8/db/f26 1128 1 2024-02-22T00:33:50.263 INFO:tasks.workunit.client.0.smithi049.stdout:8/235: creat d1/d4c/f55 x:0 0 0 2024-02-22T00:33:50.265 INFO:tasks.workunit.client.0.smithi049.stdout:3/130: dwrite d0/fc [4194304,4194304] 0 2024-02-22T00:33:50.269 INFO:tasks.workunit.client.0.smithi049.stdout:7/269: dwrite d1/df/f16 [4194304,4194304] 0 2024-02-22T00:33:50.270 INFO:tasks.workunit.client.0.smithi049.stdout:4/329: symlink d3/d8/d10/l6b 0 2024-02-22T00:33:50.270 INFO:tasks.workunit.client.0.smithi049.stdout:9/301: dread d17/d21/d4e/d4b/f5a [0,4194304] 0 2024-02-22T00:33:50.271 INFO:tasks.workunit.client.0.smithi049.stdout:2/345: dread d2/d9/f5c [0,4194304] 0 2024-02-22T00:33:50.273 INFO:tasks.workunit.client.0.smithi049.stdout:1/277: creat d2/d8/d4c/d5e/f65 x:0 0 0 2024-02-22T00:33:50.274 INFO:tasks.workunit.client.0.smithi049.stdout:0/273: truncate d3/f13 983686 0 2024-02-22T00:33:50.276 INFO:tasks.workunit.client.0.smithi049.stdout:0/274: write d3/d6/d29/f3f [9155530,96229] 0 2024-02-22T00:33:50.276 INFO:tasks.workunit.client.0.smithi049.stdout:3/131: unlink d0/l12 0 2024-02-22T00:33:50.277 INFO:tasks.workunit.client.0.smithi049.stdout:8/236: mkdir d1/d2/d5/d56 0 2024-02-22T00:33:50.279 INFO:tasks.workunit.client.0.smithi049.stdout:9/302: rmdir d17 39 2024-02-22T00:33:50.280 INFO:tasks.workunit.client.0.smithi049.stdout:7/270: write d1/df/d12/d1c/f2a [1639505,47803] 0 2024-02-22T00:33:50.281 INFO:tasks.workunit.client.0.smithi049.stdout:1/278: mkdir d2/d66 0 2024-02-22T00:33:50.281 INFO:tasks.workunit.client.0.smithi049.stdout:1/279: chown d2/d8/l3c 933016366 1 2024-02-22T00:33:50.282 INFO:tasks.workunit.client.0.smithi049.stdout:2/346: mknod d2/d9/de/d10/d46/d63/c7d 0 2024-02-22T00:33:50.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/347: read - d2/d9/de/d10/d2e/d42/f77 zero size 2024-02-22T00:33:50.285 INFO:tasks.workunit.client.0.smithi049.stdout:3/132: rename d0/d14/f17 to d0/dd/d1e/f24 0 2024-02-22T00:33:50.286 INFO:tasks.workunit.client.0.smithi049.stdout:8/237: mknod d1/d2/d5/d1b/d39/c57 0 2024-02-22T00:33:50.287 INFO:tasks.workunit.client.0.smithi049.stdout:3/133: chown d0/c5 213 1 2024-02-22T00:33:50.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:33:49.840322+0000 mon.smithi161 (mon.1) 64 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:33:50.293 INFO:tasks.workunit.client.0.smithi049.stdout:1/280: dwrite d2/d8/da/f4f [0,4194304] 0 2024-02-22T00:33:50.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/269: link d3/d16/d45/l5a d3/d16/d1f/d60/l63 0 2024-02-22T00:33:50.296 INFO:tasks.workunit.client.0.smithi049.stdout:8/238: mknod d1/c58 0 2024-02-22T00:33:50.298 INFO:tasks.workunit.client.0.smithi049.stdout:1/281: write d2/d8/d4c/f52 [548123,38412] 0 2024-02-22T00:33:50.301 INFO:tasks.workunit.client.0.smithi049.stdout:2/348: dwrite d2/d9/de/d10/d2e/f7c [0,4194304] 0 2024-02-22T00:33:50.303 INFO:tasks.workunit.client.0.smithi049.stdout:9/303: dread d17/f18 [0,4194304] 0 2024-02-22T00:33:50.306 INFO:tasks.workunit.client.0.smithi049.stdout:8/239: rmdir d1/d2/db/d15/d30/d36 39 2024-02-22T00:33:50.308 INFO:tasks.workunit.client.0.smithi049.stdout:6/270: write d3/d16/f4f [2728395,21136] 0 2024-02-22T00:33:50.308 INFO:tasks.workunit.client.0.smithi049.stdout:1/282: creat d2/d8/db/d25/d40/d4d/f67 x:0 0 0 2024-02-22T00:33:50.309 INFO:tasks.workunit.client.0.smithi049.stdout:7/271: dread d1/f6 [0,4194304] 0 2024-02-22T00:33:50.310 INFO:tasks.workunit.client.0.smithi049.stdout:9/304: truncate d17/d1c/d25/f60 684678 0 2024-02-22T00:33:50.311 INFO:tasks.workunit.client.0.smithi049.stdout:3/134: link d0/dd/l19 d0/l25 0 2024-02-22T00:33:50.312 INFO:tasks.workunit.client.0.smithi049.stdout:7/272: fsync d1/df/d12/f59 0 2024-02-22T00:33:50.312 INFO:tasks.workunit.client.0.smithi049.stdout:9/305: readlink d17/d21/d3c/l42 0 2024-02-22T00:33:50.313 INFO:tasks.workunit.client.0.smithi049.stdout:8/240: chown d1/d2/db/d15/d33/f4a 3 1 2024-02-22T00:33:50.317 INFO:tasks.workunit.client.0.smithi049.stdout:2/349: link d2/d9/de/d10/d2e/d42/f77 d2/d9/de/d10/d46/d63/f7e 0 2024-02-22T00:33:50.318 INFO:tasks.workunit.client.0.smithi049.stdout:3/135: mkdir d0/dd/d26 0 2024-02-22T00:33:50.319 INFO:tasks.workunit.client.0.smithi049.stdout:8/241: symlink d1/d2/db/d1c/l59 0 2024-02-22T00:33:50.320 INFO:tasks.workunit.client.0.smithi049.stdout:8/242: chown d1/d2/f31 261 1 2024-02-22T00:33:50.320 INFO:tasks.workunit.client.0.smithi049.stdout:0/275: truncate d3/f13 1284402 0 2024-02-22T00:33:50.321 INFO:tasks.workunit.client.0.smithi049.stdout:8/243: chown d1/d2/d5/d56 36536 1 2024-02-22T00:33:50.321 INFO:tasks.workunit.client.0.smithi049.stdout:2/350: fdatasync d2/d9/de/d15/d1b/f1f 0 2024-02-22T00:33:50.322 INFO:tasks.workunit.client.0.smithi049.stdout:0/276: write d3/df/d17/f24 [2428998,41086] 0 2024-02-22T00:33:50.324 INFO:tasks.workunit.client.0.smithi049.stdout:6/271: rename d3/d16/d1f to d3/d64 0 2024-02-22T00:33:50.324 INFO:tasks.workunit.client.0.smithi049.stdout:2/351: chown d2/d9/de/d15/l5f 2409975 1 2024-02-22T00:33:50.325 INFO:tasks.workunit.client.0.smithi049.stdout:3/136: chown d0/d14/c20 30542 1 2024-02-22T00:33:50.328 INFO:tasks.workunit.client.0.smithi049.stdout:7/273: symlink d1/df/d12/d1c/l5d 0 2024-02-22T00:33:50.331 INFO:tasks.workunit.client.0.smithi049.stdout:0/277: symlink d3/df/d17/d1b/l44 0 2024-02-22T00:33:50.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/306: truncate d17/d1c/d25/f53 2374760 0 2024-02-22T00:33:50.335 INFO:tasks.workunit.client.0.smithi049.stdout:7/274: creat d1/df/d12/d1c/d24/d2e/f5e x:0 0 0 2024-02-22T00:33:50.336 INFO:tasks.workunit.client.0.smithi049.stdout:8/244: mknod d1/d2/db/d15/d30/d4b/d51/c5a 0 2024-02-22T00:33:50.337 INFO:tasks.workunit.client.0.smithi049.stdout:7/275: write d1/df/d12/d1c/d24/f40 [337084,97303] 0 2024-02-22T00:33:50.337 INFO:tasks.workunit.client.0.smithi049.stdout:0/278: symlink d3/df/l45 0 2024-02-22T00:33:50.339 INFO:tasks.workunit.client.0.smithi049.stdout:2/352: truncate d2/d9/de/d10/d2e/d42/f43 1775000 0 2024-02-22T00:33:50.340 INFO:tasks.workunit.client.0.smithi049.stdout:8/245: mknod d1/d2/db/d1c/c5b 0 2024-02-22T00:33:50.342 INFO:tasks.workunit.client.0.smithi049.stdout:0/279: creat d3/d6/d8/f46 x:0 0 0 2024-02-22T00:33:50.343 INFO:tasks.workunit.client.0.smithi049.stdout:6/272: link d3/cc d3/d64/d60/c65 0 2024-02-22T00:33:50.344 INFO:tasks.workunit.client.0.smithi049.stdout:3/137: dread d0/d14/f21 [0,4194304] 0 2024-02-22T00:33:50.345 INFO:tasks.workunit.client.0.smithi049.stdout:9/307: link d17/d21/d3c/f40 d17/d21/d47/d5d/f6b 0 2024-02-22T00:33:50.345 INFO:tasks.workunit.client.0.smithi049.stdout:7/276: dread d1/df/f13 [0,4194304] 0 2024-02-22T00:33:50.347 INFO:tasks.workunit.client.0.smithi049.stdout:8/246: truncate d1/d2/d5/d1b/d39/f54 710934 0 2024-02-22T00:33:50.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/308: chown d17/d21/d3c/l42 246643717 1 2024-02-22T00:33:50.349 INFO:tasks.workunit.client.0.smithi049.stdout:3/138: creat d0/f27 x:0 0 0 2024-02-22T00:33:50.349 INFO:tasks.workunit.client.0.smithi049.stdout:6/273: dread d3/d16/f1c [0,4194304] 0 2024-02-22T00:33:50.352 INFO:tasks.workunit.client.0.smithi049.stdout:8/247: stat d1/d2/d5/d1b/f32 0 2024-02-22T00:33:50.352 INFO:tasks.workunit.client.0.smithi049.stdout:3/139: chown d0/dd/ff 13316 1 2024-02-22T00:33:50.353 INFO:tasks.workunit.client.0.smithi049.stdout:7/277: creat d1/f5f x:0 0 0 2024-02-22T00:33:50.356 INFO:tasks.workunit.client.0.smithi049.stdout:3/140: fdatasync d0/dd/f18 0 2024-02-22T00:33:50.356 INFO:tasks.workunit.client.0.smithi049.stdout:0/280: link d3/df/d17/l25 d3/d6/l47 0 2024-02-22T00:33:50.357 INFO:tasks.workunit.client.0.smithi049.stdout:7/278: fsync d1/d41/d28/f36 0 2024-02-22T00:33:50.359 INFO:tasks.workunit.client.0.smithi049.stdout:0/281: mkdir d3/df/d48 0 2024-02-22T00:33:50.359 INFO:tasks.workunit.client.0.smithi049.stdout:7/279: dread - d1/d49/f53 zero size 2024-02-22T00:33:50.360 INFO:tasks.workunit.client.0.smithi049.stdout:2/353: dread d2/d9/de/f2b [0,4194304] 0 2024-02-22T00:33:50.360 INFO:tasks.workunit.client.0.smithi049.stdout:3/141: mkdir d0/dd/d28 0 2024-02-22T00:33:50.363 INFO:tasks.workunit.client.0.smithi049.stdout:8/248: mknod d1/d2/d5/d56/c5c 0 2024-02-22T00:33:50.364 INFO:tasks.workunit.client.0.smithi049.stdout:0/282: creat d3/f49 x:0 0 0 2024-02-22T00:33:50.365 INFO:tasks.workunit.client.0.smithi049.stdout:9/309: dread f11 [0,4194304] 0 2024-02-22T00:33:50.365 INFO:tasks.workunit.client.0.smithi049.stdout:2/354: mkdir d2/d9/de/d10/d46/d7f 0 2024-02-22T00:33:50.368 INFO:tasks.workunit.client.0.smithi049.stdout:3/142: unlink d0/fc 0 2024-02-22T00:33:50.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/249: mknod d1/d2/d5/d1b/c5d 0 2024-02-22T00:33:50.370 INFO:tasks.workunit.client.0.smithi049.stdout:0/283: mknod d3/d1e/c4a 0 2024-02-22T00:33:50.371 INFO:tasks.workunit.client.0.smithi049.stdout:8/250: write d1/d2/f3 [1674099,61856] 0 2024-02-22T00:33:50.377 INFO:tasks.workunit.client.0.smithi049.stdout:2/355: mkdir d2/d9/de/d10/d2e/d42/d80 0 2024-02-22T00:33:50.377 INFO:tasks.workunit.client.0.smithi049.stdout:3/143: unlink d0/d14/c20 0 2024-02-22T00:33:50.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/274: dread d3/f1a [0,4194304] 0 2024-02-22T00:33:50.380 INFO:tasks.workunit.client.0.smithi049.stdout:8/251: mknod d1/d2/db/d15/d30/d4b/c5e 0 2024-02-22T00:33:50.381 INFO:tasks.workunit.client.0.smithi049.stdout:0/284: dwrite d3/df/d17/d1b/f31 [0,4194304] 0 2024-02-22T00:33:50.383 INFO:tasks.workunit.client.0.smithi049.stdout:3/144: stat d0/dd/l19 0 2024-02-22T00:33:50.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/275: rename d3/d16/d3b/d3d/f50 to d3/d64/d59/f66 0 2024-02-22T00:33:50.390 INFO:tasks.workunit.client.0.smithi049.stdout:0/285: creat d3/d6/d29/f4b x:0 0 0 2024-02-22T00:33:50.393 INFO:tasks.workunit.client.0.smithi049.stdout:2/356: fsync d2/d9/de/d10/d2e/d42/f43 0 2024-02-22T00:33:50.396 INFO:tasks.workunit.client.0.smithi049.stdout:8/252: creat d1/d2/db/d15/d30/d36/d53/f5f x:0 0 0 2024-02-22T00:33:50.399 INFO:tasks.workunit.client.0.smithi049.stdout:3/145: symlink d0/l29 0 2024-02-22T00:33:50.399 INFO:tasks.workunit.client.0.smithi049.stdout:7/280: truncate d1/df/d12/d1c/d24/f40 108750 0 2024-02-22T00:33:50.401 INFO:tasks.workunit.client.0.smithi049.stdout:6/276: symlink d3/d36/d57/l67 0 2024-02-22T00:33:50.402 INFO:tasks.workunit.client.0.smithi049.stdout:8/253: mkdir d1/d2/d5/d1b/d39/d60 0 2024-02-22T00:33:50.403 INFO:tasks.workunit.client.0.smithi049.stdout:7/281: stat d1/df/d12/d1c/d24/d2e/f42 0 2024-02-22T00:33:50.403 INFO:tasks.workunit.client.0.smithi049.stdout:9/310: dwrite d17/d21/d47/d5d/f6b [0,4194304] 0 2024-02-22T00:33:50.405 INFO:tasks.workunit.client.0.smithi049.stdout:6/277: rmdir d3/d16/d4a 39 2024-02-22T00:33:50.407 INFO:tasks.workunit.client.0.smithi049.stdout:8/254: symlink d1/d2/d5/d56/l61 0 2024-02-22T00:33:50.411 INFO:tasks.workunit.client.0.smithi049.stdout:3/146: dwrite d0/dd/ff [0,4194304] 0 2024-02-22T00:33:50.412 INFO:tasks.workunit.client.0.smithi049.stdout:6/278: creat d3/d16/d32/f68 x:0 0 0 2024-02-22T00:33:50.412 INFO:tasks.workunit.client.0.smithi049.stdout:9/311: creat d17/f6c x:0 0 0 2024-02-22T00:33:50.415 INFO:tasks.workunit.client.0.smithi049.stdout:7/282: mkdir d1/df/d12/d60 0 2024-02-22T00:33:50.418 INFO:tasks.workunit.client.0.smithi049.stdout:9/312: dread d17/d1c/d25/f60 [0,4194304] 0 2024-02-22T00:33:50.418 INFO:tasks.workunit.client.0.smithi049.stdout:6/279: truncate d3/f2a 480179 0 2024-02-22T00:33:50.419 INFO:tasks.workunit.client.0.smithi049.stdout:3/147: mknod d0/dd/d28/c2a 0 2024-02-22T00:33:50.420 INFO:tasks.workunit.client.0.smithi049.stdout:3/148: stat d0/dd/f13 0 2024-02-22T00:33:50.421 INFO:tasks.workunit.client.0.smithi049.stdout:8/255: link d1/d2/db/d15/d30/d4b/c5e d1/d2/db/c62 0 2024-02-22T00:33:50.423 INFO:tasks.workunit.client.0.smithi049.stdout:9/313: rename d17/d1c/d25 to d17/d1c/d25/d39/d67/d6d 22 2024-02-22T00:33:50.425 INFO:tasks.workunit.client.0.smithi049.stdout:6/280: getdents d3/d16/d45 0 2024-02-22T00:33:50.426 INFO:tasks.workunit.client.0.smithi049.stdout:3/149: read d0/dd/f18 [115265,99634] 0 2024-02-22T00:33:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:33:49.840322+0000 mon.smithi161 (mon.1) 64 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:33:50.428 INFO:tasks.workunit.client.0.smithi049.stdout:8/256: symlink d1/d2/db/d15/d30/l63 0 2024-02-22T00:33:50.428 INFO:tasks.workunit.client.0.smithi049.stdout:3/150: read - d0/d14/f1b zero size 2024-02-22T00:33:50.431 INFO:tasks.workunit.client.0.smithi049.stdout:6/281: mknod d3/c69 0 2024-02-22T00:33:50.431 INFO:tasks.workunit.client.0.smithi049.stdout:7/283: dwrite d1/df/f45 [0,4194304] 0 2024-02-22T00:33:50.433 INFO:tasks.workunit.client.0.smithi049.stdout:3/151: rmdir d0 39 2024-02-22T00:33:50.436 INFO:tasks.workunit.client.0.smithi049.stdout:6/282: creat d3/d64/f6a x:0 0 0 2024-02-22T00:33:50.437 INFO:tasks.workunit.client.0.smithi049.stdout:7/284: mknod d1/df/d12/d1c/d24/d2e/c61 0 2024-02-22T00:33:50.438 INFO:tasks.workunit.client.0.smithi049.stdout:8/257: mknod d1/d2/db/d15/d30/d36/d52/c64 0 2024-02-22T00:33:50.439 INFO:tasks.workunit.client.0.smithi049.stdout:3/152: chown d0/d14/l1f 82 1 2024-02-22T00:33:50.441 INFO:tasks.workunit.client.0.smithi049.stdout:6/283: read d3/d36/f4e [453539,78577] 0 2024-02-22T00:33:50.444 INFO:tasks.workunit.client.0.smithi049.stdout:6/284: fsync d3/f1d 0 2024-02-22T00:33:50.448 INFO:tasks.workunit.client.0.smithi049.stdout:6/285: read d3/d16/f30 [91284,18829] 0 2024-02-22T00:33:50.450 INFO:tasks.workunit.client.0.smithi049.stdout:7/285: rename d1/df/d12 to d1/df/d62 0 2024-02-22T00:33:50.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/314: dread d17/d21/f4f [0,4194304] 0 2024-02-22T00:33:50.452 INFO:tasks.workunit.client.0.smithi049.stdout:7/286: fdatasync d1/f3d 0 2024-02-22T00:33:50.453 INFO:tasks.workunit.client.0.smithi049.stdout:8/258: dwrite d1/d4c/f4f [0,4194304] 0 2024-02-22T00:33:50.453 INFO:tasks.workunit.client.0.smithi049.stdout:6/286: write d3/d16/d32/f5d [213327,64806] 0 2024-02-22T00:33:50.458 INFO:tasks.workunit.client.0.smithi049.stdout:6/287: creat d3/d64/d60/f6b x:0 0 0 2024-02-22T00:33:50.458 INFO:tasks.workunit.client.0.smithi049.stdout:3/153: dread d0/f6 [0,4194304] 0 2024-02-22T00:33:50.459 INFO:tasks.workunit.client.0.smithi049.stdout:9/315: rename d17/d21/d3c/c48 to d17/d1c/d38/c6e 0 2024-02-22T00:33:50.460 INFO:tasks.workunit.client.0.smithi049.stdout:7/287: creat d1/d41/f63 x:0 0 0 2024-02-22T00:33:50.468 INFO:tasks.workunit.client.0.smithi049.stdout:9/316: read d17/d21/d3c/f3d [313103,10566] 0 2024-02-22T00:33:50.468 INFO:tasks.workunit.client.0.smithi049.stdout:6/288: unlink d3/f6 0 2024-02-22T00:33:50.468 INFO:tasks.workunit.client.0.smithi049.stdout:9/317: fdatasync d17/d21/f43 0 2024-02-22T00:33:50.468 INFO:tasks.workunit.client.0.smithi049.stdout:7/288: dread d1/df/d62/d1c/d24/f40 [0,4194304] 0 2024-02-22T00:33:50.471 INFO:tasks.workunit.client.0.smithi049.stdout:6/289: fdatasync d3/f1a 0 2024-02-22T00:33:50.471 INFO:tasks.workunit.client.0.smithi049.stdout:7/289: chown d1/d41/f20 20344540 1 2024-02-22T00:33:50.471 INFO:tasks.workunit.client.0.smithi049.stdout:8/259: truncate d1/d2/db/f19 7322546 0 2024-02-22T00:33:50.472 INFO:tasks.workunit.client.0.smithi049.stdout:3/154: dwrite d0/dd/f3 [0,4194304] 0 2024-02-22T00:33:50.473 INFO:tasks.workunit.client.0.smithi049.stdout:9/318: symlink d17/d21/d4e/l6f 0 2024-02-22T00:33:50.477 INFO:tasks.workunit.client.0.smithi049.stdout:8/260: unlink d1/d2/l24 0 2024-02-22T00:33:50.478 INFO:tasks.workunit.client.0.smithi049.stdout:7/290: mknod d1/d41/d28/c64 0 2024-02-22T00:33:50.479 INFO:tasks.workunit.client.0.smithi049.stdout:6/290: mkdir d3/d16/d3b/d3d/d6c 0 2024-02-22T00:33:50.479 INFO:tasks.workunit.client.0.smithi049.stdout:3/155: dread d0/d14/f21 [0,4194304] 0 2024-02-22T00:33:50.482 INFO:tasks.workunit.client.0.smithi049.stdout:9/319: mknod d17/d21/d3c/c70 0 2024-02-22T00:33:50.483 INFO:tasks.workunit.client.0.smithi049.stdout:7/291: creat d1/df/d62/d57/f65 x:0 0 0 2024-02-22T00:33:50.485 INFO:tasks.workunit.client.0.smithi049.stdout:7/292: truncate d1/df/f4f 242295 0 2024-02-22T00:33:50.486 INFO:tasks.workunit.client.0.smithi049.stdout:6/291: mknod d3/d64/d5f/c6d 0 2024-02-22T00:33:50.488 INFO:tasks.workunit.client.0.smithi049.stdout:9/320: read d17/d21/d3c/f3f [879450,86660] 0 2024-02-22T00:33:50.489 INFO:tasks.workunit.client.0.smithi049.stdout:3/156: creat d0/dd/d26/f2b x:0 0 0 2024-02-22T00:33:50.491 INFO:tasks.workunit.client.0.smithi049.stdout:6/292: chown d3/d16/d4a/d4d 45131922 1 2024-02-22T00:33:50.492 INFO:tasks.workunit.client.0.smithi049.stdout:9/321: mkdir d17/d1c/d25/d71 0 2024-02-22T00:33:50.494 INFO:tasks.workunit.client.0.smithi049.stdout:3/157: mknod d0/dd/d28/c2c 0 2024-02-22T00:33:50.494 INFO:tasks.workunit.client.0.smithi049.stdout:6/293: dread d3/d16/f3c [0,4194304] 0 2024-02-22T00:33:50.497 INFO:tasks.workunit.client.0.smithi049.stdout:9/322: dread d17/d21/f28 [0,4194304] 0 2024-02-22T00:33:50.497 INFO:tasks.workunit.client.0.smithi049.stdout:7/293: creat d1/df/d62/f66 x:0 0 0 2024-02-22T00:33:50.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/323: fsync d17/d1c/f63 0 2024-02-22T00:33:50.501 INFO:tasks.workunit.client.0.smithi049.stdout:8/261: getdents d1/d2/d5 0 2024-02-22T00:33:50.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/294: chown d1/df/d62/d48/c5b 27195 1 2024-02-22T00:33:50.504 INFO:tasks.workunit.client.0.smithi049.stdout:9/324: symlink d17/l72 0 2024-02-22T00:33:50.505 INFO:tasks.workunit.client.0.smithi049.stdout:3/158: dread d0/dd/f13 [0,4194304] 0 2024-02-22T00:33:50.506 INFO:tasks.workunit.client.0.smithi049.stdout:6/294: dwrite d3/d16/d32/f42 [4194304,4194304] 0 2024-02-22T00:33:50.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/325: write d17/d1c/f2b [3868427,31550] 0 2024-02-22T00:33:50.508 INFO:tasks.workunit.client.0.smithi049.stdout:7/295: creat d1/df/d62/d1c/d1d/f67 x:0 0 0 2024-02-22T00:33:50.511 INFO:tasks.workunit.client.0.smithi049.stdout:3/159: symlink d0/l2d 0 2024-02-22T00:33:50.512 INFO:tasks.workunit.client.0.smithi049.stdout:6/295: mknod d3/d16/d3b/d3d/c6e 0 2024-02-22T00:33:50.515 INFO:tasks.workunit.client.0.smithi049.stdout:7/296: rename d1/df/d62/d1c/d1d/f67 to d1/d49/d4d/f68 0 2024-02-22T00:33:50.517 INFO:tasks.workunit.client.0.smithi049.stdout:3/160: mkdir d0/dd/d26/d2e 0 2024-02-22T00:33:50.518 INFO:tasks.workunit.client.0.smithi049.stdout:6/296: chown d3/d16/d3b/l3e 972477280 1 2024-02-22T00:33:50.520 INFO:tasks.workunit.client.0.smithi049.stdout:7/297: chown d1/df/d62/l4c 216880979 1 2024-02-22T00:33:50.522 INFO:tasks.workunit.client.0.smithi049.stdout:3/161: mkdir d0/dd/d2f 0 2024-02-22T00:33:50.523 INFO:tasks.workunit.client.0.smithi049.stdout:3/162: chown d0/dd/d28/c2c 1609986 1 2024-02-22T00:33:50.523 INFO:tasks.workunit.client.0.smithi049.stdout:3/163: stat d0/dd/l8 0 2024-02-22T00:33:50.525 INFO:tasks.workunit.client.0.smithi049.stdout:7/298: rename d1/d49/f50 to d1/df/d62/d57/f69 0 2024-02-22T00:33:50.527 INFO:tasks.workunit.client.0.smithi049.stdout:3/164: creat d0/dd/d26/f30 x:0 0 0 2024-02-22T00:33:50.531 INFO:tasks.workunit.client.0.smithi049.stdout:3/165: mknod d0/dd/d28/c31 0 2024-02-22T00:33:50.533 INFO:tasks.workunit.client.0.smithi049.stdout:7/299: getdents d1/d41/d28 0 2024-02-22T00:33:50.535 INFO:tasks.workunit.client.0.smithi049.stdout:6/297: dread d3/d16/f2c [0,4194304] 0 2024-02-22T00:33:50.535 INFO:tasks.workunit.client.0.smithi049.stdout:9/326: dwrite d17/d1c/d25/f60 [0,4194304] 0 2024-02-22T00:33:50.535 INFO:tasks.workunit.client.0.smithi049.stdout:3/166: rename d0/dd/d26 to d0/dd/d26/d32 22 2024-02-22T00:33:50.536 INFO:tasks.workunit.client.0.smithi049.stdout:9/327: fdatasync d17/d1c/f2c 0 2024-02-22T00:33:50.536 INFO:tasks.workunit.client.0.smithi049.stdout:6/298: chown d3/d64/c21 181912698 1 2024-02-22T00:33:50.537 INFO:tasks.workunit.client.0.smithi049.stdout:3/167: chown d0/dd/c1c 1 1 2024-02-22T00:33:50.539 INFO:tasks.workunit.client.0.smithi049.stdout:7/300: symlink d1/d41/l6a 0 2024-02-22T00:33:50.539 INFO:tasks.workunit.client.0.smithi049.stdout:6/299: truncate d3/d16/f4f 4604898 0 2024-02-22T00:33:50.540 INFO:tasks.workunit.client.0.smithi049.stdout:7/301: chown d1/d41/d28/l44 1913286989 1 2024-02-22T00:33:50.541 INFO:tasks.workunit.client.0.smithi049.stdout:9/328: mkdir d17/d1c/d25/d71/d73 0 2024-02-22T00:33:50.545 INFO:tasks.workunit.client.0.smithi049.stdout:9/329: write d17/d21/f30 [489729,64976] 0 2024-02-22T00:33:50.546 INFO:tasks.workunit.client.0.smithi049.stdout:3/168: dread d0/f6 [0,4194304] 0 2024-02-22T00:33:50.546 INFO:tasks.workunit.client.0.smithi049.stdout:9/330: truncate d17/f18 4712807 0 2024-02-22T00:33:50.549 INFO:tasks.workunit.client.0.smithi049.stdout:9/331: creat d17/d1c/d38/f74 x:0 0 0 2024-02-22T00:33:50.549 INFO:tasks.workunit.client.0.smithi049.stdout:3/169: mknod d0/dd/d2f/c33 0 2024-02-22T00:33:50.552 INFO:tasks.workunit.client.0.smithi049.stdout:3/170: chown d0/dd/f9 123 1 2024-02-22T00:33:50.555 INFO:tasks.workunit.client.0.smithi049.stdout:9/332: link d17/d1c/c37 d17/d21/d4e/d4b/c75 0 2024-02-22T00:33:50.557 INFO:tasks.workunit.client.0.smithi049.stdout:3/171: dread d0/dd/f3 [0,4194304] 0 2024-02-22T00:33:50.559 INFO:tasks.workunit.client.0.smithi049.stdout:7/302: truncate d1/df/d62/d1c/f2a 3009261 0 2024-02-22T00:33:50.560 INFO:tasks.workunit.client.0.smithi049.stdout:7/303: fdatasync d1/df/d62/f30 0 2024-02-22T00:33:50.561 INFO:tasks.workunit.client.0.smithi049.stdout:5/274: sync 2024-02-22T00:33:50.561 INFO:tasks.workunit.client.0.smithi049.stdout:6/300: dread d3/d64/f35 [0,4194304] 0 2024-02-22T00:33:50.561 INFO:tasks.workunit.client.0.smithi049.stdout:3/172: getdents d0/dd/d28 0 2024-02-22T00:33:50.564 INFO:tasks.workunit.client.0.smithi049.stdout:5/275: write d0/d20/d50/f36 [1002843,20352] 0 2024-02-22T00:33:50.565 INFO:tasks.workunit.client.0.smithi049.stdout:7/304: creat d1/df/d62/d60/f6b x:0 0 0 2024-02-22T00:33:50.567 INFO:tasks.workunit.client.0.smithi049.stdout:9/333: dread d17/d21/f50 [0,4194304] 0 2024-02-22T00:33:50.567 INFO:tasks.workunit.client.0.smithi049.stdout:3/173: dread d0/dd/ff [0,4194304] 0 2024-02-22T00:33:50.568 INFO:tasks.workunit.client.0.smithi049.stdout:5/276: creat d0/d39/f5e x:0 0 0 2024-02-22T00:33:50.570 INFO:tasks.workunit.client.0.smithi049.stdout:9/334: dread d17/d21/f50 [0,4194304] 0 2024-02-22T00:33:50.574 INFO:tasks.workunit.client.0.smithi049.stdout:9/335: symlink d17/d21/d47/d5d/l76 0 2024-02-22T00:33:50.575 INFO:tasks.workunit.client.0.smithi049.stdout:3/174: dwrite d0/f6 [0,4194304] 0 2024-02-22T00:33:50.577 INFO:tasks.workunit.client.0.smithi049.stdout:7/305: truncate d1/d41/f3e 5721363 0 2024-02-22T00:33:50.580 INFO:tasks.workunit.client.0.smithi049.stdout:9/336: unlink d17/l45 0 2024-02-22T00:33:50.581 INFO:tasks.workunit.client.0.smithi049.stdout:7/306: symlink d1/df/d62/d60/l6c 0 2024-02-22T00:33:50.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/337: write d17/d21/f33 [5011888,81347] 0 2024-02-22T00:33:50.585 INFO:tasks.workunit.client.0.smithi049.stdout:7/307: mkdir d1/df/d62/d1c/d6d 0 2024-02-22T00:33:50.585 INFO:tasks.workunit.client.0.smithi049.stdout:9/338: fdatasync d17/d21/f5c 0 2024-02-22T00:33:50.587 INFO:tasks.workunit.client.0.smithi049.stdout:3/175: dwrite d0/d14/f21 [4194304,4194304] 0 2024-02-22T00:33:50.592 INFO:tasks.workunit.client.0.smithi049.stdout:7/308: write d1/d41/d28/f36 [832660,81525] 0 2024-02-22T00:33:50.599 INFO:tasks.workunit.client.0.smithi049.stdout:9/339: dwrite d17/f1a [0,4194304] 0 2024-02-22T00:33:50.603 INFO:tasks.workunit.client.0.smithi049.stdout:3/176: dread d0/dd/f9 [4194304,4194304] 0 2024-02-22T00:33:50.611 INFO:tasks.workunit.client.0.smithi049.stdout:7/309: dwrite d1/d41/f63 [0,4194304] 0 2024-02-22T00:33:50.611 INFO:tasks.workunit.client.0.smithi049.stdout:3/177: creat d0/dd/d26/f34 x:0 0 0 2024-02-22T00:33:50.611 INFO:tasks.workunit.client.0.smithi049.stdout:7/310: mkdir d1/df/d62/d1c/d1d/d6e 0 2024-02-22T00:33:50.611 INFO:tasks.workunit.client.0.smithi049.stdout:9/340: dread d17/d1c/f1e [0,4194304] 0 2024-02-22T00:33:50.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/341: chown d17/d1c/d25/d39/c64 483041 1 2024-02-22T00:33:50.613 INFO:tasks.workunit.client.0.smithi049.stdout:3/178: symlink d0/dd/d26/l35 0 2024-02-22T00:33:50.615 INFO:tasks.workunit.client.0.smithi049.stdout:9/342: mkdir d17/d1c/d77 0 2024-02-22T00:33:50.621 INFO:tasks.workunit.client.0.smithi049.stdout:7/311: write d1/df/f13 [476901,80512] 0 2024-02-22T00:33:50.622 INFO:tasks.workunit.client.0.smithi049.stdout:3/179: dwrite d0/dd/f18 [0,4194304] 0 2024-02-22T00:33:50.624 INFO:tasks.workunit.client.0.smithi049.stdout:9/343: rename le to d17/d21/d3c/l78 0 2024-02-22T00:33:50.626 INFO:tasks.workunit.client.0.smithi049.stdout:7/312: rename d1/df/d62/d1c/d1d/d6e to d1/df/d62/d1c/d1d/d6e/d6f 22 2024-02-22T00:33:50.627 INFO:tasks.workunit.client.0.smithi049.stdout:9/344: fdatasync d17/d21/f62 0 2024-02-22T00:33:50.630 INFO:tasks.workunit.client.0.smithi049.stdout:3/180: dread d0/dd/ff [0,4194304] 0 2024-02-22T00:33:50.630 INFO:tasks.workunit.client.0.smithi049.stdout:9/345: symlink d17/d21/d47/d5d/l79 0 2024-02-22T00:33:50.631 INFO:tasks.workunit.client.0.smithi049.stdout:7/313: mkdir d1/df/d62/d1c/d1d/d70 0 2024-02-22T00:33:50.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/346: getdents d17/d21/d4e 0 2024-02-22T00:33:50.640 INFO:tasks.workunit.client.0.smithi049.stdout:3/181: dread d0/dd/ff [0,4194304] 0 2024-02-22T00:33:50.640 INFO:tasks.workunit.client.0.smithi049.stdout:3/182: readlink d0/l15 0 2024-02-22T00:33:50.640 INFO:tasks.workunit.client.0.smithi049.stdout:9/347: mkdir d17/d21/d47/d7a 0 2024-02-22T00:33:50.642 INFO:tasks.workunit.client.0.smithi049.stdout:3/183: rename d0/dd/d26/f34 to d0/dd/d28/f36 0 2024-02-22T00:33:50.642 INFO:tasks.workunit.client.0.smithi049.stdout:7/314: write d1/d41/f3e [6409695,11636] 0 2024-02-22T00:33:50.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/348: rename d17/d21/f62 to d17/d1c/d25/f7b 0 2024-02-22T00:33:50.645 INFO:tasks.workunit.client.0.smithi049.stdout:3/184: symlink d0/dd/d28/l37 0 2024-02-22T00:33:50.646 INFO:tasks.workunit.client.0.smithi049.stdout:7/315: mkdir d1/d41/d28/d71 0 2024-02-22T00:33:50.646 INFO:tasks.workunit.client.0.smithi049.stdout:9/349: write d17/d21/f5c [44122,32906] 0 2024-02-22T00:33:50.648 INFO:tasks.workunit.client.0.smithi049.stdout:3/185: creat d0/dd/d26/f38 x:0 0 0 2024-02-22T00:33:50.649 INFO:tasks.workunit.client.0.smithi049.stdout:3/186: read - d0/d14/f1b zero size 2024-02-22T00:33:50.650 INFO:tasks.workunit.client.0.smithi049.stdout:7/316: mkdir d1/d41/d28/d71/d72 0 2024-02-22T00:33:50.651 INFO:tasks.workunit.client.0.smithi049.stdout:7/317: stat d1/f4a 0 2024-02-22T00:33:50.653 INFO:tasks.workunit.client.0.smithi049.stdout:3/187: getdents d0/dd/d26/d2e 0 2024-02-22T00:33:50.653 INFO:tasks.workunit.client.0.smithi049.stdout:7/318: dread - d1/df/d62/d1c/d24/f4b zero size 2024-02-22T00:33:50.657 INFO:tasks.workunit.client.0.smithi049.stdout:7/319: getdents d1/df/d62/d60 0 2024-02-22T00:33:50.660 INFO:tasks.workunit.client.0.smithi049.stdout:3/188: dwrite d0/dd/ff [0,4194304] 0 2024-02-22T00:33:50.664 INFO:tasks.workunit.client.0.smithi049.stdout:3/189: unlink d0/dd/ff 0 2024-02-22T00:33:50.666 INFO:tasks.workunit.client.0.smithi049.stdout:7/320: rename d1/df/c21 to d1/df/d62/c73 0 2024-02-22T00:33:50.669 INFO:tasks.workunit.client.0.smithi049.stdout:7/321: creat d1/df/d62/d57/f74 x:0 0 0 2024-02-22T00:33:50.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/350: dread d17/d1c/d25/d39/f3a [0,4194304] 0 2024-02-22T00:33:50.672 INFO:tasks.workunit.client.0.smithi049.stdout:9/351: unlink d17/d21/f50 0 2024-02-22T00:33:50.674 INFO:tasks.workunit.client.0.smithi049.stdout:9/352: truncate d17/d21/f28 617175 0 2024-02-22T00:33:50.674 INFO:tasks.workunit.client.0.smithi049.stdout:9/353: fdatasync d17/d21/d4e/f4d 0 2024-02-22T00:33:50.675 INFO:tasks.workunit.client.0.smithi049.stdout:3/190: truncate d0/dd/f9 7887577 0 2024-02-22T00:33:50.677 INFO:tasks.workunit.client.0.smithi049.stdout:3/191: read - d0/dd/d26/f38 zero size 2024-02-22T00:33:50.677 INFO:tasks.workunit.client.0.smithi049.stdout:3/192: readlink d0/l25 0 2024-02-22T00:33:50.679 INFO:tasks.workunit.client.0.smithi049.stdout:7/322: truncate d1/fe 463796 0 2024-02-22T00:33:50.679 INFO:tasks.workunit.client.0.smithi049.stdout:3/193: mknod d0/dd/d26/c39 0 2024-02-22T00:33:50.682 INFO:tasks.workunit.client.0.smithi049.stdout:9/354: write d17/d1c/f1e [515856,78980] 0 2024-02-22T00:33:50.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/323: dwrite d1/f3d [0,4194304] 0 2024-02-22T00:33:50.693 INFO:tasks.workunit.client.0.smithi049.stdout:9/355: getdents d17/d1c/d38 0 2024-02-22T00:33:50.698 INFO:tasks.workunit.client.0.smithi049.stdout:7/324: dwrite d1/d49/f53 [0,4194304] 0 2024-02-22T00:33:50.702 INFO:tasks.workunit.client.0.smithi049.stdout:9/356: rename d17/d21/d3c/f40 to d17/d1c/d25/d39/d67/f7c 0 2024-02-22T00:33:50.708 INFO:tasks.workunit.client.0.smithi049.stdout:7/325: creat d1/d49/d4d/f75 x:0 0 0 2024-02-22T00:33:50.708 INFO:tasks.workunit.client.0.smithi049.stdout:3/194: dwrite d0/dd/d1e/f24 [4194304,4194304] 0 2024-02-22T00:33:50.711 INFO:tasks.workunit.client.0.smithi049.stdout:3/195: dread - d0/f27 zero size 2024-02-22T00:33:50.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/326: chown d1/d41/f3e 645104973 1 2024-02-22T00:33:50.715 INFO:tasks.workunit.client.0.smithi049.stdout:3/196: creat d0/d14/f3a x:0 0 0 2024-02-22T00:33:50.717 INFO:tasks.workunit.client.0.smithi049.stdout:9/357: dwrite d17/d1c/d25/f7b [0,4194304] 0 2024-02-22T00:33:50.719 INFO:tasks.workunit.client.0.smithi049.stdout:3/197: write d0/dd/f3 [2344128,84399] 0 2024-02-22T00:33:50.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/327: rename d1/f8 to d1/df/d62/d1c/d1d/d6e/f76 0 2024-02-22T00:33:50.727 INFO:tasks.workunit.client.0.smithi049.stdout:7/328: creat d1/df/f77 x:0 0 0 2024-02-22T00:33:50.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/198: dwrite d0/dd/d26/f38 [0,4194304] 0 2024-02-22T00:33:50.730 INFO:tasks.workunit.client.0.smithi049.stdout:7/329: write d1/df/d62/d57/f74 [508367,107481] 0 2024-02-22T00:33:50.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/199: link d0/dd/f18 d0/f3b 0 2024-02-22T00:33:50.737 INFO:tasks.workunit.client.0.smithi049.stdout:3/200: symlink d0/dd/l3c 0 2024-02-22T00:33:50.751 INFO:tasks.workunit.client.0.smithi049.stdout:3/201: dwrite d0/dd/f3 [0,4194304] 0 2024-02-22T00:33:50.751 INFO:tasks.workunit.client.0.smithi049.stdout:3/202: readlink d0/l29 0 2024-02-22T00:33:50.751 INFO:tasks.workunit.client.0.smithi049.stdout:3/203: truncate d0/f27 751156 0 2024-02-22T00:33:50.752 INFO:tasks.workunit.client.0.smithi049.stdout:4/330: sync 2024-02-22T00:33:50.752 INFO:tasks.workunit.client.0.smithi049.stdout:1/283: sync 2024-02-22T00:33:50.755 INFO:tasks.workunit.client.0.smithi049.stdout:1/284: chown d2/d8/db/d25/d40/f54 924879 1 2024-02-22T00:33:50.762 INFO:tasks.workunit.client.0.smithi049.stdout:4/331: dread d3/d8/f14 [0,4194304] 0 2024-02-22T00:33:50.762 INFO:tasks.workunit.client.0.smithi049.stdout:3/204: dwrite d0/f16 [0,4194304] 0 2024-02-22T00:33:50.765 INFO:tasks.workunit.client.0.smithi049.stdout:3/205: truncate d0/dd/d26/f30 599062 0 2024-02-22T00:33:50.766 INFO:tasks.workunit.client.0.smithi049.stdout:3/206: readlink d0/l25 0 2024-02-22T00:33:50.766 INFO:tasks.workunit.client.0.smithi049.stdout:4/332: mknod d3/d13/d48/c6c 0 2024-02-22T00:33:50.768 INFO:tasks.workunit.client.0.smithi049.stdout:3/207: rmdir d0/dd/d28 39 2024-02-22T00:33:50.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/333: rename d3/le to d3/d22/d5c/l6d 0 2024-02-22T00:33:50.777 INFO:tasks.workunit.client.0.smithi049.stdout:3/208: rename d0/dd/d28/l37 to d0/dd/d2f/l3d 0 2024-02-22T00:33:50.780 INFO:tasks.workunit.client.0.smithi049.stdout:4/334: mknod d3/d8/d10/c6e 0 2024-02-22T00:33:50.784 INFO:tasks.workunit.client.0.smithi049.stdout:3/209: mknod d0/c3e 0 2024-02-22T00:33:50.784 INFO:tasks.workunit.client.0.smithi049.stdout:4/335: symlink d3/d8/d10/d12/l6f 0 2024-02-22T00:33:50.784 INFO:tasks.workunit.client.0.smithi049.stdout:4/336: fsync d3/d8/d10/d12/f31 0 2024-02-22T00:33:50.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/337: symlink d3/d8/d10/d39/l70 0 2024-02-22T00:33:50.796 INFO:tasks.workunit.client.0.smithi049.stdout:3/210: dwrite d0/dd/d28/f36 [0,4194304] 0 2024-02-22T00:33:50.802 INFO:tasks.workunit.client.0.smithi049.stdout:1/285: dread d2/d8/db/f1c [0,4194304] 0 2024-02-22T00:33:50.809 INFO:tasks.workunit.client.0.smithi049.stdout:3/211: getdents d0/d14 0 2024-02-22T00:33:50.810 INFO:tasks.workunit.client.0.smithi049.stdout:1/286: fsync d2/d8/db/f57 0 2024-02-22T00:33:50.811 INFO:tasks.workunit.client.0.smithi049.stdout:3/212: write d0/d14/f1d [2052256,95595] 0 2024-02-22T00:33:50.812 INFO:tasks.workunit.client.0.smithi049.stdout:1/287: write d2/d8/da/f61 [177203,101860] 0 2024-02-22T00:33:50.812 INFO:tasks.workunit.client.0.smithi049.stdout:1/288: chown d2/f30 8600400 1 2024-02-22T00:33:50.815 INFO:tasks.workunit.client.0.smithi049.stdout:3/213: unlink d0/dd/f18 0 2024-02-22T00:33:50.817 INFO:tasks.workunit.client.0.smithi049.stdout:4/338: truncate d3/d8/d10/f5d 1808531 0 2024-02-22T00:33:50.818 INFO:tasks.workunit.client.0.smithi049.stdout:3/214: unlink d0/l15 0 2024-02-22T00:33:50.822 INFO:tasks.workunit.client.0.smithi049.stdout:4/339: symlink d3/d8/d10/d12/d3f/l71 0 2024-02-22T00:33:50.840 INFO:tasks.workunit.client.0.smithi049.stdout:3/215: dwrite d0/dd/d26/f2b [0,4194304] 0 2024-02-22T00:33:50.843 INFO:tasks.workunit.client.0.smithi049.stdout:1/289: dwrite d2/d8/db/d25/d40/d41/f60 [0,4194304] 0 2024-02-22T00:33:50.843 INFO:tasks.workunit.client.0.smithi049.stdout:4/340: dwrite d3/d8/d10/d12/f65 [0,4194304] 0 2024-02-22T00:33:50.847 INFO:tasks.workunit.client.0.smithi049.stdout:4/341: write d3/d22/f50 [752590,62579] 0 2024-02-22T00:33:50.854 INFO:tasks.workunit.client.0.smithi049.stdout:1/290: write d2/d8/db/d25/d40/f54 [718441,18388] 0 2024-02-22T00:33:50.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/342: dwrite d3/f4b [0,4194304] 0 2024-02-22T00:33:50.863 INFO:tasks.workunit.client.0.smithi049.stdout:4/343: mkdir d3/d8/d72 0 2024-02-22T00:33:50.868 INFO:tasks.workunit.client.0.smithi049.stdout:1/291: dwrite d2/d8/db/d25/d40/d41/f5c [0,4194304] 0 2024-02-22T00:33:50.873 INFO:tasks.workunit.client.0.smithi049.stdout:1/292: mkdir d2/d8/db/d25/d40/d41/d68 0 2024-02-22T00:33:50.878 INFO:tasks.workunit.client.0.smithi049.stdout:1/293: truncate d2/d8/db/d25/d40/f4b 437482 0 2024-02-22T00:33:50.879 INFO:tasks.workunit.client.0.smithi049.stdout:4/344: dwrite d3/d8/d10/f15 [0,4194304] 0 2024-02-22T00:33:50.881 INFO:tasks.workunit.client.0.smithi049.stdout:1/294: mkdir d2/d69 0 2024-02-22T00:33:50.882 INFO:tasks.workunit.client.0.smithi049.stdout:1/295: write d2/d8/db/d25/f2c [595330,111010] 0 2024-02-22T00:33:50.884 INFO:tasks.workunit.client.0.smithi049.stdout:1/296: fdatasync d2/d8/da/f61 0 2024-02-22T00:33:50.887 INFO:tasks.workunit.client.0.smithi049.stdout:3/216: dread d0/d14/f1d [0,4194304] 0 2024-02-22T00:33:50.889 INFO:tasks.workunit.client.0.smithi049.stdout:1/297: creat d2/d8/f6a x:0 0 0 2024-02-22T00:33:50.890 INFO:tasks.workunit.client.0.smithi049.stdout:3/217: chown d0/dd/d1e/f24 3853301 1 2024-02-22T00:33:50.891 INFO:tasks.workunit.client.0.smithi049.stdout:1/298: symlink d2/d8/d4c/d5e/l6b 0 2024-02-22T00:33:50.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/299: rename d2/d8/da/fd to d2/f6c 0 2024-02-22T00:33:50.898 INFO:tasks.workunit.client.0.smithi049.stdout:3/218: truncate d0/dd/f13 3878751 0 2024-02-22T00:33:50.898 INFO:tasks.workunit.client.0.smithi049.stdout:4/345: dwrite d3/d8/d10/d45/f55 [0,4194304] 0 2024-02-22T00:33:50.900 INFO:tasks.workunit.client.0.smithi049.stdout:4/346: fdatasync d3/d33/f67 0 2024-02-22T00:33:50.900 INFO:tasks.workunit.client.0.smithi049.stdout:1/300: read d2/d8/db/d25/d40/f4b [396873,95674] 0 2024-02-22T00:33:50.900 INFO:tasks.workunit.client.0.smithi049.stdout:3/219: mknod d0/c3f 0 2024-02-22T00:33:50.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/347: write d3/d8/d10/d12/f38 [5239405,127021] 0 2024-02-22T00:33:50.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/220: getdents d0/dd/d26/d2e 0 2024-02-22T00:33:50.904 INFO:tasks.workunit.client.0.smithi049.stdout:4/348: chown d3/d8/d10/d39 6 1 2024-02-22T00:33:50.906 INFO:tasks.workunit.client.0.smithi049.stdout:4/349: stat d3/d8/d10/d12/f31 0 2024-02-22T00:33:50.909 INFO:tasks.workunit.client.0.smithi049.stdout:2/357: sync 2024-02-22T00:33:50.909 INFO:tasks.workunit.client.0.smithi049.stdout:0/286: sync 2024-02-22T00:33:50.909 INFO:tasks.workunit.client.0.smithi049.stdout:8/262: sync 2024-02-22T00:33:50.910 INFO:tasks.workunit.client.0.smithi049.stdout:4/350: readlink d3/d22/d5c/l27 0 2024-02-22T00:33:50.913 INFO:tasks.workunit.client.0.smithi049.stdout:8/263: fdatasync d1/d2/d5/f34 0 2024-02-22T00:33:50.913 INFO:tasks.workunit.client.0.smithi049.stdout:3/221: dwrite d0/dd/f3 [0,4194304] 0 2024-02-22T00:33:50.915 INFO:tasks.workunit.client.0.smithi049.stdout:2/358: readlink d2/d9/de/l48 0 2024-02-22T00:33:50.915 INFO:tasks.workunit.client.0.smithi049.stdout:1/301: truncate d2/d8/db/d25/f2c 2723552 0 2024-02-22T00:33:50.916 INFO:tasks.workunit.client.0.smithi049.stdout:0/287: mknod d3/d6/d8/c4c 0 2024-02-22T00:33:50.919 INFO:tasks.workunit.client.0.smithi049.stdout:4/351: symlink d3/d8/d10/d43/l73 0 2024-02-22T00:33:50.919 INFO:tasks.workunit.client.0.smithi049.stdout:3/222: truncate d0/dd/d26/f2b 5159006 0 2024-02-22T00:33:50.920 INFO:tasks.workunit.client.0.smithi049.stdout:2/359: dread - d2/d9/de/d3a/f54 zero size 2024-02-22T00:33:50.921 INFO:tasks.workunit.client.0.smithi049.stdout:8/264: fsync d1/d2/d5/d1b/f32 0 2024-02-22T00:33:50.926 INFO:tasks.workunit.client.0.smithi049.stdout:1/302: rename d2/d8/db/d25/d40/d41/c5f to d2/c6d 0 2024-02-22T00:33:50.928 INFO:tasks.workunit.client.0.smithi049.stdout:1/303: read d2/f6c [1918888,70343] 0 2024-02-22T00:33:50.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/352: symlink d3/d22/l74 0 2024-02-22T00:33:50.930 INFO:tasks.workunit.client.0.smithi049.stdout:2/360: unlink d2/d9/d17/c40 0 2024-02-22T00:33:50.931 INFO:tasks.workunit.client.0.smithi049.stdout:8/265: mkdir d1/d2/db/d15/d65 0 2024-02-22T00:33:50.934 INFO:tasks.workunit.client.0.smithi049.stdout:0/288: dread d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:50.935 INFO:tasks.workunit.client.0.smithi049.stdout:3/223: fdatasync d0/dd/f13 0 2024-02-22T00:33:50.938 INFO:tasks.workunit.client.0.smithi049.stdout:8/266: write d1/d2/f27 [3440820,37430] 0 2024-02-22T00:33:50.938 INFO:tasks.workunit.client.0.smithi049.stdout:3/224: dread - d0/d14/f3a zero size 2024-02-22T00:33:50.939 INFO:tasks.workunit.client.0.smithi049.stdout:2/361: creat d2/d9/de/d10/d2e/d42/d80/f81 x:0 0 0 2024-02-22T00:33:50.941 INFO:tasks.workunit.client.0.smithi049.stdout:8/267: fdatasync d1/d2/d5/f34 0 2024-02-22T00:33:50.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/304: dwrite d2/d8/db/d25/d40/d4d/f67 [0,4194304] 0 2024-02-22T00:33:50.943 INFO:tasks.workunit.client.0.smithi049.stdout:4/353: truncate d3/d8/f1a 2816465 0 2024-02-22T00:33:50.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/305: dwrite d2/d8/db/d25/f48 [0,4194304] 0 2024-02-22T00:33:50.954 INFO:tasks.workunit.client.0.smithi049.stdout:8/268: rename d1/d2/db/c62 to d1/d2/db/d15/d65/c66 0 2024-02-22T00:33:50.957 INFO:tasks.workunit.client.0.smithi049.stdout:0/289: truncate d3/df/f2b 1771925 0 2024-02-22T00:33:50.959 INFO:tasks.workunit.client.0.smithi049.stdout:4/354: mknod d3/d22/d5c/d5e/c75 0 2024-02-22T00:33:50.961 INFO:tasks.workunit.client.0.smithi049.stdout:3/225: link d0/dd/d28/c31 d0/c40 0 2024-02-22T00:33:50.963 INFO:tasks.workunit.client.0.smithi049.stdout:8/269: write d1/d2/f3 [76980,110025] 0 2024-02-22T00:33:50.965 INFO:tasks.workunit.client.0.smithi049.stdout:4/355: creat d3/d22/d51/f76 x:0 0 0 2024-02-22T00:33:50.966 INFO:tasks.workunit.client.0.smithi049.stdout:3/226: mknod d0/dd/d2f/c41 0 2024-02-22T00:33:50.967 INFO:tasks.workunit.client.0.smithi049.stdout:2/362: truncate d2/d9/de/f57 3155670 0 2024-02-22T00:33:50.973 INFO:tasks.workunit.client.0.smithi049.stdout:3/227: creat d0/dd/d2f/f42 x:0 0 0 2024-02-22T00:33:50.975 INFO:tasks.workunit.client.0.smithi049.stdout:6/301: sync 2024-02-22T00:33:50.976 INFO:tasks.workunit.client.0.smithi049.stdout:9/358: sync 2024-02-22T00:33:50.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/277: sync 2024-02-22T00:33:50.976 INFO:tasks.workunit.client.0.smithi049.stdout:1/306: dwrite d2/d8/da/f1e [0,4194304] 0 2024-02-22T00:33:50.977 INFO:tasks.workunit.client.0.smithi049.stdout:2/363: mknod d2/d9/d17/c82 0 2024-02-22T00:33:50.980 INFO:tasks.workunit.client.0.smithi049.stdout:0/290: dwrite d3/df/d17/f2f [0,4194304] 0 2024-02-22T00:33:50.981 INFO:tasks.workunit.client.0.smithi049.stdout:6/302: chown d3/d16/d3b 1101199539 1 2024-02-22T00:33:50.982 INFO:tasks.workunit.client.0.smithi049.stdout:3/228: chown d0/dd/l19 648469 1 2024-02-22T00:33:50.987 INFO:tasks.workunit.client.0.smithi049.stdout:4/356: truncate d3/d8/d10/f5d 2433706 0 2024-02-22T00:33:50.988 INFO:tasks.workunit.client.0.smithi049.stdout:3/229: fsync d0/d14/f1b 0 2024-02-22T00:33:50.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/364: creat d2/d9/d17/f83 x:0 0 0 2024-02-22T00:33:50.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/303: mknod d3/d36/d57/c6f 0 2024-02-22T00:33:50.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/307: write d2/d8/db/d25/d40/d4d/f67 [2347207,127527] 0 2024-02-22T00:33:50.996 INFO:tasks.workunit.client.0.smithi049.stdout:3/230: unlink d0/d14/f3a 0 2024-02-22T00:33:51.001 INFO:tasks.workunit.client.0.smithi049.stdout:6/304: truncate d3/f1d 303559 0 2024-02-22T00:33:51.003 INFO:tasks.workunit.client.0.smithi049.stdout:9/359: dwrite d17/d1c/f2c [0,4194304] 0 2024-02-22T00:33:51.004 INFO:tasks.workunit.client.0.smithi049.stdout:8/270: dwrite d1/d2/d5/f18 [0,4194304] 0 2024-02-22T00:33:51.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/308: mknod d2/d8/da/c6e 0 2024-02-22T00:33:51.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/309: creat d2/d8/db/f6f x:0 0 0 2024-02-22T00:33:51.015 INFO:tasks.workunit.client.0.smithi049.stdout:9/360: rename d17/d21/f4f to d17/d1c/d25/d71/f7d 0 2024-02-22T00:33:51.018 INFO:tasks.workunit.client.0.smithi049.stdout:0/291: dwrite d3/df/d17/f20 [0,4194304] 0 2024-02-22T00:33:51.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/357: dread d3/d8/d10/d12/f65 [0,4194304] 0 2024-02-22T00:33:51.019 INFO:tasks.workunit.client.0.smithi049.stdout:2/365: truncate d2/d9/de/d10/f12 2106543 0 2024-02-22T00:33:51.021 INFO:tasks.workunit.client.0.smithi049.stdout:6/305: getdents d3/d64/d59 0 2024-02-22T00:33:51.022 INFO:tasks.workunit.client.0.smithi049.stdout:0/292: chown d3/df/f11 2404276 1 2024-02-22T00:33:51.022 INFO:tasks.workunit.client.0.smithi049.stdout:4/358: readlink d3/d8/d10/l6b 0 2024-02-22T00:33:51.023 INFO:tasks.workunit.client.0.smithi049.stdout:8/271: getdents d1/d2/db/d15 0 2024-02-22T00:33:51.023 INFO:tasks.workunit.client.0.smithi049.stdout:7/330: sync 2024-02-22T00:33:51.026 INFO:tasks.workunit.client.0.smithi049.stdout:6/306: fdatasync d3/d16/d45/f49 0 2024-02-22T00:33:51.026 INFO:tasks.workunit.client.0.smithi049.stdout:1/310: mknod d2/d8/da/c70 0 2024-02-22T00:33:51.032 INFO:tasks.workunit.client.0.smithi049.stdout:5/278: dread d0/d39/d6/f13 [0,4194304] 0 2024-02-22T00:33:51.033 INFO:tasks.workunit.client.0.smithi049.stdout:3/231: dwrite d0/d14/f1d [0,4194304] 0 2024-02-22T00:33:51.034 INFO:tasks.workunit.client.0.smithi049.stdout:6/307: mkdir d3/d36/d70 0 2024-02-22T00:33:51.034 INFO:tasks.workunit.client.0.smithi049.stdout:2/366: chown d2/d9/de/d10/d59 470926 1 2024-02-22T00:33:51.035 INFO:tasks.workunit.client.0.smithi049.stdout:7/331: mknod d1/df/d62/d48/c78 0 2024-02-22T00:33:51.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/311: mkdir d2/d8/db/d25/d40/d71 0 2024-02-22T00:33:51.039 INFO:tasks.workunit.client.0.smithi049.stdout:5/279: dread - d0/f4e zero size 2024-02-22T00:33:51.042 INFO:tasks.workunit.client.0.smithi049.stdout:2/367: dread - d2/d9/de/d3a/f61 zero size 2024-02-22T00:33:51.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/332: chown d1/f3d 893320058 1 2024-02-22T00:33:51.044 INFO:tasks.workunit.client.0.smithi049.stdout:8/272: dread d1/d2/db/d15/f10 [0,4194304] 0 2024-02-22T00:33:51.048 INFO:tasks.workunit.client.0.smithi049.stdout:6/308: creat d3/d16/d32/f71 x:0 0 0 2024-02-22T00:33:51.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/312: write d2/d8/db/d25/d40/f54 [771296,118806] 0 2024-02-22T00:33:51.050 INFO:tasks.workunit.client.0.smithi049.stdout:7/333: unlink d1/f6 0 2024-02-22T00:33:51.052 INFO:tasks.workunit.client.0.smithi049.stdout:5/280: mknod d0/d20/d50/d24/c5f 0 2024-02-22T00:33:51.053 INFO:tasks.workunit.client.0.smithi049.stdout:8/273: symlink d1/d2/d5/l67 0 2024-02-22T00:33:51.054 INFO:tasks.workunit.client.0.smithi049.stdout:0/293: dwrite d3/df/d17/f24 [4194304,4194304] 0 2024-02-22T00:33:51.055 INFO:tasks.workunit.client.0.smithi049.stdout:1/313: readlink d2/d8/db/l46 0 2024-02-22T00:33:51.057 INFO:tasks.workunit.client.0.smithi049.stdout:6/309: mkdir d3/d64/d59/d72 0 2024-02-22T00:33:51.057 INFO:tasks.workunit.client.0.smithi049.stdout:9/361: dread d17/d21/f30 [0,4194304] 0 2024-02-22T00:33:51.058 INFO:tasks.workunit.client.0.smithi049.stdout:4/359: dwrite d3/d8/d10/f11 [0,4194304] 0 2024-02-22T00:33:51.060 INFO:tasks.workunit.client.0.smithi049.stdout:2/368: symlink d2/d9/de/d10/d2e/d42/d80/l84 0 2024-02-22T00:33:51.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/334: creat d1/d41/d28/f79 x:0 0 0 2024-02-22T00:33:51.064 INFO:tasks.workunit.client.0.smithi049.stdout:0/294: chown d3/df/d17/c1d 245 1 2024-02-22T00:33:51.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/232: dwrite d0/d14/f1d [0,4194304] 0 2024-02-22T00:33:51.071 INFO:tasks.workunit.client.0.smithi049.stdout:7/335: mkdir d1/df/d62/d7a 0 2024-02-22T00:33:51.071 INFO:tasks.workunit.client.0.smithi049.stdout:4/360: fsync d3/d8/d10/d39/f37 0 2024-02-22T00:33:51.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/295: unlink d3/d1e/c4a 0 2024-02-22T00:33:51.073 INFO:tasks.workunit.client.0.smithi049.stdout:2/369: mknod d2/d9/de/d3a/c85 0 2024-02-22T00:33:51.074 INFO:tasks.workunit.client.0.smithi049.stdout:7/336: dread - d1/df/d62/d1c/d24/f32 zero size 2024-02-22T00:33:51.076 INFO:tasks.workunit.client.0.smithi049.stdout:8/274: rename d1/d2/d5/c17 to d1/d2/db/d15/d30/d36/d52/c68 0 2024-02-22T00:33:51.077 INFO:tasks.workunit.client.0.smithi049.stdout:3/233: mknod d0/dd/d26/c43 0 2024-02-22T00:33:51.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/310: dwrite d3/d16/f25 [0,4194304] 0 2024-02-22T00:33:51.078 INFO:tasks.workunit.client.0.smithi049.stdout:7/337: readlink d1/df/d62/d48/l54 0 2024-02-22T00:33:51.080 INFO:tasks.workunit.client.0.smithi049.stdout:5/281: truncate d0/d39/f41 512601 0 2024-02-22T00:33:51.083 INFO:tasks.workunit.client.0.smithi049.stdout:3/234: chown d0/dd/f13 7463 1 2024-02-22T00:33:51.084 INFO:tasks.workunit.client.0.smithi049.stdout:2/370: write d2/d9/de/d10/d2e/f49 [1390040,64063] 0 2024-02-22T00:33:51.086 INFO:tasks.workunit.client.0.smithi049.stdout:5/282: rename d0/d20/d50/d24/c5f to d0/d20/d50/d24/d54/c60 0 2024-02-22T00:33:51.089 INFO:tasks.workunit.client.0.smithi049.stdout:6/311: creat d3/d16/d32/f73 x:0 0 0 2024-02-22T00:33:51.093 INFO:tasks.workunit.client.0.smithi049.stdout:3/235: creat d0/dd/d26/d2e/f44 x:0 0 0 2024-02-22T00:33:51.093 INFO:tasks.workunit.client.0.smithi049.stdout:5/283: chown d0/d20/d50/d24/l45 304213 1 2024-02-22T00:33:51.095 INFO:tasks.workunit.client.0.smithi049.stdout:0/296: dwrite d3/df/d17/d1b/f31 [0,4194304] 0 2024-02-22T00:33:51.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/371: mknod d2/d9/de/d10/d2e/d42/d80/c86 0 2024-02-22T00:33:51.098 INFO:tasks.workunit.client.0.smithi049.stdout:3/236: write d0/dd/d26/f38 [1926072,57289] 0 2024-02-22T00:33:51.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/312: rename d3/d36/d57/l67 to d3/d37/l74 0 2024-02-22T00:33:51.104 INFO:tasks.workunit.client.0.smithi049.stdout:7/338: dwrite d1/df/f45 [0,4194304] 0 2024-02-22T00:33:51.104 INFO:tasks.workunit.client.0.smithi049.stdout:4/361: dread d3/d8/f1a [0,4194304] 0 2024-02-22T00:33:51.112 INFO:tasks.workunit.client.0.smithi049.stdout:4/362: creat d3/d22/d5c/f77 x:0 0 0 2024-02-22T00:33:51.112 INFO:tasks.workunit.client.0.smithi049.stdout:5/284: dwrite d0/d20/d50/f38 [0,4194304] 0 2024-02-22T00:33:51.115 INFO:tasks.workunit.client.0.smithi049.stdout:7/339: getdents d1 0 2024-02-22T00:33:51.120 INFO:tasks.workunit.client.0.smithi049.stdout:7/340: unlink d1/df/f77 0 2024-02-22T00:33:51.121 INFO:tasks.workunit.client.0.smithi049.stdout:7/341: fdatasync d1/f3d 0 2024-02-22T00:33:51.123 INFO:tasks.workunit.client.0.smithi049.stdout:5/285: creat d0/d39/f61 x:0 0 0 2024-02-22T00:33:51.124 INFO:tasks.workunit.client.0.smithi049.stdout:5/286: readlink d0/d20/l40 0 2024-02-22T00:33:51.128 INFO:tasks.workunit.client.0.smithi049.stdout:2/372: dread d2/d9/de/d10/d46/f68 [0,4194304] 0 2024-02-22T00:33:51.129 INFO:tasks.workunit.client.0.smithi049.stdout:7/342: creat d1/df/d62/d1c/d6d/f7b x:0 0 0 2024-02-22T00:33:51.130 INFO:tasks.workunit.client.0.smithi049.stdout:4/363: dread d3/d8/d10/f44 [0,4194304] 0 2024-02-22T00:33:51.132 INFO:tasks.workunit.client.0.smithi049.stdout:1/314: truncate d2/d8/db/d25/d40/d41/f5c 3583037 0 2024-02-22T00:33:51.133 INFO:tasks.workunit.client.0.smithi049.stdout:1/315: fsync d2/f4 0 2024-02-22T00:33:51.133 INFO:tasks.workunit.client.0.smithi049.stdout:7/343: chown d1/df/d62/d1c/d24/c51 466 1 2024-02-22T00:33:51.133 INFO:tasks.workunit.client.0.smithi049.stdout:2/373: rmdir d2/d9/de/d10/d46 39 2024-02-22T00:33:51.135 INFO:tasks.workunit.client.0.smithi049.stdout:4/364: symlink d3/d22/d49/l78 0 2024-02-22T00:33:51.139 INFO:tasks.workunit.client.0.smithi049.stdout:7/344: stat d1/df/d62/c2d 0 2024-02-22T00:33:51.140 INFO:tasks.workunit.client.0.smithi049.stdout:3/237: rmdir d0/dd/d26 39 2024-02-22T00:33:51.142 INFO:tasks.workunit.client.0.smithi049.stdout:7/345: readlink d1/d41/d28/l43 0 2024-02-22T00:33:51.143 INFO:tasks.workunit.client.0.smithi049.stdout:1/316: rename d2/d8/db/d25/d40/d4d/f67 to d2/d8/db/d25/d40/d4d/f72 0 2024-02-22T00:33:51.144 INFO:tasks.workunit.client.0.smithi049.stdout:5/287: dread d0/f32 [0,4194304] 0 2024-02-22T00:33:51.146 INFO:tasks.workunit.client.0.smithi049.stdout:8/275: dwrite d1/d2/db/d15/d33/f4a [0,4194304] 0 2024-02-22T00:33:51.147 INFO:tasks.workunit.client.0.smithi049.stdout:7/346: truncate d1/df/f45 4607708 0 2024-02-22T00:33:51.148 INFO:tasks.workunit.client.0.smithi049.stdout:2/374: creat d2/d9/de/d10/d46/d7f/f87 x:0 0 0 2024-02-22T00:33:51.148 INFO:tasks.workunit.client.0.smithi049.stdout:8/276: stat d1 0 2024-02-22T00:33:51.153 INFO:tasks.workunit.client.0.smithi049.stdout:4/365: getdents d3/d33 0 2024-02-22T00:33:51.153 INFO:tasks.workunit.client.0.smithi049.stdout:4/366: chown d3/d8/d10/f44 1299096 1 2024-02-22T00:33:51.154 INFO:tasks.workunit.client.0.smithi049.stdout:8/277: dread d1/d2/d5/f2c [0,4194304] 0 2024-02-22T00:33:51.154 INFO:tasks.workunit.client.0.smithi049.stdout:7/347: creat d1/df/d62/d60/f7c x:0 0 0 2024-02-22T00:33:51.160 INFO:tasks.workunit.client.0.smithi049.stdout:4/367: creat d3/d8/d10/d45/f79 x:0 0 0 2024-02-22T00:33:51.163 INFO:tasks.workunit.client.0.smithi049.stdout:8/278: rmdir d1/d2/d5/d1b/d39 39 2024-02-22T00:33:51.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/238: truncate d0/d14/f21 5125436 0 2024-02-22T00:33:51.169 INFO:tasks.workunit.client.0.smithi049.stdout:5/288: truncate d0/f4c 1989528 0 2024-02-22T00:33:51.170 INFO:tasks.workunit.client.0.smithi049.stdout:1/317: rename d2/d8/db/d25/d40/d41/f5c to d2/d8/db/d25/d40/d41/f73 0 2024-02-22T00:33:51.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/348: creat d1/df/d62/d1c/f7d x:0 0 0 2024-02-22T00:33:51.173 INFO:tasks.workunit.client.0.smithi049.stdout:5/289: chown d0/d20/d50/d24/d54 2334 1 2024-02-22T00:33:51.177 INFO:tasks.workunit.client.0.smithi049.stdout:7/349: stat d1/df/l56 0 2024-02-22T00:33:51.179 INFO:tasks.workunit.client.0.smithi049.stdout:2/375: dwrite d2/d9/de/d15/f4b [4194304,4194304] 0 2024-02-22T00:33:51.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/318: unlink d2/d8/da/c36 0 2024-02-22T00:33:51.183 INFO:tasks.workunit.client.0.smithi049.stdout:5/290: fsync d0/d20/d50/f36 0 2024-02-22T00:33:51.185 INFO:tasks.workunit.client.0.smithi049.stdout:2/376: readlink d2/l24 0 2024-02-22T00:33:51.187 INFO:tasks.workunit.client.0.smithi049.stdout:8/279: dwrite d1/d2/db/d15/f10 [0,4194304] 0 2024-02-22T00:33:51.191 INFO:tasks.workunit.client.0.smithi049.stdout:7/350: mkdir d1/df/d62/d60/d7e 0 2024-02-22T00:33:51.192 INFO:tasks.workunit.client.0.smithi049.stdout:4/368: dwrite d3/d8/f1a [0,4194304] 0 2024-02-22T00:33:51.199 INFO:tasks.workunit.client.0.smithi049.stdout:3/239: dread d0/f16 [0,4194304] 0 2024-02-22T00:33:51.208 INFO:tasks.workunit.client.0.smithi049.stdout:3/240: fdatasync d0/f6 0 2024-02-22T00:33:51.210 INFO:tasks.workunit.client.0.smithi049.stdout:1/319: creat d2/d8/f74 x:0 0 0 2024-02-22T00:33:51.210 INFO:tasks.workunit.client.0.smithi049.stdout:2/377: getdents d2/d9/dd/d4d/d5a 0 2024-02-22T00:33:51.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/280: dread d1/f1e [0,4194304] 0 2024-02-22T00:33:51.211 INFO:tasks.workunit.client.0.smithi049.stdout:4/369: getdents d3/d8/d72 0 2024-02-22T00:33:51.213 INFO:tasks.workunit.client.0.smithi049.stdout:7/351: dread d1/df/d62/f30 [0,4194304] 0 2024-02-22T00:33:51.214 INFO:tasks.workunit.client.0.smithi049.stdout:5/291: dwrite d0/f1d [0,4194304] 0 2024-02-22T00:33:51.215 INFO:tasks.workunit.client.0.smithi049.stdout:8/281: chown d1/d2/f27 191 1 2024-02-22T00:33:51.216 INFO:tasks.workunit.client.0.smithi049.stdout:3/241: mknod d0/dd/d26/c45 0 2024-02-22T00:33:51.217 INFO:tasks.workunit.client.0.smithi049.stdout:1/320: write d2/d8/db/f57 [1125470,82166] 0 2024-02-22T00:33:51.219 INFO:tasks.workunit.client.0.smithi049.stdout:2/378: symlink d2/d9/dd/l88 0 2024-02-22T00:33:51.223 INFO:tasks.workunit.client.0.smithi049.stdout:4/370: dread d3/d8/d10/f44 [0,4194304] 0 2024-02-22T00:33:51.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/379: chown d2/d9/de/d3a/d6d/l71 3880 1 2024-02-22T00:33:51.224 INFO:tasks.workunit.client.0.smithi049.stdout:4/371: chown d3/d22/d5c/d35/f58 244 1 2024-02-22T00:33:51.225 INFO:tasks.workunit.client.0.smithi049.stdout:2/380: dread - d2/d9/de/d10/d2e/d42/d80/f81 zero size 2024-02-22T00:33:51.226 INFO:tasks.workunit.client.0.smithi049.stdout:1/321: mkdir d2/d8/db/d25/d40/d41/d5b/d75 0 2024-02-22T00:33:51.227 INFO:tasks.workunit.client.0.smithi049.stdout:2/381: write d2/d9/de/d10/f31 [3439369,22670] 0 2024-02-22T00:33:51.228 INFO:tasks.workunit.client.0.smithi049.stdout:7/352: getdents d1/df/d62/d1c/d1d 0 2024-02-22T00:33:51.230 INFO:tasks.workunit.client.0.smithi049.stdout:2/382: readlink d2/d9/de/d15/l1a 0 2024-02-22T00:33:51.231 INFO:tasks.workunit.client.0.smithi049.stdout:4/372: creat d3/d8/d20/f7a x:0 0 0 2024-02-22T00:33:51.231 INFO:tasks.workunit.client.0.smithi049.stdout:5/292: link d0/d20/d50/l56 d0/l62 0 2024-02-22T00:33:51.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/383: readlink d2/l24 0 2024-02-22T00:33:51.232 INFO:tasks.workunit.client.0.smithi049.stdout:4/373: chown d3/d8/d10/d12/d3f 2 1 2024-02-22T00:33:51.232 INFO:tasks.workunit.client.0.smithi049.stdout:1/322: dread d2/f31 [0,4194304] 0 2024-02-22T00:33:51.233 INFO:tasks.workunit.client.0.smithi049.stdout:2/384: dread - d2/d9/de/d3a/f61 zero size 2024-02-22T00:33:51.234 INFO:tasks.workunit.client.0.smithi049.stdout:3/242: rename d0/f27 to d0/dd/f46 0 2024-02-22T00:33:51.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/374: read - d3/d8/d20/f7a zero size 2024-02-22T00:33:51.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/323: chown d2/d8/db/f12 58 1 2024-02-22T00:33:51.236 INFO:tasks.workunit.client.0.smithi049.stdout:8/282: link d1/d2/d5/d1b/d39/c57 d1/d2/d5/d1b/d39/d60/c69 0 2024-02-22T00:33:51.239 INFO:tasks.workunit.client.0.smithi049.stdout:2/385: creat d2/d9/dd/d4d/f89 x:0 0 0 2024-02-22T00:33:51.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/243: dread d0/dd/d26/f2b [0,4194304] 0 2024-02-22T00:33:51.244 INFO:tasks.workunit.client.0.smithi049.stdout:1/324: rmdir d2/d8 39 2024-02-22T00:33:51.246 INFO:tasks.workunit.client.0.smithi049.stdout:8/283: mkdir d1/d2/db/d15/d65/d6a 0 2024-02-22T00:33:51.247 INFO:tasks.workunit.client.0.smithi049.stdout:8/284: stat d1/d2/db/d15/d30/l63 0 2024-02-22T00:33:51.247 INFO:tasks.workunit.client.0.smithi049.stdout:5/293: creat d0/f63 x:0 0 0 2024-02-22T00:33:51.249 INFO:tasks.workunit.client.0.smithi049.stdout:8/285: truncate d1/f12 8474377 0 2024-02-22T00:33:51.249 INFO:tasks.workunit.client.0.smithi049.stdout:2/386: creat d2/d9/de/d3a/d6d/f8a x:0 0 0 2024-02-22T00:33:51.250 INFO:tasks.workunit.client.0.smithi049.stdout:3/244: creat d0/dd/d1e/f47 x:0 0 0 2024-02-22T00:33:51.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/353: getdents d1/d41/d28/d71 0 2024-02-22T00:33:51.253 INFO:tasks.workunit.client.0.smithi049.stdout:5/294: mkdir d0/d26/d4d/d64 0 2024-02-22T00:33:51.254 INFO:tasks.workunit.client.0.smithi049.stdout:8/286: unlink d1/d2/d5/d56/l61 0 2024-02-22T00:33:51.254 INFO:tasks.workunit.client.0.smithi049.stdout:7/354: readlink d1/df/d62/d1c/l22 0 2024-02-22T00:33:51.257 INFO:tasks.workunit.client.0.smithi049.stdout:2/387: rename d2/d9/dd/d4d/f6a to d2/d9/de/d15/f8b 0 2024-02-22T00:33:51.258 INFO:tasks.workunit.client.0.smithi049.stdout:4/375: dread d3/f32 [4194304,4194304] 0 2024-02-22T00:33:51.258 INFO:tasks.workunit.client.0.smithi049.stdout:8/287: mknod d1/d2/d5/c6b 0 2024-02-22T00:33:51.258 INFO:tasks.workunit.client.0.smithi049.stdout:1/325: write d2/d8/db/d25/d40/d41/f59 [1409468,112855] 0 2024-02-22T00:33:51.259 INFO:tasks.workunit.client.0.smithi049.stdout:7/355: symlink d1/df/d62/d60/l7f 0 2024-02-22T00:33:51.260 INFO:tasks.workunit.client.0.smithi049.stdout:5/295: write d0/d20/d50/d24/d57/f5c [603683,72743] 0 2024-02-22T00:33:51.262 INFO:tasks.workunit.client.0.smithi049.stdout:2/388: write d2/d9/f5c [3204061,126164] 0 2024-02-22T00:33:51.262 INFO:tasks.workunit.client.0.smithi049.stdout:1/326: chown d2/d8/da 0 1 2024-02-22T00:33:51.262 INFO:tasks.workunit.client.0.smithi049.stdout:8/288: chown d1/d4c/f4f 62285193 1 2024-02-22T00:33:51.262 INFO:tasks.workunit.client.0.smithi049.stdout:3/245: dread d0/d14/f1d [0,4194304] 0 2024-02-22T00:33:51.263 INFO:tasks.workunit.client.0.smithi049.stdout:4/376: mknod d3/d8/d10/d12/c7b 0 2024-02-22T00:33:51.265 INFO:tasks.workunit.client.0.smithi049.stdout:5/296: write d0/d26/f42 [940516,126709] 0 2024-02-22T00:33:51.267 INFO:tasks.workunit.client.0.smithi049.stdout:7/356: dread - d1/df/d62/d1c/d6d/f7b zero size 2024-02-22T00:33:51.268 INFO:tasks.workunit.client.0.smithi049.stdout:1/327: mknod d2/d8/c76 0 2024-02-22T00:33:51.271 INFO:tasks.workunit.client.0.smithi049.stdout:2/389: truncate d2/d9/f2a 4876109 0 2024-02-22T00:33:51.271 INFO:tasks.workunit.client.0.smithi049.stdout:4/377: mknod d3/d8/d72/c7c 0 2024-02-22T00:33:51.275 INFO:tasks.workunit.client.0.smithi049.stdout:3/246: link d0/dd/d26/f38 d0/dd/f48 0 2024-02-22T00:33:51.276 INFO:tasks.workunit.client.0.smithi049.stdout:7/357: mknod d1/d41/c80 0 2024-02-22T00:33:51.277 INFO:tasks.workunit.client.0.smithi049.stdout:8/289: dwrite d1/f12 [4194304,4194304] 0 2024-02-22T00:33:51.277 INFO:tasks.workunit.client.0.smithi049.stdout:1/328: getdents d2/d8/db/d25/d40/d41/d5b/d75 0 2024-02-22T00:33:51.278 INFO:tasks.workunit.client.0.smithi049.stdout:5/297: mknod d0/d20/d50/d24/d3b/d5b/c65 0 2024-02-22T00:33:51.280 INFO:tasks.workunit.client.0.smithi049.stdout:2/390: rename d2/d9/dd/d4d/f4e to d2/d9/de/d10/d59/f8c 0 2024-02-22T00:33:51.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/298: unlink d0/d39/f58 0 2024-02-22T00:33:51.285 INFO:tasks.workunit.client.0.smithi049.stdout:2/391: read d2/d9/de/d15/d1b/f1f [6199772,83711] 0 2024-02-22T00:33:51.287 INFO:tasks.workunit.client.0.smithi049.stdout:7/358: symlink d1/d41/d28/d71/d72/l81 0 2024-02-22T00:33:51.287 INFO:tasks.workunit.client.0.smithi049.stdout:8/290: creat d1/d2/d5/d1b/d39/f6c x:0 0 0 2024-02-22T00:33:51.287 INFO:tasks.workunit.client.0.smithi049.stdout:4/378: dwrite d3/d8/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:51.288 INFO:tasks.workunit.client.0.smithi049.stdout:5/299: write d0/d26/f42 [455697,85157] 0 2024-02-22T00:33:51.292 INFO:tasks.workunit.client.0.smithi049.stdout:2/392: fdatasync d2/d9/f3c 0 2024-02-22T00:33:51.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:49.763740+0000 mgr.smithi161.sazlam (mgr.24369) 57 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 612 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 63 KiB/s rd, 3.9 MiB/s wr, 116 op/s 2024-02-22T00:33:51.294 INFO:tasks.workunit.client.0.smithi049.stdout:7/359: creat d1/df/d62/d60/f82 x:0 0 0 2024-02-22T00:33:51.296 INFO:tasks.workunit.client.0.smithi049.stdout:3/247: dwrite d0/dd/d28/f36 [4194304,4194304] 0 2024-02-22T00:33:51.298 INFO:tasks.workunit.client.0.smithi049.stdout:8/291: unlink d1/d2/db/d15/d30/d4b/d51/c5a 0 2024-02-22T00:33:51.299 INFO:tasks.workunit.client.0.smithi049.stdout:4/379: symlink d3/d13/d48/d60/l7d 0 2024-02-22T00:33:51.301 INFO:tasks.workunit.client.0.smithi049.stdout:3/248: write d0/f6 [4305064,53644] 0 2024-02-22T00:33:51.306 INFO:tasks.workunit.client.0.smithi049.stdout:1/329: dread d2/d8/db/d25/d40/d41/f73 [0,4194304] 0 2024-02-22T00:33:51.309 INFO:tasks.workunit.client.0.smithi049.stdout:5/300: dwrite d0/d39/f61 [0,4194304] 0 2024-02-22T00:33:51.310 INFO:tasks.workunit.client.0.smithi049.stdout:2/393: link d2/l3f d2/d9/de/d10/d2e/d42/d80/l8d 0 2024-02-22T00:33:51.312 INFO:tasks.workunit.client.0.smithi049.stdout:3/249: rename d0/dd/d28/c2c to d0/dd/d2f/c49 0 2024-02-22T00:33:51.319 INFO:tasks.workunit.client.0.smithi049.stdout:5/301: chown d0/d20/d50/f38 4973 1 2024-02-22T00:33:51.320 INFO:tasks.workunit.client.0.smithi049.stdout:2/394: rename d2/d9/f5c to d2/d9/dd/d4d/d5a/f8e 0 2024-02-22T00:33:51.322 INFO:tasks.workunit.client.0.smithi049.stdout:8/292: getdents d1/d2/db/d15/d30/d36 0 2024-02-22T00:33:51.324 INFO:tasks.workunit.client.0.smithi049.stdout:4/380: dwrite d3/d8/d10/f11 [0,4194304] 0 2024-02-22T00:33:51.325 INFO:tasks.workunit.client.0.smithi049.stdout:5/302: creat d0/d20/d50/d24/d3b/f66 x:0 0 0 2024-02-22T00:33:51.325 INFO:tasks.workunit.client.0.smithi049.stdout:4/381: read d3/d22/f50 [812204,127906] 0 2024-02-22T00:33:51.327 INFO:tasks.workunit.client.0.smithi049.stdout:2/395: creat d2/d9/de/d10/d59/f8f x:0 0 0 2024-02-22T00:33:51.327 INFO:tasks.workunit.client.0.smithi049.stdout:5/303: write d0/d20/d50/d24/f5a [1233136,61502] 0 2024-02-22T00:33:51.328 INFO:tasks.workunit.client.0.smithi049.stdout:8/293: symlink d1/d2/d5/l6d 0 2024-02-22T00:33:51.329 INFO:tasks.workunit.client.0.smithi049.stdout:2/396: write d2/d9/f3c [5186946,105629] 0 2024-02-22T00:33:51.336 INFO:tasks.workunit.client.0.smithi049.stdout:5/304: creat d0/d20/d50/d24/d3b/d5b/f67 x:0 0 0 2024-02-22T00:33:51.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/360: dread d1/df/d62/f23 [0,4194304] 0 2024-02-22T00:33:51.338 INFO:tasks.workunit.client.0.smithi049.stdout:7/361: chown d1/df 10886918 1 2024-02-22T00:33:51.340 INFO:tasks.workunit.client.0.smithi049.stdout:8/294: creat d1/d2/db/d15/d30/d4b/d51/f6e x:0 0 0 2024-02-22T00:33:51.341 INFO:tasks.workunit.client.0.smithi049.stdout:2/397: mkdir d2/d9/dd/d4d/d72/d90 0 2024-02-22T00:33:51.351 INFO:tasks.workunit.client.0.smithi049.stdout:5/305: creat d0/d26/d4d/f68 x:0 0 0 2024-02-22T00:33:51.353 INFO:tasks.workunit.client.0.smithi049.stdout:1/330: dwrite d2/d8/db/d25/d40/d41/f73 [0,4194304] 0 2024-02-22T00:33:51.354 INFO:tasks.workunit.client.0.smithi049.stdout:7/362: creat d1/df/d62/d7a/f83 x:0 0 0 2024-02-22T00:33:51.356 INFO:tasks.workunit.client.0.smithi049.stdout:8/295: mknod d1/d2/db/d15/d33/c6f 0 2024-02-22T00:33:51.356 INFO:tasks.workunit.client.0.smithi049.stdout:3/250: dwrite d0/dd/d26/f2b [4194304,4194304] 0 2024-02-22T00:33:51.359 INFO:tasks.workunit.client.0.smithi049.stdout:3/251: chown d0/dd/l19 34 1 2024-02-22T00:33:51.361 INFO:tasks.workunit.client.0.smithi049.stdout:1/331: mknod d2/d8/db/d25/d40/c77 0 2024-02-22T00:33:51.367 INFO:tasks.workunit.client.0.smithi049.stdout:2/398: rmdir d2/d9 39 2024-02-22T00:33:51.367 INFO:tasks.workunit.client.0.smithi049.stdout:7/363: dwrite d1/df/d62/f59 [0,4194304] 0 2024-02-22T00:33:51.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/296: symlink d1/d2/d5/d1b/l70 0 2024-02-22T00:33:51.371 INFO:tasks.workunit.client.0.smithi049.stdout:8/297: write d1/d2/d5/d1b/d39/f40 [1433209,60125] 0 2024-02-22T00:33:51.372 INFO:tasks.workunit.client.0.smithi049.stdout:1/332: mkdir d2/d8/db/d25/d40/d41/d68/d78 0 2024-02-22T00:33:51.373 INFO:tasks.workunit.client.0.smithi049.stdout:3/252: dread d0/dd/d26/f2b [0,4194304] 0 2024-02-22T00:33:51.377 INFO:tasks.workunit.client.0.smithi049.stdout:5/306: truncate d0/d39/fb 2346759 0 2024-02-22T00:33:51.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/399: mknod d2/d9/de/d10/d2e/d42/c91 0 2024-02-22T00:33:51.382 INFO:tasks.workunit.client.0.smithi049.stdout:2/400: write d2/d9/de/d10/d2e/f49 [2431931,52538] 0 2024-02-22T00:33:51.383 INFO:tasks.workunit.client.0.smithi049.stdout:7/364: dwrite d1/df/d62/d1c/d1d/f47 [0,4194304] 0 2024-02-22T00:33:51.384 INFO:tasks.workunit.client.0.smithi049.stdout:8/298: creat d1/d2/db/d15/d30/f71 x:0 0 0 2024-02-22T00:33:51.386 INFO:tasks.workunit.client.0.smithi049.stdout:5/307: mknod d0/d20/d50/d24/c69 0 2024-02-22T00:33:51.389 INFO:tasks.workunit.client.0.smithi049.stdout:7/365: truncate d1/df/d62/d60/f6b 858740 0 2024-02-22T00:33:51.389 INFO:tasks.workunit.client.0.smithi049.stdout:8/299: unlink d1/f12 0 2024-02-22T00:33:51.395 INFO:tasks.workunit.client.0.smithi049.stdout:7/366: write d1/d49/d4d/f68 [512765,83031] 0 2024-02-22T00:33:51.396 INFO:tasks.workunit.client.0.smithi049.stdout:8/300: creat d1/d2/d5/d1b/d39/f72 x:0 0 0 2024-02-22T00:33:51.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/253: write d0/dd/f48 [704105,79572] 0 2024-02-22T00:33:51.399 INFO:tasks.workunit.client.0.smithi049.stdout:5/308: link d0/d39/f61 d0/d20/f6a 0 2024-02-22T00:33:51.401 INFO:tasks.workunit.client.0.smithi049.stdout:3/254: unlink d0/dd/d26/c39 0 2024-02-22T00:33:51.402 INFO:tasks.workunit.client.0.smithi049.stdout:1/333: dread d2/d8/da/f4f [0,4194304] 0 2024-02-22T00:33:51.403 INFO:tasks.workunit.client.0.smithi049.stdout:8/301: rmdir d1/d2/db/d15/d30/d36/d53 39 2024-02-22T00:33:51.405 INFO:tasks.workunit.client.0.smithi049.stdout:5/309: mkdir d0/d20/d6b 0 2024-02-22T00:33:51.408 INFO:tasks.workunit.client.0.smithi049.stdout:7/367: dwrite d1/df/d62/d1c/d1d/d6e/f76 [0,4194304] 0 2024-02-22T00:33:51.408 INFO:tasks.workunit.client.0.smithi049.stdout:3/255: rename d0/dd/d26/f38 to d0/dd/d26/d2e/f4a 0 2024-02-22T00:33:51.413 INFO:tasks.workunit.client.0.smithi049.stdout:2/401: truncate d2/d9/de/d10/d46/f67 2262289 0 2024-02-22T00:33:51.413 INFO:tasks.workunit.client.0.smithi049.stdout:3/256: write d0/dd/d1e/f24 [5169125,103668] 0 2024-02-22T00:33:51.415 INFO:tasks.workunit.client.0.smithi049.stdout:5/310: dread d0/f1d [0,4194304] 0 2024-02-22T00:33:51.419 INFO:tasks.workunit.client.0.smithi049.stdout:8/302: mknod d1/d2/db/d15/d65/d6a/c73 0 2024-02-22T00:33:51.420 INFO:tasks.workunit.client.0.smithi049.stdout:7/368: mknod d1/df/d62/d1c/d1d/d70/c84 0 2024-02-22T00:33:51.420 INFO:tasks.workunit.client.0.smithi049.stdout:8/303: readlink d1/d2/d5/l67 0 2024-02-22T00:33:51.421 INFO:tasks.workunit.client.0.smithi049.stdout:2/402: creat d2/d9/de/d10/d2e/f92 x:0 0 0 2024-02-22T00:33:51.425 INFO:tasks.workunit.client.0.smithi049.stdout:1/334: rename d2/d8/da/f3d to d2/d8/db/d25/d40/f79 0 2024-02-22T00:33:51.427 INFO:tasks.workunit.client.0.smithi049.stdout:1/335: chown d2/c21 8819 1 2024-02-22T00:33:51.427 INFO:tasks.workunit.client.0.smithi049.stdout:7/369: rmdir d1/df/d62/d57 39 2024-02-22T00:33:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:49.763740+0000 mgr.smithi161.sazlam (mgr.24369) 57 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 612 MiB data, 3.9 GiB used, 533 GiB / 536 GiB avail; 63 KiB/s rd, 3.9 MiB/s wr, 116 op/s 2024-02-22T00:33:51.430 INFO:tasks.workunit.client.0.smithi049.stdout:3/257: write d0/dd/f13 [2781765,92086] 0 2024-02-22T00:33:51.433 INFO:tasks.workunit.client.0.smithi049.stdout:8/304: rename d1/d2/db/l2b to d1/d2/db/d15/d30/d36/d52/l74 0 2024-02-22T00:33:51.435 INFO:tasks.workunit.client.0.smithi049.stdout:2/403: mkdir d2/d9/de/d3a/d93 0 2024-02-22T00:33:51.435 INFO:tasks.workunit.client.0.smithi049.stdout:7/370: dread - d1/df/d62/d57/f65 zero size 2024-02-22T00:33:51.437 INFO:tasks.workunit.client.0.smithi049.stdout:1/336: mknod d2/d8/db/d25/d40/d71/c7a 0 2024-02-22T00:33:51.438 INFO:tasks.workunit.client.0.smithi049.stdout:3/258: dwrite d0/f6 [0,4194304] 0 2024-02-22T00:33:51.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/311: getdents d0 0 2024-02-22T00:33:51.442 INFO:tasks.workunit.client.0.smithi049.stdout:2/404: write d2/d9/de/d10/f19 [3666980,60001] 0 2024-02-22T00:33:51.443 INFO:tasks.workunit.client.0.smithi049.stdout:1/337: chown d2/d8/db/f57 4979593 1 2024-02-22T00:33:51.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/259: dread - d0/dd/d1e/f47 zero size 2024-02-22T00:33:51.444 INFO:tasks.workunit.client.0.smithi049.stdout:3/260: read d0/f6 [2028379,47971] 0 2024-02-22T00:33:51.447 INFO:tasks.workunit.client.0.smithi049.stdout:2/405: mkdir d2/d9/d17/d94 0 2024-02-22T00:33:51.449 INFO:tasks.workunit.client.0.smithi049.stdout:7/371: rename d1/d41/f20 to d1/df/d62/d1c/f85 0 2024-02-22T00:33:51.450 INFO:tasks.workunit.client.0.smithi049.stdout:1/338: mkdir d2/d7b 0 2024-02-22T00:33:51.451 INFO:tasks.workunit.client.0.smithi049.stdout:1/339: stat d2/c33 0 2024-02-22T00:33:51.451 INFO:tasks.workunit.client.0.smithi049.stdout:2/406: truncate d2/d9/de/d10/d59/f8f 227972 0 2024-02-22T00:33:51.452 INFO:tasks.workunit.client.0.smithi049.stdout:1/340: write d2/f31 [717246,46137] 0 2024-02-22T00:33:51.455 INFO:tasks.workunit.client.0.smithi049.stdout:2/407: creat d2/f95 x:0 0 0 2024-02-22T00:33:51.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/408: write d2/d9/de/d10/f3d [698269,121341] 0 2024-02-22T00:33:51.457 INFO:tasks.workunit.client.0.smithi049.stdout:1/341: rename d2/d8/db/f6f to d2/d8/db/d25/d40/d41/d5b/f7c 0 2024-02-22T00:33:51.460 INFO:tasks.workunit.client.0.smithi049.stdout:8/305: dread d1/d2/db/f19 [0,4194304] 0 2024-02-22T00:33:51.461 INFO:tasks.workunit.client.0.smithi049.stdout:2/409: creat d2/d9/de/d15/d1b/f96 x:0 0 0 2024-02-22T00:33:51.462 INFO:tasks.workunit.client.0.smithi049.stdout:1/342: symlink d2/d69/l7d 0 2024-02-22T00:33:51.463 INFO:tasks.workunit.client.0.smithi049.stdout:3/261: truncate d0/dd/f13 1113446 0 2024-02-22T00:33:51.464 INFO:tasks.workunit.client.0.smithi049.stdout:2/410: rmdir d2/d9/de 39 2024-02-22T00:33:51.464 INFO:tasks.workunit.client.0.smithi049.stdout:3/262: stat d0/dd/d2f/c33 0 2024-02-22T00:33:51.467 INFO:tasks.workunit.client.0.smithi049.stdout:1/343: mknod d2/d8/d4c/c7e 0 2024-02-22T00:33:51.469 INFO:tasks.workunit.client.0.smithi049.stdout:2/411: mkdir d2/d9/de/d10/d2e/d42/d97 0 2024-02-22T00:33:51.472 INFO:tasks.workunit.client.0.smithi049.stdout:1/344: unlink d2/d8/db/l2b 0 2024-02-22T00:33:51.474 INFO:tasks.workunit.client.0.smithi049.stdout:7/372: dwrite d1/df/d62/f30 [0,4194304] 0 2024-02-22T00:33:51.474 INFO:tasks.workunit.client.0.smithi049.stdout:8/306: truncate d1/d2/f31 3263737 0 2024-02-22T00:33:51.476 INFO:tasks.workunit.client.0.smithi049.stdout:1/345: mkdir d2/d69/d7f 0 2024-02-22T00:33:51.477 INFO:tasks.workunit.client.0.smithi049.stdout:3/263: dwrite d0/dd/d1e/f24 [4194304,4194304] 0 2024-02-22T00:33:51.479 INFO:tasks.workunit.client.0.smithi049.stdout:2/412: rename d2/l24 to d2/d9/de/d15/d4f/l98 0 2024-02-22T00:33:51.479 INFO:tasks.workunit.client.0.smithi049.stdout:1/346: write d2/d8/da/f32 [1414985,18053] 0 2024-02-22T00:33:51.480 INFO:tasks.workunit.client.0.smithi049.stdout:3/264: fdatasync d0/dd/d26/d2e/f44 0 2024-02-22T00:33:51.480 INFO:tasks.workunit.client.0.smithi049.stdout:1/347: readlink d2/d8/db/l20 0 2024-02-22T00:33:51.481 INFO:tasks.workunit.client.0.smithi049.stdout:8/307: symlink d1/d2/db/d15/d30/d4b/d51/l75 0 2024-02-22T00:33:51.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/308: stat d1/d2/d5/d1b/d39/c3c 0 2024-02-22T00:33:51.485 INFO:tasks.workunit.client.0.smithi049.stdout:2/413: mkdir d2/d9/dd/d4d/d5a/d99 0 2024-02-22T00:33:51.487 INFO:tasks.workunit.client.0.smithi049.stdout:8/309: write d1/d2/db/f28 [7732039,81792] 0 2024-02-22T00:33:51.488 INFO:tasks.workunit.client.0.smithi049.stdout:7/373: rename d1/df/f18 to d1/d49/d4d/f86 0 2024-02-22T00:33:51.490 INFO:tasks.workunit.client.0.smithi049.stdout:3/265: dwrite d0/dd/d2f/f42 [0,4194304] 0 2024-02-22T00:33:51.491 INFO:tasks.workunit.client.0.smithi049.stdout:2/414: creat d2/d9/dd/d4d/d72/f9a x:0 0 0 2024-02-22T00:33:51.493 INFO:tasks.workunit.client.0.smithi049.stdout:8/310: truncate d1/d2/db/d15/d33/f48 12971 0 2024-02-22T00:33:51.493 INFO:tasks.workunit.client.0.smithi049.stdout:2/415: read d2/d9/de/d15/d1b/f25 [1827672,114523] 0 2024-02-22T00:33:51.495 INFO:tasks.workunit.client.0.smithi049.stdout:0/297: sync 2024-02-22T00:33:51.495 INFO:tasks.workunit.client.0.smithi049.stdout:9/362: sync 2024-02-22T00:33:51.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/313: sync 2024-02-22T00:33:51.497 INFO:tasks.workunit.client.0.smithi049.stdout:8/311: stat d1/d2/db/f21 0 2024-02-22T00:33:51.503 INFO:tasks.workunit.client.0.smithi049.stdout:9/363: rmdir d17/d21/d47/d5d 39 2024-02-22T00:33:51.503 INFO:tasks.workunit.client.0.smithi049.stdout:6/314: mkdir d3/d36/d57/d75 0 2024-02-22T00:33:51.503 INFO:tasks.workunit.client.0.smithi049.stdout:2/416: chown d2/d9/dd/c32 3 1 2024-02-22T00:33:51.509 INFO:tasks.workunit.client.0.smithi049.stdout:0/298: creat d3/d6/f4d x:0 0 0 2024-02-22T00:33:51.516 INFO:tasks.workunit.client.0.smithi049.stdout:9/364: creat d17/d21/d47/f7e x:0 0 0 2024-02-22T00:33:51.517 INFO:tasks.workunit.client.0.smithi049.stdout:0/299: dread - d3/d6/d8/f46 zero size 2024-02-22T00:33:51.521 INFO:tasks.workunit.client.0.smithi049.stdout:8/312: dwrite d1/d2/d5/d1b/d39/f54 [0,4194304] 0 2024-02-22T00:33:51.524 INFO:tasks.workunit.client.0.smithi049.stdout:7/374: dread d1/d41/f3e [0,4194304] 0 2024-02-22T00:33:51.526 INFO:tasks.workunit.client.0.smithi049.stdout:1/348: dread d2/d8/da/f22 [0,4194304] 0 2024-02-22T00:33:51.531 INFO:tasks.workunit.client.0.smithi049.stdout:6/315: dwrite d3/f29 [0,4194304] 0 2024-02-22T00:33:51.533 INFO:tasks.workunit.client.0.smithi049.stdout:3/266: dread d0/dd/d1e/f24 [0,4194304] 0 2024-02-22T00:33:51.535 INFO:tasks.workunit.client.0.smithi049.stdout:0/300: unlink d3/df/d17/d1b/c1f 0 2024-02-22T00:33:51.538 INFO:tasks.workunit.client.0.smithi049.stdout:6/316: fdatasync d3/d64/f26 0 2024-02-22T00:33:51.538 INFO:tasks.workunit.client.0.smithi049.stdout:9/365: mkdir d17/d1c/d25/d71/d73/d7f 0 2024-02-22T00:33:51.540 INFO:tasks.workunit.client.0.smithi049.stdout:1/349: creat d2/d8/db/d25/d40/d41/d68/f80 x:0 0 0 2024-02-22T00:33:51.540 INFO:tasks.workunit.client.0.smithi049.stdout:2/417: dwrite d2/d9/de/d10/d46/f68 [0,4194304] 0 2024-02-22T00:33:51.550 INFO:tasks.workunit.client.0.smithi049.stdout:0/301: symlink d3/d6/d8/d36/l4e 0 2024-02-22T00:33:51.551 INFO:tasks.workunit.client.0.smithi049.stdout:1/350: truncate d2/d8/f6a 256420 0 2024-02-22T00:33:51.552 INFO:tasks.workunit.client.0.smithi049.stdout:8/313: dwrite d1/d4c/f55 [0,4194304] 0 2024-02-22T00:33:51.555 INFO:tasks.workunit.client.0.smithi049.stdout:7/375: dwrite d1/df/f16 [0,4194304] 0 2024-02-22T00:33:51.557 INFO:tasks.workunit.client.0.smithi049.stdout:0/302: truncate d3/f49 1032689 0 2024-02-22T00:33:51.557 INFO:tasks.workunit.client.0.smithi049.stdout:7/376: fsync d1/df/f4f 0 2024-02-22T00:33:51.560 INFO:tasks.workunit.client.0.smithi049.stdout:7/377: chown d1/df/d62/f30 25590473 1 2024-02-22T00:33:51.563 INFO:tasks.workunit.client.0.smithi049.stdout:2/418: fsync d2/d9/de/d15/f8b 0 2024-02-22T00:33:51.564 INFO:tasks.workunit.client.0.smithi049.stdout:3/267: truncate d0/dd/d26/f2b 2385341 0 2024-02-22T00:33:51.566 INFO:tasks.workunit.client.0.smithi049.stdout:8/314: rename d1/d2/db/d15/d65/d6a/c73 to d1/d2/db/d15/c76 0 2024-02-22T00:33:51.566 INFO:tasks.workunit.client.0.smithi049.stdout:2/419: stat d2/d9/dd/d4d/d72/d90 0 2024-02-22T00:33:51.566 INFO:tasks.workunit.client.0.smithi049.stdout:0/303: chown d3/df/c33 382 1 2024-02-22T00:33:51.567 INFO:tasks.workunit.client.0.smithi049.stdout:7/378: write d1/df/d62/d57/f69 [3848363,91152] 0 2024-02-22T00:33:51.571 INFO:tasks.workunit.client.0.smithi049.stdout:1/351: creat d2/d8/db/d25/d40/d41/d5b/d75/f81 x:0 0 0 2024-02-22T00:33:51.571 INFO:tasks.workunit.client.0.smithi049.stdout:8/315: chown d1/d2/db/d15/d30/d36/d52 13653 1 2024-02-22T00:33:51.572 INFO:tasks.workunit.client.0.smithi049.stdout:9/366: truncate d17/d1c/d25/d71/f7d 2677318 0 2024-02-22T00:33:51.572 INFO:tasks.workunit.client.0.smithi049.stdout:2/420: read - d2/d9/de/d3a/f61 zero size 2024-02-22T00:33:51.576 INFO:tasks.workunit.client.0.smithi049.stdout:0/304: rename d3/d6/d8/c4c to d3/df/d17/d1b/c4f 0 2024-02-22T00:33:51.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/316: write d1/d2/d5/d1b/d39/f40 [1565980,77864] 0 2024-02-22T00:33:51.577 INFO:tasks.workunit.client.0.smithi049.stdout:1/352: truncate d2/d8/da/f14 4292366 0 2024-02-22T00:33:51.581 INFO:tasks.workunit.client.0.smithi049.stdout:9/367: mknod d17/d1c/d25/d39/d67/c80 0 2024-02-22T00:33:51.582 INFO:tasks.workunit.client.0.smithi049.stdout:7/379: creat d1/df/d62/d1c/d24/f87 x:0 0 0 2024-02-22T00:33:51.584 INFO:tasks.workunit.client.0.smithi049.stdout:9/368: write f14 [4817721,103412] 0 2024-02-22T00:33:51.584 INFO:tasks.workunit.client.0.smithi049.stdout:0/305: mkdir d3/df/d17/d50 0 2024-02-22T00:33:51.585 INFO:tasks.workunit.client.0.smithi049.stdout:6/317: dread d3/f5 [0,4194304] 0 2024-02-22T00:33:51.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/306: write d3/d6/f26 [2145990,35052] 0 2024-02-22T00:33:51.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/317: write d1/d2/f2e [1111228,38289] 0 2024-02-22T00:33:51.599 INFO:tasks.workunit.client.0.smithi049.stdout:7/380: rename d1/d41/d28/l43 to d1/df/d62/d1c/l88 0 2024-02-22T00:33:51.601 INFO:tasks.workunit.client.0.smithi049.stdout:6/318: creat d3/f76 x:0 0 0 2024-02-22T00:33:51.605 INFO:tasks.workunit.client.0.smithi049.stdout:9/369: dwrite d17/d1c/d25/f53 [0,4194304] 0 2024-02-22T00:33:51.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/353: dread d2/d8/db/f2d [0,4194304] 0 2024-02-22T00:33:51.606 INFO:tasks.workunit.client.0.smithi049.stdout:2/421: dread d2/d9/de/d10/f29 [0,4194304] 0 2024-02-22T00:33:51.607 INFO:tasks.workunit.client.0.smithi049.stdout:3/268: dread d0/d14/f21 [0,4194304] 0 2024-02-22T00:33:51.608 INFO:tasks.workunit.client.0.smithi049.stdout:6/319: write d3/f43 [889602,19326] 0 2024-02-22T00:33:51.608 INFO:tasks.workunit.client.0.smithi049.stdout:8/318: mknod d1/d2/c77 0 2024-02-22T00:33:51.608 INFO:tasks.workunit.client.0.smithi049.stdout:7/381: chown d1/df/d62/d1c/d1d/d6e/f76 85 1 2024-02-22T00:33:51.611 INFO:tasks.workunit.client.0.smithi049.stdout:1/354: rmdir d2/d8/da 39 2024-02-22T00:33:51.613 INFO:tasks.workunit.client.0.smithi049.stdout:6/320: chown d3/c4 174475 1 2024-02-22T00:33:51.614 INFO:tasks.workunit.client.0.smithi049.stdout:9/370: creat d17/d1c/f81 x:0 0 0 2024-02-22T00:33:51.618 INFO:tasks.workunit.client.0.smithi049.stdout:3/269: rename d0/dd/l19 to d0/dd/d28/l4b 0 2024-02-22T00:33:51.621 INFO:tasks.workunit.client.0.smithi049.stdout:9/371: mknod d17/d21/d47/c82 0 2024-02-22T00:33:51.623 INFO:tasks.workunit.client.0.smithi049.stdout:2/422: link d2/d9/de/d10/d2e/d42/d80/f81 d2/d9/de/f9b 0 2024-02-22T00:33:51.624 INFO:tasks.workunit.client.0.smithi049.stdout:8/319: rename d1/d2/d5/f18 to d1/d2/db/f78 0 2024-02-22T00:33:51.625 INFO:tasks.workunit.client.0.smithi049.stdout:3/270: fdatasync d0/dd/f9 0 2024-02-22T00:33:51.626 INFO:tasks.workunit.client.0.smithi049.stdout:9/372: stat d17/d21/d47/f5e 0 2024-02-22T00:33:51.629 INFO:tasks.workunit.client.0.smithi049.stdout:1/355: dwrite d2/d8/db/f12 [0,4194304] 0 2024-02-22T00:33:51.630 INFO:tasks.workunit.client.0.smithi049.stdout:6/321: dwrite d3/d16/f53 [0,4194304] 0 2024-02-22T00:33:51.630 INFO:tasks.workunit.client.0.smithi049.stdout:3/271: rmdir d0/d14 39 2024-02-22T00:33:51.631 INFO:tasks.workunit.client.0.smithi049.stdout:8/320: stat d1/d2/db/d15/d30/d36/d52 0 2024-02-22T00:33:51.631 INFO:tasks.workunit.client.0.smithi049.stdout:0/307: dread d3/df/d17/d1b/f28 [0,4194304] 0 2024-02-22T00:33:51.638 INFO:tasks.workunit.client.0.smithi049.stdout:2/423: creat d2/d9/de/d10/d2e/d42/d80/f9c x:0 0 0 2024-02-22T00:33:51.638 INFO:tasks.workunit.client.0.smithi049.stdout:9/373: symlink d17/d1c/d25/d39/d67/l83 0 2024-02-22T00:33:51.639 INFO:tasks.workunit.client.0.smithi049.stdout:1/356: fsync d2/d8/db/d25/d40/f4b 0 2024-02-22T00:33:51.640 INFO:tasks.workunit.client.0.smithi049.stdout:6/322: rmdir d3/d64/d60 39 2024-02-22T00:33:51.643 INFO:tasks.workunit.client.0.smithi049.stdout:6/323: dread - d3/d16/d45/f56 zero size 2024-02-22T00:33:51.646 INFO:tasks.workunit.client.0.smithi049.stdout:3/272: creat d0/dd/f4c x:0 0 0 2024-02-22T00:33:51.647 INFO:tasks.workunit.client.0.smithi049.stdout:1/357: rename d2/d8/db/d25/c5a to d2/d8/db/d25/d40/d41/c82 0 2024-02-22T00:33:51.650 INFO:tasks.workunit.client.0.smithi049.stdout:6/324: chown d3/ce 1 1 2024-02-22T00:33:51.651 INFO:tasks.workunit.client.0.smithi049.stdout:6/325: readlink d3/d16/l2e 0 2024-02-22T00:33:51.651 INFO:tasks.workunit.client.0.smithi049.stdout:2/424: rmdir d2/d9/d17/d94 0 2024-02-22T00:33:51.652 INFO:tasks.workunit.client.0.smithi049.stdout:8/321: getdents d1/d2/db/d15/d30/d4b/d51 0 2024-02-22T00:33:51.656 INFO:tasks.workunit.client.0.smithi049.stdout:6/326: creat d3/d64/d59/f77 x:0 0 0 2024-02-22T00:33:51.656 INFO:tasks.workunit.client.0.smithi049.stdout:9/374: link d17/d21/d4e/d4b/l65 d17/d21/d47/l84 0 2024-02-22T00:33:51.658 INFO:tasks.workunit.client.0.smithi049.stdout:0/308: truncate d3/df/d17/f24 833313 0 2024-02-22T00:33:51.661 INFO:tasks.workunit.client.0.smithi049.stdout:0/309: chown d3/f13 0 1 2024-02-22T00:33:51.661 INFO:tasks.workunit.client.0.smithi049.stdout:1/358: write d2/d8/db/f1a [1975727,14856] 0 2024-02-22T00:33:51.663 INFO:tasks.workunit.client.0.smithi049.stdout:6/327: creat d3/d16/f78 x:0 0 0 2024-02-22T00:33:51.665 INFO:tasks.workunit.client.0.smithi049.stdout:0/310: write d3/f43 [1006699,30050] 0 2024-02-22T00:33:51.666 INFO:tasks.workunit.client.0.smithi049.stdout:1/359: write d2/d8/db/d25/d40/d41/f73 [5056978,107937] 0 2024-02-22T00:33:51.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/375: rename d17/d1c/d25/d71/d73/d7f to d17/d21/d85 0 2024-02-22T00:33:51.668 INFO:tasks.workunit.client.0.smithi049.stdout:4/382: sync 2024-02-22T00:33:51.668 INFO:tasks.workunit.client.0.smithi049.stdout:6/328: unlink d3/d16/c23 0 2024-02-22T00:33:51.671 INFO:tasks.workunit.client.0.smithi049.stdout:8/322: dread d1/fe [0,4194304] 0 2024-02-22T00:33:51.671 INFO:tasks.workunit.client.0.smithi049.stdout:6/329: stat d3/d16/d3b/d3d 0 2024-02-22T00:33:51.671 INFO:tasks.workunit.client.0.smithi049.stdout:2/425: dread d2/d9/de/f2b [0,4194304] 0 2024-02-22T00:33:51.673 INFO:tasks.workunit.client.0.smithi049.stdout:4/383: readlink d3/d8/d10/d43/l73 0 2024-02-22T00:33:51.673 INFO:tasks.workunit.client.0.smithi049.stdout:9/376: dread - d17/d1c/d25/d39/f5b zero size 2024-02-22T00:33:51.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/360: dread d2/d8/d4c/f52 [0,4194304] 0 2024-02-22T00:33:51.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/311: dread d3/f43 [0,4194304] 0 2024-02-22T00:33:51.677 INFO:tasks.workunit.client.0.smithi049.stdout:8/323: write d1/d2/db/d15/d33/f48 [271584,71950] 0 2024-02-22T00:33:51.678 INFO:tasks.workunit.client.0.smithi049.stdout:2/426: creat d2/d9/dd/d74/f9d x:0 0 0 2024-02-22T00:33:51.683 INFO:tasks.workunit.client.0.smithi049.stdout:0/312: mknod d3/d6/c51 0 2024-02-22T00:33:51.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/427: fdatasync d2/d9/de/d10/d46/d63/f7e 0 2024-02-22T00:33:51.690 INFO:tasks.workunit.client.0.smithi049.stdout:8/324: creat d1/d2/db/d15/d30/d36/d53/f79 x:0 0 0 2024-02-22T00:33:51.693 INFO:tasks.workunit.client.0.smithi049.stdout:1/361: dread d2/d8/da/f32 [0,4194304] 0 2024-02-22T00:33:51.693 INFO:tasks.workunit.client.0.smithi049.stdout:4/384: dwrite d3/f4b [0,4194304] 0 2024-02-22T00:33:51.694 INFO:tasks.workunit.client.0.smithi049.stdout:9/377: dwrite d17/d21/f29 [0,4194304] 0 2024-02-22T00:33:51.696 INFO:tasks.workunit.client.0.smithi049.stdout:9/378: write d17/f6c [131287,29722] 0 2024-02-22T00:33:51.702 INFO:tasks.workunit.client.0.smithi049.stdout:2/428: creat d2/d9/de/d10/d2e/f9e x:0 0 0 2024-02-22T00:33:51.702 INFO:tasks.workunit.client.0.smithi049.stdout:6/330: dread d3/d16/f19 [0,4194304] 0 2024-02-22T00:33:51.703 INFO:tasks.workunit.client.0.smithi049.stdout:1/362: stat d2/d8/db/d25/d40/l45 0 2024-02-22T00:33:51.706 INFO:tasks.workunit.client.0.smithi049.stdout:8/325: link d1/d2/d5/d1b/d39/f72 d1/d2/d5/f7a 0 2024-02-22T00:33:51.707 INFO:tasks.workunit.client.0.smithi049.stdout:0/313: dread d3/df/f2b [0,4194304] 0 2024-02-22T00:33:51.707 INFO:tasks.workunit.client.0.smithi049.stdout:9/379: rename d17/d21/d4e/l6f to d17/d21/d85/l86 0 2024-02-22T00:33:51.709 INFO:tasks.workunit.client.0.smithi049.stdout:2/429: fdatasync d2/d9/de/d10/d2e/d42/f43 0 2024-02-22T00:33:51.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/326: chown d1/d2/db/d1c/l35 6838 1 2024-02-22T00:33:51.711 INFO:tasks.workunit.client.0.smithi049.stdout:1/363: write d2/d8/db/d25/d40/d41/d5b/f7c [224306,13305] 0 2024-02-22T00:33:51.713 INFO:tasks.workunit.client.0.smithi049.stdout:2/430: fdatasync d2/f95 0 2024-02-22T00:33:51.716 INFO:tasks.workunit.client.0.smithi049.stdout:9/380: write d17/f1f [1168003,128410] 0 2024-02-22T00:33:51.716 INFO:tasks.workunit.client.0.smithi049.stdout:6/331: fsync d3/d36/f4e 0 2024-02-22T00:33:51.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/364: chown d2/d8/da/f14 628663 1 2024-02-22T00:33:51.718 INFO:tasks.workunit.client.0.smithi049.stdout:9/381: stat d17/d1c/d25 0 2024-02-22T00:33:51.718 INFO:tasks.workunit.client.0.smithi049.stdout:8/327: mknod d1/d2/db/d15/d33/c7b 0 2024-02-22T00:33:51.721 INFO:tasks.workunit.client.0.smithi049.stdout:0/314: creat d3/df/d48/f52 x:0 0 0 2024-02-22T00:33:51.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/332: readlink d3/d16/l1e 0 2024-02-22T00:33:51.724 INFO:tasks.workunit.client.0.smithi049.stdout:9/382: symlink d17/d1c/l87 0 2024-02-22T00:33:51.727 INFO:tasks.workunit.client.0.smithi049.stdout:2/431: dwrite d2/d9/f6f [0,4194304] 0 2024-02-22T00:33:51.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/333: write d3/d16/f25 [3708917,77053] 0 2024-02-22T00:33:51.730 INFO:tasks.workunit.client.0.smithi049.stdout:4/385: dread d3/d8/d10/d12/f31 [0,4194304] 0 2024-02-22T00:33:51.732 INFO:tasks.workunit.client.0.smithi049.stdout:1/365: write d2/d8/db/d25/d40/d41/f60 [1606246,102855] 0 2024-02-22T00:33:51.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/366: truncate d2/d8/f74 265378 0 2024-02-22T00:33:51.741 INFO:tasks.workunit.client.0.smithi049.stdout:4/386: link d3/d8/d20/l61 d3/d22/d49/l7e 0 2024-02-22T00:33:51.742 INFO:tasks.workunit.client.0.smithi049.stdout:6/334: getdents d3/d16/d3b/d3d/d6c 0 2024-02-22T00:33:51.742 INFO:tasks.workunit.client.0.smithi049.stdout:2/432: link d2/d9/de/c58 d2/d9/de/d3a/d93/c9f 0 2024-02-22T00:33:51.743 INFO:tasks.workunit.client.0.smithi049.stdout:8/328: dwrite d1/d2/db/d15/d30/d36/d53/f5f [0,4194304] 0 2024-02-22T00:33:51.743 INFO:tasks.workunit.client.0.smithi049.stdout:0/315: dread d3/df/d17/d1b/f28 [0,4194304] 0 2024-02-22T00:33:51.745 INFO:tasks.workunit.client.0.smithi049.stdout:0/316: readlink d3/l12 0 2024-02-22T00:33:51.745 INFO:tasks.workunit.client.0.smithi049.stdout:6/335: chown d3/d36/d70 24 1 2024-02-22T00:33:51.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/329: stat d1/d2/db/d15/d33/c6f 0 2024-02-22T00:33:51.747 INFO:tasks.workunit.client.0.smithi049.stdout:0/317: stat d3/df/d17/f2f 0 2024-02-22T00:33:51.747 INFO:tasks.workunit.client.0.smithi049.stdout:2/433: unlink d2/d9/de/f57 0 2024-02-22T00:33:51.748 INFO:tasks.workunit.client.0.smithi049.stdout:4/387: symlink d3/d8/d10/l7f 0 2024-02-22T00:33:51.750 INFO:tasks.workunit.client.0.smithi049.stdout:0/318: rmdir d3/d6 39 2024-02-22T00:33:51.752 INFO:tasks.workunit.client.0.smithi049.stdout:6/336: symlink d3/d16/d32/l79 0 2024-02-22T00:33:51.754 INFO:tasks.workunit.client.0.smithi049.stdout:4/388: fsync d3/d8/d10/d12/f38 0 2024-02-22T00:33:51.758 INFO:tasks.workunit.client.0.smithi049.stdout:1/367: dwrite d2/d8/db/f34 [0,4194304] 0 2024-02-22T00:33:51.758 INFO:tasks.workunit.client.0.smithi049.stdout:4/389: write d3/d22/f52 [829023,3356] 0 2024-02-22T00:33:51.761 INFO:tasks.workunit.client.0.smithi049.stdout:8/330: rename d1/d2/f31 to d1/d2/d5/d1b/d39/f7c 0 2024-02-22T00:33:51.765 INFO:tasks.workunit.client.0.smithi049.stdout:6/337: truncate d3/d16/f30 1280735 0 2024-02-22T00:33:51.768 INFO:tasks.workunit.client.0.smithi049.stdout:4/390: read d3/d8/d10/d12/f38 [2764549,115860] 0 2024-02-22T00:33:51.772 INFO:tasks.workunit.client.0.smithi049.stdout:2/434: dwrite d2/d9/de/d3a/f61 [0,4194304] 0 2024-02-22T00:33:51.772 INFO:tasks.workunit.client.0.smithi049.stdout:1/368: fdatasync d2/d8/da/f39 0 2024-02-22T00:33:51.775 INFO:tasks.workunit.client.0.smithi049.stdout:8/331: rename d1/f42 to d1/d2/db/d15/d30/d4b/f7d 0 2024-02-22T00:33:51.783 INFO:tasks.workunit.client.0.smithi049.stdout:0/319: link d3/d6/l47 d3/df/d17/l53 0 2024-02-22T00:33:51.784 INFO:tasks.workunit.client.0.smithi049.stdout:9/383: dread d17/d21/d3c/f4a [0,4194304] 0 2024-02-22T00:33:51.785 INFO:tasks.workunit.client.0.smithi049.stdout:8/332: symlink d1/d2/db/d15/d30/d4b/d51/l7e 0 2024-02-22T00:33:51.786 INFO:tasks.workunit.client.0.smithi049.stdout:6/338: dwrite d3/d16/f24 [0,4194304] 0 2024-02-22T00:33:51.793 INFO:tasks.workunit.client.0.smithi049.stdout:0/320: write d3/df/d17/d1b/f28 [4119540,70942] 0 2024-02-22T00:33:51.794 INFO:tasks.workunit.client.0.smithi049.stdout:1/369: dwrite d2/d8/db/f34 [0,4194304] 0 2024-02-22T00:33:51.796 INFO:tasks.workunit.client.0.smithi049.stdout:6/339: creat d3/d16/d45/f7a x:0 0 0 2024-02-22T00:33:51.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/384: creat d17/d1c/d25/d39/f88 x:0 0 0 2024-02-22T00:33:51.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/370: readlink d2/d8/db/d25/d62/l55 0 2024-02-22T00:33:51.800 INFO:tasks.workunit.client.0.smithi049.stdout:0/321: chown d3/df/d17/f2f 3714838 1 2024-02-22T00:33:51.804 INFO:tasks.workunit.client.0.smithi049.stdout:4/391: truncate d3/d8/d10/d12/f23 2464821 0 2024-02-22T00:33:51.807 INFO:tasks.workunit.client.0.smithi049.stdout:1/371: creat d2/d8/db/d25/d40/d41/f83 x:0 0 0 2024-02-22T00:33:51.809 INFO:tasks.workunit.client.0.smithi049.stdout:9/385: mkdir d17/d21/d4e/d89 0 2024-02-22T00:33:51.810 INFO:tasks.workunit.client.0.smithi049.stdout:5/312: sync 2024-02-22T00:33:51.812 INFO:tasks.workunit.client.0.smithi049.stdout:9/386: fsync d17/f1a 0 2024-02-22T00:33:51.814 INFO:tasks.workunit.client.0.smithi049.stdout:6/340: read d3/f10 [861142,76801] 0 2024-02-22T00:33:51.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/322: dread d3/df/d17/d1b/f28 [0,4194304] 0 2024-02-22T00:33:51.816 INFO:tasks.workunit.client.0.smithi049.stdout:9/387: unlink d17/d21/f30 0 2024-02-22T00:33:51.816 INFO:tasks.workunit.client.0.smithi049.stdout:6/341: fsync d3/d16/d32/f68 0 2024-02-22T00:33:51.818 INFO:tasks.workunit.client.0.smithi049.stdout:9/388: write d17/d21/f33 [3175518,4304] 0 2024-02-22T00:33:51.819 INFO:tasks.workunit.client.0.smithi049.stdout:1/372: mkdir d2/d8/db/d25/d40/d41/d84 0 2024-02-22T00:33:51.819 INFO:tasks.workunit.client.0.smithi049.stdout:2/435: dread d2/d9/de/d15/f4a [0,4194304] 0 2024-02-22T00:33:51.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/323: mkdir d3/df/d48/d54 0 2024-02-22T00:33:51.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/313: symlink d0/d26/d4d/d64/l6c 0 2024-02-22T00:33:51.827 INFO:tasks.workunit.client.0.smithi049.stdout:2/436: chown d2/cb 1 1 2024-02-22T00:33:51.828 INFO:tasks.workunit.client.0.smithi049.stdout:1/373: creat d2/d7b/f85 x:0 0 0 2024-02-22T00:33:51.830 INFO:tasks.workunit.client.0.smithi049.stdout:9/389: dread d17/d1c/d25/f34 [0,4194304] 0 2024-02-22T00:33:51.831 INFO:tasks.workunit.client.0.smithi049.stdout:9/390: fdatasync d17/d1c/f2b 0 2024-02-22T00:33:51.832 INFO:tasks.workunit.client.0.smithi049.stdout:0/324: dread - d3/d6/d8/f46 zero size 2024-02-22T00:33:51.833 INFO:tasks.workunit.client.0.smithi049.stdout:5/314: mknod d0/d20/d50/d24/d54/c6d 0 2024-02-22T00:33:51.835 INFO:tasks.workunit.client.0.smithi049.stdout:2/437: chown d2/d9/de/l48 152114 1 2024-02-22T00:33:51.837 INFO:tasks.workunit.client.0.smithi049.stdout:8/333: dread d1/d2/f27 [0,4194304] 0 2024-02-22T00:33:51.839 INFO:tasks.workunit.client.0.smithi049.stdout:1/374: mkdir d2/d8/db/d25/d40/d41/d84/d86 0 2024-02-22T00:33:51.841 INFO:tasks.workunit.client.0.smithi049.stdout:9/391: dread d17/d1c/d38/f52 [0,4194304] 0 2024-02-22T00:33:51.842 INFO:tasks.workunit.client.0.smithi049.stdout:4/392: dread d3/d33/f46 [0,4194304] 0 2024-02-22T00:33:51.845 INFO:tasks.workunit.client.0.smithi049.stdout:9/392: fsync d17/d1c/d25/f53 0 2024-02-22T00:33:51.846 INFO:tasks.workunit.client.0.smithi049.stdout:2/438: mkdir d2/d9/dd/d4d/d72/da0 0 2024-02-22T00:33:51.847 INFO:tasks.workunit.client.0.smithi049.stdout:8/334: creat d1/d2/d5/d1b/f7f x:0 0 0 2024-02-22T00:33:51.849 INFO:tasks.workunit.client.0.smithi049.stdout:2/439: dread - d2/d9/de/d3a/d6d/f8a zero size 2024-02-22T00:33:51.853 INFO:tasks.workunit.client.0.smithi049.stdout:9/393: write d17/d1c/f3b [1345254,111870] 0 2024-02-22T00:33:51.856 INFO:tasks.workunit.client.0.smithi049.stdout:1/375: mkdir d2/d8/db/d25/d40/d41/d5b/d87 0 2024-02-22T00:33:51.862 INFO:tasks.workunit.client.0.smithi049.stdout:9/394: creat d17/d1c/d25/d39/f8a x:0 0 0 2024-02-22T00:33:51.865 INFO:tasks.workunit.client.0.smithi049.stdout:1/376: readlink d2/d8/l29 0 2024-02-22T00:33:51.867 INFO:tasks.workunit.client.0.smithi049.stdout:5/315: dread d0/d39/d6/fd [0,4194304] 0 2024-02-22T00:33:51.869 INFO:tasks.workunit.client.0.smithi049.stdout:8/335: link d1/d2/f25 d1/d2/db/f80 0 2024-02-22T00:33:51.872 INFO:tasks.workunit.client.0.smithi049.stdout:2/440: link d2/d9/d17/c82 d2/d9/de/d3a/d6d/ca1 0 2024-02-22T00:33:51.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/377: rename d2/d8/db/d25/l2f to d2/d8/db/d25/d40/d71/l88 0 2024-02-22T00:33:51.876 INFO:tasks.workunit.client.0.smithi049.stdout:2/441: fsync d2/d9/de/d10/d59/f8f 0 2024-02-22T00:33:51.878 INFO:tasks.workunit.client.0.smithi049.stdout:4/393: getdents d3/d8/d10 0 2024-02-22T00:33:51.880 INFO:tasks.workunit.client.0.smithi049.stdout:9/395: mknod d17/d21/d47/d5d/c8b 0 2024-02-22T00:33:51.880 INFO:tasks.workunit.client.0.smithi049.stdout:8/336: mkdir d1/d2/d5/d1b/d39/d81 0 2024-02-22T00:33:51.882 INFO:tasks.workunit.client.0.smithi049.stdout:1/378: creat d2/d8/db/d25/d40/d41/d5b/f89 x:0 0 0 2024-02-22T00:33:51.884 INFO:tasks.workunit.client.0.smithi049.stdout:1/379: fsync d2/d8/db/d25/d40/d41/f4a 0 2024-02-22T00:33:51.885 INFO:tasks.workunit.client.0.smithi049.stdout:4/394: rename d3/d8/d10/c1b to d3/d8/d10/c80 0 2024-02-22T00:33:51.886 INFO:tasks.workunit.client.0.smithi049.stdout:2/442: symlink d2/d9/de/d10/d46/la2 0 2024-02-22T00:33:51.889 INFO:tasks.workunit.client.0.smithi049.stdout:9/396: mkdir d17/d1c/d8c 0 2024-02-22T00:33:51.891 INFO:tasks.workunit.client.0.smithi049.stdout:8/337: creat d1/d2/db/d15/d30/d4b/f82 x:0 0 0 2024-02-22T00:33:51.893 INFO:tasks.workunit.client.0.smithi049.stdout:4/395: mknod d3/d13/d48/d60/c81 0 2024-02-22T00:33:51.897 INFO:tasks.workunit.client.0.smithi049.stdout:2/443: creat d2/d9/dd/d4d/d5a/fa3 x:0 0 0 2024-02-22T00:33:51.901 INFO:tasks.workunit.client.0.smithi049.stdout:9/397: mkdir d17/d21/d85/d8d 0 2024-02-22T00:33:51.902 INFO:tasks.workunit.client.0.smithi049.stdout:9/398: dread - d17/d21/d47/f68 zero size 2024-02-22T00:33:51.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/396: readlink d3/d8/d10/l7f 0 2024-02-22T00:33:51.903 INFO:tasks.workunit.client.0.smithi049.stdout:2/444: mknod d2/d9/de/d10/d46/d7f/ca4 0 2024-02-22T00:33:51.904 INFO:tasks.workunit.client.0.smithi049.stdout:5/316: truncate d0/d39/d6/f12 391199 0 2024-02-22T00:33:51.905 INFO:tasks.workunit.client.0.smithi049.stdout:1/380: rename d2/d8/db/d25/d40/d41/d84/d86 to d2/d8/da/d8a 0 2024-02-22T00:33:51.906 INFO:tasks.workunit.client.0.smithi049.stdout:9/399: read d17/d21/f28 [513343,45782] 0 2024-02-22T00:33:51.906 INFO:tasks.workunit.client.0.smithi049.stdout:5/317: readlink d0/d26/l59 0 2024-02-22T00:33:51.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/381: chown d2/f31 144 1 2024-02-22T00:33:51.908 INFO:tasks.workunit.client.0.smithi049.stdout:4/397: read d3/d8/d10/f5d [1725998,65365] 0 2024-02-22T00:33:51.909 INFO:tasks.workunit.client.0.smithi049.stdout:1/382: fsync d2/d8/da/f61 0 2024-02-22T00:33:51.909 INFO:tasks.workunit.client.0.smithi049.stdout:5/318: creat d0/d20/f6e x:0 0 0 2024-02-22T00:33:51.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/338: rename d1/d2/d5/d1b/d39/d60/c69 to d1/d2/c83 0 2024-02-22T00:33:51.914 INFO:tasks.workunit.client.0.smithi049.stdout:4/398: write d3/d8/f17 [2140482,88173] 0 2024-02-22T00:33:51.915 INFO:tasks.workunit.client.0.smithi049.stdout:1/383: mkdir d2/d8/db/d25/d40/d41/d84/d8b 0 2024-02-22T00:33:51.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/400: dwrite d17/d21/f43 [0,4194304] 0 2024-02-22T00:33:51.920 INFO:tasks.workunit.client.0.smithi049.stdout:5/319: rename d0/d39 to d0/d26/d4d/d6f 0 2024-02-22T00:33:51.920 INFO:tasks.workunit.client.0.smithi049.stdout:9/401: stat d17/d1c/d38/f56 0 2024-02-22T00:33:51.921 INFO:tasks.workunit.client.0.smithi049.stdout:1/384: dread d2/f30 [0,4194304] 0 2024-02-22T00:33:51.928 INFO:tasks.workunit.client.0.smithi049.stdout:4/399: creat d3/d8/d10/d43/d4d/f82 x:0 0 0 2024-02-22T00:33:51.932 INFO:tasks.workunit.client.0.smithi049.stdout:2/445: dwrite d2/d9/de/d10/f12 [0,4194304] 0 2024-02-22T00:33:51.940 INFO:tasks.workunit.client.0.smithi049.stdout:9/402: truncate d17/d1c/f3b 914631 0 2024-02-22T00:33:51.946 INFO:tasks.workunit.client.0.smithi049.stdout:8/339: dwrite d1/d2/db/f16 [4194304,4194304] 0 2024-02-22T00:33:51.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/385: dread d2/d8/f13 [0,4194304] 0 2024-02-22T00:33:51.947 INFO:tasks.workunit.client.0.smithi049.stdout:8/340: fsync d1/d2/d5/d1b/f7f 0 2024-02-22T00:33:51.948 INFO:tasks.workunit.client.0.smithi049.stdout:5/320: mkdir d0/d26/d4d/d70 0 2024-02-22T00:33:51.949 INFO:tasks.workunit.client.0.smithi049.stdout:2/446: getdents d2/d9/dd/d4d/d72/d90 0 2024-02-22T00:33:51.950 INFO:tasks.workunit.client.0.smithi049.stdout:9/403: rename d17/d21/d3c/f3f to d17/d21/d4e/f8e 0 2024-02-22T00:33:51.953 INFO:tasks.workunit.client.0.smithi049.stdout:4/400: dwrite d3/d22/d5c/f5b [4194304,4194304] 0 2024-02-22T00:33:51.953 INFO:tasks.workunit.client.0.smithi049.stdout:9/404: fdatasync d17/d1c/f81 0 2024-02-22T00:33:51.954 INFO:tasks.workunit.client.0.smithi049.stdout:1/386: write d2/d8/db/d25/f2c [3105212,111374] 0 2024-02-22T00:33:51.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/447: creat d2/d9/de/d10/d2e/fa5 x:0 0 0 2024-02-22T00:33:51.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/321: chown d0/d20/d50/c29 7119611 1 2024-02-22T00:33:51.956 INFO:tasks.workunit.client.0.smithi049.stdout:8/341: truncate d1/d2/db/f78 4250924 0 2024-02-22T00:33:51.958 INFO:tasks.workunit.client.0.smithi049.stdout:5/322: chown d0/d20/l35 3 1 2024-02-22T00:33:51.978 INFO:tasks.workunit.client.0.smithi049.stdout:3/273: sync 2024-02-22T00:33:51.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/382: sync 2024-02-22T00:33:51.979 INFO:tasks.workunit.client.0.smithi049.stdout:2/448: rmdir d2/d9/de/d10/d2e/d42/d97 0 2024-02-22T00:33:51.980 INFO:tasks.workunit.client.0.smithi049.stdout:8/342: mknod d1/d2/db/d15/d33/c84 0 2024-02-22T00:33:51.985 INFO:tasks.workunit.client.0.smithi049.stdout:8/343: fsync d1/d2/f27 0 2024-02-22T00:33:51.988 INFO:tasks.workunit.client.0.smithi049.stdout:2/449: fsync d2/d9/de/d10/d46/d63/f6c 0 2024-02-22T00:33:51.988 INFO:tasks.workunit.client.0.smithi049.stdout:1/387: dwrite d2/f47 [0,4194304] 0 2024-02-22T00:33:51.993 INFO:tasks.workunit.client.0.smithi049.stdout:8/344: fsync d1/d2/f25 0 2024-02-22T00:33:51.994 INFO:tasks.workunit.client.0.smithi049.stdout:9/405: dwrite d17/d21/f28 [0,4194304] 0 2024-02-22T00:33:51.995 INFO:tasks.workunit.client.0.smithi049.stdout:2/450: fsync d2/d9/de/d15/d1b/f96 0 2024-02-22T00:33:51.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/323: truncate d0/f37 5199538 0 2024-02-22T00:33:51.996 INFO:tasks.workunit.client.0.smithi049.stdout:1/388: chown d2/d8/c2e 21532 1 2024-02-22T00:33:52.000 INFO:tasks.workunit.client.0.smithi049.stdout:5/324: write d0/d20/d50/f36 [2050924,63983] 0 2024-02-22T00:33:52.000 INFO:tasks.workunit.client.0.smithi049.stdout:9/406: chown d17/d21/d3c/l42 7 1 2024-02-22T00:33:52.001 INFO:tasks.workunit.client.0.smithi049.stdout:2/451: mkdir d2/d9/de/d3a/d6d/da6 0 2024-02-22T00:33:52.003 INFO:tasks.workunit.client.0.smithi049.stdout:1/389: symlink d2/d8/db/d25/d40/d41/d84/l8c 0 2024-02-22T00:33:52.004 INFO:tasks.workunit.client.0.smithi049.stdout:3/274: dwrite d0/dd/d2f/f42 [4194304,4194304] 0 2024-02-22T00:33:52.004 INFO:tasks.workunit.client.0.smithi049.stdout:9/407: write d17/d1c/d38/f74 [110941,15060] 0 2024-02-22T00:33:52.006 INFO:tasks.workunit.client.0.smithi049.stdout:5/325: creat d0/d20/d50/d24/f71 x:0 0 0 2024-02-22T00:33:52.007 INFO:tasks.workunit.client.0.smithi049.stdout:9/408: rename d17/d1c to d17/d1c/d25/d71/d8f 22 2024-02-22T00:33:52.009 INFO:tasks.workunit.client.0.smithi049.stdout:1/390: dread d2/d8/f6a [0,4194304] 0 2024-02-22T00:33:52.012 INFO:tasks.workunit.client.0.smithi049.stdout:9/409: mkdir d17/d1c/d25/d39/d90 0 2024-02-22T00:33:52.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/275: rename d0/dd/d28 to d0/d14/d4d 0 2024-02-22T00:33:52.021 INFO:tasks.workunit.client.0.smithi049.stdout:5/326: dwrite d0/f48 [0,4194304] 0 2024-02-22T00:33:52.021 INFO:tasks.workunit.client.0.smithi049.stdout:9/410: fdatasync d17/d1c/f3b 0 2024-02-22T00:33:52.027 INFO:tasks.workunit.client.0.smithi049.stdout:9/411: chown d17/d21/d85/l86 16 1 2024-02-22T00:33:52.030 INFO:tasks.workunit.client.0.smithi049.stdout:3/276: dwrite d0/f6 [0,4194304] 0 2024-02-22T00:33:52.033 INFO:tasks.workunit.client.0.smithi049.stdout:8/345: dwrite d1/d2/d5/d1b/d39/f7c [0,4194304] 0 2024-02-22T00:33:52.036 INFO:tasks.workunit.client.0.smithi049.stdout:1/391: dread d2/d8/da/f1e [0,4194304] 0 2024-02-22T00:33:52.040 INFO:tasks.workunit.client.0.smithi049.stdout:3/277: mkdir d0/d14/d4d/d4e 0 2024-02-22T00:33:52.040 INFO:tasks.workunit.client.0.smithi049.stdout:9/412: symlink d17/d21/d4e/l91 0 2024-02-22T00:33:52.045 INFO:tasks.workunit.client.0.smithi049.stdout:9/413: dread d17/d1c/d38/f74 [0,4194304] 0 2024-02-22T00:33:52.046 INFO:tasks.workunit.client.0.smithi049.stdout:1/392: symlink d2/d8/db/d25/d40/d41/d5b/l8d 0 2024-02-22T00:33:52.051 INFO:tasks.workunit.client.0.smithi049.stdout:8/346: dwrite d1/d2/db/d15/d30/f71 [0,4194304] 0 2024-02-22T00:33:52.052 INFO:tasks.workunit.client.0.smithi049.stdout:9/414: write d17/d21/f29 [3892931,122963] 0 2024-02-22T00:33:52.057 INFO:tasks.workunit.client.0.smithi049.stdout:1/393: rmdir d2/d8/db/d25/d40/d41/d84 39 2024-02-22T00:33:52.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/327: write d0/f37 [4487284,11725] 0 2024-02-22T00:33:52.059 INFO:tasks.workunit.client.0.smithi049.stdout:5/328: chown d0/d20/d50/d24/d3b/f66 884 1 2024-02-22T00:33:52.060 INFO:tasks.workunit.client.0.smithi049.stdout:3/278: dwrite d0/f16 [0,4194304] 0 2024-02-22T00:33:52.063 INFO:tasks.workunit.client.0.smithi049.stdout:9/415: link d17/f51 d17/d21/d85/d8d/f92 0 2024-02-22T00:33:52.065 INFO:tasks.workunit.client.0.smithi049.stdout:1/394: creat d2/d8/d4c/f8e x:0 0 0 2024-02-22T00:33:52.068 INFO:tasks.workunit.client.0.smithi049.stdout:5/329: rmdir d0/d20/d6b 0 2024-02-22T00:33:52.069 INFO:tasks.workunit.client.0.smithi049.stdout:3/279: mkdir d0/d14/d4d/d4e/d4f 0 2024-02-22T00:33:52.069 INFO:tasks.workunit.client.0.smithi049.stdout:9/416: chown d17/d1c/c31 46761 1 2024-02-22T00:33:52.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/330: fsync d0/d20/d50/d24/d3b/d5b/f67 0 2024-02-22T00:33:52.073 INFO:tasks.workunit.client.0.smithi049.stdout:3/280: write d0/dd/f3 [2517541,56499] 0 2024-02-22T00:33:52.075 INFO:tasks.workunit.client.0.smithi049.stdout:5/331: chown d0/d20/l35 324 1 2024-02-22T00:33:52.075 INFO:tasks.workunit.client.0.smithi049.stdout:9/417: creat d17/d21/f93 x:0 0 0 2024-02-22T00:33:52.075 INFO:tasks.workunit.client.0.smithi049.stdout:1/395: dwrite d2/d8/da/f14 [4194304,4194304] 0 2024-02-22T00:33:52.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/281: mknod d0/c50 0 2024-02-22T00:33:52.081 INFO:tasks.workunit.client.0.smithi049.stdout:9/418: mkdir d17/d21/d4e/d89/d94 0 2024-02-22T00:33:52.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/282: write d0/dd/f48 [5038672,85489] 0 2024-02-22T00:33:52.087 INFO:tasks.workunit.client.0.smithi049.stdout:5/332: dwrite d0/f63 [0,4194304] 0 2024-02-22T00:33:52.091 INFO:tasks.workunit.client.0.smithi049.stdout:5/333: read - d0/d26/d4d/d6f/f5e zero size 2024-02-22T00:33:52.092 INFO:tasks.workunit.client.0.smithi049.stdout:8/347: dwrite d1/d2/d5/d1b/d39/f72 [0,4194304] 0 2024-02-22T00:33:52.093 INFO:tasks.workunit.client.0.smithi049.stdout:8/348: write d1/d2/db/d15/f23 [760586,106953] 0 2024-02-22T00:33:52.095 INFO:tasks.workunit.client.0.smithi049.stdout:3/283: stat d0/c40 0 2024-02-22T00:33:52.097 INFO:tasks.workunit.client.0.smithi049.stdout:5/334: creat d0/d26/d4d/d6f/d6/f72 x:0 0 0 2024-02-22T00:33:52.106 INFO:tasks.workunit.client.0.smithi049.stdout:3/284: dread d0/d14/f21 [0,4194304] 0 2024-02-22T00:33:52.110 INFO:tasks.workunit.client.0.smithi049.stdout:8/349: dwrite d1/d2/db/d15/d30/d36/d53/f47 [0,4194304] 0 2024-02-22T00:33:52.114 INFO:tasks.workunit.client.0.smithi049.stdout:5/335: dwrite d0/f4e [0,4194304] 0 2024-02-22T00:33:52.114 INFO:tasks.workunit.client.0.smithi049.stdout:3/285: chown d0/dd/d2f/l3d 5 1 2024-02-22T00:33:52.117 INFO:tasks.workunit.client.0.smithi049.stdout:8/350: write d1/d2/f3 [719606,57728] 0 2024-02-22T00:33:52.122 INFO:tasks.workunit.client.0.smithi049.stdout:3/286: creat d0/dd/d26/d2e/f51 x:0 0 0 2024-02-22T00:33:52.123 INFO:tasks.workunit.client.0.smithi049.stdout:9/419: dwrite d17/d1c/d25/f34 [0,4194304] 0 2024-02-22T00:33:52.126 INFO:tasks.workunit.client.0.smithi049.stdout:3/287: dread - d0/d14/f1b zero size 2024-02-22T00:33:52.127 INFO:tasks.workunit.client.0.smithi049.stdout:5/336: dwrite d0/d20/d50/f36 [0,4194304] 0 2024-02-22T00:33:52.128 INFO:tasks.workunit.client.0.smithi049.stdout:8/351: dread d1/f1e [0,4194304] 0 2024-02-22T00:33:52.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/352: chown d1/d2/db/d15/d33/f48 0 1 2024-02-22T00:33:52.131 INFO:tasks.workunit.client.0.smithi049.stdout:9/420: truncate d17/d1c/f3b 529999 0 2024-02-22T00:33:52.132 INFO:tasks.workunit.client.0.smithi049.stdout:5/337: mknod d0/d26/d4d/c73 0 2024-02-22T00:33:52.133 INFO:tasks.workunit.client.0.smithi049.stdout:3/288: chown d0/d14/d4d/l4b 406178 1 2024-02-22T00:33:52.134 INFO:tasks.workunit.client.0.smithi049.stdout:5/338: read d0/d26/d4d/d6f/d6/f51 [508593,4117] 0 2024-02-22T00:33:52.134 INFO:tasks.workunit.client.0.smithi049.stdout:8/353: chown d1/d2/db/d15/d30/d36/d52/l74 9 1 2024-02-22T00:33:52.136 INFO:tasks.workunit.client.0.smithi049.stdout:9/421: rename d17/f1a to d17/d1c/d25/f95 0 2024-02-22T00:33:52.137 INFO:tasks.workunit.client.0.smithi049.stdout:9/422: chown d17/d1c/d25/f34 0 1 2024-02-22T00:33:52.140 INFO:tasks.workunit.client.0.smithi049.stdout:8/354: rmdir d1/d2 39 2024-02-22T00:33:52.140 INFO:tasks.workunit.client.0.smithi049.stdout:9/423: write d17/f6c [860534,125556] 0 2024-02-22T00:33:52.145 INFO:tasks.workunit.client.0.smithi049.stdout:8/355: write d1/fe [4278493,23116] 0 2024-02-22T00:33:52.146 INFO:tasks.workunit.client.0.smithi049.stdout:5/339: dwrite d0/d20/d50/d24/f71 [0,4194304] 0 2024-02-22T00:33:52.147 INFO:tasks.workunit.client.0.smithi049.stdout:6/342: sync 2024-02-22T00:33:52.149 INFO:tasks.workunit.client.0.smithi049.stdout:6/343: fsync d3/d16/f4f 0 2024-02-22T00:33:52.149 INFO:tasks.workunit.client.0.smithi049.stdout:5/340: mkdir d0/d26/d4d/d6f/d6/d74 0 2024-02-22T00:33:52.150 INFO:tasks.workunit.client.0.smithi049.stdout:8/356: fdatasync d1/d2/d5/d1b/d39/f6c 0 2024-02-22T00:33:52.167 INFO:tasks.workunit.client.0.smithi049.stdout:9/424: dwrite d17/d1c/d25/d39/f5b [0,4194304] 0 2024-02-22T00:33:52.167 INFO:tasks.workunit.client.0.smithi049.stdout:8/357: truncate d1/d2/d5/d1b/d39/f72 1490996 0 2024-02-22T00:33:52.170 INFO:tasks.workunit.client.0.smithi049.stdout:8/358: chown d1/d2/db/d1c/c5b 0 1 2024-02-22T00:33:52.171 INFO:tasks.workunit.client.0.smithi049.stdout:9/425: write d17/d1c/d25/d39/f88 [628641,50534] 0 2024-02-22T00:33:52.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/426: stat d17/d21/d47/f68 0 2024-02-22T00:33:52.174 INFO:tasks.workunit.client.0.smithi049.stdout:8/359: creat d1/d4c/f85 x:0 0 0 2024-02-22T00:33:52.174 INFO:tasks.workunit.client.0.smithi049.stdout:5/341: dwrite d0/d20/d50/d24/f3f [0,4194304] 0 2024-02-22T00:33:52.175 INFO:tasks.workunit.client.0.smithi049.stdout:3/289: dread d0/d14/d4d/f36 [0,4194304] 0 2024-02-22T00:33:52.214 INFO:tasks.workunit.client.0.smithi049.stdout:3/290: chown d0/dd/d2f/l3d 55 1 2024-02-22T00:33:52.218 INFO:tasks.workunit.client.0.smithi049.stdout:8/360: symlink d1/d4c/l86 0 2024-02-22T00:33:52.224 INFO:tasks.workunit.client.0.smithi049.stdout:8/361: truncate d1/d2/f27 6687014 0 2024-02-22T00:33:52.224 INFO:tasks.workunit.client.0.smithi049.stdout:5/342: creat d0/d20/d50/d24/f75 x:0 0 0 2024-02-22T00:33:52.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/427: dwrite d17/d1c/f63 [0,4194304] 0 2024-02-22T00:33:52.227 INFO:tasks.workunit.client.0.smithi049.stdout:5/343: unlink d0/d26/f3c 0 2024-02-22T00:33:52.227 INFO:tasks.workunit.client.0.smithi049.stdout:9/428: stat f14 0 2024-02-22T00:33:52.231 INFO:tasks.workunit.client.0.smithi049.stdout:3/291: dwrite d0/dd/d26/f30 [0,4194304] 0 2024-02-22T00:33:52.232 INFO:tasks.workunit.client.0.smithi049.stdout:5/344: fdatasync d0/d20/f6a 0 2024-02-22T00:33:52.235 INFO:tasks.workunit.client.0.smithi049.stdout:9/429: unlink d17/d21/d47/d5d/c8b 0 2024-02-22T00:33:52.237 INFO:tasks.workunit.client.0.smithi049.stdout:8/362: rename d1/d2/db/d15/d33/c6f to d1/d2/db/d15/d30/c87 0 2024-02-22T00:33:52.241 INFO:tasks.workunit.client.0.smithi049.stdout:8/363: write d1/d2/db/d15/d33/f4a [3062560,88980] 0 2024-02-22T00:33:52.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/292: dwrite d0/dd/f9 [4194304,4194304] 0 2024-02-22T00:33:52.245 INFO:tasks.workunit.client.0.smithi049.stdout:3/293: fsync d0/f6 0 2024-02-22T00:33:52.245 INFO:tasks.workunit.client.0.smithi049.stdout:8/364: symlink d1/d2/d5/l88 0 2024-02-22T00:33:52.250 INFO:tasks.workunit.client.0.smithi049.stdout:5/345: dwrite d0/f1d [0,4194304] 0 2024-02-22T00:33:52.250 INFO:tasks.workunit.client.0.smithi049.stdout:3/294: unlink d0/l2d 0 2024-02-22T00:33:52.255 INFO:tasks.workunit.client.0.smithi049.stdout:3/295: mkdir d0/dd/d26/d2e/d52 0 2024-02-22T00:33:52.258 INFO:tasks.workunit.client.0.smithi049.stdout:3/296: rename d0/dd/l3c to d0/dd/d26/d2e/d52/l53 0 2024-02-22T00:33:52.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/297: write d0/d14/f1b [341209,56970] 0 2024-02-22T00:33:52.262 INFO:tasks.workunit.client.0.smithi049.stdout:5/346: link d0/d26/d4d/d6f/c19 d0/d26/d4d/d6f/c76 0 2024-02-22T00:33:52.263 INFO:tasks.workunit.client.0.smithi049.stdout:3/298: truncate d0/dd/f13 1092278 0 2024-02-22T00:33:52.263 INFO:tasks.workunit.client.0.smithi049.stdout:5/347: chown d0/d26/d4d/d6f/l2d 27 1 2024-02-22T00:33:52.265 INFO:tasks.workunit.client.0.smithi049.stdout:5/348: rename d0/d20/d50/d24/d54 to d0/d20/d50/d24/d54/d77 22 2024-02-22T00:33:52.277 INFO:tasks.workunit.client.0.smithi049.stdout:9/430: dread d17/d1c/d25/f60 [0,4194304] 0 2024-02-22T00:33:52.278 INFO:tasks.workunit.client.0.smithi049.stdout:9/431: chown d17/d1c/f2c 457 1 2024-02-22T00:33:52.280 INFO:tasks.workunit.client.0.smithi049.stdout:9/432: chown d17/d1c/d25/d71/f7d 3917 1 2024-02-22T00:33:52.281 INFO:tasks.workunit.client.0.smithi049.stdout:3/299: truncate d0/dd/f3 671478 0 2024-02-22T00:33:52.281 INFO:tasks.workunit.client.0.smithi049.stdout:3/300: readlink d0/d14/l23 0 2024-02-22T00:33:52.282 INFO:tasks.workunit.client.0.smithi049.stdout:9/433: mknod d17/d21/d4e/c96 0 2024-02-22T00:33:52.283 INFO:tasks.workunit.client.0.smithi049.stdout:3/301: write d0/dd/d1e/f24 [6653141,98544] 0 2024-02-22T00:33:52.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/349: write d0/d26/d4d/d6f/d6/f12 [204536,87967] 0 2024-02-22T00:33:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:9/434: dread d17/d1c/d25/f60 [0,4194304] 0 2024-02-22T00:33:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:3/302: write d0/d14/f21 [5575985,59072] 0 2024-02-22T00:33:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:5/350: dwrite d0/d20/d50/d24/f75 [0,4194304] 0 2024-02-22T00:33:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:9/435: chown d17/d1c/d25/d39/d90 117 1 2024-02-22T00:33:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/303: rmdir d0/dd/d26 39 2024-02-22T00:33:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:3/304: rmdir d0/d14/d4d/d4e 39 2024-02-22T00:33:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:5/351: mknod d0/d26/d4d/d70/c78 0 2024-02-22T00:33:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:9/436: dwrite d17/d21/f46 [0,4194304] 0 2024-02-22T00:33:52.306 INFO:tasks.workunit.client.0.smithi049.stdout:3/305: dwrite d0/dd/d1e/f24 [0,4194304] 0 2024-02-22T00:33:52.307 INFO:tasks.workunit.client.0.smithi049.stdout:9/437: unlink d17/d1c/d25/d39/l57 0 2024-02-22T00:33:52.307 INFO:tasks.workunit.client.0.smithi049.stdout:5/352: link d0/d26/d4d/d6f/c76 d0/d26/d4d/d6f/c79 0 2024-02-22T00:33:52.312 INFO:tasks.workunit.client.0.smithi049.stdout:9/438: rename d17/d21/d47/d5d/l79 to d17/d1c/d25/l97 0 2024-02-22T00:33:52.312 INFO:tasks.workunit.client.0.smithi049.stdout:3/306: dread d0/f6 [0,4194304] 0 2024-02-22T00:33:52.315 INFO:tasks.workunit.client.0.smithi049.stdout:5/353: dwrite d0/f48 [0,4194304] 0 2024-02-22T00:33:52.317 INFO:tasks.workunit.client.0.smithi049.stdout:9/439: getdents d17/d1c/d38 0 2024-02-22T00:33:52.317 INFO:tasks.workunit.client.0.smithi049.stdout:3/307: creat d0/dd/d26/d2e/f54 x:0 0 0 2024-02-22T00:33:52.320 INFO:tasks.workunit.client.0.smithi049.stdout:3/308: truncate d0/dd/d26/d2e/f51 137810 0 2024-02-22T00:33:52.325 INFO:tasks.workunit.client.0.smithi049.stdout:9/440: dwrite d17/d21/f28 [4194304,4194304] 0 2024-02-22T00:33:52.326 INFO:tasks.workunit.client.0.smithi049.stdout:3/309: truncate d0/dd/f3 1488349 0 2024-02-22T00:33:52.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/310: dread - d0/dd/f4c zero size 2024-02-22T00:33:52.330 INFO:tasks.workunit.client.0.smithi049.stdout:9/441: creat d17/d21/d47/d7a/f98 x:0 0 0 2024-02-22T00:33:52.339 INFO:tasks.workunit.client.0.smithi049.stdout:3/311: getdents d0/dd/d26/d2e 0 2024-02-22T00:33:52.343 INFO:tasks.workunit.client.0.smithi049.stdout:3/312: symlink d0/dd/d26/d2e/l55 0 2024-02-22T00:33:52.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/442: dwrite d17/d21/d3c/f59 [0,4194304] 0 2024-02-22T00:33:52.345 INFO:tasks.workunit.client.0.smithi049.stdout:9/443: chown d17/d21/d47/d7a 318 1 2024-02-22T00:33:52.349 INFO:tasks.workunit.client.0.smithi049.stdout:3/313: mkdir d0/d14/d4d/d4e/d56 0 2024-02-22T00:33:52.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/314: write d0/dd/d26/d2e/f51 [295794,47173] 0 2024-02-22T00:33:52.354 INFO:tasks.workunit.client.0.smithi049.stdout:3/315: creat d0/d14/f57 x:0 0 0 2024-02-22T00:33:52.356 INFO:tasks.workunit.client.0.smithi049.stdout:9/444: truncate d17/d1c/d25/f7b 2980130 0 2024-02-22T00:33:52.357 INFO:tasks.workunit.client.0.smithi049.stdout:3/316: creat d0/f58 x:0 0 0 2024-02-22T00:33:52.361 INFO:tasks.workunit.client.0.smithi049.stdout:3/317: rename d0/dd/d2f to d0/d59 0 2024-02-22T00:33:52.364 INFO:tasks.workunit.client.0.smithi049.stdout:3/318: mkdir d0/d14/d4d/d4e/d56/d5a 0 2024-02-22T00:33:52.371 INFO:tasks.workunit.client.0.smithi049.stdout:3/319: dwrite d0/d14/f57 [0,4194304] 0 2024-02-22T00:33:52.380 INFO:tasks.workunit.client.0.smithi049.stdout:9/445: dread d17/d1c/d25/d39/f3a [0,4194304] 0 2024-02-22T00:33:52.382 INFO:tasks.workunit.client.0.smithi049.stdout:9/446: chown d17/d21/d47/f5e 3 1 2024-02-22T00:33:52.383 INFO:tasks.workunit.client.0.smithi049.stdout:3/320: dwrite d0/dd/f13 [0,4194304] 0 2024-02-22T00:33:52.386 INFO:tasks.workunit.client.0.smithi049.stdout:3/321: rmdir d0/d14/d4d/d4e 39 2024-02-22T00:33:52.387 INFO:tasks.workunit.client.0.smithi049.stdout:3/322: write d0/f58 [926739,22111] 0 2024-02-22T00:33:52.388 INFO:tasks.workunit.client.0.smithi049.stdout:3/323: fsync d0/d14/f57 0 2024-02-22T00:33:52.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/324: dwrite d0/f6 [0,4194304] 0 2024-02-22T00:33:52.406 INFO:tasks.workunit.client.0.smithi049.stdout:3/325: mkdir d0/d14/d4d/d4e/d4f/d5b 0 2024-02-22T00:33:52.408 INFO:tasks.workunit.client.0.smithi049.stdout:3/326: fsync d0/dd/f46 0 2024-02-22T00:33:52.409 INFO:tasks.workunit.client.0.smithi049.stdout:3/327: fdatasync d0/dd/f46 0 2024-02-22T00:33:52.410 INFO:tasks.workunit.client.0.smithi049.stdout:3/328: dread - d0/dd/d26/d2e/f44 zero size 2024-02-22T00:33:52.411 INFO:tasks.workunit.client.0.smithi049.stdout:9/447: dread d17/d1c/f2b [0,4194304] 0 2024-02-22T00:33:52.412 INFO:tasks.workunit.client.0.smithi049.stdout:3/329: creat d0/d14/f5c x:0 0 0 2024-02-22T00:33:52.414 INFO:tasks.workunit.client.0.smithi049.stdout:9/448: mknod d17/d21/d47/c99 0 2024-02-22T00:33:52.415 INFO:tasks.workunit.client.0.smithi049.stdout:3/330: rmdir d0/d14/d4d 39 2024-02-22T00:33:52.416 INFO:tasks.workunit.client.0.smithi049.stdout:3/331: write d0/dd/d26/f30 [4117613,105046] 0 2024-02-22T00:33:52.416 INFO:tasks.workunit.client.0.smithi049.stdout:9/449: symlink d17/d1c/d25/d71/d73/l9a 0 2024-02-22T00:33:52.419 INFO:tasks.workunit.client.0.smithi049.stdout:3/332: dread d0/d14/f1b [0,4194304] 0 2024-02-22T00:33:52.420 INFO:tasks.workunit.client.0.smithi049.stdout:9/450: unlink d17/d21/d4e/c96 0 2024-02-22T00:33:52.422 INFO:tasks.workunit.client.0.smithi049.stdout:3/333: truncate d0/dd/d26/d2e/f4a 5352274 0 2024-02-22T00:33:52.422 INFO:tasks.workunit.client.0.smithi049.stdout:9/451: rmdir d17/d1c/d25/d39/d67 39 2024-02-22T00:33:52.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/334: chown d0/dd/d26/d2e/d52/l53 272 1 2024-02-22T00:33:52.427 INFO:tasks.workunit.client.0.smithi049.stdout:9/452: rename d17/d1c/d25/d39/f5b to d17/d21/d4e/d89/d94/f9b 0 2024-02-22T00:33:52.427 INFO:tasks.workunit.client.0.smithi049.stdout:3/335: write d0/d14/f1d [5076350,7258] 0 2024-02-22T00:33:52.428 INFO:tasks.workunit.client.0.smithi049.stdout:3/336: fsync d0/dd/f46 0 2024-02-22T00:33:52.430 INFO:tasks.workunit.client.0.smithi049.stdout:9/453: rename d17/c19 to d17/d1c/d25/d39/d67/c9c 0 2024-02-22T00:33:52.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/337: dwrite d0/d59/f42 [0,4194304] 0 2024-02-22T00:33:52.436 INFO:tasks.workunit.client.0.smithi049.stdout:9/454: dread d17/d1c/d25/f60 [0,4194304] 0 2024-02-22T00:33:52.437 INFO:tasks.workunit.client.0.smithi049.stdout:3/338: truncate d0/dd/f46 1573026 0 2024-02-22T00:33:52.438 INFO:tasks.workunit.client.0.smithi049.stdout:9/455: write d17/d1c/d25/d39/f88 [1525153,97251] 0 2024-02-22T00:33:52.441 INFO:tasks.workunit.client.0.smithi049.stdout:9/456: symlink d17/l9d 0 2024-02-22T00:33:52.442 INFO:tasks.workunit.client.0.smithi049.stdout:3/339: symlink d0/d14/d4d/l5d 0 2024-02-22T00:33:52.443 INFO:tasks.workunit.client.0.smithi049.stdout:3/340: write d0/dd/f46 [692559,56357] 0 2024-02-22T00:33:52.445 INFO:tasks.workunit.client.0.smithi049.stdout:9/457: creat d17/d1c/d25/d39/d90/f9e x:0 0 0 2024-02-22T00:33:52.448 INFO:tasks.workunit.client.0.smithi049.stdout:3/341: mknod d0/d14/c5e 0 2024-02-22T00:33:52.449 INFO:tasks.workunit.client.0.smithi049.stdout:9/458: rmdir d17/d21/d4e/d89 39 2024-02-22T00:33:52.451 INFO:tasks.workunit.client.0.smithi049.stdout:9/459: write d17/d1c/d25/d39/d90/f9e [94028,86190] 0 2024-02-22T00:33:52.456 INFO:tasks.workunit.client.0.smithi049.stdout:3/342: truncate d0/dd/f9 1656763 0 2024-02-22T00:33:52.457 INFO:tasks.workunit.client.0.smithi049.stdout:3/343: fdatasync d0/f58 0 2024-02-22T00:33:52.460 INFO:tasks.workunit.client.0.smithi049.stdout:3/344: unlink d0/l29 0 2024-02-22T00:33:52.465 INFO:tasks.workunit.client.0.smithi049.stdout:9/460: dread d17/d1c/d25/f7b [0,4194304] 0 2024-02-22T00:33:52.467 INFO:tasks.workunit.client.0.smithi049.stdout:3/345: dwrite d0/d14/f57 [0,4194304] 0 2024-02-22T00:33:52.472 INFO:tasks.workunit.client.0.smithi049.stdout:9/461: creat d17/d21/d47/d5d/f9f x:0 0 0 2024-02-22T00:33:52.472 INFO:tasks.workunit.client.0.smithi049.stdout:9/462: chown d17/d1c/d38/f74 4989835 1 2024-02-22T00:33:52.473 INFO:tasks.workunit.client.0.smithi049.stdout:0/325: sync 2024-02-22T00:33:52.473 INFO:tasks.workunit.client.0.smithi049.stdout:7/383: sync 2024-02-22T00:33:52.473 INFO:tasks.workunit.client.0.smithi049.stdout:4/401: sync 2024-02-22T00:33:52.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/463: write d17/d21/f5c [741808,57009] 0 2024-02-22T00:33:52.479 INFO:tasks.workunit.client.0.smithi049.stdout:3/346: truncate d0/d59/f42 1449843 0 2024-02-22T00:33:52.482 INFO:tasks.workunit.client.0.smithi049.stdout:7/384: mkdir d1/d41/d55/d89 0 2024-02-22T00:33:52.485 INFO:tasks.workunit.client.0.smithi049.stdout:9/464: read d17/f18 [784974,103747] 0 2024-02-22T00:33:52.488 INFO:tasks.workunit.client.0.smithi049.stdout:9/465: fdatasync d17/f6c 0 2024-02-22T00:33:52.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/326: dwrite d3/d6/d8/f46 [0,4194304] 0 2024-02-22T00:33:52.488 INFO:tasks.workunit.client.0.smithi049.stdout:7/385: chown d1/df/d62/d57/f65 187939375 1 2024-02-22T00:33:52.489 INFO:tasks.workunit.client.0.smithi049.stdout:4/402: dwrite d3/d22/d5c/f36 [0,4194304] 0 2024-02-22T00:33:52.494 INFO:tasks.workunit.client.0.smithi049.stdout:3/347: dread d0/dd/f46 [0,4194304] 0 2024-02-22T00:33:52.494 INFO:tasks.workunit.client.0.smithi049.stdout:7/386: read d1/d41/d28/f39 [924760,114017] 0 2024-02-22T00:33:52.495 INFO:tasks.workunit.client.0.smithi049.stdout:7/387: readlink d1/df/d62/l1a 0 2024-02-22T00:33:52.497 INFO:tasks.workunit.client.0.smithi049.stdout:9/466: write d17/d21/d4e/d89/d94/f9b [148018,122849] 0 2024-02-22T00:33:52.500 INFO:tasks.workunit.client.0.smithi049.stdout:4/403: unlink d3/d8/d10/d12/l69 0 2024-02-22T00:33:52.502 INFO:tasks.workunit.client.0.smithi049.stdout:0/327: mknod d3/d1e/c55 0 2024-02-22T00:33:52.502 INFO:tasks.workunit.client.0.smithi049.stdout:0/328: stat d3/d6/d29 0 2024-02-22T00:33:52.508 INFO:tasks.workunit.client.0.smithi049.stdout:9/467: dread d17/d21/f33 [0,4194304] 0 2024-02-22T00:33:52.508 INFO:tasks.workunit.client.0.smithi049.stdout:7/388: truncate d1/fe 402924 0 2024-02-22T00:33:52.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/404: rmdir d3/d33 39 2024-02-22T00:33:52.511 INFO:tasks.workunit.client.0.smithi049.stdout:3/348: getdents d0/dd 0 2024-02-22T00:33:52.512 INFO:tasks.workunit.client.0.smithi049.stdout:7/389: unlink d1/d41/d28/c38 0 2024-02-22T00:33:52.513 INFO:tasks.workunit.client.0.smithi049.stdout:3/349: write d0/d14/f1d [5154685,123029] 0 2024-02-22T00:33:52.514 INFO:tasks.workunit.client.0.smithi049.stdout:0/329: rename d3/d6/l47 to d3/l56 0 2024-02-22T00:33:52.515 INFO:tasks.workunit.client.0.smithi049.stdout:9/468: dread d17/d1c/d25/f60 [0,4194304] 0 2024-02-22T00:33:52.516 INFO:tasks.workunit.client.0.smithi049.stdout:3/350: readlink d0/l25 0 2024-02-22T00:33:52.518 INFO:tasks.workunit.client.0.smithi049.stdout:0/330: unlink d3/df/d17/d1b/f28 0 2024-02-22T00:33:52.519 INFO:tasks.workunit.client.0.smithi049.stdout:3/351: rmdir d0/d14 39 2024-02-22T00:33:52.521 INFO:tasks.workunit.client.0.smithi049.stdout:9/469: creat d17/d21/d47/d7a/fa0 x:0 0 0 2024-02-22T00:33:52.521 INFO:tasks.workunit.client.0.smithi049.stdout:7/390: link d1/df/d62/d48/l54 d1/d49/l8a 0 2024-02-22T00:33:52.522 INFO:tasks.workunit.client.0.smithi049.stdout:7/391: chown d1/d41/d28 0 1 2024-02-22T00:33:52.523 INFO:tasks.workunit.client.0.smithi049.stdout:0/331: dread d3/d6/d8/f46 [0,4194304] 0 2024-02-22T00:33:52.524 INFO:tasks.workunit.client.0.smithi049.stdout:9/470: write d17/d21/d47/f5e [481094,67639] 0 2024-02-22T00:33:52.525 INFO:tasks.workunit.client.0.smithi049.stdout:3/352: symlink d0/d14/d4d/d4e/l5f 0 2024-02-22T00:33:52.526 INFO:tasks.workunit.client.0.smithi049.stdout:9/471: write d17/d1c/d25/f34 [4687792,37001] 0 2024-02-22T00:33:52.530 INFO:tasks.workunit.client.0.smithi049.stdout:3/353: write d0/dd/f46 [1023283,49247] 0 2024-02-22T00:33:52.533 INFO:tasks.workunit.client.0.smithi049.stdout:0/332: mknod d3/df/d17/c57 0 2024-02-22T00:33:52.533 INFO:tasks.workunit.client.0.smithi049.stdout:3/354: truncate d0/f58 1391071 0 2024-02-22T00:33:52.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/472: symlink d17/d21/d85/d8d/la1 0 2024-02-22T00:33:52.539 INFO:tasks.workunit.client.0.smithi049.stdout:7/392: dread d1/d41/d28/f36 [0,4194304] 0 2024-02-22T00:33:52.542 INFO:tasks.workunit.client.0.smithi049.stdout:9/473: write d17/d21/d47/d5d/f6b [3658150,22425] 0 2024-02-22T00:33:52.545 INFO:tasks.workunit.client.0.smithi049.stdout:3/355: getdents d0 0 2024-02-22T00:33:52.545 INFO:tasks.workunit.client.0.smithi049.stdout:9/474: chown d17/d21/d4e/d89/d94/f9b 4589847 1 2024-02-22T00:33:52.546 INFO:tasks.workunit.client.0.smithi049.stdout:0/333: dwrite d3/df/d48/f52 [0,4194304] 0 2024-02-22T00:33:52.552 INFO:tasks.workunit.client.0.smithi049.stdout:9/475: write d17/d21/d4e/d89/d94/f9b [4484062,25376] 0 2024-02-22T00:33:52.558 INFO:tasks.workunit.client.0.smithi049.stdout:3/356: truncate d0/dd/d1e/f24 2249044 0 2024-02-22T00:33:52.561 INFO:tasks.workunit.client.0.smithi049.stdout:0/334: mkdir d3/d1e/d58 0 2024-02-22T00:33:52.561 INFO:tasks.workunit.client.0.smithi049.stdout:3/357: rmdir d0/d14/d4d/d4e 39 2024-02-22T00:33:52.562 INFO:tasks.workunit.client.0.smithi049.stdout:0/335: stat d3/f43 0 2024-02-22T00:33:52.564 INFO:tasks.workunit.client.0.smithi049.stdout:9/476: dwrite d17/d1c/f63 [0,4194304] 0 2024-02-22T00:33:52.564 INFO:tasks.workunit.client.0.smithi049.stdout:7/393: dread d1/d41/f63 [0,4194304] 0 2024-02-22T00:33:52.564 INFO:tasks.workunit.client.0.smithi049.stdout:3/358: chown d0/dd/d26/d2e/f51 54500003 1 2024-02-22T00:33:52.566 INFO:tasks.workunit.client.0.smithi049.stdout:0/336: unlink d3/d6/c18 0 2024-02-22T00:33:52.568 INFO:tasks.workunit.client.0.smithi049.stdout:3/359: mknod d0/dd/d26/c60 0 2024-02-22T00:33:52.569 INFO:tasks.workunit.client.0.smithi049.stdout:7/394: creat d1/df/d62/d48/f8b x:0 0 0 2024-02-22T00:33:52.571 INFO:tasks.workunit.client.0.smithi049.stdout:0/337: mkdir d3/df/d59 0 2024-02-22T00:33:52.571 INFO:tasks.workunit.client.0.smithi049.stdout:7/395: dread - d1/df/d62/d7a/f83 zero size 2024-02-22T00:33:52.580 INFO:tasks.workunit.client.0.smithi049.stdout:3/360: link d0/d14/d4d/c2a d0/dd/d26/c61 0 2024-02-22T00:33:52.584 INFO:tasks.workunit.client.0.smithi049.stdout:3/361: creat d0/f62 x:0 0 0 2024-02-22T00:33:52.584 INFO:tasks.workunit.client.0.smithi049.stdout:7/396: rmdir d1/df/d62 39 2024-02-22T00:33:52.585 INFO:tasks.workunit.client.0.smithi049.stdout:9/477: dwrite d17/f20 [0,4194304] 0 2024-02-22T00:33:52.589 INFO:tasks.workunit.client.0.smithi049.stdout:0/338: rename d3/d6/d8/f46 to d3/d1e/f5a 0 2024-02-22T00:33:52.591 INFO:tasks.workunit.client.0.smithi049.stdout:7/397: mknod d1/d41/d28/d71/c8c 0 2024-02-22T00:33:52.597 INFO:tasks.workunit.client.0.smithi049.stdout:9/478: rename d17/d21/d47/f68 to d17/d21/d85/fa2 0 2024-02-22T00:33:52.600 INFO:tasks.workunit.client.0.smithi049.stdout:7/398: rmdir d1/df/d62/d60 39 2024-02-22T00:33:52.601 INFO:tasks.workunit.client.0.smithi049.stdout:0/339: rmdir d3/df/d48 39 2024-02-22T00:33:52.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/362: read d0/d14/f1d [2098368,36200] 0 2024-02-22T00:33:52.603 INFO:tasks.workunit.client.0.smithi049.stdout:7/399: readlink d1/df/d62/d48/l54 0 2024-02-22T00:33:52.604 INFO:tasks.workunit.client.0.smithi049.stdout:7/400: stat d1/d41/d55/l58 0 2024-02-22T00:33:52.606 INFO:tasks.workunit.client.0.smithi049.stdout:7/401: truncate d1/d41/d28/f36 4714399 0 2024-02-22T00:33:52.610 INFO:tasks.workunit.client.0.smithi049.stdout:0/340: creat d3/df/f5b x:0 0 0 2024-02-22T00:33:52.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/341: fsync d3/d6/f26 0 2024-02-22T00:33:52.612 INFO:tasks.workunit.client.0.smithi049.stdout:9/479: dread d17/d21/d47/d5d/f6b [0,4194304] 0 2024-02-22T00:33:52.613 INFO:tasks.workunit.client.0.smithi049.stdout:9/480: stat d17/d1c/d25/d71 0 2024-02-22T00:33:52.614 INFO:tasks.workunit.client.0.smithi049.stdout:0/342: write d3/d6/f4d [442728,48432] 0 2024-02-22T00:33:52.614 INFO:tasks.workunit.client.0.smithi049.stdout:3/363: truncate d0/dd/f48 16080 0 2024-02-22T00:33:52.615 INFO:tasks.workunit.client.0.smithi049.stdout:9/481: read - d17/d21/d4e/f4d zero size 2024-02-22T00:33:52.616 INFO:tasks.workunit.client.0.smithi049.stdout:3/364: dread - d0/dd/d26/d2e/f44 zero size 2024-02-22T00:33:52.618 INFO:tasks.workunit.client.0.smithi049.stdout:8/365: sync 2024-02-22T00:33:52.618 INFO:tasks.workunit.client.0.smithi049.stdout:9/482: chown d17/d21/d85 37042437 1 2024-02-22T00:33:52.618 INFO:tasks.workunit.client.0.smithi049.stdout:2/452: sync 2024-02-22T00:33:52.618 INFO:tasks.workunit.client.0.smithi049.stdout:6/344: sync 2024-02-22T00:33:52.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/396: sync 2024-02-22T00:33:52.618 INFO:tasks.workunit.client.0.smithi049.stdout:5/354: sync 2024-02-22T00:33:52.618 INFO:tasks.workunit.client.0.smithi049.stdout:3/365: fdatasync d0/f62 0 2024-02-22T00:33:52.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/343: dread d3/f49 [0,4194304] 0 2024-02-22T00:33:52.622 INFO:tasks.workunit.client.0.smithi049.stdout:5/355: write d0/d26/d4d/f68 [835284,105161] 0 2024-02-22T00:33:52.626 INFO:tasks.workunit.client.0.smithi049.stdout:6/345: mkdir d3/d16/d32/d7b 0 2024-02-22T00:33:52.628 INFO:tasks.workunit.client.0.smithi049.stdout:3/366: mkdir d0/dd/d26/d63 0 2024-02-22T00:33:52.630 INFO:tasks.workunit.client.0.smithi049.stdout:7/402: dread d1/df/d62/f11 [0,4194304] 0 2024-02-22T00:33:52.632 INFO:tasks.workunit.client.0.smithi049.stdout:2/453: truncate d2/d9/dd/d74/f9d 140109 0 2024-02-22T00:33:52.633 INFO:tasks.workunit.client.0.smithi049.stdout:6/346: write d3/d16/f78 [921762,75293] 0 2024-02-22T00:33:52.635 INFO:tasks.workunit.client.0.smithi049.stdout:5/356: fdatasync d0/d20/d50/d24/d3b/d5b/f67 0 2024-02-22T00:33:52.637 INFO:tasks.workunit.client.0.smithi049.stdout:8/366: rename d1/d2/db/l1a to d1/d2/d5/d1b/d39/d81/l89 0 2024-02-22T00:33:52.638 INFO:tasks.workunit.client.0.smithi049.stdout:7/403: mknod d1/c8d 0 2024-02-22T00:33:52.639 INFO:tasks.workunit.client.0.smithi049.stdout:1/397: dwrite d2/d8/da/f3b [0,4194304] 0 2024-02-22T00:33:52.648 INFO:tasks.workunit.client.0.smithi049.stdout:9/483: dwrite d17/d21/d3c/f4a [0,4194304] 0 2024-02-22T00:33:52.653 INFO:tasks.workunit.client.0.smithi049.stdout:7/404: mkdir d1/df/d62/d48/d8e 0 2024-02-22T00:33:52.655 INFO:tasks.workunit.client.0.smithi049.stdout:1/398: mknod d2/d8/db/d25/d40/d41/d5b/d75/c8f 0 2024-02-22T00:33:52.655 INFO:tasks.workunit.client.0.smithi049.stdout:0/344: dwrite d3/f13 [0,4194304] 0 2024-02-22T00:33:52.657 INFO:tasks.workunit.client.0.smithi049.stdout:9/484: mkdir d17/d1c/d25/d71/da3 0 2024-02-22T00:33:52.661 INFO:tasks.workunit.client.0.smithi049.stdout:1/399: read - d2/d8/da/f3f zero size 2024-02-22T00:33:52.662 INFO:tasks.workunit.client.0.smithi049.stdout:9/485: stat d17/d21/d47/c82 0 2024-02-22T00:33:52.664 INFO:tasks.workunit.client.0.smithi049.stdout:0/345: truncate d3/f43 1509013 0 2024-02-22T00:33:52.665 INFO:tasks.workunit.client.0.smithi049.stdout:6/347: dwrite d3/f38 [4194304,4194304] 0 2024-02-22T00:33:52.667 INFO:tasks.workunit.client.0.smithi049.stdout:5/357: dwrite d0/d26/d4d/d6f/d6/fd [0,4194304] 0 2024-02-22T00:33:52.669 INFO:tasks.workunit.client.0.smithi049.stdout:7/405: dread d1/df/d62/d1c/d1d/f46 [0,4194304] 0 2024-02-22T00:33:52.671 INFO:tasks.workunit.client.0.smithi049.stdout:6/348: chown d3/d16/f78 38567 1 2024-02-22T00:33:52.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/367: dwrite d1/d2/db/f19 [4194304,4194304] 0 2024-02-22T00:33:52.675 INFO:tasks.workunit.client.0.smithi049.stdout:9/486: readlink d17/d21/d47/d5d/l6a 0 2024-02-22T00:33:52.676 INFO:tasks.workunit.client.0.smithi049.stdout:5/358: chown d0/d20/l35 261792 1 2024-02-22T00:33:52.676 INFO:tasks.workunit.client.0.smithi049.stdout:6/349: write d3/f1a [128928,112242] 0 2024-02-22T00:33:52.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/400: rename d2/d8/da/f32 to d2/d8/db/f90 0 2024-02-22T00:33:52.678 INFO:tasks.workunit.client.0.smithi049.stdout:0/346: creat d3/d1e/d58/f5c x:0 0 0 2024-02-22T00:33:52.683 INFO:tasks.workunit.client.0.smithi049.stdout:7/406: rename d1/d41/c80 to d1/d41/d55/c8f 0 2024-02-22T00:33:52.687 INFO:tasks.workunit.client.0.smithi049.stdout:1/401: write d2/d8/da/f4f [5215783,126070] 0 2024-02-22T00:33:52.693 INFO:tasks.workunit.client.0.smithi049.stdout:6/350: link d3/d64/d5f/c6d d3/d36/d70/c7c 0 2024-02-22T00:33:52.695 INFO:tasks.workunit.client.0.smithi049.stdout:9/487: dwrite d17/d1c/d38/f56 [0,4194304] 0 2024-02-22T00:33:52.695 INFO:tasks.workunit.client.0.smithi049.stdout:8/368: getdents d1/d2/db/d15/d33 0 2024-02-22T00:33:52.700 INFO:tasks.workunit.client.0.smithi049.stdout:6/351: creat d3/d64/d5f/f7d x:0 0 0 2024-02-22T00:33:52.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/359: dread d0/d26/d4d/d6f/f41 [0,4194304] 0 2024-02-22T00:33:52.703 INFO:tasks.workunit.client.0.smithi049.stdout:8/369: chown d1/d2/db/d15/c76 2 1 2024-02-22T00:33:52.704 INFO:tasks.workunit.client.0.smithi049.stdout:7/407: dwrite d1/df/d62/d7a/f83 [0,4194304] 0 2024-02-22T00:33:52.705 INFO:tasks.workunit.client.0.smithi049.stdout:6/352: truncate d3/f1d 1327967 0 2024-02-22T00:33:52.706 INFO:tasks.workunit.client.0.smithi049.stdout:1/402: rename d2/d8/db/d25/d40/d71/l88 to d2/d8/db/d25/d62/l91 0 2024-02-22T00:33:52.710 INFO:tasks.workunit.client.0.smithi049.stdout:6/353: fsync d3/f11 0 2024-02-22T00:33:52.711 INFO:tasks.workunit.client.0.smithi049.stdout:7/408: chown d1/df/d62/d1c/d24/f4b 22158535 1 2024-02-22T00:33:52.720 INFO:tasks.workunit.client.0.smithi049.stdout:8/370: symlink d1/d2/db/d15/d65/d6a/l8a 0 2024-02-22T00:33:52.720 INFO:tasks.workunit.client.0.smithi049.stdout:9/488: dwrite d17/d1c/d25/d39/f8a [0,4194304] 0 2024-02-22T00:33:52.720 INFO:tasks.workunit.client.0.smithi049.stdout:9/489: chown ca 203158644 1 2024-02-22T00:33:52.720 INFO:tasks.workunit.client.0.smithi049.stdout:9/490: fdatasync d17/f20 0 2024-02-22T00:33:52.721 INFO:tasks.workunit.client.0.smithi049.stdout:0/347: dread d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:52.722 INFO:tasks.workunit.client.0.smithi049.stdout:1/403: dwrite d2/d8/db/f26 [0,4194304] 0 2024-02-22T00:33:52.726 INFO:tasks.workunit.client.0.smithi049.stdout:7/409: symlink d1/d49/l90 0 2024-02-22T00:33:52.727 INFO:tasks.workunit.client.0.smithi049.stdout:8/371: mknod d1/d2/db/d15/d30/d4b/d51/c8b 0 2024-02-22T00:33:52.727 INFO:tasks.workunit.client.0.smithi049.stdout:6/354: creat d3/d16/d3b/f7e x:0 0 0 2024-02-22T00:33:52.729 INFO:tasks.workunit.client.0.smithi049.stdout:0/348: write d3/d6/d8/f1a [1985554,119340] 0 2024-02-22T00:33:52.735 INFO:tasks.workunit.client.0.smithi049.stdout:8/372: write d1/d2/db/f78 [2651092,99924] 0 2024-02-22T00:33:52.737 INFO:tasks.workunit.client.0.smithi049.stdout:1/404: creat d2/d8/db/d25/d40/d41/d68/d78/f92 x:0 0 0 2024-02-22T00:33:52.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/373: chown d1/d2/db/d15/d30/d4b/d51/l7e 197 1 2024-02-22T00:33:52.741 INFO:tasks.workunit.client.0.smithi049.stdout:1/405: write d2/f4e [573236,116320] 0 2024-02-22T00:33:52.743 INFO:tasks.workunit.client.0.smithi049.stdout:7/410: dwrite d1/df/d62/d7a/f83 [0,4194304] 0 2024-02-22T00:33:52.743 INFO:tasks.workunit.client.0.smithi049.stdout:9/491: creat d17/d21/fa4 x:0 0 0 2024-02-22T00:33:52.754 INFO:tasks.workunit.client.0.smithi049.stdout:0/349: dread d3/d6/f9 [0,4194304] 0 2024-02-22T00:33:52.754 INFO:tasks.workunit.client.0.smithi049.stdout:1/406: dread - d2/d8/db/d25/d40/d41/f83 zero size 2024-02-22T00:33:52.754 INFO:tasks.workunit.client.0.smithi049.stdout:6/355: write d3/f14 [494313,115157] 0 2024-02-22T00:33:52.754 INFO:tasks.workunit.client.0.smithi049.stdout:8/374: mkdir d1/d2/d8c 0 2024-02-22T00:33:52.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/411: dread - d1/df/d62/d1c/f85 zero size 2024-02-22T00:33:52.757 INFO:tasks.workunit.client.0.smithi049.stdout:6/356: fdatasync d3/d64/d59/f77 0 2024-02-22T00:33:52.763 INFO:tasks.workunit.client.0.smithi049.stdout:9/492: dwrite d17/d1c/d25/d39/f88 [0,4194304] 0 2024-02-22T00:33:52.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/350: creat d3/df/d48/d54/f5d x:0 0 0 2024-02-22T00:33:52.765 INFO:tasks.workunit.client.0.smithi049.stdout:8/375: mknod d1/d2/d5/d1b/d39/d60/c8d 0 2024-02-22T00:33:52.772 INFO:tasks.workunit.client.0.smithi049.stdout:1/407: link d2/d8/db/d25/d40/d41/c5d d2/d8/d4c/c93 0 2024-02-22T00:33:52.776 INFO:tasks.workunit.client.0.smithi049.stdout:7/412: dwrite d1/df/d62/d1c/d1d/f34 [0,4194304] 0 2024-02-22T00:33:52.777 INFO:tasks.workunit.client.0.smithi049.stdout:1/408: write d2/d8/db/f26 [1273483,9124] 0 2024-02-22T00:33:52.777 INFO:tasks.workunit.client.0.smithi049.stdout:9/493: rename d17/d1c/d25/d39/f8a to d17/d21/d47/d7a/fa5 0 2024-02-22T00:33:52.778 INFO:tasks.workunit.client.0.smithi049.stdout:1/409: readlink d2/l15 0 2024-02-22T00:33:52.779 INFO:tasks.workunit.client.0.smithi049.stdout:7/413: write d1/df/d62/f30 [3470153,37216] 0 2024-02-22T00:33:52.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/414: chown d1/df/f13 0 1 2024-02-22T00:33:52.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/415: chown d1/d49/d4d 3853 1 2024-02-22T00:33:52.783 INFO:tasks.workunit.client.0.smithi049.stdout:0/351: rename d3/d6/f9 to d3/d6/f5e 0 2024-02-22T00:33:52.785 INFO:tasks.workunit.client.0.smithi049.stdout:9/494: write d17/d21/d4e/d4b/f5a [4638976,15635] 0 2024-02-22T00:33:52.788 INFO:tasks.workunit.client.0.smithi049.stdout:6/357: truncate d3/d16/f1c 177689 0 2024-02-22T00:33:52.790 INFO:tasks.workunit.client.0.smithi049.stdout:7/416: dwrite d1/df/d62/f66 [0,4194304] 0 2024-02-22T00:33:52.791 INFO:tasks.workunit.client.0.smithi049.stdout:1/410: link d2/f4e d2/d8/db/d25/d40/f94 0 2024-02-22T00:33:52.794 INFO:tasks.workunit.client.0.smithi049.stdout:0/352: write d3/df/d17/f20 [971863,75020] 0 2024-02-22T00:33:52.794 INFO:tasks.workunit.client.0.smithi049.stdout:1/411: chown d2/d8/f74 57295 1 2024-02-22T00:33:52.798 INFO:tasks.workunit.client.0.smithi049.stdout:1/412: readlink d2/d8/db/d25/d40/d41/d5b/l8d 0 2024-02-22T00:33:52.802 INFO:tasks.workunit.client.0.smithi049.stdout:0/353: symlink d3/df/d59/l5f 0 2024-02-22T00:33:52.803 INFO:tasks.workunit.client.0.smithi049.stdout:6/358: dread d3/d16/f30 [0,4194304] 0 2024-02-22T00:33:52.805 INFO:tasks.workunit.client.0.smithi049.stdout:7/417: dwrite d1/df/f45 [4194304,4194304] 0 2024-02-22T00:33:52.806 INFO:tasks.workunit.client.0.smithi049.stdout:1/413: getdents d2/d8/db/d25/d40/d4d 0 2024-02-22T00:33:52.806 INFO:tasks.workunit.client.0.smithi049.stdout:6/359: fsync d3/d16/d3b/f7e 0 2024-02-22T00:33:52.808 INFO:tasks.workunit.client.0.smithi049.stdout:6/360: write d3/d16/f25 [4827161,127229] 0 2024-02-22T00:33:52.810 INFO:tasks.workunit.client.0.smithi049.stdout:6/361: fdatasync d3/d16/d3b/f7e 0 2024-02-22T00:33:52.814 INFO:tasks.workunit.client.0.smithi049.stdout:7/418: link d1/df/d62/d60/l7f d1/df/d62/d60/l91 0 2024-02-22T00:33:52.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/414: link d2/d8/c42 d2/d8/da/c95 0 2024-02-22T00:33:52.816 INFO:tasks.workunit.client.0.smithi049.stdout:0/354: dread d3/df/d17/f24 [0,4194304] 0 2024-02-22T00:33:52.816 INFO:tasks.workunit.client.0.smithi049.stdout:6/362: symlink d3/l7f 0 2024-02-22T00:33:52.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/419: link d1/d49/l90 d1/df/d62/d1c/l92 0 2024-02-22T00:33:52.823 INFO:tasks.workunit.client.0.smithi049.stdout:6/363: symlink d3/d36/d57/d75/l80 0 2024-02-22T00:33:52.825 INFO:tasks.workunit.client.0.smithi049.stdout:1/415: getdents d2/d8/db/d25 0 2024-02-22T00:33:52.827 INFO:tasks.workunit.client.0.smithi049.stdout:1/416: chown d2/d8/db/d25/d40/d71 756131 1 2024-02-22T00:33:52.828 INFO:tasks.workunit.client.0.smithi049.stdout:7/420: dread d1/df/f4f [0,4194304] 0 2024-02-22T00:33:52.829 INFO:tasks.workunit.client.0.smithi049.stdout:6/364: symlink d3/d16/d3b/d3d/l81 0 2024-02-22T00:33:52.830 INFO:tasks.workunit.client.0.smithi049.stdout:1/417: truncate d2/d8/d4c/d5e/f65 514894 0 2024-02-22T00:33:52.836 INFO:tasks.workunit.client.0.smithi049.stdout:9/495: fsync d17/d1c/d25/d39/f88 0 2024-02-22T00:33:52.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/355: getdents d3/df/d48/d54 0 2024-02-22T00:33:52.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/356: read - d3/df/f5b zero size 2024-02-22T00:33:52.837 INFO:tasks.workunit.client.0.smithi049.stdout:9/496: write d17/d21/d4e/d4b/f5a [2866970,15546] 0 2024-02-22T00:33:52.841 INFO:tasks.workunit.client.0.smithi049.stdout:1/418: rename d2/d8/db/d25/d40/f79 to d2/d66/f96 0 2024-02-22T00:33:52.842 INFO:tasks.workunit.client.0.smithi049.stdout:0/357: mkdir d3/df/d59/d60 0 2024-02-22T00:33:52.843 INFO:tasks.workunit.client.0.smithi049.stdout:1/419: write d2/f47 [3581721,86700] 0 2024-02-22T00:33:52.844 INFO:tasks.workunit.client.0.smithi049.stdout:9/497: rmdir d17/d1c/d25/d39/d90 39 2024-02-22T00:33:52.851 INFO:tasks.workunit.client.0.smithi049.stdout:0/358: getdents d3/d6 0 2024-02-22T00:33:52.853 INFO:tasks.workunit.client.0.smithi049.stdout:6/365: dread d3/d16/f19 [0,4194304] 0 2024-02-22T00:33:52.854 INFO:tasks.workunit.client.0.smithi049.stdout:9/498: creat d17/d21/d3c/fa6 x:0 0 0 2024-02-22T00:33:52.857 INFO:tasks.workunit.client.0.smithi049.stdout:1/420: creat d2/d8/d4c/f97 x:0 0 0 2024-02-22T00:33:52.857 INFO:tasks.workunit.client.0.smithi049.stdout:0/359: write d3/f43 [1717935,5809] 0 2024-02-22T00:33:52.859 INFO:tasks.workunit.client.0.smithi049.stdout:6/366: creat d3/d64/d5f/f82 x:0 0 0 2024-02-22T00:33:52.867 INFO:tasks.workunit.client.0.smithi049.stdout:1/421: mkdir d2/d8/d98 0 2024-02-22T00:33:52.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/499: creat d17/d21/d47/fa7 x:0 0 0 2024-02-22T00:33:52.867 INFO:tasks.workunit.client.0.smithi049.stdout:6/367: write d3/d64/f35 [4221869,62582] 0 2024-02-22T00:33:52.869 INFO:tasks.workunit.client.0.smithi049.stdout:1/422: chown d2/c21 0 1 2024-02-22T00:33:52.874 INFO:tasks.workunit.client.0.smithi049.stdout:1/423: unlink d2/l50 0 2024-02-22T00:33:52.877 INFO:tasks.workunit.client.0.smithi049.stdout:1/424: read d2/f4 [814569,58404] 0 2024-02-22T00:33:52.881 INFO:tasks.workunit.client.0.smithi049.stdout:1/425: rmdir d2/d8/d4c/d5e 39 2024-02-22T00:33:52.881 INFO:tasks.workunit.client.0.smithi049.stdout:7/421: dread f0 [0,4194304] 0 2024-02-22T00:33:52.883 INFO:tasks.workunit.client.0.smithi049.stdout:9/500: link d17/d21/d47/c61 d17/d1c/d38/ca8 0 2024-02-22T00:33:52.883 INFO:tasks.workunit.client.0.smithi049.stdout:0/360: dwrite d3/df/d17/f24 [0,4194304] 0 2024-02-22T00:33:52.884 INFO:tasks.workunit.client.0.smithi049.stdout:6/368: getdents d3/d16/d45 0 2024-02-22T00:33:52.893 INFO:tasks.workunit.client.0.smithi049.stdout:7/422: read d1/d49/d4d/f68 [75174,29568] 0 2024-02-22T00:33:52.893 INFO:tasks.workunit.client.0.smithi049.stdout:1/426: mknod d2/d8/da/c99 0 2024-02-22T00:33:52.894 INFO:tasks.workunit.client.0.smithi049.stdout:6/369: rmdir d3/d16/d3b 39 2024-02-22T00:33:52.898 INFO:tasks.workunit.client.0.smithi049.stdout:7/423: symlink d1/d41/d55/d89/l93 0 2024-02-22T00:33:52.899 INFO:tasks.workunit.client.0.smithi049.stdout:9/501: dwrite d17/d21/d3c/f59 [4194304,4194304] 0 2024-02-22T00:33:52.901 INFO:tasks.workunit.client.0.smithi049.stdout:9/502: read - d17/d21/d47/d5d/f9f zero size 2024-02-22T00:33:52.901 INFO:tasks.workunit.client.0.smithi049.stdout:0/361: rename d3/d6/d8/d36/f40 to d3/d1e/f61 0 2024-02-22T00:33:52.901 INFO:tasks.workunit.client.0.smithi049.stdout:6/370: mkdir d3/d83 0 2024-02-22T00:33:52.903 INFO:tasks.workunit.client.0.smithi049.stdout:7/424: unlink d1/df/d62/d1c/l22 0 2024-02-22T00:33:52.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/362: write d3/d6/f4d [879364,81548] 0 2024-02-22T00:33:52.906 INFO:tasks.workunit.client.0.smithi049.stdout:6/371: write d3/f20 [1141650,71002] 0 2024-02-22T00:33:52.909 INFO:tasks.workunit.client.0.smithi049.stdout:1/427: rename d2/d8/d4c/f52 to d2/d8/db/d25/d62/f9a 0 2024-02-22T00:33:52.909 INFO:tasks.workunit.client.0.smithi049.stdout:0/363: dread - d3/d6/d29/f4b zero size 2024-02-22T00:33:52.912 INFO:tasks.workunit.client.0.smithi049.stdout:9/503: write d17/d1c/d25/d39/d67/f7c [225500,56803] 0 2024-02-22T00:33:52.914 INFO:tasks.workunit.client.0.smithi049.stdout:9/504: chown d17/d21/d47/d7a 244 1 2024-02-22T00:33:52.916 INFO:tasks.workunit.client.0.smithi049.stdout:0/364: mkdir d3/df/d17/d50/d62 0 2024-02-22T00:33:52.917 INFO:tasks.workunit.client.0.smithi049.stdout:7/425: creat d1/f94 x:0 0 0 2024-02-22T00:33:52.918 INFO:tasks.workunit.client.0.smithi049.stdout:9/505: write d17/d1c/d25/d39/d67/f7c [3511187,116776] 0 2024-02-22T00:33:52.919 INFO:tasks.workunit.client.0.smithi049.stdout:0/365: mkdir d3/df/d48/d63 0 2024-02-22T00:33:52.921 INFO:tasks.workunit.client.0.smithi049.stdout:6/372: dwrite d3/f5 [0,4194304] 0 2024-02-22T00:33:52.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/366: fdatasync d3/df/d17/f20 0 2024-02-22T00:33:52.926 INFO:tasks.workunit.client.0.smithi049.stdout:7/426: unlink d1/df/d62/d60/f6b 0 2024-02-22T00:33:52.926 INFO:tasks.workunit.client.0.smithi049.stdout:1/428: link d2/d8/db/d25/d62/l91 d2/l9b 0 2024-02-22T00:33:52.929 INFO:tasks.workunit.client.0.smithi049.stdout:9/506: symlink d17/d1c/d25/la9 0 2024-02-22T00:33:52.931 INFO:tasks.workunit.client.0.smithi049.stdout:7/427: unlink d1/df/d62/d1c/d24/f87 0 2024-02-22T00:33:52.932 INFO:tasks.workunit.client.0.smithi049.stdout:0/367: symlink d3/df/d59/d60/l64 0 2024-02-22T00:33:52.934 INFO:tasks.workunit.client.0.smithi049.stdout:0/368: write d3/df/d17/f20 [1957452,104112] 0 2024-02-22T00:33:52.937 INFO:tasks.workunit.client.0.smithi049.stdout:1/429: rmdir d2/d8/db/d25/d40/d41/d5b 39 2024-02-22T00:33:52.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/430: write d2/d7b/f85 [309426,55248] 0 2024-02-22T00:33:52.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/431: fsync d2/f35 0 2024-02-22T00:33:52.939 INFO:tasks.workunit.client.0.smithi049.stdout:1/432: write d2/d8/db/f26 [3710224,87296] 0 2024-02-22T00:33:52.940 INFO:tasks.workunit.client.0.smithi049.stdout:9/507: rename d17/l72 to d17/d21/d4e/d89/d94/laa 0 2024-02-22T00:33:52.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/369: symlink d3/df/d48/l65 0 2024-02-22T00:33:52.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/433: rmdir d2/d8 39 2024-02-22T00:33:52.948 INFO:tasks.workunit.client.0.smithi049.stdout:9/508: fdatasync f10 0 2024-02-22T00:33:52.950 INFO:tasks.workunit.client.0.smithi049.stdout:6/373: getdents d3/d36 0 2024-02-22T00:33:52.950 INFO:tasks.workunit.client.0.smithi049.stdout:6/374: chown d3/d64/d59/d72 180 1 2024-02-22T00:33:52.952 INFO:tasks.workunit.client.0.smithi049.stdout:6/375: read d3/d16/f25 [3161251,36198] 0 2024-02-22T00:33:52.954 INFO:tasks.workunit.client.0.smithi049.stdout:9/509: write d17/f18 [942780,108023] 0 2024-02-22T00:33:52.955 INFO:tasks.workunit.client.0.smithi049.stdout:0/370: symlink d3/df/d17/l66 0 2024-02-22T00:33:52.956 INFO:tasks.workunit.client.0.smithi049.stdout:9/510: truncate d17/f6c 1064968 0 2024-02-22T00:33:52.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/428: getdents d1/df/d62/d57 0 2024-02-22T00:33:52.959 INFO:tasks.workunit.client.0.smithi049.stdout:9/511: write d17/d21/fa4 [1022552,15205] 0 2024-02-22T00:33:52.960 INFO:tasks.workunit.client.0.smithi049.stdout:1/434: creat d2/d8/db/d25/d40/d41/d84/f9c x:0 0 0 2024-02-22T00:33:52.961 INFO:tasks.workunit.client.0.smithi049.stdout:6/376: dwrite d3/d16/f19 [0,4194304] 0 2024-02-22T00:33:52.961 INFO:tasks.workunit.client.0.smithi049.stdout:0/371: unlink d3/df/d17/l25 0 2024-02-22T00:33:52.966 INFO:tasks.workunit.client.0.smithi049.stdout:7/429: mkdir d1/d41/d28/d71/d72/d95 0 2024-02-22T00:33:52.967 INFO:tasks.workunit.client.0.smithi049.stdout:1/435: unlink d2/d8/db/d25/d40/l45 0 2024-02-22T00:33:52.969 INFO:tasks.workunit.client.0.smithi049.stdout:0/372: dread d3/d6/f4d [0,4194304] 0 2024-02-22T00:33:52.969 INFO:tasks.workunit.client.0.smithi049.stdout:7/430: readlink d1/df/d62/d1c/l92 0 2024-02-22T00:33:52.971 INFO:tasks.workunit.client.0.smithi049.stdout:9/512: link d17/d1c/d25/c66 d17/d1c/d25/d71/da3/cab 0 2024-02-22T00:33:52.972 INFO:tasks.workunit.client.0.smithi049.stdout:1/436: read - d2/d8/db/d25/d40/d4d/f64 zero size 2024-02-22T00:33:52.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/405: sync 2024-02-22T00:33:52.973 INFO:tasks.workunit.client.0.smithi049.stdout:4/406: fdatasync d3/d8/d10/d12/f31 0 2024-02-22T00:33:52.977 INFO:tasks.workunit.client.0.smithi049.stdout:9/513: unlink d17/d21/d4e/l91 0 2024-02-22T00:33:52.978 INFO:tasks.workunit.client.0.smithi049.stdout:1/437: symlink d2/d8/db/d25/l9d 0 2024-02-22T00:33:52.978 INFO:tasks.workunit.client.0.smithi049.stdout:6/377: dwrite d3/f10 [0,4194304] 0 2024-02-22T00:33:52.979 INFO:tasks.workunit.client.0.smithi049.stdout:4/407: symlink d3/d13/d48/d60/l83 0 2024-02-22T00:33:52.982 INFO:tasks.workunit.client.0.smithi049.stdout:9/514: rmdir d17/d21/d4e/d4b 39 2024-02-22T00:33:52.984 INFO:tasks.workunit.client.0.smithi049.stdout:0/373: dwrite d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:52.984 INFO:tasks.workunit.client.0.smithi049.stdout:6/378: creat d3/d16/d4a/d4d/f84 x:0 0 0 2024-02-22T00:33:52.988 INFO:tasks.workunit.client.0.smithi049.stdout:4/408: symlink d3/d8/d10/d12/l84 0 2024-02-22T00:33:52.990 INFO:tasks.workunit.client.0.smithi049.stdout:1/438: creat d2/f9e x:0 0 0 2024-02-22T00:33:52.991 INFO:tasks.workunit.client.0.smithi049.stdout:7/431: write d1/df/d62/d1c/d1d/f46 [906611,42094] 0 2024-02-22T00:33:52.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/439: truncate d2/d8/db/d25/d40/d41/d84/f9c 190186 0 2024-02-22T00:33:52.995 INFO:tasks.workunit.client.0.smithi049.stdout:1/440: chown d2/d8/da/f1e 3313 1 2024-02-22T00:33:52.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/441: truncate d2/d8/da/f61 1020205 0 2024-02-22T00:33:53.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/442: read d2/f31 [455465,36957] 0 2024-02-22T00:33:53.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/443: fsync d2/f31 0 2024-02-22T00:33:53.001 INFO:tasks.workunit.client.0.smithi049.stdout:4/409: creat d3/d22/d49/f85 x:0 0 0 2024-02-22T00:33:53.002 INFO:tasks.workunit.client.0.smithi049.stdout:9/515: unlink d17/d21/d3c/c3e 0 2024-02-22T00:33:53.004 INFO:tasks.workunit.client.0.smithi049.stdout:2/454: sync 2024-02-22T00:33:53.004 INFO:tasks.workunit.client.0.smithi049.stdout:5/360: sync 2024-02-22T00:33:53.004 INFO:tasks.workunit.client.0.smithi049.stdout:3/367: sync 2024-02-22T00:33:53.004 INFO:tasks.workunit.client.0.smithi049.stdout:8/376: sync 2024-02-22T00:33:53.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/379: rename d3/d37/l74 to d3/d16/d4a/l85 0 2024-02-22T00:33:53.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/380: chown d3/d37 1242 1 2024-02-22T00:33:53.007 INFO:tasks.workunit.client.0.smithi049.stdout:7/432: symlink d1/d41/d28/d71/d72/d95/l96 0 2024-02-22T00:33:53.007 INFO:tasks.workunit.client.0.smithi049.stdout:8/377: dread - d1/d4c/f85 zero size 2024-02-22T00:33:53.007 INFO:tasks.workunit.client.0.smithi049.stdout:9/516: mknod d17/d21/d85/d8d/cac 0 2024-02-22T00:33:53.009 INFO:tasks.workunit.client.0.smithi049.stdout:2/455: truncate d2/d9/de/f9b 954013 0 2024-02-22T00:33:53.009 INFO:tasks.workunit.client.0.smithi049.stdout:5/361: rmdir d0/d26/d4d 39 2024-02-22T00:33:53.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/368: mknod d0/dd/d26/c64 0 2024-02-22T00:33:53.011 INFO:tasks.workunit.client.0.smithi049.stdout:6/381: symlink d3/d64/d59/l86 0 2024-02-22T00:33:53.014 INFO:tasks.workunit.client.0.smithi049.stdout:9/517: chown d17/d21/d4e/f8e 245872 1 2024-02-22T00:33:53.018 INFO:tasks.workunit.client.0.smithi049.stdout:1/444: dwrite d2/d8/db/d25/d40/d41/d5b/f7c [0,4194304] 0 2024-02-22T00:33:53.018 INFO:tasks.workunit.client.0.smithi049.stdout:4/410: getdents d3/d22/d49 0 2024-02-22T00:33:53.018 INFO:tasks.workunit.client.0.smithi049.stdout:9/518: readlink d17/d1c/d25/d71/d73/l9a 0 2024-02-22T00:33:53.021 INFO:tasks.workunit.client.0.smithi049.stdout:1/445: chown d2/d8/db/d25/d40/d41/d68/d78 11690165 1 2024-02-22T00:33:53.021 INFO:tasks.workunit.client.0.smithi049.stdout:2/456: mkdir d2/d9/dd/d4d/da7 0 2024-02-22T00:33:53.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/433: mknod d1/df/d62/d60/d7e/c97 0 2024-02-22T00:33:53.023 INFO:tasks.workunit.client.0.smithi049.stdout:7/434: readlink d1/d41/d28/l44 0 2024-02-22T00:33:53.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/435: write d1/df/d62/d57/f65 [755398,29343] 0 2024-02-22T00:33:53.026 INFO:tasks.workunit.client.0.smithi049.stdout:0/374: read d3/df/d17/f20 [1039379,69702] 0 2024-02-22T00:33:53.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/362: rmdir d0/d26/d4d/d70 39 2024-02-22T00:33:53.028 INFO:tasks.workunit.client.0.smithi049.stdout:8/378: creat d1/d2/d5/d1b/f8e x:0 0 0 2024-02-22T00:33:53.029 INFO:tasks.workunit.client.0.smithi049.stdout:5/363: fdatasync d0/d26/d4d/d6f/d6/fd 0 2024-02-22T00:33:53.031 INFO:tasks.workunit.client.0.smithi049.stdout:3/369: mknod d0/dd/d26/d63/c65 0 2024-02-22T00:33:53.031 INFO:tasks.workunit.client.0.smithi049.stdout:1/446: dread d2/d8/db/f90 [0,4194304] 0 2024-02-22T00:33:53.033 INFO:tasks.workunit.client.0.smithi049.stdout:3/370: fsync d0/d14/f57 0 2024-02-22T00:33:53.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/447: fsync d2/d8/db/f34 0 2024-02-22T00:33:53.035 INFO:tasks.workunit.client.0.smithi049.stdout:4/411: fdatasync d3/d22/f34 0 2024-02-22T00:33:53.035 INFO:tasks.workunit.client.0.smithi049.stdout:8/379: creat d1/d2/db/d1c/f8f x:0 0 0 2024-02-22T00:33:53.039 INFO:tasks.workunit.client.0.smithi049.stdout:2/457: creat d2/d9/dd/d4d/d5a/d99/fa8 x:0 0 0 2024-02-22T00:33:53.045 INFO:tasks.workunit.client.0.smithi049.stdout:6/382: link d3/d16/c61 d3/d64/d59/c87 0 2024-02-22T00:33:53.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/436: dwrite d1/d49/d4d/f68 [0,4194304] 0 2024-02-22T00:33:53.046 INFO:tasks.workunit.client.0.smithi049.stdout:9/519: creat d17/d21/d47/fad x:0 0 0 2024-02-22T00:33:53.046 INFO:tasks.workunit.client.0.smithi049.stdout:6/383: truncate d3/d16/d45/f56 469120 0 2024-02-22T00:33:53.046 INFO:tasks.workunit.client.0.smithi049.stdout:1/448: write d2/d8/da/f1e [5176448,73944] 0 2024-02-22T00:33:53.048 INFO:tasks.workunit.client.0.smithi049.stdout:0/375: write d3/df/f2b [641827,78187] 0 2024-02-22T00:33:53.050 INFO:tasks.workunit.client.0.smithi049.stdout:8/380: stat d1/d2/d5/d1b/d39/d81/l89 0 2024-02-22T00:33:53.050 INFO:tasks.workunit.client.0.smithi049.stdout:5/364: mkdir d0/d26/d4d/d6f/d6/d74/d7a 0 2024-02-22T00:33:53.055 INFO:tasks.workunit.client.0.smithi049.stdout:9/520: dread d17/f20 [0,4194304] 0 2024-02-22T00:33:53.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/365: creat d0/d20/f7b x:0 0 0 2024-02-22T00:33:53.061 INFO:tasks.workunit.client.0.smithi049.stdout:2/458: creat d2/d9/dd/fa9 x:0 0 0 2024-02-22T00:33:53.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/449: write d2/d8/db/d25/d62/f9a [11915,124040] 0 2024-02-22T00:33:53.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/384: symlink d3/d64/l88 0 2024-02-22T00:33:53.062 INFO:tasks.workunit.client.0.smithi049.stdout:8/381: symlink d1/d2/db/d15/d65/d6a/l90 0 2024-02-22T00:33:53.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/412: dwrite d3/d33/f67 [0,4194304] 0 2024-02-22T00:33:53.065 INFO:tasks.workunit.client.0.smithi049.stdout:3/371: write d0/dd/d1e/f24 [777933,8520] 0 2024-02-22T00:33:53.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/376: write d3/df/d17/f20 [50981,38845] 0 2024-02-22T00:33:53.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/366: mkdir d0/d26/d4d/d7c 0 2024-02-22T00:33:53.073 INFO:tasks.workunit.client.0.smithi049.stdout:7/437: dwrite d1/f3d [4194304,4194304] 0 2024-02-22T00:33:53.073 INFO:tasks.workunit.client.0.smithi049.stdout:3/372: write d0/d14/f57 [1164320,62627] 0 2024-02-22T00:33:53.075 INFO:tasks.workunit.client.0.smithi049.stdout:6/385: rename d3/d16/c2d to d3/d16/d4a/c89 0 2024-02-22T00:33:53.084 INFO:tasks.workunit.client.0.smithi049.stdout:5/367: write d0/d20/f7b [950557,85273] 0 2024-02-22T00:33:53.084 INFO:tasks.workunit.client.0.smithi049.stdout:9/521: creat d17/d21/d47/fae x:0 0 0 2024-02-22T00:33:53.086 INFO:tasks.workunit.client.0.smithi049.stdout:6/386: chown d3/d16/f19 2204503 1 2024-02-22T00:33:53.087 INFO:tasks.workunit.client.0.smithi049.stdout:0/377: dread - d3/d1e/f61 zero size 2024-02-22T00:33:53.087 INFO:tasks.workunit.client.0.smithi049.stdout:7/438: dread - d1/df/d62/d1c/d6d/f7b zero size 2024-02-22T00:33:53.090 INFO:tasks.workunit.client.0.smithi049.stdout:4/413: rename d3/d8/d10/d12/l84 to d3/d8/d10/d39/l86 0 2024-02-22T00:33:53.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/459: dwrite d2/d9/dd/d4d/d5a/f8e [4194304,4194304] 0 2024-02-22T00:33:53.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/387: write d3/d16/f39 [211259,26026] 0 2024-02-22T00:33:53.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/388: dread - d3/f76 zero size 2024-02-22T00:33:53.102 INFO:tasks.workunit.client.0.smithi049.stdout:0/378: creat d3/df/d17/d50/d62/f67 x:0 0 0 2024-02-22T00:33:53.104 INFO:tasks.workunit.client.0.smithi049.stdout:4/414: unlink d3/d22/d5c/f2c 0 2024-02-22T00:33:53.105 INFO:tasks.workunit.client.0.smithi049.stdout:1/450: dread d2/d8/db/d25/f48 [0,4194304] 0 2024-02-22T00:33:53.107 INFO:tasks.workunit.client.0.smithi049.stdout:2/460: write d2/d9/de/d10/d2e/fa5 [488683,54357] 0 2024-02-22T00:33:53.107 INFO:tasks.workunit.client.0.smithi049.stdout:3/373: dwrite d0/dd/f13 [0,4194304] 0 2024-02-22T00:33:53.110 INFO:tasks.workunit.client.0.smithi049.stdout:8/382: dread d1/d2/d5/f34 [0,4194304] 0 2024-02-22T00:33:53.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/389: rmdir d3/d36/d57/d75 39 2024-02-22T00:33:53.116 INFO:tasks.workunit.client.0.smithi049.stdout:4/415: creat d3/d8/d10/d39/f87 x:0 0 0 2024-02-22T00:33:53.118 INFO:tasks.workunit.client.0.smithi049.stdout:6/390: write d3/f38 [8594762,47034] 0 2024-02-22T00:33:53.120 INFO:tasks.workunit.client.0.smithi049.stdout:5/368: dwrite d0/d26/d4d/f68 [0,4194304] 0 2024-02-22T00:33:53.121 INFO:tasks.workunit.client.0.smithi049.stdout:7/439: truncate d1/df/d62/d57/f69 750991 0 2024-02-22T00:33:53.125 INFO:tasks.workunit.client.0.smithi049.stdout:1/451: creat d2/d8/db/d25/d40/d71/f9f x:0 0 0 2024-02-22T00:33:53.125 INFO:tasks.workunit.client.0.smithi049.stdout:9/522: dwrite d17/d21/f33 [4194304,4194304] 0 2024-02-22T00:33:53.126 INFO:tasks.workunit.client.0.smithi049.stdout:4/416: chown d3/d22/d5c/d35/f40 424 1 2024-02-22T00:33:53.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/383: link d1/d2/db/d15/f23 d1/d2/d5/d1b/d39/d81/f91 0 2024-02-22T00:33:53.131 INFO:tasks.workunit.client.0.smithi049.stdout:4/417: truncate d3/d13/f68 519558 0 2024-02-22T00:33:53.131 INFO:tasks.workunit.client.0.smithi049.stdout:1/452: truncate d2/f47 4486122 0 2024-02-22T00:33:53.131 INFO:tasks.workunit.client.0.smithi049.stdout:9/523: write d17/f1f [933203,73308] 0 2024-02-22T00:33:53.135 INFO:tasks.workunit.client.0.smithi049.stdout:2/461: dwrite d2/d9/de/d10/f3d [0,4194304] 0 2024-02-22T00:33:53.135 INFO:tasks.workunit.client.0.smithi049.stdout:3/374: truncate d0/d14/f57 1497654 0 2024-02-22T00:33:53.136 INFO:tasks.workunit.client.0.smithi049.stdout:6/391: symlink d3/d16/d3b/d3d/d6c/l8a 0 2024-02-22T00:33:53.136 INFO:tasks.workunit.client.0.smithi049.stdout:1/453: chown d2/d8/db/d25/f2c 6 1 2024-02-22T00:33:53.137 INFO:tasks.workunit.client.0.smithi049.stdout:9/524: chown d17/d21/d47/c99 10997 1 2024-02-22T00:33:53.143 INFO:tasks.workunit.client.0.smithi049.stdout:8/384: symlink d1/d2/d8c/l92 0 2024-02-22T00:33:53.143 INFO:tasks.workunit.client.0.smithi049.stdout:7/440: symlink d1/d41/l98 0 2024-02-22T00:33:53.143 INFO:tasks.workunit.client.0.smithi049.stdout:5/369: creat d0/d20/d50/d24/f7d x:0 0 0 2024-02-22T00:33:53.143 INFO:tasks.workunit.client.0.smithi049.stdout:1/454: chown d2/d8/db/d25/d40/d41/c82 57 1 2024-02-22T00:33:53.144 INFO:tasks.workunit.client.0.smithi049.stdout:2/462: creat d2/d9/de/d3a/d6d/faa x:0 0 0 2024-02-22T00:33:53.152 INFO:tasks.workunit.client.0.smithi049.stdout:7/441: mkdir d1/df/d62/d48/d99 0 2024-02-22T00:33:53.153 INFO:tasks.workunit.client.0.smithi049.stdout:3/375: rmdir d0/d14/d4d/d4e 39 2024-02-22T00:33:53.155 INFO:tasks.workunit.client.0.smithi049.stdout:7/442: fsync d1/df/d62/f30 0 2024-02-22T00:33:53.158 INFO:tasks.workunit.client.0.smithi049.stdout:4/418: dwrite d3/d22/d51/f59 [0,4194304] 0 2024-02-22T00:33:53.159 INFO:tasks.workunit.client.0.smithi049.stdout:5/370: rename d0/f1d to d0/f7e 0 2024-02-22T00:33:53.162 INFO:tasks.workunit.client.0.smithi049.stdout:1/455: getdents d2/d8/d98 0 2024-02-22T00:33:53.163 INFO:tasks.workunit.client.0.smithi049.stdout:6/392: dwrite d3/d16/d32/f5d [0,4194304] 0 2024-02-22T00:33:53.166 INFO:tasks.workunit.client.0.smithi049.stdout:2/463: fdatasync d2/d9/de/d10/d46/f67 0 2024-02-22T00:33:53.167 INFO:tasks.workunit.client.0.smithi049.stdout:8/385: dwrite d1/d2/db/d15/f10 [0,4194304] 0 2024-02-22T00:33:53.170 INFO:tasks.workunit.client.0.smithi049.stdout:3/376: mkdir d0/d14/d4d/d4e/d4f/d5b/d66 0 2024-02-22T00:33:53.172 INFO:tasks.workunit.client.0.smithi049.stdout:6/393: write d3/d64/f35 [2494912,56810] 0 2024-02-22T00:33:53.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/377: chown d0/c50 683 1 2024-02-22T00:33:53.177 INFO:tasks.workunit.client.0.smithi049.stdout:4/419: dread d3/d33/f67 [0,4194304] 0 2024-02-22T00:33:53.178 INFO:tasks.workunit.client.0.smithi049.stdout:6/394: readlink d3/d64/l46 0 2024-02-22T00:33:53.178 INFO:tasks.workunit.client.0.smithi049.stdout:8/386: write d1/d2/db/d15/d30/d36/d53/f47 [1591906,90445] 0 2024-02-22T00:33:53.179 INFO:tasks.workunit.client.0.smithi049.stdout:2/464: dwrite d2/d9/fa [0,4194304] 0 2024-02-22T00:33:53.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/525: dread f14 [0,4194304] 0 2024-02-22T00:33:53.188 INFO:tasks.workunit.client.0.smithi049.stdout:8/387: readlink d1/d2/db/d15/l49 0 2024-02-22T00:33:53.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/420: unlink d3/d22/f34 0 2024-02-22T00:33:53.190 INFO:tasks.workunit.client.0.smithi049.stdout:2/465: rmdir d2/d9/de/d10/d2e/d42/d80 39 2024-02-22T00:33:53.190 INFO:tasks.workunit.client.0.smithi049.stdout:5/371: fsync d0/d20/f7b 0 2024-02-22T00:33:53.190 INFO:tasks.workunit.client.0.smithi049.stdout:9/526: rmdir d17 39 2024-02-22T00:33:53.191 INFO:tasks.workunit.client.0.smithi049.stdout:6/395: dwrite d3/d16/d32/f68 [0,4194304] 0 2024-02-22T00:33:53.193 INFO:tasks.workunit.client.0.smithi049.stdout:3/378: mknod d0/c67 0 2024-02-22T00:33:53.195 INFO:tasks.workunit.client.0.smithi049.stdout:8/388: read d1/d2/f2e [289858,87492] 0 2024-02-22T00:33:53.200 INFO:tasks.workunit.client.0.smithi049.stdout:9/527: mknod d17/d1c/d25/d39/d90/caf 0 2024-02-22T00:33:53.203 INFO:tasks.workunit.client.0.smithi049.stdout:2/466: mknod d2/d9/de/d3a/d6d/cab 0 2024-02-22T00:33:53.204 INFO:tasks.workunit.client.0.smithi049.stdout:8/389: stat d1/d2/db/d15/d30/d4b/d51/c8b 0 2024-02-22T00:33:53.205 INFO:tasks.workunit.client.0.smithi049.stdout:9/528: mkdir d17/d1c/d8c/db0 0 2024-02-22T00:33:53.207 INFO:tasks.workunit.client.0.smithi049.stdout:3/379: rename d0/d14/f21 to d0/f68 0 2024-02-22T00:33:53.208 INFO:tasks.workunit.client.0.smithi049.stdout:2/467: creat d2/d9/de/d10/d59/fac x:0 0 0 2024-02-22T00:33:53.209 INFO:tasks.workunit.client.0.smithi049.stdout:8/390: mkdir d1/d2/db/d15/d30/d36/d53/d93 0 2024-02-22T00:33:53.260 INFO:tasks.workunit.client.0.smithi049.stdout:2/468: unlink d2/d9/f2a 0 2024-02-22T00:33:53.261 INFO:tasks.workunit.client.0.smithi049.stdout:6/396: dwrite d3/d16/f25 [4194304,4194304] 0 2024-02-22T00:33:53.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/529: creat d17/d1c/d25/d39/fb1 x:0 0 0 2024-02-22T00:33:53.265 INFO:tasks.workunit.client.0.smithi049.stdout:8/391: write d1/d2/db/d15/d30/d4b/f7d [277182,39892] 0 2024-02-22T00:33:53.265 INFO:tasks.workunit.client.0.smithi049.stdout:2/469: chown d2/d9/de/d10/d2e/l35 269 1 2024-02-22T00:33:53.266 INFO:tasks.workunit.client.0.smithi049.stdout:5/372: dread d0/d20/f6a [0,4194304] 0 2024-02-22T00:33:53.268 INFO:tasks.workunit.client.0.smithi049.stdout:6/397: rmdir d3/d83 0 2024-02-22T00:33:53.270 INFO:tasks.workunit.client.0.smithi049.stdout:3/380: dwrite d0/f68 [0,4194304] 0 2024-02-22T00:33:53.272 INFO:tasks.workunit.client.0.smithi049.stdout:2/470: mknod d2/d9/de/d10/d59/cad 0 2024-02-22T00:33:53.275 INFO:tasks.workunit.client.0.smithi049.stdout:5/373: symlink d0/d26/l7f 0 2024-02-22T00:33:53.277 INFO:tasks.workunit.client.0.smithi049.stdout:2/471: chown d2/d9/de/d15/d1b/f96 744 1 2024-02-22T00:33:53.278 INFO:tasks.workunit.client.0.smithi049.stdout:9/530: link d17/d21/d4e/d4b/f5a d17/d1c/d25/d39/fb2 0 2024-02-22T00:33:53.281 INFO:tasks.workunit.client.0.smithi049.stdout:8/392: dwrite d1/d2/db/d15/d30/d4b/d51/f6e [0,4194304] 0 2024-02-22T00:33:53.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/472: chown d2/d9/de/d10/d2e/d42/d80 13967 1 2024-02-22T00:33:53.286 INFO:tasks.workunit.client.0.smithi049.stdout:8/393: mknod d1/d2/db/d15/d33/c94 0 2024-02-22T00:33:53.286 INFO:tasks.workunit.client.0.smithi049.stdout:5/374: dread d0/d20/d50/d24/d57/f5c [0,4194304] 0 2024-02-22T00:33:53.287 INFO:tasks.workunit.client.0.smithi049.stdout:3/381: getdents d0/dd/d1e 0 2024-02-22T00:33:53.291 INFO:tasks.workunit.client.0.smithi049.stdout:8/394: symlink d1/d2/db/l95 0 2024-02-22T00:33:53.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:51.764426+0000 mgr.smithi161.sazlam (mgr.24369) 58 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 892 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 96 MiB/s wr, 300 op/s 2024-02-22T00:33:53.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/531: getdents d17/d21/d47/d7a 0 2024-02-22T00:33:53.295 INFO:tasks.workunit.client.0.smithi049.stdout:9/532: chown d17/d1c/d25/d39/d67 2595710 1 2024-02-22T00:33:53.295 INFO:tasks.workunit.client.0.smithi049.stdout:9/533: truncate d17/f20 4976394 0 2024-02-22T00:33:53.297 INFO:tasks.workunit.client.0.smithi049.stdout:2/473: creat d2/d9/de/fae x:0 0 0 2024-02-22T00:33:53.309 INFO:tasks.workunit.client.0.smithi049.stdout:9/534: link d17/d21/f5c d17/d1c/d25/d71/da3/fb3 0 2024-02-22T00:33:53.312 INFO:tasks.workunit.client.0.smithi049.stdout:6/398: truncate d3/d16/d32/f68 1673233 0 2024-02-22T00:33:53.313 INFO:tasks.workunit.client.0.smithi049.stdout:8/395: getdents d1/d2/db/d15 0 2024-02-22T00:33:53.314 INFO:tasks.workunit.client.0.smithi049.stdout:9/535: dread d17/d21/d47/d5d/f6b [0,4194304] 0 2024-02-22T00:33:53.315 INFO:tasks.workunit.client.0.smithi049.stdout:5/375: write d0/f4c [181451,13622] 0 2024-02-22T00:33:53.315 INFO:tasks.workunit.client.0.smithi049.stdout:8/396: write d1/d2/f3 [142736,69733] 0 2024-02-22T00:33:53.316 INFO:tasks.workunit.client.0.smithi049.stdout:6/399: mkdir d3/d16/d4a/d4d/d8b 0 2024-02-22T00:33:53.319 INFO:tasks.workunit.client.0.smithi049.stdout:3/382: truncate d0/f6 1585308 0 2024-02-22T00:33:53.321 INFO:tasks.workunit.client.0.smithi049.stdout:2/474: link d2/d9/de/c58 d2/d9/de/caf 0 2024-02-22T00:33:53.322 INFO:tasks.workunit.client.0.smithi049.stdout:8/397: creat d1/d2/db/d15/d30/d36/d53/f96 x:0 0 0 2024-02-22T00:33:53.327 INFO:tasks.workunit.client.0.smithi049.stdout:5/376: rename d0/d20/d50/l43 to d0/d20/d50/d24/l80 0 2024-02-22T00:33:53.329 INFO:tasks.workunit.client.0.smithi049.stdout:2/475: fdatasync d2/d9/de/d10/d2e/d42/d80/f81 0 2024-02-22T00:33:53.330 INFO:tasks.workunit.client.0.smithi049.stdout:6/400: dread d3/f38 [0,4194304] 0 2024-02-22T00:33:53.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/398: chown d1/d2/db/d15/d30/d36/d53/l3e 1001811 1 2024-02-22T00:33:53.338 INFO:tasks.workunit.client.0.smithi049.stdout:9/536: dwrite d17/d1c/d25/d39/fb2 [0,4194304] 0 2024-02-22T00:33:53.339 INFO:tasks.workunit.client.0.smithi049.stdout:9/537: chown d17/d21/d3c/f59 1758395 1 2024-02-22T00:33:53.340 INFO:tasks.workunit.client.0.smithi049.stdout:9/538: write d17/d21/d3c/fa6 [299162,125672] 0 2024-02-22T00:33:53.342 INFO:tasks.workunit.client.0.smithi049.stdout:8/399: write d1/d2/db/d15/f23 [1732465,56461] 0 2024-02-22T00:33:53.342 INFO:tasks.workunit.client.0.smithi049.stdout:2/476: link d2/d9/de/d10/d59/l5b d2/d9/de/d3a/d6d/lb0 0 2024-02-22T00:33:53.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/539: write d17/d21/d4e/f4d [519340,61851] 0 2024-02-22T00:33:53.343 INFO:tasks.workunit.client.0.smithi049.stdout:5/377: link d0/d26/d4d/d6f/l16 d0/d26/d4d/l81 0 2024-02-22T00:33:53.346 INFO:tasks.workunit.client.0.smithi049.stdout:2/477: chown d2/d9/de/d3a/d6d/l71 1582 1 2024-02-22T00:33:53.347 INFO:tasks.workunit.client.0.smithi049.stdout:2/478: stat d2/d9/de/d10/d2e/f49 0 2024-02-22T00:33:53.349 INFO:tasks.workunit.client.0.smithi049.stdout:9/540: dread d17/f6c [0,4194304] 0 2024-02-22T00:33:53.352 INFO:tasks.workunit.client.0.smithi049.stdout:5/378: readlink d0/d26/d4d/d6f/l16 0 2024-02-22T00:33:53.352 INFO:tasks.workunit.client.0.smithi049.stdout:8/400: mknod d1/d2/db/d15/d30/d36/d53/d93/c97 0 2024-02-22T00:33:53.353 INFO:tasks.workunit.client.0.smithi049.stdout:8/401: chown d1/d2/d5/l6d 239685 1 2024-02-22T00:33:53.355 INFO:tasks.workunit.client.0.smithi049.stdout:5/379: write d0/f32 [4845142,42096] 0 2024-02-22T00:33:53.356 INFO:tasks.workunit.client.0.smithi049.stdout:5/380: write d0/d26/f42 [26368,75162] 0 2024-02-22T00:33:53.359 INFO:tasks.workunit.client.0.smithi049.stdout:5/381: stat d0/d20/d50/d24/d54/c60 0 2024-02-22T00:33:53.361 INFO:tasks.workunit.client.0.smithi049.stdout:9/541: truncate d17/f1f 937886 0 2024-02-22T00:33:53.363 INFO:tasks.workunit.client.0.smithi049.stdout:8/402: dread d1/d2/f2e [0,4194304] 0 2024-02-22T00:33:53.363 INFO:tasks.workunit.client.0.smithi049.stdout:5/382: creat d0/d26/d4d/d6f/d6/d74/f82 x:0 0 0 2024-02-22T00:33:53.366 INFO:tasks.workunit.client.0.smithi049.stdout:8/403: read - d1/d2/db/d15/d30/d36/d53/f79 zero size 2024-02-22T00:33:53.367 INFO:tasks.workunit.client.0.smithi049.stdout:5/383: write d0/d20/d50/f36 [3597803,101309] 0 2024-02-22T00:33:53.367 INFO:tasks.workunit.client.0.smithi049.stdout:2/479: dwrite d2/d9/de/d3a/f44 [0,4194304] 0 2024-02-22T00:33:53.374 INFO:tasks.workunit.client.0.smithi049.stdout:8/404: mknod d1/d2/db/d15/d30/c98 0 2024-02-22T00:33:53.377 INFO:tasks.workunit.client.0.smithi049.stdout:8/405: fsync d1/d2/db/f19 0 2024-02-22T00:33:53.377 INFO:tasks.workunit.client.0.smithi049.stdout:9/542: dwrite d17/d1c/d25/d39/d90/f9e [0,4194304] 0 2024-02-22T00:33:53.385 INFO:tasks.workunit.client.0.smithi049.stdout:5/384: dread d0/d20/d50/d24/f3f [0,4194304] 0 2024-02-22T00:33:53.390 INFO:tasks.workunit.client.0.smithi049.stdout:8/406: dwrite d1/d2/d5/d1b/f8e [0,4194304] 0 2024-02-22T00:33:53.394 INFO:tasks.workunit.client.0.smithi049.stdout:5/385: stat d0/d26/d4d/d6f/d6/d74/d7a 0 2024-02-22T00:33:53.396 INFO:tasks.workunit.client.0.smithi049.stdout:9/543: dwrite d17/d21/d47/d7a/fa0 [0,4194304] 0 2024-02-22T00:33:53.397 INFO:tasks.workunit.client.0.smithi049.stdout:8/407: creat d1/d2/d5/d1b/f99 x:0 0 0 2024-02-22T00:33:53.399 INFO:tasks.workunit.client.0.smithi049.stdout:8/408: chown d1/d2/d5/d56 0 1 2024-02-22T00:33:53.400 INFO:tasks.workunit.client.0.smithi049.stdout:9/544: mkdir d17/d21/d47/d5d/db4 0 2024-02-22T00:33:53.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/409: readlink d1/d2/db/d15/d30/d4b/d51/l75 0 2024-02-22T00:33:53.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/386: creat d0/d20/d50/f83 x:0 0 0 2024-02-22T00:33:53.404 INFO:tasks.workunit.client.0.smithi049.stdout:5/387: mkdir d0/d20/d84 0 2024-02-22T00:33:53.405 INFO:tasks.workunit.client.0.smithi049.stdout:5/388: chown d0/d26/l47 22 1 2024-02-22T00:33:53.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/410: creat d1/d2/f9a x:0 0 0 2024-02-22T00:33:53.410 INFO:tasks.workunit.client.0.smithi049.stdout:9/545: dwrite d17/d1c/d25/d39/fb1 [0,4194304] 0 2024-02-22T00:33:53.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/411: rmdir d1/d2/db/d15/d33 39 2024-02-22T00:33:53.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/389: creat d0/d20/d50/d24/d54/f85 x:0 0 0 2024-02-22T00:33:53.418 INFO:tasks.workunit.client.0.smithi049.stdout:8/412: creat d1/f9b x:0 0 0 2024-02-22T00:33:53.418 INFO:tasks.workunit.client.0.smithi049.stdout:5/390: mknod d0/d26/d4d/d70/c86 0 2024-02-22T00:33:53.419 INFO:tasks.workunit.client.0.smithi049.stdout:9/546: dwrite d17/d1c/f1e [0,4194304] 0 2024-02-22T00:33:53.421 INFO:tasks.workunit.client.0.smithi049.stdout:9/547: chown d17/d21/d3c/f3d 1240 1 2024-02-22T00:33:53.423 INFO:tasks.workunit.client.0.smithi049.stdout:5/391: symlink d0/d20/d50/d24/d57/l87 0 2024-02-22T00:33:53.425 INFO:tasks.workunit.client.0.smithi049.stdout:8/413: creat d1/f9c x:0 0 0 2024-02-22T00:33:53.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:51.764426+0000 mgr.smithi161.sazlam (mgr.24369) 58 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 892 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 96 MiB/s wr, 300 op/s 2024-02-22T00:33:53.431 INFO:tasks.workunit.client.0.smithi049.stdout:9/548: getdents d17/d1c/d38 0 2024-02-22T00:33:53.432 INFO:tasks.workunit.client.0.smithi049.stdout:5/392: link d0/d26/d4d/d6f/d6/fd d0/d20/d50/d24/f88 0 2024-02-22T00:33:53.435 INFO:tasks.workunit.client.0.smithi049.stdout:5/393: dread d0/d20/d50/d24/d3b/f49 [0,4194304] 0 2024-02-22T00:33:53.437 INFO:tasks.workunit.client.0.smithi049.stdout:5/394: mkdir d0/d26/d4d/d6f/d6/d74/d7a/d89 0 2024-02-22T00:33:53.439 INFO:tasks.workunit.client.0.smithi049.stdout:5/395: chown d0/d26/d4d/d6f/c76 18 1 2024-02-22T00:33:53.440 INFO:tasks.workunit.client.0.smithi049.stdout:8/414: write d1/d2/d5/f7a [1280842,58950] 0 2024-02-22T00:33:53.440 INFO:tasks.workunit.client.0.smithi049.stdout:5/396: chown d0/d20/d50/d24/d3b/f66 369 1 2024-02-22T00:33:53.457 INFO:tasks.workunit.client.0.smithi049.stdout:5/397: dwrite d0/f4c [0,4194304] 0 2024-02-22T00:33:53.459 INFO:tasks.workunit.client.0.smithi049.stdout:5/398: chown d0/d20/d50/d24/c2c 754 1 2024-02-22T00:33:53.459 INFO:tasks.workunit.client.0.smithi049.stdout:5/399: chown d0/d20/d50/c29 5107207 1 2024-02-22T00:33:53.460 INFO:tasks.workunit.client.0.smithi049.stdout:5/400: fsync d0/d20/f6e 0 2024-02-22T00:33:53.462 INFO:tasks.workunit.client.0.smithi049.stdout:5/401: chown d0/d20/d50/d24/c2c 53 1 2024-02-22T00:33:53.464 INFO:tasks.workunit.client.0.smithi049.stdout:5/402: mknod d0/d26/d4d/d6f/d6/c8a 0 2024-02-22T00:33:53.466 INFO:tasks.workunit.client.0.smithi049.stdout:5/403: chown d0/d26/d4d/d6f/d6/f12 2031 1 2024-02-22T00:33:53.467 INFO:tasks.workunit.client.0.smithi049.stdout:8/415: dread d1/d2/db/d15/d30/d36/d53/f5f [0,4194304] 0 2024-02-22T00:33:53.467 INFO:tasks.workunit.client.0.smithi049.stdout:5/404: read d0/d20/f7b [980576,80359] 0 2024-02-22T00:33:53.470 INFO:tasks.workunit.client.0.smithi049.stdout:8/416: creat d1/d2/d5/d1b/d39/f9d x:0 0 0 2024-02-22T00:33:53.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/405: symlink d0/d26/d4d/d6f/d6/l8b 0 2024-02-22T00:33:53.471 INFO:tasks.workunit.client.0.smithi049.stdout:8/417: chown d1/d2/d5/d1b/d39/f40 0 1 2024-02-22T00:33:53.472 INFO:tasks.workunit.client.0.smithi049.stdout:5/406: write d0/d26/d4d/d6f/d6/f72 [873313,123893] 0 2024-02-22T00:33:53.474 INFO:tasks.workunit.client.0.smithi049.stdout:8/418: write d1/d2/db/d15/d33/f48 [1158488,79577] 0 2024-02-22T00:33:53.482 INFO:tasks.workunit.client.0.smithi049.stdout:5/407: dwrite d0/d26/d4d/d6f/d6/f12 [0,4194304] 0 2024-02-22T00:33:53.482 INFO:tasks.workunit.client.0.smithi049.stdout:8/419: write d1/d2/f38 [771067,41977] 0 2024-02-22T00:33:53.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/420: fdatasync d1/d2/db/d1c/f8f 0 2024-02-22T00:33:53.487 INFO:tasks.workunit.client.0.smithi049.stdout:5/408: dread d0/f4c [0,4194304] 0 2024-02-22T00:33:53.496 INFO:tasks.workunit.client.0.smithi049.stdout:8/421: dread d1/d2/f38 [0,4194304] 0 2024-02-22T00:33:53.497 INFO:tasks.workunit.client.0.smithi049.stdout:8/422: readlink d1/d2/db/d15/d30/l63 0 2024-02-22T00:33:53.497 INFO:tasks.workunit.client.0.smithi049.stdout:8/423: stat d1/f9b 0 2024-02-22T00:33:53.499 INFO:tasks.workunit.client.0.smithi049.stdout:5/409: write d0/d20/d50/d24/f88 [1675135,43604] 0 2024-02-22T00:33:53.500 INFO:tasks.workunit.client.0.smithi049.stdout:8/424: mknod d1/d2/db/d15/d30/d36/d52/c9e 0 2024-02-22T00:33:53.501 INFO:tasks.workunit.client.0.smithi049.stdout:5/410: creat d0/d26/d4d/d6f/d6/d74/f8c x:0 0 0 2024-02-22T00:33:53.501 INFO:tasks.workunit.client.0.smithi049.stdout:8/425: truncate d1/f9b 52425 0 2024-02-22T00:33:53.504 INFO:tasks.workunit.client.0.smithi049.stdout:5/411: unlink d0/d26/d4d/d6f/d6/f13 0 2024-02-22T00:33:53.505 INFO:tasks.workunit.client.0.smithi049.stdout:8/426: dread d1/d2/d5/f34 [0,4194304] 0 2024-02-22T00:33:53.507 INFO:tasks.workunit.client.0.smithi049.stdout:5/412: creat d0/d20/d50/d24/d57/f8d x:0 0 0 2024-02-22T00:33:53.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/427: dwrite d1/d2/d5/f2c [0,4194304] 0 2024-02-22T00:33:53.516 INFO:tasks.workunit.client.0.smithi049.stdout:8/428: fsync d1/d2/d5/d1b/d39/f6c 0 2024-02-22T00:33:53.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/429: mknod d1/d2/db/d15/d30/d36/c9f 0 2024-02-22T00:33:53.526 INFO:tasks.workunit.client.0.smithi049.stdout:8/430: truncate d1/d2/db/f21 5044220 0 2024-02-22T00:33:53.527 INFO:tasks.workunit.client.0.smithi049.stdout:8/431: truncate d1/d2/db/d15/d33/f4a 4527971 0 2024-02-22T00:33:53.529 INFO:tasks.workunit.client.0.smithi049.stdout:8/432: dread d1/d2/f2e [0,4194304] 0 2024-02-22T00:33:53.533 INFO:tasks.workunit.client.0.smithi049.stdout:8/433: dread d1/d2/d5/d1b/f8e [0,4194304] 0 2024-02-22T00:33:53.534 INFO:tasks.workunit.client.0.smithi049.stdout:8/434: mkdir d1/d2/d5/d1b/d39/d60/da0 0 2024-02-22T00:33:53.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/435: rmdir d1/d2/d8c 39 2024-02-22T00:33:53.539 INFO:tasks.workunit.client.0.smithi049.stdout:8/436: rename d1/d4c/f85 to d1/d2/d5/d1b/d39/d81/fa1 0 2024-02-22T00:33:53.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/437: dwrite d1/d2/d5/d1b/f7f [0,4194304] 0 2024-02-22T00:33:53.549 INFO:tasks.workunit.client.0.smithi049.stdout:8/438: dread - d1/d2/d5/d1b/d39/f9d zero size 2024-02-22T00:33:53.554 INFO:tasks.workunit.client.0.smithi049.stdout:8/439: fdatasync d1/d2/db/d15/d30/d36/d53/f79 0 2024-02-22T00:33:53.555 INFO:tasks.workunit.client.0.smithi049.stdout:8/440: write d1/d2/db/f16 [205270,51160] 0 2024-02-22T00:33:53.557 INFO:tasks.workunit.client.0.smithi049.stdout:8/441: fsync d1/d2/db/d15/d30/d36/d53/f5f 0 2024-02-22T00:33:53.685 INFO:tasks.workunit.client.0.smithi049.stdout:0/379: sync 2024-02-22T00:33:53.689 INFO:tasks.workunit.client.0.smithi049.stdout:0/380: rename d3/df/d17/d1b/l22 to d3/l68 0 2024-02-22T00:33:53.696 INFO:tasks.workunit.client.0.smithi049.stdout:0/381: dwrite d3/df/f11 [0,4194304] 0 2024-02-22T00:33:53.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/382: dread d3/d6/f5e [0,4194304] 0 2024-02-22T00:33:53.707 INFO:tasks.workunit.client.0.smithi049.stdout:0/383: dwrite d3/d6/f26 [0,4194304] 0 2024-02-22T00:33:53.710 INFO:tasks.workunit.client.0.smithi049.stdout:0/384: creat d3/df/d17/d50/d62/f69 x:0 0 0 2024-02-22T00:33:53.712 INFO:tasks.workunit.client.0.smithi049.stdout:0/385: dread - d3/d1e/f61 zero size 2024-02-22T00:33:53.713 INFO:tasks.workunit.client.0.smithi049.stdout:0/386: chown d3/d6/d8/d36/l4e 2 1 2024-02-22T00:33:53.714 INFO:tasks.workunit.client.0.smithi049.stdout:0/387: read d3/d6/f5e [3343321,128665] 0 2024-02-22T00:33:53.717 INFO:tasks.workunit.client.0.smithi049.stdout:0/388: creat d3/d1e/f6a x:0 0 0 2024-02-22T00:33:53.730 INFO:tasks.workunit.client.0.smithi049.stdout:0/389: rmdir d3/df/d17/d50/d62 39 2024-02-22T00:33:53.731 INFO:tasks.workunit.client.0.smithi049.stdout:0/390: write d3/d6/f26 [2671770,93998] 0 2024-02-22T00:33:53.734 INFO:tasks.workunit.client.0.smithi049.stdout:0/391: creat d3/df/d48/d54/f6b x:0 0 0 2024-02-22T00:33:53.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/392: creat d3/d6/d29/f6c x:0 0 0 2024-02-22T00:33:53.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/393: symlink d3/d1e/d58/l6d 0 2024-02-22T00:33:53.740 INFO:tasks.workunit.client.0.smithi049.stdout:0/394: creat d3/d6/d8/f6e x:0 0 0 2024-02-22T00:33:53.741 INFO:tasks.workunit.client.0.smithi049.stdout:0/395: write d3/d6/d8/f6e [440512,61086] 0 2024-02-22T00:33:53.744 INFO:tasks.workunit.client.0.smithi049.stdout:0/396: mkdir d3/df/d48/d6f 0 2024-02-22T00:33:53.749 INFO:tasks.workunit.client.0.smithi049.stdout:0/397: getdents d3/d6/d8 0 2024-02-22T00:33:53.751 INFO:tasks.workunit.client.0.smithi049.stdout:0/398: readlink d3/d6/d29/l38 0 2024-02-22T00:33:53.752 INFO:tasks.workunit.client.0.smithi049.stdout:0/399: write d3/df/f5b [183333,30681] 0 2024-02-22T00:33:53.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/400: dread d3/df/f2b [0,4194304] 0 2024-02-22T00:33:53.766 INFO:tasks.workunit.client.0.smithi049.stdout:0/401: dwrite d3/d1e/f6a [0,4194304] 0 2024-02-22T00:33:53.767 INFO:tasks.workunit.client.0.smithi049.stdout:0/402: chown d3/d6/d8/l3d 13 1 2024-02-22T00:33:53.771 INFO:tasks.workunit.client.0.smithi049.stdout:0/403: dread d3/d6/f5e [0,4194304] 0 2024-02-22T00:33:53.779 INFO:tasks.workunit.client.0.smithi049.stdout:0/404: dwrite d3/df/f5b [0,4194304] 0 2024-02-22T00:33:53.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/405: rmdir d3/d1e/d58 39 2024-02-22T00:33:53.790 INFO:tasks.workunit.client.0.smithi049.stdout:0/406: dwrite d3/df/f11 [0,4194304] 0 2024-02-22T00:33:53.793 INFO:tasks.workunit.client.0.smithi049.stdout:0/407: readlink d3/d1e/l2e 0 2024-02-22T00:33:53.890 INFO:tasks.workunit.client.0.smithi049.stdout:7/443: sync 2024-02-22T00:33:53.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/444: symlink d1/d41/d28/d71/d72/d95/l9a 0 2024-02-22T00:33:53.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/445: dread d1/df/d62/d1c/d1d/f34 [0,4194304] 0 2024-02-22T00:33:53.913 INFO:tasks.workunit.client.0.smithi049.stdout:7/446: dwrite d1/df/d62/d1c/f7d [0,4194304] 0 2024-02-22T00:33:53.920 INFO:tasks.workunit.client.0.smithi049.stdout:7/447: dwrite d1/df/d62/d1c/d6d/f7b [0,4194304] 0 2024-02-22T00:33:53.938 INFO:tasks.workunit.client.0.smithi049.stdout:7/448: dread d1/df/d62/d1c/d1d/f47 [0,4194304] 0 2024-02-22T00:33:53.945 INFO:tasks.workunit.client.0.smithi049.stdout:7/449: dwrite d1/df/d62/f11 [0,4194304] 0 2024-02-22T00:33:53.948 INFO:tasks.workunit.client.0.smithi049.stdout:7/450: mknod d1/df/d62/d1c/d1d/d6e/c9b 0 2024-02-22T00:33:53.950 INFO:tasks.workunit.client.0.smithi049.stdout:7/451: stat d1/d41/d55/d89 0 2024-02-22T00:33:53.951 INFO:tasks.workunit.client.0.smithi049.stdout:7/452: write d1/d49/d4d/f75 [452838,5266] 0 2024-02-22T00:33:53.953 INFO:tasks.workunit.client.0.smithi049.stdout:7/453: fsync d1/df/d62/d1c/d1d/f34 0 2024-02-22T00:33:53.954 INFO:tasks.workunit.client.0.smithi049.stdout:7/454: chown d1/df/d62/d1c/d1d/d6e 1885148 1 2024-02-22T00:33:53.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/455: write d1/df/d62/d1c/d1d/d6e/f76 [3578357,7836] 0 2024-02-22T00:33:53.956 INFO:tasks.workunit.client.0.smithi049.stdout:7/456: chown d1/df/d62/d48/f8b 40703028 1 2024-02-22T00:33:53.960 INFO:tasks.workunit.client.0.smithi049.stdout:7/457: symlink d1/df/d62/d1c/d1d/d6e/l9c 0 2024-02-22T00:33:53.966 INFO:tasks.workunit.client.0.smithi049.stdout:7/458: dwrite d1/df/d62/d60/f7c [0,4194304] 0 2024-02-22T00:33:53.967 INFO:tasks.workunit.client.0.smithi049.stdout:7/459: readlink d1/d49/l5c 0 2024-02-22T00:33:53.972 INFO:tasks.workunit.client.0.smithi049.stdout:7/460: rename d1/f4a to d1/df/d62/d57/f9d 0 2024-02-22T00:33:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:4/421: sync 2024-02-22T00:33:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:5/413: sync 2024-02-22T00:33:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:1/456: sync 2024-02-22T00:33:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:9/549: sync 2024-02-22T00:33:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/383: sync 2024-02-22T00:33:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:8/442: sync 2024-02-22T00:33:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:2/480: sync 2024-02-22T00:33:53.975 INFO:tasks.workunit.client.0.smithi049.stdout:6/401: sync 2024-02-22T00:33:53.976 INFO:tasks.workunit.client.0.smithi049.stdout:8/443: stat d1/d2 0 2024-02-22T00:33:53.978 INFO:tasks.workunit.client.0.smithi049.stdout:5/414: stat d0/d26/d4d/d6f/c76 0 2024-02-22T00:33:53.978 INFO:tasks.workunit.client.0.smithi049.stdout:3/384: chown d0/d14/d4d/d4e/d4f/d5b 732 1 2024-02-22T00:33:53.979 INFO:tasks.workunit.client.0.smithi049.stdout:6/402: mkdir d3/d16/d3b/d8c 0 2024-02-22T00:33:53.980 INFO:tasks.workunit.client.0.smithi049.stdout:4/422: symlink d3/d8/d10/d43/l88 0 2024-02-22T00:33:53.981 INFO:tasks.workunit.client.0.smithi049.stdout:7/461: read d1/d41/d28/f39 [3512052,118797] 0 2024-02-22T00:33:53.981 INFO:tasks.workunit.client.0.smithi049.stdout:9/550: mknod d17/d21/d4e/d89/d94/cb5 0 2024-02-22T00:33:53.983 INFO:tasks.workunit.client.0.smithi049.stdout:4/423: chown d3/d8/d10/d39 175 1 2024-02-22T00:33:53.984 INFO:tasks.workunit.client.0.smithi049.stdout:9/551: fdatasync d17/d1c/f2b 0 2024-02-22T00:33:53.984 INFO:tasks.workunit.client.0.smithi049.stdout:1/457: unlink d2/d8/db/d25/d62/l91 0 2024-02-22T00:33:53.986 INFO:tasks.workunit.client.0.smithi049.stdout:2/481: rmdir d2/d9/dd/d4d/d72/d90 0 2024-02-22T00:33:53.987 INFO:tasks.workunit.client.0.smithi049.stdout:5/415: creat d0/d26/d4d/d7c/f8e x:0 0 0 2024-02-22T00:33:53.988 INFO:tasks.workunit.client.0.smithi049.stdout:8/444: rename d1/d2/db/f16 to d1/d2/db/fa2 0 2024-02-22T00:33:53.989 INFO:tasks.workunit.client.0.smithi049.stdout:4/424: fdatasync d3/d8/f14 0 2024-02-22T00:33:53.994 INFO:tasks.workunit.client.0.smithi049.stdout:6/403: dread d3/d16/f53 [0,4194304] 0 2024-02-22T00:33:53.994 INFO:tasks.workunit.client.0.smithi049.stdout:1/458: unlink d2/d8/c1b 0 2024-02-22T00:33:53.996 INFO:tasks.workunit.client.0.smithi049.stdout:5/416: fdatasync d0/d20/d50/d24/f2f 0 2024-02-22T00:33:53.997 INFO:tasks.workunit.client.0.smithi049.stdout:4/425: mkdir d3/d13/d48/d89 0 2024-02-22T00:33:53.999 INFO:tasks.workunit.client.0.smithi049.stdout:2/482: rename d2/d9/de/f2b to d2/d9/d17/fb1 0 2024-02-22T00:33:53.999 INFO:tasks.workunit.client.0.smithi049.stdout:3/385: dwrite d0/d14/f1b [0,4194304] 0 2024-02-22T00:33:54.006 INFO:tasks.workunit.client.0.smithi049.stdout:5/417: read - d0/d26/d4d/d6f/f5e zero size 2024-02-22T00:33:54.006 INFO:tasks.workunit.client.0.smithi049.stdout:9/552: dread d17/d21/f33 [4194304,4194304] 0 2024-02-22T00:33:54.006 INFO:tasks.workunit.client.0.smithi049.stdout:8/445: dwrite d1/d2/f2e [0,4194304] 0 2024-02-22T00:33:54.007 INFO:tasks.workunit.client.0.smithi049.stdout:2/483: write d2/d9/f6e [217945,26486] 0 2024-02-22T00:33:54.007 INFO:tasks.workunit.client.0.smithi049.stdout:4/426: truncate f2 6026636 0 2024-02-22T00:33:54.012 INFO:tasks.workunit.client.0.smithi049.stdout:5/418: read - d0/d26/d4d/d6f/d6/d74/f82 zero size 2024-02-22T00:33:54.015 INFO:tasks.workunit.client.0.smithi049.stdout:7/462: truncate d1/f3d 3162117 0 2024-02-22T00:33:54.016 INFO:tasks.workunit.client.0.smithi049.stdout:6/404: mknod d3/d36/d57/c8d 0 2024-02-22T00:33:54.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/427: rename d3/d13 to d3/d22/d51/d8a 0 2024-02-22T00:33:54.021 INFO:tasks.workunit.client.0.smithi049.stdout:8/446: mkdir d1/d2/db/da3 0 2024-02-22T00:33:54.021 INFO:tasks.workunit.client.0.smithi049.stdout:1/459: mkdir d2/da0 0 2024-02-22T00:33:54.022 INFO:tasks.workunit.client.0.smithi049.stdout:3/386: creat d0/d14/f69 x:0 0 0 2024-02-22T00:33:54.023 INFO:tasks.workunit.client.0.smithi049.stdout:9/553: write d17/d21/d3c/f3d [133565,44164] 0 2024-02-22T00:33:54.024 INFO:tasks.workunit.client.0.smithi049.stdout:3/387: dread - d0/dd/f4c zero size 2024-02-22T00:33:54.026 INFO:tasks.workunit.client.0.smithi049.stdout:0/408: sync 2024-02-22T00:33:54.028 INFO:tasks.workunit.client.0.smithi049.stdout:2/484: rename d2/d9/de/d10/d2e/f7c to d2/d9/dd/d4d/d5a/fb2 0 2024-02-22T00:33:54.028 INFO:tasks.workunit.client.0.smithi049.stdout:4/428: write d3/d8/d10/d45/f5a [120650,88559] 0 2024-02-22T00:33:54.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/405: dwrite d3/d16/f19 [4194304,4194304] 0 2024-02-22T00:33:54.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/388: write d0/d14/f5c [840240,9069] 0 2024-02-22T00:33:54.028 INFO:tasks.workunit.client.0.smithi049.stdout:8/447: fdatasync d1/f1e 0 2024-02-22T00:33:54.040 INFO:tasks.workunit.client.0.smithi049.stdout:7/463: rename d1/d41/d55/d89/l93 to d1/d41/d28/d71/d72/l9e 0 2024-02-22T00:33:54.040 INFO:tasks.workunit.client.0.smithi049.stdout:9/554: symlink d17/d21/d4e/lb6 0 2024-02-22T00:33:54.041 INFO:tasks.workunit.client.0.smithi049.stdout:4/429: creat d3/d22/d51/d8a/f8b x:0 0 0 2024-02-22T00:33:54.041 INFO:tasks.workunit.client.0.smithi049.stdout:3/389: fsync d0/d14/d4d/f36 0 2024-02-22T00:33:54.042 INFO:tasks.workunit.client.0.smithi049.stdout:0/409: write d3/df/d17/d50/d62/f69 [165475,15568] 0 2024-02-22T00:33:54.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/555: chown ca 843 1 2024-02-22T00:33:54.043 INFO:tasks.workunit.client.0.smithi049.stdout:2/485: symlink d2/d9/lb3 0 2024-02-22T00:33:54.043 INFO:tasks.workunit.client.0.smithi049.stdout:8/448: creat d1/d2/d5/d56/fa4 x:0 0 0 2024-02-22T00:33:54.058 INFO:tasks.workunit.client.0.smithi049.stdout:3/390: fdatasync d0/d14/f1b 0 2024-02-22T00:33:54.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/464: chown d1/df/d62/d1c/d24/d2e/f42 26087956 1 2024-02-22T00:33:54.060 INFO:tasks.workunit.client.0.smithi049.stdout:1/460: creat d2/d8/db/d25/d40/d41/fa1 x:0 0 0 2024-02-22T00:33:54.062 INFO:tasks.workunit.client.0.smithi049.stdout:9/556: write d17/d21/d47/f7e [819611,94084] 0 2024-02-22T00:33:54.062 INFO:tasks.workunit.client.0.smithi049.stdout:8/449: dread - d1/d2/db/d1c/f8f zero size 2024-02-22T00:33:54.063 INFO:tasks.workunit.client.0.smithi049.stdout:2/486: fsync d2/d9/de/d10/d2e/fa5 0 2024-02-22T00:33:54.064 INFO:tasks.workunit.client.0.smithi049.stdout:0/410: chown d3/d1e/d58/l6d 217172 1 2024-02-22T00:33:54.066 INFO:tasks.workunit.client.0.smithi049.stdout:7/465: chown d1/df/d62/d48/c5b 1 1 2024-02-22T00:33:54.066 INFO:tasks.workunit.client.0.smithi049.stdout:6/406: dwrite d3/d36/f4e [0,4194304] 0 2024-02-22T00:33:54.067 INFO:tasks.workunit.client.0.smithi049.stdout:3/391: creat d0/dd/f6a x:0 0 0 2024-02-22T00:33:54.071 INFO:tasks.workunit.client.0.smithi049.stdout:4/430: creat d3/d8/f8c x:0 0 0 2024-02-22T00:33:54.071 INFO:tasks.workunit.client.0.smithi049.stdout:9/557: chown d17/d1c/f63 1713659 1 2024-02-22T00:33:54.073 INFO:tasks.workunit.client.0.smithi049.stdout:1/461: write d2/d8/db/d25/d40/d41/d68/f80 [909675,57243] 0 2024-02-22T00:33:54.073 INFO:tasks.workunit.client.0.smithi049.stdout:6/407: chown d3/f14 4 1 2024-02-22T00:33:54.073 INFO:tasks.workunit.client.0.smithi049.stdout:8/450: read d1/d2/f27 [2318563,121476] 0 2024-02-22T00:33:54.074 INFO:tasks.workunit.client.0.smithi049.stdout:0/411: write d3/f43 [2039164,4179] 0 2024-02-22T00:33:54.076 INFO:tasks.workunit.client.0.smithi049.stdout:0/412: dread - d3/df/d48/d54/f5d zero size 2024-02-22T00:33:54.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/392: creat d0/d14/d4d/d4e/d4f/d5b/f6b x:0 0 0 2024-02-22T00:33:54.078 INFO:tasks.workunit.client.0.smithi049.stdout:7/466: symlink d1/d41/l9f 0 2024-02-22T00:33:54.080 INFO:tasks.workunit.client.0.smithi049.stdout:3/393: write d0/dd/d1e/f47 [165726,102583] 0 2024-02-22T00:33:54.080 INFO:tasks.workunit.client.0.smithi049.stdout:2/487: creat d2/d9/de/d3a/fb4 x:0 0 0 2024-02-22T00:33:54.084 INFO:tasks.workunit.client.0.smithi049.stdout:4/431: rename d3/d8/d10/d12/f65 to d3/d22/f8d 0 2024-02-22T00:33:54.085 INFO:tasks.workunit.client.0.smithi049.stdout:1/462: symlink d2/d8/db/d25/d40/d41/d84/d8b/la2 0 2024-02-22T00:33:54.086 INFO:tasks.workunit.client.0.smithi049.stdout:1/463: dread - d2/d8/db/d25/d40/d41/d5b/f89 zero size 2024-02-22T00:33:54.092 INFO:tasks.workunit.client.0.smithi049.stdout:9/558: rename d17/d1c/d38/f56 to d17/d1c/d25/d71/da3/fb7 0 2024-02-22T00:33:54.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/408: dwrite d3/d16/d32/f68 [0,4194304] 0 2024-02-22T00:33:54.096 INFO:tasks.workunit.client.0.smithi049.stdout:8/451: rename d1/d2/db to d1/d2/da5 0 2024-02-22T00:33:54.098 INFO:tasks.workunit.client.0.smithi049.stdout:4/432: symlink d3/d8/d10/d43/d4d/l8e 0 2024-02-22T00:33:54.102 INFO:tasks.workunit.client.0.smithi049.stdout:7/467: write d1/f3d [3831947,1794] 0 2024-02-22T00:33:54.102 INFO:tasks.workunit.client.0.smithi049.stdout:3/394: link d0/dd/f6a d0/dd/d1e/f6c 0 2024-02-22T00:33:54.102 INFO:tasks.workunit.client.0.smithi049.stdout:1/464: creat d2/d8/db/d25/d62/fa3 x:0 0 0 2024-02-22T00:33:54.105 INFO:tasks.workunit.client.0.smithi049.stdout:9/559: creat d17/d1c/d25/d39/d90/fb8 x:0 0 0 2024-02-22T00:33:54.111 INFO:tasks.workunit.client.0.smithi049.stdout:7/468: chown d1/c33 500972 1 2024-02-22T00:33:54.112 INFO:tasks.workunit.client.0.smithi049.stdout:9/560: write d17/d1c/d25/d39/fb1 [3026121,34813] 0 2024-02-22T00:33:54.112 INFO:tasks.workunit.client.0.smithi049.stdout:0/413: getdents d3/df/d48 0 2024-02-22T00:33:54.112 INFO:tasks.workunit.client.0.smithi049.stdout:3/395: dwrite d0/dd/f9 [0,4194304] 0 2024-02-22T00:33:54.114 INFO:tasks.workunit.client.0.smithi049.stdout:4/433: mknod d3/c8f 0 2024-02-22T00:33:54.115 INFO:tasks.workunit.client.0.smithi049.stdout:8/452: symlink d1/d2/d8c/la6 0 2024-02-22T00:33:54.118 INFO:tasks.workunit.client.0.smithi049.stdout:2/488: write d2/d9/de/d10/d46/d63/f7e [696591,65676] 0 2024-02-22T00:33:54.118 INFO:tasks.workunit.client.0.smithi049.stdout:7/469: write d1/df/d62/d1c/d6d/f7b [1974548,87929] 0 2024-02-22T00:33:54.120 INFO:tasks.workunit.client.0.smithi049.stdout:6/409: getdents d3/d16/d32 0 2024-02-22T00:33:54.121 INFO:tasks.workunit.client.0.smithi049.stdout:9/561: fdatasync d17/d1c/d25/d39/fb2 0 2024-02-22T00:33:54.124 INFO:tasks.workunit.client.0.smithi049.stdout:0/414: fsync d3/df/d17/f20 0 2024-02-22T00:33:54.127 INFO:tasks.workunit.client.0.smithi049.stdout:9/562: stat d17/d21/d4e/c41 0 2024-02-22T00:33:54.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/434: rename d3/d8/d20/f7a to d3/d8/d10/d43/d4d/f90 0 2024-02-22T00:33:54.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/489: write d2/d9/dd/d4d/d5a/fa3 [107268,40955] 0 2024-02-22T00:33:54.133 INFO:tasks.workunit.client.0.smithi049.stdout:0/415: fsync d3/f13 0 2024-02-22T00:33:54.134 INFO:tasks.workunit.client.0.smithi049.stdout:6/410: readlink d3/d16/d4a/d4d/l5b 0 2024-02-22T00:33:54.134 INFO:tasks.workunit.client.0.smithi049.stdout:1/465: dread d2/d8/db/f2d [0,4194304] 0 2024-02-22T00:33:54.135 INFO:tasks.workunit.client.0.smithi049.stdout:3/396: dwrite d0/dd/f13 [4194304,4194304] 0 2024-02-22T00:33:54.137 INFO:tasks.workunit.client.0.smithi049.stdout:9/563: write d17/d1c/f81 [443116,112498] 0 2024-02-22T00:33:54.140 INFO:tasks.workunit.client.0.smithi049.stdout:4/435: chown d3/d8/d10/l6b 0 1 2024-02-22T00:33:54.141 INFO:tasks.workunit.client.0.smithi049.stdout:6/411: unlink d3/d16/d45/f56 0 2024-02-22T00:33:54.142 INFO:tasks.workunit.client.0.smithi049.stdout:0/416: write d3/df/f5b [3561430,110312] 0 2024-02-22T00:33:54.144 INFO:tasks.workunit.client.0.smithi049.stdout:8/453: dwrite d1/d4c/f4f [0,4194304] 0 2024-02-22T00:33:54.145 INFO:tasks.workunit.client.0.smithi049.stdout:1/466: mkdir d2/d8/db/d25/da4 0 2024-02-22T00:33:54.146 INFO:tasks.workunit.client.0.smithi049.stdout:9/564: rmdir d17/d21/d47/d5d 39 2024-02-22T00:33:54.148 INFO:tasks.workunit.client.0.smithi049.stdout:3/397: creat d0/d59/f6d x:0 0 0 2024-02-22T00:33:54.149 INFO:tasks.workunit.client.0.smithi049.stdout:6/412: dread - d3/d16/d4a/d4d/f84 zero size 2024-02-22T00:33:54.152 INFO:tasks.workunit.client.0.smithi049.stdout:0/417: mknod d3/df/d17/d1b/c70 0 2024-02-22T00:33:54.152 INFO:tasks.workunit.client.0.smithi049.stdout:7/470: dwrite d1/df/d62/d1c/d1d/d6e/f76 [0,4194304] 0 2024-02-22T00:33:54.153 INFO:tasks.workunit.client.0.smithi049.stdout:2/490: getdents d2/d9/de/d3a/d93 0 2024-02-22T00:33:54.155 INFO:tasks.workunit.client.0.smithi049.stdout:9/565: unlink d17/d21/d47/fa7 0 2024-02-22T00:33:54.157 INFO:tasks.workunit.client.0.smithi049.stdout:0/418: stat d3/d6/d29/l3c 0 2024-02-22T00:33:54.159 INFO:tasks.workunit.client.0.smithi049.stdout:4/436: rename d3/c3b to d3/d22/d51/d8a/d48/c91 0 2024-02-22T00:33:54.159 INFO:tasks.workunit.client.0.smithi049.stdout:9/566: chown d17/d21/d47/f69 7 1 2024-02-22T00:33:54.163 INFO:tasks.workunit.client.0.smithi049.stdout:0/419: dread d3/d1e/f6a [0,4194304] 0 2024-02-22T00:33:54.164 INFO:tasks.workunit.client.0.smithi049.stdout:8/454: mknod d1/d4c/ca7 0 2024-02-22T00:33:54.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/398: mkdir d0/dd/d26/d2e/d52/d6e 0 2024-02-22T00:33:54.165 INFO:tasks.workunit.client.0.smithi049.stdout:0/420: chown d3/d1e/d58 0 1 2024-02-22T00:33:54.166 INFO:tasks.workunit.client.0.smithi049.stdout:4/437: mkdir d3/d22/d51/d92 0 2024-02-22T00:33:54.166 INFO:tasks.workunit.client.0.smithi049.stdout:9/567: mknod d17/d1c/d25/d39/d67/cb9 0 2024-02-22T00:33:54.167 INFO:tasks.workunit.client.0.smithi049.stdout:6/413: mknod d3/d16/d3b/d8c/c8e 0 2024-02-22T00:33:54.168 INFO:tasks.workunit.client.0.smithi049.stdout:2/491: mknod d2/d9/de/d10/d2e/d42/d80/cb5 0 2024-02-22T00:33:54.169 INFO:tasks.workunit.client.0.smithi049.stdout:3/399: mkdir d0/dd/d6f 0 2024-02-22T00:33:54.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/568: mkdir d17/d1c/d25/dba 0 2024-02-22T00:33:54.174 INFO:tasks.workunit.client.0.smithi049.stdout:7/471: link d1/df/d62/d48/f8b d1/d41/d28/fa0 0 2024-02-22T00:33:54.176 INFO:tasks.workunit.client.0.smithi049.stdout:6/414: unlink d3/d36/d57/c8d 0 2024-02-22T00:33:54.178 INFO:tasks.workunit.client.0.smithi049.stdout:4/438: truncate d3/d22/f50 691791 0 2024-02-22T00:33:54.180 INFO:tasks.workunit.client.0.smithi049.stdout:7/472: dread - d1/df/d62/d1c/d24/f4b zero size 2024-02-22T00:33:54.180 INFO:tasks.workunit.client.0.smithi049.stdout:1/467: dread d2/d8/da/f1e [0,4194304] 0 2024-02-22T00:33:54.180 INFO:tasks.workunit.client.0.smithi049.stdout:6/415: dread - d3/d64/f6a zero size 2024-02-22T00:33:54.181 INFO:tasks.workunit.client.0.smithi049.stdout:8/455: dwrite d1/d2/da5/f78 [4194304,4194304] 0 2024-02-22T00:33:54.183 INFO:tasks.workunit.client.0.smithi049.stdout:9/569: write d17/d1c/d25/f60 [1252167,20973] 0 2024-02-22T00:33:54.184 INFO:tasks.workunit.client.0.smithi049.stdout:3/400: creat d0/d14/d4d/d4e/d4f/d5b/d66/f70 x:0 0 0 2024-02-22T00:33:54.187 INFO:tasks.workunit.client.0.smithi049.stdout:2/492: creat d2/d9/de/d10/d46/fb6 x:0 0 0 2024-02-22T00:33:54.189 INFO:tasks.workunit.client.0.smithi049.stdout:1/468: fdatasync d2/d8/da/f39 0 2024-02-22T00:33:54.189 INFO:tasks.workunit.client.0.smithi049.stdout:3/401: stat d0/dd/d26 0 2024-02-22T00:33:54.189 INFO:tasks.workunit.client.0.smithi049.stdout:2/493: stat d2/d9/dd/l41 0 2024-02-22T00:33:54.191 INFO:tasks.workunit.client.0.smithi049.stdout:7/473: creat d1/df/d62/d7a/fa1 x:0 0 0 2024-02-22T00:33:54.193 INFO:tasks.workunit.client.0.smithi049.stdout:8/456: read d1/d2/da5/f80 [2897236,70052] 0 2024-02-22T00:33:54.194 INFO:tasks.workunit.client.0.smithi049.stdout:6/416: unlink d3/d64/d60/f6b 0 2024-02-22T00:33:54.195 INFO:tasks.workunit.client.0.smithi049.stdout:0/421: dread d3/df/d48/f52 [0,4194304] 0 2024-02-22T00:33:54.197 INFO:tasks.workunit.client.0.smithi049.stdout:8/457: read - d1/d2/d5/d1b/d39/f9d zero size 2024-02-22T00:33:54.198 INFO:tasks.workunit.client.0.smithi049.stdout:0/422: fdatasync d3/df/d17/f24 0 2024-02-22T00:33:54.199 INFO:tasks.workunit.client.0.smithi049.stdout:9/570: dwrite d17/d21/f23 [0,4194304] 0 2024-02-22T00:33:54.200 INFO:tasks.workunit.client.0.smithi049.stdout:9/571: readlink d17/l4c 0 2024-02-22T00:33:54.201 INFO:tasks.workunit.client.0.smithi049.stdout:8/458: write d1/d2/f9a [620250,15978] 0 2024-02-22T00:33:54.204 INFO:tasks.workunit.client.0.smithi049.stdout:8/459: stat d1/d2/da5/d15/d30/d36/c9f 0 2024-02-22T00:33:54.204 INFO:tasks.workunit.client.0.smithi049.stdout:2/494: mknod d2/d9/de/d10/d46/cb7 0 2024-02-22T00:33:54.205 INFO:tasks.workunit.client.0.smithi049.stdout:1/469: dread d2/d8/db/d25/d40/f94 [0,4194304] 0 2024-02-22T00:33:54.206 INFO:tasks.workunit.client.0.smithi049.stdout:7/474: mknod d1/df/d62/ca2 0 2024-02-22T00:33:54.207 INFO:tasks.workunit.client.0.smithi049.stdout:8/460: write d1/d2/da5/d15/d30/d36/d53/f5f [1916542,104853] 0 2024-02-22T00:33:54.209 INFO:tasks.workunit.client.0.smithi049.stdout:9/572: fsync d17/f51 0 2024-02-22T00:33:54.211 INFO:tasks.workunit.client.0.smithi049.stdout:3/402: creat d0/d14/d4d/f71 x:0 0 0 2024-02-22T00:33:54.212 INFO:tasks.workunit.client.0.smithi049.stdout:6/417: symlink d3/d36/d57/d75/l8f 0 2024-02-22T00:33:54.212 INFO:tasks.workunit.client.0.smithi049.stdout:0/423: dread d3/f43 [0,4194304] 0 2024-02-22T00:33:54.214 INFO:tasks.workunit.client.0.smithi049.stdout:2/495: rmdir d2/d9/de/d15/d4f 39 2024-02-22T00:33:54.217 INFO:tasks.workunit.client.0.smithi049.stdout:8/461: creat d1/d2/d5/fa8 x:0 0 0 2024-02-22T00:33:54.218 INFO:tasks.workunit.client.0.smithi049.stdout:6/418: truncate d3/d16/d4a/d4d/f84 59181 0 2024-02-22T00:33:54.218 INFO:tasks.workunit.client.0.smithi049.stdout:7/475: rename d1/df/d62/d57/f65 to d1/d49/d5a/fa3 0 2024-02-22T00:33:54.220 INFO:tasks.workunit.client.0.smithi049.stdout:3/403: dwrite d0/dd/f4c [0,4194304] 0 2024-02-22T00:33:54.222 INFO:tasks.workunit.client.0.smithi049.stdout:0/424: creat d3/d6/d8/f71 x:0 0 0 2024-02-22T00:33:54.227 INFO:tasks.workunit.client.0.smithi049.stdout:3/404: write d0/d14/f1d [1706769,3881] 0 2024-02-22T00:33:54.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/496: symlink d2/d9/de/d10/d2e/d42/lb8 0 2024-02-22T00:33:54.230 INFO:tasks.workunit.client.0.smithi049.stdout:1/470: getdents d2/d8/db/d25/d40/d41/d5b/d75 0 2024-02-22T00:33:54.230 INFO:tasks.workunit.client.0.smithi049.stdout:6/419: dread d3/d16/f1c [0,4194304] 0 2024-02-22T00:33:54.230 INFO:tasks.workunit.client.0.smithi049.stdout:2/497: write d2/d9/f6e [285449,9868] 0 2024-02-22T00:33:54.232 INFO:tasks.workunit.client.0.smithi049.stdout:8/462: creat d1/d2/da5/d15/d30/fa9 x:0 0 0 2024-02-22T00:33:54.233 INFO:tasks.workunit.client.0.smithi049.stdout:1/471: fsync d2/d8/db/f1a 0 2024-02-22T00:33:54.233 INFO:tasks.workunit.client.0.smithi049.stdout:6/420: chown d3/d16/d3b/d3d/l81 0 1 2024-02-22T00:33:54.233 INFO:tasks.workunit.client.0.smithi049.stdout:0/425: rename d3/df/c33 to d3/d6/c72 0 2024-02-22T00:33:54.235 INFO:tasks.workunit.client.0.smithi049.stdout:0/426: read - d3/df/d48/d54/f5d zero size 2024-02-22T00:33:54.238 INFO:tasks.workunit.client.0.smithi049.stdout:6/421: symlink d3/d36/l90 0 2024-02-22T00:33:54.239 INFO:tasks.workunit.client.0.smithi049.stdout:1/472: symlink d2/d69/la5 0 2024-02-22T00:33:54.241 INFO:tasks.workunit.client.0.smithi049.stdout:6/422: readlink d3/d16/d32/l52 0 2024-02-22T00:33:54.242 INFO:tasks.workunit.client.0.smithi049.stdout:3/405: link d0/d59/f42 d0/dd/d26/d2e/f72 0 2024-02-22T00:33:54.244 INFO:tasks.workunit.client.0.smithi049.stdout:1/473: chown d2/d69/la5 335017 1 2024-02-22T00:33:54.245 INFO:tasks.workunit.client.0.smithi049.stdout:2/498: link d2/d9/de/d10/d2e/d42/d80/l84 d2/d9/de/d10/d2e/d42/d80/lb9 0 2024-02-22T00:33:54.249 INFO:tasks.workunit.client.0.smithi049.stdout:0/427: dwrite d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:54.249 INFO:tasks.workunit.client.0.smithi049.stdout:9/573: write d17/d1c/f3b [487201,14179] 0 2024-02-22T00:33:54.251 INFO:tasks.workunit.client.0.smithi049.stdout:1/474: creat d2/d8/db/d25/d40/d41/d68/fa6 x:0 0 0 2024-02-22T00:33:54.256 INFO:tasks.workunit.client.0.smithi049.stdout:8/463: truncate d1/d2/f2e 2069311 0 2024-02-22T00:33:54.257 INFO:tasks.workunit.client.0.smithi049.stdout:2/499: read d2/d9/de/d3a/f37 [3888652,41624] 0 2024-02-22T00:33:54.259 INFO:tasks.workunit.client.0.smithi049.stdout:1/475: unlink d2/d8/db/d25/d62/fa3 0 2024-02-22T00:33:54.259 INFO:tasks.workunit.client.0.smithi049.stdout:2/500: stat d2/cb 0 2024-02-22T00:33:54.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/406: dwrite d0/dd/d26/f30 [0,4194304] 0 2024-02-22T00:33:54.266 INFO:tasks.workunit.client.0.smithi049.stdout:9/574: symlink d17/d1c/d77/lbb 0 2024-02-22T00:33:54.267 INFO:tasks.workunit.client.0.smithi049.stdout:7/476: dwrite f0 [0,4194304] 0 2024-02-22T00:33:54.269 INFO:tasks.workunit.client.0.smithi049.stdout:1/476: chown d2/d8/db/d25/d62 158567981 1 2024-02-22T00:33:54.269 INFO:tasks.workunit.client.0.smithi049.stdout:8/464: rmdir d1/d2/da5/d15/d30/d36/d53 39 2024-02-22T00:33:54.269 INFO:tasks.workunit.client.0.smithi049.stdout:3/407: dread - d0/f62 zero size 2024-02-22T00:33:54.271 INFO:tasks.workunit.client.0.smithi049.stdout:0/428: dread d3/df/d17/f20 [0,4194304] 0 2024-02-22T00:33:54.275 INFO:tasks.workunit.client.0.smithi049.stdout:2/501: rmdir d2/d9/de/d10/d2e/d42/d80 39 2024-02-22T00:33:54.275 INFO:tasks.workunit.client.0.smithi049.stdout:8/465: stat d1/d2/d5/d1b/d39/f7c 0 2024-02-22T00:33:54.275 INFO:tasks.workunit.client.0.smithi049.stdout:9/575: creat d17/d21/d47/d7a/fbc x:0 0 0 2024-02-22T00:33:54.277 INFO:tasks.workunit.client.0.smithi049.stdout:8/466: chown d1/d2/d5/d1b/f99 218196322 1 2024-02-22T00:33:54.277 INFO:tasks.workunit.client.0.smithi049.stdout:1/477: creat d2/d8/d4c/fa7 x:0 0 0 2024-02-22T00:33:54.278 INFO:tasks.workunit.client.0.smithi049.stdout:3/408: creat d0/d14/d4d/f73 x:0 0 0 2024-02-22T00:33:54.280 INFO:tasks.workunit.client.0.smithi049.stdout:7/477: dwrite d1/df/f45 [4194304,4194304] 0 2024-02-22T00:33:54.283 INFO:tasks.workunit.client.0.smithi049.stdout:0/429: link d3/df/d17/f24 d3/f73 0 2024-02-22T00:33:54.285 INFO:tasks.workunit.client.0.smithi049.stdout:8/467: creat d1/d2/da5/d15/d65/d6a/faa x:0 0 0 2024-02-22T00:33:54.286 INFO:tasks.workunit.client.0.smithi049.stdout:1/478: symlink d2/d8/db/la8 0 2024-02-22T00:33:54.295 INFO:tasks.workunit.client.0.smithi049.stdout:1/479: unlink d2/d8/db/f34 0 2024-02-22T00:33:54.295 INFO:tasks.workunit.client.0.smithi049.stdout:7/478: read d1/df/d62/d1c/f2a [1328385,8056] 0 2024-02-22T00:33:54.295 INFO:tasks.workunit.client.0.smithi049.stdout:1/480: chown d2/d8/db/f57 258010 1 2024-02-22T00:33:54.295 INFO:tasks.workunit.client.0.smithi049.stdout:0/430: dwrite d3/df/d17/d50/d62/f67 [0,4194304] 0 2024-02-22T00:33:54.295 INFO:tasks.workunit.client.0.smithi049.stdout:7/479: chown d1/d49/l90 22693 1 2024-02-22T00:33:54.298 INFO:tasks.workunit.client.0.smithi049.stdout:1/481: chown d2/d8/d4c/l51 1924 1 2024-02-22T00:33:54.300 INFO:tasks.workunit.client.0.smithi049.stdout:0/431: write d3/d6/d8/f6e [703511,121122] 0 2024-02-22T00:33:54.301 INFO:tasks.workunit.client.0.smithi049.stdout:8/468: dwrite d1/d2/da5/d15/d30/d4b/f7d [0,4194304] 0 2024-02-22T00:33:54.301 INFO:tasks.workunit.client.0.smithi049.stdout:7/480: unlink d1/df/d62/d60/d7e/c97 0 2024-02-22T00:33:54.302 INFO:tasks.workunit.client.0.smithi049.stdout:1/482: write d2/d8/db/f26 [357947,29913] 0 2024-02-22T00:33:54.303 INFO:tasks.workunit.client.0.smithi049.stdout:0/432: chown d3/df/d17/d50/d62/f69 33067400 1 2024-02-22T00:33:54.305 INFO:tasks.workunit.client.0.smithi049.stdout:8/469: chown d1/d2/f25 54102 1 2024-02-22T00:33:54.308 INFO:tasks.workunit.client.0.smithi049.stdout:0/433: write d3/df/d17/d50/d62/f67 [897456,55076] 0 2024-02-22T00:33:54.309 INFO:tasks.workunit.client.0.smithi049.stdout:1/483: write d2/f9e [278067,100037] 0 2024-02-22T00:33:54.318 INFO:tasks.workunit.client.0.smithi049.stdout:1/484: read d2/d8/db/d25/d40/f4b [4935,40425] 0 2024-02-22T00:33:54.319 INFO:tasks.workunit.client.0.smithi049.stdout:8/470: link d1/d2/da5/d15/d30/fa9 d1/d2/d5/d1b/d39/d60/fab 0 2024-02-22T00:33:54.320 INFO:tasks.workunit.client.0.smithi049.stdout:3/409: truncate d0/dd/d26/f30 3740835 0 2024-02-22T00:33:54.321 INFO:tasks.workunit.client.0.smithi049.stdout:1/485: dread - d2/d8/d4c/f97 zero size 2024-02-22T00:33:54.323 INFO:tasks.workunit.client.0.smithi049.stdout:0/434: dwrite d3/d6/f5e [0,4194304] 0 2024-02-22T00:33:54.326 INFO:tasks.workunit.client.0.smithi049.stdout:7/481: dread d1/df/f45 [0,4194304] 0 2024-02-22T00:33:54.326 INFO:tasks.workunit.client.0.smithi049.stdout:3/410: write d0/f58 [358847,80917] 0 2024-02-22T00:33:54.326 INFO:tasks.workunit.client.0.smithi049.stdout:8/471: mkdir d1/d2/d5/d56/dac 0 2024-02-22T00:33:54.332 INFO:tasks.workunit.client.0.smithi049.stdout:8/472: chown d1/d2/da5/d15/d30/d4b/d51/f6e 36933 1 2024-02-22T00:33:54.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/576: dwrite d17/d21/f5c [0,4194304] 0 2024-02-22T00:33:54.333 INFO:tasks.workunit.client.0.smithi049.stdout:0/435: mkdir d3/df/d48/d6f/d74 0 2024-02-22T00:33:54.337 INFO:tasks.workunit.client.0.smithi049.stdout:9/577: chown d17/d21/f28 7703 1 2024-02-22T00:33:54.338 INFO:tasks.workunit.client.0.smithi049.stdout:3/411: rmdir d0/dd 39 2024-02-22T00:33:54.339 INFO:tasks.workunit.client.0.smithi049.stdout:1/486: dwrite d2/d8/db/f12 [0,4194304] 0 2024-02-22T00:33:54.341 INFO:tasks.workunit.client.0.smithi049.stdout:8/473: symlink d1/d2/da5/d15/d30/d4b/lad 0 2024-02-22T00:33:54.343 INFO:tasks.workunit.client.0.smithi049.stdout:0/436: symlink d3/df/d59/d60/l75 0 2024-02-22T00:33:54.343 INFO:tasks.workunit.client.0.smithi049.stdout:7/482: dwrite d1/f94 [0,4194304] 0 2024-02-22T00:33:54.346 INFO:tasks.workunit.client.0.smithi049.stdout:0/437: write d3/f13 [4553093,4042] 0 2024-02-22T00:33:54.348 INFO:tasks.workunit.client.0.smithi049.stdout:9/578: truncate d17/d21/d4e/f8e 1941358 0 2024-02-22T00:33:54.351 INFO:tasks.workunit.client.0.smithi049.stdout:0/438: creat d3/d6/d29/f76 x:0 0 0 2024-02-22T00:33:54.351 INFO:tasks.workunit.client.0.smithi049.stdout:1/487: unlink d2/d8/da/f4f 0 2024-02-22T00:33:54.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/579: mknod d17/d21/d85/cbd 0 2024-02-22T00:33:54.355 INFO:tasks.workunit.client.0.smithi049.stdout:7/483: rename d1/df/d62/d1c/f7d to d1/d41/fa4 0 2024-02-22T00:33:54.355 INFO:tasks.workunit.client.0.smithi049.stdout:3/412: creat d0/d14/f74 x:0 0 0 2024-02-22T00:33:54.357 INFO:tasks.workunit.client.0.smithi049.stdout:1/488: fdatasync d2/d8/db/d25/d40/d4d/f72 0 2024-02-22T00:33:54.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/439: getdents d3/df/d17/d1b 0 2024-02-22T00:33:54.364 INFO:tasks.workunit.client.0.smithi049.stdout:1/489: creat d2/d8/db/d25/d40/d71/fa9 x:0 0 0 2024-02-22T00:33:54.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/580: dread d17/d1c/d25/f53 [0,4194304] 0 2024-02-22T00:33:54.365 INFO:tasks.workunit.client.0.smithi049.stdout:3/413: creat d0/f75 x:0 0 0 2024-02-22T00:33:54.366 INFO:tasks.workunit.client.0.smithi049.stdout:8/474: link d1/d2/da5/d15/d30/d4b/lad d1/d2/da5/d15/d30/d36/d53/d93/lae 0 2024-02-22T00:33:54.369 INFO:tasks.workunit.client.0.smithi049.stdout:1/490: fsync d2/d8/db/d25/d40/f54 0 2024-02-22T00:33:54.370 INFO:tasks.workunit.client.0.smithi049.stdout:8/475: chown d1/d2/d5/f2c 125 1 2024-02-22T00:33:54.370 INFO:tasks.workunit.client.0.smithi049.stdout:9/581: creat d17/d21/d85/fbe x:0 0 0 2024-02-22T00:33:54.371 INFO:tasks.workunit.client.0.smithi049.stdout:7/484: dwrite d1/df/d62/d7a/fa1 [0,4194304] 0 2024-02-22T00:33:54.374 INFO:tasks.workunit.client.0.smithi049.stdout:8/476: write d1/d2/da5/d15/f10 [3632560,125697] 0 2024-02-22T00:33:54.375 INFO:tasks.workunit.client.0.smithi049.stdout:9/582: dread - d17/f51 zero size 2024-02-22T00:33:54.377 INFO:tasks.workunit.client.0.smithi049.stdout:1/491: mknod d2/d66/caa 0 2024-02-22T00:33:54.377 INFO:tasks.workunit.client.0.smithi049.stdout:7/485: symlink d1/la5 0 2024-02-22T00:33:54.378 INFO:tasks.workunit.client.0.smithi049.stdout:8/477: chown d1/d2/d5/d1b/d39/d81 46295433 1 2024-02-22T00:33:54.381 INFO:tasks.workunit.client.0.smithi049.stdout:7/486: write d1/df/d62/f11 [5181039,105176] 0 2024-02-22T00:33:54.381 INFO:tasks.workunit.client.0.smithi049.stdout:8/478: write d1/d2/da5/d15/d30/d36/d53/f79 [739333,2768] 0 2024-02-22T00:33:54.382 INFO:tasks.workunit.client.0.smithi049.stdout:9/583: mkdir d17/d21/d3c/dbf 0 2024-02-22T00:33:54.383 INFO:tasks.workunit.client.0.smithi049.stdout:0/440: dread d3/f13 [0,4194304] 0 2024-02-22T00:33:54.384 INFO:tasks.workunit.client.0.smithi049.stdout:1/492: mkdir d2/d8/db/d25/d40/d41/d84/dab 0 2024-02-22T00:33:54.385 INFO:tasks.workunit.client.0.smithi049.stdout:7/487: fdatasync d1/df/f13 0 2024-02-22T00:33:54.386 INFO:tasks.workunit.client.0.smithi049.stdout:9/584: write d17/d21/f23 [2173691,111679] 0 2024-02-22T00:33:54.387 INFO:tasks.workunit.client.0.smithi049.stdout:0/441: dread - d3/df/d48/d54/f6b zero size 2024-02-22T00:33:54.388 INFO:tasks.workunit.client.0.smithi049.stdout:8/479: mkdir d1/d2/da5/d15/d30/d36/d52/daf 0 2024-02-22T00:33:54.389 INFO:tasks.workunit.client.0.smithi049.stdout:7/488: truncate d1/df/f45 8490366 0 2024-02-22T00:33:54.390 INFO:tasks.workunit.client.0.smithi049.stdout:9/585: readlink d17/d21/d47/l84 0 2024-02-22T00:33:54.392 INFO:tasks.workunit.client.0.smithi049.stdout:7/489: chown d1/df/d62/d1c 63193 1 2024-02-22T00:33:54.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/442: dread d3/d6/d8/f6e [0,4194304] 0 2024-02-22T00:33:54.394 INFO:tasks.workunit.client.0.smithi049.stdout:9/586: truncate d17/d21/f46 5092202 0 2024-02-22T00:33:54.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/587: read - d17/d21/d85/fbe zero size 2024-02-22T00:33:54.398 INFO:tasks.workunit.client.0.smithi049.stdout:7/490: creat d1/df/d62/d1c/d24/d2e/fa6 x:0 0 0 2024-02-22T00:33:54.398 INFO:tasks.workunit.client.0.smithi049.stdout:1/493: link d2/d8/db/d25/d40/d41/c5d d2/d8/db/d25/d40/d4d/cac 0 2024-02-22T00:33:54.400 INFO:tasks.workunit.client.0.smithi049.stdout:8/480: dwrite d1/d2/da5/f78 [0,4194304] 0 2024-02-22T00:33:54.401 INFO:tasks.workunit.client.0.smithi049.stdout:7/491: creat d1/d41/d28/fa7 x:0 0 0 2024-02-22T00:33:54.402 INFO:tasks.workunit.client.0.smithi049.stdout:8/481: chown d1/d2/da5/fa2 5275 1 2024-02-22T00:33:54.402 INFO:tasks.workunit.client.0.smithi049.stdout:0/443: symlink d3/df/d48/d63/l77 0 2024-02-22T00:33:54.404 INFO:tasks.workunit.client.0.smithi049.stdout:9/588: unlink d17/d1c/d25/d39/d67/c9c 0 2024-02-22T00:33:54.406 INFO:tasks.workunit.client.0.smithi049.stdout:7/492: mkdir d1/df/d62/d1c/d24/d2e/da8 0 2024-02-22T00:33:54.406 INFO:tasks.workunit.client.0.smithi049.stdout:1/494: rmdir d2/d69/d7f 0 2024-02-22T00:33:54.408 INFO:tasks.workunit.client.0.smithi049.stdout:9/589: unlink d17/d21/d4e/d4b/l65 0 2024-02-22T00:33:54.409 INFO:tasks.workunit.client.0.smithi049.stdout:1/495: stat d2/d8/db/f90 0 2024-02-22T00:33:54.410 INFO:tasks.workunit.client.0.smithi049.stdout:7/493: truncate d1/df/f4f 812700 0 2024-02-22T00:33:54.411 INFO:tasks.workunit.client.0.smithi049.stdout:0/444: getdents d3/d6/d8 0 2024-02-22T00:33:54.414 INFO:tasks.workunit.client.0.smithi049.stdout:7/494: dread - d1/d41/d28/fa0 zero size 2024-02-22T00:33:54.416 INFO:tasks.workunit.client.0.smithi049.stdout:1/496: fdatasync d2/d8/db/d25/d40/d41/d68/f80 0 2024-02-22T00:33:54.417 INFO:tasks.workunit.client.0.smithi049.stdout:8/482: dwrite d1/d2/da5/d1c/f8f [0,4194304] 0 2024-02-22T00:33:54.419 INFO:tasks.workunit.client.0.smithi049.stdout:0/445: mknod d3/df/d17/d50/d62/c78 0 2024-02-22T00:33:54.419 INFO:tasks.workunit.client.0.smithi049.stdout:7/495: read - d1/d41/d28/f79 zero size 2024-02-22T00:33:54.421 INFO:tasks.workunit.client.0.smithi049.stdout:8/483: fsync d1/d2/da5/d15/d30/d4b/f7d 0 2024-02-22T00:33:54.425 INFO:tasks.workunit.client.0.smithi049.stdout:9/590: dwrite d17/d21/f29 [0,4194304] 0 2024-02-22T00:33:54.427 INFO:tasks.workunit.client.0.smithi049.stdout:0/446: mknod d3/df/d17/d50/d62/c79 0 2024-02-22T00:33:54.429 INFO:tasks.workunit.client.0.smithi049.stdout:1/497: truncate d2/d8/db/d25/d40/f4b 1300353 0 2024-02-22T00:33:54.432 INFO:tasks.workunit.client.0.smithi049.stdout:7/496: mknod d1/df/d62/d48/d99/ca9 0 2024-02-22T00:33:54.432 INFO:tasks.workunit.client.0.smithi049.stdout:8/484: dread d1/d2/d5/d1b/d39/f72 [0,4194304] 0 2024-02-22T00:33:54.436 INFO:tasks.workunit.client.0.smithi049.stdout:7/497: write d1/d41/d28/f79 [396440,123366] 0 2024-02-22T00:33:54.439 INFO:tasks.workunit.client.0.smithi049.stdout:1/498: dread d2/d8/d4c/d5e/f65 [0,4194304] 0 2024-02-22T00:33:54.441 INFO:tasks.workunit.client.0.smithi049.stdout:8/485: creat d1/d2/da5/d15/d30/d36/fb0 x:0 0 0 2024-02-22T00:33:54.443 INFO:tasks.workunit.client.0.smithi049.stdout:7/498: getdents d1/d49 0 2024-02-22T00:33:54.446 INFO:tasks.workunit.client.0.smithi049.stdout:0/447: dwrite d3/df/f2b [0,4194304] 0 2024-02-22T00:33:54.447 INFO:tasks.workunit.client.0.smithi049.stdout:9/591: dread - d17/d21/d47/fae zero size 2024-02-22T00:33:54.447 INFO:tasks.workunit.client.0.smithi049.stdout:9/592: stat d17/d1c 0 2024-02-22T00:33:54.448 INFO:tasks.workunit.client.0.smithi049.stdout:1/499: symlink d2/d8/db/d25/d40/d4d/lad 0 2024-02-22T00:33:54.450 INFO:tasks.workunit.client.0.smithi049.stdout:8/486: mknod d1/d2/da5/d15/d33/cb1 0 2024-02-22T00:33:54.451 INFO:tasks.workunit.client.0.smithi049.stdout:0/448: mkdir d3/df/d48/d6f/d7a 0 2024-02-22T00:33:54.452 INFO:tasks.workunit.client.0.smithi049.stdout:9/593: mknod d17/d1c/d25/cc0 0 2024-02-22T00:33:54.453 INFO:tasks.workunit.client.0.smithi049.stdout:1/500: creat d2/d8/db/d25/d62/fae x:0 0 0 2024-02-22T00:33:54.455 INFO:tasks.workunit.client.0.smithi049.stdout:0/449: creat d3/d6/f7b x:0 0 0 2024-02-22T00:33:54.457 INFO:tasks.workunit.client.0.smithi049.stdout:7/499: dwrite d1/d41/d28/f39 [4194304,4194304] 0 2024-02-22T00:33:54.458 INFO:tasks.workunit.client.0.smithi049.stdout:9/594: mkdir d17/d21/d4e/d4b/dc1 0 2024-02-22T00:33:54.458 INFO:tasks.workunit.client.0.smithi049.stdout:7/500: stat d1/df/d62/f23 0 2024-02-22T00:33:54.460 INFO:tasks.workunit.client.0.smithi049.stdout:1/501: symlink d2/d8/db/d25/d40/d41/d5b/d75/laf 0 2024-02-22T00:33:54.465 INFO:tasks.workunit.client.0.smithi049.stdout:7/501: rename d1/d41/d28 to d1/d41/d28/d71/d72/daa 22 2024-02-22T00:33:54.465 INFO:tasks.workunit.client.0.smithi049.stdout:0/450: creat d3/d1e/d58/f7c x:0 0 0 2024-02-22T00:33:54.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/487: getdents d1/d2/d8c 0 2024-02-22T00:33:54.465 INFO:tasks.workunit.client.0.smithi049.stdout:9/595: mknod d17/d1c/d25/d71/da3/cc2 0 2024-02-22T00:33:54.468 INFO:tasks.workunit.client.0.smithi049.stdout:7/502: symlink d1/df/lab 0 2024-02-22T00:33:54.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/451: creat d3/df/f7d x:0 0 0 2024-02-22T00:33:54.471 INFO:tasks.workunit.client.0.smithi049.stdout:8/488: creat d1/d2/d5/d1b/d39/d81/fb2 x:0 0 0 2024-02-22T00:33:54.472 INFO:tasks.workunit.client.0.smithi049.stdout:9/596: rmdir d17/d21/d47/d5d 39 2024-02-22T00:33:54.479 INFO:tasks.workunit.client.0.smithi049.stdout:8/489: getdents d1/d2/da5 0 2024-02-22T00:33:54.480 INFO:tasks.workunit.client.0.smithi049.stdout:7/503: dread d1/df/f45 [4194304,4194304] 0 2024-02-22T00:33:54.482 INFO:tasks.workunit.client.0.smithi049.stdout:7/504: chown d1/df/d62/d60 41976 1 2024-02-22T00:33:54.484 INFO:tasks.workunit.client.0.smithi049.stdout:7/505: mknod d1/d49/cac 0 2024-02-22T00:33:54.484 INFO:tasks.workunit.client.0.smithi049.stdout:0/452: dwrite d3/df/f5b [0,4194304] 0 2024-02-22T00:33:54.486 INFO:tasks.workunit.client.0.smithi049.stdout:1/502: dread d2/d8/f13 [0,4194304] 0 2024-02-22T00:33:54.486 INFO:tasks.workunit.client.0.smithi049.stdout:0/453: fsync d3/d6/f26 0 2024-02-22T00:33:54.487 INFO:tasks.workunit.client.0.smithi049.stdout:9/597: truncate d17/d21/f28 4812143 0 2024-02-22T00:33:54.490 INFO:tasks.workunit.client.0.smithi049.stdout:0/454: write d3/d6/f7b [254683,90965] 0 2024-02-22T00:33:54.490 INFO:tasks.workunit.client.0.smithi049.stdout:7/506: mknod d1/df/d62/d1c/d1d/d70/cad 0 2024-02-22T00:33:54.491 INFO:tasks.workunit.client.0.smithi049.stdout:9/598: read - d17/d21/d85/d8d/f92 zero size 2024-02-22T00:33:54.491 INFO:tasks.workunit.client.0.smithi049.stdout:8/490: dwrite d1/d4c/f55 [0,4194304] 0 2024-02-22T00:33:54.495 INFO:tasks.workunit.client.0.smithi049.stdout:8/491: stat d1/d2/d5/d1b/d39/f72 0 2024-02-22T00:33:54.495 INFO:tasks.workunit.client.0.smithi049.stdout:1/503: chown d2/d8/db/d25/d40/d4d/lad 1990380 1 2024-02-22T00:33:54.499 INFO:tasks.workunit.client.0.smithi049.stdout:7/507: mkdir d1/d41/dae 0 2024-02-22T00:33:54.500 INFO:tasks.workunit.client.0.smithi049.stdout:1/504: mknod d2/d8/db/cb0 0 2024-02-22T00:33:54.506 INFO:tasks.workunit.client.0.smithi049.stdout:0/455: rename d3/d6/f5e to d3/df/d17/d50/f7e 0 2024-02-22T00:33:54.506 INFO:tasks.workunit.client.0.smithi049.stdout:8/492: mknod d1/d2/d5/d1b/cb3 0 2024-02-22T00:33:54.506 INFO:tasks.workunit.client.0.smithi049.stdout:1/505: write d2/d8/db/d25/d40/d41/d5b/d75/f81 [645930,38402] 0 2024-02-22T00:33:54.506 INFO:tasks.workunit.client.0.smithi049.stdout:9/599: rename d17/d21/d47/d5d/l6a to d17/d1c/d8c/lc3 0 2024-02-22T00:33:54.507 INFO:tasks.workunit.client.0.smithi049.stdout:7/508: link d1/df/d62/d48/c4e d1/df/d62/d48/d8e/caf 0 2024-02-22T00:33:54.510 INFO:tasks.workunit.client.0.smithi049.stdout:0/456: truncate d3/df/d17/f24 1958374 0 2024-02-22T00:33:54.510 INFO:tasks.workunit.client.0.smithi049.stdout:9/600: write d17/d21/d47/f7e [1604294,57088] 0 2024-02-22T00:33:54.511 INFO:tasks.workunit.client.0.smithi049.stdout:7/509: mknod d1/d49/cb0 0 2024-02-22T00:33:54.512 INFO:tasks.workunit.client.0.smithi049.stdout:1/506: creat d2/d8/d4c/fb1 x:0 0 0 2024-02-22T00:33:54.513 INFO:tasks.workunit.client.0.smithi049.stdout:9/601: chown d17/d1c/d25/d39/d90/fb8 28 1 2024-02-22T00:33:54.513 INFO:tasks.workunit.client.0.smithi049.stdout:7/510: fdatasync d1/df/d62/f11 0 2024-02-22T00:33:54.514 INFO:tasks.workunit.client.0.smithi049.stdout:0/457: write d3/df/d17/d1b/f31 [271507,27585] 0 2024-02-22T00:33:54.516 INFO:tasks.workunit.client.0.smithi049.stdout:7/511: chown d1/cc 14 1 2024-02-22T00:33:54.519 INFO:tasks.workunit.client.0.smithi049.stdout:0/458: mkdir d3/df/d7f 0 2024-02-22T00:33:54.522 INFO:tasks.workunit.client.0.smithi049.stdout:7/512: stat d1/d41/d28/d71/d72/l9e 0 2024-02-22T00:33:54.527 INFO:tasks.workunit.client.0.smithi049.stdout:7/513: dread d1/df/d62/d1c/d6d/f7b [0,4194304] 0 2024-02-22T00:33:54.528 INFO:tasks.workunit.client.0.smithi049.stdout:8/493: dread d1/d2/da5/d15/d30/d4b/d51/f6e [0,4194304] 0 2024-02-22T00:33:54.529 INFO:tasks.workunit.client.0.smithi049.stdout:7/514: fsync d1/df/d62/d1c/d1d/d6e/f76 0 2024-02-22T00:33:54.530 INFO:tasks.workunit.client.0.smithi049.stdout:8/494: write d1/d2/d5/f2c [2791572,64478] 0 2024-02-22T00:33:54.532 INFO:tasks.workunit.client.0.smithi049.stdout:1/507: truncate d2/d8/da/f1e 4595873 0 2024-02-22T00:33:54.534 INFO:tasks.workunit.client.0.smithi049.stdout:8/495: unlink d1/d2/da5/d15/d33/f4a 0 2024-02-22T00:33:54.537 INFO:tasks.workunit.client.0.smithi049.stdout:1/508: rmdir d2/d8/db 39 2024-02-22T00:33:54.539 INFO:tasks.workunit.client.0.smithi049.stdout:7/515: dwrite d1/df/d62/d1c/d24/d2e/fa6 [0,4194304] 0 2024-02-22T00:33:54.539 INFO:tasks.workunit.client.0.smithi049.stdout:0/459: truncate d3/f73 2447302 0 2024-02-22T00:33:54.541 INFO:tasks.workunit.client.0.smithi049.stdout:8/496: unlink d1/d2/d5/d1b/d39/c3c 0 2024-02-22T00:33:54.548 INFO:tasks.workunit.client.0.smithi049.stdout:8/497: unlink d1/d2/d5/d1b/d39/f40 0 2024-02-22T00:33:54.549 INFO:tasks.workunit.client.0.smithi049.stdout:8/498: write d1/f1e [219883,119212] 0 2024-02-22T00:33:54.551 INFO:tasks.workunit.client.0.smithi049.stdout:7/516: symlink d1/df/d62/d1c/lb1 0 2024-02-22T00:33:54.568 INFO:tasks.workunit.client.0.smithi049.stdout:1/509: dread d2/d8/db/d25/d40/d41/f4a [0,4194304] 0 2024-02-22T00:33:54.569 INFO:tasks.workunit.client.0.smithi049.stdout:1/510: read - d2/d8/db/d25/d62/fae zero size 2024-02-22T00:33:54.576 INFO:tasks.workunit.client.0.smithi049.stdout:7/517: rmdir d1/df/d62/d1c/d24/d2e/da8 0 2024-02-22T00:33:54.577 INFO:tasks.workunit.client.0.smithi049.stdout:1/511: dwrite d2/d8/db/d25/d40/d41/f4a [0,4194304] 0 2024-02-22T00:33:54.580 INFO:tasks.workunit.client.0.smithi049.stdout:1/512: dread - d2/d8/db/d25/d40/d41/fa1 zero size 2024-02-22T00:33:54.594 INFO:tasks.workunit.client.0.smithi049.stdout:1/513: dwrite d2/d8/db/d25/d40/d71/f9f [0,4194304] 0 2024-02-22T00:33:54.595 INFO:tasks.workunit.client.0.smithi049.stdout:1/514: stat d2/d66 0 2024-02-22T00:33:54.595 INFO:tasks.workunit.client.0.smithi049.stdout:5/419: sync 2024-02-22T00:33:54.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/515: fsync d2/d8/db/d25/d40/d41/d5b/f89 0 2024-02-22T00:33:54.600 INFO:tasks.workunit.client.0.smithi049.stdout:7/518: creat d1/df/d62/d1c/d6d/fb2 x:0 0 0 2024-02-22T00:33:54.602 INFO:tasks.workunit.client.0.smithi049.stdout:7/519: chown d1/d41/d28/d71/d72/d95/l9a 590898 1 2024-02-22T00:33:54.602 INFO:tasks.workunit.client.0.smithi049.stdout:7/520: chown f0 0 1 2024-02-22T00:33:54.606 INFO:tasks.workunit.client.0.smithi049.stdout:5/420: mkdir d0/d26/d4d/d6f/d6/d74/d7a/d8f 0 2024-02-22T00:33:54.609 INFO:tasks.workunit.client.0.smithi049.stdout:8/499: truncate d1/f1e 329292 0 2024-02-22T00:33:54.611 INFO:tasks.workunit.client.0.smithi049.stdout:5/421: creat d0/d20/f90 x:0 0 0 2024-02-22T00:33:54.615 INFO:tasks.workunit.client.0.smithi049.stdout:7/521: dwrite d1/f94 [0,4194304] 0 2024-02-22T00:33:54.616 INFO:tasks.workunit.client.0.smithi049.stdout:8/500: mknod d1/d2/d5/d56/cb4 0 2024-02-22T00:33:54.622 INFO:tasks.workunit.client.0.smithi049.stdout:7/522: mknod d1/df/d62/d1c/d24/d2e/cb3 0 2024-02-22T00:33:54.626 INFO:tasks.workunit.client.0.smithi049.stdout:7/523: write d1/d41/d28/fa7 [385213,114213] 0 2024-02-22T00:33:54.628 INFO:tasks.workunit.client.0.smithi049.stdout:5/422: dwrite d0/d26/d4d/d6f/f41 [0,4194304] 0 2024-02-22T00:33:54.637 INFO:tasks.workunit.client.0.smithi049.stdout:7/524: dwrite d1/d41/f3e [0,4194304] 0 2024-02-22T00:33:54.637 INFO:tasks.workunit.client.0.smithi049.stdout:5/423: mkdir d0/d26/d4d/d6f/d6/d74/d7a/d8f/d91 0 2024-02-22T00:33:54.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/525: chown d1/df/d62/d1c/d24/d2e/cb3 9921 1 2024-02-22T00:33:54.643 INFO:tasks.workunit.client.0.smithi049.stdout:7/526: dread - d1/d41/d28/fa0 zero size 2024-02-22T00:33:54.647 INFO:tasks.workunit.client.0.smithi049.stdout:7/527: chown d1/df/d62/d57/f69 232260812 1 2024-02-22T00:33:54.658 INFO:tasks.workunit.client.0.smithi049.stdout:5/424: dread d0/d20/d50/d24/f5a [0,4194304] 0 2024-02-22T00:33:54.661 INFO:tasks.workunit.client.0.smithi049.stdout:5/425: creat d0/d26/d4d/d7c/f92 x:0 0 0 2024-02-22T00:33:54.663 INFO:tasks.workunit.client.0.smithi049.stdout:5/426: write d0/d20/d50/d24/d3b/f66 [653251,74166] 0 2024-02-22T00:33:54.665 INFO:tasks.workunit.client.0.smithi049.stdout:5/427: chown d0/l62 38 1 2024-02-22T00:33:54.666 INFO:tasks.workunit.client.0.smithi049.stdout:5/428: readlink d0/d20/l2a 0 2024-02-22T00:33:54.669 INFO:tasks.workunit.client.0.smithi049.stdout:5/429: creat d0/d26/d4d/d64/f93 x:0 0 0 2024-02-22T00:33:54.675 INFO:tasks.workunit.client.0.smithi049.stdout:1/516: creat d2/fb2 x:0 0 0 2024-02-22T00:33:54.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/517: truncate d2/f9e 1164840 0 2024-02-22T00:33:54.680 INFO:tasks.workunit.client.0.smithi049.stdout:8/501: dwrite d1/d2/f27 [0,4194304] 0 2024-02-22T00:33:54.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/518: dread d2/d8/db/d25/d40/d71/f9f [0,4194304] 0 2024-02-22T00:33:54.686 INFO:tasks.workunit.client.0.smithi049.stdout:5/430: rename d0/d26/d4d/d6f/d6 to d0/d26/d4d/d6f/d94 0 2024-02-22T00:33:54.686 INFO:tasks.workunit.client.0.smithi049.stdout:8/502: mknod d1/d2/d5/d56/dac/cb5 0 2024-02-22T00:33:54.688 INFO:tasks.workunit.client.0.smithi049.stdout:8/503: write d1/d2/da5/d15/d30/d36/d53/f79 [75340,916] 0 2024-02-22T00:33:54.694 INFO:tasks.workunit.client.0.smithi049.stdout:1/519: dread d2/d7b/f85 [0,4194304] 0 2024-02-22T00:33:54.695 INFO:tasks.workunit.client.0.smithi049.stdout:8/504: read d1/d2/d5/d1b/f8e [2309229,4088] 0 2024-02-22T00:33:54.699 INFO:tasks.workunit.client.0.smithi049.stdout:7/528: unlink d1/df/d62/d1c/lb1 0 2024-02-22T00:33:54.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/431: getdents d0/d26/d4d/d7c 0 2024-02-22T00:33:54.703 INFO:tasks.workunit.client.0.smithi049.stdout:1/520: dread d2/d8/da/f1e [0,4194304] 0 2024-02-22T00:33:54.704 INFO:tasks.workunit.client.0.smithi049.stdout:7/529: symlink d1/df/d62/d1c/d1d/d6e/lb4 0 2024-02-22T00:33:54.705 INFO:tasks.workunit.client.0.smithi049.stdout:8/505: dread d1/d2/da5/d15/f23 [0,4194304] 0 2024-02-22T00:33:54.707 INFO:tasks.workunit.client.0.smithi049.stdout:7/530: chown d1/d41/d55/c8f 73 1 2024-02-22T00:33:54.709 INFO:tasks.workunit.client.0.smithi049.stdout:1/521: creat d2/d8/db/d25/d40/d41/d5b/d87/fb3 x:0 0 0 2024-02-22T00:33:54.710 INFO:tasks.workunit.client.0.smithi049.stdout:7/531: chown d1/la5 187 1 2024-02-22T00:33:54.711 INFO:tasks.workunit.client.0.smithi049.stdout:8/506: rename d1/d2/da5/f28 to d1/d2/d8c/fb6 0 2024-02-22T00:33:54.712 INFO:tasks.workunit.client.0.smithi049.stdout:5/432: dwrite d0/d26/d4d/d7c/f92 [0,4194304] 0 2024-02-22T00:33:54.714 INFO:tasks.workunit.client.0.smithi049.stdout:7/532: chown d1/df/d62/d60/l6c 1204974 1 2024-02-22T00:33:54.714 INFO:tasks.workunit.client.0.smithi049.stdout:5/433: readlink d0/d26/d4d/d6f/l2d 0 2024-02-22T00:33:54.717 INFO:tasks.workunit.client.0.smithi049.stdout:5/434: dread - d0/d20/d50/d24/d54/f85 zero size 2024-02-22T00:33:54.717 INFO:tasks.workunit.client.0.smithi049.stdout:1/522: unlink d2/d8/db/d25/d40/d41/d84/d8b/la2 0 2024-02-22T00:33:54.718 INFO:tasks.workunit.client.0.smithi049.stdout:8/507: mkdir d1/d2/db7 0 2024-02-22T00:33:54.719 INFO:tasks.workunit.client.0.smithi049.stdout:8/508: write d1/f9c [620523,112197] 0 2024-02-22T00:33:54.722 INFO:tasks.workunit.client.0.smithi049.stdout:8/509: readlink d1/d2/d8c/la6 0 2024-02-22T00:33:54.722 INFO:tasks.workunit.client.0.smithi049.stdout:7/533: mknod d1/d41/cb5 0 2024-02-22T00:33:54.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/435: dread d0/d26/d4d/d7c/f92 [0,4194304] 0 2024-02-22T00:33:54.726 INFO:tasks.workunit.client.0.smithi049.stdout:1/523: link d2/d8/db/la8 d2/d8/db/d25/d40/d41/d5b/d75/lb4 0 2024-02-22T00:33:54.727 INFO:tasks.workunit.client.0.smithi049.stdout:1/524: dread - d2/d8/db/d25/d40/d4d/f64 zero size 2024-02-22T00:33:54.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/534: link d1/d49/cb0 d1/d49/cb6 0 2024-02-22T00:33:54.731 INFO:tasks.workunit.client.0.smithi049.stdout:1/525: rename d2/d8/db/f57 to d2/d8/db/d25/d62/fb5 0 2024-02-22T00:33:54.732 INFO:tasks.workunit.client.0.smithi049.stdout:7/535: mknod d1/df/d62/d60/cb7 0 2024-02-22T00:33:54.736 INFO:tasks.workunit.client.0.smithi049.stdout:1/526: mkdir d2/d8/db/d25/d40/d41/d68/db6 0 2024-02-22T00:33:54.736 INFO:tasks.workunit.client.0.smithi049.stdout:5/436: dwrite d0/f4e [0,4194304] 0 2024-02-22T00:33:54.743 INFO:tasks.workunit.client.0.smithi049.stdout:1/527: creat d2/d8/db/d25/d40/d41/d84/fb7 x:0 0 0 2024-02-22T00:33:54.743 INFO:tasks.workunit.client.0.smithi049.stdout:5/437: mknod d0/d26/d4d/d6f/d94/d74/d7a/d8f/c95 0 2024-02-22T00:33:54.745 INFO:tasks.workunit.client.0.smithi049.stdout:7/536: dwrite d1/d41/d28/f79 [0,4194304] 0 2024-02-22T00:33:54.747 INFO:tasks.workunit.client.0.smithi049.stdout:5/438: dread - d0/d26/d4d/d6f/d94/d74/f82 zero size 2024-02-22T00:33:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/528: truncate d2/d8/d4c/d5e/f65 1130920 0 2024-02-22T00:33:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:5/439: chown d0/d26/d4d/d6f/d94/d74/d7a/d8f/c95 733435 1 2024-02-22T00:33:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:7/537: dwrite d1/df/d62/f66 [0,4194304] 0 2024-02-22T00:33:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/529: read d2/f3 [1191477,76635] 0 2024-02-22T00:33:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:7/538: rename d1/df to d1/df/d62/d1c/d6d/db8 22 2024-02-22T00:33:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:5/440: dread d0/d20/d50/d24/f3f [0,4194304] 0 2024-02-22T00:33:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:6/423: sync 2024-02-22T00:33:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/439: sync 2024-02-22T00:33:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:5/441: chown d0/d26/d4d/d64/f93 228376580 1 2024-02-22T00:33:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:1/530: creat d2/d8/fb8 x:0 0 0 2024-02-22T00:33:54.765 INFO:tasks.workunit.client.0.smithi049.stdout:7/539: creat d1/d41/dae/fb9 x:0 0 0 2024-02-22T00:33:54.766 INFO:tasks.workunit.client.0.smithi049.stdout:6/424: creat d3/d36/f91 x:0 0 0 2024-02-22T00:33:54.768 INFO:tasks.workunit.client.0.smithi049.stdout:5/442: write d0/d26/d4d/d6f/d94/f72 [194050,83282] 0 2024-02-22T00:33:54.769 INFO:tasks.workunit.client.0.smithi049.stdout:6/425: truncate d3/f10 4222989 0 2024-02-22T00:33:54.769 INFO:tasks.workunit.client.0.smithi049.stdout:4/440: rename d3/d8/d10/d43/d4d/f90 to d3/d22/d5c/f93 0 2024-02-22T00:33:54.773 INFO:tasks.workunit.client.0.smithi049.stdout:5/443: write d0/d26/d4d/d6f/d94/fd [170129,121647] 0 2024-02-22T00:33:54.778 INFO:tasks.workunit.client.0.smithi049.stdout:1/531: creat d2/d8/db/d25/d40/d41/fb9 x:0 0 0 2024-02-22T00:33:54.780 INFO:tasks.workunit.client.0.smithi049.stdout:6/426: rename d3/d16/d3b/d3d to d3/d64/d59/d72/d92 0 2024-02-22T00:33:54.782 INFO:tasks.workunit.client.0.smithi049.stdout:1/532: truncate d2/d8/d4c/f8e 137246 0 2024-02-22T00:33:54.784 INFO:tasks.workunit.client.0.smithi049.stdout:7/540: dwrite d1/d41/fa4 [0,4194304] 0 2024-02-22T00:33:54.784 INFO:tasks.workunit.client.0.smithi049.stdout:6/427: readlink d3/d36/d57/d75/l80 0 2024-02-22T00:33:54.786 INFO:tasks.workunit.client.0.smithi049.stdout:4/441: getdents d3/d22/d51/d8a/d48 0 2024-02-22T00:33:54.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/444: write d0/d26/d4d/d64/f93 [502082,31885] 0 2024-02-22T00:33:54.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/541: readlink d1/df/d62/d60/l7f 0 2024-02-22T00:33:54.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/442: chown d3/d22/d51/f59 777078 1 2024-02-22T00:33:54.792 INFO:tasks.workunit.client.0.smithi049.stdout:5/445: truncate d0/f4e 4655020 0 2024-02-22T00:33:54.794 INFO:tasks.workunit.client.0.smithi049.stdout:7/542: creat d1/df/d62/d60/fba x:0 0 0 2024-02-22T00:33:54.798 INFO:tasks.workunit.client.0.smithi049.stdout:6/428: mknod d3/d36/d57/c93 0 2024-02-22T00:33:54.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/533: dread d2/d8/db/d25/d40/d41/d68/f80 [0,4194304] 0 2024-02-22T00:33:54.800 INFO:tasks.workunit.client.0.smithi049.stdout:5/446: rmdir d0/d26 39 2024-02-22T00:33:54.800 INFO:tasks.workunit.client.0.smithi049.stdout:6/429: readlink d3/d16/d3b/l48 0 2024-02-22T00:33:54.801 INFO:tasks.workunit.client.0.smithi049.stdout:4/443: rename d3/d8/d10/d12/l6f to d3/d22/d5c/d35/l94 0 2024-02-22T00:33:54.805 INFO:tasks.workunit.client.0.smithi049.stdout:5/447: read - d0/d20/d50/f83 zero size 2024-02-22T00:33:54.807 INFO:tasks.workunit.client.0.smithi049.stdout:6/430: truncate d3/d16/d4a/f55 333756 0 2024-02-22T00:33:54.809 INFO:tasks.workunit.client.0.smithi049.stdout:6/431: write d3/f1d [1764690,27624] 0 2024-02-22T00:33:54.811 INFO:tasks.workunit.client.0.smithi049.stdout:7/543: dread d1/df/f13 [0,4194304] 0 2024-02-22T00:33:54.812 INFO:tasks.workunit.client.0.smithi049.stdout:6/432: write d3/d64/f35 [1838147,83703] 0 2024-02-22T00:33:54.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/534: dread d2/d8/da/f61 [0,4194304] 0 2024-02-22T00:33:54.820 INFO:tasks.workunit.client.0.smithi049.stdout:7/544: rmdir d1/df/d62/d1c/d1d/d70 39 2024-02-22T00:33:54.821 INFO:tasks.workunit.client.0.smithi049.stdout:1/535: read d2/f4e [128907,74162] 0 2024-02-22T00:33:54.823 INFO:tasks.workunit.client.0.smithi049.stdout:6/433: creat d3/d36/d70/f94 x:0 0 0 2024-02-22T00:33:54.826 INFO:tasks.workunit.client.0.smithi049.stdout:5/448: dwrite d0/d20/d50/d24/f2f [0,4194304] 0 2024-02-22T00:33:54.829 INFO:tasks.workunit.client.0.smithi049.stdout:1/536: write d2/d8/db/d25/d62/fb5 [1375001,70110] 0 2024-02-22T00:33:54.835 INFO:tasks.workunit.client.0.smithi049.stdout:6/434: creat d3/d16/d4a/d4d/f95 x:0 0 0 2024-02-22T00:33:54.838 INFO:tasks.workunit.client.0.smithi049.stdout:7/545: getdents d1/d41/d28/d71/d72/d95 0 2024-02-22T00:33:54.839 INFO:tasks.workunit.client.0.smithi049.stdout:4/444: dread d3/d8/fd [0,4194304] 0 2024-02-22T00:33:54.845 INFO:tasks.workunit.client.0.smithi049.stdout:7/546: creat d1/df/d62/d60/d7e/fbb x:0 0 0 2024-02-22T00:33:54.846 INFO:tasks.workunit.client.0.smithi049.stdout:1/537: mknod d2/d8/db/d25/d40/d41/d84/dab/cba 0 2024-02-22T00:33:54.846 INFO:tasks.workunit.client.0.smithi049.stdout:7/547: stat d1/d41/l6a 0 2024-02-22T00:33:54.847 INFO:tasks.workunit.client.0.smithi049.stdout:4/445: mknod d3/d22/d3d/c95 0 2024-02-22T00:33:54.849 INFO:tasks.workunit.client.0.smithi049.stdout:6/435: dwrite d3/d16/f19 [8388608,4194304] 0 2024-02-22T00:33:54.851 INFO:tasks.workunit.client.0.smithi049.stdout:3/414: sync 2024-02-22T00:33:54.851 INFO:tasks.workunit.client.0.smithi049.stdout:9/602: sync 2024-02-22T00:33:54.851 INFO:tasks.workunit.client.0.smithi049.stdout:2/502: sync 2024-02-22T00:33:54.851 INFO:tasks.workunit.client.0.smithi049.stdout:6/436: read - d3/d16/d4a/d4d/f95 zero size 2024-02-22T00:33:54.851 INFO:tasks.workunit.client.0.smithi049.stdout:4/446: mknod d3/d22/d5c/d5e/c96 0 2024-02-22T00:33:54.852 INFO:tasks.workunit.client.0.smithi049.stdout:1/538: mknod d2/da0/cbb 0 2024-02-22T00:33:54.852 INFO:tasks.workunit.client.0.smithi049.stdout:7/548: mknod d1/cbc 0 2024-02-22T00:33:54.855 INFO:tasks.workunit.client.0.smithi049.stdout:7/549: chown d1/cbc 107104561 1 2024-02-22T00:33:54.855 INFO:tasks.workunit.client.0.smithi049.stdout:3/415: fsync d0/dd/d1e/f24 0 2024-02-22T00:33:54.856 INFO:tasks.workunit.client.0.smithi049.stdout:2/503: rmdir d2/d9/de 39 2024-02-22T00:33:54.857 INFO:tasks.workunit.client.0.smithi049.stdout:5/449: truncate d0/d20/d50/f38 3582736 0 2024-02-22T00:33:54.863 INFO:tasks.workunit.client.0.smithi049.stdout:9/603: truncate d17/d1c/d25/d39/f88 3673640 0 2024-02-22T00:33:54.864 INFO:tasks.workunit.client.0.smithi049.stdout:3/416: mkdir d0/d14/d4d/d4e/d4f/d5b/d76 0 2024-02-22T00:33:54.867 INFO:tasks.workunit.client.0.smithi049.stdout:2/504: readlink d2/d9/de/d10/d59/l5b 0 2024-02-22T00:33:54.871 INFO:tasks.workunit.client.0.smithi049.stdout:3/417: write d0/dd/d1e/f24 [1893942,37262] 0 2024-02-22T00:33:54.873 INFO:tasks.workunit.client.0.smithi049.stdout:5/450: write d0/d26/f42 [1140723,546] 0 2024-02-22T00:33:54.873 INFO:tasks.workunit.client.0.smithi049.stdout:1/539: rmdir d2/d8/d98 0 2024-02-22T00:33:54.873 INFO:tasks.workunit.client.0.smithi049.stdout:6/437: dread d3/f1d [0,4194304] 0 2024-02-22T00:33:54.873 INFO:tasks.workunit.client.0.smithi049.stdout:7/550: creat d1/df/d62/d1c/d24/fbd x:0 0 0 2024-02-22T00:33:54.876 INFO:tasks.workunit.client.0.smithi049.stdout:9/604: write d17/d21/f33 [874328,83154] 0 2024-02-22T00:33:54.882 INFO:tasks.workunit.client.0.smithi049.stdout:5/451: fdatasync d0/f63 0 2024-02-22T00:33:54.884 INFO:tasks.workunit.client.0.smithi049.stdout:0/460: sync 2024-02-22T00:33:54.884 INFO:tasks.workunit.client.0.smithi049.stdout:8/510: sync 2024-02-22T00:33:54.893 INFO:tasks.workunit.client.0.smithi049.stdout:1/540: dread - d2/d8/db/d25/d40/d41/d5b/f89 zero size 2024-02-22T00:33:54.893 INFO:tasks.workunit.client.0.smithi049.stdout:3/418: link d0/dd/d26/d2e/f54 d0/d14/d4d/d4e/f77 0 2024-02-22T00:33:54.895 INFO:tasks.workunit.client.0.smithi049.stdout:4/447: dwrite d3/d33/f62 [0,4194304] 0 2024-02-22T00:33:54.898 INFO:tasks.workunit.client.0.smithi049.stdout:3/419: readlink d0/dd/d26/d2e/l55 0 2024-02-22T00:33:54.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/505: write d2/d9/de/f9b [1554964,98164] 0 2024-02-22T00:33:54.901 INFO:tasks.workunit.client.0.smithi049.stdout:9/605: dwrite d17/d1c/d25/f34 [4194304,4194304] 0 2024-02-22T00:33:54.902 INFO:tasks.workunit.client.0.smithi049.stdout:7/551: write d1/d41/d28/fa0 [935959,106825] 0 2024-02-22T00:33:54.903 INFO:tasks.workunit.client.0.smithi049.stdout:6/438: link d3/f14 d3/d16/d4a/d4d/f96 0 2024-02-22T00:33:54.904 INFO:tasks.workunit.client.0.smithi049.stdout:4/448: mknod d3/d33/c97 0 2024-02-22T00:33:54.906 INFO:tasks.workunit.client.0.smithi049.stdout:2/506: chown d2/d9/d17/c2d 518896 1 2024-02-22T00:33:54.912 INFO:tasks.workunit.client.0.smithi049.stdout:5/452: truncate d0/d26/d4d/d6f/f61 4297991 0 2024-02-22T00:33:54.912 INFO:tasks.workunit.client.0.smithi049.stdout:1/541: rmdir d2/d8/db/d25/d40/d41/d68/d78 39 2024-02-22T00:33:54.914 INFO:tasks.workunit.client.0.smithi049.stdout:3/420: creat d0/dd/d1e/f78 x:0 0 0 2024-02-22T00:33:54.915 INFO:tasks.workunit.client.0.smithi049.stdout:8/511: dread d1/d2/d5/d1b/d39/d81/f91 [0,4194304] 0 2024-02-22T00:33:54.918 INFO:tasks.workunit.client.0.smithi049.stdout:1/542: chown d2/d8/da/f14 32410699 1 2024-02-22T00:33:54.919 INFO:tasks.workunit.client.0.smithi049.stdout:4/449: creat d3/d22/d51/f98 x:0 0 0 2024-02-22T00:33:54.920 INFO:tasks.workunit.client.0.smithi049.stdout:1/543: chown d2/d8/db/d25/d40/d41/d5b/d87 1574 1 2024-02-22T00:33:54.921 INFO:tasks.workunit.client.0.smithi049.stdout:0/461: dwrite d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:33:54.923 INFO:tasks.workunit.client.0.smithi049.stdout:5/453: chown d0/f7e 4 1 2024-02-22T00:33:54.924 INFO:tasks.workunit.client.0.smithi049.stdout:6/439: mknod d3/d36/d57/c97 0 2024-02-22T00:33:54.925 INFO:tasks.workunit.client.0.smithi049.stdout:9/606: creat d17/d1c/fc4 x:0 0 0 2024-02-22T00:33:54.927 INFO:tasks.workunit.client.0.smithi049.stdout:4/450: fsync d3/d22/d51/d8a/f4e 0 2024-02-22T00:33:54.929 INFO:tasks.workunit.client.0.smithi049.stdout:7/552: creat d1/df/d62/d48/d8e/fbe x:0 0 0 2024-02-22T00:33:54.930 INFO:tasks.workunit.client.0.smithi049.stdout:2/507: mkdir d2/d9/dd/d4d/d72/da0/dba 0 2024-02-22T00:33:54.931 INFO:tasks.workunit.client.0.smithi049.stdout:0/462: rename d3/d1e/d58/l6d to d3/d1e/d58/l80 0 2024-02-22T00:33:54.932 INFO:tasks.workunit.client.0.smithi049.stdout:6/440: fsync d3/d16/f1c 0 2024-02-22T00:33:54.935 INFO:tasks.workunit.client.0.smithi049.stdout:7/553: read - d1/d41/dae/fb9 zero size 2024-02-22T00:33:54.936 INFO:tasks.workunit.client.0.smithi049.stdout:8/512: creat d1/d2/da5/d15/d30/d36/d52/daf/fb8 x:0 0 0 2024-02-22T00:33:54.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/544: dwrite d2/d8/db/d25/d40/d71/fa9 [0,4194304] 0 2024-02-22T00:33:54.938 INFO:tasks.workunit.client.0.smithi049.stdout:9/607: unlink d17/d21/f5c 0 2024-02-22T00:33:54.940 INFO:tasks.workunit.client.0.smithi049.stdout:5/454: link d0/d20/d50/d24/d57/f5c d0/d26/d4d/d7c/f96 0 2024-02-22T00:33:54.940 INFO:tasks.workunit.client.0.smithi049.stdout:7/554: read d1/df/d62/d48/f8b [303013,3586] 0 2024-02-22T00:33:54.943 INFO:tasks.workunit.client.0.smithi049.stdout:0/463: unlink d3/df/f11 0 2024-02-22T00:33:54.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/451: symlink d3/d22/d51/d8a/d48/d60/l99 0 2024-02-22T00:33:54.946 INFO:tasks.workunit.client.0.smithi049.stdout:4/452: fsync d3/d8/d10/d43/d4d/f5f 0 2024-02-22T00:33:54.946 INFO:tasks.workunit.client.0.smithi049.stdout:1/545: dread d2/d8/db/d25/d62/f9a [0,4194304] 0 2024-02-22T00:33:54.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/441: creat d3/d16/d32/f98 x:0 0 0 2024-02-22T00:33:54.950 INFO:tasks.workunit.client.0.smithi049.stdout:3/421: write d0/d14/f57 [243909,96440] 0 2024-02-22T00:33:54.951 INFO:tasks.workunit.client.0.smithi049.stdout:8/513: symlink d1/d2/da5/d15/d65/lb9 0 2024-02-22T00:33:54.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/508: mkdir d2/d9/dd/dbb 0 2024-02-22T00:33:54.953 INFO:tasks.workunit.client.0.smithi049.stdout:2/509: stat d2/d9/de/d10/d2e/f9e 0 2024-02-22T00:33:54.957 INFO:tasks.workunit.client.0.smithi049.stdout:5/455: unlink d0/d20/d50/d24/d3b/f66 0 2024-02-22T00:33:54.960 INFO:tasks.workunit.client.0.smithi049.stdout:7/555: mknod d1/df/d62/d48/d8e/cbf 0 2024-02-22T00:33:54.961 INFO:tasks.workunit.client.0.smithi049.stdout:7/556: stat d1/df/d62/d1c/d24/f40 0 2024-02-22T00:33:54.961 INFO:tasks.workunit.client.0.smithi049.stdout:0/464: mkdir d3/d6/d8/d36/d81 0 2024-02-22T00:33:54.962 INFO:tasks.workunit.client.0.smithi049.stdout:7/557: chown d1/df/d62/f30 5902036 1 2024-02-22T00:33:54.962 INFO:tasks.workunit.client.0.smithi049.stdout:4/453: chown d3/d22/d49/l7e 29866 1 2024-02-22T00:33:54.963 INFO:tasks.workunit.client.0.smithi049.stdout:6/442: creat d3/d16/d45/f99 x:0 0 0 2024-02-22T00:33:54.966 INFO:tasks.workunit.client.0.smithi049.stdout:8/514: rmdir d1/d2/da5/d15/d65 39 2024-02-22T00:33:54.971 INFO:tasks.workunit.client.0.smithi049.stdout:8/515: write d1/d2/da5/d15/d30/d4b/f82 [321452,5166] 0 2024-02-22T00:33:54.973 INFO:tasks.workunit.client.0.smithi049.stdout:4/454: dwrite d3/d8/d10/d12/f38 [0,4194304] 0 2024-02-22T00:33:54.975 INFO:tasks.workunit.client.0.smithi049.stdout:8/516: write d1/d2/d5/f34 [4224116,49304] 0 2024-02-22T00:33:54.976 INFO:tasks.workunit.client.0.smithi049.stdout:7/558: unlink d1/df/d62/d1c/d1d/l26 0 2024-02-22T00:33:54.977 INFO:tasks.workunit.client.0.smithi049.stdout:3/422: mknod d0/d14/d4d/c79 0 2024-02-22T00:33:54.981 INFO:tasks.workunit.client.0.smithi049.stdout:0/465: write d3/f13 [2305114,72628] 0 2024-02-22T00:33:54.983 INFO:tasks.workunit.client.0.smithi049.stdout:9/608: dwrite d17/d1c/d25/f7b [0,4194304] 0 2024-02-22T00:33:54.984 INFO:tasks.workunit.client.0.smithi049.stdout:7/559: chown d1/df/d62/d60/f82 1110788000 1 2024-02-22T00:33:54.985 INFO:tasks.workunit.client.0.smithi049.stdout:5/456: creat d0/d26/d4d/d6f/d94/d74/d7a/d89/f97 x:0 0 0 2024-02-22T00:33:54.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/510: creat d2/d9/de/d10/fbc x:0 0 0 2024-02-22T00:33:54.990 INFO:tasks.workunit.client.0.smithi049.stdout:1/546: dread d2/d8/db/d25/d40/d41/d5b/f7c [0,4194304] 0 2024-02-22T00:33:54.992 INFO:tasks.workunit.client.0.smithi049.stdout:9/609: chown d17/d1c/d25/f7b 57923034 1 2024-02-22T00:33:54.996 INFO:tasks.workunit.client.0.smithi049.stdout:7/560: write d1/df/d62/d1c/d24/d2e/fa6 [2809612,65503] 0 2024-02-22T00:33:54.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/547: readlink d2/d8/db/l58 0 2024-02-22T00:33:54.997 INFO:tasks.workunit.client.0.smithi049.stdout:4/455: dwrite d3/d22/d49/f85 [0,4194304] 0 2024-02-22T00:33:54.998 INFO:tasks.workunit.client.0.smithi049.stdout:5/457: fsync d0/d26/d4d/d6f/d94/f72 0 2024-02-22T00:33:55.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/443: getdents d3/d16/d4a/d4d 0 2024-02-22T00:33:55.000 INFO:tasks.workunit.client.0.smithi049.stdout:2/511: symlink d2/d9/de/d3a/d93/lbd 0 2024-02-22T00:33:55.001 INFO:tasks.workunit.client.0.smithi049.stdout:9/610: write d17/d1c/d25/d39/d90/f9e [2098032,71239] 0 2024-02-22T00:33:55.008 INFO:tasks.workunit.client.0.smithi049.stdout:2/512: write d2/d9/de/d3a/fb4 [910052,44746] 0 2024-02-22T00:33:55.010 INFO:tasks.workunit.client.0.smithi049.stdout:5/458: write d0/d26/d4d/d6f/f41 [3439753,121231] 0 2024-02-22T00:33:55.012 INFO:tasks.workunit.client.0.smithi049.stdout:7/561: truncate d1/df/d62/d1c/f2a 770173 0 2024-02-22T00:33:55.016 INFO:tasks.workunit.client.0.smithi049.stdout:9/611: symlink d17/d21/d47/d5d/db4/lc5 0 2024-02-22T00:33:55.016 INFO:tasks.workunit.client.0.smithi049.stdout:3/423: dwrite d0/dd/d26/f2b [0,4194304] 0 2024-02-22T00:33:55.017 INFO:tasks.workunit.client.0.smithi049.stdout:4/456: write d3/d22/f50 [1295416,38816] 0 2024-02-22T00:33:55.018 INFO:tasks.workunit.client.0.smithi049.stdout:8/517: dread d1/d2/da5/d15/d30/d4b/d51/f6e [0,4194304] 0 2024-02-22T00:33:55.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/548: creat d2/d8/db/d25/d40/d41/fbc x:0 0 0 2024-02-22T00:33:55.028 INFO:tasks.workunit.client.0.smithi049.stdout:7/562: creat d1/d41/fc0 x:0 0 0 2024-02-22T00:33:55.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/424: creat d0/d14/d4d/d4e/d4f/d5b/f7a x:0 0 0 2024-02-22T00:33:55.032 INFO:tasks.workunit.client.0.smithi049.stdout:9/612: link d17/d21/f33 d17/d1c/d8c/fc6 0 2024-02-22T00:33:55.032 INFO:tasks.workunit.client.0.smithi049.stdout:0/466: dread d3/d6/d29/f3f [4194304,4194304] 0 2024-02-22T00:33:55.035 INFO:tasks.workunit.client.0.smithi049.stdout:8/518: creat d1/d2/da5/d15/d33/fba x:0 0 0 2024-02-22T00:33:55.037 INFO:tasks.workunit.client.0.smithi049.stdout:2/513: dwrite d2/d9/f6e [0,4194304] 0 2024-02-22T00:33:55.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/563: symlink d1/df/d62/d7a/lc1 0 2024-02-22T00:33:55.037 INFO:tasks.workunit.client.0.smithi049.stdout:5/459: write d0/d20/d50/f38 [2521387,19829] 0 2024-02-22T00:33:55.038 INFO:tasks.workunit.client.0.smithi049.stdout:0/467: fsync d3/d6/f7b 0 2024-02-22T00:33:55.039 INFO:tasks.workunit.client.0.smithi049.stdout:1/549: dread d2/d8/db/d25/d40/d41/d68/f80 [0,4194304] 0 2024-02-22T00:33:55.043 INFO:tasks.workunit.client.0.smithi049.stdout:9/613: symlink d17/d21/d4e/d89/d94/lc7 0 2024-02-22T00:33:55.044 INFO:tasks.workunit.client.0.smithi049.stdout:3/425: symlink d0/d14/d4d/d4e/d4f/d5b/l7b 0 2024-02-22T00:33:55.045 INFO:tasks.workunit.client.0.smithi049.stdout:8/519: creat d1/d2/da5/d1c/fbb x:0 0 0 2024-02-22T00:33:55.045 INFO:tasks.workunit.client.0.smithi049.stdout:1/550: chown d2/d8/l29 4583 1 2024-02-22T00:33:55.047 INFO:tasks.workunit.client.0.smithi049.stdout:9/614: readlink d17/d1c/l87 0 2024-02-22T00:33:55.048 INFO:tasks.workunit.client.0.smithi049.stdout:5/460: creat d0/d26/d4d/d6f/d94/f98 x:0 0 0 2024-02-22T00:33:55.050 INFO:tasks.workunit.client.0.smithi049.stdout:4/457: dwrite d3/d22/d5c/f36 [0,4194304] 0 2024-02-22T00:33:55.050 INFO:tasks.workunit.client.0.smithi049.stdout:3/426: chown d0/d14/d4d/d4e 8056854 1 2024-02-22T00:33:55.053 INFO:tasks.workunit.client.0.smithi049.stdout:6/444: dread d3/f29 [0,4194304] 0 2024-02-22T00:33:55.056 INFO:tasks.workunit.client.0.smithi049.stdout:5/461: dread - d0/d20/d50/d24/d3b/d5b/f67 zero size 2024-02-22T00:33:55.059 INFO:tasks.workunit.client.0.smithi049.stdout:8/520: readlink d1/d2/da5/d15/d30/d4b/lad 0 2024-02-22T00:33:55.061 INFO:tasks.workunit.client.0.smithi049.stdout:1/551: rmdir d2/d8/db/d25/d40/d41/d68/db6 0 2024-02-22T00:33:55.063 INFO:tasks.workunit.client.0.smithi049.stdout:8/521: write d1/f9c [182726,81637] 0 2024-02-22T00:33:55.063 INFO:tasks.workunit.client.0.smithi049.stdout:7/564: dread d1/df/d62/d1c/d6d/f7b [0,4194304] 0 2024-02-22T00:33:55.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/427: dread d0/dd/d26/f2b [0,4194304] 0 2024-02-22T00:33:55.066 INFO:tasks.workunit.client.0.smithi049.stdout:2/514: dread d2/d9/de/d15/f8b [0,4194304] 0 2024-02-22T00:33:55.067 INFO:tasks.workunit.client.0.smithi049.stdout:9/615: rmdir d17/d21/d4e/d4b/dc1 0 2024-02-22T00:33:55.068 INFO:tasks.workunit.client.0.smithi049.stdout:1/552: dread d2/d8/db/d25/d40/d41/d84/f9c [0,4194304] 0 2024-02-22T00:33:55.068 INFO:tasks.workunit.client.0.smithi049.stdout:6/445: symlink d3/d36/d57/d75/l9a 0 2024-02-22T00:33:55.070 INFO:tasks.workunit.client.0.smithi049.stdout:5/462: mknod d0/d20/d50/c99 0 2024-02-22T00:33:55.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/515: dread - d2/d9/de/d10/d46/fb6 zero size 2024-02-22T00:33:55.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/522: creat d1/d2/da5/d15/d33/fbc x:0 0 0 2024-02-22T00:33:55.075 INFO:tasks.workunit.client.0.smithi049.stdout:3/428: creat d0/dd/d26/d2e/d52/f7c x:0 0 0 2024-02-22T00:33:55.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/468: dwrite d3/df/d17/f24 [0,4194304] 0 2024-02-22T00:33:55.078 INFO:tasks.workunit.client.0.smithi049.stdout:1/553: rename d2/d8/da/f22 to d2/d8/db/fbd 0 2024-02-22T00:33:55.079 INFO:tasks.workunit.client.0.smithi049.stdout:1/554: dread - d2/d8/fb8 zero size 2024-02-22T00:33:55.079 INFO:tasks.workunit.client.0.smithi049.stdout:0/469: chown d3/d1e/l2e 36 1 2024-02-22T00:33:55.080 INFO:tasks.workunit.client.0.smithi049.stdout:4/458: truncate d3/f32 974633 0 2024-02-22T00:33:55.081 INFO:tasks.workunit.client.0.smithi049.stdout:5/463: symlink d0/d26/d4d/d6f/d94/d74/l9a 0 2024-02-22T00:33:55.082 INFO:tasks.workunit.client.0.smithi049.stdout:3/429: stat d0/l25 0 2024-02-22T00:33:55.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/470: rmdir d3/df/d17 39 2024-02-22T00:33:55.083 INFO:tasks.workunit.client.0.smithi049.stdout:2/516: stat d2/d9/de/d10/d2e/d42/d80/l84 0 2024-02-22T00:33:55.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/446: creat d3/f9b x:0 0 0 2024-02-22T00:33:55.086 INFO:tasks.workunit.client.0.smithi049.stdout:7/565: getdents d1/d41/d28/d71/d72 0 2024-02-22T00:33:55.086 INFO:tasks.workunit.client.0.smithi049.stdout:5/464: mknod d0/d20/d50/d24/d54/c9b 0 2024-02-22T00:33:55.086 INFO:tasks.workunit.client.0.smithi049.stdout:4/459: chown d3/d8/d10/c2a 131806143 1 2024-02-22T00:33:55.198 INFO:tasks.workunit.client.0.smithi049.stdout:4/460: mkdir d3/d22/d5c/d9a 0 2024-02-22T00:33:55.198 INFO:tasks.workunit.client.0.smithi049.stdout:6/447: read d3/d16/f30 [1188548,130537] 0 2024-02-22T00:33:55.201 INFO:tasks.workunit.client.0.smithi049.stdout:7/566: creat d1/df/d62/d1c/fc2 x:0 0 0 2024-02-22T00:33:55.205 INFO:tasks.workunit.client.0.smithi049.stdout:0/471: dwrite d3/f13 [4194304,4194304] 0 2024-02-22T00:33:55.206 INFO:tasks.workunit.client.0.smithi049.stdout:4/461: creat d3/d22/d51/d8a/d48/d60/f9b x:0 0 0 2024-02-22T00:33:55.208 INFO:tasks.workunit.client.0.smithi049.stdout:2/517: rename d2/d9/de/d10/d46/cb7 to d2/d9/de/d15/cbe 0 2024-02-22T00:33:55.208 INFO:tasks.workunit.client.0.smithi049.stdout:6/448: read d3/d16/d32/f5d [1952806,50843] 0 2024-02-22T00:33:55.212 INFO:tasks.workunit.client.0.smithi049.stdout:7/567: rmdir d1/d41/d28/d71/d72/d95 39 2024-02-22T00:33:55.213 INFO:tasks.workunit.client.0.smithi049.stdout:5/465: dwrite d0/d20/d50/f38 [0,4194304] 0 2024-02-22T00:33:55.213 INFO:tasks.workunit.client.0.smithi049.stdout:0/472: chown d3/d6/d8/f71 3 1 2024-02-22T00:33:55.214 INFO:tasks.workunit.client.0.smithi049.stdout:9/616: dread d17/d1c/d25/d39/f3a [0,4194304] 0 2024-02-22T00:33:55.217 INFO:tasks.workunit.client.0.smithi049.stdout:8/523: dread d1/d4c/f4f [0,4194304] 0 2024-02-22T00:33:55.219 INFO:tasks.workunit.client.0.smithi049.stdout:4/462: getdents d3/d22/d5c 0 2024-02-22T00:33:55.220 INFO:tasks.workunit.client.0.smithi049.stdout:9/617: chown d17/f51 7254750 1 2024-02-22T00:33:55.222 INFO:tasks.workunit.client.0.smithi049.stdout:8/524: chown d1/d2/da5/d15/d30/d4b/d51/f6e 110014 1 2024-02-22T00:33:55.222 INFO:tasks.workunit.client.0.smithi049.stdout:2/518: creat d2/d9/dd/d4d/d5a/fbf x:0 0 0 2024-02-22T00:33:55.225 INFO:tasks.workunit.client.0.smithi049.stdout:7/568: creat d1/d41/d28/d71/d72/d95/fc3 x:0 0 0 2024-02-22T00:33:55.227 INFO:tasks.workunit.client.0.smithi049.stdout:0/473: creat d3/df/d48/d6f/d7a/f82 x:0 0 0 2024-02-22T00:33:55.227 INFO:tasks.workunit.client.0.smithi049.stdout:9/618: mkdir d17/d21/d4e/d4b/dc8 0 2024-02-22T00:33:55.227 INFO:tasks.workunit.client.0.smithi049.stdout:4/463: symlink d3/d22/l9c 0 2024-02-22T00:33:55.229 INFO:tasks.workunit.client.0.smithi049.stdout:5/466: dwrite d0/d20/d50/d24/f75 [0,4194304] 0 2024-02-22T00:33:55.230 INFO:tasks.workunit.client.0.smithi049.stdout:2/519: fsync d2/d9/de/d15/d1b/f1f 0 2024-02-22T00:33:55.230 INFO:tasks.workunit.client.0.smithi049.stdout:7/569: read - d1/df/d62/d60/d7e/fbb zero size 2024-02-22T00:33:55.236 INFO:tasks.workunit.client.0.smithi049.stdout:9/619: fdatasync d17/d21/d47/d7a/fbc 0 2024-02-22T00:33:55.236 INFO:tasks.workunit.client.0.smithi049.stdout:4/464: write d3/d33/f46 [4383175,122854] 0 2024-02-22T00:33:55.238 INFO:tasks.workunit.client.0.smithi049.stdout:2/520: fsync d2/d9/f79 0 2024-02-22T00:33:55.238 INFO:tasks.workunit.client.0.smithi049.stdout:9/620: chown d17/d21/d3c/fa6 4 1 2024-02-22T00:33:55.240 INFO:tasks.workunit.client.0.smithi049.stdout:4/465: write d3/d8/d10/d12/f31 [4489680,2044] 0 2024-02-22T00:33:55.241 INFO:tasks.workunit.client.0.smithi049.stdout:0/474: link d3/d6/f7b d3/df/d59/f83 0 2024-02-22T00:33:55.244 INFO:tasks.workunit.client.0.smithi049.stdout:7/570: mknod d1/df/d62/d1c/d1d/d70/cc4 0 2024-02-22T00:33:55.245 INFO:tasks.workunit.client.0.smithi049.stdout:2/521: unlink d2/d9/de/d10/d2e/d42/lb8 0 2024-02-22T00:33:55.246 INFO:tasks.workunit.client.0.smithi049.stdout:4/466: creat d3/d8/d10/d12/d3f/f9d x:0 0 0 2024-02-22T00:33:55.248 INFO:tasks.workunit.client.0.smithi049.stdout:4/467: write d3/d22/d5c/f77 [225973,6541] 0 2024-02-22T00:33:55.248 INFO:tasks.workunit.client.0.smithi049.stdout:0/475: unlink d3/d6/f26 0 2024-02-22T00:33:55.251 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:53.764743+0000 mgr.smithi161.sazlam (mgr.24369) 59 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 892 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 96 MiB/s wr, 238 op/s 2024-02-22T00:33:55.253 INFO:tasks.workunit.client.0.smithi049.stdout:5/467: truncate d0/d20/d50/f36 1240906 0 2024-02-22T00:33:55.256 INFO:tasks.workunit.client.0.smithi049.stdout:2/522: creat d2/d9/de/fc0 x:0 0 0 2024-02-22T00:33:55.257 INFO:tasks.workunit.client.0.smithi049.stdout:7/571: getdents d1/df/d62/d1c/d1d/d6e 0 2024-02-22T00:33:55.260 INFO:tasks.workunit.client.0.smithi049.stdout:8/525: dread d1/d2/da5/d15/d30/d36/d53/f5f [0,4194304] 0 2024-02-22T00:33:55.261 INFO:tasks.workunit.client.0.smithi049.stdout:9/621: truncate d17/d1c/d25/d71/da3/fb3 3261894 0 2024-02-22T00:33:55.262 INFO:tasks.workunit.client.0.smithi049.stdout:5/468: mkdir d0/d26/d4d/d6f/d94/d9c 0 2024-02-22T00:33:55.264 INFO:tasks.workunit.client.0.smithi049.stdout:0/476: dread d3/f13 [4194304,4194304] 0 2024-02-22T00:33:55.265 INFO:tasks.workunit.client.0.smithi049.stdout:5/469: stat d0 0 2024-02-22T00:33:55.272 INFO:tasks.workunit.client.0.smithi049.stdout:9/622: creat d17/d1c/d25/fc9 x:0 0 0 2024-02-22T00:33:55.273 INFO:tasks.workunit.client.0.smithi049.stdout:4/468: dwrite d3/d8/d10/d45/f55 [0,4194304] 0 2024-02-22T00:33:55.277 INFO:tasks.workunit.client.0.smithi049.stdout:4/469: dread - d3/d22/d51/d8a/f8b zero size 2024-02-22T00:33:55.286 INFO:tasks.workunit.client.0.smithi049.stdout:2/523: dwrite d2/d9/dd/d4d/d5a/f8e [0,4194304] 0 2024-02-22T00:33:55.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:53.764743+0000 mgr.smithi161.sazlam (mgr.24369) 59 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 892 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 16 MiB/s rd, 96 MiB/s wr, 238 op/s 2024-02-22T00:33:55.299 INFO:tasks.workunit.client.0.smithi049.stdout:7/572: truncate d1/df/f45 1352629 0 2024-02-22T00:33:55.299 INFO:tasks.workunit.client.0.smithi049.stdout:5/470: dwrite d0/d26/d4d/d6f/d94/d74/f8c [0,4194304] 0 2024-02-22T00:33:55.299 INFO:tasks.workunit.client.0.smithi049.stdout:0/477: mknod d3/df/d17/d1b/c84 0 2024-02-22T00:33:55.299 INFO:tasks.workunit.client.0.smithi049.stdout:8/526: getdents d1/d2/da5/d15/d30/d36 0 2024-02-22T00:33:55.300 INFO:tasks.workunit.client.0.smithi049.stdout:4/470: dread d3/d22/d51/f59 [0,4194304] 0 2024-02-22T00:33:55.304 INFO:tasks.workunit.client.0.smithi049.stdout:0/478: chown d3/df/d59/d60/l64 121592992 1 2024-02-22T00:33:55.304 INFO:tasks.workunit.client.0.smithi049.stdout:8/527: read - d1/d2/da5/d15/d65/d6a/faa zero size 2024-02-22T00:33:55.304 INFO:tasks.workunit.client.0.smithi049.stdout:7/573: creat d1/df/d62/d48/d99/fc5 x:0 0 0 2024-02-22T00:33:55.305 INFO:tasks.workunit.client.0.smithi049.stdout:5/471: symlink d0/d26/d4d/d6f/d94/l9d 0 2024-02-22T00:33:55.307 INFO:tasks.workunit.client.0.smithi049.stdout:8/528: stat d1/d2/da5/d1c/c22 0 2024-02-22T00:33:55.307 INFO:tasks.workunit.client.0.smithi049.stdout:4/471: dread d3/d8/d10/d45/f5a [0,4194304] 0 2024-02-22T00:33:55.309 INFO:tasks.workunit.client.0.smithi049.stdout:0/479: symlink d3/d1e/d58/l85 0 2024-02-22T00:33:55.309 INFO:tasks.workunit.client.0.smithi049.stdout:8/529: write d1/d2/da5/d1c/fbb [834175,98648] 0 2024-02-22T00:33:55.310 INFO:tasks.workunit.client.0.smithi049.stdout:7/574: creat d1/d41/d55/d89/fc6 x:0 0 0 2024-02-22T00:33:55.311 INFO:tasks.workunit.client.0.smithi049.stdout:9/623: truncate d17/d21/f46 2896523 0 2024-02-22T00:33:55.312 INFO:tasks.workunit.client.0.smithi049.stdout:0/480: fsync d3/df/d48/d6f/d7a/f82 0 2024-02-22T00:33:55.312 INFO:tasks.workunit.client.0.smithi049.stdout:5/472: mkdir d0/d26/d4d/d6f/d94/d74/d7a/d8f/d91/d9e 0 2024-02-22T00:33:55.319 INFO:tasks.workunit.client.0.smithi049.stdout:2/524: truncate d2/d9/d17/fb1 2117080 0 2024-02-22T00:33:55.320 INFO:tasks.workunit.client.0.smithi049.stdout:8/530: write d1/d2/d5/d1b/d39/d81/f91 [699102,24418] 0 2024-02-22T00:33:55.321 INFO:tasks.workunit.client.0.smithi049.stdout:5/473: creat d0/d26/d4d/d6f/d94/d74/f9f x:0 0 0 2024-02-22T00:33:55.324 INFO:tasks.workunit.client.0.smithi049.stdout:8/531: dread - d1/d2/da5/d15/d30/d36/d52/daf/fb8 zero size 2024-02-22T00:33:55.325 INFO:tasks.workunit.client.0.smithi049.stdout:9/624: write d17/f51 [480783,24916] 0 2024-02-22T00:33:55.325 INFO:tasks.workunit.client.0.smithi049.stdout:8/532: chown d1/d2/da5/d1c/f8f 4080 1 2024-02-22T00:33:55.327 INFO:tasks.workunit.client.0.smithi049.stdout:5/474: mkdir d0/d20/d84/da0 0 2024-02-22T00:33:55.327 INFO:tasks.workunit.client.0.smithi049.stdout:9/625: dread - d17/d1c/d25/fc9 zero size 2024-02-22T00:33:55.327 INFO:tasks.workunit.client.0.smithi049.stdout:8/533: stat d1/d2/d5/l3f 0 2024-02-22T00:33:55.328 INFO:tasks.workunit.client.0.smithi049.stdout:0/481: write d3/d1e/f6a [3053303,125047] 0 2024-02-22T00:33:55.329 INFO:tasks.workunit.client.0.smithi049.stdout:4/472: dread d3/d22/f8d [0,4194304] 0 2024-02-22T00:33:55.330 INFO:tasks.workunit.client.0.smithi049.stdout:8/534: dread - d1/d2/da5/d15/d33/fbc zero size 2024-02-22T00:33:55.331 INFO:tasks.workunit.client.0.smithi049.stdout:7/575: truncate d1/df/d62/d7a/f83 1844284 0 2024-02-22T00:33:55.333 INFO:tasks.workunit.client.0.smithi049.stdout:4/473: chown d3/d8/d10/d45/f5a 12872003 1 2024-02-22T00:33:55.335 INFO:tasks.workunit.client.0.smithi049.stdout:0/482: symlink d3/df/d48/d63/l86 0 2024-02-22T00:33:55.335 INFO:tasks.workunit.client.0.smithi049.stdout:5/475: dread d0/d26/f42 [0,4194304] 0 2024-02-22T00:33:55.337 INFO:tasks.workunit.client.0.smithi049.stdout:4/474: dread - d3/d8/d10/d43/d4d/f82 zero size 2024-02-22T00:33:55.339 INFO:tasks.workunit.client.0.smithi049.stdout:8/535: rename d1/d2/da5/d15/d30/d36/d52/l74 to d1/d2/d5/d56/dac/lbd 0 2024-02-22T00:33:55.339 INFO:tasks.workunit.client.0.smithi049.stdout:5/476: readlink d0/d26/d4d/d6f/d94/d74/l9a 0 2024-02-22T00:33:55.340 INFO:tasks.workunit.client.0.smithi049.stdout:0/483: truncate d3/df/d17/d50/d62/f69 360801 0 2024-02-22T00:33:55.342 INFO:tasks.workunit.client.0.smithi049.stdout:5/477: truncate d0/d20/f90 543794 0 2024-02-22T00:33:55.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/626: write d17/d1c/d25/d71/da3/fb3 [1686678,98432] 0 2024-02-22T00:33:55.345 INFO:tasks.workunit.client.0.smithi049.stdout:5/478: fdatasync d0/d26/d4d/f68 0 2024-02-22T00:33:55.345 INFO:tasks.workunit.client.0.smithi049.stdout:8/536: write d1/d2/d5/d1b/f8e [2247338,27152] 0 2024-02-22T00:33:55.349 INFO:tasks.workunit.client.0.smithi049.stdout:7/576: truncate d1/df/f16 903366 0 2024-02-22T00:33:55.353 INFO:tasks.workunit.client.0.smithi049.stdout:9/627: creat d17/d21/d4e/d89/d94/fca x:0 0 0 2024-02-22T00:33:55.353 INFO:tasks.workunit.client.0.smithi049.stdout:4/475: write d3/d22/d5c/d35/f40 [1301797,99206] 0 2024-02-22T00:33:55.355 INFO:tasks.workunit.client.0.smithi049.stdout:8/537: symlink d1/d2/da5/d15/d30/d4b/d51/lbe 0 2024-02-22T00:33:55.355 INFO:tasks.workunit.client.0.smithi049.stdout:7/577: rename d1/df/d62/d1c/d6d/f7b to d1/df/d62/d60/fc7 0 2024-02-22T00:33:55.357 INFO:tasks.workunit.client.0.smithi049.stdout:0/484: link d3/df/d59/d60/l64 d3/d1e/d58/l87 0 2024-02-22T00:33:55.357 INFO:tasks.workunit.client.0.smithi049.stdout:8/538: rmdir d1/d2/d5/d1b 39 2024-02-22T00:33:55.359 INFO:tasks.workunit.client.0.smithi049.stdout:5/479: creat d0/d20/d50/fa1 x:0 0 0 2024-02-22T00:33:55.360 INFO:tasks.workunit.client.0.smithi049.stdout:7/578: symlink d1/df/d62/d1c/d1d/d6e/lc8 0 2024-02-22T00:33:55.366 INFO:tasks.workunit.client.0.smithi049.stdout:4/476: getdents d3/d8/d10/d39 0 2024-02-22T00:33:55.366 INFO:tasks.workunit.client.0.smithi049.stdout:5/480: rmdir d0/d26/d4d/d6f/d94/d74/d7a 39 2024-02-22T00:33:55.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/628: dwrite d17/d21/fa4 [0,4194304] 0 2024-02-22T00:33:55.367 INFO:tasks.workunit.client.0.smithi049.stdout:0/485: rename d3/df/d17/d50/d62/c78 to d3/df/d48/d54/c88 0 2024-02-22T00:33:55.376 INFO:tasks.workunit.client.0.smithi049.stdout:7/579: write d1/df/f45 [489176,38190] 0 2024-02-22T00:33:55.376 INFO:tasks.workunit.client.0.smithi049.stdout:9/629: rmdir d17/d21/d47/d5d 39 2024-02-22T00:33:55.376 INFO:tasks.workunit.client.0.smithi049.stdout:8/539: dwrite d1/d2/d5/f34 [0,4194304] 0 2024-02-22T00:33:55.376 INFO:tasks.workunit.client.0.smithi049.stdout:4/477: creat d3/d8/f9e x:0 0 0 2024-02-22T00:33:55.378 INFO:tasks.workunit.client.0.smithi049.stdout:0/486: getdents d3/df/d59/d60 0 2024-02-22T00:33:55.381 INFO:tasks.workunit.client.0.smithi049.stdout:7/580: rename d1/d41/d28/l44 to d1/df/d62/d57/lc9 0 2024-02-22T00:33:55.385 INFO:tasks.workunit.client.0.smithi049.stdout:0/487: dread - d3/df/d48/d54/f5d zero size 2024-02-22T00:33:55.387 INFO:tasks.workunit.client.0.smithi049.stdout:5/481: dread d0/d20/d50/f36 [0,4194304] 0 2024-02-22T00:33:55.390 INFO:tasks.workunit.client.0.smithi049.stdout:5/482: stat d0/d20/d50/d24/d57 0 2024-02-22T00:33:55.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/488: write d3/f13 [6722339,78865] 0 2024-02-22T00:33:55.392 INFO:tasks.workunit.client.0.smithi049.stdout:9/630: dwrite f11 [0,4194304] 0 2024-02-22T00:33:55.395 INFO:tasks.workunit.client.0.smithi049.stdout:0/489: write d3/df/f5b [621963,123548] 0 2024-02-22T00:33:55.396 INFO:tasks.workunit.client.0.smithi049.stdout:9/631: read d17/d21/fa4 [753155,7082] 0 2024-02-22T00:33:55.398 INFO:tasks.workunit.client.0.smithi049.stdout:8/540: dwrite d1/d2/da5/d15/d65/d6a/faa [0,4194304] 0 2024-02-22T00:33:55.406 INFO:tasks.workunit.client.0.smithi049.stdout:4/478: dread d3/f4b [0,4194304] 0 2024-02-22T00:33:55.406 INFO:tasks.workunit.client.0.smithi049.stdout:9/632: mkdir d17/dcb 0 2024-02-22T00:33:55.406 INFO:tasks.workunit.client.0.smithi049.stdout:8/541: fdatasync d1/d4c/f4f 0 2024-02-22T00:33:55.411 INFO:tasks.workunit.client.0.smithi049.stdout:8/542: mkdir d1/d4c/dbf 0 2024-02-22T00:33:55.411 INFO:tasks.workunit.client.0.smithi049.stdout:7/581: dwrite d1/fe [0,4194304] 0 2024-02-22T00:33:55.414 INFO:tasks.workunit.client.0.smithi049.stdout:8/543: symlink d1/d2/da5/d15/d30/d36/lc0 0 2024-02-22T00:33:55.416 INFO:tasks.workunit.client.0.smithi049.stdout:9/633: link c16 d17/d21/d4e/d89/ccc 0 2024-02-22T00:33:55.421 INFO:tasks.workunit.client.0.smithi049.stdout:5/483: truncate d0/d26/d4d/d6f/d94/f51 191829 0 2024-02-22T00:33:55.422 INFO:tasks.workunit.client.0.smithi049.stdout:7/582: rename d1/d49/cac to d1/d41/cca 0 2024-02-22T00:33:55.424 INFO:tasks.workunit.client.0.smithi049.stdout:8/544: write d1/d2/d5/d1b/d39/f72 [610934,3180] 0 2024-02-22T00:33:55.425 INFO:tasks.workunit.client.0.smithi049.stdout:7/583: readlink d1/df/d62/d1c/d24/d2e/l31 0 2024-02-22T00:33:55.425 INFO:tasks.workunit.client.0.smithi049.stdout:5/484: symlink d0/d26/d4d/d70/la2 0 2024-02-22T00:33:55.426 INFO:tasks.workunit.client.0.smithi049.stdout:7/584: fsync d1/f94 0 2024-02-22T00:33:55.426 INFO:tasks.workunit.client.0.smithi049.stdout:9/634: getdents d17/d21/d85/d8d 0 2024-02-22T00:33:55.427 INFO:tasks.workunit.client.0.smithi049.stdout:5/485: stat d0/d26/l31 0 2024-02-22T00:33:55.430 INFO:tasks.workunit.client.0.smithi049.stdout:7/585: unlink d1/d41/c1f 0 2024-02-22T00:33:55.430 INFO:tasks.workunit.client.0.smithi049.stdout:5/486: write d0/d26/d4d/d6f/d94/d74/f9f [428842,24581] 0 2024-02-22T00:33:55.432 INFO:tasks.workunit.client.0.smithi049.stdout:7/586: write d1/df/d62/d60/fba [474688,107442] 0 2024-02-22T00:33:55.435 INFO:tasks.workunit.client.0.smithi049.stdout:7/587: symlink d1/df/d62/d48/d99/lcb 0 2024-02-22T00:33:55.436 INFO:tasks.workunit.client.0.smithi049.stdout:5/487: dread d0/d26/d4d/d64/f93 [0,4194304] 0 2024-02-22T00:33:55.436 INFO:tasks.workunit.client.0.smithi049.stdout:9/635: link d17/d21/d4e/d89/d94/lc7 d17/d21/d3c/dbf/lcd 0 2024-02-22T00:33:55.436 INFO:tasks.workunit.client.0.smithi049.stdout:0/490: dread d3/df/d17/d50/d62/f67 [0,4194304] 0 2024-02-22T00:33:55.437 INFO:tasks.workunit.client.0.smithi049.stdout:1/555: sync 2024-02-22T00:33:55.437 INFO:tasks.workunit.client.0.smithi049.stdout:3/430: sync 2024-02-22T00:33:55.439 INFO:tasks.workunit.client.0.smithi049.stdout:3/431: readlink d0/dd/d26/d2e/d52/l53 0 2024-02-22T00:33:55.441 INFO:tasks.workunit.client.0.smithi049.stdout:3/432: chown d0/dd/d26/d2e/d52 1 1 2024-02-22T00:33:55.441 INFO:tasks.workunit.client.0.smithi049.stdout:7/588: dread d1/df/d62/d57/f74 [0,4194304] 0 2024-02-22T00:33:55.442 INFO:tasks.workunit.client.0.smithi049.stdout:9/636: mknod d17/d1c/d25/d39/d67/cce 0 2024-02-22T00:33:55.445 INFO:tasks.workunit.client.0.smithi049.stdout:0/491: fsync d3/df/d59/f83 0 2024-02-22T00:33:55.446 INFO:tasks.workunit.client.0.smithi049.stdout:7/589: creat d1/df/d62/d48/fcc x:0 0 0 2024-02-22T00:33:55.448 INFO:tasks.workunit.client.0.smithi049.stdout:9/637: creat d17/d21/d85/fcf x:0 0 0 2024-02-22T00:33:55.449 INFO:tasks.workunit.client.0.smithi049.stdout:1/556: link d2/f6c d2/d69/fbe 0 2024-02-22T00:33:55.454 INFO:tasks.workunit.client.0.smithi049.stdout:3/433: dwrite d0/f75 [0,4194304] 0 2024-02-22T00:33:55.455 INFO:tasks.workunit.client.0.smithi049.stdout:1/557: write d2/d8/db/f12 [990189,2778] 0 2024-02-22T00:33:55.457 INFO:tasks.workunit.client.0.smithi049.stdout:8/545: dwrite d1/d2/f25 [0,4194304] 0 2024-02-22T00:33:55.458 INFO:tasks.workunit.client.0.smithi049.stdout:7/590: rmdir d1/df/d62/d48 39 2024-02-22T00:33:55.464 INFO:tasks.workunit.client.0.smithi049.stdout:7/591: chown d1/df/d62/d60/fc7 1 1 2024-02-22T00:33:55.464 INFO:tasks.workunit.client.0.smithi049.stdout:0/492: dwrite d3/df/f7d [0,4194304] 0 2024-02-22T00:33:55.469 INFO:tasks.workunit.client.0.smithi049.stdout:3/434: rmdir d0/dd/d26/d63 39 2024-02-22T00:33:55.469 INFO:tasks.workunit.client.0.smithi049.stdout:0/493: fsync d3/df/d48/f52 0 2024-02-22T00:33:55.470 INFO:tasks.workunit.client.0.smithi049.stdout:3/435: chown d0/d14/d4d 409 1 2024-02-22T00:33:55.471 INFO:tasks.workunit.client.0.smithi049.stdout:1/558: mknod d2/d8/d4c/cbf 0 2024-02-22T00:33:55.473 INFO:tasks.workunit.client.0.smithi049.stdout:7/592: mknod d1/df/d62/d1c/d1d/ccd 0 2024-02-22T00:33:55.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/546: symlink d1/d2/d5/lc1 0 2024-02-22T00:33:55.481 INFO:tasks.workunit.client.0.smithi049.stdout:7/593: chown d1/df/d62/d1c/d24/d2e/l3c 2906 1 2024-02-22T00:33:55.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/547: mknod d1/d2/da5/d15/d33/cc2 0 2024-02-22T00:33:55.486 INFO:tasks.workunit.client.0.smithi049.stdout:9/638: dwrite d17/d21/d4e/f8e [0,4194304] 0 2024-02-22T00:33:55.488 INFO:tasks.workunit.client.0.smithi049.stdout:3/436: dwrite d0/dd/f9 [0,4194304] 0 2024-02-22T00:33:55.491 INFO:tasks.workunit.client.0.smithi049.stdout:8/548: dread - d1/d2/d5/d1b/d39/d60/fab zero size 2024-02-22T00:33:55.491 INFO:tasks.workunit.client.0.smithi049.stdout:7/594: mkdir d1/df/dce 0 2024-02-22T00:33:55.494 INFO:tasks.workunit.client.0.smithi049.stdout:0/494: dwrite d3/df/d48/f52 [0,4194304] 0 2024-02-22T00:33:55.500 INFO:tasks.workunit.client.0.smithi049.stdout:0/495: write d3/df/f5b [377439,30376] 0 2024-02-22T00:33:55.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/595: truncate d1/df/d62/d1c/f85 469479 0 2024-02-22T00:33:55.505 INFO:tasks.workunit.client.0.smithi049.stdout:3/437: dread d0/f6 [0,4194304] 0 2024-02-22T00:33:55.506 INFO:tasks.workunit.client.0.smithi049.stdout:1/559: dwrite d2/d8/db/d25/d40/f4b [0,4194304] 0 2024-02-22T00:33:55.507 INFO:tasks.workunit.client.0.smithi049.stdout:1/560: readlink d2/d8/db/l44 0 2024-02-22T00:33:55.508 INFO:tasks.workunit.client.0.smithi049.stdout:9/639: creat d17/d1c/d25/d71/da3/fd0 x:0 0 0 2024-02-22T00:33:55.511 INFO:tasks.workunit.client.0.smithi049.stdout:3/438: creat d0/d14/d4d/d4e/d4f/d5b/d66/f7d x:0 0 0 2024-02-22T00:33:55.511 INFO:tasks.workunit.client.0.smithi049.stdout:0/496: creat d3/d6/d8/d36/d81/f89 x:0 0 0 2024-02-22T00:33:55.512 INFO:tasks.workunit.client.0.smithi049.stdout:7/596: symlink d1/df/d62/d1c/d24/lcf 0 2024-02-22T00:33:55.513 INFO:tasks.workunit.client.0.smithi049.stdout:1/561: mknod d2/d8/db/d25/d40/d41/d84/d8b/cc0 0 2024-02-22T00:33:55.514 INFO:tasks.workunit.client.0.smithi049.stdout:9/640: creat d17/d1c/d25/d71/fd1 x:0 0 0 2024-02-22T00:33:55.515 INFO:tasks.workunit.client.0.smithi049.stdout:0/497: mknod d3/d6/d8/d36/c8a 0 2024-02-22T00:33:55.516 INFO:tasks.workunit.client.0.smithi049.stdout:9/641: read - d17/d21/d4e/d89/d94/fca zero size 2024-02-22T00:33:55.520 INFO:tasks.workunit.client.0.smithi049.stdout:3/439: getdents d0 0 2024-02-22T00:33:55.521 INFO:tasks.workunit.client.0.smithi049.stdout:1/562: creat d2/d8/db/d25/d40/d41/d68/fc1 x:0 0 0 2024-02-22T00:33:55.522 INFO:tasks.workunit.client.0.smithi049.stdout:9/642: creat d17/d21/d85/d8d/fd2 x:0 0 0 2024-02-22T00:33:55.523 INFO:tasks.workunit.client.0.smithi049.stdout:0/498: link d3/d6/d8/f6e d3/d6/d8/f8b 0 2024-02-22T00:33:55.523 INFO:tasks.workunit.client.0.smithi049.stdout:1/563: fdatasync d2/d8/d4c/f97 0 2024-02-22T00:33:55.525 INFO:tasks.workunit.client.0.smithi049.stdout:3/440: mkdir d0/d14/d4d/d7e 0 2024-02-22T00:33:55.527 INFO:tasks.workunit.client.0.smithi049.stdout:9/643: symlink d17/d21/d47/d5d/ld3 0 2024-02-22T00:33:55.527 INFO:tasks.workunit.client.0.smithi049.stdout:1/564: chown d2/d8/db/d25/d40/f54 65397345 1 2024-02-22T00:33:55.530 INFO:tasks.workunit.client.0.smithi049.stdout:1/565: write d2/f9e [795871,72350] 0 2024-02-22T00:33:55.532 INFO:tasks.workunit.client.0.smithi049.stdout:8/549: truncate d1/d2/da5/d15/d30/f71 2130184 0 2024-02-22T00:33:55.534 INFO:tasks.workunit.client.0.smithi049.stdout:7/597: dread d1/df/d62/f11 [0,4194304] 0 2024-02-22T00:33:55.537 INFO:tasks.workunit.client.0.smithi049.stdout:0/499: dwrite d3/d6/d29/f4b [0,4194304] 0 2024-02-22T00:33:55.540 INFO:tasks.workunit.client.0.smithi049.stdout:8/550: creat d1/d2/da5/d1c/fc3 x:0 0 0 2024-02-22T00:33:55.540 INFO:tasks.workunit.client.0.smithi049.stdout:7/598: chown d1/d49/d4d/f75 318 1 2024-02-22T00:33:55.540 INFO:tasks.workunit.client.0.smithi049.stdout:1/566: mknod d2/d8/d4c/cc2 0 2024-02-22T00:33:55.541 INFO:tasks.workunit.client.0.smithi049.stdout:0/500: mkdir d3/df/d59/d8c 0 2024-02-22T00:33:55.543 INFO:tasks.workunit.client.0.smithi049.stdout:3/441: dwrite d0/dd/d26/f2b [0,4194304] 0 2024-02-22T00:33:55.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/599: creat d1/d49/d4d/fd0 x:0 0 0 2024-02-22T00:33:55.547 INFO:tasks.workunit.client.0.smithi049.stdout:8/551: dread d1/f9c [0,4194304] 0 2024-02-22T00:33:55.550 INFO:tasks.workunit.client.0.smithi049.stdout:7/600: write d1/d41/dae/fb9 [263109,12545] 0 2024-02-22T00:33:55.552 INFO:tasks.workunit.client.0.smithi049.stdout:8/552: creat d1/d4c/fc4 x:0 0 0 2024-02-22T00:33:55.552 INFO:tasks.workunit.client.0.smithi049.stdout:3/442: read d0/dd/f48 [2175,46565] 0 2024-02-22T00:33:55.553 INFO:tasks.workunit.client.0.smithi049.stdout:1/567: mknod d2/d8/db/d25/d40/d41/d68/d78/cc3 0 2024-02-22T00:33:55.553 INFO:tasks.workunit.client.0.smithi049.stdout:0/501: link d3/l68 d3/df/d48/d63/l8d 0 2024-02-22T00:33:55.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/502: write d3/df/f5b [4590930,35055] 0 2024-02-22T00:33:55.556 INFO:tasks.workunit.client.0.smithi049.stdout:7/601: creat d1/d41/d28/fd1 x:0 0 0 2024-02-22T00:33:55.557 INFO:tasks.workunit.client.0.smithi049.stdout:8/553: write d1/d2/d5/d1b/f8e [1354622,49792] 0 2024-02-22T00:33:55.559 INFO:tasks.workunit.client.0.smithi049.stdout:3/443: read d0/d14/f1d [3078595,95341] 0 2024-02-22T00:33:55.559 INFO:tasks.workunit.client.0.smithi049.stdout:1/568: write d2/d8/db/d25/d40/d41/fa1 [628090,41770] 0 2024-02-22T00:33:55.567 INFO:tasks.workunit.client.0.smithi049.stdout:8/554: symlink d1/lc5 0 2024-02-22T00:33:55.569 INFO:tasks.workunit.client.0.smithi049.stdout:0/503: dread d3/df/d17/d50/d62/f69 [0,4194304] 0 2024-02-22T00:33:55.569 INFO:tasks.workunit.client.0.smithi049.stdout:7/602: rename d1/df/d62/d48/d99/lcb to d1/d41/d28/d71/ld2 0 2024-02-22T00:33:55.575 INFO:tasks.workunit.client.0.smithi049.stdout:0/504: mkdir d3/df/d59/d8e 0 2024-02-22T00:33:55.576 INFO:tasks.workunit.client.0.smithi049.stdout:1/569: dwrite d2/d8/db/fbd [0,4194304] 0 2024-02-22T00:33:55.579 INFO:tasks.workunit.client.0.smithi049.stdout:7/603: unlink d1/df/d62/d7a/lc1 0 2024-02-22T00:33:55.580 INFO:tasks.workunit.client.0.smithi049.stdout:0/505: read d3/df/d59/f83 [313982,33970] 0 2024-02-22T00:33:55.581 INFO:tasks.workunit.client.0.smithi049.stdout:1/570: mkdir d2/d69/dc4 0 2024-02-22T00:33:55.581 INFO:tasks.workunit.client.0.smithi049.stdout:8/555: dwrite d1/d2/d5/d1b/d39/d81/fb2 [0,4194304] 0 2024-02-22T00:33:55.586 INFO:tasks.workunit.client.0.smithi049.stdout:0/506: write d3/d1e/f6a [2621540,119907] 0 2024-02-22T00:33:55.589 INFO:tasks.workunit.client.0.smithi049.stdout:1/571: write d2/d8/db/d25/d40/d41/d68/fc1 [966247,27818] 0 2024-02-22T00:33:55.589 INFO:tasks.workunit.client.0.smithi049.stdout:7/604: dread - d1/f5f zero size 2024-02-22T00:33:55.598 INFO:tasks.workunit.client.0.smithi049.stdout:3/444: dwrite d0/dd/d26/d2e/f54 [0,4194304] 0 2024-02-22T00:33:55.600 INFO:tasks.workunit.client.0.smithi049.stdout:8/556: dread d1/d2/da5/f80 [0,4194304] 0 2024-02-22T00:33:55.600 INFO:tasks.workunit.client.0.smithi049.stdout:3/445: write d0/f75 [503481,82645] 0 2024-02-22T00:33:55.602 INFO:tasks.workunit.client.0.smithi049.stdout:0/507: link d3/d1e/f61 d3/d1e/d58/f8f 0 2024-02-22T00:33:55.604 INFO:tasks.workunit.client.0.smithi049.stdout:3/446: write d0/f75 [3153593,11764] 0 2024-02-22T00:33:55.605 INFO:tasks.workunit.client.0.smithi049.stdout:8/557: symlink d1/d2/d5/d1b/d39/d60/da0/lc6 0 2024-02-22T00:33:55.612 INFO:tasks.workunit.client.0.smithi049.stdout:0/508: rename d3/df/d17/d1b to d3/df/d48/d6f/d90 0 2024-02-22T00:33:55.613 INFO:tasks.workunit.client.0.smithi049.stdout:3/447: dread - d0/d14/d4d/d4e/d4f/d5b/d66/f70 zero size 2024-02-22T00:33:55.615 INFO:tasks.workunit.client.0.smithi049.stdout:0/509: truncate d3/d6/d8/f71 32344 0 2024-02-22T00:33:55.617 INFO:tasks.workunit.client.0.smithi049.stdout:3/448: unlink d0/d14/d4d/l5d 0 2024-02-22T00:33:55.619 INFO:tasks.workunit.client.0.smithi049.stdout:7/605: dread d1/d49/f53 [0,4194304] 0 2024-02-22T00:33:55.624 INFO:tasks.workunit.client.0.smithi049.stdout:1/572: dread d2/d8/db/fbd [4194304,4194304] 0 2024-02-22T00:33:55.626 INFO:tasks.workunit.client.0.smithi049.stdout:1/573: read - d2/d8/da/f3f zero size 2024-02-22T00:33:55.627 INFO:tasks.workunit.client.0.smithi049.stdout:0/510: dwrite d3/df/d48/d54/f5d [0,4194304] 0 2024-02-22T00:33:55.629 INFO:tasks.workunit.client.0.smithi049.stdout:8/558: dread d1/d2/d5/d1b/d39/f7c [0,4194304] 0 2024-02-22T00:33:55.634 INFO:tasks.workunit.client.0.smithi049.stdout:0/511: write d3/df/d59/f83 [281606,68273] 0 2024-02-22T00:33:55.635 INFO:tasks.workunit.client.0.smithi049.stdout:8/559: symlink d1/d2/da5/d15/lc7 0 2024-02-22T00:33:55.639 INFO:tasks.workunit.client.0.smithi049.stdout:1/574: dwrite d2/d8/db/d25/d40/d41/f60 [0,4194304] 0 2024-02-22T00:33:55.642 INFO:tasks.workunit.client.0.smithi049.stdout:8/560: unlink d1/d2/d8c/fb6 0 2024-02-22T00:33:55.648 INFO:tasks.workunit.client.0.smithi049.stdout:6/449: sync 2024-02-22T00:33:55.648 INFO:tasks.workunit.client.0.smithi049.stdout:0/512: dwrite d3/d6/d8/d36/d81/f89 [0,4194304] 0 2024-02-22T00:33:55.648 INFO:tasks.workunit.client.0.smithi049.stdout:1/575: creat d2/d8/db/d25/d40/d41/d68/d78/fc5 x:0 0 0 2024-02-22T00:33:55.648 INFO:tasks.workunit.client.0.smithi049.stdout:8/561: truncate d1/d2/d5/d1b/f99 313866 0 2024-02-22T00:33:55.649 INFO:tasks.workunit.client.0.smithi049.stdout:7/606: dread d1/d41/f3b [0,4194304] 0 2024-02-22T00:33:55.649 INFO:tasks.workunit.client.0.smithi049.stdout:0/513: write d3/d1e/f6a [1971791,19765] 0 2024-02-22T00:33:55.651 INFO:tasks.workunit.client.0.smithi049.stdout:1/576: mknod d2/d8/da/cc6 0 2024-02-22T00:33:55.653 INFO:tasks.workunit.client.0.smithi049.stdout:8/562: creat d1/d4c/fc8 x:0 0 0 2024-02-22T00:33:55.656 INFO:tasks.workunit.client.0.smithi049.stdout:0/514: rmdir d3/df/d17/d50/d62 39 2024-02-22T00:33:55.657 INFO:tasks.workunit.client.0.smithi049.stdout:1/577: creat d2/d8/db/d25/fc7 x:0 0 0 2024-02-22T00:33:55.658 INFO:tasks.workunit.client.0.smithi049.stdout:8/563: mknod d1/d2/da5/cc9 0 2024-02-22T00:33:55.659 INFO:tasks.workunit.client.0.smithi049.stdout:7/607: dwrite d1/df/d62/d1c/d1d/f34 [4194304,4194304] 0 2024-02-22T00:33:55.659 INFO:tasks.workunit.client.0.smithi049.stdout:0/515: readlink d3/l12 0 2024-02-22T00:33:55.665 INFO:tasks.workunit.client.0.smithi049.stdout:0/516: mkdir d3/df/d48/d91 0 2024-02-22T00:33:55.669 INFO:tasks.workunit.client.0.smithi049.stdout:6/450: truncate d3/f38 7537721 0 2024-02-22T00:33:55.670 INFO:tasks.workunit.client.0.smithi049.stdout:8/564: rmdir d1/d2/da5/d15/d30/d36/d53/d93 39 2024-02-22T00:33:55.671 INFO:tasks.workunit.client.0.smithi049.stdout:8/565: fdatasync d1/d2/da5/d15/d33/fbc 0 2024-02-22T00:33:55.671 INFO:tasks.workunit.client.0.smithi049.stdout:7/608: creat d1/fd3 x:0 0 0 2024-02-22T00:33:55.673 INFO:tasks.workunit.client.0.smithi049.stdout:7/609: readlink d1/df/d62/l4c 0 2024-02-22T00:33:55.674 INFO:tasks.workunit.client.0.smithi049.stdout:6/451: stat d3/f13 0 2024-02-22T00:33:55.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/566: mknod d1/d2/d5/d56/dac/cca 0 2024-02-22T00:33:55.675 INFO:tasks.workunit.client.0.smithi049.stdout:0/517: rmdir d3/df/d17/d50/d62 39 2024-02-22T00:33:55.676 INFO:tasks.workunit.client.0.smithi049.stdout:7/610: creat d1/d41/d55/d89/fd4 x:0 0 0 2024-02-22T00:33:55.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/518: chown d3/df/d59/d60 408 1 2024-02-22T00:33:55.678 INFO:tasks.workunit.client.0.smithi049.stdout:6/452: rename d3/d16/f19 to d3/d64/d60/f9c 0 2024-02-22T00:33:55.682 INFO:tasks.workunit.client.0.smithi049.stdout:1/578: dwrite d2/d69/fbe [0,4194304] 0 2024-02-22T00:33:55.682 INFO:tasks.workunit.client.0.smithi049.stdout:6/453: readlink d3/d64/d59/d72/d92/d6c/l8a 0 2024-02-22T00:33:55.682 INFO:tasks.workunit.client.0.smithi049.stdout:1/579: chown d2/f3 36117 1 2024-02-22T00:33:55.684 INFO:tasks.workunit.client.0.smithi049.stdout:8/567: mkdir d1/d2/da5/d15/d30/d36/d52/daf/dcb 0 2024-02-22T00:33:55.686 INFO:tasks.workunit.client.0.smithi049.stdout:6/454: creat d3/d36/f9d x:0 0 0 2024-02-22T00:33:55.687 INFO:tasks.workunit.client.0.smithi049.stdout:6/455: fdatasync d3/d16/d4a/d4d/f84 0 2024-02-22T00:33:55.688 INFO:tasks.workunit.client.0.smithi049.stdout:1/580: unlink d2/d8/db/d25/d40/d4d/f72 0 2024-02-22T00:33:55.690 INFO:tasks.workunit.client.0.smithi049.stdout:0/519: rename d3/df/d48/d6f/d74 to d3/d92 0 2024-02-22T00:33:55.697 INFO:tasks.workunit.client.0.smithi049.stdout:6/456: link d3/d16/f25 d3/d64/d60/f9e 0 2024-02-22T00:33:55.698 INFO:tasks.workunit.client.0.smithi049.stdout:8/568: creat d1/d2/da5/d15/d30/fcc x:0 0 0 2024-02-22T00:33:55.700 INFO:tasks.workunit.client.0.smithi049.stdout:0/520: link d3/d6/d8/d36/d81/f89 d3/df/d7f/f93 0 2024-02-22T00:33:55.703 INFO:tasks.workunit.client.0.smithi049.stdout:8/569: dread d1/d4c/f4f [0,4194304] 0 2024-02-22T00:33:55.703 INFO:tasks.workunit.client.0.smithi049.stdout:7/611: rename d1/df/d62/d60/l6c to d1/df/ld5 0 2024-02-22T00:33:55.705 INFO:tasks.workunit.client.0.smithi049.stdout:6/457: creat d3/d64/d59/d72/d92/d6c/f9f x:0 0 0 2024-02-22T00:33:55.706 INFO:tasks.workunit.client.0.smithi049.stdout:0/521: dread d3/d6/d8/f8b [0,4194304] 0 2024-02-22T00:33:55.706 INFO:tasks.workunit.client.0.smithi049.stdout:1/581: getdents d2/d8/db/d25/d40/d41/d84 0 2024-02-22T00:33:55.707 INFO:tasks.workunit.client.0.smithi049.stdout:6/458: dread - d3/d64/d59/f77 zero size 2024-02-22T00:33:55.709 INFO:tasks.workunit.client.0.smithi049.stdout:8/570: rmdir d1/d2/d8c 39 2024-02-22T00:33:55.710 INFO:tasks.workunit.client.0.smithi049.stdout:7/612: chown d1/c5 266973171 1 2024-02-22T00:33:55.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/459: mkdir d3/d64/d60/da0 0 2024-02-22T00:33:55.713 INFO:tasks.workunit.client.0.smithi049.stdout:6/460: chown d3/f62 320 1 2024-02-22T00:33:55.714 INFO:tasks.workunit.client.0.smithi049.stdout:0/522: symlink d3/df/d59/l94 0 2024-02-22T00:33:55.714 INFO:tasks.workunit.client.0.smithi049.stdout:6/461: dread - d3/d64/d5f/f7d zero size 2024-02-22T00:33:55.721 INFO:tasks.workunit.client.0.smithi049.stdout:6/462: unlink d3/f2a 0 2024-02-22T00:33:55.722 INFO:tasks.workunit.client.0.smithi049.stdout:1/582: creat d2/d8/da/fc8 x:0 0 0 2024-02-22T00:33:55.725 INFO:tasks.workunit.client.0.smithi049.stdout:8/571: write d1/d2/da5/d15/d30/fa9 [469370,126785] 0 2024-02-22T00:33:55.725 INFO:tasks.workunit.client.0.smithi049.stdout:0/523: link d3/c15 d3/df/d59/d60/c95 0 2024-02-22T00:33:55.732 INFO:tasks.workunit.client.0.smithi049.stdout:0/524: creat d3/df/d48/d54/f96 x:0 0 0 2024-02-22T00:33:55.733 INFO:tasks.workunit.client.0.smithi049.stdout:6/463: dwrite d3/d64/f26 [0,4194304] 0 2024-02-22T00:33:55.735 INFO:tasks.workunit.client.0.smithi049.stdout:8/572: chown d1/d2/d5/d1b/f32 2 1 2024-02-22T00:33:55.739 INFO:tasks.workunit.client.0.smithi049.stdout:6/464: chown d3/d16/d32/l52 6 1 2024-02-22T00:33:55.739 INFO:tasks.workunit.client.0.smithi049.stdout:7/613: dwrite d1/df/d62/d48/f8b [0,4194304] 0 2024-02-22T00:33:55.739 INFO:tasks.workunit.client.0.smithi049.stdout:1/583: rename d2/d8/db/d25/d40/d41/d84/d8b/cc0 to d2/d8/db/d25/d40/d41/cc9 0 2024-02-22T00:33:55.739 INFO:tasks.workunit.client.0.smithi049.stdout:7/614: stat d1/df/d62/d48 0 2024-02-22T00:33:55.740 INFO:tasks.workunit.client.0.smithi049.stdout:0/525: fdatasync d3/df/d17/f20 0 2024-02-22T00:33:55.742 INFO:tasks.workunit.client.0.smithi049.stdout:0/526: truncate d3/d1e/d58/f7c 366329 0 2024-02-22T00:33:55.743 INFO:tasks.workunit.client.0.smithi049.stdout:1/584: write d2/d66/f96 [5038013,21354] 0 2024-02-22T00:33:55.743 INFO:tasks.workunit.client.0.smithi049.stdout:8/573: mkdir d1/d2/da5/d15/d30/d36/dcd 0 2024-02-22T00:33:55.746 INFO:tasks.workunit.client.0.smithi049.stdout:7/615: mknod d1/d41/d28/d71/d72/d95/cd6 0 2024-02-22T00:33:55.747 INFO:tasks.workunit.client.0.smithi049.stdout:0/527: creat d3/df/d48/d63/f97 x:0 0 0 2024-02-22T00:33:55.748 INFO:tasks.workunit.client.0.smithi049.stdout:1/585: unlink d2/d8/da/c6e 0 2024-02-22T00:33:55.750 INFO:tasks.workunit.client.0.smithi049.stdout:0/528: creat d3/d1e/d58/f98 x:0 0 0 2024-02-22T00:33:55.751 INFO:tasks.workunit.client.0.smithi049.stdout:6/465: rename d3/f38 to d3/fa1 0 2024-02-22T00:33:55.752 INFO:tasks.workunit.client.0.smithi049.stdout:1/586: creat d2/d8/da/d8a/fca x:0 0 0 2024-02-22T00:33:55.757 INFO:tasks.workunit.client.0.smithi049.stdout:5/488: sync 2024-02-22T00:33:55.757 INFO:tasks.workunit.client.0.smithi049.stdout:6/466: symlink d3/d16/d4a/d4d/la2 0 2024-02-22T00:33:55.758 INFO:tasks.workunit.client.0.smithi049.stdout:0/529: symlink d3/df/d17/l99 0 2024-02-22T00:33:55.764 INFO:tasks.workunit.client.0.smithi049.stdout:7/616: dwrite d1/df/d62/d1c/d1d/d6e/f76 [0,4194304] 0 2024-02-22T00:33:55.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/574: dwrite d1/d2/da5/d15/d30/d36/d53/f5f [0,4194304] 0 2024-02-22T00:33:55.764 INFO:tasks.workunit.client.0.smithi049.stdout:5/489: mknod d0/d20/d50/ca3 0 2024-02-22T00:33:55.768 INFO:tasks.workunit.client.0.smithi049.stdout:6/467: creat d3/d64/d60/da0/fa3 x:0 0 0 2024-02-22T00:33:55.769 INFO:tasks.workunit.client.0.smithi049.stdout:1/587: dwrite d2/d8/db/f2d [0,4194304] 0 2024-02-22T00:33:55.771 INFO:tasks.workunit.client.0.smithi049.stdout:0/530: creat d3/d1e/f9a x:0 0 0 2024-02-22T00:33:55.774 INFO:tasks.workunit.client.0.smithi049.stdout:6/468: write d3/d64/f35 [1738218,20087] 0 2024-02-22T00:33:55.774 INFO:tasks.workunit.client.0.smithi049.stdout:7/617: creat d1/df/d62/d57/fd7 x:0 0 0 2024-02-22T00:33:55.775 INFO:tasks.workunit.client.0.smithi049.stdout:0/531: write d3/d6/f7b [540511,16797] 0 2024-02-22T00:33:55.776 INFO:tasks.workunit.client.0.smithi049.stdout:5/490: mknod d0/d20/ca4 0 2024-02-22T00:33:55.782 INFO:tasks.workunit.client.0.smithi049.stdout:8/575: write d1/d2/d5/d1b/d39/f9d [1004935,121104] 0 2024-02-22T00:33:55.784 INFO:tasks.workunit.client.0.smithi049.stdout:1/588: mkdir d2/d8/db/d25/d62/dcb 0 2024-02-22T00:33:55.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/618: dread d1/d49/d4d/f75 [0,4194304] 0 2024-02-22T00:33:55.785 INFO:tasks.workunit.client.0.smithi049.stdout:6/469: symlink d3/d64/d59/d72/la4 0 2024-02-22T00:33:55.786 INFO:tasks.workunit.client.0.smithi049.stdout:7/619: fsync d1/fe 0 2024-02-22T00:33:55.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/491: link d0/d20/d50/fa1 d0/d20/d50/fa5 0 2024-02-22T00:33:55.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/470: readlink d3/d16/d3b/l3e 0 2024-02-22T00:33:55.788 INFO:tasks.workunit.client.0.smithi049.stdout:8/576: creat d1/d2/da5/d15/d30/d36/d52/fce x:0 0 0 2024-02-22T00:33:55.789 INFO:tasks.workunit.client.0.smithi049.stdout:7/620: truncate d1/df/d62/d1c/f85 704641 0 2024-02-22T00:33:55.790 INFO:tasks.workunit.client.0.smithi049.stdout:1/589: mkdir d2/d8/db/d25/d62/dcc 0 2024-02-22T00:33:55.791 INFO:tasks.workunit.client.0.smithi049.stdout:0/532: creat d3/df/d7f/f9b x:0 0 0 2024-02-22T00:33:55.791 INFO:tasks.workunit.client.0.smithi049.stdout:5/492: creat d0/d20/fa6 x:0 0 0 2024-02-22T00:33:55.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/471: creat d3/d37/fa5 x:0 0 0 2024-02-22T00:33:55.793 INFO:tasks.workunit.client.0.smithi049.stdout:7/621: mknod d1/df/d62/d1c/d1d/d70/cd8 0 2024-02-22T00:33:55.795 INFO:tasks.workunit.client.0.smithi049.stdout:6/472: read d3/d16/f1c [45745,103170] 0 2024-02-22T00:33:55.795 INFO:tasks.workunit.client.0.smithi049.stdout:8/577: rename d1/d2/d5/lc1 to d1/d2/d5/d1b/d39/d60/da0/lcf 0 2024-02-22T00:33:55.796 INFO:tasks.workunit.client.0.smithi049.stdout:1/590: fsync d2/d8/db/d25/d40/d41/d5b/f7c 0 2024-02-22T00:33:55.797 INFO:tasks.workunit.client.0.smithi049.stdout:7/622: symlink d1/d41/d55/ld9 0 2024-02-22T00:33:55.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/578: rename d1/d2/d5 to d1/d2/d5/d1b/d39/d60/da0/dd0 22 2024-02-22T00:33:55.800 INFO:tasks.workunit.client.0.smithi049.stdout:6/473: symlink d3/d16/d3b/d8c/la6 0 2024-02-22T00:33:55.803 INFO:tasks.workunit.client.0.smithi049.stdout:1/591: mknod d2/d8/db/d25/d40/d4d/ccd 0 2024-02-22T00:33:55.804 INFO:tasks.workunit.client.0.smithi049.stdout:5/493: creat d0/d26/d4d/d6f/d94/d74/d7a/d89/fa7 x:0 0 0 2024-02-22T00:33:55.806 INFO:tasks.workunit.client.0.smithi049.stdout:7/623: rename d1/df/d62/f66 to d1/df/d62/d60/fda 0 2024-02-22T00:33:55.806 INFO:tasks.workunit.client.0.smithi049.stdout:5/494: write d0/d20/d50/d24/d54/f85 [491382,66363] 0 2024-02-22T00:33:55.808 INFO:tasks.workunit.client.0.smithi049.stdout:7/624: fsync d1/df/f4f 0 2024-02-22T00:33:55.809 INFO:tasks.workunit.client.0.smithi049.stdout:1/592: mkdir d2/d69/dce 0 2024-02-22T00:33:55.812 INFO:tasks.workunit.client.0.smithi049.stdout:6/474: creat d3/d16/d4a/d4d/d8b/fa7 x:0 0 0 2024-02-22T00:33:55.814 INFO:tasks.workunit.client.0.smithi049.stdout:7/625: creat d1/d49/d4d/fdb x:0 0 0 2024-02-22T00:33:55.818 INFO:tasks.workunit.client.0.smithi049.stdout:8/579: dwrite d1/d2/d5/d1b/d39/d81/fa1 [0,4194304] 0 2024-02-22T00:33:55.824 INFO:tasks.workunit.client.0.smithi049.stdout:6/475: rmdir d3/d64/d60/da0 39 2024-02-22T00:33:55.828 INFO:tasks.workunit.client.0.smithi049.stdout:0/533: truncate d3/d1e/f5a 1164602 0 2024-02-22T00:33:55.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/495: dwrite d0/d20/d50/d24/d57/f8d [0,4194304] 0 2024-02-22T00:33:55.836 INFO:tasks.workunit.client.0.smithi049.stdout:0/534: chown d3/d6/d29/f6c 248929 1 2024-02-22T00:33:55.836 INFO:tasks.workunit.client.0.smithi049.stdout:6/476: creat d3/d64/d60/da0/fa8 x:0 0 0 2024-02-22T00:33:55.856 INFO:tasks.workunit.client.0.smithi049.stdout:1/593: dwrite d2/d8/da/f39 [0,4194304] 0 2024-02-22T00:33:55.860 INFO:tasks.workunit.client.0.smithi049.stdout:8/580: dread d1/d2/d5/d1b/d39/f72 [0,4194304] 0 2024-02-22T00:33:55.864 INFO:tasks.workunit.client.0.smithi049.stdout:7/626: dwrite d1/d41/fc0 [0,4194304] 0 2024-02-22T00:33:55.867 INFO:tasks.workunit.client.0.smithi049.stdout:1/594: write d2/d8/db/d25/d40/d41/fa1 [669165,105929] 0 2024-02-22T00:33:55.867 INFO:tasks.workunit.client.0.smithi049.stdout:6/477: dwrite d3/d64/d60/da0/fa8 [0,4194304] 0 2024-02-22T00:33:55.871 INFO:tasks.workunit.client.0.smithi049.stdout:0/535: dwrite d3/d1e/d58/f7c [0,4194304] 0 2024-02-22T00:33:55.875 INFO:tasks.workunit.client.0.smithi049.stdout:8/581: mkdir d1/dd1 0 2024-02-22T00:33:55.879 INFO:tasks.workunit.client.0.smithi049.stdout:5/496: dwrite d0/d20/d50/f36 [0,4194304] 0 2024-02-22T00:33:55.880 INFO:tasks.workunit.client.0.smithi049.stdout:0/536: dread - d3/df/d48/d54/f96 zero size 2024-02-22T00:33:55.881 INFO:tasks.workunit.client.0.smithi049.stdout:1/595: write d2/d8/db/d25/d40/d41/d68/f80 [1518109,79149] 0 2024-02-22T00:33:55.885 INFO:tasks.workunit.client.0.smithi049.stdout:6/478: rename d3/d16/c40 to d3/d64/d59/d72/d92/d6c/ca9 0 2024-02-22T00:33:55.885 INFO:tasks.workunit.client.0.smithi049.stdout:8/582: mkdir d1/d2/d5/d56/dd2 0 2024-02-22T00:33:55.887 INFO:tasks.workunit.client.0.smithi049.stdout:1/596: chown d2/d8/db/l58 1 1 2024-02-22T00:33:55.888 INFO:tasks.workunit.client.0.smithi049.stdout:0/537: chown d3/df/d48/d63/l8d 454 1 2024-02-22T00:33:55.888 INFO:tasks.workunit.client.0.smithi049.stdout:6/479: truncate d3/d16/d45/f49 346706 0 2024-02-22T00:33:55.897 INFO:tasks.workunit.client.0.smithi049.stdout:1/597: creat d2/d69/dc4/fcf x:0 0 0 2024-02-22T00:33:55.897 INFO:tasks.workunit.client.0.smithi049.stdout:0/538: mknod d3/df/d17/d50/c9c 0 2024-02-22T00:33:55.897 INFO:tasks.workunit.client.0.smithi049.stdout:8/583: truncate d1/d2/d5/d56/fa4 332153 0 2024-02-22T00:33:55.902 INFO:tasks.workunit.client.0.smithi049.stdout:8/584: dread d1/d2/d5/d1b/d39/f72 [0,4194304] 0 2024-02-22T00:33:55.904 INFO:tasks.workunit.client.0.smithi049.stdout:0/539: creat d3/df/d48/d6f/d7a/f9d x:0 0 0 2024-02-22T00:33:55.909 INFO:tasks.workunit.client.0.smithi049.stdout:8/585: rename d1/c58 to d1/d2/da5/d15/d30/d36/dcd/cd3 0 2024-02-22T00:33:55.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/480: getdents d3/d36/d57 0 2024-02-22T00:33:55.916 INFO:tasks.workunit.client.0.smithi049.stdout:0/540: rename d3/d6/c1c to d3/df/d48/d63/c9e 0 2024-02-22T00:33:55.917 INFO:tasks.workunit.client.0.smithi049.stdout:8/586: stat d1/d2/da5/d15/d30/d4b/d51/c8b 0 2024-02-22T00:33:55.919 INFO:tasks.workunit.client.0.smithi049.stdout:8/587: write d1/d2/d5/d1b/f8e [2975762,827] 0 2024-02-22T00:33:55.926 INFO:tasks.workunit.client.0.smithi049.stdout:6/481: link d3/d36/l90 d3/d36/d70/laa 0 2024-02-22T00:33:55.927 INFO:tasks.workunit.client.0.smithi049.stdout:5/497: dwrite d0/d20/d50/fa5 [0,4194304] 0 2024-02-22T00:33:55.929 INFO:tasks.workunit.client.0.smithi049.stdout:8/588: rmdir d1/d2/d5/d1b/d39/d60/da0 39 2024-02-22T00:33:55.931 INFO:tasks.workunit.client.0.smithi049.stdout:6/482: symlink d3/d16/d45/lab 0 2024-02-22T00:33:55.932 INFO:tasks.workunit.client.0.smithi049.stdout:0/541: link d3/df/l45 d3/d1e/l9f 0 2024-02-22T00:33:55.933 INFO:tasks.workunit.client.0.smithi049.stdout:8/589: readlink d1/d2/da5/d15/d65/d6a/l90 0 2024-02-22T00:33:55.934 INFO:tasks.workunit.client.0.smithi049.stdout:1/598: dwrite d2/d8/db/f90 [0,4194304] 0 2024-02-22T00:33:55.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/498: rmdir d0/d20/d50/d24 39 2024-02-22T00:33:55.939 INFO:tasks.workunit.client.0.smithi049.stdout:6/483: creat d3/d36/d70/fac x:0 0 0 2024-02-22T00:33:55.940 INFO:tasks.workunit.client.0.smithi049.stdout:0/542: mknod d3/df/d48/d54/ca0 0 2024-02-22T00:33:55.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/599: mkdir d2/d8/db/d25/d40/d41/d5b/d75/dd0 0 2024-02-22T00:33:55.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/499: unlink d0/d26/d4d/d6f/d94/f72 0 2024-02-22T00:33:55.946 INFO:tasks.workunit.client.0.smithi049.stdout:8/590: mknod d1/d2/d5/d1b/d39/d60/da0/cd4 0 2024-02-22T00:33:55.948 INFO:tasks.workunit.client.0.smithi049.stdout:0/543: chown d3/c3a 0 1 2024-02-22T00:33:55.949 INFO:tasks.workunit.client.0.smithi049.stdout:6/484: mknod d3/d64/cad 0 2024-02-22T00:33:55.951 INFO:tasks.workunit.client.0.smithi049.stdout:8/591: creat d1/d2/da5/d1c/fd5 x:0 0 0 2024-02-22T00:33:55.951 INFO:tasks.workunit.client.0.smithi049.stdout:0/544: write d3/d1e/d58/f7c [1775481,16074] 0 2024-02-22T00:33:55.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/600: creat d2/fd1 x:0 0 0 2024-02-22T00:33:55.954 INFO:tasks.workunit.client.0.smithi049.stdout:0/545: fsync d3/df/d48/d6f/d90/f31 0 2024-02-22T00:33:55.957 INFO:tasks.workunit.client.0.smithi049.stdout:8/592: rmdir d1/d2/d5/d56 39 2024-02-22T00:33:55.957 INFO:tasks.workunit.client.0.smithi049.stdout:0/546: chown d3/df/d59/d8e 111034 1 2024-02-22T00:33:55.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/485: dread d3/d64/d59/f66 [0,4194304] 0 2024-02-22T00:33:55.961 INFO:tasks.workunit.client.0.smithi049.stdout:0/547: creat d3/d1e/d58/fa1 x:0 0 0 2024-02-22T00:33:55.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/486: truncate d3/d64/d59/d72/d92/d6c/f9f 868805 0 2024-02-22T00:33:55.967 INFO:tasks.workunit.client.0.smithi049.stdout:1/601: rename d2/d8/c1d to d2/d8/db/d25/d40/d41/d5b/d75/cd2 0 2024-02-22T00:33:55.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/602: chown d2/d8/db/d25/l9d 1 1 2024-02-22T00:33:55.970 INFO:tasks.workunit.client.0.smithi049.stdout:1/603: dread - d2/d8/db/d25/d40/d41/d68/d78/f92 zero size 2024-02-22T00:33:55.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/593: getdents d1/d2/da5/d15/d30/d36/d52 0 2024-02-22T00:33:55.973 INFO:tasks.workunit.client.0.smithi049.stdout:5/500: truncate d0/f48 287452 0 2024-02-22T00:33:55.973 INFO:tasks.workunit.client.0.smithi049.stdout:8/594: chown d1/d4c/f4f 94421483 1 2024-02-22T00:33:55.973 INFO:tasks.workunit.client.0.smithi049.stdout:1/604: symlink d2/d8/d4c/d5e/ld3 0 2024-02-22T00:33:55.977 INFO:tasks.workunit.client.0.smithi049.stdout:0/548: write d3/d6/d8/d36/d81/f89 [4993039,124437] 0 2024-02-22T00:33:55.978 INFO:tasks.workunit.client.0.smithi049.stdout:5/501: chown d0/d20/d50/d24/l3e 30 1 2024-02-22T00:33:55.979 INFO:tasks.workunit.client.0.smithi049.stdout:8/595: rename d1/d2/da5/d15/d30/d36/lc0 to d1/d2/d5/d1b/d39/ld6 0 2024-02-22T00:33:55.979 INFO:tasks.workunit.client.0.smithi049.stdout:6/487: link d3/d16/d4a/c89 d3/d64/cae 0 2024-02-22T00:33:55.984 INFO:tasks.workunit.client.0.smithi049.stdout:8/596: mkdir d1/d2/dd7 0 2024-02-22T00:33:55.985 INFO:tasks.workunit.client.0.smithi049.stdout:1/605: dwrite d2/d8/db/d25/d40/d41/d68/fa6 [0,4194304] 0 2024-02-22T00:33:55.985 INFO:tasks.workunit.client.0.smithi049.stdout:5/502: mkdir d0/d26/d4d/d6f/da8 0 2024-02-22T00:33:55.986 INFO:tasks.workunit.client.0.smithi049.stdout:6/488: truncate d3/d64/d5f/f82 954542 0 2024-02-22T00:33:55.988 INFO:tasks.workunit.client.0.smithi049.stdout:8/597: write d1/d2/da5/d15/d30/fa9 [1139885,102571] 0 2024-02-22T00:33:55.988 INFO:tasks.workunit.client.0.smithi049.stdout:0/549: creat d3/df/d17/d50/d62/fa2 x:0 0 0 2024-02-22T00:33:55.992 INFO:tasks.workunit.client.0.smithi049.stdout:0/550: unlink d3/df/f5b 0 2024-02-22T00:33:55.996 INFO:tasks.workunit.client.0.smithi049.stdout:6/489: getdents d3/d16 0 2024-02-22T00:33:55.997 INFO:tasks.workunit.client.0.smithi049.stdout:8/598: write d1/d2/da5/f78 [7624822,17165] 0 2024-02-22T00:33:55.997 INFO:tasks.workunit.client.0.smithi049.stdout:0/551: write d3/d6/d8/f71 [973793,126250] 0 2024-02-22T00:33:56.001 INFO:tasks.workunit.client.0.smithi049.stdout:1/606: getdents d2/d8/db/d25/d40 0 2024-02-22T00:33:56.002 INFO:tasks.workunit.client.0.smithi049.stdout:6/490: creat d3/d16/d4a/faf x:0 0 0 2024-02-22T00:33:56.003 INFO:tasks.workunit.client.0.smithi049.stdout:0/552: creat d3/df/d7f/fa3 x:0 0 0 2024-02-22T00:33:56.005 INFO:tasks.workunit.client.0.smithi049.stdout:5/503: dwrite d0/d26/d4d/d64/f93 [0,4194304] 0 2024-02-22T00:33:56.007 INFO:tasks.workunit.client.0.smithi049.stdout:0/553: readlink d3/d1e/l2a 0 2024-02-22T00:33:56.013 INFO:tasks.workunit.client.0.smithi049.stdout:1/607: mknod d2/d8/db/d25/da4/cd4 0 2024-02-22T00:33:56.015 INFO:tasks.workunit.client.0.smithi049.stdout:5/504: creat d0/d26/d4d/d6f/d94/d74/d7a/d8f/fa9 x:0 0 0 2024-02-22T00:33:56.017 INFO:tasks.workunit.client.0.smithi049.stdout:1/608: dread - d2/d8/fb8 zero size 2024-02-22T00:33:56.018 INFO:tasks.workunit.client.0.smithi049.stdout:0/554: write d3/df/d17/d50/d62/f67 [2427840,43970] 0 2024-02-22T00:33:56.019 INFO:tasks.workunit.client.0.smithi049.stdout:6/491: dwrite d3/d64/f22 [4194304,4194304] 0 2024-02-22T00:33:56.020 INFO:tasks.workunit.client.0.smithi049.stdout:5/505: chown d0/d20/d50 1681375 1 2024-02-22T00:33:56.021 INFO:tasks.workunit.client.0.smithi049.stdout:8/599: dwrite d1/d2/d5/fa8 [0,4194304] 0 2024-02-22T00:33:56.024 INFO:tasks.workunit.client.0.smithi049.stdout:6/492: fsync d3/d16/d32/f73 0 2024-02-22T00:33:56.027 INFO:tasks.workunit.client.0.smithi049.stdout:5/506: unlink d0/d20/ca4 0 2024-02-22T00:33:56.033 INFO:tasks.workunit.client.0.smithi049.stdout:6/493: dread d3/d64/d59/d72/d92/d6c/f9f [0,4194304] 0 2024-02-22T00:33:56.034 INFO:tasks.workunit.client.0.smithi049.stdout:5/507: mknod d0/d26/d4d/d6f/d94/caa 0 2024-02-22T00:33:56.034 INFO:tasks.workunit.client.0.smithi049.stdout:8/600: dwrite d1/d2/da5/d15/d33/f48 [0,4194304] 0 2024-02-22T00:33:56.038 INFO:tasks.workunit.client.0.smithi049.stdout:1/609: truncate d2/d8/db/fbd 4313139 0 2024-02-22T00:33:56.040 INFO:tasks.workunit.client.0.smithi049.stdout:5/508: write d0/d20/d50/d24/d54/f85 [1565093,2840] 0 2024-02-22T00:33:56.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/494: symlink d3/d64/d60/lb0 0 2024-02-22T00:33:56.044 INFO:tasks.workunit.client.0.smithi049.stdout:6/495: write d3/d16/f39 [1253226,66732] 0 2024-02-22T00:33:56.046 INFO:tasks.workunit.client.0.smithi049.stdout:8/601: dread d1/d2/f27 [0,4194304] 0 2024-02-22T00:33:56.051 INFO:tasks.workunit.client.0.smithi049.stdout:8/602: fsync d1/d2/d5/d1b/d39/d81/fb2 0 2024-02-22T00:33:56.052 INFO:tasks.workunit.client.0.smithi049.stdout:1/610: dwrite d2/fd1 [0,4194304] 0 2024-02-22T00:33:56.053 INFO:tasks.workunit.client.0.smithi049.stdout:2/525: sync 2024-02-22T00:33:56.053 INFO:tasks.workunit.client.0.smithi049.stdout:4/479: sync 2024-02-22T00:33:56.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/611: chown d2/d8/db/d25/d40/f54 1207 1 2024-02-22T00:33:56.056 INFO:tasks.workunit.client.0.smithi049.stdout:8/603: creat d1/d2/da5/d15/d30/d36/d52/daf/fd8 x:0 0 0 2024-02-22T00:33:56.058 INFO:tasks.workunit.client.0.smithi049.stdout:8/604: write d1/d2/d5/d1b/d39/f6c [485404,84951] 0 2024-02-22T00:33:56.060 INFO:tasks.workunit.client.0.smithi049.stdout:2/526: mknod d2/d9/de/d3a/d6d/da6/cc1 0 2024-02-22T00:33:56.068 INFO:tasks.workunit.client.0.smithi049.stdout:5/509: write d0/d26/d4d/d6f/f61 [2697773,69042] 0 2024-02-22T00:33:56.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/555: dread d3/df/d48/d6f/d90/f31 [0,4194304] 0 2024-02-22T00:33:56.069 INFO:tasks.workunit.client.0.smithi049.stdout:1/612: dwrite d2/d8/db/d25/d62/fb5 [0,4194304] 0 2024-02-22T00:33:56.071 INFO:tasks.workunit.client.0.smithi049.stdout:5/510: readlink d0/d26/l4b 0 2024-02-22T00:33:56.072 INFO:tasks.workunit.client.0.smithi049.stdout:2/527: mknod d2/d9/dd/d4d/d72/cc2 0 2024-02-22T00:33:56.072 INFO:tasks.workunit.client.0.smithi049.stdout:8/605: rmdir d1/d2/da5/d15/d30/d36/d52/daf 39 2024-02-22T00:33:56.072 INFO:tasks.workunit.client.0.smithi049.stdout:6/496: dread d3/f11 [0,4194304] 0 2024-02-22T00:33:56.079 INFO:tasks.workunit.client.0.smithi049.stdout:5/511: creat d0/d26/d4d/d70/fab x:0 0 0 2024-02-22T00:33:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:1/613: symlink d2/d8/db/d25/d40/d41/d5b/d75/ld5 0 2024-02-22T00:33:56.084 INFO:tasks.workunit.client.0.smithi049.stdout:5/512: stat d0/d26/d4d/d6f/d94/c8a 0 2024-02-22T00:33:56.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/497: write d3/f13 [1895769,105206] 0 2024-02-22T00:33:56.086 INFO:tasks.workunit.client.0.smithi049.stdout:8/606: creat d1/d2/da5/d15/d30/d36/d52/daf/fd9 x:0 0 0 2024-02-22T00:33:56.089 INFO:tasks.workunit.client.0.smithi049.stdout:4/480: dwrite d3/d22/d5c/f93 [0,4194304] 0 2024-02-22T00:33:56.089 INFO:tasks.workunit.client.0.smithi049.stdout:2/528: write d2/d9/de/f26 [181694,128207] 0 2024-02-22T00:33:56.089 INFO:tasks.workunit.client.0.smithi049.stdout:1/614: dread - d2/d8/da/f3f zero size 2024-02-22T00:33:56.092 INFO:tasks.workunit.client.0.smithi049.stdout:5/513: readlink d0/d26/d4d/d6f/d94/l8b 0 2024-02-22T00:33:56.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/529: dread - d2/d9/de/fae zero size 2024-02-22T00:33:56.095 INFO:tasks.workunit.client.0.smithi049.stdout:0/556: dwrite d3/df/d59/f83 [0,4194304] 0 2024-02-22T00:33:56.097 INFO:tasks.workunit.client.0.smithi049.stdout:6/498: mkdir d3/d64/d59/d72/d92/db1 0 2024-02-22T00:33:56.097 INFO:tasks.workunit.client.0.smithi049.stdout:5/514: fsync d0/d20/d50/f83 0 2024-02-22T00:33:56.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/499: write d3/d36/f4e [1173390,5546] 0 2024-02-22T00:33:56.103 INFO:tasks.workunit.client.0.smithi049.stdout:2/530: mkdir d2/d9/de/d3a/dc3 0 2024-02-22T00:33:56.106 INFO:tasks.workunit.client.0.smithi049.stdout:8/607: dread d1/d2/da5/d15/d33/f48 [0,4194304] 0 2024-02-22T00:33:56.107 INFO:tasks.workunit.client.0.smithi049.stdout:4/481: rename d3/d8/d10/d45/f5a to d3/d8/d10/d39/f9f 0 2024-02-22T00:33:56.108 INFO:tasks.workunit.client.0.smithi049.stdout:5/515: creat d0/d26/d4d/fac x:0 0 0 2024-02-22T00:33:56.109 INFO:tasks.workunit.client.0.smithi049.stdout:6/500: creat d3/d16/d4a/d4d/d8b/fb2 x:0 0 0 2024-02-22T00:33:56.110 INFO:tasks.workunit.client.0.smithi049.stdout:2/531: read d2/d9/de/d3a/fb4 [932240,74561] 0 2024-02-22T00:33:56.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/608: fsync d1/d2/da5/d15/d30/fcc 0 2024-02-22T00:33:56.114 INFO:tasks.workunit.client.0.smithi049.stdout:6/501: dread - d3/d16/d45/f7a zero size 2024-02-22T00:33:56.119 INFO:tasks.workunit.client.0.smithi049.stdout:0/557: dwrite d3/d6/f4d [0,4194304] 0 2024-02-22T00:33:56.120 INFO:tasks.workunit.client.0.smithi049.stdout:2/532: fsync d2/d9/dd/d4d/d5a/d99/fa8 0 2024-02-22T00:33:56.120 INFO:tasks.workunit.client.0.smithi049.stdout:8/609: chown d1/d2/da5/d15/f23 731 1 2024-02-22T00:33:56.120 INFO:tasks.workunit.client.0.smithi049.stdout:5/516: rename d0/d20/d50/d24/d57 to d0/d20/dad 0 2024-02-22T00:33:56.121 INFO:tasks.workunit.client.0.smithi049.stdout:0/558: creat d3/d92/fa4 x:0 0 0 2024-02-22T00:33:56.122 INFO:tasks.workunit.client.0.smithi049.stdout:8/610: write d1/d2/d5/d1b/d39/d81/fa1 [4292146,115793] 0 2024-02-22T00:33:56.122 INFO:tasks.workunit.client.0.smithi049.stdout:4/482: rename d3/d8/d10/c2a to d3/d22/d49/d57/ca0 0 2024-02-22T00:33:56.124 INFO:tasks.workunit.client.0.smithi049.stdout:4/483: chown d3/d22/c6a 914332 1 2024-02-22T00:33:56.124 INFO:tasks.workunit.client.0.smithi049.stdout:5/517: mkdir d0/d26/d4d/d6f/d94/dae 0 2024-02-22T00:33:56.126 INFO:tasks.workunit.client.0.smithi049.stdout:0/559: write d3/df/d48/d63/f97 [820991,102672] 0 2024-02-22T00:33:56.128 INFO:tasks.workunit.client.0.smithi049.stdout:6/502: getdents d3/d16/d3b/d8c 0 2024-02-22T00:33:56.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/484: read d3/d22/d5c/f36 [2931741,37556] 0 2024-02-22T00:33:56.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/611: mkdir d1/d4c/dda 0 2024-02-22T00:33:56.130 INFO:tasks.workunit.client.0.smithi049.stdout:6/503: chown d3/l7f 0 1 2024-02-22T00:33:56.130 INFO:tasks.workunit.client.0.smithi049.stdout:5/518: mkdir d0/d20/dad/daf 0 2024-02-22T00:33:56.132 INFO:tasks.workunit.client.0.smithi049.stdout:0/560: write d3/d6/d29/f4b [3253428,60712] 0 2024-02-22T00:33:56.134 INFO:tasks.workunit.client.0.smithi049.stdout:2/533: dread d2/d9/de/d10/f29 [0,4194304] 0 2024-02-22T00:33:56.136 INFO:tasks.workunit.client.0.smithi049.stdout:5/519: creat d0/d20/d84/da0/fb0 x:0 0 0 2024-02-22T00:33:56.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/504: mkdir d3/d64/d59/d72/d92/db1/db3 0 2024-02-22T00:33:56.139 INFO:tasks.workunit.client.0.smithi049.stdout:8/612: dread d1/d2/f25 [0,4194304] 0 2024-02-22T00:33:56.140 INFO:tasks.workunit.client.0.smithi049.stdout:2/534: mkdir d2/d9/de/d15/d1b/dc4 0 2024-02-22T00:33:56.143 INFO:tasks.workunit.client.0.smithi049.stdout:8/613: mknod d1/d4c/cdb 0 2024-02-22T00:33:56.146 INFO:tasks.workunit.client.0.smithi049.stdout:4/485: truncate d3/d22/f8d 2879796 0 2024-02-22T00:33:56.148 INFO:tasks.workunit.client.0.smithi049.stdout:0/561: rename d3/l56 to d3/d1e/la5 0 2024-02-22T00:33:56.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/520: dwrite d0/d20/d50/d24/f5a [0,4194304] 0 2024-02-22T00:33:56.152 INFO:tasks.workunit.client.0.smithi049.stdout:0/562: chown d3/d6/f4d 2855406 1 2024-02-22T00:33:56.154 INFO:tasks.workunit.client.0.smithi049.stdout:5/521: write d0/d20/f90 [664495,100533] 0 2024-02-22T00:33:56.160 INFO:tasks.workunit.client.0.smithi049.stdout:8/614: dwrite d1/d2/da5/d1c/f8f [0,4194304] 0 2024-02-22T00:33:56.162 INFO:tasks.workunit.client.0.smithi049.stdout:5/522: write d0/d20/f7b [319427,33441] 0 2024-02-22T00:33:56.164 INFO:tasks.workunit.client.0.smithi049.stdout:2/535: dwrite d2/f6 [0,4194304] 0 2024-02-22T00:33:56.165 INFO:tasks.workunit.client.0.smithi049.stdout:4/486: dwrite d3/d22/f50 [0,4194304] 0 2024-02-22T00:33:56.173 INFO:tasks.workunit.client.0.smithi049.stdout:5/523: fdatasync d0/f4c 0 2024-02-22T00:33:56.178 INFO:tasks.workunit.client.0.smithi049.stdout:8/615: dwrite d1/d2/f3 [0,4194304] 0 2024-02-22T00:33:56.178 INFO:tasks.workunit.client.0.smithi049.stdout:2/536: symlink d2/d9/dd/d4d/d72/da0/dba/lc5 0 2024-02-22T00:33:56.183 INFO:tasks.workunit.client.0.smithi049.stdout:5/524: rename d0/d26/d4d/d6f/d94/d74/d7a/d8f/d91 to d0/d26/d4d/d70/db1 0 2024-02-22T00:33:56.187 INFO:tasks.workunit.client.0.smithi049.stdout:8/616: write d1/d2/da5/d15/d30/d36/d53/f47 [2072733,90671] 0 2024-02-22T00:33:56.187 INFO:tasks.workunit.client.0.smithi049.stdout:4/487: dwrite d3/d8/d10/d43/d4d/f82 [0,4194304] 0 2024-02-22T00:33:56.189 INFO:tasks.workunit.client.0.smithi049.stdout:4/488: chown d3/d22/d5c 238263712 1 2024-02-22T00:33:56.189 INFO:tasks.workunit.client.0.smithi049.stdout:5/525: mkdir d0/d26/d4d/d6f/d94/d74/db2 0 2024-02-22T00:33:56.197 INFO:tasks.workunit.client.0.smithi049.stdout:4/489: dread d3/d8/d10/d43/d4d/f82 [0,4194304] 0 2024-02-22T00:33:56.198 INFO:tasks.workunit.client.0.smithi049.stdout:5/526: dwrite d0/d20/d50/f36 [0,4194304] 0 2024-02-22T00:33:56.199 INFO:tasks.workunit.client.0.smithi049.stdout:5/527: readlink d0/d20/dad/l87 0 2024-02-22T00:33:56.201 INFO:tasks.workunit.client.0.smithi049.stdout:8/617: creat d1/d2/da5/d15/d30/d36/d53/d93/fdc x:0 0 0 2024-02-22T00:33:56.201 INFO:tasks.workunit.client.0.smithi049.stdout:2/537: link d2/d9/de/d10/d2e/d42/d80/c86 d2/d9/de/d10/d46/d5d/cc6 0 2024-02-22T00:33:56.203 INFO:tasks.workunit.client.0.smithi049.stdout:8/618: write d1/d2/da5/d15/d65/d6a/faa [2081352,5609] 0 2024-02-22T00:33:56.203 INFO:tasks.workunit.client.0.smithi049.stdout:5/528: unlink d0/d26/d4d/d7c/f92 0 2024-02-22T00:33:56.207 INFO:tasks.workunit.client.0.smithi049.stdout:4/490: dread d3/d8/f14 [0,4194304] 0 2024-02-22T00:33:56.210 INFO:tasks.workunit.client.0.smithi049.stdout:8/619: mknod d1/d2/da5/d15/d30/cdd 0 2024-02-22T00:33:56.212 INFO:tasks.workunit.client.0.smithi049.stdout:4/491: creat d3/d8/fa1 x:0 0 0 2024-02-22T00:33:56.213 INFO:tasks.workunit.client.0.smithi049.stdout:5/529: getdents d0/d20/d50/d24/d3b/d5b 0 2024-02-22T00:33:56.215 INFO:tasks.workunit.client.0.smithi049.stdout:4/492: creat d3/d8/d10/d12/d3f/fa2 x:0 0 0 2024-02-22T00:33:56.216 INFO:tasks.workunit.client.0.smithi049.stdout:5/530: creat d0/d26/d4d/d7c/fb3 x:0 0 0 2024-02-22T00:33:56.219 INFO:tasks.workunit.client.0.smithi049.stdout:5/531: read d0/d20/d50/f38 [2788727,71095] 0 2024-02-22T00:33:56.220 INFO:tasks.workunit.client.0.smithi049.stdout:5/532: chown d0/d20/l35 5582506 1 2024-02-22T00:33:56.225 INFO:tasks.workunit.client.0.smithi049.stdout:4/493: dread d3/d22/f8d [0,4194304] 0 2024-02-22T00:33:56.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/494: dwrite d3/d8/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:56.236 INFO:tasks.workunit.client.0.smithi049.stdout:4/495: rmdir d3/d8/d10/d45 39 2024-02-22T00:33:56.237 INFO:tasks.workunit.client.0.smithi049.stdout:4/496: dread - d3/d8/fa1 zero size 2024-02-22T00:33:56.244 INFO:tasks.workunit.client.0.smithi049.stdout:4/497: dwrite d3/d8/d10/d39/f87 [0,4194304] 0 2024-02-22T00:33:56.247 INFO:tasks.workunit.client.0.smithi049.stdout:4/498: creat d3/d22/d5c/d9a/fa3 x:0 0 0 2024-02-22T00:33:56.249 INFO:tasks.workunit.client.0.smithi049.stdout:4/499: creat d3/d22/d5c/d9a/fa4 x:0 0 0 2024-02-22T00:33:56.279 INFO:tasks.workunit.client.0.smithi049.stdout:4/500: dread d3/d8/d10/f15 [0,4194304] 0 2024-02-22T00:33:56.282 INFO:tasks.workunit.client.0.smithi049.stdout:4/501: mkdir d3/d22/d5c/da5 0 2024-02-22T00:33:56.285 INFO:tasks.workunit.client.0.smithi049.stdout:4/502: write d3/d8/f1a [2113812,112635] 0 2024-02-22T00:33:56.288 INFO:tasks.workunit.client.0.smithi049.stdout:4/503: rmdir d3/d22/d5c/d9a 39 2024-02-22T00:33:56.290 INFO:tasks.workunit.client.0.smithi049.stdout:4/504: mknod d3/d22/d5c/d35/ca6 0 2024-02-22T00:33:56.291 INFO:tasks.workunit.client.0.smithi049.stdout:4/505: chown d3/d33 166336 1 2024-02-22T00:33:56.294 INFO:tasks.workunit.client.0.smithi049.stdout:4/506: creat d3/d8/d72/fa7 x:0 0 0 2024-02-22T00:33:56.295 INFO:tasks.workunit.client.0.smithi049.stdout:4/507: chown d3/d8/d10/f11 242 1 2024-02-22T00:33:56.297 INFO:tasks.workunit.client.0.smithi049.stdout:4/508: mkdir d3/d22/d5c/da5/da8 0 2024-02-22T00:33:56.298 INFO:tasks.workunit.client.0.smithi049.stdout:4/509: write d3/d8/fa1 [422368,80564] 0 2024-02-22T00:33:56.316 INFO:tasks.workunit.client.0.smithi049.stdout:4/510: dread d3/d8/f17 [0,4194304] 0 2024-02-22T00:33:56.318 INFO:tasks.workunit.client.0.smithi049.stdout:4/511: dread d3/f2f [0,4194304] 0 2024-02-22T00:33:56.329 INFO:tasks.workunit.client.0.smithi049.stdout:4/512: dwrite d3/f32 [0,4194304] 0 2024-02-22T00:33:56.330 INFO:tasks.workunit.client.0.smithi049.stdout:4/513: stat d3/d22/d5c/d35/c53 0 2024-02-22T00:33:56.332 INFO:tasks.workunit.client.0.smithi049.stdout:4/514: dread d3/d8/f14 [0,4194304] 0 2024-02-22T00:33:56.334 INFO:tasks.workunit.client.0.smithi049.stdout:4/515: fdatasync d3/d8/d10/d39/f9f 0 2024-02-22T00:33:56.338 INFO:tasks.workunit.client.0.smithi049.stdout:4/516: creat d3/d8/d10/d12/d3f/fa9 x:0 0 0 2024-02-22T00:33:56.347 INFO:tasks.workunit.client.0.smithi049.stdout:4/517: truncate d3/d8/d10/d43/d4d/f82 3561596 0 2024-02-22T00:33:56.352 INFO:tasks.workunit.client.0.smithi049.stdout:4/518: dwrite d3/d22/d5c/f5b [0,4194304] 0 2024-02-22T00:33:56.354 INFO:tasks.workunit.client.0.smithi049.stdout:4/519: write d3/d22/f50 [4648476,12238] 0 2024-02-22T00:33:56.355 INFO:tasks.workunit.client.0.smithi049.stdout:4/520: write d3/d22/d49/f85 [2427968,2021] 0 2024-02-22T00:33:56.359 INFO:tasks.workunit.client.0.smithi049.stdout:4/521: creat d3/d22/d5c/da5/da8/faa x:0 0 0 2024-02-22T00:33:56.367 INFO:tasks.workunit.client.0.smithi049.stdout:4/522: dwrite d3/d33/f46 [0,4194304] 0 2024-02-22T00:33:56.377 INFO:tasks.workunit.client.0.smithi049.stdout:4/523: dwrite d3/d22/d5c/d9a/fa3 [0,4194304] 0 2024-02-22T00:33:56.378 INFO:tasks.workunit.client.0.smithi049.stdout:4/524: chown d3/d22/d5c/l47 24926 1 2024-02-22T00:33:56.381 INFO:tasks.workunit.client.0.smithi049.stdout:4/525: unlink d3/d22/d51/d8a/f4e 0 2024-02-22T00:33:56.382 INFO:tasks.workunit.client.0.smithi049.stdout:4/526: read - d3/d8/f8c zero size 2024-02-22T00:33:56.385 INFO:tasks.workunit.client.0.smithi049.stdout:4/527: creat d3/d8/d10/d39/fab x:0 0 0 2024-02-22T00:33:56.397 INFO:tasks.workunit.client.0.smithi049.stdout:4/528: dread d3/d22/d5c/f36 [0,4194304] 0 2024-02-22T00:33:56.400 INFO:tasks.workunit.client.0.smithi049.stdout:4/529: mknod d3/d8/cac 0 2024-02-22T00:33:56.401 INFO:tasks.workunit.client.0.smithi049.stdout:4/530: truncate d3/d8/f9e 407535 0 2024-02-22T00:33:56.404 INFO:tasks.workunit.client.0.smithi049.stdout:4/531: unlink d3/d8/d10/f44 0 2024-02-22T00:33:56.407 INFO:tasks.workunit.client.0.smithi049.stdout:4/532: symlink d3/d22/d51/d8a/d48/d60/lad 0 2024-02-22T00:33:56.409 INFO:tasks.workunit.client.0.smithi049.stdout:4/533: symlink d3/d8/d10/d12/d3f/lae 0 2024-02-22T00:33:56.411 INFO:tasks.workunit.client.0.smithi049.stdout:4/534: truncate d3/d22/d5c/da5/da8/faa 208532 0 2024-02-22T00:33:56.416 INFO:tasks.workunit.client.0.smithi049.stdout:4/535: write d3/f2f [733263,9999] 0 2024-02-22T00:33:56.420 INFO:tasks.workunit.client.0.smithi049.stdout:4/536: getdents d3/d8/d10/d43/d4d 0 2024-02-22T00:33:56.421 INFO:tasks.workunit.client.0.smithi049.stdout:4/537: truncate d3/d8/f9e 611251 0 2024-02-22T00:33:56.423 INFO:tasks.workunit.client.0.smithi049.stdout:4/538: symlink d3/d22/d51/d8a/laf 0 2024-02-22T00:33:56.424 INFO:tasks.workunit.client.0.smithi049.stdout:4/539: mknod d3/d22/d3d/cb0 0 2024-02-22T00:33:56.429 INFO:tasks.workunit.client.0.smithi049.stdout:9/644: sync 2024-02-22T00:33:56.429 INFO:tasks.workunit.client.0.smithi049.stdout:7/627: sync 2024-02-22T00:33:56.429 INFO:tasks.workunit.client.0.smithi049.stdout:3/449: sync 2024-02-22T00:33:56.435 INFO:tasks.workunit.client.0.smithi049.stdout:3/450: write d0/dd/f6a [724291,2246] 0 2024-02-22T00:33:56.441 INFO:tasks.workunit.client.0.smithi049.stdout:4/540: dwrite d3/d22/f8d [0,4194304] 0 2024-02-22T00:33:56.442 INFO:tasks.workunit.client.0.smithi049.stdout:3/451: read d0/dd/d26/d2e/f51 [316527,106129] 0 2024-02-22T00:33:56.445 INFO:tasks.workunit.client.0.smithi049.stdout:7/628: dwrite d1/df/d62/d48/f8b [0,4194304] 0 2024-02-22T00:33:56.446 INFO:tasks.workunit.client.0.smithi049.stdout:4/541: readlink d3/d8/d20/l61 0 2024-02-22T00:33:56.446 INFO:tasks.workunit.client.0.smithi049.stdout:9/645: dwrite d17/d1c/d25/d39/fb2 [0,4194304] 0 2024-02-22T00:33:56.451 INFO:tasks.workunit.client.0.smithi049.stdout:3/452: creat d0/dd/d1e/f7f x:0 0 0 2024-02-22T00:33:56.453 INFO:tasks.workunit.client.0.smithi049.stdout:7/629: write d1/df/d62/d60/fc7 [5095333,59437] 0 2024-02-22T00:33:56.456 INFO:tasks.workunit.client.0.smithi049.stdout:6/505: sync 2024-02-22T00:33:56.456 INFO:tasks.workunit.client.0.smithi049.stdout:1/615: sync 2024-02-22T00:33:56.456 INFO:tasks.workunit.client.0.smithi049.stdout:0/563: sync 2024-02-22T00:33:56.456 INFO:tasks.workunit.client.0.smithi049.stdout:5/533: sync 2024-02-22T00:33:56.457 INFO:tasks.workunit.client.0.smithi049.stdout:8/620: sync 2024-02-22T00:33:56.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/538: sync 2024-02-22T00:33:56.458 INFO:tasks.workunit.client.0.smithi049.stdout:3/453: mknod d0/dd/d6f/c80 0 2024-02-22T00:33:56.459 INFO:tasks.workunit.client.0.smithi049.stdout:9/646: dwrite d17/d21/d3c/f3d [0,4194304] 0 2024-02-22T00:33:56.459 INFO:tasks.workunit.client.0.smithi049.stdout:7/630: read - d1/df/d62/d1c/d24/f32 zero size 2024-02-22T00:33:56.459 INFO:tasks.workunit.client.0.smithi049.stdout:4/542: link d3/d22/l9c d3/lb1 0 2024-02-22T00:33:56.460 INFO:tasks.workunit.client.0.smithi049.stdout:1/616: stat d2/d8/db/d25 0 2024-02-22T00:33:56.461 INFO:tasks.workunit.client.0.smithi049.stdout:0/564: fsync d3/d6/d8/d36/d81/f89 0 2024-02-22T00:33:56.463 INFO:tasks.workunit.client.0.smithi049.stdout:6/506: chown d3/d16/c61 103 1 2024-02-22T00:33:56.464 INFO:tasks.workunit.client.0.smithi049.stdout:3/454: chown d0/d14/d4d/d4e/d4f/d5b/d76 4329857 1 2024-02-22T00:33:56.464 INFO:tasks.workunit.client.0.smithi049.stdout:2/539: chown d2/d9/de/d15/d1b/f96 15 1 2024-02-22T00:33:56.467 INFO:tasks.workunit.client.0.smithi049.stdout:7/631: creat d1/d41/dae/fdc x:0 0 0 2024-02-22T00:33:56.469 INFO:tasks.workunit.client.0.smithi049.stdout:8/621: read d1/d2/f2e [497534,53615] 0 2024-02-22T00:33:56.470 INFO:tasks.workunit.client.0.smithi049.stdout:0/565: fsync d3/df/d59/f83 0 2024-02-22T00:33:56.471 INFO:tasks.workunit.client.0.smithi049.stdout:3/455: write d0/dd/d26/d2e/d52/f7c [465285,38937] 0 2024-02-22T00:33:56.472 INFO:tasks.workunit.client.0.smithi049.stdout:0/566: dread - d3/d92/fa4 zero size 2024-02-22T00:33:56.473 INFO:tasks.workunit.client.0.smithi049.stdout:1/617: rename d2/d8/d4c to d2/d8/d4c/dd6 22 2024-02-22T00:33:56.474 INFO:tasks.workunit.client.0.smithi049.stdout:6/507: mknod d3/d16/d4a/d4d/d8b/cb4 0 2024-02-22T00:33:56.474 INFO:tasks.workunit.client.0.smithi049.stdout:4/543: mkdir d3/d22/d51/d8a/d48/d89/db2 0 2024-02-22T00:33:56.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/544: stat d3/d33/l4c 0 2024-02-22T00:33:56.476 INFO:tasks.workunit.client.0.smithi049.stdout:1/618: dread - d2/d8/da/d8a/fca zero size 2024-02-22T00:33:56.476 INFO:tasks.workunit.client.0.smithi049.stdout:7/632: creat d1/df/d62/d1c/d1d/d6e/fdd x:0 0 0 2024-02-22T00:33:56.477 INFO:tasks.workunit.client.0.smithi049.stdout:8/622: mkdir d1/d2/da5/d15/d30/d36/d52/daf/dde 0 2024-02-22T00:33:56.479 INFO:tasks.workunit.client.0.smithi049.stdout:5/534: dread d0/d26/d4d/d7c/f96 [0,4194304] 0 2024-02-22T00:33:56.479 INFO:tasks.workunit.client.0.smithi049.stdout:2/540: mknod d2/d9/de/d10/d2e/d42/cc7 0 2024-02-22T00:33:56.481 INFO:tasks.workunit.client.0.smithi049.stdout:7/633: mkdir d1/df/d62/d48/d8e/dde 0 2024-02-22T00:33:56.481 INFO:tasks.workunit.client.0.smithi049.stdout:6/508: chown d3/d36/d70/laa 103597 1 2024-02-22T00:33:56.482 INFO:tasks.workunit.client.0.smithi049.stdout:1/619: write d2/d7b/f85 [1078764,108695] 0 2024-02-22T00:33:56.482 INFO:tasks.workunit.client.0.smithi049.stdout:2/541: fdatasync d2/d9/de/d10/f3d 0 2024-02-22T00:33:56.483 INFO:tasks.workunit.client.0.smithi049.stdout:8/623: rename d1/d2/f27 to d1/d2/db7/fdf 0 2024-02-22T00:33:56.486 INFO:tasks.workunit.client.0.smithi049.stdout:3/456: dread d0/f58 [0,4194304] 0 2024-02-22T00:33:56.488 INFO:tasks.workunit.client.0.smithi049.stdout:6/509: stat d3/d64/d60/c65 0 2024-02-22T00:33:56.489 INFO:tasks.workunit.client.0.smithi049.stdout:7/634: write d1/df/d62/d57/f74 [1308049,83939] 0 2024-02-22T00:33:56.490 INFO:tasks.workunit.client.0.smithi049.stdout:8/624: chown d1/d2/d8c 154275 1 2024-02-22T00:33:56.493 INFO:tasks.workunit.client.0.smithi049.stdout:4/545: dwrite d3/d8/d10/d12/d3f/f9d [0,4194304] 0 2024-02-22T00:33:56.494 INFO:tasks.workunit.client.0.smithi049.stdout:9/647: write d17/d21/f28 [2777847,68103] 0 2024-02-22T00:33:56.496 INFO:tasks.workunit.client.0.smithi049.stdout:2/542: truncate d2/d9/de/d10/d59/fac 226127 0 2024-02-22T00:33:56.496 INFO:tasks.workunit.client.0.smithi049.stdout:3/457: mknod d0/d14/d4d/d4e/d56/c81 0 2024-02-22T00:33:56.498 INFO:tasks.workunit.client.0.smithi049.stdout:9/648: dread - d17/d21/d85/d8d/fd2 zero size 2024-02-22T00:33:56.500 INFO:tasks.workunit.client.0.smithi049.stdout:0/567: write d3/d1e/f61 [248891,16880] 0 2024-02-22T00:33:56.502 INFO:tasks.workunit.client.0.smithi049.stdout:4/546: chown d3/d22/d5c/f5b 1 1 2024-02-22T00:33:56.504 INFO:tasks.workunit.client.0.smithi049.stdout:1/620: write d2/d8/da/f1e [1439570,116957] 0 2024-02-22T00:33:56.507 INFO:tasks.workunit.client.0.smithi049.stdout:0/568: chown d3/d6/d8/f1a 5 1 2024-02-22T00:33:56.510 INFO:tasks.workunit.client.0.smithi049.stdout:7/635: mknod d1/d41/d28/d71/d72/cdf 0 2024-02-22T00:33:56.511 INFO:tasks.workunit.client.0.smithi049.stdout:2/543: mknod d2/d9/de/d15/cc8 0 2024-02-22T00:33:56.513 INFO:tasks.workunit.client.0.smithi049.stdout:4/547: creat d3/d22/d51/fb3 x:0 0 0 2024-02-22T00:33:56.519 INFO:tasks.workunit.client.0.smithi049.stdout:0/569: symlink d3/d6/d8/d36/d81/la6 0 2024-02-22T00:33:56.519 INFO:tasks.workunit.client.0.smithi049.stdout:6/510: dwrite d3/d16/d45/f99 [0,4194304] 0 2024-02-22T00:33:56.521 INFO:tasks.workunit.client.0.smithi049.stdout:8/625: dwrite d1/d2/d5/d1b/f8e [4194304,4194304] 0 2024-02-22T00:33:56.522 INFO:tasks.workunit.client.0.smithi049.stdout:4/548: chown d3/d8/d10/d12/f38 12 1 2024-02-22T00:33:56.531 INFO:tasks.workunit.client.0.smithi049.stdout:3/458: dread d0/d14/f57 [0,4194304] 0 2024-02-22T00:33:56.533 INFO:tasks.workunit.client.0.smithi049.stdout:7/636: rename d1/df/d62/d1c/f85 to d1/d41/fe0 0 2024-02-22T00:33:56.534 INFO:tasks.workunit.client.0.smithi049.stdout:0/570: write d3/df/d7f/f93 [2465451,16245] 0 2024-02-22T00:33:56.535 INFO:tasks.workunit.client.0.smithi049.stdout:6/511: stat d3/d16/d45/l5a 0 2024-02-22T00:33:56.535 INFO:tasks.workunit.client.0.smithi049.stdout:9/649: dread d17/d1c/d25/d71/f7d [0,4194304] 0 2024-02-22T00:33:56.537 INFO:tasks.workunit.client.0.smithi049.stdout:8/626: creat d1/d2/d5/d56/dac/fe0 x:0 0 0 2024-02-22T00:33:56.539 INFO:tasks.workunit.client.0.smithi049.stdout:2/544: link d2/d9/de/d10/d2e/f9e d2/d9/de/d10/d46/d63/fc9 0 2024-02-22T00:33:56.539 INFO:tasks.workunit.client.0.smithi049.stdout:1/621: dwrite d2/d8/db/d25/d40/d41/d68/d78/fc5 [0,4194304] 0 2024-02-22T00:33:56.540 INFO:tasks.workunit.client.0.smithi049.stdout:7/637: symlink d1/d49/le1 0 2024-02-22T00:33:56.540 INFO:tasks.workunit.client.0.smithi049.stdout:5/535: dread d0/d26/d4d/d6f/d94/f12 [0,4194304] 0 2024-02-22T00:33:56.540 INFO:tasks.workunit.client.0.smithi049.stdout:9/650: fsync d17/d1c/fc4 0 2024-02-22T00:33:56.543 INFO:tasks.workunit.client.0.smithi049.stdout:8/627: fdatasync d1/f1e 0 2024-02-22T00:33:56.544 INFO:tasks.workunit.client.0.smithi049.stdout:1/622: write d2/f47 [2304036,6525] 0 2024-02-22T00:33:56.545 INFO:tasks.workunit.client.0.smithi049.stdout:2/545: rmdir d2/d9/dd 39 2024-02-22T00:33:56.545 INFO:tasks.workunit.client.0.smithi049.stdout:5/536: stat d0/d26/d4d/d70/c86 0 2024-02-22T00:33:56.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/549: dread d3/d8/d10/f15 [0,4194304] 0 2024-02-22T00:33:56.547 INFO:tasks.workunit.client.0.smithi049.stdout:2/546: chown d2/d9/de 2850434 1 2024-02-22T00:33:56.551 INFO:tasks.workunit.client.0.smithi049.stdout:3/459: symlink d0/dd/d26/d2e/d52/d6e/l82 0 2024-02-22T00:33:56.551 INFO:tasks.workunit.client.0.smithi049.stdout:2/547: write d2/d9/de/d10/f3d [4386195,899] 0 2024-02-22T00:33:56.552 INFO:tasks.workunit.client.0.smithi049.stdout:9/651: creat d17/d1c/d25/d39/d67/fd4 x:0 0 0 2024-02-22T00:33:56.553 INFO:tasks.workunit.client.0.smithi049.stdout:0/571: creat d3/df/d59/d8e/fa7 x:0 0 0 2024-02-22T00:33:56.555 INFO:tasks.workunit.client.0.smithi049.stdout:1/623: creat d2/d69/fd7 x:0 0 0 2024-02-22T00:33:56.555 INFO:tasks.workunit.client.0.smithi049.stdout:0/572: write d3/d1e/f6a [4195791,21229] 0 2024-02-22T00:33:56.561 INFO:tasks.workunit.client.0.smithi049.stdout:5/537: truncate d0/f63 108330 0 2024-02-22T00:33:56.563 INFO:tasks.workunit.client.0.smithi049.stdout:7/638: creat d1/df/d62/fe2 x:0 0 0 2024-02-22T00:33:56.564 INFO:tasks.workunit.client.0.smithi049.stdout:8/628: mknod d1/d2/da5/d15/d30/d36/d52/daf/dde/ce1 0 2024-02-22T00:33:56.565 INFO:tasks.workunit.client.0.smithi049.stdout:4/550: dwrite d3/d8/f17 [0,4194304] 0 2024-02-22T00:33:56.566 INFO:tasks.workunit.client.0.smithi049.stdout:6/512: link d3/d36/d57/c97 d3/cb5 0 2024-02-22T00:33:56.567 INFO:tasks.workunit.client.0.smithi049.stdout:3/460: mknod d0/d14/d4d/d4e/d4f/d5b/d76/c83 0 2024-02-22T00:33:56.569 INFO:tasks.workunit.client.0.smithi049.stdout:2/548: mknod d2/d9/dd/d4d/d5a/d99/cca 0 2024-02-22T00:33:56.570 INFO:tasks.workunit.client.0.smithi049.stdout:6/513: write d3/d16/d45/f99 [561609,65430] 0 2024-02-22T00:33:56.570 INFO:tasks.workunit.client.0.smithi049.stdout:4/551: chown d3/d22/d51/f59 1866 1 2024-02-22T00:33:56.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/549: chown d2/d9/dd/d4d 8 1 2024-02-22T00:33:56.571 INFO:tasks.workunit.client.0.smithi049.stdout:6/514: stat d3/d64/f35 0 2024-02-22T00:33:56.571 INFO:tasks.workunit.client.0.smithi049.stdout:5/538: chown d0/c3 25 1 2024-02-22T00:33:56.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/629: symlink d1/d2/da5/d15/d30/d4b/d51/le2 0 2024-02-22T00:33:56.580 INFO:tasks.workunit.client.0.smithi049.stdout:4/552: creat d3/d22/d5c/d5e/fb4 x:0 0 0 2024-02-22T00:33:56.581 INFO:tasks.workunit.client.0.smithi049.stdout:2/550: fdatasync d2/d9/de/d10/f19 0 2024-02-22T00:33:56.581 INFO:tasks.workunit.client.0.smithi049.stdout:4/553: chown d3/d22/d51/d8a/d48 13833563 1 2024-02-22T00:33:56.585 INFO:tasks.workunit.client.0.smithi049.stdout:6/515: fsync d3/d16/f1c 0 2024-02-22T00:33:56.586 INFO:tasks.workunit.client.0.smithi049.stdout:5/539: creat d0/d26/d4d/d70/fb4 x:0 0 0 2024-02-22T00:33:56.587 INFO:tasks.workunit.client.0.smithi049.stdout:6/516: readlink d3/d36/d57/d75/l8f 0 2024-02-22T00:33:56.590 INFO:tasks.workunit.client.0.smithi049.stdout:0/573: getdents d3/df/d17 0 2024-02-22T00:33:56.591 INFO:tasks.workunit.client.0.smithi049.stdout:2/551: mknod d2/d9/d17/ccb 0 2024-02-22T00:33:56.592 INFO:tasks.workunit.client.0.smithi049.stdout:0/574: stat d3/d6/d29 0 2024-02-22T00:33:56.592 INFO:tasks.workunit.client.0.smithi049.stdout:9/652: rename d17/d1c/d25/d39/d67/fd4 to d17/fd5 0 2024-02-22T00:33:56.594 INFO:tasks.workunit.client.0.smithi049.stdout:6/517: chown d3/d16/d4a/d4d/f84 91661 1 2024-02-22T00:33:56.595 INFO:tasks.workunit.client.0.smithi049.stdout:5/540: mknod d0/d26/d4d/d70/db1/cb5 0 2024-02-22T00:33:56.596 INFO:tasks.workunit.client.0.smithi049.stdout:4/554: mknod d3/d22/d51/d92/cb5 0 2024-02-22T00:33:56.597 INFO:tasks.workunit.client.0.smithi049.stdout:1/624: truncate d2/f6c 3741354 0 2024-02-22T00:33:56.598 INFO:tasks.workunit.client.0.smithi049.stdout:7/639: rename d1/d41/d28/d71 to d1/d41/d28/d71/d72/de3 22 2024-02-22T00:33:56.598 INFO:tasks.workunit.client.0.smithi049.stdout:6/518: dread - d3/d36/f91 zero size 2024-02-22T00:33:56.599 INFO:tasks.workunit.client.0.smithi049.stdout:8/630: dwrite d1/d2/da5/d15/d33/f48 [4194304,4194304] 0 2024-02-22T00:33:56.600 INFO:tasks.workunit.client.0.smithi049.stdout:0/575: mknod d3/d6/d8/d36/d81/ca8 0 2024-02-22T00:33:56.606 INFO:tasks.workunit.client.0.smithi049.stdout:7/640: dread - d1/d41/dae/fdc zero size 2024-02-22T00:33:56.606 INFO:tasks.workunit.client.0.smithi049.stdout:1/625: write d2/d8/fb8 [329924,20595] 0 2024-02-22T00:33:56.606 INFO:tasks.workunit.client.0.smithi049.stdout:4/555: write d3/d8/d10/d12/f23 [2582218,44959] 0 2024-02-22T00:33:56.609 INFO:tasks.workunit.client.0.smithi049.stdout:7/641: dread - d1/d49/d4d/fd0 zero size 2024-02-22T00:33:56.610 INFO:tasks.workunit.client.0.smithi049.stdout:1/626: chown d2/d69/dc4/fcf 58 1 2024-02-22T00:33:56.610 INFO:tasks.workunit.client.0.smithi049.stdout:2/552: rename d2/d9/de/d15/d4f to d2/d9/de/d10/d2e/d42/d80/dcc 0 2024-02-22T00:33:56.612 INFO:tasks.workunit.client.0.smithi049.stdout:8/631: symlink d1/d2/d5/d56/dac/le3 0 2024-02-22T00:33:56.615 INFO:tasks.workunit.client.0.smithi049.stdout:4/556: mkdir d3/d8/d10/d43/d4d/db6 0 2024-02-22T00:33:56.619 INFO:tasks.workunit.client.0.smithi049.stdout:1/627: creat d2/da0/fd8 x:0 0 0 2024-02-22T00:33:56.620 INFO:tasks.workunit.client.0.smithi049.stdout:8/632: dread d1/d2/d5/d1b/f99 [0,4194304] 0 2024-02-22T00:33:56.620 INFO:tasks.workunit.client.0.smithi049.stdout:7/642: unlink d1/d41/d28/d71/d72/l9e 0 2024-02-22T00:33:56.620 INFO:tasks.workunit.client.0.smithi049.stdout:0/576: dwrite d3/df/d17/d50/d62/f67 [0,4194304] 0 2024-02-22T00:33:56.621 INFO:tasks.workunit.client.0.smithi049.stdout:9/653: link d17/d1c/d25/d71/f7d d17/d1c/d25/d71/d73/fd6 0 2024-02-22T00:33:56.621 INFO:tasks.workunit.client.0.smithi049.stdout:7/643: chown d1/d49/d5a 373518792 1 2024-02-22T00:33:56.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/628: read d2/d8/fb8 [329699,130584] 0 2024-02-22T00:33:56.623 INFO:tasks.workunit.client.0.smithi049.stdout:8/633: stat d1/d2/da5/d15/d30/d36/d53/f96 0 2024-02-22T00:33:56.625 INFO:tasks.workunit.client.0.smithi049.stdout:1/629: fdatasync d2/d8/db/d25/d40/f54 0 2024-02-22T00:33:56.625 INFO:tasks.workunit.client.0.smithi049.stdout:2/553: unlink d2/d9/l38 0 2024-02-22T00:33:56.626 INFO:tasks.workunit.client.0.smithi049.stdout:1/630: chown d2/d8/db/d25/d62/l55 1 1 2024-02-22T00:33:56.627 INFO:tasks.workunit.client.0.smithi049.stdout:4/557: mkdir d3/d22/d51/d92/db7 0 2024-02-22T00:33:56.628 INFO:tasks.workunit.client.0.smithi049.stdout:2/554: write d2/d9/de/d3a/d6d/faa [916333,89236] 0 2024-02-22T00:33:56.631 INFO:tasks.workunit.client.0.smithi049.stdout:2/555: chown d2/f6 2708355 1 2024-02-22T00:33:56.631 INFO:tasks.workunit.client.0.smithi049.stdout:6/519: dwrite d3/d16/f1c [0,4194304] 0 2024-02-22T00:33:56.633 INFO:tasks.workunit.client.0.smithi049.stdout:6/520: chown d3/d37/fa5 369061179 1 2024-02-22T00:33:56.634 INFO:tasks.workunit.client.0.smithi049.stdout:7/644: stat d1/df/d62/d1c/f2a 0 2024-02-22T00:33:56.635 INFO:tasks.workunit.client.0.smithi049.stdout:2/556: chown d2/d9/de/d10/d2e/d42/d80/dcc/l6b 2882 1 2024-02-22T00:33:56.638 INFO:tasks.workunit.client.0.smithi049.stdout:1/631: creat d2/d8/db/d25/d40/d41/d5b/fd9 x:0 0 0 2024-02-22T00:33:56.640 INFO:tasks.workunit.client.0.smithi049.stdout:4/558: rename d3/f32 to d3/d33/fb8 0 2024-02-22T00:33:56.643 INFO:tasks.workunit.client.0.smithi049.stdout:8/634: symlink d1/d4c/dda/le4 0 2024-02-22T00:33:56.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/559: write d3/d22/f8d [2070496,118882] 0 2024-02-22T00:33:56.644 INFO:tasks.workunit.client.0.smithi049.stdout:6/521: creat d3/d36/d57/d75/fb6 x:0 0 0 2024-02-22T00:33:56.646 INFO:tasks.workunit.client.0.smithi049.stdout:7/645: mknod d1/df/d62/d1c/d6d/ce4 0 2024-02-22T00:33:56.648 INFO:tasks.workunit.client.0.smithi049.stdout:8/635: write d1/d4c/f4f [4722913,37004] 0 2024-02-22T00:33:56.649 INFO:tasks.workunit.client.0.smithi049.stdout:6/522: dread - d3/d36/f91 zero size 2024-02-22T00:33:56.650 INFO:tasks.workunit.client.0.smithi049.stdout:2/557: creat d2/d9/de/d10/d46/d7f/fcd x:0 0 0 2024-02-22T00:33:56.651 INFO:tasks.workunit.client.0.smithi049.stdout:9/654: getdents d17/d1c/d25/d39 0 2024-02-22T00:33:56.653 INFO:tasks.workunit.client.0.smithi049.stdout:1/632: dwrite d2/fd1 [4194304,4194304] 0 2024-02-22T00:33:56.653 INFO:tasks.workunit.client.0.smithi049.stdout:4/560: getdents d3/d22/d49 0 2024-02-22T00:33:56.657 INFO:tasks.workunit.client.0.smithi049.stdout:2/558: symlink d2/d9/d17/lce 0 2024-02-22T00:33:56.660 INFO:tasks.workunit.client.0.smithi049.stdout:7/646: creat d1/d41/d28/d71/d72/fe5 x:0 0 0 2024-02-22T00:33:56.662 INFO:tasks.workunit.client.0.smithi049.stdout:9/655: rename d17/d21/d47/d5d/f9f to d17/d1c/d77/fd7 0 2024-02-22T00:33:56.665 INFO:tasks.workunit.client.0.smithi049.stdout:0/577: write d3/f49 [1335548,34764] 0 2024-02-22T00:33:56.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/656: chown d17/d21/f28 4193 1 2024-02-22T00:33:56.667 INFO:tasks.workunit.client.0.smithi049.stdout:7/647: readlink d1/df/d62/d1c/d24/d2e/l31 0 2024-02-22T00:33:56.667 INFO:tasks.workunit.client.0.smithi049.stdout:2/559: symlink d2/d9/de/d3a/d6d/da6/lcf 0 2024-02-22T00:33:56.670 INFO:tasks.workunit.client.0.smithi049.stdout:0/578: chown d3/d6/d8/d36/d81 11823105 1 2024-02-22T00:33:56.673 INFO:tasks.workunit.client.0.smithi049.stdout:6/523: dwrite d3/f1d [0,4194304] 0 2024-02-22T00:33:56.673 INFO:tasks.workunit.client.0.smithi049.stdout:7/648: stat d1/d41/d28/d71/d72/l81 0 2024-02-22T00:33:56.676 INFO:tasks.workunit.client.0.smithi049.stdout:4/561: truncate d3/d33/f67 3721679 0 2024-02-22T00:33:56.676 INFO:tasks.workunit.client.0.smithi049.stdout:8/636: dread d1/d2/da5/d15/d30/d36/d53/f47 [0,4194304] 0 2024-02-22T00:33:56.676 INFO:tasks.workunit.client.0.smithi049.stdout:1/633: dread d2/d8/da/f1e [0,4194304] 0 2024-02-22T00:33:56.677 INFO:tasks.workunit.client.0.smithi049.stdout:9/657: symlink d17/d1c/d25/d71/da3/ld8 0 2024-02-22T00:33:56.678 INFO:tasks.workunit.client.0.smithi049.stdout:7/649: write d1/d41/d28/f79 [1816104,23788] 0 2024-02-22T00:33:56.682 INFO:tasks.workunit.client.0.smithi049.stdout:8/637: dread - d1/d2/da5/d15/d33/fba zero size 2024-02-22T00:33:56.686 INFO:tasks.workunit.client.0.smithi049.stdout:7/650: mkdir d1/df/d62/d60/d7e/de6 0 2024-02-22T00:33:56.689 INFO:tasks.workunit.client.0.smithi049.stdout:4/562: rename d3/d22/d51 to d3/d8/d10/d43/d4d/db9 0 2024-02-22T00:33:56.692 INFO:tasks.workunit.client.0.smithi049.stdout:0/579: link d3/d6/d8/d36/d81/f89 d3/fa9 0 2024-02-22T00:33:56.693 INFO:tasks.workunit.client.0.smithi049.stdout:6/524: dwrite d3/d16/f24 [0,4194304] 0 2024-02-22T00:33:56.693 INFO:tasks.workunit.client.0.smithi049.stdout:8/638: mkdir d1/d2/da5/d15/d65/d6a/de5 0 2024-02-22T00:33:56.695 INFO:tasks.workunit.client.0.smithi049.stdout:1/634: dwrite d2/d8/db/f12 [4194304,4194304] 0 2024-02-22T00:33:56.700 INFO:tasks.workunit.client.0.smithi049.stdout:2/560: dwrite d2/d9/de/d10/d2e/d42/d80/dcc/f65 [0,4194304] 0 2024-02-22T00:33:56.700 INFO:tasks.workunit.client.0.smithi049.stdout:0/580: creat d3/df/d48/d54/faa x:0 0 0 2024-02-22T00:33:56.702 INFO:tasks.workunit.client.0.smithi049.stdout:1/635: mkdir d2/d8/db/d25/dda 0 2024-02-22T00:33:56.703 INFO:tasks.workunit.client.0.smithi049.stdout:0/581: fdatasync d3/d1e/f61 0 2024-02-22T00:33:56.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/582: fdatasync d3/d6/f7b 0 2024-02-22T00:33:56.705 INFO:tasks.workunit.client.0.smithi049.stdout:1/636: read - d2/d8/db/d25/d40/d41/f83 zero size 2024-02-22T00:33:56.712 INFO:tasks.workunit.client.0.smithi049.stdout:4/563: rename d3/d8/d10/f11 to d3/d8/d10/d43/d4d/db9/d8a/d48/fba 0 2024-02-22T00:33:56.712 INFO:tasks.workunit.client.0.smithi049.stdout:8/639: dread d1/d2/d5/d1b/d39/d81/f91 [0,4194304] 0 2024-02-22T00:33:56.712 INFO:tasks.workunit.client.0.smithi049.stdout:8/640: write d1/d2/da5/d15/d30/d4b/f7d [937802,125754] 0 2024-02-22T00:33:56.715 INFO:tasks.workunit.client.0.smithi049.stdout:2/561: symlink d2/d9/de/d3a/d6d/ld0 0 2024-02-22T00:33:56.717 INFO:tasks.workunit.client.0.smithi049.stdout:0/583: symlink d3/d6/d8/d36/lab 0 2024-02-22T00:33:56.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/637: unlink d2/d8/db/d25/d40/c77 0 2024-02-22T00:33:56.719 INFO:tasks.workunit.client.0.smithi049.stdout:7/651: write d1/df/d62/d1c/d24/d2e/f42 [1141876,25665] 0 2024-02-22T00:33:56.721 INFO:tasks.workunit.client.0.smithi049.stdout:6/525: write d3/f14 [287856,27362] 0 2024-02-22T00:33:56.726 INFO:tasks.workunit.client.0.smithi049.stdout:1/638: rmdir d2/d66 39 2024-02-22T00:33:56.727 INFO:tasks.workunit.client.0.smithi049.stdout:6/526: chown d3/d16/f39 0 1 2024-02-22T00:33:56.731 INFO:tasks.workunit.client.0.smithi049.stdout:0/584: write d3/d6/d29/f3f [1062166,2071] 0 2024-02-22T00:33:56.732 INFO:tasks.workunit.client.0.smithi049.stdout:8/641: dread d1/d2/da5/d15/f23 [0,4194304] 0 2024-02-22T00:33:56.733 INFO:tasks.workunit.client.0.smithi049.stdout:4/564: dread d3/d33/f62 [0,4194304] 0 2024-02-22T00:33:56.734 INFO:tasks.workunit.client.0.smithi049.stdout:7/652: dwrite d1/d49/d4d/f68 [0,4194304] 0 2024-02-22T00:33:56.735 INFO:tasks.workunit.client.0.smithi049.stdout:2/562: dwrite d2/d9/de/d3a/d6d/f8a [0,4194304] 0 2024-02-22T00:33:56.735 INFO:tasks.workunit.client.0.smithi049.stdout:6/527: fdatasync d3/f18 0 2024-02-22T00:33:56.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/642: fdatasync d1/d2/da5/d1c/fd5 0 2024-02-22T00:33:56.740 INFO:tasks.workunit.client.0.smithi049.stdout:2/563: fsync d2/d9/de/d10/f12 0 2024-02-22T00:33:56.748 INFO:tasks.workunit.client.0.smithi049.stdout:7/653: rename d1/d49/cb6 to d1/df/ce7 0 2024-02-22T00:33:56.749 INFO:tasks.workunit.client.0.smithi049.stdout:8/643: dread d1/d2/da5/d15/f23 [0,4194304] 0 2024-02-22T00:33:56.749 INFO:tasks.workunit.client.0.smithi049.stdout:0/585: dread d3/d6/d8/f6e [0,4194304] 0 2024-02-22T00:33:56.751 INFO:tasks.workunit.client.0.smithi049.stdout:1/639: dread d2/d8/db/d25/d40/d41/d68/fc1 [0,4194304] 0 2024-02-22T00:33:56.752 INFO:tasks.workunit.client.0.smithi049.stdout:4/565: truncate d3/d8/d10/d43/d4d/db9/f98 945198 0 2024-02-22T00:33:56.758 INFO:tasks.workunit.client.0.smithi049.stdout:7/654: mkdir d1/df/d62/d60/d7e/de6/de8 0 2024-02-22T00:33:56.759 INFO:tasks.workunit.client.0.smithi049.stdout:0/586: creat d3/d1e/fac x:0 0 0 2024-02-22T00:33:56.760 INFO:tasks.workunit.client.0.smithi049.stdout:4/566: symlink d3/d8/lbb 0 2024-02-22T00:33:56.763 INFO:tasks.workunit.client.0.smithi049.stdout:6/528: dwrite d3/f62 [0,4194304] 0 2024-02-22T00:33:56.763 INFO:tasks.workunit.client.0.smithi049.stdout:8/644: creat d1/d2/da5/d15/d30/d36/d52/daf/dcb/fe6 x:0 0 0 2024-02-22T00:33:56.767 INFO:tasks.workunit.client.0.smithi049.stdout:2/564: dwrite d2/d9/de/d10/d46/d63/f6c [0,4194304] 0 2024-02-22T00:33:56.773 INFO:tasks.workunit.client.0.smithi049.stdout:6/529: stat d3/d16/d4a/d4d/la2 0 2024-02-22T00:33:56.774 INFO:tasks.workunit.client.0.smithi049.stdout:4/567: fsync d3/d22/d5c/f36 0 2024-02-22T00:33:56.774 INFO:tasks.workunit.client.0.smithi049.stdout:6/530: write d3/f10 [1808779,115754] 0 2024-02-22T00:33:56.780 INFO:tasks.workunit.client.0.smithi049.stdout:2/565: rmdir d2/d9/de 39 2024-02-22T00:33:56.782 INFO:tasks.workunit.client.0.smithi049.stdout:0/587: truncate d3/df/d48/d6f/d90/f31 286152 0 2024-02-22T00:33:56.788 INFO:tasks.workunit.client.0.smithi049.stdout:7/655: dwrite d1/df/d62/d1c/d24/d2e/fa6 [4194304,4194304] 0 2024-02-22T00:33:56.788 INFO:tasks.workunit.client.0.smithi049.stdout:0/588: symlink d3/df/d48/lad 0 2024-02-22T00:33:56.792 INFO:tasks.workunit.client.0.smithi049.stdout:6/531: dread d3/d16/d45/f99 [0,4194304] 0 2024-02-22T00:33:56.794 INFO:tasks.workunit.client.0.smithi049.stdout:4/568: dwrite d3/d8/d10/d39/f87 [0,4194304] 0 2024-02-22T00:33:56.797 INFO:tasks.workunit.client.0.smithi049.stdout:0/589: write d3/d1e/d58/f8f [585974,99213] 0 2024-02-22T00:33:56.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/566: creat d2/d9/de/d3a/dc3/fd1 x:0 0 0 2024-02-22T00:33:56.801 INFO:tasks.workunit.client.0.smithi049.stdout:8/645: dwrite d1/d2/da5/d15/d30/d36/d53/f47 [0,4194304] 0 2024-02-22T00:33:56.801 INFO:tasks.workunit.client.0.smithi049.stdout:7/656: link d1/fe d1/df/fe9 0 2024-02-22T00:33:56.803 INFO:tasks.workunit.client.0.smithi049.stdout:6/532: mknod d3/d16/d3b/d8c/cb7 0 2024-02-22T00:33:56.804 INFO:tasks.workunit.client.0.smithi049.stdout:8/646: fsync d1/d2/da5/d15/d30/d36/d52/fce 0 2024-02-22T00:33:56.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/569: mknod d3/d22/d5c/da5/cbc 0 2024-02-22T00:33:56.806 INFO:tasks.workunit.client.0.smithi049.stdout:0/590: mknod d3/df/d17/d50/d62/cae 0 2024-02-22T00:33:56.808 INFO:tasks.workunit.client.0.smithi049.stdout:6/533: symlink d3/d64/d60/da0/lb8 0 2024-02-22T00:33:56.808 INFO:tasks.workunit.client.0.smithi049.stdout:7/657: creat d1/d41/d55/fea x:0 0 0 2024-02-22T00:33:56.808 INFO:tasks.workunit.client.0.smithi049.stdout:2/567: mkdir d2/d9/dd/d4d/da7/dd2 0 2024-02-22T00:33:56.812 INFO:tasks.workunit.client.0.smithi049.stdout:8/647: unlink d1/d2/da5/d15/d30/d36/d53/c3d 0 2024-02-22T00:33:56.813 INFO:tasks.workunit.client.0.smithi049.stdout:2/568: dread - d2/d9/de/d10/d2e/d42/d80/f9c zero size 2024-02-22T00:33:56.814 INFO:tasks.workunit.client.0.smithi049.stdout:4/570: write d3/d8/d10/d43/d4d/db9/d8a/d48/fba [3064194,76468] 0 2024-02-22T00:33:56.816 INFO:tasks.workunit.client.0.smithi049.stdout:8/648: chown d1/d2/d5/c6b 7 1 2024-02-22T00:33:56.821 INFO:tasks.workunit.client.0.smithi049.stdout:6/534: dread d3/d64/d59/d72/d92/d6c/f9f [0,4194304] 0 2024-02-22T00:33:56.821 INFO:tasks.workunit.client.0.smithi049.stdout:7/658: symlink d1/df/d62/d48/d8e/dde/leb 0 2024-02-22T00:33:56.821 INFO:tasks.workunit.client.0.smithi049.stdout:0/591: dwrite d3/df/d17/d50/f7e [0,4194304] 0 2024-02-22T00:33:56.821 INFO:tasks.workunit.client.0.smithi049.stdout:4/571: mknod d3/d8/d20/cbd 0 2024-02-22T00:33:56.823 INFO:tasks.workunit.client.0.smithi049.stdout:7/659: chown d1/d41/d28/d71/d72/d95 1956918120 1 2024-02-22T00:33:56.825 INFO:tasks.workunit.client.0.smithi049.stdout:8/649: creat d1/d2/dd7/fe7 x:0 0 0 2024-02-22T00:33:56.825 INFO:tasks.workunit.client.0.smithi049.stdout:0/592: write d3/d1e/fac [780393,63736] 0 2024-02-22T00:33:56.830 INFO:tasks.workunit.client.0.smithi049.stdout:4/572: creat d3/d22/d3d/fbe x:0 0 0 2024-02-22T00:33:56.830 INFO:tasks.workunit.client.0.smithi049.stdout:0/593: truncate d3/f49 2061890 0 2024-02-22T00:33:56.831 INFO:tasks.workunit.client.0.smithi049.stdout:6/535: rename d3/d16/l3f to d3/d16/d3b/lb9 0 2024-02-22T00:33:56.834 INFO:tasks.workunit.client.0.smithi049.stdout:8/650: read d1/d2/d5/d56/fa4 [98733,95320] 0 2024-02-22T00:33:56.834 INFO:tasks.workunit.client.0.smithi049.stdout:6/536: mknod d3/d16/d4a/cba 0 2024-02-22T00:33:56.846 INFO:tasks.workunit.client.0.smithi049.stdout:6/537: rename d3/d16/f53 to d3/d16/d4a/d4d/fbb 0 2024-02-22T00:33:56.847 INFO:tasks.workunit.client.0.smithi049.stdout:7/660: getdents d1/df/d62/d60 0 2024-02-22T00:33:56.854 INFO:tasks.workunit.client.0.smithi049.stdout:8/651: dread d1/d2/f38 [0,4194304] 0 2024-02-22T00:33:56.856 INFO:tasks.workunit.client.0.smithi049.stdout:6/538: readlink d3/d16/d3b/lb9 0 2024-02-22T00:33:56.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/573: truncate d3/d22/f50 4165130 0 2024-02-22T00:33:56.857 INFO:tasks.workunit.client.0.smithi049.stdout:7/661: creat d1/fec x:0 0 0 2024-02-22T00:33:56.858 INFO:tasks.workunit.client.0.smithi049.stdout:6/539: read d3/f10 [746303,76041] 0 2024-02-22T00:33:56.860 INFO:tasks.workunit.client.0.smithi049.stdout:2/569: dwrite d2/d9/d17/fb1 [0,4194304] 0 2024-02-22T00:33:56.860 INFO:tasks.workunit.client.0.smithi049.stdout:8/652: write d1/d2/da5/d15/f10 [3795626,21490] 0 2024-02-22T00:33:56.864 INFO:tasks.workunit.client.0.smithi049.stdout:6/540: unlink d3/d16/d3b/d8c/cb7 0 2024-02-22T00:33:56.866 INFO:tasks.workunit.client.0.smithi049.stdout:2/570: stat d2/d9/de/d10/d2e/d42/d80/l8d 0 2024-02-22T00:33:56.867 INFO:tasks.workunit.client.0.smithi049.stdout:6/541: write d3/d64/f35 [1558725,104236] 0 2024-02-22T00:33:56.868 INFO:tasks.workunit.client.0.smithi049.stdout:7/662: mkdir d1/df/d62/d60/d7e/de6/ded 0 2024-02-22T00:33:56.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/574: getdents d3 0 2024-02-22T00:33:56.873 INFO:tasks.workunit.client.0.smithi049.stdout:8/653: read d1/d2/d5/d56/fa4 [54723,46307] 0 2024-02-22T00:33:56.874 INFO:tasks.workunit.client.0.smithi049.stdout:6/542: creat d3/d36/fbc x:0 0 0 2024-02-22T00:33:56.881 INFO:tasks.workunit.client.0.smithi049.stdout:6/543: creat d3/d64/d59/d72/d92/fbd x:0 0 0 2024-02-22T00:33:56.891 INFO:tasks.workunit.client.0.smithi049.stdout:6/544: fdatasync d3/d16/d4a/f55 0 2024-02-22T00:33:56.891 INFO:tasks.workunit.client.0.smithi049.stdout:4/575: dwrite d3/f2f [0,4194304] 0 2024-02-22T00:33:56.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/576: mknod d3/d22/d49/cbf 0 2024-02-22T00:33:56.906 INFO:tasks.workunit.client.0.smithi049.stdout:7/663: write d1/df/fe9 [3070217,69053] 0 2024-02-22T00:33:56.911 INFO:tasks.workunit.client.0.smithi049.stdout:7/664: write d1/df/fe9 [3544192,115568] 0 2024-02-22T00:33:56.918 INFO:tasks.workunit.client.0.smithi049.stdout:6/545: dwrite d3/f1a [0,4194304] 0 2024-02-22T00:33:56.918 INFO:tasks.workunit.client.0.smithi049.stdout:2/571: dwrite d2/d9/dd/d4d/d5a/d99/fa8 [0,4194304] 0 2024-02-22T00:33:56.919 INFO:tasks.workunit.client.0.smithi049.stdout:4/577: write d3/d8/d10/d39/f9f [1173581,43906] 0 2024-02-22T00:33:56.923 INFO:tasks.workunit.client.0.smithi049.stdout:4/578: chown d3/d8/d20/c2b 32907 1 2024-02-22T00:33:56.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/654: dwrite d1/d2/da5/d15/d30/d36/d52/daf/fd8 [0,4194304] 0 2024-02-22T00:33:56.926 INFO:tasks.workunit.client.0.smithi049.stdout:6/546: mknod d3/d37/cbe 0 2024-02-22T00:33:56.930 INFO:tasks.workunit.client.0.smithi049.stdout:2/572: fsync d2/d9/de/d10/f31 0 2024-02-22T00:33:56.932 INFO:tasks.workunit.client.0.smithi049.stdout:2/573: fdatasync d2/f95 0 2024-02-22T00:33:56.943 INFO:tasks.workunit.client.0.smithi049.stdout:8/655: mknod d1/d2/da5/d15/d30/d36/d52/daf/dcb/ce8 0 2024-02-22T00:33:56.945 INFO:tasks.workunit.client.0.smithi049.stdout:4/579: dwrite d3/d8/d10/d43/d4d/f5f [0,4194304] 0 2024-02-22T00:33:56.948 INFO:tasks.workunit.client.0.smithi049.stdout:2/574: chown d2/d9/de/d15/cbe 110952515 1 2024-02-22T00:33:56.950 INFO:tasks.workunit.client.0.smithi049.stdout:8/656: chown d1/d2/da5/d15/d30/d36/d53/f5f 852902646 1 2024-02-22T00:33:56.952 INFO:tasks.workunit.client.0.smithi049.stdout:2/575: unlink d2/d9/de/d10/d2e/d42/f77 0 2024-02-22T00:33:56.955 INFO:tasks.workunit.client.0.smithi049.stdout:4/580: mknod d3/d8/d10/cc0 0 2024-02-22T00:33:56.961 INFO:tasks.workunit.client.0.smithi049.stdout:6/547: dwrite d3/d64/d59/f66 [0,4194304] 0 2024-02-22T00:33:56.966 INFO:tasks.workunit.client.0.smithi049.stdout:4/581: symlink d3/d22/d5c/da5/lc1 0 2024-02-22T00:33:56.969 INFO:tasks.workunit.client.0.smithi049.stdout:6/548: creat d3/d36/d57/d75/fbf x:0 0 0 2024-02-22T00:33:56.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/582: truncate d3/d8/d10/d12/d3f/fa9 496575 0 2024-02-22T00:33:56.973 INFO:tasks.workunit.client.0.smithi049.stdout:8/657: dwrite d1/fe [4194304,4194304] 0 2024-02-22T00:33:56.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/549: symlink d3/d16/d3b/lc0 0 2024-02-22T00:33:56.982 INFO:tasks.workunit.client.0.smithi049.stdout:7/665: dread d1/d41/d28/f39 [4194304,4194304] 0 2024-02-22T00:33:56.984 INFO:tasks.workunit.client.0.smithi049.stdout:6/550: write d3/f10 [1434908,75222] 0 2024-02-22T00:33:56.984 INFO:tasks.workunit.client.0.smithi049.stdout:2/576: dwrite d2/f6 [0,4194304] 0 2024-02-22T00:33:56.987 INFO:tasks.workunit.client.0.smithi049.stdout:6/551: read - d3/d16/d45/f7a zero size 2024-02-22T00:33:56.989 INFO:tasks.workunit.client.0.smithi049.stdout:6/552: chown d3/d64/d59/d72/d92/db1 56041 1 2024-02-22T00:33:56.992 INFO:tasks.workunit.client.0.smithi049.stdout:4/583: dread d3/d33/f46 [4194304,4194304] 0 2024-02-22T00:33:56.993 INFO:tasks.workunit.client.0.smithi049.stdout:2/577: symlink d2/d9/de/d15/d1b/dc4/ld3 0 2024-02-22T00:33:56.995 INFO:tasks.workunit.client.0.smithi049.stdout:7/666: link d1/df/d62/d1c/d1d/d6e/l9c d1/d49/d5a/lee 0 2024-02-22T00:33:57.003 INFO:tasks.workunit.client.0.smithi049.stdout:6/553: dwrite d3/f20 [0,4194304] 0 2024-02-22T00:33:57.003 INFO:tasks.workunit.client.0.smithi049.stdout:7/667: write d1/d41/d55/d89/fc6 [411161,114101] 0 2024-02-22T00:33:57.004 INFO:tasks.workunit.client.0.smithi049.stdout:4/584: dread d3/d22/f52 [0,4194304] 0 2024-02-22T00:33:57.005 INFO:tasks.workunit.client.0.smithi049.stdout:6/554: chown d3/d36/f91 814361 1 2024-02-22T00:33:57.008 INFO:tasks.workunit.client.0.smithi049.stdout:4/585: fdatasync d3/d8/d10/d45/f55 0 2024-02-22T00:33:57.009 INFO:tasks.workunit.client.0.smithi049.stdout:8/658: dread d1/d2/f2e [0,4194304] 0 2024-02-22T00:33:57.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/578: dread d2/d9/de/d10/d46/d63/f7e [0,4194304] 0 2024-02-22T00:33:57.013 INFO:tasks.workunit.client.0.smithi049.stdout:2/579: fdatasync d2/d9/de/d10/d46/fb6 0 2024-02-22T00:33:57.013 INFO:tasks.workunit.client.0.smithi049.stdout:6/555: creat d3/d64/d60/fc1 x:0 0 0 2024-02-22T00:33:57.017 INFO:tasks.workunit.client.0.smithi049.stdout:2/580: creat d2/fd4 x:0 0 0 2024-02-22T00:33:57.019 INFO:tasks.workunit.client.0.smithi049.stdout:6/556: dread d3/d64/d59/d72/d92/d6c/f9f [0,4194304] 0 2024-02-22T00:33:57.020 INFO:tasks.workunit.client.0.smithi049.stdout:8/659: link d1/d2/da5/d15/d33/c94 d1/d2/d5/ce9 0 2024-02-22T00:33:57.021 INFO:tasks.workunit.client.0.smithi049.stdout:4/586: dwrite d3/d8/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:57.024 INFO:tasks.workunit.client.0.smithi049.stdout:8/660: write d1/d2/da5/d15/d33/fbc [845605,125694] 0 2024-02-22T00:33:57.024 INFO:tasks.workunit.client.0.smithi049.stdout:6/557: truncate d3/d36/d70/f94 11301 0 2024-02-22T00:33:57.026 INFO:tasks.workunit.client.0.smithi049.stdout:4/587: mknod d3/d33/cc2 0 2024-02-22T00:33:57.028 INFO:tasks.workunit.client.0.smithi049.stdout:6/558: read d3/f14 [595803,80959] 0 2024-02-22T00:33:57.032 INFO:tasks.workunit.client.0.smithi049.stdout:6/559: rmdir d3/d36/d70 39 2024-02-22T00:33:57.033 INFO:tasks.workunit.client.0.smithi049.stdout:2/581: dread d2/d9/de/f26 [0,4194304] 0 2024-02-22T00:33:57.034 INFO:tasks.workunit.client.0.smithi049.stdout:8/661: truncate d1/d2/da5/d15/d30/f71 1194983 0 2024-02-22T00:33:57.035 INFO:tasks.workunit.client.0.smithi049.stdout:2/582: symlink d2/d9/dd/d74/ld5 0 2024-02-22T00:33:57.036 INFO:tasks.workunit.client.0.smithi049.stdout:8/662: write d1/d2/da5/f19 [2115537,73135] 0 2024-02-22T00:33:57.036 INFO:tasks.workunit.client.0.smithi049.stdout:4/588: rmdir d3/d8/d10/d43/d4d/db6 0 2024-02-22T00:33:57.037 INFO:tasks.workunit.client.0.smithi049.stdout:4/589: chown d3/d8/d10/d43 0 1 2024-02-22T00:33:57.038 INFO:tasks.workunit.client.0.smithi049.stdout:2/583: mkdir d2/d9/d17/dd6 0 2024-02-22T00:33:57.040 INFO:tasks.workunit.client.0.smithi049.stdout:8/663: creat d1/dd1/fea x:0 0 0 2024-02-22T00:33:57.040 INFO:tasks.workunit.client.0.smithi049.stdout:4/590: fdatasync d3/d22/d5c/d35/f58 0 2024-02-22T00:33:57.042 INFO:tasks.workunit.client.0.smithi049.stdout:2/584: creat d2/d9/de/d10/d2e/fd7 x:0 0 0 2024-02-22T00:33:57.042 INFO:tasks.workunit.client.0.smithi049.stdout:8/664: write d1/d4c/fc8 [313494,78913] 0 2024-02-22T00:33:57.043 INFO:tasks.workunit.client.0.smithi049.stdout:3/461: sync 2024-02-22T00:33:57.045 INFO:tasks.workunit.client.0.smithi049.stdout:3/462: dread - d0/d14/d4d/d4e/d4f/d5b/d66/f70 zero size 2024-02-22T00:33:57.046 INFO:tasks.workunit.client.0.smithi049.stdout:4/591: chown d3/d8/d10/d39/c2e 834 1 2024-02-22T00:33:57.047 INFO:tasks.workunit.client.0.smithi049.stdout:2/585: mknod d2/d9/de/d3a/d6d/cd8 0 2024-02-22T00:33:57.050 INFO:tasks.workunit.client.0.smithi049.stdout:8/665: rename d1/d2/da5/d15/d30/d36/d53 to d1/d2/da5/deb 0 2024-02-22T00:33:57.052 INFO:tasks.workunit.client.0.smithi049.stdout:3/463: creat d0/dd/d26/d2e/f84 x:0 0 0 2024-02-22T00:33:57.058 INFO:tasks.workunit.client.0.smithi049.stdout:4/592: getdents d3/d8/d10/d43/d4d/db9/d92 0 2024-02-22T00:33:57.060 INFO:tasks.workunit.client.0.smithi049.stdout:6/560: write d3/d16/d4a/d4d/fbb [5877900,3712] 0 2024-02-22T00:33:57.061 INFO:tasks.workunit.client.0.smithi049.stdout:6/561: fdatasync d3/d36/d57/d75/fb6 0 2024-02-22T00:33:57.063 INFO:tasks.workunit.client.0.smithi049.stdout:6/562: fdatasync d3/fa1 0 2024-02-22T00:33:57.064 INFO:tasks.workunit.client.0.smithi049.stdout:3/464: dread d0/d59/f42 [0,4194304] 0 2024-02-22T00:33:57.066 INFO:tasks.workunit.client.0.smithi049.stdout:6/563: mkdir d3/d64/d60/dc2 0 2024-02-22T00:33:57.067 INFO:tasks.workunit.client.0.smithi049.stdout:4/593: truncate d3/d33/f62 501155 0 2024-02-22T00:33:57.071 INFO:tasks.workunit.client.0.smithi049.stdout:6/564: rename d3/d36/l90 to d3/d16/d32/d7b/lc3 0 2024-02-22T00:33:57.073 INFO:tasks.workunit.client.0.smithi049.stdout:3/465: dwrite d0/d14/d4d/f71 [0,4194304] 0 2024-02-22T00:33:57.075 INFO:tasks.workunit.client.0.smithi049.stdout:6/565: write d3/d16/f4f [3848675,107204] 0 2024-02-22T00:33:57.077 INFO:tasks.workunit.client.0.smithi049.stdout:3/466: write d0/d14/f1b [1935661,23244] 0 2024-02-22T00:33:57.080 INFO:tasks.workunit.client.0.smithi049.stdout:4/594: dwrite d3/d22/d5c/f36 [0,4194304] 0 2024-02-22T00:33:57.081 INFO:tasks.workunit.client.0.smithi049.stdout:3/467: write d0/dd/d1e/f6c [900851,107409] 0 2024-02-22T00:33:57.082 INFO:tasks.workunit.client.0.smithi049.stdout:6/566: rename d3/d16/c3a to d3/d16/d32/cc4 0 2024-02-22T00:33:57.084 INFO:tasks.workunit.client.0.smithi049.stdout:4/595: fsync d3/d8/d10/d39/fab 0 2024-02-22T00:33:57.086 INFO:tasks.workunit.client.0.smithi049.stdout:4/596: truncate d3/d8/d10/d39/f87 4580599 0 2024-02-22T00:33:57.088 INFO:tasks.workunit.client.0.smithi049.stdout:3/468: rename d0/dd/d26/d2e/f72 to d0/d59/f85 0 2024-02-22T00:33:57.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/567: mknod d3/d64/d59/d72/cc5 0 2024-02-22T00:33:57.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/469: dread d0/dd/f6a [0,4194304] 0 2024-02-22T00:33:57.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/568: rename d3/f11 to d3/d16/d45/fc6 0 2024-02-22T00:33:57.093 INFO:tasks.workunit.client.0.smithi049.stdout:4/597: creat d3/d22/fc3 x:0 0 0 2024-02-22T00:33:57.093 INFO:tasks.workunit.client.0.smithi049.stdout:6/569: write d3/d36/f4e [1706178,22621] 0 2024-02-22T00:33:57.094 INFO:tasks.workunit.client.0.smithi049.stdout:3/470: write d0/dd/d26/d2e/d52/f7c [184946,65912] 0 2024-02-22T00:33:57.095 INFO:tasks.workunit.client.0.smithi049.stdout:4/598: write d3/d22/d5c/d9a/fa3 [2341521,95621] 0 2024-02-22T00:33:57.096 INFO:tasks.workunit.client.0.smithi049.stdout:3/471: write d0/d59/f6d [190173,38255] 0 2024-02-22T00:33:57.099 INFO:tasks.workunit.client.0.smithi049.stdout:4/599: mkdir d3/d8/d10/dc4 0 2024-02-22T00:33:57.101 INFO:tasks.workunit.client.0.smithi049.stdout:3/472: dread d0/d14/f5c [0,4194304] 0 2024-02-22T00:33:57.101 INFO:tasks.workunit.client.0.smithi049.stdout:4/600: rmdir d3/d8/d10/d45 39 2024-02-22T00:33:57.103 INFO:tasks.workunit.client.0.smithi049.stdout:3/473: dread d0/d14/f57 [0,4194304] 0 2024-02-22T00:33:57.103 INFO:tasks.workunit.client.0.smithi049.stdout:4/601: mknod d3/d33/cc5 0 2024-02-22T00:33:57.106 INFO:tasks.workunit.client.0.smithi049.stdout:6/570: getdents d3 0 2024-02-22T00:33:57.106 INFO:tasks.workunit.client.0.smithi049.stdout:6/571: readlink d3/d16/d4a/l4c 0 2024-02-22T00:33:57.106 INFO:tasks.workunit.client.0.smithi049.stdout:4/602: fdatasync d3/d8/d10/d43/d4d/db9/f76 0 2024-02-22T00:33:57.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/572: chown d3/d64/d60/da0/fa8 57 1 2024-02-22T00:33:57.108 INFO:tasks.workunit.client.0.smithi049.stdout:3/474: creat d0/d14/d4d/d4e/d56/d5a/f86 x:0 0 0 2024-02-22T00:33:57.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/475: read d0/dd/d1e/f47 [105891,12423] 0 2024-02-22T00:33:57.111 INFO:tasks.workunit.client.0.smithi049.stdout:4/603: symlink d3/d8/d10/lc6 0 2024-02-22T00:33:57.113 INFO:tasks.workunit.client.0.smithi049.stdout:6/573: rename d3/d16/d32/l52 to d3/d16/d3b/d8c/lc7 0 2024-02-22T00:33:57.114 INFO:tasks.workunit.client.0.smithi049.stdout:3/476: mkdir d0/d59/d87 0 2024-02-22T00:33:57.115 INFO:tasks.workunit.client.0.smithi049.stdout:4/604: creat d3/d22/d5c/d9a/fc7 x:0 0 0 2024-02-22T00:33:57.115 INFO:tasks.workunit.client.0.smithi049.stdout:3/477: write d0/d14/d4d/d4e/f77 [2651728,52305] 0 2024-02-22T00:33:57.117 INFO:tasks.workunit.client.0.smithi049.stdout:6/574: link d3/d64/d60/da0/lb8 d3/d37/lc8 0 2024-02-22T00:33:57.120 INFO:tasks.workunit.client.0.smithi049.stdout:3/478: rename d0/dd/d26/d2e/f4a to d0/dd/d26/d2e/d52/f88 0 2024-02-22T00:33:57.126 INFO:tasks.workunit.client.0.smithi049.stdout:3/479: mknod d0/d59/d87/c89 0 2024-02-22T00:33:57.128 INFO:tasks.workunit.client.0.smithi049.stdout:3/480: rmdir d0/d14/d4d/d4e/d56/d5a 39 2024-02-22T00:33:57.131 INFO:tasks.workunit.client.0.smithi049.stdout:4/605: truncate d3/d8/d10/d12/d3f/f9d 2668884 0 2024-02-22T00:33:57.133 INFO:tasks.workunit.client.0.smithi049.stdout:6/575: dread d3/d36/f4e [0,4194304] 0 2024-02-22T00:33:57.133 INFO:tasks.workunit.client.0.smithi049.stdout:3/481: rename d0/f6 to d0/dd/d26/d63/f8a 0 2024-02-22T00:33:57.134 INFO:tasks.workunit.client.0.smithi049.stdout:6/576: chown d3/d16/d3b 11752646 1 2024-02-22T00:33:57.139 INFO:tasks.workunit.client.0.smithi049.stdout:6/577: mknod d3/d16/d32/cc9 0 2024-02-22T00:33:57.139 INFO:tasks.workunit.client.0.smithi049.stdout:6/578: chown d3/d64/l46 69 1 2024-02-22T00:33:57.140 INFO:tasks.workunit.client.0.smithi049.stdout:4/606: truncate d3/d8/f17 3726782 0 2024-02-22T00:33:57.142 INFO:tasks.workunit.client.0.smithi049.stdout:6/579: rmdir d3/d64 39 2024-02-22T00:33:57.145 INFO:tasks.workunit.client.0.smithi049.stdout:4/607: creat d3/d8/d10/dc4/fc8 x:0 0 0 2024-02-22T00:33:57.151 INFO:tasks.workunit.client.0.smithi049.stdout:4/608: fdatasync d3/d33/f62 0 2024-02-22T00:33:57.153 INFO:tasks.workunit.client.0.smithi049.stdout:3/482: link d0/d14/d4d/d4e/d4f/d5b/d66/f7d d0/dd/d26/d2e/d52/f8b 0 2024-02-22T00:33:57.156 INFO:tasks.workunit.client.0.smithi049.stdout:4/609: mknod d3/d22/cc9 0 2024-02-22T00:33:57.157 INFO:tasks.workunit.client.0.smithi049.stdout:4/610: readlink d3/d8/lbb 0 2024-02-22T00:33:57.158 INFO:tasks.workunit.client.0.smithi049.stdout:4/611: write d3/d22/d5c/da5/da8/faa [726804,55436] 0 2024-02-22T00:33:57.159 INFO:tasks.workunit.client.0.smithi049.stdout:3/483: link d0/d59/d87/c89 d0/d14/d4d/d4e/d4f/d5b/c8c 0 2024-02-22T00:33:57.160 INFO:tasks.workunit.client.0.smithi049.stdout:4/612: fdatasync d3/d33/fb8 0 2024-02-22T00:33:57.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/484: write d0/d14/d4d/f73 [386603,2925] 0 2024-02-22T00:33:57.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/485: creat d0/dd/d26/d2e/f8d x:0 0 0 2024-02-22T00:33:57.163 INFO:tasks.workunit.client.0.smithi049.stdout:4/613: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca 0 2024-02-22T00:33:57.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/486: write d0/dd/d1e/f7f [936707,14025] 0 2024-02-22T00:33:57.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/487: write d0/dd/d26/f2b [1197126,14620] 0 2024-02-22T00:33:57.167 INFO:tasks.workunit.client.0.smithi049.stdout:4/614: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d60/dcb 0 2024-02-22T00:33:57.168 INFO:tasks.workunit.client.0.smithi049.stdout:4/615: stat d3/d8/d10/d43/l73 0 2024-02-22T00:33:57.170 INFO:tasks.workunit.client.0.smithi049.stdout:3/488: link d0/d14/f69 d0/d14/f8e 0 2024-02-22T00:33:57.171 INFO:tasks.workunit.client.0.smithi049.stdout:4/616: creat d3/d22/d5c/da5/fcc x:0 0 0 2024-02-22T00:33:57.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/489: unlink d0/d14/d4d/d4e/d4f/d5b/f6b 0 2024-02-22T00:33:57.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/490: mkdir d0/d59/d8f 0 2024-02-22T00:33:57.175 INFO:tasks.workunit.client.0.smithi049.stdout:4/617: mkdir d3/d8/d10/d45/dcd 0 2024-02-22T00:33:57.177 INFO:tasks.workunit.client.0.smithi049.stdout:4/618: mkdir d3/d8/d10/dc4/dce 0 2024-02-22T00:33:57.179 INFO:tasks.workunit.client.0.smithi049.stdout:3/491: link d0/d14/d4d/d4e/d4f/d5b/d66/f70 d0/d14/d4d/d4e/d4f/d5b/d66/f90 0 2024-02-22T00:33:57.183 INFO:tasks.workunit.client.0.smithi049.stdout:3/492: rename d0/d14/d4d/d4e/d4f/d5b/c8c to d0/c91 0 2024-02-22T00:33:57.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/493: creat d0/d14/d4d/d4e/d56/d5a/f92 x:0 0 0 2024-02-22T00:33:57.189 INFO:tasks.workunit.client.0.smithi049.stdout:3/494: write d0/dd/d26/d2e/f44 [315197,46212] 0 2024-02-22T00:33:57.192 INFO:tasks.workunit.client.0.smithi049.stdout:3/495: mknod d0/d14/d4d/c93 0 2024-02-22T00:33:57.203 INFO:tasks.workunit.client.0.smithi049.stdout:9/658: sync 2024-02-22T00:33:57.204 INFO:tasks.workunit.client.0.smithi049.stdout:1/640: sync 2024-02-22T00:33:57.204 INFO:tasks.workunit.client.0.smithi049.stdout:5/541: sync 2024-02-22T00:33:57.207 INFO:tasks.workunit.client.0.smithi049.stdout:1/641: rename d2/f4e to d2/d8/db/d25/d62/fdb 0 2024-02-22T00:33:57.208 INFO:tasks.workunit.client.0.smithi049.stdout:9/659: symlink d17/d1c/d25/d71/da3/ld9 0 2024-02-22T00:33:57.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/496: dread d0/dd/d1e/f24 [0,4194304] 0 2024-02-22T00:33:57.212 INFO:tasks.workunit.client.0.smithi049.stdout:5/542: dwrite d0/d20/f6a [0,4194304] 0 2024-02-22T00:33:57.213 INFO:tasks.workunit.client.0.smithi049.stdout:1/642: symlink d2/d8/db/d25/d40/d41/d84/dab/ldc 0 2024-02-22T00:33:57.217 INFO:tasks.workunit.client.0.smithi049.stdout:3/497: write d0/dd/d26/f30 [2466247,22075] 0 2024-02-22T00:33:57.218 INFO:tasks.workunit.client.0.smithi049.stdout:1/643: write d2/d8/db/d25/d40/d41/d68/fc1 [1452125,46884] 0 2024-02-22T00:33:57.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/543: read d0/d20/d50/d24/f5a [973499,36408] 0 2024-02-22T00:33:57.221 INFO:tasks.workunit.client.0.smithi049.stdout:3/498: creat d0/dd/d6f/f94 x:0 0 0 2024-02-22T00:33:57.221 INFO:tasks.workunit.client.0.smithi049.stdout:5/544: rmdir d0/d26/d4d/d70/db1 39 2024-02-22T00:33:57.222 INFO:tasks.workunit.client.0.smithi049.stdout:5/545: fsync d0/f4c 0 2024-02-22T00:33:57.223 INFO:tasks.workunit.client.0.smithi049.stdout:1/644: rename d2/d8/db/d25/da4 to d2/d7b/ddd 0 2024-02-22T00:33:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:5/546: dwrite d0/d20/d50/d24/f2f [0,4194304] 0 2024-02-22T00:33:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:1/645: dwrite d2/d8/db/f90 [0,4194304] 0 2024-02-22T00:33:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:9/660: truncate d17/d21/f43 1057643 0 2024-02-22T00:33:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:3/499: dwrite d0/dd/f6a [0,4194304] 0 2024-02-22T00:33:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:1/646: readlink d2/d8/db/d25/l38 0 2024-02-22T00:33:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/500: chown d0/d14/f5c 202016884 1 2024-02-22T00:33:57.242 INFO:tasks.workunit.client.0.smithi049.stdout:5/547: rename d0/d20/d50/d24/d3b/d5b to d0/d20/d84/da0/db6 0 2024-02-22T00:33:57.244 INFO:tasks.workunit.client.0.smithi049.stdout:9/661: mkdir d17/d1c/d8c/dda 0 2024-02-22T00:33:57.245 INFO:tasks.workunit.client.0.smithi049.stdout:5/548: dread - d0/d20/f6e zero size 2024-02-22T00:33:57.246 INFO:tasks.workunit.client.0.smithi049.stdout:1/647: chown d2/c3a 944902 1 2024-02-22T00:33:57.247 INFO:tasks.workunit.client.0.smithi049.stdout:1/648: dread - d2/d8/d4c/fb1 zero size 2024-02-22T00:33:57.251 INFO:tasks.workunit.client.0.smithi049.stdout:1/649: chown d2/d8/db/d25/d40/d41/f59 26114721 1 2024-02-22T00:33:57.252 INFO:tasks.workunit.client.0.smithi049.stdout:1/650: chown d2/d8/db/d25/f2c 2694 1 2024-02-22T00:33:57.257 INFO:tasks.workunit.client.0.smithi049.stdout:9/662: rmdir d17/d1c/d8c/dda 0 2024-02-22T00:33:57.257 INFO:tasks.workunit.client.0.smithi049.stdout:3/501: rename d0/dd/d26/d63/c65 to d0/d14/c95 0 2024-02-22T00:33:57.261 INFO:tasks.workunit.client.0.smithi049.stdout:9/663: mknod d17/d1c/d25/d71/d73/cdb 0 2024-02-22T00:33:57.261 INFO:tasks.workunit.client.0.smithi049.stdout:9/664: dread - d17/d1c/fc4 zero size 2024-02-22T00:33:57.269 INFO:tasks.workunit.client.0.smithi049.stdout:5/549: dwrite d0/d20/d50/d24/d3b/f49 [0,4194304] 0 2024-02-22T00:33:57.273 INFO:tasks.workunit.client.0.smithi049.stdout:5/550: creat d0/fb7 x:0 0 0 2024-02-22T00:33:57.274 INFO:tasks.workunit.client.0.smithi049.stdout:9/665: dwrite d17/d1c/d25/d71/da3/fb7 [4194304,4194304] 0 2024-02-22T00:33:57.286 INFO:tasks.workunit.client.0.smithi049.stdout:5/551: unlink d0/d26/d4d/d6f/d94/d74/f8c 0 2024-02-22T00:33:57.287 INFO:tasks.workunit.client.0.smithi049.stdout:9/666: symlink d17/d21/d47/d7a/ldc 0 2024-02-22T00:33:57.287 INFO:tasks.workunit.client.0.smithi049.stdout:1/651: truncate d2/d8/db/d25/d40/f4b 1775109 0 2024-02-22T00:33:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:55.765130+0000 mgr.smithi161.sazlam (mgr.24369) 60 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 1.1 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 32 MiB/s rd, 140 MiB/s wr, 387 op/s 2024-02-22T00:33:57.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/502: dwrite d0/dd/d26/d63/f8a [0,4194304] 0 2024-02-22T00:33:57.302 INFO:tasks.workunit.client.0.smithi049.stdout:9/667: mknod d17/d21/d4e/d4b/dc8/cdd 0 2024-02-22T00:33:57.304 INFO:tasks.workunit.client.0.smithi049.stdout:9/668: chown d17/d1c/d25 70657624 1 2024-02-22T00:33:57.305 INFO:tasks.workunit.client.0.smithi049.stdout:1/652: rename d2/d8/db/d25/d40/d41/d68/fc1 to d2/d8/db/d25/d40/d4d/fde 0 2024-02-22T00:33:57.306 INFO:tasks.workunit.client.0.smithi049.stdout:1/653: chown d2/d8/db/d25/d40/d41/d5b/l8d 13371 1 2024-02-22T00:33:57.307 INFO:tasks.workunit.client.0.smithi049.stdout:3/503: unlink d0/d59/f6d 0 2024-02-22T00:33:57.311 INFO:tasks.workunit.client.0.smithi049.stdout:3/504: mkdir d0/dd/d96 0 2024-02-22T00:33:57.313 INFO:tasks.workunit.client.0.smithi049.stdout:3/505: symlink d0/dd/d26/d2e/d52/l97 0 2024-02-22T00:33:57.316 INFO:tasks.workunit.client.0.smithi049.stdout:9/669: creat d17/d21/d47/fde x:0 0 0 2024-02-22T00:33:57.321 INFO:tasks.workunit.client.0.smithi049.stdout:3/506: getdents d0/d14/d4d 0 2024-02-22T00:33:57.326 INFO:tasks.workunit.client.0.smithi049.stdout:9/670: dwrite d17/d21/d47/fad [0,4194304] 0 2024-02-22T00:33:57.327 INFO:tasks.workunit.client.0.smithi049.stdout:5/552: dread d0/d20/d50/d24/f5a [0,4194304] 0 2024-02-22T00:33:57.328 INFO:tasks.workunit.client.0.smithi049.stdout:3/507: creat d0/d14/d4d/d4e/d56/f98 x:0 0 0 2024-02-22T00:33:57.328 INFO:tasks.workunit.client.0.smithi049.stdout:9/671: readlink d17/d1c/d25/d39/d67/l83 0 2024-02-22T00:33:57.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/508: write d0/dd/d26/d2e/f84 [225414,42854] 0 2024-02-22T00:33:57.331 INFO:tasks.workunit.client.0.smithi049.stdout:1/654: write d2/d8/db/d25/d40/d41/d84/f9c [916835,20990] 0 2024-02-22T00:33:57.332 INFO:tasks.workunit.client.0.smithi049.stdout:9/672: fdatasync d17/f1f 0 2024-02-22T00:33:57.333 INFO:tasks.workunit.client.0.smithi049.stdout:1/655: truncate d2/d8/da/d8a/fca 829300 0 2024-02-22T00:33:57.334 INFO:tasks.workunit.client.0.smithi049.stdout:9/673: fsync d17/d1c/d25/d39/fb2 0 2024-02-22T00:33:57.336 INFO:tasks.workunit.client.0.smithi049.stdout:3/509: mkdir d0/dd/d26/d2e/d52/d99 0 2024-02-22T00:33:57.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/674: symlink d17/d21/d4e/d4b/ldf 0 2024-02-22T00:33:57.344 INFO:tasks.workunit.client.0.smithi049.stdout:5/553: truncate d0/d20/d50/d24/f3f 2571393 0 2024-02-22T00:33:57.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/510: dread d0/dd/f3 [0,4194304] 0 2024-02-22T00:33:57.346 INFO:tasks.workunit.client.0.smithi049.stdout:1/656: getdents d2/d8/d4c 0 2024-02-22T00:33:57.347 INFO:tasks.workunit.client.0.smithi049.stdout:9/675: mkdir d17/d21/d3c/dbf/de0 0 2024-02-22T00:33:57.348 INFO:tasks.workunit.client.0.smithi049.stdout:5/554: symlink d0/d26/d4d/d64/lb8 0 2024-02-22T00:33:57.349 INFO:tasks.workunit.client.0.smithi049.stdout:7/668: sync 2024-02-22T00:33:57.349 INFO:tasks.workunit.client.0.smithi049.stdout:0/594: sync 2024-02-22T00:33:57.350 INFO:tasks.workunit.client.0.smithi049.stdout:5/555: truncate d0/f7e 4505472 0 2024-02-22T00:33:57.350 INFO:tasks.workunit.client.0.smithi049.stdout:9/676: write d17/d1c/d77/fd7 [309076,18652] 0 2024-02-22T00:33:57.351 INFO:tasks.workunit.client.0.smithi049.stdout:3/511: rename d0/c5 to d0/d14/d4d/c9a 0 2024-02-22T00:33:57.352 INFO:tasks.workunit.client.0.smithi049.stdout:9/677: dread - d17/d1c/fc4 zero size 2024-02-22T00:33:57.353 INFO:tasks.workunit.client.0.smithi049.stdout:1/657: mkdir d2/d8/db/d25/d40/d41/d68/ddf 0 2024-02-22T00:33:57.356 INFO:tasks.workunit.client.0.smithi049.stdout:0/595: creat d3/df/faf x:0 0 0 2024-02-22T00:33:57.361 INFO:tasks.workunit.client.0.smithi049.stdout:5/556: rename d0/d26/d4d/d7c/f8e to d0/d26/d4d/fb9 0 2024-02-22T00:33:57.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/596: read d3/d1e/f5a [496534,8524] 0 2024-02-22T00:33:57.365 INFO:tasks.workunit.client.0.smithi049.stdout:3/512: rename d0/dd/d26/c60 to d0/dd/d26/d2e/d52/c9b 0 2024-02-22T00:33:57.366 INFO:tasks.workunit.client.0.smithi049.stdout:9/678: dread d17/d1c/d8c/fc6 [0,4194304] 0 2024-02-22T00:33:57.366 INFO:tasks.workunit.client.0.smithi049.stdout:7/669: write d1/d49/d4d/f86 [1394145,14887] 0 2024-02-22T00:33:57.367 INFO:tasks.workunit.client.0.smithi049.stdout:0/597: mknod d3/df/d48/d6f/cb0 0 2024-02-22T00:33:57.370 INFO:tasks.workunit.client.0.smithi049.stdout:9/679: dread - d17/d21/d4e/d89/d94/fca zero size 2024-02-22T00:33:57.371 INFO:tasks.workunit.client.0.smithi049.stdout:0/598: write d3/d1e/d58/f8f [218524,77990] 0 2024-02-22T00:33:57.371 INFO:tasks.workunit.client.0.smithi049.stdout:3/513: unlink d0/d14/d4d/f71 0 2024-02-22T00:33:57.375 INFO:tasks.workunit.client.0.smithi049.stdout:7/670: creat d1/df/d62/d57/fef x:0 0 0 2024-02-22T00:33:57.377 INFO:tasks.workunit.client.0.smithi049.stdout:9/680: mknod d17/d21/d3c/dbf/ce1 0 2024-02-22T00:33:57.379 INFO:tasks.workunit.client.0.smithi049.stdout:7/671: rmdir d1/df/d62/d48/d8e 39 2024-02-22T00:33:57.380 INFO:tasks.workunit.client.0.smithi049.stdout:3/514: write d0/dd/d1e/f24 [1136075,80074] 0 2024-02-22T00:33:57.383 INFO:tasks.workunit.client.0.smithi049.stdout:9/681: dread - d17/d21/d4e/d89/d94/fca zero size 2024-02-22T00:33:57.384 INFO:tasks.workunit.client.0.smithi049.stdout:0/599: dwrite d3/d6/d29/f3f [0,4194304] 0 2024-02-22T00:33:57.386 INFO:tasks.workunit.client.0.smithi049.stdout:1/658: dread d2/f4 [0,4194304] 0 2024-02-22T00:33:57.387 INFO:tasks.workunit.client.0.smithi049.stdout:3/515: creat d0/dd/d26/d63/f9c x:0 0 0 2024-02-22T00:33:57.387 INFO:tasks.workunit.client.0.smithi049.stdout:5/557: dwrite d0/d26/d4d/d7c/f96 [0,4194304] 0 2024-02-22T00:33:57.390 INFO:tasks.workunit.client.0.smithi049.stdout:9/682: creat d17/d1c/d25/d39/fe2 x:0 0 0 2024-02-22T00:33:57.390 INFO:tasks.workunit.client.0.smithi049.stdout:1/659: chown d2/d7b/f85 200342 1 2024-02-22T00:33:57.391 INFO:tasks.workunit.client.0.smithi049.stdout:5/558: readlink d0/l62 0 2024-02-22T00:33:57.393 INFO:tasks.workunit.client.0.smithi049.stdout:8/666: sync 2024-02-22T00:33:57.393 INFO:tasks.workunit.client.0.smithi049.stdout:2/586: sync 2024-02-22T00:33:57.393 INFO:tasks.workunit.client.0.smithi049.stdout:4/619: sync 2024-02-22T00:33:57.393 INFO:tasks.workunit.client.0.smithi049.stdout:6/580: sync 2024-02-22T00:33:57.393 INFO:tasks.workunit.client.0.smithi049.stdout:3/516: write d0/d14/d4d/f73 [576352,51665] 0 2024-02-22T00:33:57.397 INFO:tasks.workunit.client.0.smithi049.stdout:9/683: unlink d17/d1c/d25/f60 0 2024-02-22T00:33:57.398 INFO:tasks.workunit.client.0.smithi049.stdout:7/672: getdents d1/df/d62/d48/d99 0 2024-02-22T00:33:57.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/600: link d3/df/d7f/fa3 d3/d6/d8/d36/d81/fb1 0 2024-02-22T00:33:57.399 INFO:tasks.workunit.client.0.smithi049.stdout:1/660: fsync d2/d8/db/d25/d62/fdb 0 2024-02-22T00:33:57.402 INFO:tasks.workunit.client.0.smithi049.stdout:4/620: unlink d3/d22/d5c/d35/f58 0 2024-02-22T00:33:57.404 INFO:tasks.workunit.client.0.smithi049.stdout:3/517: chown d0/d14/d4d/d4e/d4f/d5b/f7a 598 1 2024-02-22T00:33:57.404 INFO:tasks.workunit.client.0.smithi049.stdout:2/587: creat d2/d9/de/d3a/d6d/fd9 x:0 0 0 2024-02-22T00:33:57.408 INFO:tasks.workunit.client.0.smithi049.stdout:7/673: unlink d1/d41/f3e 0 2024-02-22T00:33:57.410 INFO:tasks.workunit.client.0.smithi049.stdout:8/667: dread d1/d2/da5/d15/d65/d6a/faa [0,4194304] 0 2024-02-22T00:33:57.410 INFO:tasks.workunit.client.0.smithi049.stdout:0/601: creat d3/d6/d8/fb2 x:0 0 0 2024-02-22T00:33:57.412 INFO:tasks.workunit.client.0.smithi049.stdout:4/621: creat d3/d8/d10/d43/d4d/db9/d8a/fcf x:0 0 0 2024-02-22T00:33:57.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/559: rename d0/d26/d4d/d6f/l44 to d0/d26/d4d/d64/lba 0 2024-02-22T00:33:57.414 INFO:tasks.workunit.client.0.smithi049.stdout:4/622: readlink d3/d8/d10/lc6 0 2024-02-22T00:33:57.415 INFO:tasks.workunit.client.0.smithi049.stdout:9/684: mkdir d17/d21/d3c/de3 0 2024-02-22T00:33:57.415 INFO:tasks.workunit.client.0.smithi049.stdout:3/518: symlink d0/d14/d4d/d4e/d56/d5a/l9d 0 2024-02-22T00:33:57.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/588: dwrite d2/d9/fa [0,4194304] 0 2024-02-22T00:33:57.419 INFO:tasks.workunit.client.0.smithi049.stdout:1/661: rename d2/fd1 to d2/d8/d4c/fe0 0 2024-02-22T00:33:57.427 INFO:tasks.workunit.client.0.smithi049.stdout:3/519: chown d0/dd/d26/f2b 156575 1 2024-02-22T00:33:57.427 INFO:tasks.workunit.client.0.smithi049.stdout:8/668: dread d1/d2/da5/d15/d33/fbc [0,4194304] 0 2024-02-22T00:33:57.427 INFO:tasks.workunit.client.0.smithi049.stdout:4/623: rmdir d3/d8/d10/dc4/dce 0 2024-02-22T00:33:57.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:55.765130+0000 mgr.smithi161.sazlam (mgr.24369) 60 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 1.1 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 32 MiB/s rd, 140 MiB/s wr, 387 op/s 2024-02-22T00:33:57.429 INFO:tasks.workunit.client.0.smithi049.stdout:5/560: mknod d0/d20/d50/d24/d54/cbb 0 2024-02-22T00:33:57.433 INFO:tasks.workunit.client.0.smithi049.stdout:8/669: readlink d1/d2/d5/d1b/d39/d81/l89 0 2024-02-22T00:33:57.434 INFO:tasks.workunit.client.0.smithi049.stdout:9/685: stat d17/d1c/d25/d39/d67/cb9 0 2024-02-22T00:33:57.435 INFO:tasks.workunit.client.0.smithi049.stdout:2/589: rename d2/d9/de/d10/d46 to d2/dda 0 2024-02-22T00:33:57.439 INFO:tasks.workunit.client.0.smithi049.stdout:8/670: creat d1/d4c/fec x:0 0 0 2024-02-22T00:33:57.441 INFO:tasks.workunit.client.0.smithi049.stdout:6/581: dwrite d3/d16/d32/f5d [0,4194304] 0 2024-02-22T00:33:57.441 INFO:tasks.workunit.client.0.smithi049.stdout:9/686: unlink d17/f20 0 2024-02-22T00:33:57.443 INFO:tasks.workunit.client.0.smithi049.stdout:1/662: rename d2/d8/db/d25/d62/fae to d2/d8/da/d8a/fe1 0 2024-02-22T00:33:57.444 INFO:tasks.workunit.client.0.smithi049.stdout:3/520: dwrite d0/dd/f6a [0,4194304] 0 2024-02-22T00:33:57.444 INFO:tasks.workunit.client.0.smithi049.stdout:8/671: readlink d1/d2/da5/l95 0 2024-02-22T00:33:57.445 INFO:tasks.workunit.client.0.smithi049.stdout:5/561: truncate d0/d20/d50/d24/f71 2452334 0 2024-02-22T00:33:57.446 INFO:tasks.workunit.client.0.smithi049.stdout:7/674: dread d1/df/d62/d1c/d1d/f47 [0,4194304] 0 2024-02-22T00:33:57.446 INFO:tasks.workunit.client.0.smithi049.stdout:2/590: write d2/d9/de/d10/d2e/fa5 [1204155,67701] 0 2024-02-22T00:33:57.446 INFO:tasks.workunit.client.0.smithi049.stdout:0/602: dread d3/d6/d29/f4b [0,4194304] 0 2024-02-22T00:33:57.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/582: chown d3/d16/f2c 1192797 1 2024-02-22T00:33:57.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/624: rename d3/d22/d49/l7e to d3/d22/d5c/d9a/ld0 0 2024-02-22T00:33:57.453 INFO:tasks.workunit.client.0.smithi049.stdout:2/591: write d2/d9/dd/d4d/d5a/fbf [1018161,93454] 0 2024-02-22T00:33:57.456 INFO:tasks.workunit.client.0.smithi049.stdout:5/562: write d0/d26/f42 [1742461,9740] 0 2024-02-22T00:33:57.465 INFO:tasks.workunit.client.0.smithi049.stdout:7/675: dwrite d1/fec [0,4194304] 0 2024-02-22T00:33:57.465 INFO:tasks.workunit.client.0.smithi049.stdout:0/603: creat d3/df/d17/d50/d62/fb3 x:0 0 0 2024-02-22T00:33:57.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/672: mknod d1/d2/da5/d1c/ced 0 2024-02-22T00:33:57.466 INFO:tasks.workunit.client.0.smithi049.stdout:4/625: creat d3/d8/d10/d12/fd1 x:0 0 0 2024-02-22T00:33:57.468 INFO:tasks.workunit.client.0.smithi049.stdout:2/592: mknod d2/d9/dd/d4d/cdb 0 2024-02-22T00:33:57.469 INFO:tasks.workunit.client.0.smithi049.stdout:1/663: symlink d2/d8/db/d25/d40/le2 0 2024-02-22T00:33:57.472 INFO:tasks.workunit.client.0.smithi049.stdout:5/563: mknod d0/d20/d50/cbc 0 2024-02-22T00:33:57.473 INFO:tasks.workunit.client.0.smithi049.stdout:4/626: readlink d3/d8/d10/d43/l73 0 2024-02-22T00:33:57.475 INFO:tasks.workunit.client.0.smithi049.stdout:0/604: mknod d3/d6/d29/cb4 0 2024-02-22T00:33:57.478 INFO:tasks.workunit.client.0.smithi049.stdout:9/687: dwrite d17/d1c/d25/d39/d90/fb8 [0,4194304] 0 2024-02-22T00:33:57.481 INFO:tasks.workunit.client.0.smithi049.stdout:6/583: dwrite d3/f20 [0,4194304] 0 2024-02-22T00:33:57.482 INFO:tasks.workunit.client.0.smithi049.stdout:1/664: symlink d2/da0/le3 0 2024-02-22T00:33:57.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/593: symlink d2/d9/de/d3a/dc3/ldc 0 2024-02-22T00:33:57.487 INFO:tasks.workunit.client.0.smithi049.stdout:3/521: write d0/dd/d26/d2e/d52/f88 [182858,24271] 0 2024-02-22T00:33:57.487 INFO:tasks.workunit.client.0.smithi049.stdout:0/605: write d3/df/d59/d8e/fa7 [327725,115824] 0 2024-02-22T00:33:57.491 INFO:tasks.workunit.client.0.smithi049.stdout:2/594: readlink d2/d9/de/d3a/dc3/ldc 0 2024-02-22T00:33:57.492 INFO:tasks.workunit.client.0.smithi049.stdout:4/627: dread - d3/d8/d10/d39/f37 zero size 2024-02-22T00:33:57.492 INFO:tasks.workunit.client.0.smithi049.stdout:0/606: fsync d3/df/d17/d50/d62/fb3 0 2024-02-22T00:33:57.493 INFO:tasks.workunit.client.0.smithi049.stdout:2/595: readlink d2/d9/dd/l41 0 2024-02-22T00:33:57.493 INFO:tasks.workunit.client.0.smithi049.stdout:8/673: dwrite d1/f1e [0,4194304] 0 2024-02-22T00:33:57.495 INFO:tasks.workunit.client.0.smithi049.stdout:6/584: chown d3/f10 60250294 1 2024-02-22T00:33:57.497 INFO:tasks.workunit.client.0.smithi049.stdout:5/564: symlink d0/d26/d4d/d6f/lbd 0 2024-02-22T00:33:57.498 INFO:tasks.workunit.client.0.smithi049.stdout:9/688: write d17/d21/f33 [1947106,90503] 0 2024-02-22T00:33:57.501 INFO:tasks.workunit.client.0.smithi049.stdout:3/522: read d0/dd/d26/d2e/d52/f88 [112574,73757] 0 2024-02-22T00:33:57.501 INFO:tasks.workunit.client.0.smithi049.stdout:2/596: symlink d2/d9/d17/ldd 0 2024-02-22T00:33:57.503 INFO:tasks.workunit.client.0.smithi049.stdout:0/607: mkdir d3/df/db5 0 2024-02-22T00:33:57.505 INFO:tasks.workunit.client.0.smithi049.stdout:4/628: read d3/d22/d5c/f5b [4490733,86655] 0 2024-02-22T00:33:57.505 INFO:tasks.workunit.client.0.smithi049.stdout:8/674: write d1/d2/d5/d1b/d39/f7c [663787,55051] 0 2024-02-22T00:33:57.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/629: chown d3 123732 1 2024-02-22T00:33:57.514 INFO:tasks.workunit.client.0.smithi049.stdout:8/675: write d1/d2/da5/d15/f10 [2367301,47930] 0 2024-02-22T00:33:57.517 INFO:tasks.workunit.client.0.smithi049.stdout:3/523: symlink d0/d14/d4d/d4e/d56/d5a/l9e 0 2024-02-22T00:33:57.519 INFO:tasks.workunit.client.0.smithi049.stdout:7/676: dwrite d1/df/d62/d1c/d24/d2e/f5e [0,4194304] 0 2024-02-22T00:33:57.519 INFO:tasks.workunit.client.0.smithi049.stdout:0/608: truncate d3/df/d17/d50/d62/f67 4426502 0 2024-02-22T00:33:57.521 INFO:tasks.workunit.client.0.smithi049.stdout:4/630: read d3/d8/d10/d43/d4d/db9/f98 [362460,17445] 0 2024-02-22T00:33:57.522 INFO:tasks.workunit.client.0.smithi049.stdout:6/585: getdents d3/d16/d32/d7b 0 2024-02-22T00:33:57.525 INFO:tasks.workunit.client.0.smithi049.stdout:9/689: dwrite d17/d1c/fc4 [0,4194304] 0 2024-02-22T00:33:57.529 INFO:tasks.workunit.client.0.smithi049.stdout:2/597: link d2/d9/d17/lce d2/d9/dd/d4d/d72/lde 0 2024-02-22T00:33:57.530 INFO:tasks.workunit.client.0.smithi049.stdout:0/609: rmdir d3/df/d17 39 2024-02-22T00:33:57.531 INFO:tasks.workunit.client.0.smithi049.stdout:3/524: write d0/dd/d26/d2e/f8d [866048,83315] 0 2024-02-22T00:33:57.532 INFO:tasks.workunit.client.0.smithi049.stdout:8/676: rmdir d1/d2/da5/d15/d30/d36/d52/daf/dcb 39 2024-02-22T00:33:57.533 INFO:tasks.workunit.client.0.smithi049.stdout:1/665: dwrite d2/f30 [0,4194304] 0 2024-02-22T00:33:57.533 INFO:tasks.workunit.client.0.smithi049.stdout:7/677: mkdir d1/df/d62/d1c/d24/d2e/df0 0 2024-02-22T00:33:57.536 INFO:tasks.workunit.client.0.smithi049.stdout:5/565: dread d0/d26/d4d/f68 [0,4194304] 0 2024-02-22T00:33:57.539 INFO:tasks.workunit.client.0.smithi049.stdout:2/598: write d2/d9/de/d10/fbc [332936,46721] 0 2024-02-22T00:33:57.543 INFO:tasks.workunit.client.0.smithi049.stdout:8/677: write d1/d4c/f55 [3706186,78926] 0 2024-02-22T00:33:57.544 INFO:tasks.workunit.client.0.smithi049.stdout:0/610: write d3/df/d17/f24 [3361804,127141] 0 2024-02-22T00:33:57.547 INFO:tasks.workunit.client.0.smithi049.stdout:9/690: write d17/d21/d4e/d89/d94/fca [286538,74545] 0 2024-02-22T00:33:57.547 INFO:tasks.workunit.client.0.smithi049.stdout:5/566: chown d0/d20/d50/d24/d3b/f49 3519260 1 2024-02-22T00:33:57.552 INFO:tasks.workunit.client.0.smithi049.stdout:1/666: symlink d2/d69/dce/le4 0 2024-02-22T00:33:57.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/611: fsync d3/df/d48/d54/f6b 0 2024-02-22T00:33:57.559 INFO:tasks.workunit.client.0.smithi049.stdout:3/525: truncate d0/d14/d4d/d4e/d4f/d5b/d66/f90 577522 0 2024-02-22T00:33:57.561 INFO:tasks.workunit.client.0.smithi049.stdout:0/612: fsync d3/d1e/d58/f8f 0 2024-02-22T00:33:57.561 INFO:tasks.workunit.client.0.smithi049.stdout:7/678: mknod d1/df/d62/d48/d8e/dde/cf1 0 2024-02-22T00:33:57.564 INFO:tasks.workunit.client.0.smithi049.stdout:9/691: write d17/d21/d85/fcf [254971,95410] 0 2024-02-22T00:33:57.567 INFO:tasks.workunit.client.0.smithi049.stdout:2/599: rmdir d2/d9/de/d10/d2e/d42/d80/dcc 39 2024-02-22T00:33:57.568 INFO:tasks.workunit.client.0.smithi049.stdout:4/631: dwrite d3/d8/d10/d12/f23 [0,4194304] 0 2024-02-22T00:33:57.569 INFO:tasks.workunit.client.0.smithi049.stdout:6/586: dwrite d3/d16/d4a/d4d/fbb [4194304,4194304] 0 2024-02-22T00:33:57.572 INFO:tasks.workunit.client.0.smithi049.stdout:8/678: mknod d1/d4c/cee 0 2024-02-22T00:33:57.572 INFO:tasks.workunit.client.0.smithi049.stdout:4/632: readlink d3/l6 0 2024-02-22T00:33:57.576 INFO:tasks.workunit.client.0.smithi049.stdout:7/679: truncate d1/d41/dae/fdc 214143 0 2024-02-22T00:33:57.580 INFO:tasks.workunit.client.0.smithi049.stdout:1/667: symlink d2/le5 0 2024-02-22T00:33:57.583 INFO:tasks.workunit.client.0.smithi049.stdout:9/692: dread d17/d1c/d25/d39/d90/fb8 [0,4194304] 0 2024-02-22T00:33:57.585 INFO:tasks.workunit.client.0.smithi049.stdout:8/679: write d1/d2/da5/d15/d30/d36/d52/daf/fd8 [1477716,58691] 0 2024-02-22T00:33:57.590 INFO:tasks.workunit.client.0.smithi049.stdout:5/567: dwrite d0/d26/d4d/d6f/d94/d74/f9f [0,4194304] 0 2024-02-22T00:33:57.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/693: write d17/d21/d47/fad [1462381,113519] 0 2024-02-22T00:33:57.592 INFO:tasks.workunit.client.0.smithi049.stdout:3/526: rmdir d0/dd/d96 0 2024-02-22T00:33:57.595 INFO:tasks.workunit.client.0.smithi049.stdout:0/613: dwrite d3/df/d48/d63/f97 [0,4194304] 0 2024-02-22T00:33:57.598 INFO:tasks.workunit.client.0.smithi049.stdout:2/600: getdents d2/dda/d5d 0 2024-02-22T00:33:57.599 INFO:tasks.workunit.client.0.smithi049.stdout:1/668: chown d2/d8/d4c/d5e/ld3 256839 1 2024-02-22T00:33:57.601 INFO:tasks.workunit.client.0.smithi049.stdout:1/669: stat d2/f9e 0 2024-02-22T00:33:57.604 INFO:tasks.workunit.client.0.smithi049.stdout:9/694: creat d17/d1c/d25/fe4 x:0 0 0 2024-02-22T00:33:57.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/633: dwrite d3/f4b [0,4194304] 0 2024-02-22T00:33:57.606 INFO:tasks.workunit.client.0.smithi049.stdout:7/680: rename d1/df/f16 to d1/df/d62/d60/d7e/de6/ded/ff2 0 2024-02-22T00:33:57.609 INFO:tasks.workunit.client.0.smithi049.stdout:2/601: creat d2/d9/dd/d4d/d72/fdf x:0 0 0 2024-02-22T00:33:57.614 INFO:tasks.workunit.client.0.smithi049.stdout:0/614: symlink d3/lb6 0 2024-02-22T00:33:57.614 INFO:tasks.workunit.client.0.smithi049.stdout:6/587: link d3/d16/l33 d3/d64/d60/da0/lca 0 2024-02-22T00:33:57.615 INFO:tasks.workunit.client.0.smithi049.stdout:8/680: getdents d1/d2/d8c 0 2024-02-22T00:33:57.616 INFO:tasks.workunit.client.0.smithi049.stdout:3/527: dwrite d0/d14/d4d/f73 [0,4194304] 0 2024-02-22T00:33:57.618 INFO:tasks.workunit.client.0.smithi049.stdout:9/695: mknod d17/d1c/d25/ce5 0 2024-02-22T00:33:57.618 INFO:tasks.workunit.client.0.smithi049.stdout:5/568: rename d0/d26/d4d/d6f/d94/d74/d7a/d8f to d0/d26/d4d/d70/db1/dbe 0 2024-02-22T00:33:57.619 INFO:tasks.workunit.client.0.smithi049.stdout:7/681: read d1/df/d62/f59 [3804562,62908] 0 2024-02-22T00:33:57.623 INFO:tasks.workunit.client.0.smithi049.stdout:5/569: dread - d0/d26/d4d/d6f/d94/d74/f82 zero size 2024-02-22T00:33:57.623 INFO:tasks.workunit.client.0.smithi049.stdout:6/588: creat d3/d64/d59/fcb x:0 0 0 2024-02-22T00:33:57.625 INFO:tasks.workunit.client.0.smithi049.stdout:7/682: write d1/df/d62/d60/d7e/fbb [874512,105205] 0 2024-02-22T00:33:57.626 INFO:tasks.workunit.client.0.smithi049.stdout:0/615: unlink d3/d1e/la5 0 2024-02-22T00:33:57.626 INFO:tasks.workunit.client.0.smithi049.stdout:9/696: dread - d17/d21/d47/f69 zero size 2024-02-22T00:33:57.628 INFO:tasks.workunit.client.0.smithi049.stdout:4/634: rename d3/d22/d5c/da5/fcc to d3/d33/fd2 0 2024-02-22T00:33:57.629 INFO:tasks.workunit.client.0.smithi049.stdout:7/683: write d1/d41/fa4 [4068545,15510] 0 2024-02-22T00:33:57.630 INFO:tasks.workunit.client.0.smithi049.stdout:4/635: readlink d3/d8/l4f 0 2024-02-22T00:33:57.634 INFO:tasks.workunit.client.0.smithi049.stdout:8/681: getdents d1/d2/da5/d15/d65/d6a/de5 0 2024-02-22T00:33:57.634 INFO:tasks.workunit.client.0.smithi049.stdout:7/684: dread - d1/d41/d28/d71/d72/d95/fc3 zero size 2024-02-22T00:33:57.634 INFO:tasks.workunit.client.0.smithi049.stdout:2/602: creat d2/d9/de/d10/d2e/d42/d80/fe0 x:0 0 0 2024-02-22T00:33:57.635 INFO:tasks.workunit.client.0.smithi049.stdout:1/670: getdents d2/d7b 0 2024-02-22T00:33:57.637 INFO:tasks.workunit.client.0.smithi049.stdout:0/616: rmdir d3/df 39 2024-02-22T00:33:57.641 INFO:tasks.workunit.client.0.smithi049.stdout:9/697: dwrite d17/d1c/d25/d71/da3/fd0 [0,4194304] 0 2024-02-22T00:33:57.643 INFO:tasks.workunit.client.0.smithi049.stdout:4/636: creat d3/d22/d49/d57/fd3 x:0 0 0 2024-02-22T00:33:57.652 INFO:tasks.workunit.client.0.smithi049.stdout:0/617: readlink d3/df/d48/d63/l77 0 2024-02-22T00:33:57.652 INFO:tasks.workunit.client.0.smithi049.stdout:5/570: mknod d0/d26/d4d/d6f/d94/d9c/cbf 0 2024-02-22T00:33:57.655 INFO:tasks.workunit.client.0.smithi049.stdout:6/589: rename d3/d16/d4a to d3/d36/d70/dcc 0 2024-02-22T00:33:57.656 INFO:tasks.workunit.client.0.smithi049.stdout:4/637: mkdir d3/d22/d5c/d35/dd4 0 2024-02-22T00:33:57.658 INFO:tasks.workunit.client.0.smithi049.stdout:2/603: creat d2/d9/dd/d4d/da7/dd2/fe1 x:0 0 0 2024-02-22T00:33:57.659 INFO:tasks.workunit.client.0.smithi049.stdout:8/682: dwrite d1/d2/da5/d15/d30/d4b/f82 [0,4194304] 0 2024-02-22T00:33:57.665 INFO:tasks.workunit.client.0.smithi049.stdout:4/638: write d3/d8/f14 [922746,49405] 0 2024-02-22T00:33:57.666 INFO:tasks.workunit.client.0.smithi049.stdout:3/528: dwrite d0/f3b [0,4194304] 0 2024-02-22T00:33:57.666 INFO:tasks.workunit.client.0.smithi049.stdout:0/618: rename d3/d1e/d58/l85 to d3/d92/lb7 0 2024-02-22T00:33:57.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/698: dwrite d17/d1c/d25/fc9 [0,4194304] 0 2024-02-22T00:33:57.671 INFO:tasks.workunit.client.0.smithi049.stdout:8/683: creat d1/d2/d5/d56/dd2/fef x:0 0 0 2024-02-22T00:33:57.680 INFO:tasks.workunit.client.0.smithi049.stdout:3/529: chown d0/d14/d4d/d4e/d4f/d5b/d66/f7d 1592152255 1 2024-02-22T00:33:57.683 INFO:tasks.workunit.client.0.smithi049.stdout:4/639: creat d3/d22/d49/d57/fd5 x:0 0 0 2024-02-22T00:33:57.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/671: dread d2/d8/db/fbd [0,4194304] 0 2024-02-22T00:33:57.683 INFO:tasks.workunit.client.0.smithi049.stdout:2/604: readlink d2/d9/de/d10/d2e/d42/d80/dcc/l98 0 2024-02-22T00:33:57.687 INFO:tasks.workunit.client.0.smithi049.stdout:6/590: dwrite d3/f9b [0,4194304] 0 2024-02-22T00:33:57.687 INFO:tasks.workunit.client.0.smithi049.stdout:5/571: dwrite d0/d20/d50/d24/f5a [0,4194304] 0 2024-02-22T00:33:57.690 INFO:tasks.workunit.client.0.smithi049.stdout:1/672: fsync d2/d8/d4c/f97 0 2024-02-22T00:33:57.691 INFO:tasks.workunit.client.0.smithi049.stdout:5/572: fsync d0/d26/d4d/d6f/fb 0 2024-02-22T00:33:57.693 INFO:tasks.workunit.client.0.smithi049.stdout:0/619: getdents d3 0 2024-02-22T00:33:57.695 INFO:tasks.workunit.client.0.smithi049.stdout:4/640: write d3/d22/d5c/d35/f40 [2965895,82928] 0 2024-02-22T00:33:57.695 INFO:tasks.workunit.client.0.smithi049.stdout:2/605: dread - d2/dda/d63/fc9 zero size 2024-02-22T00:33:57.697 INFO:tasks.workunit.client.0.smithi049.stdout:6/591: read d3/d64/d59/d72/d92/d6c/f9f [555948,121983] 0 2024-02-22T00:33:57.701 INFO:tasks.workunit.client.0.smithi049.stdout:3/530: rmdir d0/d14/d4d/d7e 0 2024-02-22T00:33:57.704 INFO:tasks.workunit.client.0.smithi049.stdout:4/641: creat d3/d8/d10/d43/fd6 x:0 0 0 2024-02-22T00:33:57.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/620: truncate d3/d1e/d58/f98 233766 0 2024-02-22T00:33:57.705 INFO:tasks.workunit.client.0.smithi049.stdout:2/606: creat d2/dda/d7f/fe2 x:0 0 0 2024-02-22T00:33:57.706 INFO:tasks.workunit.client.0.smithi049.stdout:6/592: mkdir d3/dcd 0 2024-02-22T00:33:57.709 INFO:tasks.workunit.client.0.smithi049.stdout:5/573: rename d0/d20/d50/d24/f3f to d0/d26/d4d/d70/db1/fc0 0 2024-02-22T00:33:57.711 INFO:tasks.workunit.client.0.smithi049.stdout:2/607: chown d2/d9/de/d10/d59/fac 7 1 2024-02-22T00:33:57.712 INFO:tasks.workunit.client.0.smithi049.stdout:6/593: fdatasync d3/d36/d70/dcc/d4d/d8b/fb2 0 2024-02-22T00:33:57.714 INFO:tasks.workunit.client.0.smithi049.stdout:8/684: truncate d1/d2/d5/f34 2770352 0 2024-02-22T00:33:57.714 INFO:tasks.workunit.client.0.smithi049.stdout:5/574: readlink d0/d26/d4d/d6f/d94/l11 0 2024-02-22T00:33:57.720 INFO:tasks.workunit.client.0.smithi049.stdout:5/575: fsync d0/d20/d84/da0/db6/f67 0 2024-02-22T00:33:57.720 INFO:tasks.workunit.client.0.smithi049.stdout:3/531: dwrite d0/dd/d1e/f7f [0,4194304] 0 2024-02-22T00:33:57.721 INFO:tasks.workunit.client.0.smithi049.stdout:1/673: dwrite d2/d8/db/d25/fc7 [0,4194304] 0 2024-02-22T00:33:57.721 INFO:tasks.workunit.client.0.smithi049.stdout:2/608: creat d2/dda/d5d/fe3 x:0 0 0 2024-02-22T00:33:57.727 INFO:tasks.workunit.client.0.smithi049.stdout:5/576: fdatasync d0/d20/f6a 0 2024-02-22T00:33:57.728 INFO:tasks.workunit.client.0.smithi049.stdout:8/685: dread - d1/d2/da5/d15/d33/fba zero size 2024-02-22T00:33:57.728 INFO:tasks.workunit.client.0.smithi049.stdout:3/532: chown d0/dd/l8 122 1 2024-02-22T00:33:57.729 INFO:tasks.workunit.client.0.smithi049.stdout:5/577: stat d0/d20/d50/c99 0 2024-02-22T00:33:57.735 INFO:tasks.workunit.client.0.smithi049.stdout:8/686: rename d1/d2/d5/d1b/c2f to d1/d2/da5/da3/cf0 0 2024-02-22T00:33:57.736 INFO:tasks.workunit.client.0.smithi049.stdout:9/699: dread d17/d1c/f63 [0,4194304] 0 2024-02-22T00:33:57.736 INFO:tasks.workunit.client.0.smithi049.stdout:2/609: truncate d2/d9/dd/d74/f9d 903254 0 2024-02-22T00:33:57.743 INFO:tasks.workunit.client.0.smithi049.stdout:4/642: dwrite d3/d8/d10/f5d [0,4194304] 0 2024-02-22T00:33:57.743 INFO:tasks.workunit.client.0.smithi049.stdout:9/700: readlink d17/d21/d47/d7a/ldc 0 2024-02-22T00:33:57.749 INFO:tasks.workunit.client.0.smithi049.stdout:1/674: truncate d2/d8/db/f26 1780156 0 2024-02-22T00:33:57.749 INFO:tasks.workunit.client.0.smithi049.stdout:2/610: mknod d2/d9/dd/d4d/d72/da0/dba/ce4 0 2024-02-22T00:33:57.749 INFO:tasks.workunit.client.0.smithi049.stdout:6/594: dwrite d3/ff [0,4194304] 0 2024-02-22T00:33:57.749 INFO:tasks.workunit.client.0.smithi049.stdout:3/533: rename d0/dd/d26/c61 to d0/dd/d26/d2e/d52/d6e/c9f 0 2024-02-22T00:33:57.750 INFO:tasks.workunit.client.0.smithi049.stdout:9/701: fsync d17/d1c/d77/fd7 0 2024-02-22T00:33:57.753 INFO:tasks.workunit.client.0.smithi049.stdout:2/611: chown d2/dda/d7f/fcd 130102 1 2024-02-22T00:33:57.757 INFO:tasks.workunit.client.0.smithi049.stdout:5/578: dwrite d0/d20/d50/d24/f88 [0,4194304] 0 2024-02-22T00:33:57.759 INFO:tasks.workunit.client.0.smithi049.stdout:9/702: fdatasync d17/d1c/d25/f53 0 2024-02-22T00:33:57.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/643: truncate d3/d8/d10/d39/f37 536732 0 2024-02-22T00:33:57.763 INFO:tasks.workunit.client.0.smithi049.stdout:2/612: chown d2/dda/d5d/cc6 24630 1 2024-02-22T00:33:57.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/687: dwrite d1/d2/da5/d15/d30/d4b/f82 [0,4194304] 0 2024-02-22T00:33:57.766 INFO:tasks.workunit.client.0.smithi049.stdout:5/579: truncate d0/d20/d50/d24/f7d 564741 0 2024-02-22T00:33:57.767 INFO:tasks.workunit.client.0.smithi049.stdout:6/595: write d3/d36/d70/dcc/d4d/f96 [1134733,83224] 0 2024-02-22T00:33:57.767 INFO:tasks.workunit.client.0.smithi049.stdout:8/688: chown d1/d2/da5/d15/d65/d6a/de5 53915 1 2024-02-22T00:33:57.770 INFO:tasks.workunit.client.0.smithi049.stdout:6/596: stat d3/d16/d32/f71 0 2024-02-22T00:33:57.770 INFO:tasks.workunit.client.0.smithi049.stdout:3/534: link d0/dd/d26/f2b d0/d14/d4d/d4e/d4f/d5b/d76/fa0 0 2024-02-22T00:33:57.772 INFO:tasks.workunit.client.0.smithi049.stdout:5/580: symlink d0/d20/d84/da0/lc1 0 2024-02-22T00:33:57.776 INFO:tasks.workunit.client.0.smithi049.stdout:6/597: mkdir d3/d36/d57/d75/dce 0 2024-02-22T00:33:57.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/689: dwrite d1/d2/da5/d15/d30/fcc [0,4194304] 0 2024-02-22T00:33:57.781 INFO:tasks.workunit.client.0.smithi049.stdout:4/644: link d3/d8/d10/d43/d4d/l8e d3/d22/d5c/d9a/ld7 0 2024-02-22T00:33:57.781 INFO:tasks.workunit.client.0.smithi049.stdout:6/598: symlink d3/d16/d32/lcf 0 2024-02-22T00:33:57.782 INFO:tasks.workunit.client.0.smithi049.stdout:9/703: link d17/d1c/d38/c44 d17/d21/d85/ce6 0 2024-02-22T00:33:57.783 INFO:tasks.workunit.client.0.smithi049.stdout:5/581: creat d0/fc2 x:0 0 0 2024-02-22T00:33:57.784 INFO:tasks.workunit.client.0.smithi049.stdout:6/599: chown d3/d36/d57/d75/l80 62712868 1 2024-02-22T00:33:57.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/690: mkdir d1/d2/d5/d1b/df1 0 2024-02-22T00:33:57.786 INFO:tasks.workunit.client.0.smithi049.stdout:9/704: mkdir d17/d1c/d77/de7 0 2024-02-22T00:33:57.787 INFO:tasks.workunit.client.0.smithi049.stdout:6/600: chown d3/d64/d59/d72 4168 1 2024-02-22T00:33:57.788 INFO:tasks.workunit.client.0.smithi049.stdout:5/582: write d0/d26/d4d/d6f/d94/d74/f82 [240961,10136] 0 2024-02-22T00:33:57.789 INFO:tasks.workunit.client.0.smithi049.stdout:4/645: rename d3/d8/d10/d43/d4d/db9/d92/db7 to d3/d8/d10/d12/dd8 0 2024-02-22T00:33:57.791 INFO:tasks.workunit.client.0.smithi049.stdout:5/583: write d0/d20/d50/fa5 [4709112,51044] 0 2024-02-22T00:33:57.793 INFO:tasks.workunit.client.0.smithi049.stdout:8/691: mkdir d1/d2/d5/d1b/d39/d60/df2 0 2024-02-22T00:33:57.795 INFO:tasks.workunit.client.0.smithi049.stdout:4/646: write d3/d8/d10/d43/d4d/db9/d8a/d48/d60/f9b [13432,105391] 0 2024-02-22T00:33:57.796 INFO:tasks.workunit.client.0.smithi049.stdout:8/692: chown d1/d2/d5/d1b/d39/f72 23486 1 2024-02-22T00:33:57.797 INFO:tasks.workunit.client.0.smithi049.stdout:9/705: link d17/d21/d4e/d89/d94/f9b d17/d21/d3c/dbf/de0/fe8 0 2024-02-22T00:33:57.801 INFO:tasks.workunit.client.0.smithi049.stdout:9/706: stat d17/d1c/d38/c6e 0 2024-02-22T00:33:57.803 INFO:tasks.workunit.client.0.smithi049.stdout:6/601: dwrite d3/d16/d45/fc6 [0,4194304] 0 2024-02-22T00:33:57.804 INFO:tasks.workunit.client.0.smithi049.stdout:9/707: write d17/d1c/d25/fc9 [870560,29211] 0 2024-02-22T00:33:57.804 INFO:tasks.workunit.client.0.smithi049.stdout:5/584: rename d0/d26/d4d to d0/d20/d84/da0/db6/dc3 0 2024-02-22T00:33:57.806 INFO:tasks.workunit.client.0.smithi049.stdout:4/647: chown d3/d8/d10/d39/c2e 14297427 1 2024-02-22T00:33:57.810 INFO:tasks.workunit.client.0.smithi049.stdout:8/693: rename d1/d2/da5/d1c to d1/d2/d5/d1b/d39/d81/df3 0 2024-02-22T00:33:57.812 INFO:tasks.workunit.client.0.smithi049.stdout:4/648: write d3/d22/d5c/f93 [4869273,39222] 0 2024-02-22T00:33:57.813 INFO:tasks.workunit.client.0.smithi049.stdout:5/585: symlink d0/d20/d84/da0/db6/dc3/d64/lc4 0 2024-02-22T00:33:57.813 INFO:tasks.workunit.client.0.smithi049.stdout:1/675: dread d2/d8/db/d25/d40/d41/f60 [0,4194304] 0 2024-02-22T00:33:57.815 INFO:tasks.workunit.client.0.smithi049.stdout:8/694: write d1/d4c/fc8 [119732,33239] 0 2024-02-22T00:33:57.816 INFO:tasks.workunit.client.0.smithi049.stdout:9/708: mkdir d17/d1c/d8c/db0/de9 0 2024-02-22T00:33:57.818 INFO:tasks.workunit.client.0.smithi049.stdout:4/649: mkdir d3/d22/d5c/d9a/dd9 0 2024-02-22T00:33:57.823 INFO:tasks.workunit.client.0.smithi049.stdout:9/709: write d17/d21/d3c/f59 [8638952,82358] 0 2024-02-22T00:33:57.823 INFO:tasks.workunit.client.0.smithi049.stdout:4/650: creat d3/d33/fda x:0 0 0 2024-02-22T00:33:57.827 INFO:tasks.workunit.client.0.smithi049.stdout:6/602: dwrite d3/d16/d45/f99 [0,4194304] 0 2024-02-22T00:33:57.834 INFO:tasks.workunit.client.0.smithi049.stdout:6/603: dread - d3/d64/d59/d72/d92/fbd zero size 2024-02-22T00:33:57.834 INFO:tasks.workunit.client.0.smithi049.stdout:1/676: dwrite d2/d8/db/d25/d40/d41/d68/fa6 [0,4194304] 0 2024-02-22T00:33:57.836 INFO:tasks.workunit.client.0.smithi049.stdout:5/586: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/f98 [0,4194304] 0 2024-02-22T00:33:57.836 INFO:tasks.workunit.client.0.smithi049.stdout:8/695: link d1/d2/da5/d15/f10 d1/d2/da5/d15/d30/d36/d52/daf/ff4 0 2024-02-22T00:33:57.837 INFO:tasks.workunit.client.0.smithi049.stdout:6/604: fdatasync d3/f20 0 2024-02-22T00:33:57.842 INFO:tasks.workunit.client.0.smithi049.stdout:6/605: chown d3/d36/d57/d75 8 1 2024-02-22T00:33:57.842 INFO:tasks.workunit.client.0.smithi049.stdout:5/587: write d0/d20/d84/da0/db6/dc3/d6f/d94/f98 [129874,82794] 0 2024-02-22T00:33:57.843 INFO:tasks.workunit.client.0.smithi049.stdout:8/696: creat d1/d2/da5/ff5 x:0 0 0 2024-02-22T00:33:57.847 INFO:tasks.workunit.client.0.smithi049.stdout:5/588: read - d0/d20/d84/da0/db6/dc3/d70/db1/dbe/fa9 zero size 2024-02-22T00:33:57.848 INFO:tasks.workunit.client.0.smithi049.stdout:1/677: creat d2/d8/db/d25/dda/fe6 x:0 0 0 2024-02-22T00:33:57.850 INFO:tasks.workunit.client.0.smithi049.stdout:8/697: chown d1/d2/da5/d15/d30/d36/dcd/cd3 11879 1 2024-02-22T00:33:57.851 INFO:tasks.workunit.client.0.smithi049.stdout:5/589: stat d0/d20/d84/da0/db6/dc3/d64/l6c 0 2024-02-22T00:33:57.852 INFO:tasks.workunit.client.0.smithi049.stdout:4/651: dread d3/d8/d10/d12/f38 [0,4194304] 0 2024-02-22T00:33:57.853 INFO:tasks.workunit.client.0.smithi049.stdout:8/698: fdatasync d1/d2/d5/f2c 0 2024-02-22T00:33:57.854 INFO:tasks.workunit.client.0.smithi049.stdout:6/606: dread d3/d16/d32/f5d [0,4194304] 0 2024-02-22T00:33:57.855 INFO:tasks.workunit.client.0.smithi049.stdout:5/590: fdatasync d0/d20/d84/da0/db6/dc3/f68 0 2024-02-22T00:33:57.855 INFO:tasks.workunit.client.0.smithi049.stdout:1/678: creat d2/d8/db/d25/d40/d41/d5b/d75/dd0/fe7 x:0 0 0 2024-02-22T00:33:57.857 INFO:tasks.workunit.client.0.smithi049.stdout:4/652: creat d3/fdb x:0 0 0 2024-02-22T00:33:57.857 INFO:tasks.workunit.client.0.smithi049.stdout:6/607: write d3/d36/f9d [134575,89277] 0 2024-02-22T00:33:57.858 INFO:tasks.workunit.client.0.smithi049.stdout:8/699: creat d1/d2/da5/d15/d30/d36/dcd/ff6 x:0 0 0 2024-02-22T00:33:57.858 INFO:tasks.workunit.client.0.smithi049.stdout:1/679: read - d2/d8/db/d25/dda/fe6 zero size 2024-02-22T00:33:57.859 INFO:tasks.workunit.client.0.smithi049.stdout:8/700: fsync d1/fe 0 2024-02-22T00:33:57.861 INFO:tasks.workunit.client.0.smithi049.stdout:6/608: mkdir d3/d16/d45/dd0 0 2024-02-22T00:33:57.863 INFO:tasks.workunit.client.0.smithi049.stdout:6/609: write d3/d16/d45/f49 [232196,124517] 0 2024-02-22T00:33:57.864 INFO:tasks.workunit.client.0.smithi049.stdout:9/710: dread d17/d1c/d25/d39/fb2 [0,4194304] 0 2024-02-22T00:33:57.864 INFO:tasks.workunit.client.0.smithi049.stdout:5/591: getdents d0/d20/d50/d24/d3b 0 2024-02-22T00:33:57.866 INFO:tasks.workunit.client.0.smithi049.stdout:6/610: fdatasync d3/d64/d59/f77 0 2024-02-22T00:33:57.867 INFO:tasks.workunit.client.0.smithi049.stdout:1/680: rmdir d2/d8/db/d25/d40/d41/d68/ddf 0 2024-02-22T00:33:57.867 INFO:tasks.workunit.client.0.smithi049.stdout:5/592: chown d0/d20/c23 4108237 1 2024-02-22T00:33:57.867 INFO:tasks.workunit.client.0.smithi049.stdout:9/711: chown d17/d21/d4e/d4b/dc8 206733345 1 2024-02-22T00:33:57.869 INFO:tasks.workunit.client.0.smithi049.stdout:6/611: dread - d3/d36/f91 zero size 2024-02-22T00:33:57.870 INFO:tasks.workunit.client.0.smithi049.stdout:1/681: fsync d2/d8/db/d25/d62/fdb 0 2024-02-22T00:33:57.871 INFO:tasks.workunit.client.0.smithi049.stdout:8/701: dwrite d1/f9c [0,4194304] 0 2024-02-22T00:33:57.873 INFO:tasks.workunit.client.0.smithi049.stdout:5/593: write d0/f32 [997591,51014] 0 2024-02-22T00:33:57.876 INFO:tasks.workunit.client.0.smithi049.stdout:4/653: chown d3/d8/d10/d43/d4d/db9/d8a/fcf 227 1 2024-02-22T00:33:57.877 INFO:tasks.workunit.client.0.smithi049.stdout:1/682: truncate d2/d8/da/fc8 216222 0 2024-02-22T00:33:57.877 INFO:tasks.workunit.client.0.smithi049.stdout:5/594: mkdir d0/d20/dc5 0 2024-02-22T00:33:57.878 INFO:tasks.workunit.client.0.smithi049.stdout:1/683: chown d2/le5 728304 1 2024-02-22T00:33:57.878 INFO:tasks.workunit.client.0.smithi049.stdout:8/702: mknod d1/d2/d5/d1b/d39/d81/cf7 0 2024-02-22T00:33:57.879 INFO:tasks.workunit.client.0.smithi049.stdout:5/595: chown d0/d20/d84/da0/db6/dc3/d6f/c79 0 1 2024-02-22T00:33:57.881 INFO:tasks.workunit.client.0.smithi049.stdout:1/684: mkdir d2/d8/db/d25/d40/de8 0 2024-02-22T00:33:57.885 INFO:tasks.workunit.client.0.smithi049.stdout:6/612: truncate d3/d64/f26 2401405 0 2024-02-22T00:33:57.886 INFO:tasks.workunit.client.0.smithi049.stdout:8/703: dread d1/f9c [0,4194304] 0 2024-02-22T00:33:57.886 INFO:tasks.workunit.client.0.smithi049.stdout:4/654: dwrite d3/d8/d10/d12/f38 [0,4194304] 0 2024-02-22T00:33:57.886 INFO:tasks.workunit.client.0.smithi049.stdout:5/596: creat d0/d20/d84/da0/db6/dc3/d70/db1/d9e/fc6 x:0 0 0 2024-02-22T00:33:57.888 INFO:tasks.workunit.client.0.smithi049.stdout:6/613: truncate d3/ff 5485743 0 2024-02-22T00:33:57.890 INFO:tasks.workunit.client.0.smithi049.stdout:1/685: read d2/d8/db/f1c [2079693,57870] 0 2024-02-22T00:33:57.892 INFO:tasks.workunit.client.0.smithi049.stdout:4/655: creat d3/d22/d49/d57/fdc x:0 0 0 2024-02-22T00:33:57.893 INFO:tasks.workunit.client.0.smithi049.stdout:8/704: write d1/d2/da5/d15/d30/d36/d52/daf/fd8 [1509636,24870] 0 2024-02-22T00:33:57.897 INFO:tasks.workunit.client.0.smithi049.stdout:8/705: fsync d1/f9c 0 2024-02-22T00:33:57.901 INFO:tasks.workunit.client.0.smithi049.stdout:5/597: dwrite d0/d20/d50/d24/f75 [0,4194304] 0 2024-02-22T00:33:57.902 INFO:tasks.workunit.client.0.smithi049.stdout:8/706: stat d1/d2/da5/d15/f23 0 2024-02-22T00:33:57.902 INFO:tasks.workunit.client.0.smithi049.stdout:5/598: stat d0/d20/f6a 0 2024-02-22T00:33:57.903 INFO:tasks.workunit.client.0.smithi049.stdout:1/686: write d2/f31 [786747,55093] 0 2024-02-22T00:33:57.904 INFO:tasks.workunit.client.0.smithi049.stdout:4/656: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd 0 2024-02-22T00:33:57.907 INFO:tasks.workunit.client.0.smithi049.stdout:5/599: truncate d0/d20/f7b 2076290 0 2024-02-22T00:33:57.907 INFO:tasks.workunit.client.0.smithi049.stdout:6/614: dwrite d3/d64/d59/fcb [0,4194304] 0 2024-02-22T00:33:57.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/657: truncate f2 809176 0 2024-02-22T00:33:57.912 INFO:tasks.workunit.client.0.smithi049.stdout:5/600: read d0/d20/d84/da0/db6/dc3/d6f/f61 [3137056,88034] 0 2024-02-22T00:33:57.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/707: write d1/d2/f2e [204333,124553] 0 2024-02-22T00:33:57.913 INFO:tasks.workunit.client.0.smithi049.stdout:1/687: creat d2/d8/db/d25/d62/dcb/fe9 x:0 0 0 2024-02-22T00:33:57.914 INFO:tasks.workunit.client.0.smithi049.stdout:6/615: mknod d3/dcd/cd1 0 2024-02-22T00:33:57.914 INFO:tasks.workunit.client.0.smithi049.stdout:4/658: fdatasync d3/d22/d49/d57/fdc 0 2024-02-22T00:33:57.917 INFO:tasks.workunit.client.0.smithi049.stdout:6/616: write d3/d16/d45/f99 [3467667,24768] 0 2024-02-22T00:33:57.917 INFO:tasks.workunit.client.0.smithi049.stdout:1/688: dread - d2/d8/db/d25/d40/d41/f83 zero size 2024-02-22T00:33:57.920 INFO:tasks.workunit.client.0.smithi049.stdout:4/659: creat d3/fde x:0 0 0 2024-02-22T00:33:57.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/617: creat d3/d36/d70/dcc/d4d/d8b/fd2 x:0 0 0 2024-02-22T00:33:57.925 INFO:tasks.workunit.client.0.smithi049.stdout:4/660: write d3/d22/d49/d57/fd5 [201866,11393] 0 2024-02-22T00:33:57.928 INFO:tasks.workunit.client.0.smithi049.stdout:8/708: dwrite d1/d2/f9a [0,4194304] 0 2024-02-22T00:33:57.928 INFO:tasks.workunit.client.0.smithi049.stdout:6/618: rmdir d3/d64/d59/d72/d92 39 2024-02-22T00:33:57.930 INFO:tasks.workunit.client.0.smithi049.stdout:4/661: dread - d3/d33/fda zero size 2024-02-22T00:33:57.934 INFO:tasks.workunit.client.0.smithi049.stdout:6/619: write d3/d16/d32/f98 [161748,129404] 0 2024-02-22T00:33:57.936 INFO:tasks.workunit.client.0.smithi049.stdout:1/689: dwrite d2/d8/db/d25/d40/d41/d68/d78/fc5 [4194304,4194304] 0 2024-02-22T00:33:57.938 INFO:tasks.workunit.client.0.smithi049.stdout:1/690: dread - d2/d8/db/d25/d40/d41/d5b/f89 zero size 2024-02-22T00:33:57.943 INFO:tasks.workunit.client.0.smithi049.stdout:6/620: symlink d3/d16/d32/ld3 0 2024-02-22T00:33:57.943 INFO:tasks.workunit.client.0.smithi049.stdout:5/601: dwrite d0/d20/d84/da0/db6/dc3/d70/db1/fc0 [0,4194304] 0 2024-02-22T00:33:57.947 INFO:tasks.workunit.client.0.smithi049.stdout:6/621: write d3/f1a [736718,16941] 0 2024-02-22T00:33:57.949 INFO:tasks.workunit.client.0.smithi049.stdout:6/622: write d3/d36/f9d [897123,2692] 0 2024-02-22T00:33:57.953 INFO:tasks.workunit.client.0.smithi049.stdout:5/602: dwrite d0/d20/fa6 [0,4194304] 0 2024-02-22T00:33:57.956 INFO:tasks.workunit.client.0.smithi049.stdout:5/603: chown d0/f4c 756877 1 2024-02-22T00:33:57.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/604: stat d0/d20/f90 0 2024-02-22T00:33:57.959 INFO:tasks.workunit.client.0.smithi049.stdout:6/623: mkdir d3/d64/d60/dd4 0 2024-02-22T00:33:57.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/624: write d3/d64/d5f/f7d [97920,26032] 0 2024-02-22T00:33:57.962 INFO:tasks.workunit.client.0.smithi049.stdout:6/625: write d3/d16/f24 [4782408,57608] 0 2024-02-22T00:33:57.964 INFO:tasks.workunit.client.0.smithi049.stdout:1/691: truncate d2/d8/db/d25/d40/d41/fa1 364375 0 2024-02-22T00:33:57.967 INFO:tasks.workunit.client.0.smithi049.stdout:6/626: creat d3/d64/d5f/fd5 x:0 0 0 2024-02-22T00:33:57.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/692: mkdir d2/d8/db/d25/d62/dcc/dea 0 2024-02-22T00:33:57.974 INFO:tasks.workunit.client.0.smithi049.stdout:6/627: creat d3/d64/d60/da0/fd6 x:0 0 0 2024-02-22T00:33:57.988 INFO:tasks.workunit.client.0.smithi049.stdout:5/605: truncate d0/d20/dad/f5c 3703869 0 2024-02-22T00:33:57.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/628: dwrite d3/f29 [0,4194304] 0 2024-02-22T00:33:57.998 INFO:tasks.workunit.client.0.smithi049.stdout:5/606: mknod d0/d20/d84/cc7 0 2024-02-22T00:33:58.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/629: truncate d3/f20 1659612 0 2024-02-22T00:33:58.000 INFO:tasks.workunit.client.0.smithi049.stdout:5/607: dread - d0/d20/d50/f83 zero size 2024-02-22T00:33:58.000 INFO:tasks.workunit.client.0.smithi049.stdout:1/693: dread d2/d8/d4c/fe0 [0,4194304] 0 2024-02-22T00:33:58.001 INFO:tasks.workunit.client.0.smithi049.stdout:6/630: readlink d3/d64/l46 0 2024-02-22T00:33:58.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/631: write d3/d36/d70/fac [686524,75858] 0 2024-02-22T00:33:58.006 INFO:tasks.workunit.client.0.smithi049.stdout:5/608: fsync d0/d20/d84/da0/db6/dc3/fac 0 2024-02-22T00:33:58.007 INFO:tasks.workunit.client.0.smithi049.stdout:6/632: write d3/d36/fbc [474473,29370] 0 2024-02-22T00:33:58.008 INFO:tasks.workunit.client.0.smithi049.stdout:4/662: dread d3/d33/fb8 [0,4194304] 0 2024-02-22T00:33:58.008 INFO:tasks.workunit.client.0.smithi049.stdout:5/609: chown d0/d26/l59 0 1 2024-02-22T00:33:58.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/694: chown d2/c33 216300 1 2024-02-22T00:33:58.013 INFO:tasks.workunit.client.0.smithi049.stdout:6/633: truncate d3/d16/d32/f73 618597 0 2024-02-22T00:33:58.018 INFO:tasks.workunit.client.0.smithi049.stdout:6/634: chown d3/d16/c61 1512384090 1 2024-02-22T00:33:58.019 INFO:tasks.workunit.client.0.smithi049.stdout:5/610: rmdir d0/d20/d84/da0/db6/dc3/d6f/d94/dae 0 2024-02-22T00:33:58.023 INFO:tasks.workunit.client.0.smithi049.stdout:4/663: rename d3/d8/d10/d43/d4d/db9/d8a/d48/d60/l83 to d3/d8/ldf 0 2024-02-22T00:33:58.025 INFO:tasks.workunit.client.0.smithi049.stdout:6/635: creat d3/d64/d60/da0/fd7 x:0 0 0 2024-02-22T00:33:58.026 INFO:tasks.workunit.client.0.smithi049.stdout:4/664: read d3/d8/f1a [544613,77632] 0 2024-02-22T00:33:58.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/695: write d2/d8/db/f1c [682952,117139] 0 2024-02-22T00:33:58.031 INFO:tasks.workunit.client.0.smithi049.stdout:1/696: stat d2/c3a 0 2024-02-22T00:33:58.031 INFO:tasks.workunit.client.0.smithi049.stdout:4/665: creat d3/d22/d49/d57/fe0 x:0 0 0 2024-02-22T00:33:58.034 INFO:tasks.workunit.client.0.smithi049.stdout:1/697: dread - d2/d8/db/d25/d40/d4d/f64 zero size 2024-02-22T00:33:58.039 INFO:tasks.workunit.client.0.smithi049.stdout:4/666: symlink d3/d8/le1 0 2024-02-22T00:33:58.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/636: dwrite d3/d16/f1c [0,4194304] 0 2024-02-22T00:33:58.044 INFO:tasks.workunit.client.0.smithi049.stdout:5/611: truncate d0/d20/d50/d24/f88 1951002 0 2024-02-22T00:33:58.045 INFO:tasks.workunit.client.0.smithi049.stdout:4/667: read - d3/d8/d10/d12/fd1 zero size 2024-02-22T00:33:58.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/698: creat d2/d8/db/d25/d40/d41/d68/feb x:0 0 0 2024-02-22T00:33:58.051 INFO:tasks.workunit.client.0.smithi049.stdout:6/637: creat d3/d16/d3b/d8c/fd8 x:0 0 0 2024-02-22T00:33:58.053 INFO:tasks.workunit.client.0.smithi049.stdout:5/612: creat d0/d20/d84/da0/db6/dc3/d6f/da8/fc8 x:0 0 0 2024-02-22T00:33:58.054 INFO:tasks.workunit.client.0.smithi049.stdout:5/613: fdatasync d0/f32 0 2024-02-22T00:33:58.056 INFO:tasks.workunit.client.0.smithi049.stdout:6/638: creat d3/d16/d45/dd0/fd9 x:0 0 0 2024-02-22T00:33:58.058 INFO:tasks.workunit.client.0.smithi049.stdout:4/668: link d3/d8/d10/d43/d4d/db9/d8a/c16 d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ce2 0 2024-02-22T00:33:58.061 INFO:tasks.workunit.client.0.smithi049.stdout:4/669: chown d3/d22/d5c/da5/da8 2124 1 2024-02-22T00:33:58.064 INFO:tasks.workunit.client.0.smithi049.stdout:6/639: rename d3/d16/f4f to d3/d64/d60/dc2/fda 0 2024-02-22T00:33:58.065 INFO:tasks.workunit.client.0.smithi049.stdout:4/670: creat d3/d22/d3d/fe3 x:0 0 0 2024-02-22T00:33:58.069 INFO:tasks.workunit.client.0.smithi049.stdout:5/614: dread d0/d20/d50/d24/f88 [0,4194304] 0 2024-02-22T00:33:58.070 INFO:tasks.workunit.client.0.smithi049.stdout:4/671: mknod d3/ce4 0 2024-02-22T00:33:58.071 INFO:tasks.workunit.client.0.smithi049.stdout:6/640: dread d3/ff [0,4194304] 0 2024-02-22T00:33:58.072 INFO:tasks.workunit.client.0.smithi049.stdout:5/615: write d0/d20/d84/da0/fb0 [72756,81071] 0 2024-02-22T00:33:58.077 INFO:tasks.workunit.client.0.smithi049.stdout:5/616: write d0/d20/d84/da0/db6/dc3/d6f/da8/fc8 [808546,10478] 0 2024-02-22T00:33:58.077 INFO:tasks.workunit.client.0.smithi049.stdout:1/699: dread d2/d8/f27 [0,4194304] 0 2024-02-22T00:33:58.078 INFO:tasks.workunit.client.0.smithi049.stdout:6/641: creat d3/d36/d70/fdb x:0 0 0 2024-02-22T00:33:58.082 INFO:tasks.workunit.client.0.smithi049.stdout:6/642: truncate d3/d16/f2c 2992637 0 2024-02-22T00:33:58.086 INFO:tasks.workunit.client.0.smithi049.stdout:4/672: dwrite d3/d8/d10/d43/d4d/db9/f59 [4194304,4194304] 0 2024-02-22T00:33:58.088 INFO:tasks.workunit.client.0.smithi049.stdout:5/617: link d0/d20/d84/da0/db6/dc3/d64/f93 d0/d20/d84/da0/db6/dc3/d70/db1/dbe/fc9 0 2024-02-22T00:33:58.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/643: truncate d3/f43 1161057 0 2024-02-22T00:33:58.093 INFO:tasks.workunit.client.0.smithi049.stdout:1/700: dwrite d2/d8/db/d25/d40/d41/d68/d78/fc5 [4194304,4194304] 0 2024-02-22T00:33:58.093 INFO:tasks.workunit.client.0.smithi049.stdout:6/644: chown d3/d64/d60/f9e 2 1 2024-02-22T00:33:58.094 INFO:tasks.workunit.client.0.smithi049.stdout:4/673: unlink d3/d22/d5c/f77 0 2024-02-22T00:33:58.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/645: dread - d3/d16/d45/dd0/fd9 zero size 2024-02-22T00:33:58.096 INFO:tasks.workunit.client.0.smithi049.stdout:5/618: symlink d0/d20/d50/lca 0 2024-02-22T00:33:58.102 INFO:tasks.workunit.client.0.smithi049.stdout:4/674: mkdir d3/d22/d5c/d9a/dd9/de5 0 2024-02-22T00:33:58.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/646: rename d3/d64/d59/d72/d92/d6c/l8a to d3/d36/d57/ldc 0 2024-02-22T00:33:58.108 INFO:tasks.workunit.client.0.smithi049.stdout:6/647: symlink d3/d16/d32/d7b/ldd 0 2024-02-22T00:33:58.110 INFO:tasks.workunit.client.0.smithi049.stdout:5/619: getdents d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a 0 2024-02-22T00:33:58.111 INFO:tasks.workunit.client.0.smithi049.stdout:6/648: write d3/f1d [4093208,125143] 0 2024-02-22T00:33:58.114 INFO:tasks.workunit.client.0.smithi049.stdout:4/675: dwrite d3/f4b [0,4194304] 0 2024-02-22T00:33:58.115 INFO:tasks.workunit.client.0.smithi049.stdout:6/649: write d3/d64/d60/da0/fa8 [809987,32063] 0 2024-02-22T00:33:58.121 INFO:tasks.workunit.client.0.smithi049.stdout:5/620: creat d0/d20/d84/da0/db6/dc3/d70/db1/d9e/fcb x:0 0 0 2024-02-22T00:33:58.121 INFO:tasks.workunit.client.0.smithi049.stdout:4/676: readlink d3/d22/d5c/d9a/ld7 0 2024-02-22T00:33:58.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/650: stat d3/d36/d57/d75/fb6 0 2024-02-22T00:33:58.124 INFO:tasks.workunit.client.0.smithi049.stdout:5/621: fdatasync d0/d20/dad/f5c 0 2024-02-22T00:33:58.126 INFO:tasks.workunit.client.0.smithi049.stdout:5/622: chown d0/d20/d50/ca3 6865060 1 2024-02-22T00:33:58.126 INFO:tasks.workunit.client.0.smithi049.stdout:6/651: unlink d3/d16/d32/f42 0 2024-02-22T00:33:58.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/677: rename d3/d8/d10/d43/d4d/db9/f98 to d3/d8/d10/d43/d4d/db9/d92/fe6 0 2024-02-22T00:33:58.128 INFO:tasks.workunit.client.0.smithi049.stdout:4/678: fsync d3/d22/d5c/f36 0 2024-02-22T00:33:58.129 INFO:tasks.workunit.client.0.smithi049.stdout:6/652: mknod d3/d64/d60/da0/cde 0 2024-02-22T00:33:58.132 INFO:tasks.workunit.client.0.smithi049.stdout:4/679: mkdir d3/d8/d10/d43/d4d/db9/de7 0 2024-02-22T00:33:58.134 INFO:tasks.workunit.client.0.smithi049.stdout:4/680: write d3/d8/d10/d43/d4d/db9/f59 [1399519,4339] 0 2024-02-22T00:33:58.135 INFO:tasks.workunit.client.0.smithi049.stdout:6/653: dread d3/d16/f1c [0,4194304] 0 2024-02-22T00:33:58.136 INFO:tasks.workunit.client.0.smithi049.stdout:6/654: fsync d3/d16/d32/f73 0 2024-02-22T00:33:58.138 INFO:tasks.workunit.client.0.smithi049.stdout:4/681: symlink d3/d8/d10/d43/d4d/db9/d8a/le8 0 2024-02-22T00:33:58.139 INFO:tasks.workunit.client.0.smithi049.stdout:6/655: creat d3/d64/d60/dc2/fdf x:0 0 0 2024-02-22T00:33:58.139 INFO:tasks.workunit.client.0.smithi049.stdout:4/682: chown d3/d22/d49/d57/fdc 2842 1 2024-02-22T00:33:58.139 INFO:tasks.workunit.client.0.smithi049.stdout:6/656: chown d3/d64/f22 6 1 2024-02-22T00:33:58.140 INFO:tasks.workunit.client.0.smithi049.stdout:6/657: chown d3/dcd/cd1 28964 1 2024-02-22T00:33:58.143 INFO:tasks.workunit.client.0.smithi049.stdout:6/658: dread - d3/d16/d32/f71 zero size 2024-02-22T00:33:58.144 INFO:tasks.workunit.client.0.smithi049.stdout:5/623: dread d0/f7e [0,4194304] 0 2024-02-22T00:33:58.144 INFO:tasks.workunit.client.0.smithi049.stdout:4/683: dread d3/d8/d10/d43/d4d/db9/f59 [4194304,4194304] 0 2024-02-22T00:33:58.146 INFO:tasks.workunit.client.0.smithi049.stdout:4/684: dread - d3/d8/d10/d43/fd6 zero size 2024-02-22T00:33:58.146 INFO:tasks.workunit.client.0.smithi049.stdout:6/659: dread d3/d36/d70/dcc/f55 [0,4194304] 0 2024-02-22T00:33:58.148 INFO:tasks.workunit.client.0.smithi049.stdout:4/685: write d3/d22/f52 [379379,53280] 0 2024-02-22T00:33:58.148 INFO:tasks.workunit.client.0.smithi049.stdout:6/660: truncate d3/d16/d32/f71 315568 0 2024-02-22T00:33:58.150 INFO:tasks.workunit.client.0.smithi049.stdout:5/624: getdents d0/d20/d84/da0/db6/dc3/d6f/d94/d9c 0 2024-02-22T00:33:58.150 INFO:tasks.workunit.client.0.smithi049.stdout:4/686: mknod d3/d8/ce9 0 2024-02-22T00:33:58.151 INFO:tasks.workunit.client.0.smithi049.stdout:6/661: creat d3/d16/d3b/fe0 x:0 0 0 2024-02-22T00:33:58.154 INFO:tasks.workunit.client.0.smithi049.stdout:6/662: unlink d3/d16/d32/f68 0 2024-02-22T00:33:58.157 INFO:tasks.workunit.client.0.smithi049.stdout:4/687: dwrite d3/d8/d10/d39/f9f [0,4194304] 0 2024-02-22T00:33:58.157 INFO:tasks.workunit.client.0.smithi049.stdout:6/663: truncate d3/f43 530840 0 2024-02-22T00:33:58.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/664: dread - d3/d36/d70/dcc/faf zero size 2024-02-22T00:33:58.159 INFO:tasks.workunit.client.0.smithi049.stdout:4/688: readlink d3/d8/d10/d43/d4d/db9/d8a/d48/d60/l7d 0 2024-02-22T00:33:58.159 INFO:tasks.workunit.client.0.smithi049.stdout:6/665: write d3/d64/f22 [502652,15345] 0 2024-02-22T00:33:58.167 INFO:tasks.workunit.client.0.smithi049.stdout:6/666: rename d3/d36/d70/dcc/d4d/d8b/fb2 to d3/d36/d70/dcc/d4d/d8b/fe1 0 2024-02-22T00:33:58.167 INFO:tasks.workunit.client.0.smithi049.stdout:4/689: dwrite d3/d22/d49/f85 [0,4194304] 0 2024-02-22T00:33:58.172 INFO:tasks.workunit.client.0.smithi049.stdout:6/667: unlink d3/d36/d70/c7c 0 2024-02-22T00:33:58.175 INFO:tasks.workunit.client.0.smithi049.stdout:4/690: dwrite d3/d22/d3d/fbe [0,4194304] 0 2024-02-22T00:33:58.175 INFO:tasks.workunit.client.0.smithi049.stdout:6/668: symlink d3/d16/d32/le2 0 2024-02-22T00:33:58.180 INFO:tasks.workunit.client.0.smithi049.stdout:4/691: dread d3/d8/d10/d39/f9f [0,4194304] 0 2024-02-22T00:33:58.220 INFO:tasks.workunit.client.0.smithi049.stdout:6/669: rmdir d3/d36/d70 39 2024-02-22T00:33:58.232 INFO:tasks.workunit.client.0.smithi049.stdout:4/692: dwrite d3/d8/d10/d45/f79 [0,4194304] 0 2024-02-22T00:33:58.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/693: write d3/d22/d5c/da5/da8/faa [1721219,103381] 0 2024-02-22T00:33:58.235 INFO:tasks.workunit.client.0.smithi049.stdout:6/670: dread d3/d64/f35 [0,4194304] 0 2024-02-22T00:33:58.237 INFO:tasks.workunit.client.0.smithi049.stdout:4/694: mknod d3/d8/d72/cea 0 2024-02-22T00:33:58.239 INFO:tasks.workunit.client.0.smithi049.stdout:6/671: chown d3/fa1 10852 1 2024-02-22T00:33:58.243 INFO:tasks.workunit.client.0.smithi049.stdout:6/672: creat d3/d16/d32/d7b/fe3 x:0 0 0 2024-02-22T00:33:58.244 INFO:tasks.workunit.client.0.smithi049.stdout:4/695: getdents d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd 0 2024-02-22T00:33:58.244 INFO:tasks.workunit.client.0.smithi049.stdout:6/673: rmdir d3 39 2024-02-22T00:33:58.245 INFO:tasks.workunit.client.0.smithi049.stdout:4/696: dread - d3/d8/d72/fa7 zero size 2024-02-22T00:33:58.251 INFO:tasks.workunit.client.0.smithi049.stdout:6/674: dread d3/d16/f1c [0,4194304] 0 2024-02-22T00:33:58.253 INFO:tasks.workunit.client.0.smithi049.stdout:4/697: dwrite d3/d33/f46 [0,4194304] 0 2024-02-22T00:33:58.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/675: creat d3/d64/d59/d72/d92/fe4 x:0 0 0 2024-02-22T00:33:58.264 INFO:tasks.workunit.client.0.smithi049.stdout:6/676: truncate d3/d64/f35 1586236 0 2024-02-22T00:33:58.265 INFO:tasks.workunit.client.0.smithi049.stdout:4/698: dread d3/d22/d5c/da5/da8/faa [0,4194304] 0 2024-02-22T00:33:58.270 INFO:tasks.workunit.client.0.smithi049.stdout:4/699: link d3/d8/l1d d3/d8/d10/d43/d4d/leb 0 2024-02-22T00:33:58.271 INFO:tasks.workunit.client.0.smithi049.stdout:6/677: dwrite d3/f5 [0,4194304] 0 2024-02-22T00:33:58.272 INFO:tasks.workunit.client.0.smithi049.stdout:4/700: write d3/d22/d49/d57/fdc [314807,5802] 0 2024-02-22T00:33:58.276 INFO:tasks.workunit.client.0.smithi049.stdout:4/701: rmdir d3/d22/d5c/d9a 39 2024-02-22T00:33:58.276 INFO:tasks.workunit.client.0.smithi049.stdout:6/678: dread d3/d64/d5f/f82 [0,4194304] 0 2024-02-22T00:33:58.278 INFO:tasks.workunit.client.0.smithi049.stdout:4/702: write d3/d8/d10/d12/d3f/fa2 [132807,47700] 0 2024-02-22T00:33:58.279 INFO:tasks.workunit.client.0.smithi049.stdout:6/679: write d3/d36/f4e [1883904,92633] 0 2024-02-22T00:33:58.285 INFO:tasks.workunit.client.0.smithi049.stdout:6/680: dwrite d3/d64/d59/fcb [0,4194304] 0 2024-02-22T00:33:58.294 INFO:tasks.workunit.client.0.smithi049.stdout:6/681: write d3/d64/d60/fc1 [603849,93241] 0 2024-02-22T00:33:58.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/682: dread - d3/d64/d59/d72/d92/fbd zero size 2024-02-22T00:33:58.301 INFO:tasks.workunit.client.0.smithi049.stdout:6/683: symlink d3/d64/d59/d72/le5 0 2024-02-22T00:33:58.305 INFO:tasks.workunit.client.0.smithi049.stdout:6/684: mknod d3/d36/d70/dcc/d4d/ce6 0 2024-02-22T00:33:58.306 INFO:tasks.workunit.client.0.smithi049.stdout:6/685: mknod d3/d36/d70/dcc/ce7 0 2024-02-22T00:33:58.308 INFO:tasks.workunit.client.0.smithi049.stdout:6/686: dread - d3/d16/d3b/f7e zero size 2024-02-22T00:33:58.308 INFO:tasks.workunit.client.0.smithi049.stdout:6/687: chown d3/d16/d32/l79 9571 1 2024-02-22T00:33:58.310 INFO:tasks.workunit.client.0.smithi049.stdout:6/688: truncate d3/d37/fa5 53492 0 2024-02-22T00:33:58.313 INFO:tasks.workunit.client.0.smithi049.stdout:6/689: creat d3/d36/d70/dcc/d4d/d8b/fe8 x:0 0 0 2024-02-22T00:33:58.314 INFO:tasks.workunit.client.0.smithi049.stdout:6/690: mknod d3/d36/d57/d75/ce9 0 2024-02-22T00:33:58.315 INFO:tasks.workunit.client.0.smithi049.stdout:6/691: fdatasync d3/f9b 0 2024-02-22T00:33:58.421 INFO:tasks.workunit.client.0.smithi049.stdout:7/685: sync 2024-02-22T00:33:58.421 INFO:tasks.workunit.client.0.smithi049.stdout:3/535: sync 2024-02-22T00:33:58.421 INFO:tasks.workunit.client.0.smithi049.stdout:2/613: sync 2024-02-22T00:33:58.421 INFO:tasks.workunit.client.0.smithi049.stdout:0/621: sync 2024-02-22T00:33:58.422 INFO:tasks.workunit.client.0.smithi049.stdout:7/686: write d1/df/d62/f30 [19188,39871] 0 2024-02-22T00:33:58.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/536: fsync d0/dd/f48 0 2024-02-22T00:33:58.424 INFO:tasks.workunit.client.0.smithi049.stdout:7/687: chown d1/df/d62/d1c/d1d/d6e/lc8 6375284 1 2024-02-22T00:33:58.425 INFO:tasks.workunit.client.0.smithi049.stdout:7/688: fdatasync d1/d41/d28/fa7 0 2024-02-22T00:33:58.425 INFO:tasks.workunit.client.0.smithi049.stdout:3/537: chown d0/d14/f1d 189 1 2024-02-22T00:33:58.426 INFO:tasks.workunit.client.0.smithi049.stdout:2/614: creat d2/d9/dd/d4d/d5a/fe5 x:0 0 0 2024-02-22T00:33:58.430 INFO:tasks.workunit.client.0.smithi049.stdout:3/538: symlink d0/d59/d87/la1 0 2024-02-22T00:33:58.432 INFO:tasks.workunit.client.0.smithi049.stdout:0/622: dwrite d3/fa9 [0,4194304] 0 2024-02-22T00:33:58.432 INFO:tasks.workunit.client.0.smithi049.stdout:7/689: write d1/d41/f3b [1597442,129130] 0 2024-02-22T00:33:58.433 INFO:tasks.workunit.client.0.smithi049.stdout:3/539: readlink d0/d14/d4d/d4e/d4f/d5b/l7b 0 2024-02-22T00:33:58.435 INFO:tasks.workunit.client.0.smithi049.stdout:0/623: write d3/df/f2b [4579580,86187] 0 2024-02-22T00:33:58.436 INFO:tasks.workunit.client.0.smithi049.stdout:2/615: rename d2/d9/de/d10/l13 to d2/d9/de/d10/d2e/d42/d80/le6 0 2024-02-22T00:33:58.439 INFO:tasks.workunit.client.0.smithi049.stdout:3/540: mknod d0/d14/d4d/ca2 0 2024-02-22T00:33:58.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/690: rename d1/d41/d28/f79 to d1/df/d62/d1c/d1d/d70/ff3 0 2024-02-22T00:33:58.444 INFO:tasks.workunit.client.0.smithi049.stdout:7/691: readlink d1/df/d62/d48/l54 0 2024-02-22T00:33:58.445 INFO:tasks.workunit.client.0.smithi049.stdout:0/624: dwrite d3/df/d48/d63/f97 [0,4194304] 0 2024-02-22T00:33:58.446 INFO:tasks.workunit.client.0.smithi049.stdout:7/692: fdatasync d1/df/f45 0 2024-02-22T00:33:58.447 INFO:tasks.workunit.client.0.smithi049.stdout:2/616: rename d2/d9/de/d10/d2e/d42/d80/l84 to d2/d9/dd/d4d/d5a/d99/le7 0 2024-02-22T00:33:58.450 INFO:tasks.workunit.client.0.smithi049.stdout:0/625: symlink d3/d6/d8/lb8 0 2024-02-22T00:33:58.450 INFO:tasks.workunit.client.0.smithi049.stdout:3/541: dwrite d0/d14/f1b [0,4194304] 0 2024-02-22T00:33:58.452 INFO:tasks.workunit.client.0.smithi049.stdout:7/693: symlink d1/d41/d28/lf4 0 2024-02-22T00:33:58.454 INFO:tasks.workunit.client.0.smithi049.stdout:0/626: creat d3/d6/d8/d36/d81/fb9 x:0 0 0 2024-02-22T00:33:58.459 INFO:tasks.workunit.client.0.smithi049.stdout:7/694: truncate d1/df/d62/d1c/d24/f52 3831221 0 2024-02-22T00:33:58.461 INFO:tasks.workunit.client.0.smithi049.stdout:7/695: truncate d1/d41/dae/fdc 902087 0 2024-02-22T00:33:58.462 INFO:tasks.workunit.client.0.smithi049.stdout:2/617: write d2/dda/d63/f7e [1038944,102529] 0 2024-02-22T00:33:58.464 INFO:tasks.workunit.client.0.smithi049.stdout:7/696: chown d1/d41/d28/d71/d72/d95/l96 2682 1 2024-02-22T00:33:58.467 INFO:tasks.workunit.client.0.smithi049.stdout:2/618: mknod d2/d9/dd/ce8 0 2024-02-22T00:33:58.468 INFO:tasks.workunit.client.0.smithi049.stdout:7/697: creat d1/df/d62/d60/ff5 x:0 0 0 2024-02-22T00:33:58.468 INFO:tasks.workunit.client.0.smithi049.stdout:0/627: dwrite d3/df/d17/d50/d62/f67 [4194304,4194304] 0 2024-02-22T00:33:58.473 INFO:tasks.workunit.client.0.smithi049.stdout:0/628: creat d3/d6/d8/fba x:0 0 0 2024-02-22T00:33:58.474 INFO:tasks.workunit.client.0.smithi049.stdout:7/698: creat d1/d41/ff6 x:0 0 0 2024-02-22T00:33:58.476 INFO:tasks.workunit.client.0.smithi049.stdout:2/619: getdents d2/d9/de/d10/d2e/d42/d80/dcc 0 2024-02-22T00:33:58.478 INFO:tasks.workunit.client.0.smithi049.stdout:2/620: truncate d2/d9/dd/d4d/da7/dd2/fe1 953836 0 2024-02-22T00:33:58.479 INFO:tasks.workunit.client.0.smithi049.stdout:7/699: rename d1/df/d62/d1c/d24/f4b to d1/d41/d55/d89/ff7 0 2024-02-22T00:33:58.481 INFO:tasks.workunit.client.0.smithi049.stdout:2/621: write d2/d9/de/d10/d2e/d42/d80/fe0 [84894,120277] 0 2024-02-22T00:33:58.487 INFO:tasks.workunit.client.0.smithi049.stdout:2/622: dread d2/d9/dd/d4d/d5a/fa3 [0,4194304] 0 2024-02-22T00:33:58.489 INFO:tasks.workunit.client.0.smithi049.stdout:2/623: mkdir d2/d9/de/d15/d1b/dc4/de9 0 2024-02-22T00:33:58.493 INFO:tasks.workunit.client.0.smithi049.stdout:2/624: dread d2/d9/de/d10/fbc [0,4194304] 0 2024-02-22T00:33:58.495 INFO:tasks.workunit.client.0.smithi049.stdout:2/625: write d2/dda/d63/f6c [1063876,12738] 0 2024-02-22T00:33:58.500 INFO:tasks.workunit.client.0.smithi049.stdout:2/626: link d2/d9/dd/d4d/d5a/fa3 d2/d9/dd/fea 0 2024-02-22T00:33:58.504 INFO:tasks.workunit.client.0.smithi049.stdout:7/700: dread d1/df/fe9 [0,4194304] 0 2024-02-22T00:33:58.505 INFO:tasks.workunit.client.0.smithi049.stdout:2/627: readlink d2/d9/de/d10/d2e/d42/d80/le6 0 2024-02-22T00:33:58.511 INFO:tasks.workunit.client.0.smithi049.stdout:7/701: rename d1/d41/d28/d71/ld2 to d1/df/d62/d57/lf8 0 2024-02-22T00:33:58.512 INFO:tasks.workunit.client.0.smithi049.stdout:7/702: write d1/d41/d28/fa7 [408600,40479] 0 2024-02-22T00:33:58.517 INFO:tasks.workunit.client.0.smithi049.stdout:2/628: rename d2/d9/de/d10/d2e/d42/d80/c86 to d2/d9/de/d10/d2e/d42/ceb 0 2024-02-22T00:33:58.520 INFO:tasks.workunit.client.0.smithi049.stdout:7/703: dwrite d1/df/d62/d1c/d24/d2e/f42 [0,4194304] 0 2024-02-22T00:33:58.522 INFO:tasks.workunit.client.0.smithi049.stdout:2/629: truncate d2/d9/de/d15/d1b/f96 605705 0 2024-02-22T00:33:58.524 INFO:tasks.workunit.client.0.smithi049.stdout:7/704: creat d1/df/d62/d48/d8e/ff9 x:0 0 0 2024-02-22T00:33:58.526 INFO:tasks.workunit.client.0.smithi049.stdout:2/630: rename d2/d9/de/d15/cc8 to d2/d9/de/d10/d59/cec 0 2024-02-22T00:33:58.527 INFO:tasks.workunit.client.0.smithi049.stdout:2/631: fsync d2/dda/d63/f7e 0 2024-02-22T00:33:58.530 INFO:tasks.workunit.client.0.smithi049.stdout:7/705: rename d1/d41/d55/fea to d1/df/d62/d60/d7e/de6/ded/ffa 0 2024-02-22T00:33:58.531 INFO:tasks.workunit.client.0.smithi049.stdout:2/632: fdatasync d2/d9/d17/f83 0 2024-02-22T00:33:58.533 INFO:tasks.workunit.client.0.smithi049.stdout:7/706: creat d1/df/d62/d1c/d24/d2e/df0/ffb x:0 0 0 2024-02-22T00:33:58.534 INFO:tasks.workunit.client.0.smithi049.stdout:7/707: write d1/df/d62/d1c/d6d/fb2 [575255,104272] 0 2024-02-22T00:33:58.535 INFO:tasks.workunit.client.0.smithi049.stdout:2/633: creat d2/dda/fed x:0 0 0 2024-02-22T00:33:58.535 INFO:tasks.workunit.client.0.smithi049.stdout:7/708: readlink d1/ld 0 2024-02-22T00:33:58.540 INFO:tasks.workunit.client.0.smithi049.stdout:7/709: rename d1/df/d62/d1c/d1d/d70/cc4 to d1/d49/d4d/cfc 0 2024-02-22T00:33:58.541 INFO:tasks.workunit.client.0.smithi049.stdout:2/634: getdents d2/d9/de/d10/d2e 0 2024-02-22T00:33:58.543 INFO:tasks.workunit.client.0.smithi049.stdout:2/635: write d2/dda/f68 [2376111,113041] 0 2024-02-22T00:33:58.547 INFO:tasks.workunit.client.0.smithi049.stdout:7/710: mkdir d1/df/d62/d60/d7e/de6/de8/dfd 0 2024-02-22T00:33:58.549 INFO:tasks.workunit.client.0.smithi049.stdout:2/636: unlink d2/d9/dd/fa9 0 2024-02-22T00:33:58.549 INFO:tasks.workunit.client.0.smithi049.stdout:2/637: dread - d2/dda/fed zero size 2024-02-22T00:33:58.551 INFO:tasks.workunit.client.0.smithi049.stdout:7/711: symlink d1/d49/d5a/lfe 0 2024-02-22T00:33:58.563 INFO:tasks.workunit.client.0.smithi049.stdout:7/712: dread d1/d41/d28/f39 [4194304,4194304] 0 2024-02-22T00:33:58.567 INFO:tasks.workunit.client.0.smithi049.stdout:7/713: mknod d1/df/d62/d1c/d1d/cff 0 2024-02-22T00:33:58.570 INFO:tasks.workunit.client.0.smithi049.stdout:7/714: link d1/df/d62/d48/fcc d1/df/d62/d60/d7e/de6/de8/f100 0 2024-02-22T00:33:58.572 INFO:tasks.workunit.client.0.smithi049.stdout:7/715: symlink d1/df/d62/d1c/d6d/l101 0 2024-02-22T00:33:58.573 INFO:tasks.workunit.client.0.smithi049.stdout:7/716: write d1/df/d62/d1c/d1d/d6e/f76 [5932010,3269] 0 2024-02-22T00:33:58.583 INFO:tasks.workunit.client.0.smithi049.stdout:7/717: dread d1/df/d62/d1c/d1d/f34 [4194304,4194304] 0 2024-02-22T00:33:58.585 INFO:tasks.workunit.client.0.smithi049.stdout:9/712: sync 2024-02-22T00:33:58.588 INFO:tasks.workunit.client.0.smithi049.stdout:9/713: symlink d17/d21/d4e/d4b/lea 0 2024-02-22T00:33:58.589 INFO:tasks.workunit.client.0.smithi049.stdout:9/714: write d17/d1c/d25/d71/da3/fb7 [4297873,5382] 0 2024-02-22T00:33:58.590 INFO:tasks.workunit.client.0.smithi049.stdout:9/715: write d17/d1c/d77/fd7 [745182,87131] 0 2024-02-22T00:33:58.592 INFO:tasks.workunit.client.0.smithi049.stdout:9/716: rename d17/d1c/d25 to d17/d1c/d25/d39/deb 22 2024-02-22T00:33:58.598 INFO:tasks.workunit.client.0.smithi049.stdout:7/718: dread d1/d49/d4d/f86 [0,4194304] 0 2024-02-22T00:33:58.600 INFO:tasks.workunit.client.0.smithi049.stdout:7/719: write d1/df/d62/d60/f7c [4430444,75125] 0 2024-02-22T00:33:58.604 INFO:tasks.workunit.client.0.smithi049.stdout:7/720: creat d1/d41/dae/f102 x:0 0 0 2024-02-22T00:33:58.606 INFO:tasks.workunit.client.0.smithi049.stdout:9/717: dread d17/d1c/d25/d39/d90/fb8 [0,4194304] 0 2024-02-22T00:33:58.607 INFO:tasks.workunit.client.0.smithi049.stdout:7/721: mknod d1/df/d62/d7a/c103 0 2024-02-22T00:33:58.613 INFO:tasks.workunit.client.0.smithi049.stdout:7/722: creat d1/f104 x:0 0 0 2024-02-22T00:33:58.614 INFO:tasks.workunit.client.0.smithi049.stdout:9/718: link d17/d21/d4e/c41 d17/d1c/d8c/db0/cec 0 2024-02-22T00:33:58.616 INFO:tasks.workunit.client.0.smithi049.stdout:9/719: creat d17/d21/d85/fed x:0 0 0 2024-02-22T00:33:58.617 INFO:tasks.workunit.client.0.smithi049.stdout:9/720: fsync d17/d21/d47/d7a/fa0 0 2024-02-22T00:33:58.618 INFO:tasks.workunit.client.0.smithi049.stdout:7/723: dread d1/df/d62/d1c/d24/d2e/f42 [0,4194304] 0 2024-02-22T00:33:58.629 INFO:tasks.workunit.client.0.smithi049.stdout:9/721: dread d17/d1c/f1e [0,4194304] 0 2024-02-22T00:33:58.632 INFO:tasks.workunit.client.0.smithi049.stdout:9/722: symlink d17/d21/d4e/lee 0 2024-02-22T00:33:58.633 INFO:tasks.workunit.client.0.smithi049.stdout:9/723: chown d17/d21/d4e/f8e 11316 1 2024-02-22T00:33:58.634 INFO:tasks.workunit.client.0.smithi049.stdout:7/724: dread d1/df/d62/d48/f8b [0,4194304] 0 2024-02-22T00:33:58.636 INFO:tasks.workunit.client.0.smithi049.stdout:9/724: mkdir d17/d1c/d25/dba/def 0 2024-02-22T00:33:58.637 INFO:tasks.workunit.client.0.smithi049.stdout:7/725: fdatasync d1/df/d62/d1c/d24/f32 0 2024-02-22T00:33:58.639 INFO:tasks.workunit.client.0.smithi049.stdout:9/725: write d17/d1c/d25/d39/fb1 [3650242,131058] 0 2024-02-22T00:33:58.644 INFO:tasks.workunit.client.0.smithi049.stdout:9/726: rename d17/d1c/d25/d39/d67 to d17/d21/d4e/d89/d94/df0 0 2024-02-22T00:33:58.645 INFO:tasks.workunit.client.0.smithi049.stdout:9/727: write d17/d21/d3c/f59 [1518690,96523] 0 2024-02-22T00:33:58.646 INFO:tasks.workunit.client.0.smithi049.stdout:7/726: link d1/df/d62/d1c/d24/d2e/f42 d1/df/d62/d48/f105 0 2024-02-22T00:33:58.647 INFO:tasks.workunit.client.0.smithi049.stdout:9/728: mknod d17/d1c/d77/de7/cf1 0 2024-02-22T00:33:58.648 INFO:tasks.workunit.client.0.smithi049.stdout:7/727: stat d1/d49/d4d/cfc 0 2024-02-22T00:33:58.650 INFO:tasks.workunit.client.0.smithi049.stdout:7/728: creat d1/df/d62/d60/d7e/f106 x:0 0 0 2024-02-22T00:33:58.651 INFO:tasks.workunit.client.0.smithi049.stdout:7/729: chown d1/d41/dae/fdc 211 1 2024-02-22T00:33:58.656 INFO:tasks.workunit.client.0.smithi049.stdout:7/730: rename d1/d41/l6a to d1/d41/d28/d71/d72/l107 0 2024-02-22T00:33:58.660 INFO:tasks.workunit.client.0.smithi049.stdout:7/731: getdents d1/d41/d55 0 2024-02-22T00:33:58.661 INFO:tasks.workunit.client.0.smithi049.stdout:9/729: write d17/d1c/d25/d71/f7d [2691177,70196] 0 2024-02-22T00:33:58.663 INFO:tasks.workunit.client.0.smithi049.stdout:7/732: creat d1/df/d62/d1c/d24/d2e/f108 x:0 0 0 2024-02-22T00:33:58.664 INFO:tasks.workunit.client.0.smithi049.stdout:7/733: chown d1/df/d62/d48 2 1 2024-02-22T00:33:58.667 INFO:tasks.workunit.client.0.smithi049.stdout:7/734: unlink d1/df/d62/d1c/d1d/d70/ff3 0 2024-02-22T00:33:58.669 INFO:tasks.workunit.client.0.smithi049.stdout:9/730: dwrite d17/d1c/d25/f95 [4194304,4194304] 0 2024-02-22T00:33:58.670 INFO:tasks.workunit.client.0.smithi049.stdout:7/735: symlink d1/d49/d5a/l109 0 2024-02-22T00:33:58.670 INFO:tasks.workunit.client.0.smithi049.stdout:9/731: chown d17/d21/d4e/d89/d94 210135 1 2024-02-22T00:33:58.672 INFO:tasks.workunit.client.0.smithi049.stdout:7/736: mkdir d1/d41/d28/d71/d10a 0 2024-02-22T00:33:58.673 INFO:tasks.workunit.client.0.smithi049.stdout:9/732: creat d17/d1c/d25/dba/def/ff2 x:0 0 0 2024-02-22T00:33:58.681 INFO:tasks.workunit.client.0.smithi049.stdout:9/733: dwrite d17/d21/f23 [0,4194304] 0 2024-02-22T00:33:58.689 INFO:tasks.workunit.client.0.smithi049.stdout:9/734: creat d17/d1c/d25/d39/ff3 x:0 0 0 2024-02-22T00:33:58.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/737: dwrite d1/df/d62/d1c/d1d/f46 [0,4194304] 0 2024-02-22T00:33:58.696 INFO:tasks.workunit.client.0.smithi049.stdout:7/738: mknod d1/d41/d28/c10b 0 2024-02-22T00:33:58.697 INFO:tasks.workunit.client.0.smithi049.stdout:9/735: write d17/d21/d47/d7a/fbc [258882,25797] 0 2024-02-22T00:33:58.702 INFO:tasks.workunit.client.0.smithi049.stdout:1/701: sync 2024-02-22T00:33:58.702 INFO:tasks.workunit.client.0.smithi049.stdout:8/709: sync 2024-02-22T00:33:58.702 INFO:tasks.workunit.client.0.smithi049.stdout:5/625: sync 2024-02-22T00:33:58.704 INFO:tasks.workunit.client.0.smithi049.stdout:9/736: write d17/f6c [695367,54665] 0 2024-02-22T00:33:58.705 INFO:tasks.workunit.client.0.smithi049.stdout:8/710: mknod d1/d2/dd7/cf8 0 2024-02-22T00:33:58.709 INFO:tasks.workunit.client.0.smithi049.stdout:8/711: symlink d1/d2/d5/d1b/lf9 0 2024-02-22T00:33:58.711 INFO:tasks.workunit.client.0.smithi049.stdout:9/737: write d17/d21/d47/d7a/f98 [505763,94015] 0 2024-02-22T00:33:58.712 INFO:tasks.workunit.client.0.smithi049.stdout:8/712: symlink d1/d4c/lfa 0 2024-02-22T00:33:58.715 INFO:tasks.workunit.client.0.smithi049.stdout:1/702: dwrite d2/d8/db/d25/d40/d71/f9f [0,4194304] 0 2024-02-22T00:33:58.715 INFO:tasks.workunit.client.0.smithi049.stdout:9/738: chown d17/d21/d4e/c54 0 1 2024-02-22T00:33:58.717 INFO:tasks.workunit.client.0.smithi049.stdout:9/739: readlink d17/l9d 0 2024-02-22T00:33:58.721 INFO:tasks.workunit.client.0.smithi049.stdout:5/626: dread d0/d20/f6a [0,4194304] 0 2024-02-22T00:33:58.723 INFO:tasks.workunit.client.0.smithi049.stdout:9/740: symlink d17/d1c/d8c/db0/de9/lf4 0 2024-02-22T00:33:58.728 INFO:tasks.workunit.client.0.smithi049.stdout:3/542: sync 2024-02-22T00:33:58.728 INFO:tasks.workunit.client.0.smithi049.stdout:0/629: sync 2024-02-22T00:33:58.728 INFO:tasks.workunit.client.0.smithi049.stdout:6/692: sync 2024-02-22T00:33:58.728 INFO:tasks.workunit.client.0.smithi049.stdout:4/703: sync 2024-02-22T00:33:58.729 INFO:tasks.workunit.client.0.smithi049.stdout:2/638: sync 2024-02-22T00:33:58.731 INFO:tasks.workunit.client.0.smithi049.stdout:5/627: rename d0/d20/d84/da0/db6/dc3/d6f/d94/f51 to d0/d20/d84/da0/db6/dc3/d70/db1/d9e/fcc 0 2024-02-22T00:33:58.733 INFO:tasks.workunit.client.0.smithi049.stdout:9/741: creat d17/d21/d47/ff5 x:0 0 0 2024-02-22T00:33:58.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/543: creat d0/dd/fa3 x:0 0 0 2024-02-22T00:33:58.737 INFO:tasks.workunit.client.0.smithi049.stdout:8/713: dread d1/d2/f3 [0,4194304] 0 2024-02-22T00:33:58.737 INFO:tasks.workunit.client.0.smithi049.stdout:1/703: dwrite d2/d8/db/d25/d40/d41/f59 [0,4194304] 0 2024-02-22T00:33:58.737 INFO:tasks.workunit.client.0.smithi049.stdout:2/639: rmdir d2/d9/de/d3a/d6d 39 2024-02-22T00:33:58.740 INFO:tasks.workunit.client.0.smithi049.stdout:2/640: fdatasync d2/dda/d7f/fe2 0 2024-02-22T00:33:58.740 INFO:tasks.workunit.client.0.smithi049.stdout:7/739: dread d1/d41/f3b [0,4194304] 0 2024-02-22T00:33:58.748 INFO:tasks.workunit.client.0.smithi049.stdout:8/714: write d1/d2/f9a [2739330,5529] 0 2024-02-22T00:33:58.750 INFO:tasks.workunit.client.0.smithi049.stdout:3/544: write d0/dd/f13 [366254,62023] 0 2024-02-22T00:33:58.750 INFO:tasks.workunit.client.0.smithi049.stdout:5/628: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d9c/fcd x:0 0 0 2024-02-22T00:33:58.752 INFO:tasks.workunit.client.0.smithi049.stdout:4/704: creat d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/fec x:0 0 0 2024-02-22T00:33:58.753 INFO:tasks.workunit.client.0.smithi049.stdout:7/740: mkdir d1/d41/d28/d10c 0 2024-02-22T00:33:58.755 INFO:tasks.workunit.client.0.smithi049.stdout:2/641: creat d2/d9/dd/d4d/d72/da0/fee x:0 0 0 2024-02-22T00:33:58.759 INFO:tasks.workunit.client.0.smithi049.stdout:6/693: dwrite d3/d36/d70/dcc/d4d/f84 [0,4194304] 0 2024-02-22T00:33:58.759 INFO:tasks.workunit.client.0.smithi049.stdout:1/704: dread d2/f6c [0,4194304] 0 2024-02-22T00:33:58.760 INFO:tasks.workunit.client.0.smithi049.stdout:8/715: unlink d1/d2/d5/d1b/d39/d81/fb2 0 2024-02-22T00:33:58.764 INFO:tasks.workunit.client.0.smithi049.stdout:3/545: truncate d0/d59/f42 563392 0 2024-02-22T00:33:58.772 INFO:tasks.workunit.client.0.smithi049.stdout:1/705: symlink d2/lec 0 2024-02-22T00:33:58.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/705: creat d3/d22/d5c/fed x:0 0 0 2024-02-22T00:33:58.772 INFO:tasks.workunit.client.0.smithi049.stdout:0/630: dread d3/d6/d29/f4b [0,4194304] 0 2024-02-22T00:33:58.772 INFO:tasks.workunit.client.0.smithi049.stdout:5/629: rename d0/d26/l59 to d0/d20/d84/da0/db6/dc3/d6f/lce 0 2024-02-22T00:33:58.775 INFO:tasks.workunit.client.0.smithi049.stdout:6/694: dwrite d3/d64/d59/fcb [0,4194304] 0 2024-02-22T00:33:58.776 INFO:tasks.workunit.client.0.smithi049.stdout:5/630: fsync d0/d20/f7b 0 2024-02-22T00:33:58.777 INFO:tasks.workunit.client.0.smithi049.stdout:2/642: link d2/d9/de/d3a/f54 d2/d9/de/d10/fef 0 2024-02-22T00:33:58.778 INFO:tasks.workunit.client.0.smithi049.stdout:4/706: stat d3/d8/d10/d43/d4d/db9/d8a/le8 0 2024-02-22T00:33:58.778 INFO:tasks.workunit.client.0.smithi049.stdout:8/716: dwrite d1/d2/d5/d1b/d39/d60/fab [0,4194304] 0 2024-02-22T00:33:58.778 INFO:tasks.workunit.client.0.smithi049.stdout:3/546: mkdir d0/dd/d26/da4 0 2024-02-22T00:33:58.783 INFO:tasks.workunit.client.0.smithi049.stdout:3/547: creat d0/dd/d26/d2e/fa5 x:0 0 0 2024-02-22T00:33:58.789 INFO:tasks.workunit.client.0.smithi049.stdout:2/643: creat d2/ff0 x:0 0 0 2024-02-22T00:33:58.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/717: write d1/d2/d5/d1b/d39/f72 [1247974,58458] 0 2024-02-22T00:33:58.789 INFO:tasks.workunit.client.0.smithi049.stdout:0/631: mknod d3/df/d17/d50/cbb 0 2024-02-22T00:33:58.789 INFO:tasks.workunit.client.0.smithi049.stdout:6/695: getdents d3/dcd 0 2024-02-22T00:33:58.790 INFO:tasks.workunit.client.0.smithi049.stdout:0/632: dread - d3/df/d48/d6f/d7a/f9d zero size 2024-02-22T00:33:58.800 INFO:tasks.workunit.client.0.smithi049.stdout:2/644: read d2/dda/f68 [2299806,30505] 0 2024-02-22T00:33:58.800 INFO:tasks.workunit.client.0.smithi049.stdout:1/706: dread d2/d8/db/f26 [0,4194304] 0 2024-02-22T00:33:58.800 INFO:tasks.workunit.client.0.smithi049.stdout:4/707: dwrite d3/d8/d10/d43/d4d/db9/fb3 [0,4194304] 0 2024-02-22T00:33:58.807 INFO:tasks.workunit.client.0.smithi049.stdout:3/548: mkdir d0/d14/d4d/d4e/d4f/d5b/d76/da6 0 2024-02-22T00:33:58.808 INFO:tasks.workunit.client.0.smithi049.stdout:2/645: dread - d2/d9/de/d3a/dc3/fd1 zero size 2024-02-22T00:33:58.808 INFO:tasks.workunit.client.0.smithi049.stdout:4/708: chown d3/d22/fc3 809088 1 2024-02-22T00:33:58.810 INFO:tasks.workunit.client.0.smithi049.stdout:8/718: symlink d1/d2/da5/d15/d65/d6a/de5/lfb 0 2024-02-22T00:33:58.815 INFO:tasks.workunit.client.0.smithi049.stdout:3/549: fsync d0/dd/d6f/f94 0 2024-02-22T00:33:58.816 INFO:tasks.workunit.client.0.smithi049.stdout:1/707: rename d2/c6d to d2/d8/da/d8a/ced 0 2024-02-22T00:33:58.817 INFO:tasks.workunit.client.0.smithi049.stdout:5/631: dwrite d0/d20/d50/d24/f88 [0,4194304] 0 2024-02-22T00:33:58.820 INFO:tasks.workunit.client.0.smithi049.stdout:4/709: unlink d3/d8/fd 0 2024-02-22T00:33:58.821 INFO:tasks.workunit.client.0.smithi049.stdout:0/633: dwrite d3/d6/d29/f76 [0,4194304] 0 2024-02-22T00:33:58.821 INFO:tasks.workunit.client.0.smithi049.stdout:2/646: write d2/d9/dd/d4d/d5a/fbf [62607,47283] 0 2024-02-22T00:33:58.823 INFO:tasks.workunit.client.0.smithi049.stdout:8/719: mkdir d1/d2/d5/d1b/d39/d81/dfc 0 2024-02-22T00:33:58.831 INFO:tasks.workunit.client.0.smithi049.stdout:6/696: dwrite d3/f20 [0,4194304] 0 2024-02-22T00:33:58.833 INFO:tasks.workunit.client.0.smithi049.stdout:8/720: chown d1/d2/da5/d15/d65/d6a/faa 29574614 1 2024-02-22T00:33:58.833 INFO:tasks.workunit.client.0.smithi049.stdout:0/634: creat d3/df/d48/d63/fbc x:0 0 0 2024-02-22T00:33:58.841 INFO:tasks.workunit.client.0.smithi049.stdout:3/550: creat d0/dd/d26/fa7 x:0 0 0 2024-02-22T00:33:58.842 INFO:tasks.workunit.client.0.smithi049.stdout:1/708: creat d2/d8/db/d25/d40/d41/d5b/d75/fee x:0 0 0 2024-02-22T00:33:58.843 INFO:tasks.workunit.client.0.smithi049.stdout:4/710: creat d3/d22/d5c/d9a/fee x:0 0 0 2024-02-22T00:33:58.844 INFO:tasks.workunit.client.0.smithi049.stdout:4/711: dread - d3/d22/d3d/fe3 zero size 2024-02-22T00:33:58.845 INFO:tasks.workunit.client.0.smithi049.stdout:0/635: rename d3/d6/d8/d36/d81/la6 to d3/df/d48/d6f/d7a/lbd 0 2024-02-22T00:33:58.846 INFO:tasks.workunit.client.0.smithi049.stdout:1/709: write d2/d8/db/f12 [9062660,14868] 0 2024-02-22T00:33:58.851 INFO:tasks.workunit.client.0.smithi049.stdout:0/636: fdatasync d3/df/d59/d8e/fa7 0 2024-02-22T00:33:58.852 INFO:tasks.workunit.client.0.smithi049.stdout:5/632: getdents d0/d20/d84/da0/db6/dc3/d6f 0 2024-02-22T00:33:58.856 INFO:tasks.workunit.client.0.smithi049.stdout:4/712: rmdir d3/d8/d10/d43/d4d/db9/d92 39 2024-02-22T00:33:58.857 INFO:tasks.workunit.client.0.smithi049.stdout:1/710: dread d2/d8/d4c/f8e [0,4194304] 0 2024-02-22T00:33:58.858 INFO:tasks.workunit.client.0.smithi049.stdout:6/697: link d3/cc d3/d64/d60/cea 0 2024-02-22T00:33:58.860 INFO:tasks.workunit.client.0.smithi049.stdout:5/633: symlink d0/d20/d50/d24/d3b/lcf 0 2024-02-22T00:33:58.861 INFO:tasks.workunit.client.0.smithi049.stdout:3/551: dwrite d0/dd/d1e/f24 [0,4194304] 0 2024-02-22T00:33:58.870 INFO:tasks.workunit.client.0.smithi049.stdout:8/721: dread d1/d2/d5/d1b/f7f [0,4194304] 0 2024-02-22T00:33:58.870 INFO:tasks.workunit.client.0.smithi049.stdout:0/637: creat d3/df/d17/fbe x:0 0 0 2024-02-22T00:33:58.874 INFO:tasks.workunit.client.0.smithi049.stdout:6/698: mkdir d3/d64/d59/d72/d92/db1/db3/deb 0 2024-02-22T00:33:58.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/552: stat d0/d14/d4d/d4e/d4f/d5b/d66/f7d 0 2024-02-22T00:33:58.876 INFO:tasks.workunit.client.0.smithi049.stdout:8/722: chown d1/d2/da5/d15/d65/lb9 5 1 2024-02-22T00:33:58.877 INFO:tasks.workunit.client.0.smithi049.stdout:4/713: truncate d3/d8/d10/d43/d4d/db9/d8a/fcf 328291 0 2024-02-22T00:33:58.879 INFO:tasks.workunit.client.0.smithi049.stdout:2/647: dwrite d2/d9/de/d15/f4a [0,4194304] 0 2024-02-22T00:33:58.880 INFO:tasks.workunit.client.0.smithi049.stdout:5/634: creat d0/d20/d50/fd0 x:0 0 0 2024-02-22T00:33:58.883 INFO:tasks.workunit.client.0.smithi049.stdout:6/699: symlink d3/dcd/lec 0 2024-02-22T00:33:58.884 INFO:tasks.workunit.client.0.smithi049.stdout:1/711: getdents d2 0 2024-02-22T00:33:58.884 INFO:tasks.workunit.client.0.smithi049.stdout:2/648: rmdir d2/d9/dd/d4d/d5a/d99 39 2024-02-22T00:33:58.886 INFO:tasks.workunit.client.0.smithi049.stdout:8/723: write d1/d2/f9a [1415865,122729] 0 2024-02-22T00:33:58.891 INFO:tasks.workunit.client.0.smithi049.stdout:2/649: rmdir d2/d9/de/d10 39 2024-02-22T00:33:58.893 INFO:tasks.workunit.client.0.smithi049.stdout:6/700: chown d3/d36/fbc 355344 1 2024-02-22T00:33:58.907 INFO:tasks.workunit.client.0.smithi049.stdout:4/714: write d3/d8/d10/d39/f37 [1430296,72248] 0 2024-02-22T00:33:58.907 INFO:tasks.workunit.client.0.smithi049.stdout:8/724: symlink d1/d2/d5/d56/dac/lfd 0 2024-02-22T00:33:58.910 INFO:tasks.workunit.client.0.smithi049.stdout:3/553: dwrite d0/dd/d26/d63/f8a [0,4194304] 0 2024-02-22T00:33:58.911 INFO:tasks.workunit.client.0.smithi049.stdout:0/638: dwrite d3/f43 [0,4194304] 0 2024-02-22T00:33:58.914 INFO:tasks.workunit.client.0.smithi049.stdout:1/712: creat d2/d8/db/d25/d40/d41/d68/d78/fef x:0 0 0 2024-02-22T00:33:58.917 INFO:tasks.workunit.client.0.smithi049.stdout:0/639: chown d3/df/d17/d50/d62 10832 1 2024-02-22T00:33:58.919 INFO:tasks.workunit.client.0.smithi049.stdout:5/635: dread d0/d20/d50/f36 [0,4194304] 0 2024-02-22T00:33:58.930 INFO:tasks.workunit.client.0.smithi049.stdout:2/650: rename d2/d9/de/d10/d59/cad to d2/d9/dd/d74/cf1 0 2024-02-22T00:33:58.931 INFO:tasks.workunit.client.0.smithi049.stdout:8/725: symlink d1/d2/da5/d15/d30/d4b/d51/lfe 0 2024-02-22T00:33:58.936 INFO:tasks.workunit.client.0.smithi049.stdout:0/640: link d3/df/d48/d6f/d7a/f9d d3/df/d48/d91/fbf 0 2024-02-22T00:33:58.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/701: creat d3/d64/d59/d72/fed x:0 0 0 2024-02-22T00:33:58.937 INFO:tasks.workunit.client.0.smithi049.stdout:4/715: dwrite d3/d8/d10/d39/f87 [4194304,4194304] 0 2024-02-22T00:33:58.938 INFO:tasks.workunit.client.0.smithi049.stdout:2/651: mkdir d2/d9/df2 0 2024-02-22T00:33:58.944 INFO:tasks.workunit.client.0.smithi049.stdout:3/554: getdents d0/dd/d26/d2e/d52 0 2024-02-22T00:33:58.950 INFO:tasks.workunit.client.0.smithi049.stdout:0/641: rmdir d3/d6/d8 39 2024-02-22T00:33:58.952 INFO:tasks.workunit.client.0.smithi049.stdout:4/716: write d3/d8/d10/d43/d4d/db9/d8a/d48/fba [3616194,102212] 0 2024-02-22T00:33:58.953 INFO:tasks.workunit.client.0.smithi049.stdout:1/713: dwrite d2/d8/da/f14 [0,4194304] 0 2024-02-22T00:33:58.959 INFO:tasks.workunit.client.0.smithi049.stdout:0/642: symlink d3/df/d48/d6f/d90/lc0 0 2024-02-22T00:33:58.963 INFO:tasks.workunit.client.0.smithi049.stdout:0/643: symlink d3/lc1 0 2024-02-22T00:33:58.964 INFO:tasks.workunit.client.0.smithi049.stdout:3/555: symlink d0/d14/d4d/d4e/d4f/d5b/la8 0 2024-02-22T00:33:58.964 INFO:tasks.workunit.client.0.smithi049.stdout:8/726: dwrite d1/d2/da5/d15/d30/d36/d52/daf/fd8 [0,4194304] 0 2024-02-22T00:33:58.965 INFO:tasks.workunit.client.0.smithi049.stdout:2/652: truncate d2/d9/de/d3a/dc3/fd1 466992 0 2024-02-22T00:33:58.973 INFO:tasks.workunit.client.0.smithi049.stdout:2/653: readlink d2/d9/de/d10/d2e/d42/d80/le6 0 2024-02-22T00:33:58.974 INFO:tasks.workunit.client.0.smithi049.stdout:4/717: rename d3/d22/d5c/d5e/fb4 to d3/d22/d3d/fef 0 2024-02-22T00:33:58.976 INFO:tasks.workunit.client.0.smithi049.stdout:6/702: dwrite d3/d36/fbc [0,4194304] 0 2024-02-22T00:33:58.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/556: readlink d0/d14/d4d/d4e/d56/d5a/l9d 0 2024-02-22T00:33:58.978 INFO:tasks.workunit.client.0.smithi049.stdout:2/654: dread - d2/d9/de/d3a/f54 zero size 2024-02-22T00:33:58.979 INFO:tasks.workunit.client.0.smithi049.stdout:8/727: rename d1/d2/d5/d1b/l70 to d1/d2/d5/d56/lff 0 2024-02-22T00:33:58.984 INFO:tasks.workunit.client.0.smithi049.stdout:4/718: truncate d3/d8/d10/d12/d3f/fa9 891043 0 2024-02-22T00:33:58.988 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:33:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:57.765615+0000 mgr.smithi161.sazlam (mgr.24369) 61 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 47 MiB/s rd, 178 MiB/s wr, 460 op/s 2024-02-22T00:33:58.989 INFO:tasks.workunit.client.0.smithi049.stdout:1/714: dwrite d2/d8/db/d25/d40/d41/f4a [0,4194304] 0 2024-02-22T00:33:58.990 INFO:tasks.workunit.client.0.smithi049.stdout:6/703: creat d3/d36/d70/dcc/d4d/fee x:0 0 0 2024-02-22T00:33:58.993 INFO:tasks.workunit.client.0.smithi049.stdout:8/728: rename d1/d2/da5/deb/d93 to d1/d2/db7/d100 0 2024-02-22T00:33:58.993 INFO:tasks.workunit.client.0.smithi049.stdout:3/557: truncate d0/d59/f85 1272328 0 2024-02-22T00:33:58.996 INFO:tasks.workunit.client.0.smithi049.stdout:4/719: mkdir d3/d22/df0 0 2024-02-22T00:33:58.997 INFO:tasks.workunit.client.0.smithi049.stdout:3/558: truncate d0/d14/f74 30283 0 2024-02-22T00:33:58.997 INFO:tasks.workunit.client.0.smithi049.stdout:1/715: mkdir d2/d69/dce/df0 0 2024-02-22T00:33:58.999 INFO:tasks.workunit.client.0.smithi049.stdout:6/704: unlink d3/d64/f22 0 2024-02-22T00:33:59.001 INFO:tasks.workunit.client.0.smithi049.stdout:8/729: write d1/d2/db7/d100/fdc [771819,27915] 0 2024-02-22T00:33:59.002 INFO:tasks.workunit.client.0.smithi049.stdout:2/655: dwrite d2/d9/de/d3a/fb4 [0,4194304] 0 2024-02-22T00:33:59.006 INFO:tasks.workunit.client.0.smithi049.stdout:1/716: write d2/d8/db/f2d [5023670,61744] 0 2024-02-22T00:33:59.006 INFO:tasks.workunit.client.0.smithi049.stdout:0/644: getdents d3/df/d7f 0 2024-02-22T00:33:59.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/717: fdatasync d2/f30 0 2024-02-22T00:33:59.009 INFO:tasks.workunit.client.0.smithi049.stdout:4/720: truncate d3/d33/fb8 3277802 0 2024-02-22T00:33:59.011 INFO:tasks.workunit.client.0.smithi049.stdout:1/718: symlink d2/d8/d4c/d5e/lf1 0 2024-02-22T00:33:59.013 INFO:tasks.workunit.client.0.smithi049.stdout:2/656: creat d2/d9/de/d15/d1b/dc4/ff3 x:0 0 0 2024-02-22T00:33:59.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/645: creat d3/df/d17/d50/fc2 x:0 0 0 2024-02-22T00:33:59.015 INFO:tasks.workunit.client.0.smithi049.stdout:1/719: rmdir d2/d8/db/d25/d40/d41/d84 39 2024-02-22T00:33:59.017 INFO:tasks.workunit.client.0.smithi049.stdout:8/730: link d1/d2/da5/d15/d33/fba d1/d2/da5/d15/d65/d6a/de5/f101 0 2024-02-22T00:33:59.021 INFO:tasks.workunit.client.0.smithi049.stdout:4/721: dwrite d3/d22/d5c/d35/f40 [4194304,4194304] 0 2024-02-22T00:33:59.023 INFO:tasks.workunit.client.0.smithi049.stdout:2/657: fdatasync d2/d9/de/d10/fef 0 2024-02-22T00:33:59.027 INFO:tasks.workunit.client.0.smithi049.stdout:1/720: dread d2/f6c [0,4194304] 0 2024-02-22T00:33:59.028 INFO:tasks.workunit.client.0.smithi049.stdout:4/722: read - d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/fec zero size 2024-02-22T00:33:59.033 INFO:tasks.workunit.client.0.smithi049.stdout:1/721: chown d2/d8/db/d25/d40/d41/d84/fb7 1022034 1 2024-02-22T00:33:59.035 INFO:tasks.workunit.client.0.smithi049.stdout:1/722: write d2/d8/db/d25/d40/d41/d5b/fd9 [306974,124343] 0 2024-02-22T00:33:59.036 INFO:tasks.workunit.client.0.smithi049.stdout:2/658: creat d2/d9/de/d15/d1b/dc4/de9/ff4 x:0 0 0 2024-02-22T00:33:59.036 INFO:tasks.workunit.client.0.smithi049.stdout:4/723: getdents d3/d8/d10/d12/dd8 0 2024-02-22T00:33:59.037 INFO:tasks.workunit.client.0.smithi049.stdout:9/742: sync 2024-02-22T00:33:59.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/741: sync 2024-02-22T00:33:59.040 INFO:tasks.workunit.client.0.smithi049.stdout:0/646: truncate d3/d1e/f6a 3943068 0 2024-02-22T00:33:59.042 INFO:tasks.workunit.client.0.smithi049.stdout:7/742: mknod d1/d41/dae/c10d 0 2024-02-22T00:33:59.050 INFO:tasks.workunit.client.0.smithi049.stdout:4/724: read d3/d8/d10/d43/d4d/db9/d8a/d48/d60/f9b [107458,104924] 0 2024-02-22T00:33:59.053 INFO:tasks.workunit.client.0.smithi049.stdout:8/731: dwrite d1/d2/d5/d56/fa4 [0,4194304] 0 2024-02-22T00:33:59.057 INFO:tasks.workunit.client.0.smithi049.stdout:9/743: getdents d17/d21/d3c/dbf 0 2024-02-22T00:33:59.060 INFO:tasks.workunit.client.0.smithi049.stdout:6/705: dwrite d3/f5 [4194304,4194304] 0 2024-02-22T00:33:59.060 INFO:tasks.workunit.client.0.smithi049.stdout:0/647: mkdir d3/d6/d8/d36/d81/dc3 0 2024-02-22T00:33:59.064 INFO:tasks.workunit.client.0.smithi049.stdout:1/723: dwrite d2/d8/d4c/fe0 [4194304,4194304] 0 2024-02-22T00:33:59.065 INFO:tasks.workunit.client.0.smithi049.stdout:6/706: stat d3/d64/d60/lb0 0 2024-02-22T00:33:59.066 INFO:tasks.workunit.client.0.smithi049.stdout:2/659: dread d2/d9/de/d10/f31 [0,4194304] 0 2024-02-22T00:33:59.067 INFO:tasks.workunit.client.0.smithi049.stdout:1/724: write d2/da0/fd8 [314332,104088] 0 2024-02-22T00:33:59.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/648: creat d3/df/d48/fc4 x:0 0 0 2024-02-22T00:33:59.068 INFO:tasks.workunit.client.0.smithi049.stdout:4/725: dread d3/d8/d10/d12/d3f/fa2 [0,4194304] 0 2024-02-22T00:33:59.071 INFO:tasks.workunit.client.0.smithi049.stdout:4/726: chown d3/d22/l63 326506 1 2024-02-22T00:33:59.073 INFO:tasks.workunit.client.0.smithi049.stdout:7/743: link d1/df/d62/d1c/d24/f52 d1/df/d62/d1c/f10e 0 2024-02-22T00:33:59.076 INFO:tasks.workunit.client.0.smithi049.stdout:8/732: dwrite d1/d2/d5/d1b/d39/d81/df3/fc3 [0,4194304] 0 2024-02-22T00:33:59.077 INFO:tasks.workunit.client.0.smithi049.stdout:4/727: write d3/d8/d10/d12/d3f/fa9 [383845,60480] 0 2024-02-22T00:33:59.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/649: truncate d3/d6/d8/d36/d81/fb1 855010 0 2024-02-22T00:33:59.079 INFO:tasks.workunit.client.0.smithi049.stdout:9/744: write d17/d21/fa4 [615226,23280] 0 2024-02-22T00:33:59.080 INFO:tasks.workunit.client.0.smithi049.stdout:0/650: read - d3/df/d17/d50/fc2 zero size 2024-02-22T00:33:59.082 INFO:tasks.workunit.client.0.smithi049.stdout:6/707: creat d3/fef x:0 0 0 2024-02-22T00:33:59.083 INFO:tasks.workunit.client.0.smithi049.stdout:1/725: creat d2/d8/db/d25/d62/dcb/ff2 x:0 0 0 2024-02-22T00:33:59.083 INFO:tasks.workunit.client.0.smithi049.stdout:8/733: symlink d1/d4c/l102 0 2024-02-22T00:33:59.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/708: chown d3/d64/d60/f9e 432056 1 2024-02-22T00:33:59.085 INFO:tasks.workunit.client.0.smithi049.stdout:9/745: chown d17/d21/d47/l84 5629 1 2024-02-22T00:33:59.086 INFO:tasks.workunit.client.0.smithi049.stdout:0/651: truncate d3/df/d17/d50/fc2 443217 0 2024-02-22T00:33:59.088 INFO:tasks.workunit.client.0.smithi049.stdout:9/746: stat d17/d21/d4e/d4b/dc8/cdd 0 2024-02-22T00:33:59.088 INFO:tasks.workunit.client.0.smithi049.stdout:0/652: fsync d3/df/d48/d63/f97 0 2024-02-22T00:33:59.092 INFO:tasks.workunit.client.0.smithi049.stdout:6/709: creat d3/d36/d70/dcc/ff0 x:0 0 0 2024-02-22T00:33:59.095 INFO:tasks.workunit.client.0.smithi049.stdout:8/734: creat d1/d2/d5/f103 x:0 0 0 2024-02-22T00:33:59.097 INFO:tasks.workunit.client.0.smithi049.stdout:0/653: creat d3/df/fc5 x:0 0 0 2024-02-22T00:33:59.097 INFO:tasks.workunit.client.0.smithi049.stdout:4/728: dwrite d3/d22/d5c/d35/f40 [4194304,4194304] 0 2024-02-22T00:33:59.098 INFO:tasks.workunit.client.0.smithi049.stdout:8/735: fsync d1/d4c/f4f 0 2024-02-22T00:33:59.098 INFO:tasks.workunit.client.0.smithi049.stdout:6/710: mknod d3/d64/d59/d72/d92/cf1 0 2024-02-22T00:33:59.099 INFO:tasks.workunit.client.0.smithi049.stdout:9/747: getdents d17/d1c/d25/d71 0 2024-02-22T00:33:59.101 INFO:tasks.workunit.client.0.smithi049.stdout:2/660: dwrite d2/d9/dd/d4d/d5a/fa3 [0,4194304] 0 2024-02-22T00:33:59.102 INFO:tasks.workunit.client.0.smithi049.stdout:4/729: chown d3/d8/d10/d43/fd6 43 1 2024-02-22T00:33:59.105 INFO:tasks.workunit.client.0.smithi049.stdout:6/711: symlink d3/d64/d59/d72/d92/d6c/lf2 0 2024-02-22T00:33:59.106 INFO:tasks.workunit.client.0.smithi049.stdout:4/730: dread d3/d8/d10/d12/d3f/fa2 [0,4194304] 0 2024-02-22T00:33:59.107 INFO:tasks.workunit.client.0.smithi049.stdout:2/661: fsync d2/d9/de/d3a/f37 0 2024-02-22T00:33:59.109 INFO:tasks.workunit.client.0.smithi049.stdout:6/712: write d3/d36/d70/dcc/d4d/f95 [151666,13967] 0 2024-02-22T00:33:59.110 INFO:tasks.workunit.client.0.smithi049.stdout:0/654: rename d3/d6/d8/d36/d81/ca8 to d3/d92/cc6 0 2024-02-22T00:33:59.112 INFO:tasks.workunit.client.0.smithi049.stdout:8/736: link d1/d2/d5/d1b/d39/d81/fa1 d1/d2/da5/f104 0 2024-02-22T00:33:59.113 INFO:tasks.workunit.client.0.smithi049.stdout:6/713: dread - d3/d36/d57/d75/fbf zero size 2024-02-22T00:33:59.115 INFO:tasks.workunit.client.0.smithi049.stdout:0/655: rmdir d3/d1e/d58 39 2024-02-22T00:33:59.116 INFO:tasks.workunit.client.0.smithi049.stdout:7/744: truncate d1/d41/fe0 125297 0 2024-02-22T00:33:59.118 INFO:tasks.workunit.client.0.smithi049.stdout:4/731: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/df1 0 2024-02-22T00:33:59.118 INFO:tasks.workunit.client.0.smithi049.stdout:1/726: write d2/f35 [4130394,87884] 0 2024-02-22T00:33:59.119 INFO:tasks.workunit.client.0.smithi049.stdout:9/748: dread d17/d21/f33 [0,4194304] 0 2024-02-22T00:33:59.120 INFO:tasks.workunit.client.0.smithi049.stdout:6/714: unlink d3/d16/c61 0 2024-02-22T00:33:59.124 INFO:tasks.workunit.client.0.smithi049.stdout:2/662: rename d2/d9/de/d15/l1a to d2/d9/lf5 0 2024-02-22T00:33:59.129 INFO:tasks.workunit.client.0.smithi049.stdout:0/656: creat d3/df/db5/fc7 x:0 0 0 2024-02-22T00:33:59.132 INFO:tasks.workunit.client.0.smithi049.stdout:4/732: creat d3/d8/d10/d39/ff2 x:0 0 0 2024-02-22T00:33:59.133 INFO:tasks.workunit.client.0.smithi049.stdout:6/715: readlink d3/d16/d3b/d8c/lc7 0 2024-02-22T00:33:59.136 INFO:tasks.workunit.client.0.smithi049.stdout:8/737: creat d1/d2/da5/d15/d30/d36/d52/daf/f105 x:0 0 0 2024-02-22T00:33:59.137 INFO:tasks.workunit.client.0.smithi049.stdout:6/716: dread - d3/d64/d5f/fd5 zero size 2024-02-22T00:33:59.138 INFO:tasks.workunit.client.0.smithi049.stdout:2/663: dwrite d2/dda/d5d/fe3 [0,4194304] 0 2024-02-22T00:33:59.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/749: dread d17/d1c/d25/fc9 [0,4194304] 0 2024-02-22T00:33:59.143 INFO:tasks.workunit.client.0.smithi049.stdout:2/664: fdatasync d2/d9/d17/fb1 0 2024-02-22T00:33:59.147 INFO:tasks.workunit.client.0.smithi049.stdout:1/727: dwrite d2/d8/db/d25/d40/d41/f60 [0,4194304] 0 2024-02-22T00:33:59.149 INFO:tasks.workunit.client.0.smithi049.stdout:1/728: fdatasync d2/d8/d4c/fe0 0 2024-02-22T00:33:59.149 INFO:tasks.workunit.client.0.smithi049.stdout:9/750: read d17/d21/d3c/fa6 [217899,2802] 0 2024-02-22T00:33:59.151 INFO:tasks.workunit.client.0.smithi049.stdout:1/729: stat d2/d8/db/d25/d40/d41/f60 0 2024-02-22T00:33:59.154 INFO:tasks.workunit.client.0.smithi049.stdout:7/745: dread d1/df/d62/f23 [0,4194304] 0 2024-02-22T00:33:59.155 INFO:tasks.workunit.client.0.smithi049.stdout:0/657: write d3/d1e/f5a [1514527,124891] 0 2024-02-22T00:33:59.155 INFO:tasks.workunit.client.0.smithi049.stdout:9/751: truncate f10 1109780 0 2024-02-22T00:33:59.156 INFO:tasks.workunit.client.0.smithi049.stdout:8/738: write d1/d2/da5/d15/f23 [1845312,71970] 0 2024-02-22T00:33:59.158 INFO:tasks.workunit.client.0.smithi049.stdout:1/730: rename d2/d8/db/d25/d62/dcb/ff2 to d2/d8/db/d25/d40/de8/ff3 0 2024-02-22T00:33:59.161 INFO:tasks.workunit.client.0.smithi049.stdout:0/658: creat d3/df/d59/d60/fc8 x:0 0 0 2024-02-22T00:33:59.162 INFO:tasks.workunit.client.0.smithi049.stdout:9/752: creat d17/d21/ff6 x:0 0 0 2024-02-22T00:33:59.162 INFO:tasks.workunit.client.0.smithi049.stdout:7/746: truncate d1/df/d62/d57/fef 1016948 0 2024-02-22T00:33:59.165 INFO:tasks.workunit.client.0.smithi049.stdout:8/739: read d1/d2/d5/d1b/d39/d81/df3/fbb [35968,26368] 0 2024-02-22T00:33:59.165 INFO:tasks.workunit.client.0.smithi049.stdout:4/733: dwrite f2 [0,4194304] 0 2024-02-22T00:33:59.167 INFO:tasks.workunit.client.0.smithi049.stdout:0/659: fdatasync d3/d1e/d58/fa1 0 2024-02-22T00:33:59.168 INFO:tasks.workunit.client.0.smithi049.stdout:7/747: dread - d1/df/d62/d1c/d1d/d6e/fdd zero size 2024-02-22T00:33:59.169 INFO:tasks.workunit.client.0.smithi049.stdout:2/665: write d2/dda/f68 [1605286,63632] 0 2024-02-22T00:33:59.170 INFO:tasks.workunit.client.0.smithi049.stdout:9/753: truncate d17/f1f 1656964 0 2024-02-22T00:33:59.172 INFO:tasks.workunit.client.0.smithi049.stdout:1/731: rmdir d2/d8/db/d25/d40/d41/d84/d8b 0 2024-02-22T00:33:59.173 INFO:tasks.workunit.client.0.smithi049.stdout:8/740: creat d1/d4c/dda/f106 x:0 0 0 2024-02-22T00:33:59.174 INFO:tasks.workunit.client.0.smithi049.stdout:0/660: symlink d3/d6/d8/d36/lc9 0 2024-02-22T00:33:59.175 INFO:tasks.workunit.client.0.smithi049.stdout:4/734: link d3/d8/d10/dc4/fc8 d3/d22/d5c/ff3 0 2024-02-22T00:33:59.175 INFO:tasks.workunit.client.0.smithi049.stdout:0/661: chown d3/df/d17 1437878 1 2024-02-22T00:33:59.179 INFO:tasks.workunit.client.0.smithi049.stdout:1/732: symlink d2/d8/db/d25/d40/d41/d84/dab/lf4 0 2024-02-22T00:33:59.179 INFO:tasks.workunit.client.0.smithi049.stdout:9/754: write d17/d1c/d25/d39/fe2 [181653,248] 0 2024-02-22T00:33:59.179 INFO:tasks.workunit.client.0.smithi049.stdout:2/666: dwrite d2/d9/dd/d4d/d5a/fa3 [0,4194304] 0 2024-02-22T00:33:59.181 INFO:tasks.workunit.client.0.smithi049.stdout:0/662: stat d3/df/d48/d54/c88 0 2024-02-22T00:33:59.181 INFO:tasks.workunit.client.0.smithi049.stdout:7/748: link d1/df/d62/d1c/d6d/l101 d1/df/d62/d1c/d1d/d6e/l10f 0 2024-02-22T00:33:59.184 INFO:tasks.workunit.client.0.smithi049.stdout:8/741: link d1/d2/db7/d100/c97 d1/d4c/c107 0 2024-02-22T00:33:59.187 INFO:tasks.workunit.client.0.smithi049.stdout:2/667: truncate d2/d9/de/d15/d1b/dc4/de9/ff4 687372 0 2024-02-22T00:33:59.187 INFO:tasks.workunit.client.0.smithi049.stdout:7/749: write d1/df/d62/d60/fda [3094864,22201] 0 2024-02-22T00:33:59.192 INFO:tasks.workunit.client.0.smithi049.stdout:6/717: truncate d3/f29 1905690 0 2024-02-22T00:33:59.197 INFO:tasks.workunit.client.0.smithi049.stdout:1/733: dwrite d2/d69/fbe [0,4194304] 0 2024-02-22T00:33:59.198 INFO:tasks.workunit.client.0.smithi049.stdout:2/668: chown d2/d9/de/d10/d2e/d42/d80/dcc/l6b 0 1 2024-02-22T00:33:59.200 INFO:tasks.workunit.client.0.smithi049.stdout:6/718: truncate d3/d36/d57/d75/fbf 247686 0 2024-02-22T00:33:59.204 INFO:tasks.workunit.client.0.smithi049.stdout:4/735: getdents d3/d22/d5c 0 2024-02-22T00:33:59.206 INFO:tasks.workunit.client.0.smithi049.stdout:8/742: link d1/d2/db7/fdf d1/d2/da5/d15/d33/f108 0 2024-02-22T00:33:59.207 INFO:tasks.workunit.client.0.smithi049.stdout:9/755: dread d17/d21/d47/d5d/f6b [0,4194304] 0 2024-02-22T00:33:59.208 INFO:tasks.workunit.client.0.smithi049.stdout:7/750: dread d1/df/d62/d57/f74 [0,4194304] 0 2024-02-22T00:33:59.208 INFO:tasks.workunit.client.0.smithi049.stdout:0/663: truncate d3/d1e/d58/f7c 3620574 0 2024-02-22T00:33:59.209 INFO:tasks.workunit.client.0.smithi049.stdout:2/669: dread d2/d9/de/d10/d59/f8f [0,4194304] 0 2024-02-22T00:33:59.210 INFO:tasks.workunit.client.0.smithi049.stdout:1/734: creat d2/d8/db/d25/d40/d41/d68/d78/ff5 x:0 0 0 2024-02-22T00:33:59.216 INFO:tasks.workunit.client.0.smithi049.stdout:7/751: dread - d1/df/d62/d48/d99/fc5 zero size 2024-02-22T00:33:59.220 INFO:tasks.workunit.client.0.smithi049.stdout:9/756: truncate d17/d1c/d38/f74 575872 0 2024-02-22T00:33:59.222 INFO:tasks.workunit.client.0.smithi049.stdout:2/670: symlink d2/d9/de/lf6 0 2024-02-22T00:33:59.223 INFO:tasks.workunit.client.0.smithi049.stdout:7/752: rmdir d1/d41/dae 39 2024-02-22T00:33:59.224 INFO:tasks.workunit.client.0.smithi049.stdout:6/719: dwrite d3/d36/d70/dcc/ff0 [0,4194304] 0 2024-02-22T00:33:59.227 INFO:tasks.workunit.client.0.smithi049.stdout:0/664: link d3/d1e/f6a d3/df/d48/d63/fca 0 2024-02-22T00:33:59.227 INFO:tasks.workunit.client.0.smithi049.stdout:5/636: sync 2024-02-22T00:33:59.228 INFO:tasks.workunit.client.0.smithi049.stdout:2/671: unlink d2/dda/d63/fc9 0 2024-02-22T00:33:59.229 INFO:tasks.workunit.client.0.smithi049.stdout:9/757: mknod d17/cf7 0 2024-02-22T00:33:59.231 INFO:tasks.workunit.client.0.smithi049.stdout:8/743: write d1/d2/da5/d15/d30/d36/d52/daf/ff4 [1290204,3541] 0 2024-02-22T00:33:59.231 INFO:tasks.workunit.client.0.smithi049.stdout:6/720: creat d3/d64/d60/dc2/ff3 x:0 0 0 2024-02-22T00:33:59.234 INFO:tasks.workunit.client.0.smithi049.stdout:1/735: dwrite d2/d8/db/d25/fc7 [0,4194304] 0 2024-02-22T00:33:59.235 INFO:tasks.workunit.client.0.smithi049.stdout:4/736: dread d3/d8/d10/d43/d4d/f5f [0,4194304] 0 2024-02-22T00:33:59.236 INFO:tasks.workunit.client.0.smithi049.stdout:9/758: chown d17/d1c/f2c 22 1 2024-02-22T00:33:59.239 INFO:tasks.workunit.client.0.smithi049.stdout:5/637: read d0/d20/d84/da0/db6/dc3/d6f/da8/fc8 [661904,50218] 0 2024-02-22T00:33:59.240 INFO:tasks.workunit.client.0.smithi049.stdout:7/753: truncate d1/df/d62/d60/f82 242356 0 2024-02-22T00:33:59.242 INFO:tasks.workunit.client.0.smithi049.stdout:6/721: creat d3/d64/d59/ff4 x:0 0 0 2024-02-22T00:33:59.242 INFO:tasks.workunit.client.0.smithi049.stdout:2/672: mkdir d2/d9/de/d15/d1b/dc4/df7 0 2024-02-22T00:33:59.244 INFO:tasks.workunit.client.0.smithi049.stdout:1/736: unlink d2/d8/da/f1e 0 2024-02-22T00:33:59.245 INFO:tasks.workunit.client.0.smithi049.stdout:8/744: creat d1/d2/d5/d56/f109 x:0 0 0 2024-02-22T00:33:59.249 INFO:tasks.workunit.client.0.smithi049.stdout:7/754: read d1/d41/d55/d89/fc6 [142949,18487] 0 2024-02-22T00:33:59.249 INFO:tasks.workunit.client.0.smithi049.stdout:9/759: rename d17/d21/d3c/dbf/ce1 to d17/d1c/d38/cf8 0 2024-02-22T00:33:59.250 INFO:tasks.workunit.client.0.smithi049.stdout:2/673: fdatasync d2/dda/d5d/fe3 0 2024-02-22T00:33:59.250 INFO:tasks.workunit.client.0.smithi049.stdout:1/737: fsync d2/d8/da/f14 0 2024-02-22T00:33:59.251 INFO:tasks.workunit.client.0.smithi049.stdout:5/638: mknod d0/d20/d50/d24/cd1 0 2024-02-22T00:33:59.253 INFO:tasks.workunit.client.0.smithi049.stdout:6/722: mknod d3/cf5 0 2024-02-22T00:33:59.253 INFO:tasks.workunit.client.0.smithi049.stdout:0/665: dwrite d3/df/fc5 [0,4194304] 0 2024-02-22T00:33:59.257 INFO:tasks.workunit.client.0.smithi049.stdout:7/755: rmdir d1/df/d62/d48/d8e 39 2024-02-22T00:33:59.259 INFO:tasks.workunit.client.0.smithi049.stdout:2/674: rmdir d2/d9/dd/d4d/d72/da0/dba 39 2024-02-22T00:33:59.259 INFO:tasks.workunit.client.0.smithi049.stdout:4/737: dwrite d3/d8/d10/d39/f87 [4194304,4194304] 0 2024-02-22T00:33:59.260 INFO:tasks.workunit.client.0.smithi049.stdout:9/760: symlink d17/d1c/d8c/db0/de9/lf9 0 2024-02-22T00:33:59.267 INFO:tasks.workunit.client.0.smithi049.stdout:7/756: unlink d1/df/d62/d60/d7e/de6/ded/ffa 0 2024-02-22T00:33:59.270 INFO:tasks.workunit.client.0.smithi049.stdout:5/639: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/f12 [0,4194304] 0 2024-02-22T00:33:59.272 INFO:tasks.workunit.client.0.smithi049.stdout:0/666: mkdir d3/dcb 0 2024-02-22T00:33:59.274 INFO:tasks.workunit.client.0.smithi049.stdout:4/738: mkdir d3/d22/df0/df4 0 2024-02-22T00:33:59.275 INFO:tasks.workunit.client.0.smithi049.stdout:2/675: truncate d2/d9/d17/f28 604706 0 2024-02-22T00:33:59.279 INFO:tasks.workunit.client.0.smithi049.stdout:6/723: rename d3/d16/d3b/f7e to d3/ff6 0 2024-02-22T00:33:59.281 INFO:tasks.workunit.client.0.smithi049.stdout:7/757: mknod d1/d41/d55/d89/c110 0 2024-02-22T00:33:59.283 INFO:tasks.workunit.client.0.smithi049.stdout:0/667: chown d3/d6/d8/d36/lab 63055 1 2024-02-22T00:33:59.283 INFO:tasks.workunit.client.0.smithi049.stdout:5/640: truncate d0/d20/d84/da0/db6/dc3/d7c/f96 1360273 0 2024-02-22T00:33:59.284 INFO:tasks.workunit.client.0.smithi049.stdout:4/739: symlink d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/lf5 0 2024-02-22T00:33:59.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/676: truncate d2/d9/de/d10/f29 3498552 0 2024-02-22T00:33:59.287 INFO:tasks.workunit.client.0.smithi049.stdout:9/761: link f10 d17/d21/d47/d5d/db4/ffa 0 2024-02-22T00:33:59.288 INFO:tasks.workunit.client.0.smithi049.stdout:7/758: getdents d1/df/d62/d60/d7e/de6/de8/dfd 0 2024-02-22T00:33:59.291 INFO:tasks.workunit.client.0.smithi049.stdout:6/724: getdents d3/d16/d45 0 2024-02-22T00:33:59.292 INFO:tasks.workunit.client.0.smithi049.stdout:8/745: dread d1/d2/da5/f21 [0,4194304] 0 2024-02-22T00:33:59.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:33:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:57.765615+0000 mgr.smithi161.sazlam (mgr.24369) 61 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 47 MiB/s rd, 178 MiB/s wr, 460 op/s 2024-02-22T00:33:59.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/762: write d17/d21/d4e/d4b/f5a [1393932,22498] 0 2024-02-22T00:33:59.300 INFO:tasks.workunit.client.0.smithi049.stdout:7/759: stat d1/df/d62/d1c/d1d/d70/cad 0 2024-02-22T00:33:59.303 INFO:tasks.workunit.client.0.smithi049.stdout:4/740: dwrite d3/d22/d5c/d9a/fc7 [0,4194304] 0 2024-02-22T00:33:59.304 INFO:tasks.workunit.client.0.smithi049.stdout:2/677: dwrite d2/d9/de/d10/f12 [0,4194304] 0 2024-02-22T00:33:59.308 INFO:tasks.workunit.client.0.smithi049.stdout:5/641: truncate d0/d20/d84/da0/db6/dc3/d70/db1/dbe/fc9 578887 0 2024-02-22T00:33:59.310 INFO:tasks.workunit.client.0.smithi049.stdout:6/725: mkdir d3/d36/d70/dcc/d4d/d8b/df7 0 2024-02-22T00:33:59.312 INFO:tasks.workunit.client.0.smithi049.stdout:9/763: creat d17/d21/d4e/d89/d94/df0/ffb x:0 0 0 2024-02-22T00:33:59.314 INFO:tasks.workunit.client.0.smithi049.stdout:2/678: rmdir d2/d9/de/d3a/dc3 39 2024-02-22T00:33:59.314 INFO:tasks.workunit.client.0.smithi049.stdout:6/726: chown d3/d36/d70/dcc/ff0 2475 1 2024-02-22T00:33:59.316 INFO:tasks.workunit.client.0.smithi049.stdout:7/760: dwrite d1/df/d62/d60/ff5 [0,4194304] 0 2024-02-22T00:33:59.320 INFO:tasks.workunit.client.0.smithi049.stdout:6/727: dread - d3/f76 zero size 2024-02-22T00:33:59.326 INFO:tasks.workunit.client.0.smithi049.stdout:4/741: link d3/d22/d5c/d35/c53 d3/d8/d10/d12/cf6 0 2024-02-22T00:33:59.328 INFO:tasks.workunit.client.0.smithi049.stdout:6/728: mkdir d3/d36/d70/df8 0 2024-02-22T00:33:59.330 INFO:tasks.workunit.client.0.smithi049.stdout:0/668: truncate d3/df/f2b 155543 0 2024-02-22T00:33:59.331 INFO:tasks.workunit.client.0.smithi049.stdout:9/764: dwrite d17/d21/d47/ff5 [0,4194304] 0 2024-02-22T00:33:59.333 INFO:tasks.workunit.client.0.smithi049.stdout:4/742: write d3/d22/d5c/d9a/fc7 [1082909,125807] 0 2024-02-22T00:33:59.341 INFO:tasks.workunit.client.0.smithi049.stdout:7/761: dwrite d1/df/fe9 [0,4194304] 0 2024-02-22T00:33:59.343 INFO:tasks.workunit.client.0.smithi049.stdout:5/642: dread d0/f4c [0,4194304] 0 2024-02-22T00:33:59.346 INFO:tasks.workunit.client.0.smithi049.stdout:6/729: rename d3/d16/d32/cc4 to d3/d64/d60/da0/cf9 0 2024-02-22T00:33:59.350 INFO:tasks.workunit.client.0.smithi049.stdout:9/765: dwrite d17/d1c/f1e [0,4194304] 0 2024-02-22T00:33:59.351 INFO:tasks.workunit.client.0.smithi049.stdout:9/766: chown d17/d21/fa4 57761 1 2024-02-22T00:33:59.352 INFO:tasks.workunit.client.0.smithi049.stdout:4/743: creat d3/d8/d10/d43/d4d/db9/ff7 x:0 0 0 2024-02-22T00:33:59.355 INFO:tasks.workunit.client.0.smithi049.stdout:0/669: rename d3/df/d48/d54 to d3/df/d48/d6f/d90/dcc 0 2024-02-22T00:33:59.355 INFO:tasks.workunit.client.0.smithi049.stdout:6/730: truncate d3/f76 829143 0 2024-02-22T00:33:59.359 INFO:tasks.workunit.client.0.smithi049.stdout:0/670: fdatasync d3/df/d59/f83 0 2024-02-22T00:33:59.359 INFO:tasks.workunit.client.0.smithi049.stdout:5/643: mknod d0/d20/d84/da0/db6/dc3/d70/cd2 0 2024-02-22T00:33:59.362 INFO:tasks.workunit.client.0.smithi049.stdout:6/731: dread d3/d64/d59/fcb [0,4194304] 0 2024-02-22T00:33:59.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/767: creat d17/d21/d47/d5d/ffc x:0 0 0 2024-02-22T00:33:59.366 INFO:tasks.workunit.client.0.smithi049.stdout:5/644: creat d0/d20/dad/fd3 x:0 0 0 2024-02-22T00:33:59.366 INFO:tasks.workunit.client.0.smithi049.stdout:4/744: link d3/d22/l74 d3/d22/df0/df4/lf8 0 2024-02-22T00:33:59.368 INFO:tasks.workunit.client.0.smithi049.stdout:7/762: rename d1/df/d62/d1c/d1d/d6e/c9b to d1/df/d62/d1c/c111 0 2024-02-22T00:33:59.371 INFO:tasks.workunit.client.0.smithi049.stdout:0/671: fsync d3/d1e/f6a 0 2024-02-22T00:33:59.371 INFO:tasks.workunit.client.0.smithi049.stdout:7/763: fsync d1/d41/ff6 0 2024-02-22T00:33:59.371 INFO:tasks.workunit.client.0.smithi049.stdout:2/679: dread d2/d9/de/d10/f3d [0,4194304] 0 2024-02-22T00:33:59.372 INFO:tasks.workunit.client.0.smithi049.stdout:5/645: rmdir d0/d20/d50/d24/d54 39 2024-02-22T00:33:59.374 INFO:tasks.workunit.client.0.smithi049.stdout:6/732: dwrite d3/d37/fa5 [0,4194304] 0 2024-02-22T00:33:59.374 INFO:tasks.workunit.client.0.smithi049.stdout:2/680: dread - d2/fd4 zero size 2024-02-22T00:33:59.375 INFO:tasks.workunit.client.0.smithi049.stdout:9/768: rename d17/d1c/d25/d39/d90/fb8 to d17/d1c/d25/dba/ffd 0 2024-02-22T00:33:59.377 INFO:tasks.workunit.client.0.smithi049.stdout:7/764: mkdir d1/d49/d5a/d112 0 2024-02-22T00:33:59.378 INFO:tasks.workunit.client.0.smithi049.stdout:7/765: dread - d1/fd3 zero size 2024-02-22T00:33:59.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/681: write d2/d9/dd/d4d/d72/da0/fee [714142,116659] 0 2024-02-22T00:33:59.379 INFO:tasks.workunit.client.0.smithi049.stdout:6/733: creat d3/d64/d60/da0/ffa x:0 0 0 2024-02-22T00:33:59.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/734: readlink d3/d64/l88 0 2024-02-22T00:33:59.381 INFO:tasks.workunit.client.0.smithi049.stdout:9/769: creat d17/d1c/d8c/ffe x:0 0 0 2024-02-22T00:33:59.384 INFO:tasks.workunit.client.0.smithi049.stdout:5/646: dread d0/d20/d84/da0/db6/dc3/d6f/d94/fd [0,4194304] 0 2024-02-22T00:33:59.388 INFO:tasks.workunit.client.0.smithi049.stdout:4/745: link d3/d22/d49/d57/ca0 d3/d8/d10/d43/d4d/db9/d8a/d48/cf9 0 2024-02-22T00:33:59.388 INFO:tasks.workunit.client.0.smithi049.stdout:2/682: mknod d2/d9/dd/d4d/d72/da0/dba/cf8 0 2024-02-22T00:33:59.390 INFO:tasks.workunit.client.0.smithi049.stdout:5/647: creat d0/d20/dad/daf/fd4 x:0 0 0 2024-02-22T00:33:59.392 INFO:tasks.workunit.client.0.smithi049.stdout:7/766: rename d1/fec to d1/df/d62/d1c/f113 0 2024-02-22T00:33:59.392 INFO:tasks.workunit.client.0.smithi049.stdout:6/735: creat d3/d36/ffb x:0 0 0 2024-02-22T00:33:59.393 INFO:tasks.workunit.client.0.smithi049.stdout:2/683: symlink d2/d9/dd/d74/lf9 0 2024-02-22T00:33:59.393 INFO:tasks.workunit.client.0.smithi049.stdout:7/767: dread - d1/df/d62/d57/fd7 zero size 2024-02-22T00:33:59.394 INFO:tasks.workunit.client.0.smithi049.stdout:2/684: chown d2/d9/d17/ldd 25 1 2024-02-22T00:33:59.395 INFO:tasks.workunit.client.0.smithi049.stdout:5/648: mkdir d0/d20/d84/da0/db6/dc3/d64/dd5 0 2024-02-22T00:33:59.396 INFO:tasks.workunit.client.0.smithi049.stdout:7/768: readlink d1/d41/d55/ld9 0 2024-02-22T00:33:59.397 INFO:tasks.workunit.client.0.smithi049.stdout:4/746: link d3/c8f d3/d8/d10/d43/d4d/cfa 0 2024-02-22T00:33:59.399 INFO:tasks.workunit.client.0.smithi049.stdout:5/649: chown d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89 96001027 1 2024-02-22T00:33:59.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/685: fdatasync d2/d9/de/d10/f31 0 2024-02-22T00:33:59.401 INFO:tasks.workunit.client.0.smithi049.stdout:7/769: mknod d1/d41/c114 0 2024-02-22T00:33:59.402 INFO:tasks.workunit.client.0.smithi049.stdout:4/747: symlink d3/d22/d49/lfb 0 2024-02-22T00:33:59.402 INFO:tasks.workunit.client.0.smithi049.stdout:6/736: dread d3/d36/d70/dcc/ff0 [0,4194304] 0 2024-02-22T00:33:59.403 INFO:tasks.workunit.client.0.smithi049.stdout:2/686: dread - d2/d9/de/d10/d2e/f92 zero size 2024-02-22T00:33:59.404 INFO:tasks.workunit.client.0.smithi049.stdout:4/748: chown d3/d22/d5c/l27 6 1 2024-02-22T00:33:59.408 INFO:tasks.workunit.client.0.smithi049.stdout:6/737: mknod d3/d64/d60/cfc 0 2024-02-22T00:33:59.411 INFO:tasks.workunit.client.0.smithi049.stdout:6/738: chown d3/fa1 43264 1 2024-02-22T00:33:59.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/650: dwrite d0/d20/d50/d24/f2f [0,4194304] 0 2024-02-22T00:33:59.415 INFO:tasks.workunit.client.0.smithi049.stdout:7/770: dwrite d1/d41/fc0 [0,4194304] 0 2024-02-22T00:33:59.415 INFO:tasks.workunit.client.0.smithi049.stdout:2/687: rename d2/d9/d17/lce to d2/d9/d17/dd6/lfa 0 2024-02-22T00:33:59.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/651: write d0/f7e [3112037,53983] 0 2024-02-22T00:33:59.420 INFO:tasks.workunit.client.0.smithi049.stdout:4/749: rename d3/d22/d5c/ff3 to d3/d8/d10/dc4/ffc 0 2024-02-22T00:33:59.422 INFO:tasks.workunit.client.0.smithi049.stdout:9/770: dread d17/d21/f46 [0,4194304] 0 2024-02-22T00:33:59.424 INFO:tasks.workunit.client.0.smithi049.stdout:6/739: mkdir d3/d36/d70/dcc/d4d/d8b/df7/dfd 0 2024-02-22T00:33:59.426 INFO:tasks.workunit.client.0.smithi049.stdout:7/771: creat d1/df/d62/d60/d7e/f115 x:0 0 0 2024-02-22T00:33:59.428 INFO:tasks.workunit.client.0.smithi049.stdout:9/771: dread - d17/d21/d4e/d89/d94/df0/ffb zero size 2024-02-22T00:33:59.430 INFO:tasks.workunit.client.0.smithi049.stdout:0/672: dwrite d3/d1e/d58/f7c [0,4194304] 0 2024-02-22T00:33:59.432 INFO:tasks.workunit.client.0.smithi049.stdout:6/740: fsync d3/ff6 0 2024-02-22T00:33:59.433 INFO:tasks.workunit.client.0.smithi049.stdout:0/673: chown d3/df/d48/d6f/d7a/f9d 138545 1 2024-02-22T00:33:59.435 INFO:tasks.workunit.client.0.smithi049.stdout:2/688: rename d2/dda/f68 to d2/d9/de/d10/ffb 0 2024-02-22T00:33:59.437 INFO:tasks.workunit.client.0.smithi049.stdout:4/750: creat d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/ffd x:0 0 0 2024-02-22T00:33:59.439 INFO:tasks.workunit.client.0.smithi049.stdout:7/772: dwrite d1/f94 [0,4194304] 0 2024-02-22T00:33:59.440 INFO:tasks.workunit.client.0.smithi049.stdout:6/741: rename d3/d16/f30 to d3/d64/d59/d72/d92/ffe 0 2024-02-22T00:33:59.444 INFO:tasks.workunit.client.0.smithi049.stdout:6/742: rmdir d3/d64/d60/dc2 39 2024-02-22T00:33:59.445 INFO:tasks.workunit.client.0.smithi049.stdout:2/689: mknod d2/d9/de/d3a/dc3/cfc 0 2024-02-22T00:33:59.450 INFO:tasks.workunit.client.0.smithi049.stdout:6/743: write d3/d64/d5f/fd5 [49888,37482] 0 2024-02-22T00:33:59.453 INFO:tasks.workunit.client.0.smithi049.stdout:9/772: dread d17/d1c/d25/d71/da3/fd0 [0,4194304] 0 2024-02-22T00:33:59.455 INFO:tasks.workunit.client.0.smithi049.stdout:7/773: dwrite d1/df/d62/d60/d7e/f106 [0,4194304] 0 2024-02-22T00:33:59.456 INFO:tasks.workunit.client.0.smithi049.stdout:6/744: dread - d3/d36/d70/dcc/d4d/d8b/fe1 zero size 2024-02-22T00:33:59.456 INFO:tasks.workunit.client.0.smithi049.stdout:7/774: readlink d1/d49/l8a 0 2024-02-22T00:33:59.457 INFO:tasks.workunit.client.0.smithi049.stdout:9/773: fsync d17/d1c/f81 0 2024-02-22T00:33:59.458 INFO:tasks.workunit.client.0.smithi049.stdout:9/774: stat d17/d21/d47 0 2024-02-22T00:33:59.461 INFO:tasks.workunit.client.0.smithi049.stdout:7/775: creat d1/d41/d28/d71/d10a/f116 x:0 0 0 2024-02-22T00:33:59.462 INFO:tasks.workunit.client.0.smithi049.stdout:9/775: mkdir d17/d1c/d25/dba/dff 0 2024-02-22T00:33:59.464 INFO:tasks.workunit.client.0.smithi049.stdout:9/776: creat d17/d1c/d25/d39/d90/f100 x:0 0 0 2024-02-22T00:33:59.466 INFO:tasks.workunit.client.0.smithi049.stdout:7/776: link d1/df/d62/l4c d1/l117 0 2024-02-22T00:33:59.470 INFO:tasks.workunit.client.0.smithi049.stdout:7/777: creat d1/d41/dae/f118 x:0 0 0 2024-02-22T00:33:59.471 INFO:tasks.workunit.client.0.smithi049.stdout:9/777: dwrite d17/d1c/d25/d39/d90/f9e [0,4194304] 0 2024-02-22T00:33:59.474 INFO:tasks.workunit.client.0.smithi049.stdout:7/778: creat d1/df/d62/d60/d7e/de6/ded/f119 x:0 0 0 2024-02-22T00:33:59.475 INFO:tasks.workunit.client.0.smithi049.stdout:9/778: mkdir d17/d1c/d25/dba/dff/d101 0 2024-02-22T00:33:59.477 INFO:tasks.workunit.client.0.smithi049.stdout:7/779: mknod d1/df/d62/d1c/d1d/c11a 0 2024-02-22T00:33:59.478 INFO:tasks.workunit.client.0.smithi049.stdout:9/779: creat d17/d21/d47/d5d/db4/f102 x:0 0 0 2024-02-22T00:33:59.480 INFO:tasks.workunit.client.0.smithi049.stdout:7/780: dread - d1/d41/dae/f102 zero size 2024-02-22T00:33:59.481 INFO:tasks.workunit.client.0.smithi049.stdout:0/674: dread d3/d6/d8/d36/d81/f89 [0,4194304] 0 2024-02-22T00:33:59.483 INFO:tasks.workunit.client.0.smithi049.stdout:0/675: chown d3/dcb 0 1 2024-02-22T00:33:59.485 INFO:tasks.workunit.client.0.smithi049.stdout:7/781: rmdir d1/d41/d28/d71/d72 39 2024-02-22T00:33:59.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/751: mkdir d3/d22/d5c/d5e/dfe 0 2024-02-22T00:33:59.488 INFO:tasks.workunit.client.0.smithi049.stdout:0/676: creat d3/df/d59/d8e/fcd x:0 0 0 2024-02-22T00:33:59.489 INFO:tasks.workunit.client.0.smithi049.stdout:9/780: dwrite d17/d1c/d25/d71/da3/fb3 [0,4194304] 0 2024-02-22T00:33:59.491 INFO:tasks.workunit.client.0.smithi049.stdout:7/782: chown d1/d41/d28/d71/d72/cdf 0 1 2024-02-22T00:33:59.493 INFO:tasks.workunit.client.0.smithi049.stdout:0/677: mknod d3/cce 0 2024-02-22T00:33:59.495 INFO:tasks.workunit.client.0.smithi049.stdout:2/690: write d2/d9/dd/d4d/f89 [769364,4366] 0 2024-02-22T00:33:59.495 INFO:tasks.workunit.client.0.smithi049.stdout:7/783: mknod d1/d49/d4d/c11b 0 2024-02-22T00:33:59.502 INFO:tasks.workunit.client.0.smithi049.stdout:7/784: readlink d1/df/d62/d57/lf8 0 2024-02-22T00:33:59.504 INFO:tasks.workunit.client.0.smithi049.stdout:4/752: dwrite d3/d8/d10/d43/d4d/db9/d8a/fcf [0,4194304] 0 2024-02-22T00:33:59.504 INFO:tasks.workunit.client.0.smithi049.stdout:2/691: mknod d2/dda/cfd 0 2024-02-22T00:33:59.509 INFO:tasks.workunit.client.0.smithi049.stdout:0/678: rename d3/df/d59/d60/fc8 to d3/df/d48/d6f/d90/dcc/fcf 0 2024-02-22T00:33:59.510 INFO:tasks.workunit.client.0.smithi049.stdout:9/781: dwrite d17/d1c/d8c/fc6 [0,4194304] 0 2024-02-22T00:33:59.512 INFO:tasks.workunit.client.0.smithi049.stdout:4/753: fsync d3/d22/d5c/d9a/fa4 0 2024-02-22T00:33:59.519 INFO:tasks.workunit.client.0.smithi049.stdout:7/785: creat d1/df/d62/d48/d99/f11c x:0 0 0 2024-02-22T00:33:59.519 INFO:tasks.workunit.client.0.smithi049.stdout:2/692: write d2/d9/de/d3a/d6d/faa [58781,14242] 0 2024-02-22T00:33:59.519 INFO:tasks.workunit.client.0.smithi049.stdout:6/745: dwrite d3/d16/f78 [0,4194304] 0 2024-02-22T00:33:59.527 INFO:tasks.workunit.client.0.smithi049.stdout:3/559: sync 2024-02-22T00:33:59.527 INFO:tasks.workunit.client.0.smithi049.stdout:9/782: rename d17/d1c/d25/d39/d90 to d17/d1c/d8c/db0/d103 0 2024-02-22T00:33:59.527 INFO:tasks.workunit.client.0.smithi049.stdout:2/693: fsync d2/dda/f67 0 2024-02-22T00:33:59.530 INFO:tasks.workunit.client.0.smithi049.stdout:3/560: write d0/f3b [2787244,26208] 0 2024-02-22T00:33:59.530 INFO:tasks.workunit.client.0.smithi049.stdout:0/679: dwrite d3/df/d48/d6f/d90/dcc/f5d [0,4194304] 0 2024-02-22T00:33:59.533 INFO:tasks.workunit.client.0.smithi049.stdout:3/561: chown d0/d14 18 1 2024-02-22T00:33:59.537 INFO:tasks.workunit.client.0.smithi049.stdout:3/562: creat d0/d14/d4d/d4e/fa9 x:0 0 0 2024-02-22T00:33:59.537 INFO:tasks.workunit.client.0.smithi049.stdout:4/754: dwrite d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/ffd [0,4194304] 0 2024-02-22T00:33:59.539 INFO:tasks.workunit.client.0.smithi049.stdout:9/783: getdents d17/d21/d3c/dbf/de0 0 2024-02-22T00:33:59.542 INFO:tasks.workunit.client.0.smithi049.stdout:9/784: dread - d17/d21/d85/fa2 zero size 2024-02-22T00:33:59.544 INFO:tasks.workunit.client.0.smithi049.stdout:9/785: stat d17/d1c/d25/d71/d73 0 2024-02-22T00:33:59.545 INFO:tasks.workunit.client.0.smithi049.stdout:3/563: unlink d0/dd/d26/d2e/d52/f88 0 2024-02-22T00:33:59.545 INFO:tasks.workunit.client.0.smithi049.stdout:2/694: dwrite d2/d9/de/d10/f3d [4194304,4194304] 0 2024-02-22T00:33:59.547 INFO:tasks.workunit.client.0.smithi049.stdout:4/755: rename d3/d8/d20 to d3/d8/d10/d43/dff 0 2024-02-22T00:33:59.550 INFO:tasks.workunit.client.0.smithi049.stdout:0/680: link d3/df/d48/d63/l8d d3/df/db5/ld0 0 2024-02-22T00:33:59.553 INFO:tasks.workunit.client.0.smithi049.stdout:2/695: creat d2/d9/de/d10/d59/ffe x:0 0 0 2024-02-22T00:33:59.554 INFO:tasks.workunit.client.0.smithi049.stdout:9/786: mkdir d17/d21/d104 0 2024-02-22T00:33:59.554 INFO:tasks.workunit.client.0.smithi049.stdout:4/756: write d3/d22/d5c/f36 [2382860,112233] 0 2024-02-22T00:33:59.554 INFO:tasks.workunit.client.0.smithi049.stdout:3/564: mknod d0/d14/caa 0 2024-02-22T00:33:59.556 INFO:tasks.workunit.client.0.smithi049.stdout:0/681: write d3/d6/d8/d36/d81/f89 [1192101,44731] 0 2024-02-22T00:33:59.556 INFO:tasks.workunit.client.0.smithi049.stdout:3/565: chown d0/d14/c22 9438375 1 2024-02-22T00:33:59.559 INFO:tasks.workunit.client.0.smithi049.stdout:3/566: write d0/dd/d26/f30 [3474203,80663] 0 2024-02-22T00:33:59.559 INFO:tasks.workunit.client.0.smithi049.stdout:0/682: unlink d3/d6/d8/f6e 0 2024-02-22T00:33:59.560 INFO:tasks.workunit.client.0.smithi049.stdout:3/567: chown d0/dd/f3 5951 1 2024-02-22T00:33:59.561 INFO:tasks.workunit.client.0.smithi049.stdout:4/757: creat d3/d22/d5c/da5/da8/f100 x:0 0 0 2024-02-22T00:33:59.561 INFO:tasks.workunit.client.0.smithi049.stdout:2/696: dread d2/d9/de/d10/f31 [0,4194304] 0 2024-02-22T00:33:59.561 INFO:tasks.workunit.client.0.smithi049.stdout:0/683: symlink d3/d6/d29/ld1 0 2024-02-22T00:33:59.563 INFO:tasks.workunit.client.0.smithi049.stdout:0/684: stat d3/df/faf 0 2024-02-22T00:33:59.571 INFO:tasks.workunit.client.0.smithi049.stdout:3/568: dwrite d0/dd/f13 [4194304,4194304] 0 2024-02-22T00:33:59.572 INFO:tasks.workunit.client.0.smithi049.stdout:2/697: dread d2/d9/de/d10/d2e/d42/d80/f81 [0,4194304] 0 2024-02-22T00:33:59.577 INFO:tasks.workunit.client.0.smithi049.stdout:0/685: dwrite d3/df/d48/d6f/d7a/f82 [0,4194304] 0 2024-02-22T00:33:59.586 INFO:tasks.workunit.client.0.smithi049.stdout:0/686: dwrite d3/df/f7d [0,4194304] 0 2024-02-22T00:33:59.588 INFO:tasks.workunit.client.0.smithi049.stdout:0/687: readlink d3/d6/d8/la 0 2024-02-22T00:33:59.604 INFO:tasks.workunit.client.0.smithi049.stdout:4/758: dwrite d3/d8/d10/d43/d4d/f5f [0,4194304] 0 2024-02-22T00:33:59.605 INFO:tasks.workunit.client.0.smithi049.stdout:4/759: fdatasync d3/fde 0 2024-02-22T00:33:59.614 INFO:tasks.workunit.client.0.smithi049.stdout:0/688: truncate d3/df/d17/f24 4399477 0 2024-02-22T00:33:59.618 INFO:tasks.workunit.client.0.smithi049.stdout:6/746: truncate d3/d16/f24 3861150 0 2024-02-22T00:33:59.618 INFO:tasks.workunit.client.0.smithi049.stdout:4/760: write d3/d8/d10/d43/d4d/db9/f59 [8350442,4606] 0 2024-02-22T00:33:59.618 INFO:tasks.workunit.client.0.smithi049.stdout:2/698: dwrite d2/d9/de/d10/f19 [4194304,4194304] 0 2024-02-22T00:33:59.623 INFO:tasks.workunit.client.0.smithi049.stdout:7/786: truncate d1/df/d62/d1c/d6d/fb2 210112 0 2024-02-22T00:33:59.625 INFO:tasks.workunit.client.0.smithi049.stdout:7/787: chown d1/d41/d28/c64 214 1 2024-02-22T00:33:59.631 INFO:tasks.workunit.client.0.smithi049.stdout:6/747: fsync d3/d36/d70/dcc/d4d/d8b/fe1 0 2024-02-22T00:33:59.639 INFO:tasks.workunit.client.0.smithi049.stdout:6/748: mknod d3/d36/d70/dcc/d4d/d8b/cff 0 2024-02-22T00:33:59.647 INFO:tasks.workunit.client.0.smithi049.stdout:4/761: link d3/d8/d10/d12/fd1 d3/d22/f101 0 2024-02-22T00:33:59.652 INFO:tasks.workunit.client.0.smithi049.stdout:6/749: getdents d3/d64/d59/d72/d92/db1/db3 0 2024-02-22T00:33:59.653 INFO:tasks.workunit.client.0.smithi049.stdout:4/762: creat d3/d8/f102 x:0 0 0 2024-02-22T00:33:59.654 INFO:tasks.workunit.client.0.smithi049.stdout:1/738: sync 2024-02-22T00:33:59.655 INFO:tasks.workunit.client.0.smithi049.stdout:6/750: mknod d3/d36/d70/dcc/d4d/d8b/c100 0 2024-02-22T00:33:59.658 INFO:tasks.workunit.client.0.smithi049.stdout:4/763: dread d3/d8/d10/d43/d4d/db9/d8a/d48/d60/f9b [0,4194304] 0 2024-02-22T00:33:59.664 INFO:tasks.workunit.client.0.smithi049.stdout:1/739: dwrite d2/d8/db/d25/d40/d41/d84/f9c [0,4194304] 0 2024-02-22T00:33:59.669 INFO:tasks.workunit.client.0.smithi049.stdout:1/740: creat d2/ff6 x:0 0 0 2024-02-22T00:33:59.669 INFO:tasks.workunit.client.0.smithi049.stdout:4/764: dwrite d3/d8/d10/d12/f38 [4194304,4194304] 0 2024-02-22T00:33:59.670 INFO:tasks.workunit.client.0.smithi049.stdout:4/765: stat d3/d8/d10/dc4/fc8 0 2024-02-22T00:33:59.672 INFO:tasks.workunit.client.0.smithi049.stdout:4/766: fdatasync d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/fec 0 2024-02-22T00:33:59.680 INFO:tasks.workunit.client.0.smithi049.stdout:3/569: write d0/d59/f85 [1733170,55534] 0 2024-02-22T00:33:59.683 INFO:tasks.workunit.client.0.smithi049.stdout:4/767: dread d3/d8/d10/d39/f37 [0,4194304] 0 2024-02-22T00:33:59.689 INFO:tasks.workunit.client.0.smithi049.stdout:4/768: rename d3/d8/d10/d39/ff2 to d3/d8/d10/dc4/f103 0 2024-02-22T00:33:59.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/788: write d1/df/d62/d60/f82 [774006,12443] 0 2024-02-22T00:33:59.694 INFO:tasks.workunit.client.0.smithi049.stdout:4/769: stat d3/d8/d10/d12/c7b 0 2024-02-22T00:33:59.695 INFO:tasks.workunit.client.0.smithi049.stdout:0/689: dwrite d3/df/f2b [0,4194304] 0 2024-02-22T00:33:59.701 INFO:tasks.workunit.client.0.smithi049.stdout:8/746: sync 2024-02-22T00:33:59.701 INFO:tasks.workunit.client.0.smithi049.stdout:5/652: sync 2024-02-22T00:33:59.702 INFO:tasks.workunit.client.0.smithi049.stdout:2/699: dwrite d2/d9/de/d3a/f44 [0,4194304] 0 2024-02-22T00:33:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:3/570: rmdir d0/d14/d4d 39 2024-02-22T00:33:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:5/653: mknod d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/cd6 0 2024-02-22T00:33:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:0/690: dwrite d3/d6/f4d [4194304,4194304] 0 2024-02-22T00:33:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:4/770: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/d104 0 2024-02-22T00:33:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:6/751: dread d3/d16/f24 [0,4194304] 0 2024-02-22T00:33:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:4/771: chown d3/d22/d3d/c95 2 1 2024-02-22T00:33:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:2/700: write d2/d9/f6f [1163604,87557] 0 2024-02-22T00:33:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:4/772: chown d3/d8/d10/d43/d4d/db9/d8a/d48/fba 24013262 1 2024-02-22T00:33:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:1/741: unlink d2/le5 0 2024-02-22T00:33:59.728 INFO:tasks.workunit.client.0.smithi049.stdout:7/789: truncate d1/df/d62/d1c/d1d/d6e/f76 1937804 0 2024-02-22T00:33:59.730 INFO:tasks.workunit.client.0.smithi049.stdout:7/790: dread - d1/d41/d55/d89/fd4 zero size 2024-02-22T00:33:59.733 INFO:tasks.workunit.client.0.smithi049.stdout:7/791: write d1/df/d62/d48/d99/fc5 [785094,72167] 0 2024-02-22T00:33:59.733 INFO:tasks.workunit.client.0.smithi049.stdout:1/742: fdatasync d2/f30 0 2024-02-22T00:33:59.734 INFO:tasks.workunit.client.0.smithi049.stdout:6/752: dread d3/d64/d60/f9c [0,4194304] 0 2024-02-22T00:33:59.735 INFO:tasks.workunit.client.0.smithi049.stdout:0/691: link d3/df/d48/d6f/d90/dcc/fcf d3/df/d59/d60/fd2 0 2024-02-22T00:33:59.736 INFO:tasks.workunit.client.0.smithi049.stdout:8/747: truncate d1/d2/da5/d15/d30/d36/d52/daf/ff4 3702509 0 2024-02-22T00:33:59.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/692: write d3/d6/f4d [1764029,34411] 0 2024-02-22T00:33:59.738 INFO:tasks.workunit.client.0.smithi049.stdout:4/773: getdents d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/d104 0 2024-02-22T00:33:59.738 INFO:tasks.workunit.client.0.smithi049.stdout:9/787: sync 2024-02-22T00:33:59.742 INFO:tasks.workunit.client.0.smithi049.stdout:7/792: mkdir d1/d49/d11d 0 2024-02-22T00:33:59.743 INFO:tasks.workunit.client.0.smithi049.stdout:2/701: creat d2/d9/dd/d4d/d72/da0/fff x:0 0 0 2024-02-22T00:33:59.745 INFO:tasks.workunit.client.0.smithi049.stdout:4/774: read d3/d8/f14 [287792,98489] 0 2024-02-22T00:33:59.745 INFO:tasks.workunit.client.0.smithi049.stdout:6/753: mkdir d3/d64/d59/d72/d92/d6c/d101 0 2024-02-22T00:33:59.834 INFO:tasks.workunit.client.0.smithi049.stdout:1/743: symlink d2/d8/db/d25/d62/lf7 0 2024-02-22T00:33:59.837 INFO:tasks.workunit.client.0.smithi049.stdout:3/571: truncate d0/dd/d26/d2e/f84 48154 0 2024-02-22T00:33:59.837 INFO:tasks.workunit.client.0.smithi049.stdout:5/654: dwrite d0/d20/d84/da0/db6/dc3/d70/db1/d9e/fcc [0,4194304] 0 2024-02-22T00:33:59.840 INFO:tasks.workunit.client.0.smithi049.stdout:8/748: creat d1/d2/da5/d15/d30/d36/d52/daf/dcb/f10a x:0 0 0 2024-02-22T00:33:59.841 INFO:tasks.workunit.client.0.smithi049.stdout:2/702: read d2/d9/dd/d4d/d5a/fbf [41733,22605] 0 2024-02-22T00:33:59.843 INFO:tasks.workunit.client.0.smithi049.stdout:7/793: symlink d1/df/d62/d1c/d1d/l11e 0 2024-02-22T00:33:59.843 INFO:tasks.workunit.client.0.smithi049.stdout:3/572: dread - d0/dd/d26/d2e/d52/f8b zero size 2024-02-22T00:33:59.845 INFO:tasks.workunit.client.0.smithi049.stdout:1/744: write d2/d8/db/d25/fc7 [4646216,38133] 0 2024-02-22T00:33:59.847 INFO:tasks.workunit.client.0.smithi049.stdout:6/754: dread d3/d64/d5f/f82 [0,4194304] 0 2024-02-22T00:33:59.848 INFO:tasks.workunit.client.0.smithi049.stdout:8/749: chown d1/d4c/dda/le4 23852 1 2024-02-22T00:33:59.848 INFO:tasks.workunit.client.0.smithi049.stdout:2/703: mknod d2/d9/de/d3a/d6d/c100 0 2024-02-22T00:33:59.849 INFO:tasks.workunit.client.0.smithi049.stdout:4/775: creat d3/d8/f105 x:0 0 0 2024-02-22T00:33:59.858 INFO:tasks.workunit.client.0.smithi049.stdout:4/776: fdatasync d3/d22/d5c/f93 0 2024-02-22T00:33:59.861 INFO:tasks.workunit.client.0.smithi049.stdout:1/745: truncate d2/d8/db/f1a 325858 0 2024-02-22T00:33:59.864 INFO:tasks.workunit.client.0.smithi049.stdout:5/655: dwrite d0/d20/dad/fd3 [0,4194304] 0 2024-02-22T00:33:59.865 INFO:tasks.workunit.client.0.smithi049.stdout:8/750: truncate d1/d2/da5/f78 3427317 0 2024-02-22T00:33:59.866 INFO:tasks.workunit.client.0.smithi049.stdout:3/573: dread d0/dd/f46 [0,4194304] 0 2024-02-22T00:33:59.869 INFO:tasks.workunit.client.0.smithi049.stdout:7/794: rename d1/df/d62/c2d to d1/df/d62/d1c/d1d/c11f 0 2024-02-22T00:33:59.870 INFO:tasks.workunit.client.0.smithi049.stdout:4/777: mkdir d3/d22/d5c/d5e/d106 0 2024-02-22T00:33:59.872 INFO:tasks.workunit.client.0.smithi049.stdout:6/755: dwrite d3/d37/fa5 [0,4194304] 0 2024-02-22T00:33:59.874 INFO:tasks.workunit.client.0.smithi049.stdout:2/704: rename d2/d9/de/d3a/dc3/fd1 to d2/d9/de/d10/d2e/f101 0 2024-02-22T00:33:59.876 INFO:tasks.workunit.client.0.smithi049.stdout:0/693: dread d3/f73 [0,4194304] 0 2024-02-22T00:33:59.877 INFO:tasks.workunit.client.0.smithi049.stdout:5/656: mknod d0/d20/d50/d24/cd7 0 2024-02-22T00:33:59.882 INFO:tasks.workunit.client.0.smithi049.stdout:4/778: read d3/d8/d10/d43/d4d/f5f [2663699,56844] 0 2024-02-22T00:33:59.885 INFO:tasks.workunit.client.0.smithi049.stdout:2/705: write d2/d9/de/d10/f12 [4105584,61154] 0 2024-02-22T00:33:59.887 INFO:tasks.workunit.client.0.smithi049.stdout:4/779: write d3/d8/d10/d12/f38 [4788815,108156] 0 2024-02-22T00:33:59.890 INFO:tasks.workunit.client.0.smithi049.stdout:7/795: creat d1/df/d62/d60/f120 x:0 0 0 2024-02-22T00:33:59.893 INFO:tasks.workunit.client.0.smithi049.stdout:1/746: rename d2/d8/da/f39 to d2/d8/db/ff8 0 2024-02-22T00:33:59.893 INFO:tasks.workunit.client.0.smithi049.stdout:8/751: dwrite d1/d4c/f55 [0,4194304] 0 2024-02-22T00:33:59.895 INFO:tasks.workunit.client.0.smithi049.stdout:0/694: mknod d3/df/d48/d6f/cd3 0 2024-02-22T00:33:59.895 INFO:tasks.workunit.client.0.smithi049.stdout:3/574: dwrite d0/dd/d26/d63/f9c [0,4194304] 0 2024-02-22T00:33:59.897 INFO:tasks.workunit.client.0.smithi049.stdout:0/695: read - d3/d1e/f9a zero size 2024-02-22T00:33:59.900 INFO:tasks.workunit.client.0.smithi049.stdout:2/706: dread - d2/d9/dd/d4d/d72/fdf zero size 2024-02-22T00:33:59.906 INFO:tasks.workunit.client.0.smithi049.stdout:0/696: dread - d3/df/d17/d50/d62/fa2 zero size 2024-02-22T00:33:59.907 INFO:tasks.workunit.client.0.smithi049.stdout:6/756: getdents d3/d64/d59/d72/d92/db1/db3 0 2024-02-22T00:33:59.910 INFO:tasks.workunit.client.0.smithi049.stdout:4/780: dread d3/d8/f9e [0,4194304] 0 2024-02-22T00:33:59.912 INFO:tasks.workunit.client.0.smithi049.stdout:7/796: symlink d1/df/d62/d1c/d24/d2e/df0/l121 0 2024-02-22T00:33:59.912 INFO:tasks.workunit.client.0.smithi049.stdout:6/757: mkdir d3/d16/d32/d7b/d102 0 2024-02-22T00:33:59.912 INFO:tasks.workunit.client.0.smithi049.stdout:5/657: getdents d0/d20/d84/da0/db6/dc3/d6f 0 2024-02-22T00:33:59.912 INFO:tasks.workunit.client.0.smithi049.stdout:8/752: unlink d1/d2/da5/d15/d30/d4b/c5e 0 2024-02-22T00:33:59.916 INFO:tasks.workunit.client.0.smithi049.stdout:5/658: fdatasync d0/d20/d84/da0/db6/f67 0 2024-02-22T00:33:59.916 INFO:tasks.workunit.client.0.smithi049.stdout:2/707: mkdir d2/d9/d102 0 2024-02-22T00:33:59.921 INFO:tasks.workunit.client.0.smithi049.stdout:1/747: creat d2/d8/db/d25/d40/d41/d84/dab/ff9 x:0 0 0 2024-02-22T00:33:59.923 INFO:tasks.workunit.client.0.smithi049.stdout:6/758: rename d3/d64/d59/d72/d92/d6c/d101 to d3/dcd/d103 0 2024-02-22T00:33:59.923 INFO:tasks.workunit.client.0.smithi049.stdout:3/575: symlink d0/lab 0 2024-02-22T00:33:59.928 INFO:tasks.workunit.client.0.smithi049.stdout:0/697: dwrite d3/d6/d29/f3f [4194304,4194304] 0 2024-02-22T00:33:59.930 INFO:tasks.workunit.client.0.smithi049.stdout:4/781: fsync d3/d8/f17 0 2024-02-22T00:33:59.931 INFO:tasks.workunit.client.0.smithi049.stdout:2/708: fsync d2/d9/de/d10/f31 0 2024-02-22T00:33:59.932 INFO:tasks.workunit.client.0.smithi049.stdout:4/782: dread - d3/d8/d10/d43/fd6 zero size 2024-02-22T00:33:59.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/759: write d3/d16/d32/d7b/fe3 [79597,119260] 0 2024-02-22T00:33:59.940 INFO:tasks.workunit.client.0.smithi049.stdout:1/748: creat d2/d69/dc4/ffa x:0 0 0 2024-02-22T00:33:59.942 INFO:tasks.workunit.client.0.smithi049.stdout:3/576: symlink d0/dd/d6f/lac 0 2024-02-22T00:33:59.943 INFO:tasks.workunit.client.0.smithi049.stdout:2/709: rename d2/d9/de/d3a/d6d/da6/lcf to d2/d9/de/d15/d1b/dc4/de9/l103 0 2024-02-22T00:33:59.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/659: mknod d0/d20/d50/d24/cd8 0 2024-02-22T00:33:59.947 INFO:tasks.workunit.client.0.smithi049.stdout:1/749: read - d2/d8/d4c/fb1 zero size 2024-02-22T00:33:59.947 INFO:tasks.workunit.client.0.smithi049.stdout:4/783: symlink d3/d8/d10/l107 0 2024-02-22T00:33:59.950 INFO:tasks.workunit.client.0.smithi049.stdout:8/753: dread d1/f1e [0,4194304] 0 2024-02-22T00:33:59.951 INFO:tasks.workunit.client.0.smithi049.stdout:2/710: rename d2/cb to d2/dda/d5d/c104 0 2024-02-22T00:33:59.953 INFO:tasks.workunit.client.0.smithi049.stdout:8/754: chown d1/d2/d5/d1b/f7f 167962 1 2024-02-22T00:33:59.955 INFO:tasks.workunit.client.0.smithi049.stdout:2/711: dread d2/d9/de/d10/d59/f8f [0,4194304] 0 2024-02-22T00:33:59.957 INFO:tasks.workunit.client.0.smithi049.stdout:4/784: creat d3/d8/d10/d12/dd8/f108 x:0 0 0 2024-02-22T00:33:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:8/755: dread d1/d2/f38 [0,4194304] 0 2024-02-22T00:33:59.959 INFO:tasks.workunit.client.0.smithi049.stdout:6/760: getdents d3/d64/d59 0 2024-02-22T00:33:59.960 INFO:tasks.workunit.client.0.smithi049.stdout:6/761: chown d3/d16/d32/d7b 108 1 2024-02-22T00:33:59.961 INFO:tasks.workunit.client.0.smithi049.stdout:5/660: rename d0/d20/dad/l87 to d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/ld9 0 2024-02-22T00:33:59.962 INFO:tasks.workunit.client.0.smithi049.stdout:0/698: truncate d3/f13 2765228 0 2024-02-22T00:33:59.962 INFO:tasks.workunit.client.0.smithi049.stdout:7/797: dread d1/df/d62/d1c/d24/d2e/f5e [0,4194304] 0 2024-02-22T00:33:59.962 INFO:tasks.workunit.client.0.smithi049.stdout:1/750: mknod d2/cfb 0 2024-02-22T00:33:59.964 INFO:tasks.workunit.client.0.smithi049.stdout:4/785: mknod d3/d22/d5c/d9a/c109 0 2024-02-22T00:33:59.964 INFO:tasks.workunit.client.0.smithi049.stdout:3/577: getdents d0/d14/d4d/d4e/d4f/d5b/d76/da6 0 2024-02-22T00:33:59.966 INFO:tasks.workunit.client.0.smithi049.stdout:2/712: creat d2/d9/dd/dbb/f105 x:0 0 0 2024-02-22T00:33:59.966 INFO:tasks.workunit.client.0.smithi049.stdout:6/762: write d3/f13 [4724718,119023] 0 2024-02-22T00:33:59.968 INFO:tasks.workunit.client.0.smithi049.stdout:3/578: read - d0/d14/d4d/d4e/d56/d5a/f92 zero size 2024-02-22T00:33:59.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/751: write d2/d8/db/ff8 [916247,101664] 0 2024-02-22T00:33:59.970 INFO:tasks.workunit.client.0.smithi049.stdout:6/763: chown d3/d64/d59/d72/d92/db1/db3/deb 15770057 1 2024-02-22T00:33:59.970 INFO:tasks.workunit.client.0.smithi049.stdout:7/798: rename d1/d41/d28/d71/d72/d95 to d1/d49/d5a/d112/d122 0 2024-02-22T00:33:59.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/699: creat d3/df/d59/d8c/fd4 x:0 0 0 2024-02-22T00:33:59.972 INFO:tasks.workunit.client.0.smithi049.stdout:8/756: creat d1/d2/da5/d15/f10b x:0 0 0 2024-02-22T00:33:59.973 INFO:tasks.workunit.client.0.smithi049.stdout:7/799: readlink d1/df/d62/d1c/d24/d2e/df0/l121 0 2024-02-22T00:33:59.973 INFO:tasks.workunit.client.0.smithi049.stdout:2/713: creat d2/d9/de/d3a/d6d/f106 x:0 0 0 2024-02-22T00:33:59.975 INFO:tasks.workunit.client.0.smithi049.stdout:4/786: creat d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/f10a x:0 0 0 2024-02-22T00:33:59.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/661: rmdir d0/d20/d84/da0/db6/dc3/d64/dd5 0 2024-02-22T00:33:59.979 INFO:tasks.workunit.client.0.smithi049.stdout:6/764: mknod d3/d36/d57/d75/dce/c104 0 2024-02-22T00:33:59.980 INFO:tasks.workunit.client.0.smithi049.stdout:4/787: mknod d3/d8/d10/d43/d4d/c10b 0 2024-02-22T00:33:59.981 INFO:tasks.workunit.client.0.smithi049.stdout:7/800: dread d1/d41/fe0 [0,4194304] 0 2024-02-22T00:33:59.981 INFO:tasks.workunit.client.0.smithi049.stdout:8/757: dread d1/d2/d5/d1b/d39/f6c [0,4194304] 0 2024-02-22T00:33:59.981 INFO:tasks.workunit.client.0.smithi049.stdout:0/700: chown d3/f13 194208 1 2024-02-22T00:33:59.982 INFO:tasks.workunit.client.0.smithi049.stdout:3/579: dwrite d0/dd/d26/d63/f8a [0,4194304] 0 2024-02-22T00:33:59.985 INFO:tasks.workunit.client.0.smithi049.stdout:2/714: truncate d2/d9/de/d3a/d6d/fd9 921781 0 2024-02-22T00:33:59.985 INFO:tasks.workunit.client.0.smithi049.stdout:5/662: creat d0/d20/d50/d24/d54/fda x:0 0 0 2024-02-22T00:33:59.992 INFO:tasks.workunit.client.0.smithi049.stdout:7/801: creat d1/df/d62/d1c/d24/d2e/f123 x:0 0 0 2024-02-22T00:33:59.992 INFO:tasks.workunit.client.0.smithi049.stdout:2/715: creat d2/d9/dd/dbb/f107 x:0 0 0 2024-02-22T00:33:59.992 INFO:tasks.workunit.client.0.smithi049.stdout:0/701: dread d3/d1e/f61 [0,4194304] 0 2024-02-22T00:33:59.995 INFO:tasks.workunit.client.0.smithi049.stdout:3/580: chown d0/d14/d4d/l4b 7811387 1 2024-02-22T00:33:59.995 INFO:tasks.workunit.client.0.smithi049.stdout:2/716: truncate d2/d9/de/d10/d2e/f101 1004017 0 2024-02-22T00:33:59.996 INFO:tasks.workunit.client.0.smithi049.stdout:5/663: stat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/l9a 0 2024-02-22T00:33:59.997 INFO:tasks.workunit.client.0.smithi049.stdout:0/702: creat d3/d6/fd5 x:0 0 0 2024-02-22T00:34:00.001 INFO:tasks.workunit.client.0.smithi049.stdout:2/717: chown d2/d9/de/d3a/d6d/lb0 44 1 2024-02-22T00:34:00.001 INFO:tasks.workunit.client.0.smithi049.stdout:5/664: write d0/d20/d84/da0/db6/dc3/f68 [1649958,100753] 0 2024-02-22T00:34:00.008 INFO:tasks.workunit.client.0.smithi049.stdout:7/802: dwrite d1/fd3 [0,4194304] 0 2024-02-22T00:34:00.009 INFO:tasks.workunit.client.0.smithi049.stdout:0/703: symlink d3/df/d17/d50/d62/ld6 0 2024-02-22T00:34:00.011 INFO:tasks.workunit.client.0.smithi049.stdout:6/765: dread d3/f13 [0,4194304] 0 2024-02-22T00:34:00.011 INFO:tasks.workunit.client.0.smithi049.stdout:3/581: dwrite d0/dd/d26/d63/f8a [0,4194304] 0 2024-02-22T00:34:00.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/803: creat d1/df/d62/d1c/d6d/f124 x:0 0 0 2024-02-22T00:34:00.026 INFO:tasks.workunit.client.0.smithi049.stdout:6/766: creat d3/d36/d70/dcc/d4d/d8b/df7/dfd/f105 x:0 0 0 2024-02-22T00:34:00.029 INFO:tasks.workunit.client.0.smithi049.stdout:5/665: dread d0/d20/d50/d24/d54/f85 [0,4194304] 0 2024-02-22T00:34:00.029 INFO:tasks.workunit.client.0.smithi049.stdout:0/704: dwrite d3/df/d7f/f93 [4194304,4194304] 0 2024-02-22T00:34:00.031 INFO:tasks.workunit.client.0.smithi049.stdout:8/758: truncate d1/d2/da5/d15/d65/d6a/faa 1487090 0 2024-02-22T00:34:00.032 INFO:tasks.workunit.client.0.smithi049.stdout:7/804: read d1/df/d62/d1c/f10e [656008,100046] 0 2024-02-22T00:34:00.041 INFO:tasks.workunit.client.0.smithi049.stdout:2/718: dwrite d2/d9/d17/f28 [0,4194304] 0 2024-02-22T00:34:00.045 INFO:tasks.workunit.client.0.smithi049.stdout:2/719: chown d2/d9/dd/d4d/d72/da0/dba 2489836 1 2024-02-22T00:34:00.045 INFO:tasks.workunit.client.0.smithi049.stdout:7/805: dwrite d1/df/d62/d60/f82 [0,4194304] 0 2024-02-22T00:34:00.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/582: dread d0/dd/d1e/f24 [0,4194304] 0 2024-02-22T00:34:00.052 INFO:tasks.workunit.client.0.smithi049.stdout:7/806: dwrite d1/d41/fa4 [4194304,4194304] 0 2024-02-22T00:34:00.067 INFO:tasks.workunit.client.0.smithi049.stdout:6/767: dread d3/d64/d60/f9c [8388608,4194304] 0 2024-02-22T00:34:00.071 INFO:tasks.workunit.client.0.smithi049.stdout:0/705: mknod d3/df/d48/d6f/d7a/cd7 0 2024-02-22T00:34:00.075 INFO:tasks.workunit.client.0.smithi049.stdout:3/583: creat d0/d59/d87/fad x:0 0 0 2024-02-22T00:34:00.076 INFO:tasks.workunit.client.0.smithi049.stdout:7/807: mkdir d1/df/d62/d60/d7e/de6/d125 0 2024-02-22T00:34:00.077 INFO:tasks.workunit.client.0.smithi049.stdout:6/768: rename d3/d16/d3b/fe0 to d3/d16/d3b/d8c/f106 0 2024-02-22T00:34:00.077 INFO:tasks.workunit.client.0.smithi049.stdout:0/706: rmdir d3/df/d17/d50 39 2024-02-22T00:34:00.078 INFO:tasks.workunit.client.0.smithi049.stdout:0/707: chown d3/d1e/l2e 8143552 1 2024-02-22T00:34:00.080 INFO:tasks.workunit.client.0.smithi049.stdout:2/720: mkdir d2/d9/de/d10/d2e/d42/d80/d108 0 2024-02-22T00:34:00.085 INFO:tasks.workunit.client.0.smithi049.stdout:5/666: link d0/d20/d84/da0/db6/dc3/d6f/lce d0/d20/d84/da0/db6/dc3/d6f/d94/d74/db2/ldb 0 2024-02-22T00:34:00.086 INFO:tasks.workunit.client.0.smithi049.stdout:2/721: rmdir d2/d9/d17/dd6 39 2024-02-22T00:34:00.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/769: dwrite d3/d16/d32/f98 [0,4194304] 0 2024-02-22T00:34:00.092 INFO:tasks.workunit.client.0.smithi049.stdout:0/708: getdents d3/df/d48/d63 0 2024-02-22T00:34:00.093 INFO:tasks.workunit.client.0.smithi049.stdout:5/667: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/fdc x:0 0 0 2024-02-22T00:34:00.101 INFO:tasks.workunit.client.0.smithi049.stdout:5/668: symlink d0/d20/d84/da0/db6/dc3/d7c/ldd 0 2024-02-22T00:34:00.104 INFO:tasks.workunit.client.0.smithi049.stdout:7/808: dread d1/df/d62/d1c/d1d/f46 [0,4194304] 0 2024-02-22T00:34:00.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/770: dwrite d3/d36/d70/dcc/d4d/fbb [0,4194304] 0 2024-02-22T00:34:00.107 INFO:tasks.workunit.client.0.smithi049.stdout:3/584: dwrite d0/f62 [0,4194304] 0 2024-02-22T00:34:00.117 INFO:tasks.workunit.client.0.smithi049.stdout:2/722: dread d2/d9/de/f26 [0,4194304] 0 2024-02-22T00:34:00.117 INFO:tasks.workunit.client.0.smithi049.stdout:5/669: creat d0/d20/d84/da0/db6/dc3/d6f/d94/fde x:0 0 0 2024-02-22T00:34:00.117 INFO:tasks.workunit.client.0.smithi049.stdout:0/709: dwrite d3/df/d17/d50/d62/fb3 [0,4194304] 0 2024-02-22T00:34:00.119 INFO:tasks.workunit.client.0.smithi049.stdout:3/585: mkdir d0/d14/dae 0 2024-02-22T00:34:00.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/771: write d3/d64/d60/dc2/fda [4661646,126340] 0 2024-02-22T00:34:00.123 INFO:tasks.workunit.client.0.smithi049.stdout:5/670: mknod d0/d20/d84/da0/cdf 0 2024-02-22T00:34:00.124 INFO:tasks.workunit.client.0.smithi049.stdout:3/586: write d0/dd/d1e/f78 [159180,42028] 0 2024-02-22T00:34:00.125 INFO:tasks.workunit.client.0.smithi049.stdout:0/710: write d3/d6/d8/f1a [3294537,120351] 0 2024-02-22T00:34:00.131 INFO:tasks.workunit.client.0.smithi049.stdout:2/723: dwrite d2/d9/de/fc0 [0,4194304] 0 2024-02-22T00:34:00.134 INFO:tasks.workunit.client.0.smithi049.stdout:5/671: creat d0/d20/d84/da0/db6/dc3/d70/db1/dbe/fe0 x:0 0 0 2024-02-22T00:34:00.134 INFO:tasks.workunit.client.0.smithi049.stdout:2/724: write d2/dda/d63/f7e [1479930,29035] 0 2024-02-22T00:34:00.135 INFO:tasks.workunit.client.0.smithi049.stdout:6/772: rename d3/d36/d70/dcc/d4d/f84 to d3/d36/d70/df8/f107 0 2024-02-22T00:34:00.136 INFO:tasks.workunit.client.0.smithi049.stdout:3/587: rmdir d0/dd/d26/da4 0 2024-02-22T00:34:00.138 INFO:tasks.workunit.client.0.smithi049.stdout:5/672: dread - d0/d20/d84/da0/db6/dc3/d6f/d94/d9c/fcd zero size 2024-02-22T00:34:00.141 INFO:tasks.workunit.client.0.smithi049.stdout:3/588: symlink d0/dd/d1e/laf 0 2024-02-22T00:34:00.142 INFO:tasks.workunit.client.0.smithi049.stdout:6/773: truncate d3/d36/d70/dcc/f55 270871 0 2024-02-22T00:34:00.148 INFO:tasks.workunit.client.0.smithi049.stdout:6/774: dread d3/d16/f3c [0,4194304] 0 2024-02-22T00:34:00.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/589: rename d0/dd/d26/d2e/d52/c9b to d0/d59/d8f/cb0 0 2024-02-22T00:34:00.150 INFO:tasks.workunit.client.0.smithi049.stdout:2/725: dwrite d2/d9/dd/d4d/d5a/fb2 [0,4194304] 0 2024-02-22T00:34:00.151 INFO:tasks.workunit.client.0.smithi049.stdout:7/809: write d1/df/d62/d1c/d24/d2e/f42 [4019989,114347] 0 2024-02-22T00:34:00.152 INFO:tasks.workunit.client.0.smithi049.stdout:5/673: dwrite d0/d20/d50/d24/f75 [0,4194304] 0 2024-02-22T00:34:00.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/775: dread - d3/fef zero size 2024-02-22T00:34:00.155 INFO:tasks.workunit.client.0.smithi049.stdout:0/711: write d3/d1e/d58/f5c [597659,43615] 0 2024-02-22T00:34:00.163 INFO:tasks.workunit.client.0.smithi049.stdout:5/674: write d0/d20/d84/da0/db6/dc3/d6f/d94/d9c/fcd [704471,92261] 0 2024-02-22T00:34:00.166 INFO:tasks.workunit.client.0.smithi049.stdout:6/776: symlink d3/d36/l108 0 2024-02-22T00:34:00.168 INFO:tasks.workunit.client.0.smithi049.stdout:7/810: link d1/d41/d28/c10b d1/df/d62/d1c/d24/d2e/c126 0 2024-02-22T00:34:00.170 INFO:tasks.workunit.client.0.smithi049.stdout:2/726: getdents d2/d9/de/d15/d1b/dc4 0 2024-02-22T00:34:00.171 INFO:tasks.workunit.client.0.smithi049.stdout:0/712: dread d3/df/d59/d8e/fa7 [0,4194304] 0 2024-02-22T00:34:00.172 INFO:tasks.workunit.client.0.smithi049.stdout:7/811: unlink d1/df/d62/d1c/d24/lcf 0 2024-02-22T00:34:00.174 INFO:tasks.workunit.client.0.smithi049.stdout:2/727: creat d2/d9/dd/d74/f109 x:0 0 0 2024-02-22T00:34:00.174 INFO:tasks.workunit.client.0.smithi049.stdout:3/590: dwrite d0/dd/f13 [4194304,4194304] 0 2024-02-22T00:34:00.179 INFO:tasks.workunit.client.0.smithi049.stdout:5/675: link d0/f4e d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/fe1 0 2024-02-22T00:34:00.179 INFO:tasks.workunit.client.0.smithi049.stdout:7/812: chown d1/df/d62/d1c/d24/f52 106703 1 2024-02-22T00:34:00.180 INFO:tasks.workunit.client.0.smithi049.stdout:3/591: chown d0/dd/f4c 1558 1 2024-02-22T00:34:00.180 INFO:tasks.workunit.client.0.smithi049.stdout:7/813: fsync d1/df/f13 0 2024-02-22T00:34:00.182 INFO:tasks.workunit.client.0.smithi049.stdout:7/814: dread - d1/df/d62/d1c/d24/d2e/f123 zero size 2024-02-22T00:34:00.182 INFO:tasks.workunit.client.0.smithi049.stdout:2/728: rename d2/d9/de/d10/fbc to d2/d9/dd/d4d/d72/da0/dba/f10a 0 2024-02-22T00:34:00.185 INFO:tasks.workunit.client.0.smithi049.stdout:2/729: dread - d2/d9/de/d15/d1b/dc4/ff3 zero size 2024-02-22T00:34:00.186 INFO:tasks.workunit.client.0.smithi049.stdout:7/815: rmdir d1/df/d62/d1c/d6d 39 2024-02-22T00:34:00.190 INFO:tasks.workunit.client.0.smithi049.stdout:7/816: write d1/d41/dae/fb9 [1205908,109982] 0 2024-02-22T00:34:00.192 INFO:tasks.workunit.client.0.smithi049.stdout:0/713: dread d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:34:00.195 INFO:tasks.workunit.client.0.smithi049.stdout:0/714: dread d3/df/d7f/fa3 [0,4194304] 0 2024-02-22T00:34:00.195 INFO:tasks.workunit.client.0.smithi049.stdout:2/730: creat d2/d9/de/d15/d1b/f10b x:0 0 0 2024-02-22T00:34:00.199 INFO:tasks.workunit.client.0.smithi049.stdout:2/731: chown d2/d9/dd/d4d/d72/da0/dba 0 1 2024-02-22T00:34:00.199 INFO:tasks.workunit.client.0.smithi049.stdout:7/817: mknod d1/d49/d5a/c127 0 2024-02-22T00:34:00.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/715: symlink d3/df/d17/d50/d62/ld8 0 2024-02-22T00:34:00.205 INFO:tasks.workunit.client.0.smithi049.stdout:2/732: read d2/d9/f3c [3462097,102980] 0 2024-02-22T00:34:00.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/592: dwrite d0/d14/d4d/d4e/d4f/d5b/d76/fa0 [0,4194304] 0 2024-02-22T00:34:00.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/733: chown d2/ff0 3 1 2024-02-22T00:34:00.207 INFO:tasks.workunit.client.0.smithi049.stdout:2/734: fdatasync d2/dda/d63/f7e 0 2024-02-22T00:34:00.341 INFO:tasks.workunit.client.0.smithi049.stdout:7/818: creat d1/d49/d5a/f128 x:0 0 0 2024-02-22T00:34:00.346 INFO:tasks.workunit.client.0.smithi049.stdout:2/735: mknod d2/d9/dd/d4d/da7/dd2/c10c 0 2024-02-22T00:34:00.355 INFO:tasks.workunit.client.0.smithi049.stdout:2/736: dread d2/d9/de/d10/d2e/d42/d80/fe0 [0,4194304] 0 2024-02-22T00:34:00.375 INFO:tasks.workunit.client.0.smithi049.stdout:0/716: link d3/d6/d8/d36/d81/f89 d3/df/d59/d8c/fd9 0 2024-02-22T00:34:00.381 INFO:tasks.workunit.client.0.smithi049.stdout:0/717: dwrite d3/d1e/d58/f7c [0,4194304] 0 2024-02-22T00:34:00.383 INFO:tasks.workunit.client.0.smithi049.stdout:0/718: write d3/df/d59/d8c/fd4 [725177,120983] 0 2024-02-22T00:34:00.389 INFO:tasks.workunit.client.0.smithi049.stdout:0/719: mkdir d3/df/d17/d50/d62/dda 0 2024-02-22T00:34:00.392 INFO:tasks.workunit.client.0.smithi049.stdout:0/720: fdatasync d3/df/d48/d91/fbf 0 2024-02-22T00:34:00.393 INFO:tasks.workunit.client.0.smithi049.stdout:3/593: dwrite d0/dd/d26/d2e/f84 [0,4194304] 0 2024-02-22T00:34:00.396 INFO:tasks.workunit.client.0.smithi049.stdout:3/594: mknod d0/d59/cb1 0 2024-02-22T00:34:00.398 INFO:tasks.workunit.client.0.smithi049.stdout:0/721: mkdir d3/d6/ddb 0 2024-02-22T00:34:00.421 INFO:tasks.workunit.client.0.smithi049.stdout:0/722: mknod d3/df/d59/cdc 0 2024-02-22T00:34:00.423 INFO:tasks.workunit.client.0.smithi049.stdout:1/752: sync 2024-02-22T00:34:00.423 INFO:tasks.workunit.client.0.smithi049.stdout:9/788: sync 2024-02-22T00:34:00.424 INFO:tasks.workunit.client.0.smithi049.stdout:1/753: dread - d2/d8/db/d25/d40/d41/f83 zero size 2024-02-22T00:34:00.430 INFO:tasks.workunit.client.0.smithi049.stdout:1/754: dread d2/d8/db/f12 [8388608,4194304] 0 2024-02-22T00:34:00.431 INFO:tasks.workunit.client.0.smithi049.stdout:3/595: rename d0/f16 to d0/dd/d1e/fb2 0 2024-02-22T00:34:00.434 INFO:tasks.workunit.client.0.smithi049.stdout:9/789: rename d17/d21/d4e/c54 to d17/dcb/c105 0 2024-02-22T00:34:00.436 INFO:tasks.workunit.client.0.smithi049.stdout:9/790: readlink d17/d1c/d25/l97 0 2024-02-22T00:34:00.436 INFO:tasks.workunit.client.0.smithi049.stdout:1/755: dread d2/d8/db/d25/d40/d41/d5b/fd9 [0,4194304] 0 2024-02-22T00:34:00.440 INFO:tasks.workunit.client.0.smithi049.stdout:9/791: getdents d17/d21/d3c/dbf/de0 0 2024-02-22T00:34:00.441 INFO:tasks.workunit.client.0.smithi049.stdout:3/596: dwrite d0/dd/d26/d63/f9c [0,4194304] 0 2024-02-22T00:34:00.445 INFO:tasks.workunit.client.0.smithi049.stdout:9/792: stat d17/d21/d47/fae 0 2024-02-22T00:34:00.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/597: rmdir d0/d14/d4d/d4e/d4f/d5b/d66 39 2024-02-22T00:34:00.447 INFO:tasks.workunit.client.0.smithi049.stdout:9/793: dread - d17/d21/d85/fa2 zero size 2024-02-22T00:34:00.448 INFO:tasks.workunit.client.0.smithi049.stdout:1/756: rename d2/d8/db/d25/d40/d41/d68/d78/ff5 to d2/d8/db/d25/d40/ffc 0 2024-02-22T00:34:00.449 INFO:tasks.workunit.client.0.smithi049.stdout:9/794: readlink d17/d21/d3c/l78 0 2024-02-22T00:34:00.451 INFO:tasks.workunit.client.0.smithi049.stdout:1/757: read d2/f35 [3981472,52606] 0 2024-02-22T00:34:00.452 INFO:tasks.workunit.client.0.smithi049.stdout:3/598: rename d0/d14/d4d/d4e/d56/d5a/f86 to d0/d14/dae/fb3 0 2024-02-22T00:34:00.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/758: write d2/d66/f96 [224382,8585] 0 2024-02-22T00:34:00.463 INFO:tasks.workunit.client.0.smithi049.stdout:1/759: read d2/d8/db/f1c [4052030,120173] 0 2024-02-22T00:34:00.464 INFO:tasks.workunit.client.0.smithi049.stdout:8/759: dwrite d1/d2/da5/d15/d30/fa9 [0,4194304] 0 2024-02-22T00:34:00.466 INFO:tasks.workunit.client.0.smithi049.stdout:1/760: chown d2/d8/d4c/fb1 0 1 2024-02-22T00:34:00.482 INFO:tasks.workunit.client.0.smithi049.stdout:3/599: stat d0/c67 0 2024-02-22T00:34:00.482 INFO:tasks.workunit.client.0.smithi049.stdout:1/761: rename d2/d8/db/d25/d40/d41/fbc to d2/d69/dc4/ffd 0 2024-02-22T00:34:00.487 INFO:tasks.workunit.client.0.smithi049.stdout:8/760: mkdir d1/d2/da5/d15/d30/d36/dcd/d10c 0 2024-02-22T00:34:00.494 INFO:tasks.workunit.client.0.smithi049.stdout:3/600: mknod d0/d14/d4d/d4e/d4f/d5b/d76/cb4 0 2024-02-22T00:34:00.494 INFO:tasks.workunit.client.0.smithi049.stdout:9/795: link d17/d21/d47/c82 d17/d1c/d25/dba/dff/d101/c106 0 2024-02-22T00:34:00.496 INFO:tasks.workunit.client.0.smithi049.stdout:3/601: creat d0/d59/d87/fb5 x:0 0 0 2024-02-22T00:34:00.498 INFO:tasks.workunit.client.0.smithi049.stdout:8/761: rename d1/f9b to d1/dd1/f10d 0 2024-02-22T00:34:00.499 INFO:tasks.workunit.client.0.smithi049.stdout:9/796: creat d17/d21/f107 x:0 0 0 2024-02-22T00:34:00.501 INFO:tasks.workunit.client.0.smithi049.stdout:7/819: rmdir d1/df/d62/d1c/d1d/d70 39 2024-02-22T00:34:00.502 INFO:tasks.workunit.client.0.smithi049.stdout:9/797: rmdir d17/d21/d4e/d89 39 2024-02-22T00:34:00.503 INFO:tasks.workunit.client.0.smithi049.stdout:3/602: getdents d0/dd/d26/d63 0 2024-02-22T00:34:00.503 INFO:tasks.workunit.client.0.smithi049.stdout:9/798: chown d17/d21/d4e/d4b/dc8 326552 1 2024-02-22T00:34:00.503 INFO:tasks.workunit.client.0.smithi049.stdout:7/820: truncate d1/d41/dae/f118 843090 0 2024-02-22T00:34:00.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/799: creat d17/d1c/f108 x:0 0 0 2024-02-22T00:34:00.507 INFO:tasks.workunit.client.0.smithi049.stdout:7/821: mknod d1/df/d62/d60/d7e/c129 0 2024-02-22T00:34:00.509 INFO:tasks.workunit.client.0.smithi049.stdout:9/800: fdatasync d17/d1c/f63 0 2024-02-22T00:34:00.509 INFO:tasks.workunit.client.0.smithi049.stdout:7/822: chown d1/df/d62/d1c/f113 465 1 2024-02-22T00:34:00.510 INFO:tasks.workunit.client.0.smithi049.stdout:3/603: dwrite d0/dd/d1e/f6c [0,4194304] 0 2024-02-22T00:34:00.515 INFO:tasks.workunit.client.0.smithi049.stdout:3/604: symlink d0/d14/dae/lb6 0 2024-02-22T00:34:00.516 INFO:tasks.workunit.client.0.smithi049.stdout:7/823: rmdir d1/d49 39 2024-02-22T00:34:00.517 INFO:tasks.workunit.client.0.smithi049.stdout:3/605: chown d0/f58 1421445 1 2024-02-22T00:34:00.522 INFO:tasks.workunit.client.0.smithi049.stdout:9/801: link d17/d21/d4e/d89/ccc d17/d1c/d25/d39/c109 0 2024-02-22T00:34:00.527 INFO:tasks.workunit.client.0.smithi049.stdout:9/802: unlink d17/d21/d3c/dbf/lcd 0 2024-02-22T00:34:00.531 INFO:tasks.workunit.client.0.smithi049.stdout:9/803: unlink d17/d1c/d38/cf8 0 2024-02-22T00:34:00.535 INFO:tasks.workunit.client.0.smithi049.stdout:8/762: readlink d1/lc5 0 2024-02-22T00:34:00.537 INFO:tasks.workunit.client.0.smithi049.stdout:8/763: fdatasync d1/d2/d5/fa8 0 2024-02-22T00:34:00.542 INFO:tasks.workunit.client.0.smithi049.stdout:9/804: write d17/d1c/d38/f52 [855211,63150] 0 2024-02-22T00:34:00.549 INFO:tasks.workunit.client.0.smithi049.stdout:9/805: creat d17/d21/d3c/f10a x:0 0 0 2024-02-22T00:34:00.549 INFO:tasks.workunit.client.0.smithi049.stdout:8/764: dwrite d1/d2/da5/deb/f47 [0,4194304] 0 2024-02-22T00:34:00.551 INFO:tasks.workunit.client.0.smithi049.stdout:3/606: dwrite d0/dd/f48 [0,4194304] 0 2024-02-22T00:34:00.559 INFO:tasks.workunit.client.0.smithi049.stdout:3/607: creat d0/dd/d26/d63/fb7 x:0 0 0 2024-02-22T00:34:00.561 INFO:tasks.workunit.client.0.smithi049.stdout:8/765: creat d1/d2/d5/d1b/f10e x:0 0 0 2024-02-22T00:34:00.562 INFO:tasks.workunit.client.0.smithi049.stdout:3/608: fsync d0/dd/f46 0 2024-02-22T00:34:00.563 INFO:tasks.workunit.client.0.smithi049.stdout:9/806: dwrite d17/d21/d4e/d4b/f5a [0,4194304] 0 2024-02-22T00:34:00.564 INFO:tasks.workunit.client.0.smithi049.stdout:8/766: write d1/d2/dd7/fe7 [494065,27621] 0 2024-02-22T00:34:00.571 INFO:tasks.workunit.client.0.smithi049.stdout:9/807: creat d17/d1c/f10b x:0 0 0 2024-02-22T00:34:00.591 INFO:tasks.workunit.client.0.smithi049.stdout:9/808: dread d17/d1c/d25/d71/f7d [0,4194304] 0 2024-02-22T00:34:00.593 INFO:tasks.workunit.client.0.smithi049.stdout:3/609: getdents d0/d59/d87 0 2024-02-22T00:34:00.596 INFO:tasks.workunit.client.0.smithi049.stdout:9/809: fsync f14 0 2024-02-22T00:34:00.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/767: truncate d1/d2/f38 446479 0 2024-02-22T00:34:00.600 INFO:tasks.workunit.client.0.smithi049.stdout:9/810: creat d17/d21/d4e/f10c x:0 0 0 2024-02-22T00:34:00.602 INFO:tasks.workunit.client.0.smithi049.stdout:9/811: fdatasync d17/d21/d85/d8d/f92 0 2024-02-22T00:34:00.602 INFO:tasks.workunit.client.0.smithi049.stdout:3/610: write d0/f68 [147420,4472] 0 2024-02-22T00:34:00.603 INFO:tasks.workunit.client.0.smithi049.stdout:9/812: fsync d17/d21/fa4 0 2024-02-22T00:34:00.605 INFO:tasks.workunit.client.0.smithi049.stdout:8/768: unlink d1/d2/da5/l95 0 2024-02-22T00:34:00.610 INFO:tasks.workunit.client.0.smithi049.stdout:9/813: dread d17/d21/d47/d7a/f98 [0,4194304] 0 2024-02-22T00:34:00.621 INFO:tasks.workunit.client.0.smithi049.stdout:9/814: rmdir d17/d21/d3c/dbf/de0 39 2024-02-22T00:34:00.625 INFO:tasks.workunit.client.0.smithi049.stdout:9/815: creat d17/d21/d3c/f10d x:0 0 0 2024-02-22T00:34:00.627 INFO:tasks.workunit.client.0.smithi049.stdout:8/769: mkdir d1/d2/da5/d15/d10f 0 2024-02-22T00:34:00.629 INFO:tasks.workunit.client.0.smithi049.stdout:9/816: readlink d17/d21/d47/d5d/ld3 0 2024-02-22T00:34:00.631 INFO:tasks.workunit.client.0.smithi049.stdout:3/611: dwrite d0/d14/f69 [0,4194304] 0 2024-02-22T00:34:00.631 INFO:tasks.workunit.client.0.smithi049.stdout:0/723: write d3/df/fc5 [913023,4795] 0 2024-02-22T00:34:00.640 INFO:tasks.workunit.client.0.smithi049.stdout:3/612: rename d0/d14/dae to d0/d14/db8 0 2024-02-22T00:34:00.642 INFO:tasks.workunit.client.0.smithi049.stdout:1/762: fsync d2/d8/db/d25/d40/d71/fa9 0 2024-02-22T00:34:00.642 INFO:tasks.workunit.client.0.smithi049.stdout:9/817: dwrite d17/fd5 [0,4194304] 0 2024-02-22T00:34:00.644 INFO:tasks.workunit.client.0.smithi049.stdout:9/818: fdatasync d17/f6c 0 2024-02-22T00:34:00.645 INFO:tasks.workunit.client.0.smithi049.stdout:3/613: creat d0/d14/d4d/d4e/d4f/d5b/d76/fb9 x:0 0 0 2024-02-22T00:34:00.646 INFO:tasks.workunit.client.0.smithi049.stdout:0/724: mknod d3/d1e/d58/cdd 0 2024-02-22T00:34:00.646 INFO:tasks.workunit.client.0.smithi049.stdout:1/763: chown d2/d8/db/d25/d40/d41/f59 941560 1 2024-02-22T00:34:00.647 INFO:tasks.workunit.client.0.smithi049.stdout:0/725: chown d3/df/d17/d50/d62 171 1 2024-02-22T00:34:00.650 INFO:tasks.workunit.client.0.smithi049.stdout:9/819: rename d17/d21/f33 to d17/d21/d4e/d89/d94/f10e 0 2024-02-22T00:34:00.651 INFO:tasks.workunit.client.0.smithi049.stdout:1/764: read d2/d8/db/d25/d40/d41/d68/d78/fc5 [6632268,41008] 0 2024-02-22T00:34:00.653 INFO:tasks.workunit.client.0.smithi049.stdout:9/820: mknod d17/d21/d85/c10f 0 2024-02-22T00:34:00.658 INFO:tasks.workunit.client.0.smithi049.stdout:3/614: dwrite d0/dd/fa3 [0,4194304] 0 2024-02-22T00:34:00.660 INFO:tasks.workunit.client.0.smithi049.stdout:9/821: creat d17/d21/d47/f110 x:0 0 0 2024-02-22T00:34:00.661 INFO:tasks.workunit.client.0.smithi049.stdout:0/726: dread d3/d6/d8/f8b [0,4194304] 0 2024-02-22T00:34:00.663 INFO:tasks.workunit.client.0.smithi049.stdout:3/615: symlink d0/d14/lba 0 2024-02-22T00:34:00.663 INFO:tasks.workunit.client.0.smithi049.stdout:0/727: stat d3/df/d48/lad 0 2024-02-22T00:34:00.665 INFO:tasks.workunit.client.0.smithi049.stdout:1/765: creat d2/d8/db/d25/d62/dcc/ffe x:0 0 0 2024-02-22T00:34:00.666 INFO:tasks.workunit.client.0.smithi049.stdout:1/766: dread - d2/d8/d4c/f97 zero size 2024-02-22T00:34:00.666 INFO:tasks.workunit.client.0.smithi049.stdout:9/822: write f10 [84476,8328] 0 2024-02-22T00:34:00.667 INFO:tasks.workunit.client.0.smithi049.stdout:8/770: truncate d1/d2/da5/d15/f23 21466 0 2024-02-22T00:34:00.670 INFO:tasks.workunit.client.0.smithi049.stdout:9/823: creat d17/d21/d47/d7a/f111 x:0 0 0 2024-02-22T00:34:00.671 INFO:tasks.workunit.client.0.smithi049.stdout:9/824: stat d17/l4c 0 2024-02-22T00:34:00.674 INFO:tasks.workunit.client.0.smithi049.stdout:0/728: readlink d3/d92/lb7 0 2024-02-22T00:34:00.675 INFO:tasks.workunit.client.0.smithi049.stdout:9/825: write d17/d21/d4e/d89/d94/df0/ffb [693372,88661] 0 2024-02-22T00:34:00.677 INFO:tasks.workunit.client.0.smithi049.stdout:8/771: write d1/d4c/f4f [931574,28543] 0 2024-02-22T00:34:00.678 INFO:tasks.workunit.client.0.smithi049.stdout:3/616: dwrite d0/d14/d4d/d4e/d4f/d5b/d66/f90 [0,4194304] 0 2024-02-22T00:34:00.684 INFO:tasks.workunit.client.0.smithi049.stdout:8/772: mknod d1/d2/db7/d100/c110 0 2024-02-22T00:34:00.695 INFO:tasks.workunit.client.0.smithi049.stdout:9/826: dwrite d17/d21/f93 [0,4194304] 0 2024-02-22T00:34:00.700 INFO:tasks.workunit.client.0.smithi049.stdout:9/827: creat d17/d1c/d25/d71/d73/f112 x:0 0 0 2024-02-22T00:34:00.702 INFO:tasks.workunit.client.0.smithi049.stdout:0/729: write d3/df/d59/d8c/fd9 [165081,48482] 0 2024-02-22T00:34:00.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/617: dread d0/dd/f4c [0,4194304] 0 2024-02-22T00:34:00.711 INFO:tasks.workunit.client.0.smithi049.stdout:8/773: dwrite d1/d2/da5/f104 [0,4194304] 0 2024-02-22T00:34:00.713 INFO:tasks.workunit.client.0.smithi049.stdout:3/618: fdatasync d0/dd/f46 0 2024-02-22T00:34:00.716 INFO:tasks.workunit.client.0.smithi049.stdout:9/828: write d17/d21/d47/f5e [846333,3535] 0 2024-02-22T00:34:00.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/767: dread d2/d8/db/d25/f2c [0,4194304] 0 2024-02-22T00:34:00.720 INFO:tasks.workunit.client.0.smithi049.stdout:8/774: link d1/d4c/fec d1/d2/d5/d1b/df1/f111 0 2024-02-22T00:34:00.722 INFO:tasks.workunit.client.0.smithi049.stdout:4/788: sync 2024-02-22T00:34:00.722 INFO:tasks.workunit.client.0.smithi049.stdout:6/777: sync 2024-02-22T00:34:00.723 INFO:tasks.workunit.client.0.smithi049.stdout:5/676: sync 2024-02-22T00:34:00.726 INFO:tasks.workunit.client.0.smithi049.stdout:9/829: getdents d17/d1c/d8c/db0/d103 0 2024-02-22T00:34:00.727 INFO:tasks.workunit.client.0.smithi049.stdout:3/619: dwrite d0/d14/d4d/d4e/d56/d5a/f92 [0,4194304] 0 2024-02-22T00:34:00.731 INFO:tasks.workunit.client.0.smithi049.stdout:6/778: stat d3/d36/d57/ldc 0 2024-02-22T00:34:00.731 INFO:tasks.workunit.client.0.smithi049.stdout:9/830: truncate d17/d1c/d25/dba/ffd 4933861 0 2024-02-22T00:34:00.732 INFO:tasks.workunit.client.0.smithi049.stdout:0/730: truncate d3/d6/d8/f1a 3037217 0 2024-02-22T00:34:00.735 INFO:tasks.workunit.client.0.smithi049.stdout:1/768: rename d2/d8/db/d25/d62/c56 to d2/d8/db/d25/d40/d4d/cff 0 2024-02-22T00:34:00.736 INFO:tasks.workunit.client.0.smithi049.stdout:0/731: write d3/d6/fd5 [241929,47973] 0 2024-02-22T00:34:00.736 INFO:tasks.workunit.client.0.smithi049.stdout:6/779: mkdir d3/d36/d70/df8/d109 0 2024-02-22T00:34:00.738 INFO:tasks.workunit.client.0.smithi049.stdout:8/775: mknod d1/d2/da5/d15/d65/d6a/de5/c112 0 2024-02-22T00:34:00.740 INFO:tasks.workunit.client.0.smithi049.stdout:0/732: chown d3/df/d17/d50/c9c 54646 1 2024-02-22T00:34:00.742 INFO:tasks.workunit.client.0.smithi049.stdout:9/831: dread d17/d21/d4e/d89/d94/df0/ffb [0,4194304] 0 2024-02-22T00:34:00.742 INFO:tasks.workunit.client.0.smithi049.stdout:4/789: link d3/d22/l63 d3/d8/d10/d12/d3f/l10c 0 2024-02-22T00:34:00.743 INFO:tasks.workunit.client.0.smithi049.stdout:8/776: chown d1/d4c/dda/le4 3301 1 2024-02-22T00:34:00.743 INFO:tasks.workunit.client.0.smithi049.stdout:6/780: mkdir d3/d16/d32/d7b/d10a 0 2024-02-22T00:34:00.746 INFO:tasks.workunit.client.0.smithi049.stdout:9/832: stat d17/d1c/d25/d71/d73/f112 0 2024-02-22T00:34:00.747 INFO:tasks.workunit.client.0.smithi049.stdout:3/620: dread d0/dd/f3 [0,4194304] 0 2024-02-22T00:34:00.747 INFO:tasks.workunit.client.0.smithi049.stdout:8/777: write d1/d2/d5/f103 [857494,91701] 0 2024-02-22T00:34:00.748 INFO:tasks.workunit.client.0.smithi049.stdout:4/790: creat d3/d8/d10/d43/d4d/f10d x:0 0 0 2024-02-22T00:34:00.750 INFO:tasks.workunit.client.0.smithi049.stdout:0/733: rename d3/df/d17/c57 to d3/df/d7f/cde 0 2024-02-22T00:34:00.752 INFO:tasks.workunit.client.0.smithi049.stdout:3/621: chown d0/dd/d26/d2e/f54 252 1 2024-02-22T00:34:00.754 INFO:tasks.workunit.client.0.smithi049.stdout:5/677: dread d0/d20/d50/f36 [0,4194304] 0 2024-02-22T00:34:00.761 INFO:tasks.workunit.client.0.smithi049.stdout:0/734: unlink d3/df/d17/l99 0 2024-02-22T00:34:00.763 INFO:tasks.workunit.client.0.smithi049.stdout:3/622: write d0/d14/db8/fb3 [311317,54294] 0 2024-02-22T00:34:00.763 INFO:tasks.workunit.client.0.smithi049.stdout:1/769: dread d2/d8/db/d25/f48 [0,4194304] 0 2024-02-22T00:34:00.764 INFO:tasks.workunit.client.0.smithi049.stdout:8/778: creat d1/d2/da5/d15/f113 x:0 0 0 2024-02-22T00:34:00.764 INFO:tasks.workunit.client.0.smithi049.stdout:4/791: rename d3/d22/d49/cbf to d3/d8/d10/d43/d4d/db9/d8a/d48/c10e 0 2024-02-22T00:34:00.766 INFO:tasks.workunit.client.0.smithi049.stdout:5/678: mknod d0/d20/d84/da0/db6/dc3/d6f/d94/ce2 0 2024-02-22T00:34:00.767 INFO:tasks.workunit.client.0.smithi049.stdout:6/781: dwrite d3/d36/d70/dcc/d4d/d8b/fa7 [0,4194304] 0 2024-02-22T00:34:00.769 INFO:tasks.workunit.client.0.smithi049.stdout:0/735: mkdir d3/d1e/ddf 0 2024-02-22T00:34:00.772 INFO:tasks.workunit.client.0.smithi049.stdout:3/623: write d0/d14/d4d/d4e/fa9 [1007070,87039] 0 2024-02-22T00:34:00.779 INFO:tasks.workunit.client.0.smithi049.stdout:9/833: dwrite d17/d21/f29 [4194304,4194304] 0 2024-02-22T00:34:00.779 INFO:tasks.workunit.client.0.smithi049.stdout:4/792: rmdir d3/d8/d10/d43/d4d/db9/d92 39 2024-02-22T00:34:00.782 INFO:tasks.workunit.client.0.smithi049.stdout:1/770: mkdir d2/d8/db/d25/d40/d41/d100 0 2024-02-22T00:34:00.783 INFO:tasks.workunit.client.0.smithi049.stdout:6/782: unlink d3/d64/d60/da0/fa3 0 2024-02-22T00:34:00.783 INFO:tasks.workunit.client.0.smithi049.stdout:1/771: chown d2/d8/l29 52287 1 2024-02-22T00:34:00.784 INFO:tasks.workunit.client.0.smithi049.stdout:6/783: write d3/d36/d57/d75/fb6 [894598,28847] 0 2024-02-22T00:34:00.786 INFO:tasks.workunit.client.0.smithi049.stdout:0/736: mkdir d3/d6/d8/de0 0 2024-02-22T00:34:00.788 INFO:tasks.workunit.client.0.smithi049.stdout:4/793: creat d3/d22/d3d/f10f x:0 0 0 2024-02-22T00:34:00.789 INFO:tasks.workunit.client.0.smithi049.stdout:8/779: fsync d1/dd1/f10d 0 2024-02-22T00:34:00.789 INFO:tasks.workunit.client.0.smithi049.stdout:9/834: dread d17/d1c/f81 [0,4194304] 0 2024-02-22T00:34:00.791 INFO:tasks.workunit.client.0.smithi049.stdout:1/772: readlink d2/d8/db/d25/d40/d41/d5b/d75/lb4 0 2024-02-22T00:34:00.794 INFO:tasks.workunit.client.0.smithi049.stdout:1/773: readlink d2/d69/l7d 0 2024-02-22T00:34:00.795 INFO:tasks.workunit.client.0.smithi049.stdout:9/835: mkdir d17/d113 0 2024-02-22T00:34:00.795 INFO:tasks.workunit.client.0.smithi049.stdout:5/679: dread d0/d20/dad/f5c [0,4194304] 0 2024-02-22T00:34:00.796 INFO:tasks.workunit.client.0.smithi049.stdout:3/624: dwrite d0/dd/d1e/f24 [0,4194304] 0 2024-02-22T00:34:00.798 INFO:tasks.workunit.client.0.smithi049.stdout:4/794: creat d3/d22/d5c/d35/f110 x:0 0 0 2024-02-22T00:34:00.798 INFO:tasks.workunit.client.0.smithi049.stdout:6/784: truncate d3/d37/fa5 3914618 0 2024-02-22T00:34:00.801 INFO:tasks.workunit.client.0.smithi049.stdout:9/836: unlink d17/d1c/d25/l97 0 2024-02-22T00:34:00.805 INFO:tasks.workunit.client.0.smithi049.stdout:5/680: mknod d0/d20/d84/da0/db6/dc3/d70/db1/d9e/ce3 0 2024-02-22T00:34:00.805 INFO:tasks.workunit.client.0.smithi049.stdout:4/795: fdatasync d3/d8/d10/d39/f37 0 2024-02-22T00:34:00.808 INFO:tasks.workunit.client.0.smithi049.stdout:5/681: unlink d0/c3 0 2024-02-22T00:34:00.811 INFO:tasks.workunit.client.0.smithi049.stdout:6/785: rename d3/d64/d60/dd4 to d3/d10b 0 2024-02-22T00:34:00.815 INFO:tasks.workunit.client.0.smithi049.stdout:6/786: chown d3/d36/d70/dcc/faf 2 1 2024-02-22T00:34:00.817 INFO:tasks.workunit.client.0.smithi049.stdout:3/625: dwrite d0/dd/f6a [0,4194304] 0 2024-02-22T00:34:00.817 INFO:tasks.workunit.client.0.smithi049.stdout:0/737: write d3/df/d17/f2f [3061698,79740] 0 2024-02-22T00:34:00.827 INFO:tasks.workunit.client.0.smithi049.stdout:1/774: symlink d2/d8/l101 0 2024-02-22T00:34:00.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/682: creat d0/d20/d84/da0/db6/dc3/d64/fe4 x:0 0 0 2024-02-22T00:34:00.829 INFO:tasks.workunit.client.0.smithi049.stdout:3/626: fsync d0/d14/f8e 0 2024-02-22T00:34:00.829 INFO:tasks.workunit.client.0.smithi049.stdout:6/787: chown d3/d16/d45/fc6 7204182 1 2024-02-22T00:34:00.831 INFO:tasks.workunit.client.0.smithi049.stdout:4/796: dwrite d3/d8/d10/f5d [0,4194304] 0 2024-02-22T00:34:00.843 INFO:tasks.workunit.client.0.smithi049.stdout:0/738: creat d3/df/d48/d91/fe1 x:0 0 0 2024-02-22T00:34:00.845 INFO:tasks.workunit.client.0.smithi049.stdout:6/788: creat d3/d16/f10c x:0 0 0 2024-02-22T00:34:00.847 INFO:tasks.workunit.client.0.smithi049.stdout:3/627: symlink d0/dd/lbb 0 2024-02-22T00:34:00.850 INFO:tasks.workunit.client.0.smithi049.stdout:8/780: dwrite d1/d2/d5/d1b/f99 [0,4194304] 0 2024-02-22T00:34:00.850 INFO:tasks.workunit.client.0.smithi049.stdout:6/789: readlink d3/d16/d3b/d8c/lc7 0 2024-02-22T00:34:00.853 INFO:tasks.workunit.client.0.smithi049.stdout:9/837: dread d17/d1c/d25/d71/da3/fb7 [0,4194304] 0 2024-02-22T00:34:00.854 INFO:tasks.workunit.client.0.smithi049.stdout:4/797: rename d3/d22/d5c/f93 to d3/d8/d10/d43/d4d/db9/de7/f111 0 2024-02-22T00:34:00.857 INFO:tasks.workunit.client.0.smithi049.stdout:3/628: mkdir d0/d14/d4d/d4e/d56/d5a/dbc 0 2024-02-22T00:34:00.858 INFO:tasks.workunit.client.0.smithi049.stdout:9/838: stat d17/d1c/d25/fc9 0 2024-02-22T00:34:00.872 INFO:tasks.workunit.client.0.smithi049.stdout:5/683: truncate d0/d20/d84/da0/db6/dc3/d6f/d94/f12 1401727 0 2024-02-22T00:34:00.873 INFO:tasks.workunit.client.0.smithi049.stdout:1/775: dwrite d2/d8/db/d25/d40/f54 [0,4194304] 0 2024-02-22T00:34:00.874 INFO:tasks.workunit.client.0.smithi049.stdout:0/739: dwrite d3/df/d17/d50/f7e [0,4194304] 0 2024-02-22T00:34:00.875 INFO:tasks.workunit.client.0.smithi049.stdout:4/798: truncate d3/d8/d10/d43/d4d/f82 4407580 0 2024-02-22T00:34:00.890 INFO:tasks.workunit.client.0.smithi049.stdout:3/629: dwrite d0/d14/d4d/d4e/fa9 [0,4194304] 0 2024-02-22T00:34:00.891 INFO:tasks.workunit.client.0.smithi049.stdout:7/824: sync 2024-02-22T00:34:00.891 INFO:tasks.workunit.client.0.smithi049.stdout:2/737: sync 2024-02-22T00:34:00.892 INFO:tasks.workunit.client.0.smithi049.stdout:8/781: dread d1/d2/d5/d1b/f99 [0,4194304] 0 2024-02-22T00:34:00.894 INFO:tasks.workunit.client.0.smithi049.stdout:1/776: mkdir d2/d8/db/d25/d40/d4d/d102 0 2024-02-22T00:34:00.898 INFO:tasks.workunit.client.0.smithi049.stdout:6/790: dwrite d3/d64/d60/dc2/fdf [0,4194304] 0 2024-02-22T00:34:00.898 INFO:tasks.workunit.client.0.smithi049.stdout:9/839: dwrite d17/d1c/f10b [0,4194304] 0 2024-02-22T00:34:00.911 INFO:tasks.workunit.client.0.smithi049.stdout:6/791: dread - d3/d64/d60/dc2/ff3 zero size 2024-02-22T00:34:00.915 INFO:tasks.workunit.client.0.smithi049.stdout:4/799: dwrite d3/d8/d10/d43/d4d/db9/d8a/fcf [4194304,4194304] 0 2024-02-22T00:34:00.916 INFO:tasks.workunit.client.0.smithi049.stdout:3/630: write d0/dd/d26/fa7 [312626,103151] 0 2024-02-22T00:34:00.919 INFO:tasks.workunit.client.0.smithi049.stdout:9/840: mknod d17/d21/d4e/d89/c114 0 2024-02-22T00:34:00.923 INFO:tasks.workunit.client.0.smithi049.stdout:2/738: rename d2/d9/de/d10/f3d to d2/d9/dd/d4d/da7/f10d 0 2024-02-22T00:34:00.923 INFO:tasks.workunit.client.0.smithi049.stdout:8/782: dwrite d1/d2/da5/f19 [0,4194304] 0 2024-02-22T00:34:00.929 INFO:tasks.workunit.client.0.smithi049.stdout:5/684: truncate d0/d20/d84/da0/db6/dc3/d7c/f96 1707558 0 2024-02-22T00:34:00.933 INFO:tasks.workunit.client.0.smithi049.stdout:6/792: symlink d3/d10b/l10d 0 2024-02-22T00:34:00.934 INFO:tasks.workunit.client.0.smithi049.stdout:7/825: creat d1/d49/d5a/d112/d122/f12a x:0 0 0 2024-02-22T00:34:00.935 INFO:tasks.workunit.client.0.smithi049.stdout:4/800: write d3/d8/d10/d12/d3f/fa2 [895743,9488] 0 2024-02-22T00:34:00.936 INFO:tasks.workunit.client.0.smithi049.stdout:0/740: link d3/df/d48/d63/l86 d3/d6/d8/d36/le2 0 2024-02-22T00:34:00.941 INFO:tasks.workunit.client.0.smithi049.stdout:3/631: symlink d0/d14/d4d/lbd 0 2024-02-22T00:34:00.942 INFO:tasks.workunit.client.0.smithi049.stdout:4/801: write d3/d22/d49/d57/fdc [393229,14549] 0 2024-02-22T00:34:00.944 INFO:tasks.workunit.client.0.smithi049.stdout:9/841: truncate d17/f6c 586124 0 2024-02-22T00:34:00.945 INFO:tasks.workunit.client.0.smithi049.stdout:6/793: mkdir d3/d64/d60/dc2/d10e 0 2024-02-22T00:34:00.946 INFO:tasks.workunit.client.0.smithi049.stdout:5/685: creat d0/d20/dad/daf/fe5 x:0 0 0 2024-02-22T00:34:00.949 INFO:tasks.workunit.client.0.smithi049.stdout:6/794: fsync d3/d64/d59/f77 0 2024-02-22T00:34:00.950 INFO:tasks.workunit.client.0.smithi049.stdout:2/739: mknod d2/d9/de/d10/c10e 0 2024-02-22T00:34:00.951 INFO:tasks.workunit.client.0.smithi049.stdout:3/632: creat d0/d14/d4d/d4e/d4f/d5b/d76/fbe x:0 0 0 2024-02-22T00:34:00.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/686: stat d0/d20/d84/da0/db6/dc3/d6f/f41 0 2024-02-22T00:34:00.956 INFO:tasks.workunit.client.0.smithi049.stdout:7/826: dread - d1/df/d62/d60/d7e/f115 zero size 2024-02-22T00:34:00.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/827: fdatasync d1/df/d62/d60/fba 0 2024-02-22T00:34:00.959 INFO:tasks.workunit.client.0.smithi049.stdout:1/777: creat d2/d8/da/f103 x:0 0 0 2024-02-22T00:34:00.963 INFO:tasks.workunit.client.0.smithi049.stdout:1/778: dread - d2/d8/db/d25/dda/fe6 zero size 2024-02-22T00:34:00.971 INFO:tasks.workunit.client.0.smithi049.stdout:2/740: stat d2/d9/de/d10/d2e/f9e 0 2024-02-22T00:34:00.976 INFO:tasks.workunit.client.0.smithi049.stdout:6/795: mknod d3/d64/d59/d72/d92/d6c/c10f 0 2024-02-22T00:34:00.979 INFO:tasks.workunit.client.0.smithi049.stdout:0/741: dread d3/df/d48/d6f/d90/f31 [0,4194304] 0 2024-02-22T00:34:00.980 INFO:tasks.workunit.client.0.smithi049.stdout:7/828: dwrite d1/df/d62/d60/ff5 [0,4194304] 0 2024-02-22T00:34:00.986 INFO:tasks.workunit.client.0.smithi049.stdout:7/829: readlink d1/d49/d5a/lfe 0 2024-02-22T00:34:00.990 INFO:tasks.workunit.client.0.smithi049.stdout:2/741: creat d2/dda/d7f/f10f x:0 0 0 2024-02-22T00:34:00.990 INFO:tasks.workunit.client.0.smithi049.stdout:1/779: write d2/d8/db/d25/d62/fb5 [4710120,38496] 0 2024-02-22T00:34:00.994 INFO:tasks.workunit.client.0.smithi049.stdout:2/742: chown d2/d9/de/d3a/f44 9481 1 2024-02-22T00:34:00.996 INFO:tasks.workunit.client.0.smithi049.stdout:4/802: dread d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/ffd [0,4194304] 0 2024-02-22T00:34:00.998 INFO:tasks.workunit.client.0.smithi049.stdout:9/842: dwrite d17/d1c/d25/d39/fb1 [0,4194304] 0 2024-02-22T00:34:01.002 INFO:tasks.workunit.client.0.smithi049.stdout:0/742: rename d3/df/d17/d50/d62/dda to d3/df/d48/d6f/d90/de3 0 2024-02-22T00:34:01.003 INFO:tasks.workunit.client.0.smithi049.stdout:5/687: link d0/d26/l2e d0/d20/d84/da0/db6/dc3/d6f/d94/le6 0 2024-02-22T00:34:01.006 INFO:tasks.workunit.client.0.smithi049.stdout:2/743: stat d2/d9/de/d10/d2e/d42/cc7 0 2024-02-22T00:34:01.008 INFO:tasks.workunit.client.0.smithi049.stdout:5/688: dread - d0/d20/d84/da0/db6/dc3/fb9 zero size 2024-02-22T00:34:01.008 INFO:tasks.workunit.client.0.smithi049.stdout:1/780: chown d2/d69/la5 328155 1 2024-02-22T00:34:01.009 INFO:tasks.workunit.client.0.smithi049.stdout:8/783: dwrite d1/d2/da5/d15/d30/d36/d52/daf/ff4 [4194304,4194304] 0 2024-02-22T00:34:01.015 INFO:tasks.workunit.client.0.smithi049.stdout:7/830: dread d1/d41/d28/fa7 [0,4194304] 0 2024-02-22T00:34:01.015 INFO:tasks.workunit.client.0.smithi049.stdout:9/843: creat d17/d1c/d25/d71/f115 x:0 0 0 2024-02-22T00:34:01.015 INFO:tasks.workunit.client.0.smithi049.stdout:6/796: creat d3/d64/d60/f110 x:0 0 0 2024-02-22T00:34:01.021 INFO:tasks.workunit.client.0.smithi049.stdout:1/781: readlink d2/d8/db/l43 0 2024-02-22T00:34:01.022 INFO:tasks.workunit.client.0.smithi049.stdout:3/633: dwrite d0/dd/f46 [0,4194304] 0 2024-02-22T00:34:01.022 INFO:tasks.workunit.client.0.smithi049.stdout:8/784: stat d1/d2/da5/d15/l49 0 2024-02-22T00:34:01.028 INFO:tasks.workunit.client.0.smithi049.stdout:4/803: creat d3/d22/d5c/f112 x:0 0 0 2024-02-22T00:34:01.029 INFO:tasks.workunit.client.0.smithi049.stdout:1/782: write d2/d8/db/d25/d40/d41/f83 [828652,24671] 0 2024-02-22T00:34:01.030 INFO:tasks.workunit.client.0.smithi049.stdout:7/831: creat d1/df/d62/d48/f12b x:0 0 0 2024-02-22T00:34:01.033 INFO:tasks.workunit.client.0.smithi049.stdout:0/743: dwrite d3/d92/fa4 [0,4194304] 0 2024-02-22T00:34:01.036 INFO:tasks.workunit.client.0.smithi049.stdout:3/634: write d0/dd/f9 [3408741,83821] 0 2024-02-22T00:34:01.037 INFO:tasks.workunit.client.0.smithi049.stdout:4/804: write d3/d22/d49/d57/fd5 [126002,57935] 0 2024-02-22T00:34:01.041 INFO:tasks.workunit.client.0.smithi049.stdout:3/635: chown d0/dd/d26/d2e/d52/d6e/l82 910541597 1 2024-02-22T00:34:01.041 INFO:tasks.workunit.client.0.smithi049.stdout:9/844: mknod d17/d1c/d25/d71/da3/c116 0 2024-02-22T00:34:01.043 INFO:tasks.workunit.client.0.smithi049.stdout:6/797: truncate d3/d16/d45/f99 232510 0 2024-02-22T00:34:01.047 INFO:tasks.workunit.client.0.smithi049.stdout:1/783: mkdir d2/d8/db/d25/d40/d41/d5b/d75/dd0/d104 0 2024-02-22T00:34:01.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/636: fsync d0/dd/f48 0 2024-02-22T00:34:01.047 INFO:tasks.workunit.client.0.smithi049.stdout:4/805: mknod d3/d22/d3d/c113 0 2024-02-22T00:34:01.047 INFO:tasks.workunit.client.0.smithi049.stdout:8/785: getdents d1/d2/da5/d15 0 2024-02-22T00:34:01.051 INFO:tasks.workunit.client.0.smithi049.stdout:9/845: creat d17/d1c/d25/d71/d73/f117 x:0 0 0 2024-02-22T00:34:01.051 INFO:tasks.workunit.client.0.smithi049.stdout:3/637: fdatasync d0/dd/d26/d63/f9c 0 2024-02-22T00:34:01.052 INFO:tasks.workunit.client.0.smithi049.stdout:6/798: symlink d3/d64/d60/l111 0 2024-02-22T00:34:01.055 INFO:tasks.workunit.client.0.smithi049.stdout:9/846: write d17/d21/ff6 [835152,95743] 0 2024-02-22T00:34:01.055 INFO:tasks.workunit.client.0.smithi049.stdout:7/832: link d1/d41/d28/d71/d72/fe5 d1/df/d62/d60/d7e/de6/de8/f12c 0 2024-02-22T00:34:01.055 INFO:tasks.workunit.client.0.smithi049.stdout:3/638: readlink d0/lab 0 2024-02-22T00:34:01.058 INFO:tasks.workunit.client.0.smithi049.stdout:2/744: dread d2/dda/d5d/fe3 [0,4194304] 0 2024-02-22T00:34:01.061 INFO:tasks.workunit.client.0.smithi049.stdout:5/689: dwrite d0/f63 [0,4194304] 0 2024-02-22T00:34:01.068 INFO:tasks.workunit.client.0.smithi049.stdout:6/799: stat d3/d36/d70/dcc/d4d/d8b/fe8 0 2024-02-22T00:34:01.068 INFO:tasks.workunit.client.0.smithi049.stdout:1/784: creat d2/d8/db/d25/d40/d71/f105 x:0 0 0 2024-02-22T00:34:01.068 INFO:tasks.workunit.client.0.smithi049.stdout:9/847: fsync d17/d1c/f3b 0 2024-02-22T00:34:01.070 INFO:tasks.workunit.client.0.smithi049.stdout:4/806: dwrite d3/d22/d49/d57/fd3 [0,4194304] 0 2024-02-22T00:34:01.078 INFO:tasks.workunit.client.0.smithi049.stdout:3/639: read d0/dd/d1e/f7f [3156456,45488] 0 2024-02-22T00:34:01.081 INFO:tasks.workunit.client.0.smithi049.stdout:7/833: dread d1/df/d62/d57/f9d [0,4194304] 0 2024-02-22T00:34:01.085 INFO:tasks.workunit.client.0.smithi049.stdout:1/785: write d2/d69/fd7 [767596,113007] 0 2024-02-22T00:34:01.091 INFO:tasks.workunit.client.0.smithi049.stdout:8/786: dwrite d1/d2/d5/d1b/d39/d60/fab [0,4194304] 0 2024-02-22T00:34:01.092 INFO:tasks.workunit.client.0.smithi049.stdout:3/640: readlink d0/dd/l8 0 2024-02-22T00:34:01.092 INFO:tasks.workunit.client.0.smithi049.stdout:5/690: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/fe7 x:0 0 0 2024-02-22T00:34:01.095 INFO:tasks.workunit.client.0.smithi049.stdout:2/745: dwrite d2/d9/dd/d4d/f89 [0,4194304] 0 2024-02-22T00:34:01.096 INFO:tasks.workunit.client.0.smithi049.stdout:9/848: creat d17/d21/d4e/f118 x:0 0 0 2024-02-22T00:34:01.097 INFO:tasks.workunit.client.0.smithi049.stdout:0/744: dread d3/fa9 [4194304,4194304] 0 2024-02-22T00:34:01.100 INFO:tasks.workunit.client.0.smithi049.stdout:9/849: fsync d17/d21/d47/ff5 0 2024-02-22T00:34:01.101 INFO:tasks.workunit.client.0.smithi049.stdout:9/850: chown d17/d21/d85 1 1 2024-02-22T00:34:01.103 INFO:tasks.workunit.client.0.smithi049.stdout:3/641: dread - d0/d14/d4d/d4e/d56/f98 zero size 2024-02-22T00:34:01.107 INFO:tasks.workunit.client.0.smithi049.stdout:4/807: creat d3/d22/d5c/d9a/dd9/de5/f114 x:0 0 0 2024-02-22T00:34:01.108 INFO:tasks.workunit.client.0.smithi049.stdout:5/691: read d0/d20/d50/fa1 [2473789,114927] 0 2024-02-22T00:34:01.110 INFO:tasks.workunit.client.0.smithi049.stdout:9/851: symlink d17/d1c/d8c/db0/l119 0 2024-02-22T00:34:01.112 INFO:tasks.workunit.client.0.smithi049.stdout:4/808: stat d3/d8/d10/d39/l70 0 2024-02-22T00:34:01.113 INFO:tasks.workunit.client.0.smithi049.stdout:3/642: mkdir d0/d14/d4d/d4e/d56/d5a/dbf 0 2024-02-22T00:34:01.115 INFO:tasks.workunit.client.0.smithi049.stdout:8/787: symlink d1/d2/da5/d15/d10f/l114 0 2024-02-22T00:34:01.115 INFO:tasks.workunit.client.0.smithi049.stdout:5/692: symlink d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/le8 0 2024-02-22T00:34:01.116 INFO:tasks.workunit.client.0.smithi049.stdout:0/745: fdatasync d3/f13 0 2024-02-22T00:34:01.117 INFO:tasks.workunit.client.0.smithi049.stdout:2/746: dread d2/d9/dd/d4d/d5a/fbf [0,4194304] 0 2024-02-22T00:34:01.118 INFO:tasks.workunit.client.0.smithi049.stdout:4/809: mknod d3/d8/d10/d43/d4d/db9/d8a/d48/d60/c115 0 2024-02-22T00:34:01.121 INFO:tasks.workunit.client.0.smithi049.stdout:5/693: read d0/f32 [1173643,73579] 0 2024-02-22T00:34:01.122 INFO:tasks.workunit.client.0.smithi049.stdout:2/747: write d2/ff0 [20079,54505] 0 2024-02-22T00:34:01.122 INFO:tasks.workunit.client.0.smithi049.stdout:4/810: mknod d3/d22/df0/c116 0 2024-02-22T00:34:01.123 INFO:tasks.workunit.client.0.smithi049.stdout:5/694: readlink d0/d26/l47 0 2024-02-22T00:34:01.125 INFO:tasks.workunit.client.0.smithi049.stdout:9/852: dread d17/fd5 [0,4194304] 0 2024-02-22T00:34:01.130 INFO:tasks.workunit.client.0.smithi049.stdout:2/748: mknod d2/d9/de/d15/d1b/dc4/df7/c110 0 2024-02-22T00:34:01.132 INFO:tasks.workunit.client.0.smithi049.stdout:9/853: mkdir d17/d21/d85/d8d/d11a 0 2024-02-22T00:34:01.133 INFO:tasks.workunit.client.0.smithi049.stdout:0/746: dwrite d3/d6/fd5 [0,4194304] 0 2024-02-22T00:34:01.135 INFO:tasks.workunit.client.0.smithi049.stdout:4/811: dwrite d3/d8/f102 [0,4194304] 0 2024-02-22T00:34:01.135 INFO:tasks.workunit.client.0.smithi049.stdout:2/749: readlink d2/d9/de/d10/d2e/d42/d80/l8d 0 2024-02-22T00:34:01.137 INFO:tasks.workunit.client.0.smithi049.stdout:0/747: chown d3/d6/d29/l3e 19412 1 2024-02-22T00:34:01.139 INFO:tasks.workunit.client.0.smithi049.stdout:9/854: write d17/d21/d85/fa2 [922085,88884] 0 2024-02-22T00:34:01.141 INFO:tasks.workunit.client.0.smithi049.stdout:7/834: read d1/df/d62/f59 [2987582,16693] 0 2024-02-22T00:34:01.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/855: chown d17/cf7 449364 1 2024-02-22T00:34:01.143 INFO:tasks.workunit.client.0.smithi049.stdout:3/643: dread d0/f68 [0,4194304] 0 2024-02-22T00:34:01.145 INFO:tasks.workunit.client.0.smithi049.stdout:4/812: creat d3/d8/d10/d43/d4d/db9/d8a/d48/f117 x:0 0 0 2024-02-22T00:34:01.145 INFO:tasks.workunit.client.0.smithi049.stdout:6/800: write d3/d36/d70/dcc/f55 [42446,102452] 0 2024-02-22T00:34:01.148 INFO:tasks.workunit.client.0.smithi049.stdout:0/748: mknod d3/df/d48/d6f/d90/dcc/ce4 0 2024-02-22T00:34:01.148 INFO:tasks.workunit.client.0.smithi049.stdout:4/813: readlink d3/d8/l4f 0 2024-02-22T00:34:01.149 INFO:tasks.workunit.client.0.smithi049.stdout:3/644: dread d0/dd/d26/d2e/f44 [0,4194304] 0 2024-02-22T00:34:01.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/801: mkdir d3/d64/d59/d72/d92/d112 0 2024-02-22T00:34:01.158 INFO:tasks.workunit.client.0.smithi049.stdout:3/645: chown d0/dd/d26/fa7 878 1 2024-02-22T00:34:01.163 INFO:tasks.workunit.client.0.smithi049.stdout:8/788: truncate d1/d2/d5/d1b/f99 3843378 0 2024-02-22T00:34:01.168 INFO:tasks.workunit.client.0.smithi049.stdout:0/749: getdents d3/df/d48/d63 0 2024-02-22T00:34:01.168 INFO:tasks.workunit.client.0.smithi049.stdout:1/786: dwrite d2/f35 [4194304,4194304] 0 2024-02-22T00:34:01.168 INFO:tasks.workunit.client.0.smithi049.stdout:7/835: dwrite d1/df/d62/d48/f8b [0,4194304] 0 2024-02-22T00:34:01.168 INFO:tasks.workunit.client.0.smithi049.stdout:2/750: dread d2/d9/de/d10/ffb [0,4194304] 0 2024-02-22T00:34:01.170 INFO:tasks.workunit.client.0.smithi049.stdout:6/802: creat d3/d64/d60/da0/f113 x:0 0 0 2024-02-22T00:34:01.176 INFO:tasks.workunit.client.0.smithi049.stdout:8/789: creat d1/d2/da5/d15/d10f/f115 x:0 0 0 2024-02-22T00:34:01.176 INFO:tasks.workunit.client.0.smithi049.stdout:3/646: creat d0/dd/fc0 x:0 0 0 2024-02-22T00:34:01.176 INFO:tasks.workunit.client.0.smithi049.stdout:0/750: mkdir d3/df/d48/d63/de5 0 2024-02-22T00:34:01.179 INFO:tasks.workunit.client.0.smithi049.stdout:4/814: dread d3/d22/d5c/f36 [0,4194304] 0 2024-02-22T00:34:01.181 INFO:tasks.workunit.client.0.smithi049.stdout:1/787: truncate d2/d8/db/fbd 4850039 0 2024-02-22T00:34:01.182 INFO:tasks.workunit.client.0.smithi049.stdout:9/856: dwrite d17/d1c/d25/d71/d73/fd6 [0,4194304] 0 2024-02-22T00:34:01.183 INFO:tasks.workunit.client.0.smithi049.stdout:6/803: symlink d3/d36/d70/dcc/d4d/d8b/df7/dfd/l114 0 2024-02-22T00:34:01.190 INFO:tasks.workunit.client.0.smithi049.stdout:0/751: mkdir d3/d6/d8/d36/de6 0 2024-02-22T00:34:01.190 INFO:tasks.workunit.client.0.smithi049.stdout:2/751: creat d2/dda/d63/f111 x:0 0 0 2024-02-22T00:34:01.190 INFO:tasks.workunit.client.0.smithi049.stdout:9/857: mknod d17/d21/d3c/de3/c11b 0 2024-02-22T00:34:01.191 INFO:tasks.workunit.client.0.smithi049.stdout:2/752: chown d2/d9/de/d10/d2e/d42/d80/dcc/c53 1768681 1 2024-02-22T00:34:01.192 INFO:tasks.workunit.client.0.smithi049.stdout:8/790: mknod d1/d2/da5/d15/d30/d4b/c116 0 2024-02-22T00:34:01.193 INFO:tasks.workunit.client.0.smithi049.stdout:3/647: mkdir d0/d14/d4d/d4e/d56/dc1 0 2024-02-22T00:34:01.196 INFO:tasks.workunit.client.0.smithi049.stdout:0/752: symlink d3/df/d48/le7 0 2024-02-22T00:34:01.197 INFO:tasks.workunit.client.0.smithi049.stdout:1/788: dread d2/d8/db/d25/d62/fdb [0,4194304] 0 2024-02-22T00:34:01.204 INFO:tasks.workunit.client.0.smithi049.stdout:3/648: write d0/d14/d4d/d4e/d56/d5a/f92 [2605581,25047] 0 2024-02-22T00:34:01.205 INFO:tasks.workunit.client.0.smithi049.stdout:1/789: truncate d2/d8/da/d8a/fe1 98326 0 2024-02-22T00:34:01.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/753: dwrite d2/dda/d7f/fcd [0,4194304] 0 2024-02-22T00:34:01.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/649: chown d0/d14/d4d 179563 1 2024-02-22T00:34:01.210 INFO:tasks.workunit.client.0.smithi049.stdout:3/650: chown d0/dd/d26/d2e/d52/l53 474168 1 2024-02-22T00:34:01.215 INFO:tasks.workunit.client.0.smithi049.stdout:6/804: truncate d3/d64/d60/dc2/fda 867723 0 2024-02-22T00:34:01.220 INFO:tasks.workunit.client.0.smithi049.stdout:9/858: truncate d17/d21/d4e/f8e 2648427 0 2024-02-22T00:34:01.220 INFO:tasks.workunit.client.0.smithi049.stdout:0/753: dwrite d3/df/d48/d6f/d7a/f82 [0,4194304] 0 2024-02-22T00:34:01.220 INFO:tasks.workunit.client.0.smithi049.stdout:3/651: rename d0/dd/d26/d2e/d52 to d0/dd/d26/d2e/d52/d6e/dc2 22 2024-02-22T00:34:01.220 INFO:tasks.workunit.client.0.smithi049.stdout:2/754: truncate d2/d9/dd/d4d/d72/da0/dba/f10a 890370 0 2024-02-22T00:34:01.220 INFO:tasks.workunit.client.0.smithi049.stdout:1/790: creat d2/d8/db/d25/d62/dcc/dea/f106 x:0 0 0 2024-02-22T00:34:01.224 INFO:tasks.workunit.client.0.smithi049.stdout:4/815: dread d3/d8/d10/d12/f38 [4194304,4194304] 0 2024-02-22T00:34:01.225 INFO:tasks.workunit.client.0.smithi049.stdout:6/805: mkdir d3/d36/d70/dcc/d4d/d8b/df7/dfd/d115 0 2024-02-22T00:34:01.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/859: mknod d17/d21/d47/d5d/c11c 0 2024-02-22T00:34:01.228 INFO:tasks.workunit.client.0.smithi049.stdout:6/806: chown d3/d64/d60/dc2 36 1 2024-02-22T00:34:01.235 INFO:tasks.workunit.client.0.smithi049.stdout:6/807: symlink d3/d16/d3b/l116 0 2024-02-22T00:34:01.236 INFO:tasks.workunit.client.0.smithi049.stdout:8/791: dwrite d1/d2/da5/d15/f23 [0,4194304] 0 2024-02-22T00:34:01.236 INFO:tasks.workunit.client.0.smithi049.stdout:3/652: write d0/dd/d1e/fb2 [4427182,107579] 0 2024-02-22T00:34:01.240 INFO:tasks.workunit.client.0.smithi049.stdout:6/808: stat d3/d16/d3b/l116 0 2024-02-22T00:34:01.242 INFO:tasks.workunit.client.0.smithi049.stdout:9/860: getdents d17/d1c/d8c/db0/de9 0 2024-02-22T00:34:01.243 INFO:tasks.workunit.client.0.smithi049.stdout:2/755: dwrite d2/d9/dd/dbb/f105 [0,4194304] 0 2024-02-22T00:34:01.245 INFO:tasks.workunit.client.0.smithi049.stdout:8/792: chown d1/d2/d5/d1b/d39/d81/df3/c2a 285792 1 2024-02-22T00:34:01.248 INFO:tasks.workunit.client.0.smithi049.stdout:6/809: unlink d3/d16/d3b/d8c/lc7 0 2024-02-22T00:34:01.249 INFO:tasks.workunit.client.0.smithi049.stdout:9/861: mkdir d17/d21/d3c/de3/d11d 0 2024-02-22T00:34:01.250 INFO:tasks.workunit.client.0.smithi049.stdout:2/756: rmdir d2/d9/de/d10/d2e/d42/d80/dcc 39 2024-02-22T00:34:01.250 INFO:tasks.workunit.client.0.smithi049.stdout:4/816: dwrite d3/d22/d49/d57/fe0 [0,4194304] 0 2024-02-22T00:34:01.255 INFO:tasks.workunit.client.0.smithi049.stdout:8/793: fdatasync d1/d2/da5/d15/d30/d36/d52/daf/ff4 0 2024-02-22T00:34:01.256 INFO:tasks.workunit.client.0.smithi049.stdout:3/653: dwrite d0/f58 [0,4194304] 0 2024-02-22T00:34:01.256 INFO:tasks.workunit.client.0.smithi049.stdout:4/817: symlink d3/d8/d10/d12/l118 0 2024-02-22T00:34:01.259 INFO:tasks.workunit.client.0.smithi049.stdout:6/810: creat d3/d36/d70/dcc/d4d/d8b/f117 x:0 0 0 2024-02-22T00:34:01.259 INFO:tasks.workunit.client.0.smithi049.stdout:8/794: readlink d1/d2/da5/d15/d30/d4b/lad 0 2024-02-22T00:34:01.259 INFO:tasks.workunit.client.0.smithi049.stdout:2/757: truncate d2/d9/de/d10/f31 955202 0 2024-02-22T00:34:01.261 INFO:tasks.workunit.client.0.smithi049.stdout:3/654: symlink d0/dd/d26/d2e/d52/lc3 0 2024-02-22T00:34:01.262 INFO:tasks.workunit.client.0.smithi049.stdout:9/862: getdents d17/d1c 0 2024-02-22T00:34:01.267 INFO:tasks.workunit.client.0.smithi049.stdout:9/863: read d17/d21/d47/ff5 [1443988,52544] 0 2024-02-22T00:34:01.271 INFO:tasks.workunit.client.0.smithi049.stdout:2/758: dread d2/d9/dd/d4d/f89 [0,4194304] 0 2024-02-22T00:34:01.272 INFO:tasks.workunit.client.0.smithi049.stdout:9/864: creat d17/d1c/d25/dba/f11e x:0 0 0 2024-02-22T00:34:01.276 INFO:tasks.workunit.client.0.smithi049.stdout:2/759: rmdir d2/dda/d5d 39 2024-02-22T00:34:01.276 INFO:tasks.workunit.client.0.smithi049.stdout:3/655: dwrite d0/d14/d4d/d4e/d4f/d5b/d66/f70 [0,4194304] 0 2024-02-22T00:34:01.281 INFO:tasks.workunit.client.0.smithi049.stdout:4/818: dwrite d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/ffd [0,4194304] 0 2024-02-22T00:34:01.284 INFO:tasks.workunit.client.0.smithi049.stdout:6/811: dread d3/d36/d70/dcc/d4d/fbb [0,4194304] 0 2024-02-22T00:34:01.285 INFO:tasks.workunit.client.0.smithi049.stdout:2/760: creat d2/f112 x:0 0 0 2024-02-22T00:34:01.286 INFO:tasks.workunit.client.0.smithi049.stdout:4/819: mknod d3/d33/c119 0 2024-02-22T00:34:01.289 INFO:tasks.workunit.client.0.smithi049.stdout:4/820: chown d3/d22/l74 0 1 2024-02-22T00:34:01.293 INFO:tasks.workunit.client.0.smithi049.stdout:9/865: truncate d17/d21/d47/f5e 356378 0 2024-02-22T00:34:01.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:59.765959+0000 mgr.smithi161.sazlam (mgr.24369) 62 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 47 MiB/s rd, 177 MiB/s wr, 423 op/s 2024-02-22T00:34:01.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:33:59.999092+0000 mon.smithi049 (mon.0) 702 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:34:01.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/812: link d3/d16/d3b/l48 d3/d16/d3b/l118 0 2024-02-22T00:34:01.296 INFO:tasks.workunit.client.0.smithi049.stdout:0/754: mkdir d3/de8 0 2024-02-22T00:34:01.298 INFO:tasks.workunit.client.0.smithi049.stdout:1/791: rename d2/d8/db/d25/d40/d41/d5b/d87/fb3 to d2/d8/d4c/d5e/f107 0 2024-02-22T00:34:01.299 INFO:tasks.workunit.client.0.smithi049.stdout:2/761: getdents d2/d9/de/d10/d2e/d42/d80 0 2024-02-22T00:34:01.300 INFO:tasks.workunit.client.0.smithi049.stdout:8/795: readlink d1/d2/da5/d15/d65/lb9 0 2024-02-22T00:34:01.300 INFO:tasks.workunit.client.0.smithi049.stdout:6/813: mkdir d3/d16/d45/d119 0 2024-02-22T00:34:01.300 INFO:tasks.workunit.client.0.smithi049.stdout:4/821: link d3/d8/d72/c7c d3/d8/d10/d43/d4d/db9/de7/c11a 0 2024-02-22T00:34:01.307 INFO:tasks.workunit.client.0.smithi049.stdout:0/755: mkdir d3/df/d59/d60/de9 0 2024-02-22T00:34:01.317 INFO:tasks.workunit.client.0.smithi049.stdout:4/822: creat d3/d8/d10/d45/f11b x:0 0 0 2024-02-22T00:34:01.318 INFO:tasks.workunit.client.0.smithi049.stdout:9/866: dwrite d17/d1c/d25/dba/def/ff2 [0,4194304] 0 2024-02-22T00:34:01.318 INFO:tasks.workunit.client.0.smithi049.stdout:1/792: read d2/d8/d4c/f8e [88582,127602] 0 2024-02-22T00:34:01.320 INFO:tasks.workunit.client.0.smithi049.stdout:8/796: mknod d1/d2/da5/d15/d65/d6a/de5/c117 0 2024-02-22T00:34:01.325 INFO:tasks.workunit.client.0.smithi049.stdout:3/656: dread d0/dd/d26/f30 [0,4194304] 0 2024-02-22T00:34:01.328 INFO:tasks.workunit.client.0.smithi049.stdout:6/814: rename d3/d64/d59/c87 to d3/d16/d45/c11a 0 2024-02-22T00:34:01.328 INFO:tasks.workunit.client.0.smithi049.stdout:2/762: dwrite d2/dda/d63/f6c [0,4194304] 0 2024-02-22T00:34:01.329 INFO:tasks.workunit.client.0.smithi049.stdout:9/867: mkdir d17/d1c/d25/d39/d11f 0 2024-02-22T00:34:01.330 INFO:tasks.workunit.client.0.smithi049.stdout:3/657: truncate d0/d14/f74 820769 0 2024-02-22T00:34:01.331 INFO:tasks.workunit.client.0.smithi049.stdout:4/823: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/d11c 0 2024-02-22T00:34:01.333 INFO:tasks.workunit.client.0.smithi049.stdout:2/763: write d2/d9/d17/fb1 [1857152,72072] 0 2024-02-22T00:34:01.335 INFO:tasks.workunit.client.0.smithi049.stdout:6/815: symlink d3/d16/d45/dd0/l11b 0 2024-02-22T00:34:01.336 INFO:tasks.workunit.client.0.smithi049.stdout:3/658: stat d0/dd/f3 0 2024-02-22T00:34:01.336 INFO:tasks.workunit.client.0.smithi049.stdout:1/793: dwrite d2/d8/db/d25/d40/f54 [0,4194304] 0 2024-02-22T00:34:01.340 INFO:tasks.workunit.client.0.smithi049.stdout:9/868: creat d17/d1c/d25/dba/def/f120 x:0 0 0 2024-02-22T00:34:01.342 INFO:tasks.workunit.client.0.smithi049.stdout:3/659: mkdir d0/d14/d4d/d4e/d56/d5a/dc4 0 2024-02-22T00:34:01.343 INFO:tasks.workunit.client.0.smithi049.stdout:4/824: unlink d3/d22/d5c/l6d 0 2024-02-22T00:34:01.346 INFO:tasks.workunit.client.0.smithi049.stdout:4/825: symlink d3/d8/d72/l11d 0 2024-02-22T00:34:01.347 INFO:tasks.workunit.client.0.smithi049.stdout:2/764: creat d2/d9/dd/d4d/d5a/f113 x:0 0 0 2024-02-22T00:34:01.349 INFO:tasks.workunit.client.0.smithi049.stdout:8/797: rmdir d1/d2/da5/deb 39 2024-02-22T00:34:01.353 INFO:tasks.workunit.client.0.smithi049.stdout:6/816: dwrite d3/d64/d60/da0/fd6 [0,4194304] 0 2024-02-22T00:34:01.354 INFO:tasks.workunit.client.0.smithi049.stdout:1/794: mknod d2/d69/dce/df0/c108 0 2024-02-22T00:34:01.354 INFO:tasks.workunit.client.0.smithi049.stdout:8/798: readlink d1/d2/da5/d15/l11 0 2024-02-22T00:34:01.356 INFO:tasks.workunit.client.0.smithi049.stdout:9/869: rename d17/d1c/d25/d39/fb1 to d17/d21/d4e/d89/d94/df0/f121 0 2024-02-22T00:34:01.359 INFO:tasks.workunit.client.0.smithi049.stdout:6/817: readlink d3/d36/d57/ldc 0 2024-02-22T00:34:01.361 INFO:tasks.workunit.client.0.smithi049.stdout:1/795: readlink d2/d8/db/d25/d40/d41/d5b/l8d 0 2024-02-22T00:34:01.362 INFO:tasks.workunit.client.0.smithi049.stdout:8/799: fdatasync d1/d2/da5/d15/d30/d36/d52/daf/f105 0 2024-02-22T00:34:01.363 INFO:tasks.workunit.client.0.smithi049.stdout:3/660: dwrite d0/d14/d4d/d4e/f77 [0,4194304] 0 2024-02-22T00:34:01.369 INFO:tasks.workunit.client.0.smithi049.stdout:0/756: getdents d3/df/d17/d50 0 2024-02-22T00:34:01.372 INFO:tasks.workunit.client.0.smithi049.stdout:2/765: dwrite d2/d9/dd/dbb/f107 [0,4194304] 0 2024-02-22T00:34:01.375 INFO:tasks.workunit.client.0.smithi049.stdout:8/800: chown d1/d2/da5/d15/d33/c94 50048 1 2024-02-22T00:34:01.377 INFO:tasks.workunit.client.0.smithi049.stdout:0/757: fsync d3/df/d17/f24 0 2024-02-22T00:34:01.379 INFO:tasks.workunit.client.0.smithi049.stdout:1/796: creat d2/d8/db/d25/d40/d4d/d102/f109 x:0 0 0 2024-02-22T00:34:01.383 INFO:tasks.workunit.client.0.smithi049.stdout:9/870: dread d17/d21/d4e/d89/d94/df0/f121 [0,4194304] 0 2024-02-22T00:34:01.384 INFO:tasks.workunit.client.0.smithi049.stdout:8/801: fdatasync d1/d2/da5/d15/d30/d4b/d51/f6e 0 2024-02-22T00:34:01.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/818: dwrite d3/d16/f3c [0,4194304] 0 2024-02-22T00:34:01.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/797: mknod d2/d7b/c10a 0 2024-02-22T00:34:01.391 INFO:tasks.workunit.client.0.smithi049.stdout:9/871: write d17/d1c/d25/dba/ffd [3735098,78630] 0 2024-02-22T00:34:01.398 INFO:tasks.workunit.client.0.smithi049.stdout:6/819: rename d3/d64/d60/da0/fa8 to d3/d64/d59/d72/d92/d6c/f11c 0 2024-02-22T00:34:01.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/766: dread d2/d9/d17/fb1 [0,4194304] 0 2024-02-22T00:34:01.400 INFO:tasks.workunit.client.0.smithi049.stdout:6/820: read - d3/d36/d70/dcc/d4d/fee zero size 2024-02-22T00:34:01.405 INFO:tasks.workunit.client.0.smithi049.stdout:6/821: stat d3/d36/d70/dcc/d4d/d8b/fe1 0 2024-02-22T00:34:01.406 INFO:tasks.workunit.client.0.smithi049.stdout:3/661: dread d0/f3b [0,4194304] 0 2024-02-22T00:34:01.409 INFO:tasks.workunit.client.0.smithi049.stdout:3/662: chown d0/dd/d26 19975834 1 2024-02-22T00:34:01.410 INFO:tasks.workunit.client.0.smithi049.stdout:2/767: dwrite d2/dda/d7f/f10f [0,4194304] 0 2024-02-22T00:34:01.412 INFO:tasks.workunit.client.0.smithi049.stdout:3/663: chown d0/dd/d26/d2e/l55 248886045 1 2024-02-22T00:34:01.413 INFO:tasks.workunit.client.0.smithi049.stdout:6/822: mkdir d3/d36/d70/dcc/d4d/d8b/df7/d11d 0 2024-02-22T00:34:01.415 INFO:tasks.workunit.client.0.smithi049.stdout:1/798: getdents d2/d8/db/d25/d40/d41/d5b/d75/dd0 0 2024-02-22T00:34:01.415 INFO:tasks.workunit.client.0.smithi049.stdout:2/768: creat d2/d9/dd/d4d/d5a/f114 x:0 0 0 2024-02-22T00:34:01.417 INFO:tasks.workunit.client.0.smithi049.stdout:3/664: mknod d0/d14/d4d/d4e/d4f/d5b/d76/da6/cc5 0 2024-02-22T00:34:01.417 INFO:tasks.workunit.client.0.smithi049.stdout:9/872: dread d17/d21/fa4 [0,4194304] 0 2024-02-22T00:34:01.419 INFO:tasks.workunit.client.0.smithi049.stdout:6/823: getdents d3/d36/d57 0 2024-02-22T00:34:01.419 INFO:tasks.workunit.client.0.smithi049.stdout:9/873: write d17/d21/f93 [2436253,72583] 0 2024-02-22T00:34:01.420 INFO:tasks.workunit.client.0.smithi049.stdout:2/769: mknod d2/d9/de/d3a/d6d/da6/c115 0 2024-02-22T00:34:01.424 INFO:tasks.workunit.client.0.smithi049.stdout:1/799: creat d2/d8/d4c/d5e/f10b x:0 0 0 2024-02-22T00:34:01.424 INFO:tasks.workunit.client.0.smithi049.stdout:6/824: fsync d3/d36/d70/dcc/d4d/d8b/fa7 0 2024-02-22T00:34:01.424 INFO:tasks.workunit.client.0.smithi049.stdout:3/665: creat d0/d14/d4d/d4e/d56/dc1/fc6 x:0 0 0 2024-02-22T00:34:01.425 INFO:tasks.workunit.client.0.smithi049.stdout:2/770: symlink d2/d9/dd/l116 0 2024-02-22T00:34:01.426 INFO:tasks.workunit.client.0.smithi049.stdout:6/825: rmdir d3/dcd 39 2024-02-22T00:34:01.427 INFO:tasks.workunit.client.0.smithi049.stdout:2/771: chown d2/fd4 716657711 1 2024-02-22T00:34:01.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:59.765959+0000 mgr.smithi161.sazlam (mgr.24369) 62 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 1.3 GiB data, 5.5 GiB used, 531 GiB / 536 GiB avail; 47 MiB/s rd, 177 MiB/s wr, 423 op/s 2024-02-22T00:34:01.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:33:59.999092+0000 mon.smithi049 (mon.0) 702 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:34:01.430 INFO:tasks.workunit.client.0.smithi049.stdout:2/772: symlink d2/d9/dd/d4d/l117 0 2024-02-22T00:34:01.431 INFO:tasks.workunit.client.0.smithi049.stdout:6/826: readlink d3/d64/d59/d72/d92/d6c/lf2 0 2024-02-22T00:34:01.433 INFO:tasks.workunit.client.0.smithi049.stdout:1/800: rename d2/c3a to d2/d8/db/d25/d40/d41/d5b/d75/dd0/c10c 0 2024-02-22T00:34:01.436 INFO:tasks.workunit.client.0.smithi049.stdout:9/874: dwrite d17/d21/d3c/f59 [4194304,4194304] 0 2024-02-22T00:34:01.439 INFO:tasks.workunit.client.0.smithi049.stdout:2/773: rename d2/d9/fa to d2/d9/de/d3a/d93/f118 0 2024-02-22T00:34:01.441 INFO:tasks.workunit.client.0.smithi049.stdout:3/666: dread d0/dd/d26/f2b [0,4194304] 0 2024-02-22T00:34:01.446 INFO:tasks.workunit.client.0.smithi049.stdout:9/875: dwrite d17/d1c/d25/f95 [4194304,4194304] 0 2024-02-22T00:34:01.454 INFO:tasks.workunit.client.0.smithi049.stdout:6/827: dwrite d3/d16/f39 [0,4194304] 0 2024-02-22T00:34:01.455 INFO:tasks.workunit.client.0.smithi049.stdout:9/876: chown d17/d21/d4e/d4b/ldf 0 1 2024-02-22T00:34:01.456 INFO:tasks.workunit.client.0.smithi049.stdout:3/667: dwrite d0/d14/d4d/d4e/d56/f98 [0,4194304] 0 2024-02-22T00:34:01.457 INFO:tasks.workunit.client.0.smithi049.stdout:9/877: stat d17/d1c/f81 0 2024-02-22T00:34:01.460 INFO:tasks.workunit.client.0.smithi049.stdout:9/878: write d17/d1c/d25/d71/da3/fb3 [4418841,130788] 0 2024-02-22T00:34:01.465 INFO:tasks.workunit.client.0.smithi049.stdout:6/828: rename d3/d16/d45/dd0/l11b to d3/d64/d60/da0/l11e 0 2024-02-22T00:34:01.469 INFO:tasks.workunit.client.0.smithi049.stdout:9/879: dwrite d17/d1c/d25/dba/f11e [0,4194304] 0 2024-02-22T00:34:01.473 INFO:tasks.workunit.client.0.smithi049.stdout:3/668: rename d0/dd/d26/d2e/d52/f8b to d0/d14/d4d/d4e/d56/d5a/dc4/fc7 0 2024-02-22T00:34:01.475 INFO:tasks.workunit.client.0.smithi049.stdout:6/829: chown d3/d36/d57/c97 244828 1 2024-02-22T00:34:01.476 INFO:tasks.workunit.client.0.smithi049.stdout:9/880: mkdir d17/d21/d85/d8d/d122 0 2024-02-22T00:34:01.478 INFO:tasks.workunit.client.0.smithi049.stdout:3/669: mknod d0/dd/d26/cc8 0 2024-02-22T00:34:01.479 INFO:tasks.workunit.client.0.smithi049.stdout:9/881: symlink d17/d1c/d77/l123 0 2024-02-22T00:34:01.483 INFO:tasks.workunit.client.0.smithi049.stdout:9/882: creat d17/d21/d85/d8d/d11a/f124 x:0 0 0 2024-02-22T00:34:01.486 INFO:tasks.workunit.client.0.smithi049.stdout:3/670: rename d0/dd/d26/d2e/d52/d6e/c9f to d0/d14/d4d/cc9 0 2024-02-22T00:34:01.487 INFO:tasks.workunit.client.0.smithi049.stdout:9/883: creat d17/d1c/d38/f125 x:0 0 0 2024-02-22T00:34:01.490 INFO:tasks.workunit.client.0.smithi049.stdout:9/884: mknod d17/d1c/d25/dba/def/c126 0 2024-02-22T00:34:01.490 INFO:tasks.workunit.client.0.smithi049.stdout:9/885: fdatasync d17/d21/d47/d5d/ffc 0 2024-02-22T00:34:01.491 INFO:tasks.workunit.client.0.smithi049.stdout:9/886: dread - d17/d1c/f108 zero size 2024-02-22T00:34:01.491 INFO:tasks.workunit.client.0.smithi049.stdout:3/671: mknod d0/dd/d6f/cca 0 2024-02-22T00:34:01.495 INFO:tasks.workunit.client.0.smithi049.stdout:3/672: getdents d0/d14/d4d/d4e/d56/d5a 0 2024-02-22T00:34:01.499 INFO:tasks.workunit.client.0.smithi049.stdout:3/673: rename d0/d14/caa to d0/d14/d4d/d4e/d4f/d5b/d76/da6/ccb 0 2024-02-22T00:34:01.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/887: dread d17/d21/f23 [0,4194304] 0 2024-02-22T00:34:01.508 INFO:tasks.workunit.client.0.smithi049.stdout:9/888: fsync d17/d1c/d25/d71/da3/fb7 0 2024-02-22T00:34:01.509 INFO:tasks.workunit.client.0.smithi049.stdout:9/889: write d17/d21/d47/d5d/db4/f102 [660971,124694] 0 2024-02-22T00:34:01.514 INFO:tasks.workunit.client.0.smithi049.stdout:9/890: write f11 [1591666,15698] 0 2024-02-22T00:34:01.517 INFO:tasks.workunit.client.0.smithi049.stdout:9/891: mknod d17/d21/d47/c127 0 2024-02-22T00:34:01.519 INFO:tasks.workunit.client.0.smithi049.stdout:3/674: dread d0/d14/d4d/f36 [0,4194304] 0 2024-02-22T00:34:01.520 INFO:tasks.workunit.client.0.smithi049.stdout:9/892: write d17/d21/d47/d7a/fa5 [485503,123040] 0 2024-02-22T00:34:01.521 INFO:tasks.workunit.client.0.smithi049.stdout:9/893: fdatasync d17/d21/d85/fa2 0 2024-02-22T00:34:01.522 INFO:tasks.workunit.client.0.smithi049.stdout:9/894: write f11 [4701529,31693] 0 2024-02-22T00:34:01.526 INFO:tasks.workunit.client.0.smithi049.stdout:9/895: rename d17/d1c/d25/d71/d73/l9a to d17/d1c/d77/de7/l128 0 2024-02-22T00:34:01.527 INFO:tasks.workunit.client.0.smithi049.stdout:9/896: truncate d17/d1c/d25/d71/d73/f112 156942 0 2024-02-22T00:34:01.528 INFO:tasks.workunit.client.0.smithi049.stdout:3/675: truncate d0/d14/d4d/f36 6394521 0 2024-02-22T00:34:01.531 INFO:tasks.workunit.client.0.smithi049.stdout:3/676: symlink d0/d14/d4d/d4e/d56/d5a/dbc/lcc 0 2024-02-22T00:34:01.532 INFO:tasks.workunit.client.0.smithi049.stdout:9/897: dread d17/d21/d3c/fa6 [0,4194304] 0 2024-02-22T00:34:01.533 INFO:tasks.workunit.client.0.smithi049.stdout:9/898: symlink d17/d1c/d38/l129 0 2024-02-22T00:34:01.534 INFO:tasks.workunit.client.0.smithi049.stdout:9/899: fsync d17/f51 0 2024-02-22T00:34:01.535 INFO:tasks.workunit.client.0.smithi049.stdout:9/900: creat d17/d1c/f12a x:0 0 0 2024-02-22T00:34:01.544 INFO:tasks.workunit.client.0.smithi049.stdout:9/901: read d17/d1c/d25/fc9 [3278766,59709] 0 2024-02-22T00:34:01.562 INFO:tasks.workunit.client.0.smithi049.stdout:9/902: mknod d17/d1c/c12b 0 2024-02-22T00:34:01.568 INFO:tasks.workunit.client.0.smithi049.stdout:9/903: rename d17/d1c/d25/dba/dff/d101/c106 to d17/d1c/c12c 0 2024-02-22T00:34:01.573 INFO:tasks.workunit.client.0.smithi049.stdout:9/904: dread d17/d1c/d38/f74 [0,4194304] 0 2024-02-22T00:34:01.574 INFO:tasks.workunit.client.0.smithi049.stdout:1/801: creat d2/d8/db/f10d x:0 0 0 2024-02-22T00:34:01.576 INFO:tasks.workunit.client.0.smithi049.stdout:9/905: unlink d17/d21/d3c/f4a 0 2024-02-22T00:34:01.578 INFO:tasks.workunit.client.0.smithi049.stdout:9/906: symlink d17/d21/d4e/d89/d94/l12d 0 2024-02-22T00:34:01.580 INFO:tasks.workunit.client.0.smithi049.stdout:9/907: write d17/d1c/d25/d71/d73/f112 [865123,34721] 0 2024-02-22T00:34:01.580 INFO:tasks.workunit.client.0.smithi049.stdout:1/802: link d2/f4 d2/d8/d4c/f10e 0 2024-02-22T00:34:01.582 INFO:tasks.workunit.client.0.smithi049.stdout:9/908: write d17/d21/d47/f110 [298151,89280] 0 2024-02-22T00:34:01.586 INFO:tasks.workunit.client.0.smithi049.stdout:1/803: read d2/d8/db/d25/d40/d41/d68/d78/fc5 [6201217,128375] 0 2024-02-22T00:34:01.590 INFO:tasks.workunit.client.0.smithi049.stdout:1/804: truncate d2/d8/d4c/fa7 255440 0 2024-02-22T00:34:01.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/805: mkdir d2/d8/db/d25/d40/d41/d10f 0 2024-02-22T00:34:01.598 INFO:tasks.workunit.client.0.smithi049.stdout:1/806: dread - d2/d8/db/d25/d40/d41/d5b/f89 zero size 2024-02-22T00:34:01.602 INFO:tasks.workunit.client.0.smithi049.stdout:1/807: creat d2/d8/db/d25/d40/d41/d5b/d75/f110 x:0 0 0 2024-02-22T00:34:01.605 INFO:tasks.workunit.client.0.smithi049.stdout:1/808: symlink d2/d8/d4c/d5e/l111 0 2024-02-22T00:34:01.611 INFO:tasks.workunit.client.0.smithi049.stdout:1/809: symlink d2/d8/d4c/l112 0 2024-02-22T00:34:01.614 INFO:tasks.workunit.client.0.smithi049.stdout:1/810: write d2/f35 [7884195,53980] 0 2024-02-22T00:34:01.618 INFO:tasks.workunit.client.0.smithi049.stdout:1/811: rename d2/d8/l29 to d2/d8/db/d25/d40/d41/d84/dab/l113 0 2024-02-22T00:34:01.620 INFO:tasks.workunit.client.0.smithi049.stdout:1/812: creat d2/d8/db/d25/d62/dcc/dea/f114 x:0 0 0 2024-02-22T00:34:01.623 INFO:tasks.workunit.client.0.smithi049.stdout:1/813: symlink d2/d8/db/l115 0 2024-02-22T00:34:01.626 INFO:tasks.workunit.client.0.smithi049.stdout:1/814: mkdir d2/d8/db/d25/d40/d41/d100/d116 0 2024-02-22T00:34:01.631 INFO:tasks.workunit.client.0.smithi049.stdout:1/815: rename d2/d8/db/d25/d40/d4d/d102/f109 to d2/da0/f117 0 2024-02-22T00:34:01.638 INFO:tasks.workunit.client.0.smithi049.stdout:1/816: dwrite d2/d8/da/d8a/fca [0,4194304] 0 2024-02-22T00:34:01.642 INFO:tasks.workunit.client.0.smithi049.stdout:1/817: dread d2/d8/da/d8a/fca [0,4194304] 0 2024-02-22T00:34:01.722 INFO:tasks.workunit.client.0.smithi049.stdout:5/695: sync 2024-02-22T00:34:01.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/696: unlink d0/d20/d84/da0/db6/dc3/d6f/c19 0 2024-02-22T00:34:01.727 INFO:tasks.workunit.client.0.smithi049.stdout:5/697: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d9c/fe9 x:0 0 0 2024-02-22T00:34:01.731 INFO:tasks.workunit.client.0.smithi049.stdout:5/698: mkdir d0/d20/d84/da0/db6/dc3/dea 0 2024-02-22T00:34:01.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/699: truncate d0/d20/d84/da0/fb0 512050 0 2024-02-22T00:34:01.733 INFO:tasks.workunit.client.0.smithi049.stdout:5/700: read d0/d20/d50/f36 [2362900,101180] 0 2024-02-22T00:34:01.735 INFO:tasks.workunit.client.0.smithi049.stdout:5/701: chown d0/d20/d84/da0/db6/dc3/d64/f93 26676601 1 2024-02-22T00:34:01.736 INFO:tasks.workunit.client.0.smithi049.stdout:5/702: dread - d0/d20/d50/fd0 zero size 2024-02-22T00:34:01.742 INFO:tasks.workunit.client.0.smithi049.stdout:5/703: dwrite d0/fc2 [0,4194304] 0 2024-02-22T00:34:01.744 INFO:tasks.workunit.client.0.smithi049.stdout:5/704: dread - d0/d20/d84/da0/db6/dc3/d70/db1/d9e/fcb zero size 2024-02-22T00:34:01.747 INFO:tasks.workunit.client.0.smithi049.stdout:5/705: read - d0/d20/dad/daf/fe5 zero size 2024-02-22T00:34:01.755 INFO:tasks.workunit.client.0.smithi049.stdout:5/706: creat d0/d20/d84/da0/db6/dc3/d6f/feb x:0 0 0 2024-02-22T00:34:01.758 INFO:tasks.workunit.client.0.smithi049.stdout:5/707: creat d0/d20/d50/d24/fec x:0 0 0 2024-02-22T00:34:01.759 INFO:tasks.workunit.client.0.smithi049.stdout:5/708: chown d0/d20/d50/fa1 33 1 2024-02-22T00:34:01.761 INFO:tasks.workunit.client.0.smithi049.stdout:5/709: mknod d0/d20/d84/da0/db6/ced 0 2024-02-22T00:34:01.769 INFO:tasks.workunit.client.0.smithi049.stdout:5/710: truncate d0/d20/d84/da0/db6/dc3/d6f/d94/f98 2450016 0 2024-02-22T00:34:01.774 INFO:tasks.workunit.client.0.smithi049.stdout:5/711: write d0/d20/d84/da0/db6/dc3/d6f/f5e [906528,110013] 0 2024-02-22T00:34:01.775 INFO:tasks.workunit.client.0.smithi049.stdout:5/712: fsync d0/fb7 0 2024-02-22T00:34:01.781 INFO:tasks.workunit.client.0.smithi049.stdout:5/713: rename d0/d20/d84/da0/db6/dc3/d7c/fb3 to d0/d20/d84/da0/db6/dc3/fee 0 2024-02-22T00:34:01.783 INFO:tasks.workunit.client.0.smithi049.stdout:5/714: creat d0/d20/fef x:0 0 0 2024-02-22T00:34:01.787 INFO:tasks.workunit.client.0.smithi049.stdout:5/715: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/db2/ff0 x:0 0 0 2024-02-22T00:34:01.790 INFO:tasks.workunit.client.0.smithi049.stdout:5/716: creat d0/d20/d84/da0/db6/ff1 x:0 0 0 2024-02-22T00:34:01.791 INFO:tasks.workunit.client.0.smithi049.stdout:5/717: chown d0/d20/d50/d24/f2f 3405612 1 2024-02-22T00:34:01.792 INFO:tasks.workunit.client.0.smithi049.stdout:5/718: dread - d0/d20/d84/da0/db6/f67 zero size 2024-02-22T00:34:01.795 INFO:tasks.workunit.client.0.smithi049.stdout:5/719: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d9c/ff2 x:0 0 0 2024-02-22T00:34:01.795 INFO:tasks.workunit.client.0.smithi049.stdout:5/720: write d0/fb7 [196088,31743] 0 2024-02-22T00:34:01.799 INFO:tasks.workunit.client.0.smithi049.stdout:5/721: creat d0/d20/d84/da0/db6/dc3/d6f/ff3 x:0 0 0 2024-02-22T00:34:01.801 INFO:tasks.workunit.client.0.smithi049.stdout:5/722: dread d0/fb7 [0,4194304] 0 2024-02-22T00:34:01.807 INFO:tasks.workunit.client.0.smithi049.stdout:5/723: dwrite d0/d20/d50/fd0 [0,4194304] 0 2024-02-22T00:34:01.816 INFO:tasks.workunit.client.0.smithi049.stdout:5/724: write d0/f37 [3091385,30418] 0 2024-02-22T00:34:01.822 INFO:tasks.workunit.client.0.smithi049.stdout:5/725: truncate d0/d20/d84/da0/db6/dc3/d6f/d94/f98 3461445 0 2024-02-22T00:34:01.824 INFO:tasks.workunit.client.0.smithi049.stdout:5/726: write d0/f63 [2488895,78110] 0 2024-02-22T00:34:01.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/727: unlink d0/d20/l2a 0 2024-02-22T00:34:01.832 INFO:tasks.workunit.client.0.smithi049.stdout:5/728: rmdir d0/d20/d84/da0/db6/dc3/d6f/da8 39 2024-02-22T00:34:01.838 INFO:tasks.workunit.client.0.smithi049.stdout:5/729: unlink d0/d20/d84/da0/db6/dc3/d6f/f5e 0 2024-02-22T00:34:01.858 INFO:tasks.workunit.client.0.smithi049.stdout:5/730: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/f12 [0,4194304] 0 2024-02-22T00:34:01.917 INFO:tasks.workunit.client.0.smithi049.stdout:7/836: sync 2024-02-22T00:34:01.918 INFO:tasks.workunit.client.0.smithi049.stdout:7/837: chown d1/df/d62/d1c/d24/d2e/df0 5 1 2024-02-22T00:34:01.923 INFO:tasks.workunit.client.0.smithi049.stdout:7/838: truncate d1/f5f 357106 0 2024-02-22T00:34:01.930 INFO:tasks.workunit.client.0.smithi049.stdout:7/839: dwrite d1/df/d62/d60/d7e/f106 [0,4194304] 0 2024-02-22T00:34:01.938 INFO:tasks.workunit.client.0.smithi049.stdout:7/840: dwrite d1/d49/d4d/fd0 [0,4194304] 0 2024-02-22T00:34:01.943 INFO:tasks.workunit.client.0.smithi049.stdout:7/841: creat d1/df/d62/d60/d7e/f12d x:0 0 0 2024-02-22T00:34:01.947 INFO:tasks.workunit.client.0.smithi049.stdout:7/842: rename d1/df/d62/d1c/d24/d2e/f108 to d1/d41/d28/d10c/f12e 0 2024-02-22T00:34:01.951 INFO:tasks.workunit.client.0.smithi049.stdout:7/843: creat d1/df/d62/f12f x:0 0 0 2024-02-22T00:34:01.955 INFO:tasks.workunit.client.0.smithi049.stdout:7/844: mkdir d1/df/d62/d48/d130 0 2024-02-22T00:34:01.957 INFO:tasks.workunit.client.0.smithi049.stdout:7/845: creat d1/d49/d11d/f131 x:0 0 0 2024-02-22T00:34:01.973 INFO:tasks.workunit.client.0.smithi049.stdout:7/846: getdents d1/df/d62/d48 0 2024-02-22T00:34:01.979 INFO:tasks.workunit.client.0.smithi049.stdout:7/847: dwrite d1/df/f45 [0,4194304] 0 2024-02-22T00:34:01.983 INFO:tasks.workunit.client.0.smithi049.stdout:7/848: write d1/d41/d28/f39 [9191261,89819] 0 2024-02-22T00:34:01.985 INFO:tasks.workunit.client.0.smithi049.stdout:7/849: unlink d1/d41/cb5 0 2024-02-22T00:34:02.005 INFO:tasks.workunit.client.0.smithi049.stdout:7/850: dread d1/df/d62/d1c/d24/d2e/f5e [0,4194304] 0 2024-02-22T00:34:02.024 INFO:tasks.workunit.client.0.smithi049.stdout:7/851: write d1/df/d62/d7a/fa1 [590660,3383] 0 2024-02-22T00:34:02.025 INFO:tasks.workunit.client.0.smithi049.stdout:7/852: chown d1/df/d62/d1c/l88 66697405 1 2024-02-22T00:34:02.036 INFO:tasks.workunit.client.0.smithi049.stdout:7/853: dwrite d1/d49/f53 [0,4194304] 0 2024-02-22T00:34:02.039 INFO:tasks.workunit.client.0.smithi049.stdout:7/854: rmdir d1/d49/d5a/d112 39 2024-02-22T00:34:02.040 INFO:tasks.workunit.client.0.smithi049.stdout:7/855: write d1/df/d62/d1c/d24/d2e/fa6 [4832275,118266] 0 2024-02-22T00:34:02.048 INFO:tasks.workunit.client.0.smithi049.stdout:7/856: dwrite d1/df/d62/d60/d7e/de6/ded/f119 [0,4194304] 0 2024-02-22T00:34:02.054 INFO:tasks.workunit.client.0.smithi049.stdout:7/857: chown d1/df/ld5 15 1 2024-02-22T00:34:02.057 INFO:tasks.workunit.client.0.smithi049.stdout:7/858: mkdir d1/d49/d11d/d132 0 2024-02-22T00:34:02.058 INFO:tasks.workunit.client.0.smithi049.stdout:7/859: stat d1/d41/d55/l58 0 2024-02-22T00:34:02.226 INFO:tasks.workunit.client.0.smithi049.stdout:4/826: sync 2024-02-22T00:34:02.226 INFO:tasks.workunit.client.0.smithi049.stdout:8/802: sync 2024-02-22T00:34:02.226 INFO:tasks.workunit.client.0.smithi049.stdout:0/758: sync 2024-02-22T00:34:02.229 INFO:tasks.workunit.client.0.smithi049.stdout:8/803: readlink d1/d2/d5/d1b/d39/d60/da0/lcf 0 2024-02-22T00:34:02.230 INFO:tasks.workunit.client.0.smithi049.stdout:0/759: write d3/d6/d29/f76 [4876834,81568] 0 2024-02-22T00:34:02.230 INFO:tasks.workunit.client.0.smithi049.stdout:4/827: read d3/d8/d10/d43/d4d/db9/d8a/d48/fba [3029818,97999] 0 2024-02-22T00:34:02.234 INFO:tasks.workunit.client.0.smithi049.stdout:4/828: getdents d3/d22/d5c/d5e/d106 0 2024-02-22T00:34:02.239 INFO:tasks.workunit.client.0.smithi049.stdout:4/829: symlink d3/d22/df0/df4/l11e 0 2024-02-22T00:34:02.240 INFO:tasks.workunit.client.0.smithi049.stdout:0/760: dread d3/d1e/f5a [0,4194304] 0 2024-02-22T00:34:02.243 INFO:tasks.workunit.client.0.smithi049.stdout:4/830: rmdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd 39 2024-02-22T00:34:02.248 INFO:tasks.workunit.client.0.smithi049.stdout:0/761: dwrite d3/d1e/f61 [0,4194304] 0 2024-02-22T00:34:02.252 INFO:tasks.workunit.client.0.smithi049.stdout:0/762: write d3/df/d17/d50/d62/f67 [2511750,90836] 0 2024-02-22T00:34:02.253 INFO:tasks.workunit.client.0.smithi049.stdout:4/831: dwrite d3/d8/d10/d12/dd8/f108 [0,4194304] 0 2024-02-22T00:34:02.256 INFO:tasks.workunit.client.0.smithi049.stdout:4/832: rmdir d3/d8/d10/d43/d4d/db9 39 2024-02-22T00:34:02.257 INFO:tasks.workunit.client.0.smithi049.stdout:4/833: chown d3/d22/d3d/c95 40685 1 2024-02-22T00:34:02.259 INFO:tasks.workunit.client.0.smithi049.stdout:0/763: fsync d3/d1e/f6a 0 2024-02-22T00:34:02.259 INFO:tasks.workunit.client.0.smithi049.stdout:4/834: readlink d3/d8/d10/d43/l73 0 2024-02-22T00:34:02.262 INFO:tasks.workunit.client.0.smithi049.stdout:4/835: fsync d3/d22/f101 0 2024-02-22T00:34:02.271 INFO:tasks.workunit.client.0.smithi049.stdout:4/836: truncate d3/d22/f101 891324 0 2024-02-22T00:34:02.275 INFO:tasks.workunit.client.0.smithi049.stdout:4/837: write d3/d8/f14 [1602208,90583] 0 2024-02-22T00:34:02.279 INFO:tasks.workunit.client.0.smithi049.stdout:4/838: creat d3/d8/f11f x:0 0 0 2024-02-22T00:34:02.283 INFO:tasks.workunit.client.0.smithi049.stdout:4/839: getdents d3/d22/d5c/da5 0 2024-02-22T00:34:02.284 INFO:tasks.workunit.client.0.smithi049.stdout:0/764: dread d3/d6/d29/f4b [0,4194304] 0 2024-02-22T00:34:02.286 INFO:tasks.workunit.client.0.smithi049.stdout:4/840: unlink d3/d8/d10/d12/c7b 0 2024-02-22T00:34:02.291 INFO:tasks.workunit.client.0.smithi049.stdout:4/841: truncate d3/d22/f8d 2648326 0 2024-02-22T00:34:02.292 INFO:tasks.workunit.client.0.smithi049.stdout:4/842: mknod d3/d8/d10/d12/c120 0 2024-02-22T00:34:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:4/843: symlink d3/d22/d5c/d35/l121 0 2024-02-22T00:34:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:3/677: sync 2024-02-22T00:34:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:6/830: sync 2024-02-22T00:34:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:5/731: sync 2024-02-22T00:34:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:9/909: sync 2024-02-22T00:34:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:2/774: sync 2024-02-22T00:34:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:7/860: sync 2024-02-22T00:34:02.296 INFO:tasks.workunit.client.0.smithi049.stdout:1/818: sync 2024-02-22T00:34:02.297 INFO:tasks.workunit.client.0.smithi049.stdout:0/765: truncate d3/df/d59/f83 1833089 0 2024-02-22T00:34:02.299 INFO:tasks.workunit.client.0.smithi049.stdout:6/831: mknod d3/c11f 0 2024-02-22T00:34:02.299 INFO:tasks.workunit.client.0.smithi049.stdout:0/766: stat d3/d6/f7b 0 2024-02-22T00:34:02.300 INFO:tasks.workunit.client.0.smithi049.stdout:9/910: rmdir d17/d21/d85/d8d 39 2024-02-22T00:34:02.300 INFO:tasks.workunit.client.0.smithi049.stdout:3/678: fsync d0/dd/d26/d63/fb7 0 2024-02-22T00:34:02.302 INFO:tasks.workunit.client.0.smithi049.stdout:4/844: read d3/d22/d49/d57/fd3 [258868,109681] 0 2024-02-22T00:34:02.303 INFO:tasks.workunit.client.0.smithi049.stdout:2/775: mkdir d2/d9/dd/d4d/d72/d119 0 2024-02-22T00:34:02.304 INFO:tasks.workunit.client.0.smithi049.stdout:6/832: chown d3/d16/d3b/l116 11352355 1 2024-02-22T00:34:02.307 INFO:tasks.workunit.client.0.smithi049.stdout:7/861: mknod d1/df/d62/d1c/d1d/d6e/c133 0 2024-02-22T00:34:02.308 INFO:tasks.workunit.client.0.smithi049.stdout:6/833: write d3/d16/d45/fc6 [2456678,48228] 0 2024-02-22T00:34:02.308 INFO:tasks.workunit.client.0.smithi049.stdout:3/679: creat d0/d14/d4d/d4e/d56/d5a/dbf/fcd x:0 0 0 2024-02-22T00:34:02.311 INFO:tasks.workunit.client.0.smithi049.stdout:4/845: write d3/d8/d10/d12/d3f/fa2 [1398209,30725] 0 2024-02-22T00:34:02.313 INFO:tasks.workunit.client.0.smithi049.stdout:4/846: fsync d3/fdb 0 2024-02-22T00:34:02.315 INFO:tasks.workunit.client.0.smithi049.stdout:6/834: symlink d3/d64/d59/d72/d92/db1/l120 0 2024-02-22T00:34:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:9/911: truncate d17/d1c/d25/dba/ffd 144572 0 2024-02-22T00:34:02.328 INFO:tasks.workunit.client.0.smithi049.stdout:1/819: dread d2/d8/d4c/fe0 [0,4194304] 0 2024-02-22T00:34:02.330 INFO:tasks.workunit.client.0.smithi049.stdout:0/767: dwrite d3/df/d17/f20 [0,4194304] 0 2024-02-22T00:34:02.338 INFO:tasks.workunit.client.0.smithi049.stdout:2/776: link d2/d9/f3c d2/d9/dd/d4d/da7/f11a 0 2024-02-22T00:34:02.339 INFO:tasks.workunit.client.0.smithi049.stdout:9/912: creat d17/d1c/d25/dba/dff/f12e x:0 0 0 2024-02-22T00:34:02.341 INFO:tasks.workunit.client.0.smithi049.stdout:6/835: dread d3/ff [0,4194304] 0 2024-02-22T00:34:02.341 INFO:tasks.workunit.client.0.smithi049.stdout:3/680: getdents d0 0 2024-02-22T00:34:02.341 INFO:tasks.workunit.client.0.smithi049.stdout:4/847: creat d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/df1/f122 x:0 0 0 2024-02-22T00:34:02.343 INFO:tasks.workunit.client.0.smithi049.stdout:9/913: fsync d17/d21/f43 0 2024-02-22T00:34:02.344 INFO:tasks.workunit.client.0.smithi049.stdout:3/681: write d0/dd/d1e/f78 [644085,39739] 0 2024-02-22T00:34:02.345 INFO:tasks.workunit.client.0.smithi049.stdout:4/848: unlink d3/d33/f62 0 2024-02-22T00:34:02.346 INFO:tasks.workunit.client.0.smithi049.stdout:6/836: fsync d3/d36/d70/dcc/ff0 0 2024-02-22T00:34:02.348 INFO:tasks.workunit.client.0.smithi049.stdout:6/837: truncate d3/d64/d59/d72/d92/fe4 683720 0 2024-02-22T00:34:02.350 INFO:tasks.workunit.client.0.smithi049.stdout:3/682: creat d0/fce x:0 0 0 2024-02-22T00:34:02.351 INFO:tasks.workunit.client.0.smithi049.stdout:6/838: truncate d3/d16/d45/dd0/fd9 1007887 0 2024-02-22T00:34:02.352 INFO:tasks.workunit.client.0.smithi049.stdout:4/849: creat d3/d8/d10/d12/f123 x:0 0 0 2024-02-22T00:34:02.354 INFO:tasks.workunit.client.0.smithi049.stdout:4/850: write d3/d22/d49/d57/fd5 [58173,15188] 0 2024-02-22T00:34:02.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/839: creat d3/d64/d60/f121 x:0 0 0 2024-02-22T00:34:02.362 INFO:tasks.workunit.client.0.smithi049.stdout:6/840: mknod d3/d64/d60/dc2/d10e/c122 0 2024-02-22T00:34:02.369 INFO:tasks.workunit.client.0.smithi049.stdout:7/862: creat d1/d49/d5a/f134 x:0 0 0 2024-02-22T00:34:02.370 INFO:tasks.workunit.client.0.smithi049.stdout:1/820: chown d2/d8/da/c95 79 1 2024-02-22T00:34:02.373 INFO:tasks.workunit.client.0.smithi049.stdout:7/863: mknod d1/d49/d11d/c135 0 2024-02-22T00:34:02.373 INFO:tasks.workunit.client.0.smithi049.stdout:4/851: truncate d3/d22/d3d/fbe 484326 0 2024-02-22T00:34:02.373 INFO:tasks.workunit.client.0.smithi049.stdout:3/683: mknod d0/dd/d1e/ccf 0 2024-02-22T00:34:02.376 INFO:tasks.workunit.client.0.smithi049.stdout:1/821: write d2/d8/db/d25/d40/d41/d5b/fd9 [808433,102778] 0 2024-02-22T00:34:02.377 INFO:tasks.workunit.client.0.smithi049.stdout:0/768: rename d3/df/l45 to d3/d6/d8/de0/lea 0 2024-02-22T00:34:02.379 INFO:tasks.workunit.client.0.smithi049.stdout:7/864: creat d1/d41/d28/d10c/f136 x:0 0 0 2024-02-22T00:34:02.383 INFO:tasks.workunit.client.0.smithi049.stdout:2/777: rename d2/d9/de/c58 to d2/d9/de/d15/d1b/dc4/de9/c11b 0 2024-02-22T00:34:02.385 INFO:tasks.workunit.client.0.smithi049.stdout:1/822: creat d2/d69/dc4/f118 x:0 0 0 2024-02-22T00:34:02.387 INFO:tasks.workunit.client.0.smithi049.stdout:7/865: mknod d1/df/d62/d7a/c137 0 2024-02-22T00:34:02.387 INFO:tasks.workunit.client.0.smithi049.stdout:3/684: dwrite d0/dd/d26/d2e/f8d [0,4194304] 0 2024-02-22T00:34:02.389 INFO:tasks.workunit.client.0.smithi049.stdout:6/841: rename d3/d36/d57/d75/ce9 to d3/d64/d59/d72/d92/d6c/c123 0 2024-02-22T00:34:02.397 INFO:tasks.workunit.client.0.smithi049.stdout:2/778: read d2/dda/d5d/fe3 [3476855,68909] 0 2024-02-22T00:34:02.397 INFO:tasks.workunit.client.0.smithi049.stdout:1/823: stat d2/d8/db/d25/d40/d41/f60 0 2024-02-22T00:34:02.397 INFO:tasks.workunit.client.0.smithi049.stdout:6/842: creat d3/dcd/f124 x:0 0 0 2024-02-22T00:34:02.397 INFO:tasks.workunit.client.0.smithi049.stdout:3/685: readlink d0/dd/d26/d2e/d52/l97 0 2024-02-22T00:34:02.398 INFO:tasks.workunit.client.0.smithi049.stdout:6/843: write d3/d64/d59/ff4 [852034,105968] 0 2024-02-22T00:34:02.398 INFO:tasks.workunit.client.0.smithi049.stdout:4/852: dwrite d3/d8/f9e [0,4194304] 0 2024-02-22T00:34:02.399 INFO:tasks.workunit.client.0.smithi049.stdout:0/769: rename d3/d6/d8/d36/d81/fb9 to d3/d92/feb 0 2024-02-22T00:34:02.407 INFO:tasks.workunit.client.0.smithi049.stdout:4/853: write d3/d8/d10/d43/d4d/f5f [872612,75073] 0 2024-02-22T00:34:02.409 INFO:tasks.workunit.client.0.smithi049.stdout:0/770: fsync d3/d6/d29/f3f 0 2024-02-22T00:34:02.409 INFO:tasks.workunit.client.0.smithi049.stdout:6/844: chown d3/d36/d70/dcc/d4d/fee 0 1 2024-02-22T00:34:02.410 INFO:tasks.workunit.client.0.smithi049.stdout:3/686: symlink d0/d14/d4d/d4e/d56/d5a/ld0 0 2024-02-22T00:34:02.413 INFO:tasks.workunit.client.0.smithi049.stdout:4/854: mkdir d3/d8/d10/d43/d4d/db9/de7/d124 0 2024-02-22T00:34:02.413 INFO:tasks.workunit.client.0.smithi049.stdout:2/779: dwrite d2/dda/f67 [0,4194304] 0 2024-02-22T00:34:02.415 INFO:tasks.workunit.client.0.smithi049.stdout:3/687: write d0/f58 [2623411,82148] 0 2024-02-22T00:34:02.416 INFO:tasks.workunit.client.0.smithi049.stdout:2/780: dread - d2/d9/d17/f83 zero size 2024-02-22T00:34:02.418 INFO:tasks.workunit.client.0.smithi049.stdout:4/855: readlink d3/l6 0 2024-02-22T00:34:02.418 INFO:tasks.workunit.client.0.smithi049.stdout:0/771: chown d3/d1e/d58/l80 683 1 2024-02-22T00:34:02.419 INFO:tasks.workunit.client.0.smithi049.stdout:6/845: truncate d3/d64/d59/d72/d92/ffe 1045863 0 2024-02-22T00:34:02.419 INFO:tasks.workunit.client.0.smithi049.stdout:3/688: read d0/dd/d26/d63/f8a [2406127,82155] 0 2024-02-22T00:34:02.422 INFO:tasks.workunit.client.0.smithi049.stdout:3/689: chown d0/dd/d26/d2e/l55 0 1 2024-02-22T00:34:02.422 INFO:tasks.workunit.client.0.smithi049.stdout:3/690: readlink d0/dd/d6f/lac 0 2024-02-22T00:34:02.424 INFO:tasks.workunit.client.0.smithi049.stdout:8/804: sync 2024-02-22T00:34:02.426 INFO:tasks.workunit.client.0.smithi049.stdout:3/691: write d0/d14/f74 [1683476,52460] 0 2024-02-22T00:34:02.428 INFO:tasks.workunit.client.0.smithi049.stdout:0/772: creat d3/df/d48/d63/fec x:0 0 0 2024-02-22T00:34:02.430 INFO:tasks.workunit.client.0.smithi049.stdout:0/773: chown d3/df/d48/d63 0 1 2024-02-22T00:34:02.432 INFO:tasks.workunit.client.0.smithi049.stdout:8/805: dread - d1/dd1/fea zero size 2024-02-22T00:34:02.434 INFO:tasks.workunit.client.0.smithi049.stdout:6/846: dwrite d3/d36/d70/dcc/d4d/f95 [0,4194304] 0 2024-02-22T00:34:02.438 INFO:tasks.workunit.client.0.smithi049.stdout:6/847: mknod d3/d64/d59/d72/d92/c125 0 2024-02-22T00:34:02.438 INFO:tasks.workunit.client.0.smithi049.stdout:3/692: dread d0/dd/d26/d2e/f51 [0,4194304] 0 2024-02-22T00:34:02.439 INFO:tasks.workunit.client.0.smithi049.stdout:3/693: stat d0/d14/l1f 0 2024-02-22T00:34:02.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/774: mknod d3/df/d17/d50/d62/ced 0 2024-02-22T00:34:02.442 INFO:tasks.workunit.client.0.smithi049.stdout:6/848: mknod d3/d64/d59/d72/d92/db1/c126 0 2024-02-22T00:34:02.443 INFO:tasks.workunit.client.0.smithi049.stdout:8/806: truncate d1/d4c/fc4 314889 0 2024-02-22T00:34:02.444 INFO:tasks.workunit.client.0.smithi049.stdout:0/775: chown d3/d6/d8/d36/d81/dc3 56 1 2024-02-22T00:34:02.445 INFO:tasks.workunit.client.0.smithi049.stdout:3/694: rename d0/d14/l23 to d0/d59/ld1 0 2024-02-22T00:34:02.446 INFO:tasks.workunit.client.0.smithi049.stdout:4/856: dread d3/d8/f17 [0,4194304] 0 2024-02-22T00:34:02.446 INFO:tasks.workunit.client.0.smithi049.stdout:6/849: unlink d3/d16/d3b/d8c/fd8 0 2024-02-22T00:34:02.448 INFO:tasks.workunit.client.0.smithi049.stdout:2/781: dread d2/d9/de/d10/d2e/f49 [0,4194304] 0 2024-02-22T00:34:02.450 INFO:tasks.workunit.client.0.smithi049.stdout:6/850: truncate d3/d36/d57/d75/fbf 912209 0 2024-02-22T00:34:02.450 INFO:tasks.workunit.client.0.smithi049.stdout:4/857: fsync d3/d22/d3d/fbe 0 2024-02-22T00:34:02.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/858: fdatasync d3/f4b 0 2024-02-22T00:34:02.452 INFO:tasks.workunit.client.0.smithi049.stdout:6/851: readlink d3/d16/d3b/l54 0 2024-02-22T00:34:02.453 INFO:tasks.workunit.client.0.smithi049.stdout:8/807: creat d1/d2/da5/d15/d30/d36/d52/daf/dde/f118 x:0 0 0 2024-02-22T00:34:02.455 INFO:tasks.workunit.client.0.smithi049.stdout:6/852: read d3/d36/f9d [816930,60468] 0 2024-02-22T00:34:02.456 INFO:tasks.workunit.client.0.smithi049.stdout:3/695: dwrite d0/f62 [0,4194304] 0 2024-02-22T00:34:02.460 INFO:tasks.workunit.client.0.smithi049.stdout:3/696: stat d0/dd/d26/d2e/d52 0 2024-02-22T00:34:02.465 INFO:tasks.workunit.client.0.smithi049.stdout:8/808: creat d1/d2/da5/d15/d30/d4b/f119 x:0 0 0 2024-02-22T00:34:02.466 INFO:tasks.workunit.client.0.smithi049.stdout:3/697: mknod d0/d14/d4d/d4e/d56/d5a/dbc/cd2 0 2024-02-22T00:34:02.466 INFO:tasks.workunit.client.0.smithi049.stdout:6/853: link d3/dcd/lec d3/d36/d70/dcc/d4d/l127 0 2024-02-22T00:34:02.468 INFO:tasks.workunit.client.0.smithi049.stdout:3/698: write d0/f62 [621430,8749] 0 2024-02-22T00:34:02.472 INFO:tasks.workunit.client.0.smithi049.stdout:2/782: dread d2/dda/d5d/fe3 [0,4194304] 0 2024-02-22T00:34:02.473 INFO:tasks.workunit.client.0.smithi049.stdout:6/854: getdents d3/d64/d60/da0 0 2024-02-22T00:34:02.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/809: truncate d1/d2/d5/f34 1182811 0 2024-02-22T00:34:02.475 INFO:tasks.workunit.client.0.smithi049.stdout:6/855: readlink d3/d64/d60/da0/l11e 0 2024-02-22T00:34:02.475 INFO:tasks.workunit.client.0.smithi049.stdout:8/810: chown d1/d2/d5/d56/dd2 26 1 2024-02-22T00:34:02.475 INFO:tasks.workunit.client.0.smithi049.stdout:3/699: rename d0/d14/d4d/d4e/d4f/d5b/d76/da6 to d0/d14/d4d/d4e/d56/dc1/dd3 0 2024-02-22T00:34:02.476 INFO:tasks.workunit.client.0.smithi049.stdout:8/811: fdatasync d1/d2/d5/d1b/f10e 0 2024-02-22T00:34:02.477 INFO:tasks.workunit.client.0.smithi049.stdout:6/856: symlink d3/d64/d60/da0/l128 0 2024-02-22T00:34:02.478 INFO:tasks.workunit.client.0.smithi049.stdout:8/812: stat d1/d4c/dda/le4 0 2024-02-22T00:34:02.480 INFO:tasks.workunit.client.0.smithi049.stdout:2/783: rename d2/d9/de/d10/d59/fac to d2/d9/de/d10/f11c 0 2024-02-22T00:34:02.485 INFO:tasks.workunit.client.0.smithi049.stdout:2/784: creat d2/d9/de/d10/d59/f11d x:0 0 0 2024-02-22T00:34:02.487 INFO:tasks.workunit.client.0.smithi049.stdout:6/857: dwrite d3/fef [0,4194304] 0 2024-02-22T00:34:02.487 INFO:tasks.workunit.client.0.smithi049.stdout:4/859: dread d3/d22/d5c/d9a/fa3 [0,4194304] 0 2024-02-22T00:34:02.489 INFO:tasks.workunit.client.0.smithi049.stdout:4/860: chown d3/d8/d10/d43/d4d/db9/de7 117 1 2024-02-22T00:34:02.501 INFO:tasks.workunit.client.0.smithi049.stdout:7/866: truncate d1/f94 1967334 0 2024-02-22T00:34:02.506 INFO:tasks.workunit.client.0.smithi049.stdout:7/867: dread - d1/f104 zero size 2024-02-22T00:34:02.507 INFO:tasks.workunit.client.0.smithi049.stdout:8/813: dread d1/d2/da5/d15/d30/d4b/d51/f6e [0,4194304] 0 2024-02-22T00:34:02.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/861: dwrite d3/d8/f105 [0,4194304] 0 2024-02-22T00:34:02.511 INFO:tasks.workunit.client.0.smithi049.stdout:2/785: dwrite d2/d9/dd/d4d/f89 [0,4194304] 0 2024-02-22T00:34:02.520 INFO:tasks.workunit.client.0.smithi049.stdout:6/858: dwrite d3/d64/d59/d72/d92/d6c/f11c [4194304,4194304] 0 2024-02-22T00:34:02.525 INFO:tasks.workunit.client.0.smithi049.stdout:1/824: dwrite d2/d8/da/f3f [0,4194304] 0 2024-02-22T00:34:02.528 INFO:tasks.workunit.client.0.smithi049.stdout:1/825: readlink d2/d8/db/d25/d62/lf7 0 2024-02-22T00:34:02.528 INFO:tasks.workunit.client.0.smithi049.stdout:6/859: symlink d3/d16/d32/l129 0 2024-02-22T00:34:02.529 INFO:tasks.workunit.client.0.smithi049.stdout:7/868: mknod d1/d49/d5a/d112/d122/c138 0 2024-02-22T00:34:02.531 INFO:tasks.workunit.client.0.smithi049.stdout:2/786: getdents d2/d9/de/d10/d2e/d42/d80 0 2024-02-22T00:34:02.533 INFO:tasks.workunit.client.0.smithi049.stdout:6/860: chown d3/d64/d59/d72/d92/fe4 286 1 2024-02-22T00:34:02.534 INFO:tasks.workunit.client.0.smithi049.stdout:4/862: dwrite d3/d22/f8d [0,4194304] 0 2024-02-22T00:34:02.538 INFO:tasks.workunit.client.0.smithi049.stdout:2/787: mkdir d2/d9/de/d3a/dc3/d11e 0 2024-02-22T00:34:02.538 INFO:tasks.workunit.client.0.smithi049.stdout:6/861: mknod d3/d10b/c12a 0 2024-02-22T00:34:02.541 INFO:tasks.workunit.client.0.smithi049.stdout:4/863: truncate d3/f2f 649967 0 2024-02-22T00:34:02.544 INFO:tasks.workunit.client.0.smithi049.stdout:8/814: truncate d1/d2/da5/d15/f10 5693847 0 2024-02-22T00:34:02.545 INFO:tasks.workunit.client.0.smithi049.stdout:4/864: write d3/d8/d10/d43/d4d/db9/d8a/d48/fba [4057090,72079] 0 2024-02-22T00:34:02.546 INFO:tasks.workunit.client.0.smithi049.stdout:7/869: symlink d1/d41/d28/d71/d10a/l139 0 2024-02-22T00:34:02.549 INFO:tasks.workunit.client.0.smithi049.stdout:0/776: truncate d3/d6/fd5 1786379 0 2024-02-22T00:34:02.550 INFO:tasks.workunit.client.0.smithi049.stdout:4/865: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/df1/d125 0 2024-02-22T00:34:02.552 INFO:tasks.workunit.client.0.smithi049.stdout:4/866: write d3/d8/d10/dc4/f103 [957698,113024] 0 2024-02-22T00:34:02.554 INFO:tasks.workunit.client.0.smithi049.stdout:4/867: dread - d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/fec zero size 2024-02-22T00:34:02.554 INFO:tasks.workunit.client.0.smithi049.stdout:8/815: unlink d1/d2/db7/d100/fdc 0 2024-02-22T00:34:02.556 INFO:tasks.workunit.client.0.smithi049.stdout:8/816: stat d1/d2/da5/d15/d33/fbc 0 2024-02-22T00:34:02.560 INFO:tasks.workunit.client.0.smithi049.stdout:0/777: rename d3/d1e/d58/cdd to d3/df/d17/d50/d62/cee 0 2024-02-22T00:34:02.560 INFO:tasks.workunit.client.0.smithi049.stdout:4/868: link d3/d8/d10/dc4/fc8 d3/d22/d3d/f126 0 2024-02-22T00:34:02.564 INFO:tasks.workunit.client.0.smithi049.stdout:2/788: write d2/d9/de/d10/d2e/d42/d80/f81 [83282,18254] 0 2024-02-22T00:34:02.567 INFO:tasks.workunit.client.0.smithi049.stdout:7/870: mkdir d1/d49/d5a/d13a 0 2024-02-22T00:34:02.571 INFO:tasks.workunit.client.0.smithi049.stdout:1/826: dread d2/d8/db/d25/d40/d71/f9f [0,4194304] 0 2024-02-22T00:34:02.571 INFO:tasks.workunit.client.0.smithi049.stdout:2/789: fsync d2/d9/de/d10/fef 0 2024-02-22T00:34:02.573 INFO:tasks.workunit.client.0.smithi049.stdout:4/869: link d3/d33/fb8 d3/d8/d10/dc4/f127 0 2024-02-22T00:34:02.574 INFO:tasks.workunit.client.0.smithi049.stdout:2/790: fdatasync d2/dda/fed 0 2024-02-22T00:34:02.575 INFO:tasks.workunit.client.0.smithi049.stdout:6/862: dwrite d3/d64/d59/f66 [0,4194304] 0 2024-02-22T00:34:02.576 INFO:tasks.workunit.client.0.smithi049.stdout:2/791: read - d2/fd4 zero size 2024-02-22T00:34:02.576 INFO:tasks.workunit.client.0.smithi049.stdout:4/870: read - d3/d8/d10/d45/f11b zero size 2024-02-22T00:34:02.577 INFO:tasks.workunit.client.0.smithi049.stdout:6/863: dread - d3/d36/d70/dcc/d4d/d8b/fe1 zero size 2024-02-22T00:34:02.581 INFO:tasks.workunit.client.0.smithi049.stdout:6/864: unlink d3/d36/d57/ldc 0 2024-02-22T00:34:02.582 INFO:tasks.workunit.client.0.smithi049.stdout:4/871: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/d11c/d128 0 2024-02-22T00:34:02.587 INFO:tasks.workunit.client.0.smithi049.stdout:2/792: dwrite d2/d9/de/d10/d59/f11d [0,4194304] 0 2024-02-22T00:34:02.593 INFO:tasks.workunit.client.0.smithi049.stdout:4/872: dread d3/d8/d10/d12/d3f/fa9 [0,4194304] 0 2024-02-22T00:34:02.595 INFO:tasks.workunit.client.0.smithi049.stdout:4/873: chown d3/d22/df0/df4/l11e 70814 1 2024-02-22T00:34:02.600 INFO:tasks.workunit.client.0.smithi049.stdout:7/871: rename d1/d49/d5a/fa3 to d1/d41/f13b 0 2024-02-22T00:34:02.600 INFO:tasks.workunit.client.0.smithi049.stdout:2/793: dwrite d2/d9/de/d10/d2e/f92 [0,4194304] 0 2024-02-22T00:34:02.602 INFO:tasks.workunit.client.0.smithi049.stdout:4/874: write d3/d8/d10/d43/d4d/db9/d8a/f8b [645724,130993] 0 2024-02-22T00:34:02.606 INFO:tasks.workunit.client.0.smithi049.stdout:4/875: write d3/d8/d10/d43/d4d/db9/d8a/fcf [6443505,22376] 0 2024-02-22T00:34:02.608 INFO:tasks.workunit.client.0.smithi049.stdout:7/872: truncate d1/df/d62/d1c/d24/f52 2699627 0 2024-02-22T00:34:02.611 INFO:tasks.workunit.client.0.smithi049.stdout:2/794: dwrite d2/dda/d63/f7e [0,4194304] 0 2024-02-22T00:34:02.613 INFO:tasks.workunit.client.0.smithi049.stdout:2/795: dread - d2/d9/dd/d4d/d5a/f114 zero size 2024-02-22T00:34:02.614 INFO:tasks.workunit.client.0.smithi049.stdout:2/796: dread - d2/dda/d7f/f87 zero size 2024-02-22T00:34:02.616 INFO:tasks.workunit.client.0.smithi049.stdout:2/797: mkdir d2/dda/d5d/d11f 0 2024-02-22T00:34:02.618 INFO:tasks.workunit.client.0.smithi049.stdout:2/798: write d2/d9/dd/d4d/da7/dd2/fe1 [522839,73831] 0 2024-02-22T00:34:02.620 INFO:tasks.workunit.client.0.smithi049.stdout:2/799: dread - d2/f95 zero size 2024-02-22T00:34:02.625 INFO:tasks.workunit.client.0.smithi049.stdout:2/800: mknod d2/d9/de/d10/d2e/d42/d80/d108/c120 0 2024-02-22T00:34:02.626 INFO:tasks.workunit.client.0.smithi049.stdout:4/876: dread d3/d8/d10/dc4/f127 [0,4194304] 0 2024-02-22T00:34:02.628 INFO:tasks.workunit.client.0.smithi049.stdout:2/801: read d2/d9/f6f [3803508,81395] 0 2024-02-22T00:34:02.629 INFO:tasks.workunit.client.0.smithi049.stdout:4/877: read - d3/d22/d3d/f126 zero size 2024-02-22T00:34:02.634 INFO:tasks.workunit.client.0.smithi049.stdout:4/878: getdents d3/d8/d10/d43/d4d/db9/d8a/d48/d89 0 2024-02-22T00:34:02.639 INFO:tasks.workunit.client.0.smithi049.stdout:2/802: dwrite d2/d9/f79 [0,4194304] 0 2024-02-22T00:34:02.640 INFO:tasks.workunit.client.0.smithi049.stdout:2/803: fdatasync d2/d9/de/fc0 0 2024-02-22T00:34:02.641 INFO:tasks.workunit.client.0.smithi049.stdout:4/879: link d3/d8/d10/d43/d4d/db9/f59 d3/d8/d10/d43/d4d/db9/d8a/f129 0 2024-02-22T00:34:02.645 INFO:tasks.workunit.client.0.smithi049.stdout:2/804: chown d2/d9/dd/d4d/d72/d119 827208 1 2024-02-22T00:34:02.650 INFO:tasks.workunit.client.0.smithi049.stdout:4/880: dwrite d3/d22/d49/d57/fd5 [0,4194304] 0 2024-02-22T00:34:02.651 INFO:tasks.workunit.client.0.smithi049.stdout:2/805: creat d2/d9/d17/f121 x:0 0 0 2024-02-22T00:34:02.652 INFO:tasks.workunit.client.0.smithi049.stdout:2/806: stat d2/d9/f6e 0 2024-02-22T00:34:02.653 INFO:tasks.workunit.client.0.smithi049.stdout:4/881: stat d3/d8/d10/d43/d4d/db9/d92/cb5 0 2024-02-22T00:34:02.657 INFO:tasks.workunit.client.0.smithi049.stdout:2/807: rename d2/dda/d63/f7e to d2/d9/de/d15/d1b/dc4/f122 0 2024-02-22T00:34:02.662 INFO:tasks.workunit.client.0.smithi049.stdout:0/778: dwrite d3/df/d48/d63/fca [0,4194304] 0 2024-02-22T00:34:02.662 INFO:tasks.workunit.client.0.smithi049.stdout:2/808: creat d2/dda/d5d/d11f/f123 x:0 0 0 2024-02-22T00:34:02.668 INFO:tasks.workunit.client.0.smithi049.stdout:2/809: fsync d2/d9/de/d15/d1b/f20 0 2024-02-22T00:34:02.668 INFO:tasks.workunit.client.0.smithi049.stdout:1/827: dwrite d2/d8/db/d25/f48 [0,4194304] 0 2024-02-22T00:34:02.672 INFO:tasks.workunit.client.0.smithi049.stdout:1/828: chown d2/d8/db/d25/d62/dcc/dea/f114 14146449 1 2024-02-22T00:34:02.674 INFO:tasks.workunit.client.0.smithi049.stdout:2/810: creat d2/d9/de/d3a/dc3/d11e/f124 x:0 0 0 2024-02-22T00:34:02.678 INFO:tasks.workunit.client.0.smithi049.stdout:2/811: creat d2/d9/dd/d4d/d72/f125 x:0 0 0 2024-02-22T00:34:02.679 INFO:tasks.workunit.client.0.smithi049.stdout:0/779: getdents d3/df/d59/d60/de9 0 2024-02-22T00:34:02.683 INFO:tasks.workunit.client.0.smithi049.stdout:0/780: chown d3/d6/d29/f4b 135772 1 2024-02-22T00:34:02.684 INFO:tasks.workunit.client.0.smithi049.stdout:8/817: dread d1/d2/da5/d15/d33/f108 [0,4194304] 0 2024-02-22T00:34:02.686 INFO:tasks.workunit.client.0.smithi049.stdout:1/829: write d2/d8/db/d25/d40/d71/f9f [3937087,98115] 0 2024-02-22T00:34:02.688 INFO:tasks.workunit.client.0.smithi049.stdout:2/812: write d2/d9/de/d15/f4b [2399306,41179] 0 2024-02-22T00:34:02.689 INFO:tasks.workunit.client.0.smithi049.stdout:7/873: dwrite d1/df/d62/d1c/fc2 [0,4194304] 0 2024-02-22T00:34:02.692 INFO:tasks.workunit.client.0.smithi049.stdout:0/781: creat d3/df/d59/d8e/fef x:0 0 0 2024-02-22T00:34:02.704 INFO:tasks.workunit.client.0.smithi049.stdout:7/874: creat d1/d49/d5a/d13a/f13c x:0 0 0 2024-02-22T00:34:02.707 INFO:tasks.workunit.client.0.smithi049.stdout:2/813: dwrite d2/d9/dd/d4d/d72/fdf [0,4194304] 0 2024-02-22T00:34:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:4/882: dread d3/d8/d10/d12/f23 [0,4194304] 0 2024-02-22T00:34:02.709 INFO:tasks.workunit.client.0.smithi049.stdout:7/875: write d1/f104 [1024761,94160] 0 2024-02-22T00:34:02.710 INFO:tasks.workunit.client.0.smithi049.stdout:8/818: dwrite d1/d2/da5/d15/d30/d36/d52/daf/dde/f118 [0,4194304] 0 2024-02-22T00:34:02.711 INFO:tasks.workunit.client.0.smithi049.stdout:0/782: dwrite d3/df/d59/d8e/fef [0,4194304] 0 2024-02-22T00:34:02.717 INFO:tasks.workunit.client.0.smithi049.stdout:8/819: write d1/d2/d5/d56/fa4 [3531927,38653] 0 2024-02-22T00:34:02.718 INFO:tasks.workunit.client.0.smithi049.stdout:2/814: symlink d2/d9/de/l126 0 2024-02-22T00:34:02.720 INFO:tasks.workunit.client.0.smithi049.stdout:4/883: read d3/d8/d10/d43/d4d/f5f [3574264,88289] 0 2024-02-22T00:34:02.720 INFO:tasks.workunit.client.0.smithi049.stdout:8/820: stat d1/d2/da5/d15/d33/c7b 0 2024-02-22T00:34:02.720 INFO:tasks.workunit.client.0.smithi049.stdout:0/783: chown d3/df/d48/d6f/d90/dcc/fcf 314318 1 2024-02-22T00:34:02.724 INFO:tasks.workunit.client.0.smithi049.stdout:4/884: creat d3/d8/d10/d45/f12a x:0 0 0 2024-02-22T00:34:02.727 INFO:tasks.workunit.client.0.smithi049.stdout:8/821: mknod d1/d2/d5/d1b/d39/d60/df2/c11a 0 2024-02-22T00:34:02.728 INFO:tasks.workunit.client.0.smithi049.stdout:4/885: creat d3/d8/d10/d43/d4d/db9/de7/d124/f12b x:0 0 0 2024-02-22T00:34:02.730 INFO:tasks.workunit.client.0.smithi049.stdout:7/876: symlink d1/l13d 0 2024-02-22T00:34:02.732 INFO:tasks.workunit.client.0.smithi049.stdout:0/784: truncate d3/df/d48/d6f/d90/dcc/f96 547668 0 2024-02-22T00:34:02.736 INFO:tasks.workunit.client.0.smithi049.stdout:8/822: rename d1/d2/da5/d15/d30/d36/d52/daf/f105 to d1/d2/da5/d15/d65/d6a/f11b 0 2024-02-22T00:34:02.740 INFO:tasks.workunit.client.0.smithi049.stdout:0/785: mknod d3/df/d59/d60/cf0 0 2024-02-22T00:34:02.744 INFO:tasks.workunit.client.0.smithi049.stdout:7/877: rmdir d1/df/d62/d60 39 2024-02-22T00:34:02.746 INFO:tasks.workunit.client.0.smithi049.stdout:8/823: dwrite d1/d2/d5/f2c [0,4194304] 0 2024-02-22T00:34:02.755 INFO:tasks.workunit.client.0.smithi049.stdout:7/878: dread - d1/d41/d28/d71/d72/fe5 zero size 2024-02-22T00:34:02.757 INFO:tasks.workunit.client.0.smithi049.stdout:1/830: write d2/d8/db/d25/d40/f4b [1783466,122742] 0 2024-02-22T00:34:02.760 INFO:tasks.workunit.client.0.smithi049.stdout:2/815: dwrite d2/d9/dd/d4d/d72/f9a [0,4194304] 0 2024-02-22T00:34:02.763 INFO:tasks.workunit.client.0.smithi049.stdout:4/886: dwrite d3/d8/d10/d12/f31 [0,4194304] 0 2024-02-22T00:34:02.763 INFO:tasks.workunit.client.0.smithi049.stdout:0/786: dwrite d3/df/d48/d63/fbc [0,4194304] 0 2024-02-22T00:34:02.765 INFO:tasks.workunit.client.0.smithi049.stdout:4/887: read - d3/d22/d3d/f10f zero size 2024-02-22T00:34:02.765 INFO:tasks.workunit.client.0.smithi049.stdout:0/787: dread - d3/d92/feb zero size 2024-02-22T00:34:02.770 INFO:tasks.workunit.client.0.smithi049.stdout:2/816: symlink d2/dda/d7f/l127 0 2024-02-22T00:34:02.772 INFO:tasks.workunit.client.0.smithi049.stdout:4/888: rmdir d3/d22/d3d 39 2024-02-22T00:34:02.777 INFO:tasks.workunit.client.0.smithi049.stdout:2/817: creat d2/d9/df2/f128 x:0 0 0 2024-02-22T00:34:02.780 INFO:tasks.workunit.client.0.smithi049.stdout:2/818: dread - d2/d9/de/fae zero size 2024-02-22T00:34:02.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/879: creat d1/d49/d5a/d13a/f13e x:0 0 0 2024-02-22T00:34:02.784 INFO:tasks.workunit.client.0.smithi049.stdout:8/824: dwrite d1/d2/d5/d1b/d39/d81/df3/fbb [0,4194304] 0 2024-02-22T00:34:02.786 INFO:tasks.workunit.client.0.smithi049.stdout:0/788: mkdir d3/dcb/df1 0 2024-02-22T00:34:02.787 INFO:tasks.workunit.client.0.smithi049.stdout:8/825: chown d1/d2/da5/d15/d30/d36 460195 1 2024-02-22T00:34:02.788 INFO:tasks.workunit.client.0.smithi049.stdout:2/819: unlink d2/d9/de/d15/d1b/f25 0 2024-02-22T00:34:02.789 INFO:tasks.workunit.client.0.smithi049.stdout:4/889: dwrite d3/d8/d10/d43/d4d/db9/d8a/d48/d60/f9b [0,4194304] 0 2024-02-22T00:34:02.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/880: chown d1/df/d62/d60/d7e 1937 1 2024-02-22T00:34:02.792 INFO:tasks.workunit.client.0.smithi049.stdout:4/890: fsync d3/d8/d10/d45/f11b 0 2024-02-22T00:34:02.797 INFO:tasks.workunit.client.0.smithi049.stdout:2/820: mknod d2/d9/dd/d74/c129 0 2024-02-22T00:34:02.797 INFO:tasks.workunit.client.0.smithi049.stdout:7/881: read - d1/df/d62/d60/f120 zero size 2024-02-22T00:34:02.797 INFO:tasks.workunit.client.0.smithi049.stdout:8/826: rmdir d1/d2/d5/d1b/d39/d60/df2 39 2024-02-22T00:34:02.799 INFO:tasks.workunit.client.0.smithi049.stdout:8/827: chown d1/d2/d5/d1b/d39/d81/cf7 74415908 1 2024-02-22T00:34:02.799 INFO:tasks.workunit.client.0.smithi049.stdout:2/821: symlink d2/l12a 0 2024-02-22T00:34:02.801 INFO:tasks.workunit.client.0.smithi049.stdout:4/891: creat d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/d11c/d128/f12c x:0 0 0 2024-02-22T00:34:02.802 INFO:tasks.workunit.client.0.smithi049.stdout:1/831: dread d2/f35 [4194304,4194304] 0 2024-02-22T00:34:02.806 INFO:tasks.workunit.client.0.smithi049.stdout:2/822: dread d2/d9/de/d3a/d6d/fd9 [0,4194304] 0 2024-02-22T00:34:02.813 INFO:tasks.workunit.client.0.smithi049.stdout:7/882: dread d1/df/d62/d60/d7e/de6/ded/f119 [0,4194304] 0 2024-02-22T00:34:02.813 INFO:tasks.workunit.client.0.smithi049.stdout:4/892: dwrite d3/f4b [0,4194304] 0 2024-02-22T00:34:02.815 INFO:tasks.workunit.client.0.smithi049.stdout:8/828: rename d1/d2/da5/deb/c44 to d1/d2/da5/d15/d33/c11c 0 2024-02-22T00:34:02.817 INFO:tasks.workunit.client.0.smithi049.stdout:1/832: dwrite d2/d8/da/fc8 [0,4194304] 0 2024-02-22T00:34:02.819 INFO:tasks.workunit.client.0.smithi049.stdout:4/893: mknod d3/d22/d5c/da5/c12d 0 2024-02-22T00:34:02.824 INFO:tasks.workunit.client.0.smithi049.stdout:7/883: read d1/d41/d28/fa0 [3983016,83065] 0 2024-02-22T00:34:02.825 INFO:tasks.workunit.client.0.smithi049.stdout:4/894: fsync d3/d22/f101 0 2024-02-22T00:34:02.825 INFO:tasks.workunit.client.0.smithi049.stdout:2/823: dwrite d2/d9/de/d10/d2e/d42/d80/dcc/f65 [0,4194304] 0 2024-02-22T00:34:02.827 INFO:tasks.workunit.client.0.smithi049.stdout:4/895: stat d3/d8/ce9 0 2024-02-22T00:34:02.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/732: sync 2024-02-22T00:34:02.828 INFO:tasks.workunit.client.0.smithi049.stdout:9/914: sync 2024-02-22T00:34:02.831 INFO:tasks.workunit.client.0.smithi049.stdout:8/829: symlink d1/d2/d8c/l11d 0 2024-02-22T00:34:02.832 INFO:tasks.workunit.client.0.smithi049.stdout:4/896: dread - d3/d8/d10/d43/fd6 zero size 2024-02-22T00:34:02.833 INFO:tasks.workunit.client.0.smithi049.stdout:0/789: write d3/df/d48/d6f/d90/f31 [1288493,15849] 0 2024-02-22T00:34:02.835 INFO:tasks.workunit.client.0.smithi049.stdout:8/830: chown d1/d2/da5/d15/d30/d4b/c116 178199 1 2024-02-22T00:34:02.836 INFO:tasks.workunit.client.0.smithi049.stdout:2/824: fdatasync d2/d9/d17/f18 0 2024-02-22T00:34:02.838 INFO:tasks.workunit.client.0.smithi049.stdout:1/833: read d2/d8/db/d25/d40/d41/d68/f80 [1233523,107365] 0 2024-02-22T00:34:02.839 INFO:tasks.workunit.client.0.smithi049.stdout:2/825: readlink d2/d9/de/d10/d2e/d42/d80/dcc/l66 0 2024-02-22T00:34:02.839 INFO:tasks.workunit.client.0.smithi049.stdout:9/915: mkdir d17/d21/d4e/d89/d94/d12f 0 2024-02-22T00:34:02.840 INFO:tasks.workunit.client.0.smithi049.stdout:7/884: creat d1/df/d62/d48/d99/f13f x:0 0 0 2024-02-22T00:34:02.844 INFO:tasks.workunit.client.0.smithi049.stdout:7/885: dread - d1/d41/d55/d89/fd4 zero size 2024-02-22T00:34:02.845 INFO:tasks.workunit.client.0.smithi049.stdout:1/834: chown d2/d8/db/d25/d40/d41/d5b/d75/fee 9262 1 2024-02-22T00:34:02.845 INFO:tasks.workunit.client.0.smithi049.stdout:9/916: chown d17/d1c/d38/ca8 968326 1 2024-02-22T00:34:02.846 INFO:tasks.workunit.client.0.smithi049.stdout:0/790: symlink d3/df/d48/d6f/lf2 0 2024-02-22T00:34:02.847 INFO:tasks.workunit.client.0.smithi049.stdout:5/733: write d0/d20/d84/da0/db6/dc3/d64/f93 [1208308,52061] 0 2024-02-22T00:34:02.848 INFO:tasks.workunit.client.0.smithi049.stdout:7/886: write d1/df/d62/d57/fd7 [389690,79818] 0 2024-02-22T00:34:02.849 INFO:tasks.workunit.client.0.smithi049.stdout:2/826: write d2/d9/de/d10/d2e/d42/f43 [185300,31055] 0 2024-02-22T00:34:02.851 INFO:tasks.workunit.client.0.smithi049.stdout:4/897: dwrite d3/d8/d10/d45/f79 [0,4194304] 0 2024-02-22T00:34:02.855 INFO:tasks.workunit.client.0.smithi049.stdout:1/835: unlink d2/d8/d4c/d5e/lf1 0 2024-02-22T00:34:02.862 INFO:tasks.workunit.client.0.smithi049.stdout:4/898: creat d3/d8/d10/d43/d4d/db9/d92/f12e x:0 0 0 2024-02-22T00:34:02.862 INFO:tasks.workunit.client.0.smithi049.stdout:7/887: truncate d1/d41/d28/f36 5667529 0 2024-02-22T00:34:02.865 INFO:tasks.workunit.client.0.smithi049.stdout:9/917: dwrite d17/d21/d4e/d89/d94/df0/f7c [0,4194304] 0 2024-02-22T00:34:02.865 INFO:tasks.workunit.client.0.smithi049.stdout:8/831: getdents d1/d2/da5/d15/d33 0 2024-02-22T00:34:02.869 INFO:tasks.workunit.client.0.smithi049.stdout:8/832: chown d1/d2/d5/d1b/d39/d60/c8d 346428056 1 2024-02-22T00:34:02.871 INFO:tasks.workunit.client.0.smithi049.stdout:0/791: rename d3/d6/d8/d36/lab to d3/lf3 0 2024-02-22T00:34:02.873 INFO:tasks.workunit.client.0.smithi049.stdout:2/827: dread d2/d9/de/d10/d59/f11d [0,4194304] 0 2024-02-22T00:34:02.873 INFO:tasks.workunit.client.0.smithi049.stdout:4/899: creat d3/f12f x:0 0 0 2024-02-22T00:34:02.878 INFO:tasks.workunit.client.0.smithi049.stdout:5/734: rename d0/d20/d50/fa1 to d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/ff4 0 2024-02-22T00:34:02.880 INFO:tasks.workunit.client.0.smithi049.stdout:3/700: sync 2024-02-22T00:34:02.880 INFO:tasks.workunit.client.0.smithi049.stdout:9/918: dwrite d17/d1c/d25/d71/d73/f112 [0,4194304] 0 2024-02-22T00:34:02.883 INFO:tasks.workunit.client.0.smithi049.stdout:3/701: write d0/dd/d1e/fb2 [641257,19622] 0 2024-02-22T00:34:02.884 INFO:tasks.workunit.client.0.smithi049.stdout:7/888: dread d1/d41/f13b [0,4194304] 0 2024-02-22T00:34:02.886 INFO:tasks.workunit.client.0.smithi049.stdout:4/900: truncate d3/d22/f8d 2481534 0 2024-02-22T00:34:02.887 INFO:tasks.workunit.client.0.smithi049.stdout:5/735: mkdir d0/d20/dc5/df5 0 2024-02-22T00:34:02.888 INFO:tasks.workunit.client.0.smithi049.stdout:0/792: symlink d3/dcb/lf4 0 2024-02-22T00:34:02.890 INFO:tasks.workunit.client.0.smithi049.stdout:1/836: getdents d2/d8/db/d25/d62/dcc 0 2024-02-22T00:34:02.892 INFO:tasks.workunit.client.0.smithi049.stdout:5/736: dread - d0/d20/dad/daf/fd4 zero size 2024-02-22T00:34:02.893 INFO:tasks.workunit.client.0.smithi049.stdout:8/833: truncate d1/d2/da5/d15/d30/d36/d52/daf/ff4 5096670 0 2024-02-22T00:34:02.894 INFO:tasks.workunit.client.0.smithi049.stdout:3/702: rename d0/d14/d4d/d4e/fa9 to d0/d14/d4d/d4e/fd4 0 2024-02-22T00:34:02.895 INFO:tasks.workunit.client.0.smithi049.stdout:2/828: dwrite d2/d9/d17/f18 [4194304,4194304] 0 2024-02-22T00:34:02.896 INFO:tasks.workunit.client.0.smithi049.stdout:0/793: truncate d3/df/d59/d8e/fa7 802119 0 2024-02-22T00:34:02.896 INFO:tasks.workunit.client.0.smithi049.stdout:4/901: unlink d3/d8/ldf 0 2024-02-22T00:34:02.898 INFO:tasks.workunit.client.0.smithi049.stdout:1/837: write d2/d8/db/d25/d40/d41/d84/dab/ff9 [403260,106697] 0 2024-02-22T00:34:02.902 INFO:tasks.workunit.client.0.smithi049.stdout:9/919: truncate d17/fd5 1686400 0 2024-02-22T00:34:02.902 INFO:tasks.workunit.client.0.smithi049.stdout:2/829: chown d2/d9/de/d15/f4b 0 1 2024-02-22T00:34:02.903 INFO:tasks.workunit.client.0.smithi049.stdout:4/902: write d3/d8/d10/d39/f37 [1199923,15344] 0 2024-02-22T00:34:02.907 INFO:tasks.workunit.client.0.smithi049.stdout:0/794: dread - d3/d6/d8/fb2 zero size 2024-02-22T00:34:02.908 INFO:tasks.workunit.client.0.smithi049.stdout:9/920: fsync d17/d1c/d25/d71/da3/fb3 0 2024-02-22T00:34:02.908 INFO:tasks.workunit.client.0.smithi049.stdout:7/889: creat d1/df/d62/f140 x:0 0 0 2024-02-22T00:34:02.911 INFO:tasks.workunit.client.0.smithi049.stdout:0/795: readlink d3/df/d17/d50/d62/ld8 0 2024-02-22T00:34:02.912 INFO:tasks.workunit.client.0.smithi049.stdout:1/838: creat d2/d8/d4c/d5e/f119 x:0 0 0 2024-02-22T00:34:02.912 INFO:tasks.workunit.client.0.smithi049.stdout:4/903: chown d3/d22/d5c/d9a/c109 23228 1 2024-02-22T00:34:02.914 INFO:tasks.workunit.client.0.smithi049.stdout:9/921: stat d17/d1c/d25/d71/d73/fd6 0 2024-02-22T00:34:02.915 INFO:tasks.workunit.client.0.smithi049.stdout:2/830: mknod d2/d9/dd/d4d/d72/d119/c12b 0 2024-02-22T00:34:02.917 INFO:tasks.workunit.client.0.smithi049.stdout:5/737: rename d0/d20/d84/da0/db6/dc3/d6f/d94/d9c/fcd to d0/d20/d84/da0/db6/dc3/ff6 0 2024-02-22T00:34:02.919 INFO:tasks.workunit.client.0.smithi049.stdout:4/904: unlink d3/d22/d49/d57/fd5 0 2024-02-22T00:34:02.919 INFO:tasks.workunit.client.0.smithi049.stdout:6/865: sync 2024-02-22T00:34:02.920 INFO:tasks.workunit.client.0.smithi049.stdout:0/796: creat d3/d1e/ddf/ff5 x:0 0 0 2024-02-22T00:34:02.921 INFO:tasks.workunit.client.0.smithi049.stdout:2/831: mknod d2/d9/de/d15/d1b/dc4/df7/c12c 0 2024-02-22T00:34:02.922 INFO:tasks.workunit.client.0.smithi049.stdout:9/922: mknod d17/d21/c130 0 2024-02-22T00:34:02.922 INFO:tasks.workunit.client.0.smithi049.stdout:3/703: dread d0/d14/d4d/d4e/d4f/d5b/d76/fa0 [0,4194304] 0 2024-02-22T00:34:02.924 INFO:tasks.workunit.client.0.smithi049.stdout:0/797: dread - d3/d1e/d58/fa1 zero size 2024-02-22T00:34:02.925 INFO:tasks.workunit.client.0.smithi049.stdout:1/839: truncate d2/d8/db/d25/d62/f9a 942564 0 2024-02-22T00:34:02.926 INFO:tasks.workunit.client.0.smithi049.stdout:2/832: symlink d2/d9/de/d15/d1b/dc4/l12d 0 2024-02-22T00:34:02.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/704: dread - d0/d59/d87/fb5 zero size 2024-02-22T00:34:02.931 INFO:tasks.workunit.client.0.smithi049.stdout:4/905: rmdir d3/d22/d5c/d35/dd4 0 2024-02-22T00:34:02.933 INFO:tasks.workunit.client.0.smithi049.stdout:6/866: creat d3/d36/d70/dcc/d4d/d8b/df7/d11d/f12b x:0 0 0 2024-02-22T00:34:02.934 INFO:tasks.workunit.client.0.smithi049.stdout:0/798: write d3/df/f7d [390686,10783] 0 2024-02-22T00:34:02.939 INFO:tasks.workunit.client.0.smithi049.stdout:9/923: dwrite d17/f51 [0,4194304] 0 2024-02-22T00:34:02.939 INFO:tasks.workunit.client.0.smithi049.stdout:2/833: creat d2/d9/de/d10/d2e/f12e x:0 0 0 2024-02-22T00:34:02.942 INFO:tasks.workunit.client.0.smithi049.stdout:1/840: write d2/d8/db/d25/d40/d41/d5b/d75/fee [50814,92262] 0 2024-02-22T00:34:02.950 INFO:tasks.workunit.client.0.smithi049.stdout:3/705: creat d0/d14/d4d/d4e/fd5 x:0 0 0 2024-02-22T00:34:02.955 INFO:tasks.workunit.client.0.smithi049.stdout:6/867: mkdir d3/d64/d60/dc2/d10e/d12c 0 2024-02-22T00:34:02.957 INFO:tasks.workunit.client.0.smithi049.stdout:0/799: mkdir d3/df/d48/d63/de5/df6 0 2024-02-22T00:34:02.959 INFO:tasks.workunit.client.0.smithi049.stdout:1/841: dread d2/d8/db/d25/d40/d41/d5b/d75/fee [0,4194304] 0 2024-02-22T00:34:02.959 INFO:tasks.workunit.client.0.smithi049.stdout:5/738: dread d0/d20/d84/da0/db6/dc3/d6f/f61 [0,4194304] 0 2024-02-22T00:34:02.959 INFO:tasks.workunit.client.0.smithi049.stdout:9/924: unlink d17/d21/d85/ce6 0 2024-02-22T00:34:02.965 INFO:tasks.workunit.client.0.smithi049.stdout:6/868: mkdir d3/d64/d59/d12d 0 2024-02-22T00:34:02.971 INFO:tasks.workunit.client.0.smithi049.stdout:0/800: mkdir d3/df/d48/df7 0 2024-02-22T00:34:02.972 INFO:tasks.workunit.client.0.smithi049.stdout:4/906: rename d3/d8/d10/dc4 to d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/d130 0 2024-02-22T00:34:02.977 INFO:tasks.workunit.client.0.smithi049.stdout:2/834: dwrite d2/d9/de/d10/d2e/fa5 [0,4194304] 0 2024-02-22T00:34:02.978 INFO:tasks.workunit.client.0.smithi049.stdout:3/706: dwrite d0/d14/f69 [0,4194304] 0 2024-02-22T00:34:02.978 INFO:tasks.workunit.client.0.smithi049.stdout:4/907: write d3/d8/d10/d39/f37 [135922,51687] 0 2024-02-22T00:34:02.985 INFO:tasks.workunit.client.0.smithi049.stdout:1/842: mknod d2/d8/db/d25/dda/c11a 0 2024-02-22T00:34:02.997 INFO:tasks.workunit.client.0.smithi049.stdout:0/801: creat d3/df/d17/d50/ff8 x:0 0 0 2024-02-22T00:34:02.997 INFO:tasks.workunit.client.0.smithi049.stdout:9/925: write d17/d21/d4e/f8e [1255073,82427] 0 2024-02-22T00:34:02.997 INFO:tasks.workunit.client.0.smithi049.stdout:4/908: write d3/d22/d5c/f5b [1651035,14477] 0 2024-02-22T00:34:02.999 INFO:tasks.workunit.client.0.smithi049.stdout:2/835: write d2/d9/de/d10/d59/f8c [492972,4626] 0 2024-02-22T00:34:02.999 INFO:tasks.workunit.client.0.smithi049.stdout:3/707: rmdir d0/dd/d1e 39 2024-02-22T00:34:03.002 INFO:tasks.workunit.client.0.smithi049.stdout:5/739: truncate d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/fa7 354110 0 2024-02-22T00:34:03.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/869: dread d3/f43 [0,4194304] 0 2024-02-22T00:34:03.014 INFO:tasks.workunit.client.0.smithi049.stdout:2/836: write d2/d9/dd/dbb/f107 [4491585,12414] 0 2024-02-22T00:34:03.017 INFO:tasks.workunit.client.0.smithi049.stdout:9/926: mkdir d17/d21/d3c/dbf/de0/d131 0 2024-02-22T00:34:03.017 INFO:tasks.workunit.client.0.smithi049.stdout:5/740: mkdir d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/df7 0 2024-02-22T00:34:03.019 INFO:tasks.workunit.client.0.smithi049.stdout:0/802: creat d3/d92/ff9 x:0 0 0 2024-02-22T00:34:03.020 INFO:tasks.workunit.client.0.smithi049.stdout:4/909: truncate d3/d22/d3d/fe3 881529 0 2024-02-22T00:34:03.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/890: truncate d1/df/d62/d1c/fc2 679758 0 2024-02-22T00:34:03.024 INFO:tasks.workunit.client.0.smithi049.stdout:2/837: creat d2/d9/dd/d4d/d72/f12f x:0 0 0 2024-02-22T00:34:03.026 INFO:tasks.workunit.client.0.smithi049.stdout:9/927: dread - d17/d1c/d25/d39/ff3 zero size 2024-02-22T00:34:03.028 INFO:tasks.workunit.client.0.smithi049.stdout:8/834: dwrite d1/fe [0,4194304] 0 2024-02-22T00:34:03.030 INFO:tasks.workunit.client.0.smithi049.stdout:3/708: dwrite d0/dd/d1e/f78 [0,4194304] 0 2024-02-22T00:34:03.034 INFO:tasks.workunit.client.0.smithi049.stdout:9/928: stat d17/d1c/d8c/ffe 0 2024-02-22T00:34:03.035 INFO:tasks.workunit.client.0.smithi049.stdout:5/741: write d0/d20/d84/da0/db6/dc3/d70/db1/dbe/fc9 [1993121,80454] 0 2024-02-22T00:34:03.036 INFO:tasks.workunit.client.0.smithi049.stdout:3/709: dread - d0/dd/fc0 zero size 2024-02-22T00:34:03.037 INFO:tasks.workunit.client.0.smithi049.stdout:6/870: truncate d3/d64/d60/dc2/fdf 1476923 0 2024-02-22T00:34:03.037 INFO:tasks.workunit.client.0.smithi049.stdout:7/891: chown d1/d41/d28/fa7 8004028 1 2024-02-22T00:34:03.040 INFO:tasks.workunit.client.0.smithi049.stdout:3/710: readlink d0/d59/ld1 0 2024-02-22T00:34:03.040 INFO:tasks.workunit.client.0.smithi049.stdout:2/838: write d2/d9/dd/d4d/d72/fdf [262830,50267] 0 2024-02-22T00:34:03.041 INFO:tasks.workunit.client.0.smithi049.stdout:6/871: read d3/fa1 [4185642,88797] 0 2024-02-22T00:34:03.042 INFO:tasks.workunit.client.0.smithi049.stdout:4/910: truncate d3/d8/d10/d43/d4d/f82 4062043 0 2024-02-22T00:34:03.043 INFO:tasks.workunit.client.0.smithi049.stdout:7/892: write d1/d41/fa4 [4637332,126692] 0 2024-02-22T00:34:03.047 INFO:tasks.workunit.client.0.smithi049.stdout:8/835: symlink d1/d2/da5/d15/d33/l11e 0 2024-02-22T00:34:03.051 INFO:tasks.workunit.client.0.smithi049.stdout:2/839: rmdir d2/d9/de/d15/d1b 39 2024-02-22T00:34:03.052 INFO:tasks.workunit.client.0.smithi049.stdout:6/872: mkdir d3/d64/d59/d72/d92/db1/db3/d12e 0 2024-02-22T00:34:03.052 INFO:tasks.workunit.client.0.smithi049.stdout:3/711: mknod d0/dd/cd6 0 2024-02-22T00:34:03.054 INFO:tasks.workunit.client.0.smithi049.stdout:9/929: getdents d17/d1c/d25/dba/def 0 2024-02-22T00:34:03.054 INFO:tasks.workunit.client.0.smithi049.stdout:7/893: fsync d1/df/d62/d57/f69 0 2024-02-22T00:34:03.057 INFO:tasks.workunit.client.0.smithi049.stdout:4/911: rename d3/d22/c6a to d3/d22/c131 0 2024-02-22T00:34:03.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/803: rename d3/d6/d8/c2d to d3/df/cfa 0 2024-02-22T00:34:03.059 INFO:tasks.workunit.client.0.smithi049.stdout:6/873: unlink d3/dcd/lec 0 2024-02-22T00:34:03.059 INFO:tasks.workunit.client.0.smithi049.stdout:7/894: chown d1/d41/f13b 2285628 1 2024-02-22T00:34:03.062 INFO:tasks.workunit.client.0.smithi049.stdout:1/843: write d2/d8/db/f1a [74402,83941] 0 2024-02-22T00:34:03.062 INFO:tasks.workunit.client.0.smithi049.stdout:3/712: symlink d0/d14/ld7 0 2024-02-22T00:34:03.064 INFO:tasks.workunit.client.0.smithi049.stdout:5/742: dread d0/d20/d50/d24/f2f [0,4194304] 0 2024-02-22T00:34:03.064 INFO:tasks.workunit.client.0.smithi049.stdout:2/840: rmdir d2/d9/dd/d4d/d5a/d99 39 2024-02-22T00:34:03.065 INFO:tasks.workunit.client.0.smithi049.stdout:8/836: creat d1/d2/d5/d1b/d39/d60/df2/f11f x:0 0 0 2024-02-22T00:34:03.066 INFO:tasks.workunit.client.0.smithi049.stdout:9/930: rename d17/d21/d47/d5d/db4/f102 to d17/d1c/d25/dba/def/f132 0 2024-02-22T00:34:03.068 INFO:tasks.workunit.client.0.smithi049.stdout:8/837: chown d1/d2/d5/l67 3070 1 2024-02-22T00:34:03.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/804: fdatasync d3/df/d7f/fa3 0 2024-02-22T00:34:03.069 INFO:tasks.workunit.client.0.smithi049.stdout:8/838: chown d1/d2/d5 631 1 2024-02-22T00:34:03.070 INFO:tasks.workunit.client.0.smithi049.stdout:2/841: read d2/d9/d17/f18 [2309091,82520] 0 2024-02-22T00:34:03.071 INFO:tasks.workunit.client.0.smithi049.stdout:9/931: write d17/d1c/d8c/db0/d103/f100 [320302,30339] 0 2024-02-22T00:34:03.075 INFO:tasks.workunit.client.0.smithi049.stdout:3/713: symlink d0/d14/d4d/d4e/d56/d5a/dbf/ld8 0 2024-02-22T00:34:03.080 INFO:tasks.workunit.client.0.smithi049.stdout:3/714: rename d0 to d0/d14/d4d/d4e/d56/dc1/dd3/dd9 22 2024-02-22T00:34:03.082 INFO:tasks.workunit.client.0.smithi049.stdout:0/805: dwrite d3/d6/d8/fb2 [0,4194304] 0 2024-02-22T00:34:03.082 INFO:tasks.workunit.client.0.smithi049.stdout:8/839: unlink d1/d2/da5/d15/d30/d4b/f82 0 2024-02-22T00:34:03.085 INFO:tasks.workunit.client.0.smithi049.stdout:4/912: write d3/d8/d10/d43/d4d/db9/f59 [8673001,5850] 0 2024-02-22T00:34:03.087 INFO:tasks.workunit.client.0.smithi049.stdout:3/715: mknod d0/dd/d26/d2e/d52/d6e/cda 0 2024-02-22T00:34:03.089 INFO:tasks.workunit.client.0.smithi049.stdout:0/806: read d3/d6/d8/d36/d81/fb1 [685514,106056] 0 2024-02-22T00:34:03.091 INFO:tasks.workunit.client.0.smithi049.stdout:6/874: dread d3/d64/d60/da0/fd6 [0,4194304] 0 2024-02-22T00:34:03.095 INFO:tasks.workunit.client.0.smithi049.stdout:8/840: mkdir d1/d2/d8c/d120 0 2024-02-22T00:34:03.096 INFO:tasks.workunit.client.0.smithi049.stdout:0/807: read d3/df/d17/f24 [2666643,108892] 0 2024-02-22T00:34:03.097 INFO:tasks.workunit.client.0.smithi049.stdout:4/913: write d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/fec [225164,22246] 0 2024-02-22T00:34:03.097 INFO:tasks.workunit.client.0.smithi049.stdout:6/875: creat d3/dcd/d103/f12f x:0 0 0 2024-02-22T00:34:03.099 INFO:tasks.workunit.client.0.smithi049.stdout:8/841: stat d1/d2/da5/d15/lc7 0 2024-02-22T00:34:03.100 INFO:tasks.workunit.client.0.smithi049.stdout:5/743: dwrite d0/d20/f6e [0,4194304] 0 2024-02-22T00:34:03.102 INFO:tasks.workunit.client.0.smithi049.stdout:3/716: rename d0/dd/f13 to d0/d14/d4d/d4e/d56/d5a/dc4/fdb 0 2024-02-22T00:34:03.103 INFO:tasks.workunit.client.0.smithi049.stdout:9/932: dread f14 [0,4194304] 0 2024-02-22T00:34:03.103 INFO:tasks.workunit.client.0.smithi049.stdout:6/876: mkdir d3/d36/d57/d75/dce/d130 0 2024-02-22T00:34:03.104 INFO:tasks.workunit.client.0.smithi049.stdout:5/744: write d0/f32 [2033106,21274] 0 2024-02-22T00:34:03.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/877: dread - d3/dcd/f124 zero size 2024-02-22T00:34:03.109 INFO:tasks.workunit.client.0.smithi049.stdout:3/717: creat d0/d14/d4d/d4e/d56/dc1/dd3/fdc x:0 0 0 2024-02-22T00:34:03.109 INFO:tasks.workunit.client.0.smithi049.stdout:2/842: dread d2/d9/de/d3a/f37 [0,4194304] 0 2024-02-22T00:34:03.113 INFO:tasks.workunit.client.0.smithi049.stdout:5/745: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/db2/ff8 x:0 0 0 2024-02-22T00:34:03.113 INFO:tasks.workunit.client.0.smithi049.stdout:8/842: unlink d1/fe 0 2024-02-22T00:34:03.114 INFO:tasks.workunit.client.0.smithi049.stdout:2/843: chown d2/d9/de/d10/d2e/d42/d80/f9c 255861320 1 2024-02-22T00:34:03.115 INFO:tasks.workunit.client.0.smithi049.stdout:7/895: write d1/df/d62/d7a/f83 [1984079,56755] 0 2024-02-22T00:34:03.119 INFO:tasks.workunit.client.0.smithi049.stdout:2/844: chown d2/d9/dd/d4d/d72/da0/dba 2038983307 1 2024-02-22T00:34:03.119 INFO:tasks.workunit.client.0.smithi049.stdout:5/746: rmdir d0/d20/d84/da0/db6/dc3/d6f/d94/d74 39 2024-02-22T00:34:03.120 INFO:tasks.workunit.client.0.smithi049.stdout:6/878: dread d3/d64/d59/d72/d92/d6c/f11c [4194304,4194304] 0 2024-02-22T00:34:03.120 INFO:tasks.workunit.client.0.smithi049.stdout:3/718: dread d0/dd/d26/d2e/d52/f7c [0,4194304] 0 2024-02-22T00:34:03.122 INFO:tasks.workunit.client.0.smithi049.stdout:0/808: rename d3/d6/d8/d36/le2 to d3/df/d48/d6f/d90/lfb 0 2024-02-22T00:34:03.122 INFO:tasks.workunit.client.0.smithi049.stdout:6/879: chown d3/d16/d32/ld3 5 1 2024-02-22T00:34:03.123 INFO:tasks.workunit.client.0.smithi049.stdout:5/747: write d0/d20/d50/f36 [3743721,25484] 0 2024-02-22T00:34:03.124 INFO:tasks.workunit.client.0.smithi049.stdout:3/719: chown d0/d14/d4d/d4e/d56/c81 72421573 1 2024-02-22T00:34:03.126 INFO:tasks.workunit.client.0.smithi049.stdout:6/880: fsync d3/d36/f4e 0 2024-02-22T00:34:03.127 INFO:tasks.workunit.client.0.smithi049.stdout:2/845: symlink d2/d9/dd/d4d/d72/da0/l130 0 2024-02-22T00:34:03.128 INFO:tasks.workunit.client.0.smithi049.stdout:7/896: creat d1/df/d62/d48/f141 x:0 0 0 2024-02-22T00:34:03.129 INFO:tasks.workunit.client.0.smithi049.stdout:8/843: mkdir d1/d2/da5/d15/d30/d4b/d51/d121 0 2024-02-22T00:34:03.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/914: dread d3/d8/d10/d43/d4d/db9/d8a/fcf [4194304,4194304] 0 2024-02-22T00:34:03.132 INFO:tasks.workunit.client.0.smithi049.stdout:9/933: rename d17/d21/d4e/d4b/f5a to d17/d21/d47/d5d/f133 0 2024-02-22T00:34:03.133 INFO:tasks.workunit.client.0.smithi049.stdout:3/720: creat d0/fdd x:0 0 0 2024-02-22T00:34:03.137 INFO:tasks.workunit.client.0.smithi049.stdout:9/934: mknod d17/d21/d3c/dbf/de0/c134 0 2024-02-22T00:34:03.138 INFO:tasks.workunit.client.0.smithi049.stdout:3/721: fdatasync d0/dd/d26/d2e/f8d 0 2024-02-22T00:34:03.139 INFO:tasks.workunit.client.0.smithi049.stdout:5/748: dwrite d0/d20/d50/fa5 [0,4194304] 0 2024-02-22T00:34:03.141 INFO:tasks.workunit.client.0.smithi049.stdout:9/935: write d17/d1c/d38/f52 [700798,76847] 0 2024-02-22T00:34:03.147 INFO:tasks.workunit.client.0.smithi049.stdout:7/897: creat d1/df/d62/f142 x:0 0 0 2024-02-22T00:34:03.147 INFO:tasks.workunit.client.0.smithi049.stdout:8/844: creat d1/d2/da5/d15/d30/f122 x:0 0 0 2024-02-22T00:34:03.149 INFO:tasks.workunit.client.0.smithi049.stdout:5/749: write d0/d20/d84/da0/db6/dc3/d6f/d94/fde [520287,99509] 0 2024-02-22T00:34:03.149 INFO:tasks.workunit.client.0.smithi049.stdout:6/881: write d3/d64/f26 [3304905,42582] 0 2024-02-22T00:34:03.151 INFO:tasks.workunit.client.0.smithi049.stdout:2/846: rename d2/d9/dd/d4d/d5a/d99 to d2/d9/de/d10/d2e/d42/d131 0 2024-02-22T00:34:03.152 INFO:tasks.workunit.client.0.smithi049.stdout:5/750: chown d0/d20/d50/cbc 920 1 2024-02-22T00:34:03.153 INFO:tasks.workunit.client.0.smithi049.stdout:3/722: dread - d0/d14/d4d/d4e/d4f/d5b/f7a zero size 2024-02-22T00:34:03.154 INFO:tasks.workunit.client.0.smithi049.stdout:8/845: creat d1/d2/d8c/f123 x:0 0 0 2024-02-22T00:34:03.156 INFO:tasks.workunit.client.0.smithi049.stdout:9/936: rename d17/d1c/d8c/db0/l119 to d17/d21/d47/d7a/l135 0 2024-02-22T00:34:03.156 INFO:tasks.workunit.client.0.smithi049.stdout:6/882: mkdir d3/d64/d59/d72/d92/db1/db3/d131 0 2024-02-22T00:34:03.158 INFO:tasks.workunit.client.0.smithi049.stdout:4/915: link d3/d22/d5c/d9a/ld7 d3/d8/d10/d43/d4d/db9/l132 0 2024-02-22T00:34:03.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/723: creat d0/dd/d6f/fde x:0 0 0 2024-02-22T00:34:03.160 INFO:tasks.workunit.client.0.smithi049.stdout:5/751: mkdir d0/d20/dc5/df5/df9 0 2024-02-22T00:34:03.161 INFO:tasks.workunit.client.0.smithi049.stdout:2/847: symlink d2/d9/de/d15/d1b/l132 0 2024-02-22T00:34:03.164 INFO:tasks.workunit.client.0.smithi049.stdout:7/898: dwrite d1/d49/d5a/d112/d122/f12a [0,4194304] 0 2024-02-22T00:34:03.165 INFO:tasks.workunit.client.0.smithi049.stdout:9/937: rename d17/d1c/d38/c6e to d17/d1c/d8c/db0/de9/c136 0 2024-02-22T00:34:03.166 INFO:tasks.workunit.client.0.smithi049.stdout:2/848: dread - d2/d9/dd/d4d/d5a/fe5 zero size 2024-02-22T00:34:03.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/724: rmdir d0/dd/d26/d2e/d52/d6e 39 2024-02-22T00:34:03.170 INFO:tasks.workunit.client.0.smithi049.stdout:4/916: getdents d3/d22/d5c 0 2024-02-22T00:34:03.174 INFO:tasks.workunit.client.0.smithi049.stdout:9/938: creat d17/d21/d104/f137 x:0 0 0 2024-02-22T00:34:03.174 INFO:tasks.workunit.client.0.smithi049.stdout:2/849: chown d2/d9/de/d10/d2e/f12e 92 1 2024-02-22T00:34:03.175 INFO:tasks.workunit.client.0.smithi049.stdout:3/725: mknod d0/d59/d8f/cdf 0 2024-02-22T00:34:03.175 INFO:tasks.workunit.client.0.smithi049.stdout:7/899: write d1/df/d62/d1c/f113 [2454053,1568] 0 2024-02-22T00:34:03.175 INFO:tasks.workunit.client.0.smithi049.stdout:0/809: truncate d3/df/f7d 4058405 0 2024-02-22T00:34:03.179 INFO:tasks.workunit.client.0.smithi049.stdout:4/917: creat d3/d8/d10/d39/f133 x:0 0 0 2024-02-22T00:34:03.181 INFO:tasks.workunit.client.0.smithi049.stdout:2/850: creat d2/d9/df2/f133 x:0 0 0 2024-02-22T00:34:03.181 INFO:tasks.workunit.client.0.smithi049.stdout:3/726: write d0/fdd [449519,100699] 0 2024-02-22T00:34:03.182 INFO:tasks.workunit.client.0.smithi049.stdout:5/752: dwrite d0/fb7 [0,4194304] 0 2024-02-22T00:34:03.184 INFO:tasks.workunit.client.0.smithi049.stdout:8/846: truncate d1/d2/da5/d15/d30/d36/d52/daf/ff4 4006175 0 2024-02-22T00:34:03.187 INFO:tasks.workunit.client.0.smithi049.stdout:9/939: fsync d17/d1c/d25/d39/f3a 0 2024-02-22T00:34:03.189 INFO:tasks.workunit.client.0.smithi049.stdout:8/847: read d1/d2/f3 [1928028,96118] 0 2024-02-22T00:34:03.189 INFO:tasks.workunit.client.0.smithi049.stdout:3/727: write d0/d59/f42 [2309901,36705] 0 2024-02-22T00:34:03.191 INFO:tasks.workunit.client.0.smithi049.stdout:0/810: symlink d3/d6/d8/lfc 0 2024-02-22T00:34:03.192 INFO:tasks.workunit.client.0.smithi049.stdout:5/753: write d0/d20/d84/da0/db6/dc3/d70/db1/fc0 [2004912,48116] 0 2024-02-22T00:34:03.193 INFO:tasks.workunit.client.0.smithi049.stdout:3/728: chown d0/dd/d6f/c80 0 1 2024-02-22T00:34:03.198 INFO:tasks.workunit.client.0.smithi049.stdout:7/900: dwrite d1/df/d62/d7a/f83 [0,4194304] 0 2024-02-22T00:34:03.199 INFO:tasks.workunit.client.0.smithi049.stdout:3/729: write d0/dd/d26/f30 [3907274,11859] 0 2024-02-22T00:34:03.200 INFO:tasks.workunit.client.0.smithi049.stdout:9/940: getdents d17/d21/d3c/de3/d11d 0 2024-02-22T00:34:03.204 INFO:tasks.workunit.client.0.smithi049.stdout:5/754: mknod d0/d20/dc5/df5/cfa 0 2024-02-22T00:34:03.207 INFO:tasks.workunit.client.0.smithi049.stdout:4/918: getdents d3/d22/d5c/d5e 0 2024-02-22T00:34:03.209 INFO:tasks.workunit.client.0.smithi049.stdout:9/941: fdatasync d17/d21/d47/f7e 0 2024-02-22T00:34:03.210 INFO:tasks.workunit.client.0.smithi049.stdout:3/730: mknod d0/d14/ce0 0 2024-02-22T00:34:03.212 INFO:tasks.workunit.client.0.smithi049.stdout:0/811: dwrite d3/df/f2b [0,4194304] 0 2024-02-22T00:34:03.214 INFO:tasks.workunit.client.0.smithi049.stdout:4/919: unlink d3/d33/cc2 0 2024-02-22T00:34:03.216 INFO:tasks.workunit.client.0.smithi049.stdout:0/812: readlink d3/d6/d8/d36/l4e 0 2024-02-22T00:34:03.217 INFO:tasks.workunit.client.0.smithi049.stdout:5/755: mknod d0/d20/d84/da0/db6/dc3/dea/cfb 0 2024-02-22T00:34:03.218 INFO:tasks.workunit.client.0.smithi049.stdout:8/848: truncate d1/d2/d5/d1b/d39/d81/df3/f8f 2270862 0 2024-02-22T00:34:03.220 INFO:tasks.workunit.client.0.smithi049.stdout:3/731: write d0/d14/d4d/d4e/d4f/d5b/d76/fbe [411111,54935] 0 2024-02-22T00:34:03.220 INFO:tasks.workunit.client.0.smithi049.stdout:4/920: stat d3/d8/d10/lc6 0 2024-02-22T00:34:03.226 INFO:tasks.workunit.client.0.smithi049.stdout:9/942: link d17/d1c/d8c/fc6 d17/d1c/d8c/db0/de9/f138 0 2024-02-22T00:34:03.230 INFO:tasks.workunit.client.0.smithi049.stdout:2/851: dread d2/d9/de/d3a/f61 [0,4194304] 0 2024-02-22T00:34:03.231 INFO:tasks.workunit.client.0.smithi049.stdout:8/849: rmdir d1/d2 39 2024-02-22T00:34:03.231 INFO:tasks.workunit.client.0.smithi049.stdout:5/756: dwrite d0/d20/d50/f83 [0,4194304] 0 2024-02-22T00:34:03.232 INFO:tasks.workunit.client.0.smithi049.stdout:0/813: symlink d3/df/d48/d63/de5/df6/lfd 0 2024-02-22T00:34:03.236 INFO:tasks.workunit.client.0.smithi049.stdout:2/852: truncate d2/d9/de/d10/d2e/d42/f43 2518820 0 2024-02-22T00:34:03.237 INFO:tasks.workunit.client.0.smithi049.stdout:5/757: creat d0/d20/d50/ffc x:0 0 0 2024-02-22T00:34:03.241 INFO:tasks.workunit.client.0.smithi049.stdout:0/814: symlink d3/d6/d8/d36/d81/lfe 0 2024-02-22T00:34:03.245 INFO:tasks.workunit.client.0.smithi049.stdout:8/850: rmdir d1/d2/d5/d1b/d39/d60 39 2024-02-22T00:34:03.245 INFO:tasks.workunit.client.0.smithi049.stdout:2/853: link d2/d9/de/d15/d1b/l132 d2/d9/de/d15/d1b/dc4/df7/l134 0 2024-02-22T00:34:03.248 INFO:tasks.workunit.client.0.smithi049.stdout:0/815: fsync d3/f43 0 2024-02-22T00:34:03.251 INFO:tasks.workunit.client.0.smithi049.stdout:5/758: dwrite d0/d20/d50/d24/f2f [4194304,4194304] 0 2024-02-22T00:34:03.254 INFO:tasks.workunit.client.0.smithi049.stdout:2/854: symlink d2/d9/de/d10/d2e/d42/l135 0 2024-02-22T00:34:03.257 INFO:tasks.workunit.client.0.smithi049.stdout:3/732: dread d0/dd/d26/f30 [0,4194304] 0 2024-02-22T00:34:03.257 INFO:tasks.workunit.client.0.smithi049.stdout:7/901: truncate d1/d41/f3b 3765698 0 2024-02-22T00:34:03.261 INFO:tasks.workunit.client.0.smithi049.stdout:3/733: readlink d0/d14/d4d/d4e/d4f/d5b/l7b 0 2024-02-22T00:34:03.263 INFO:tasks.workunit.client.0.smithi049.stdout:2/855: write d2/d9/de/d10/d2e/f101 [703304,22987] 0 2024-02-22T00:34:03.263 INFO:tasks.workunit.client.0.smithi049.stdout:4/921: dread d3/d8/d10/d43/d4d/db9/f59 [4194304,4194304] 0 2024-02-22T00:34:03.264 INFO:tasks.workunit.client.0.smithi049.stdout:5/759: dwrite d0/fc2 [0,4194304] 0 2024-02-22T00:34:03.266 INFO:tasks.workunit.client.0.smithi049.stdout:0/816: unlink d3/d6/d29/f6c 0 2024-02-22T00:34:03.268 INFO:tasks.workunit.client.0.smithi049.stdout:4/922: write d3/d8/d10/d39/f87 [1940100,81122] 0 2024-02-22T00:34:03.271 INFO:tasks.workunit.client.0.smithi049.stdout:4/923: mkdir d3/d22/d49/d134 0 2024-02-22T00:34:03.272 INFO:tasks.workunit.client.0.smithi049.stdout:5/760: creat d0/d20/dc5/df5/df9/ffd x:0 0 0 2024-02-22T00:34:03.275 INFO:tasks.workunit.client.0.smithi049.stdout:3/734: read d0/f68 [382650,28993] 0 2024-02-22T00:34:03.279 INFO:tasks.workunit.client.0.smithi049.stdout:0/817: dread d3/df/d59/d8e/fa7 [0,4194304] 0 2024-02-22T00:34:03.280 INFO:tasks.workunit.client.0.smithi049.stdout:3/735: symlink d0/d59/d87/le1 0 2024-02-22T00:34:03.280 INFO:tasks.workunit.client.0.smithi049.stdout:9/943: dread d17/d21/d3c/f3d [0,4194304] 0 2024-02-22T00:34:03.284 INFO:tasks.workunit.client.0.smithi049.stdout:5/761: link d0/d20/c23 d0/d20/d50/d24/d54/cfe 0 2024-02-22T00:34:03.284 INFO:tasks.workunit.client.0.smithi049.stdout:2/856: dwrite d2/d9/de/d3a/d93/f118 [0,4194304] 0 2024-02-22T00:34:03.285 INFO:tasks.workunit.client.0.smithi049.stdout:9/944: chown d17/d21/d4e/d89/d94/laa 13517 1 2024-02-22T00:34:03.289 INFO:tasks.workunit.client.0.smithi049.stdout:9/945: write d17/d21/d47/d7a/fa0 [4382049,52015] 0 2024-02-22T00:34:03.289 INFO:tasks.workunit.client.0.smithi049.stdout:8/851: rename d1/d4c/fc8 to d1/d2/da5/d15/d30/d36/d52/daf/f124 0 2024-02-22T00:34:03.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:01.766362+0000 mgr.smithi161.sazlam (mgr.24369) 63 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 76 MiB/s rd, 261 MiB/s wr, 656 op/s 2024-02-22T00:34:03.293 INFO:tasks.workunit.client.0.smithi049.stdout:0/818: mkdir d3/df/d7f/dff 0 2024-02-22T00:34:03.295 INFO:tasks.workunit.client.0.smithi049.stdout:0/819: write d3/df/db5/fc7 [649119,18880] 0 2024-02-22T00:34:03.296 INFO:tasks.workunit.client.0.smithi049.stdout:7/902: write d1/df/d62/d60/fc7 [4704842,50432] 0 2024-02-22T00:34:03.298 INFO:tasks.workunit.client.0.smithi049.stdout:8/852: rmdir d1/d2/da5/d15 39 2024-02-22T00:34:03.304 INFO:tasks.workunit.client.0.smithi049.stdout:0/820: dwrite d3/df/d17/f24 [4194304,4194304] 0 2024-02-22T00:34:03.306 INFO:tasks.workunit.client.0.smithi049.stdout:5/762: creat d0/d20/d84/da0/db6/dc3/d70/db1/dbe/fff x:0 0 0 2024-02-22T00:34:03.309 INFO:tasks.workunit.client.0.smithi049.stdout:9/946: fsync d17/d21/f23 0 2024-02-22T00:34:03.310 INFO:tasks.workunit.client.0.smithi049.stdout:4/924: truncate d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/d130/f103 851483 0 2024-02-22T00:34:03.311 INFO:tasks.workunit.client.0.smithi049.stdout:8/853: mkdir d1/dd1/d125 0 2024-02-22T00:34:03.313 INFO:tasks.workunit.client.0.smithi049.stdout:2/857: rename d2/d9/de/d3a/f61 to d2/d9/dd/d4d/d5a/f136 0 2024-02-22T00:34:03.314 INFO:tasks.workunit.client.0.smithi049.stdout:9/947: fdatasync d17/d21/ff6 0 2024-02-22T00:34:03.314 INFO:tasks.workunit.client.0.smithi049.stdout:5/763: truncate d0/d20/d84/da0/db6/dc3/fac 532625 0 2024-02-22T00:34:03.315 INFO:tasks.workunit.client.0.smithi049.stdout:4/925: chown d3/d22/d5c/d5e/dfe 923770 1 2024-02-22T00:34:03.317 INFO:tasks.workunit.client.0.smithi049.stdout:2/858: fsync d2/d9/de/d10/d59/ffe 0 2024-02-22T00:34:03.318 INFO:tasks.workunit.client.0.smithi049.stdout:7/903: dread d1/d41/d28/f36 [0,4194304] 0 2024-02-22T00:34:03.318 INFO:tasks.workunit.client.0.smithi049.stdout:9/948: write d17/d21/d47/d5d/ffc [289260,84552] 0 2024-02-22T00:34:03.320 INFO:tasks.workunit.client.0.smithi049.stdout:7/904: chown d1/df/d62/d1c/l92 124654 1 2024-02-22T00:34:03.321 INFO:tasks.workunit.client.0.smithi049.stdout:2/859: symlink d2/d9/de/d3a/dc3/l137 0 2024-02-22T00:34:03.323 INFO:tasks.workunit.client.0.smithi049.stdout:2/860: chown d2/d9/dd/dbb 17149425 1 2024-02-22T00:34:03.332 INFO:tasks.workunit.client.0.smithi049.stdout:5/764: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/f100 x:0 0 0 2024-02-22T00:34:03.334 INFO:tasks.workunit.client.0.smithi049.stdout:9/949: getdents d17/d1c/d25/dba/def 0 2024-02-22T00:34:03.337 INFO:tasks.workunit.client.0.smithi049.stdout:2/861: fsync d2/d9/dd/d4d/d5a/f113 0 2024-02-22T00:34:03.344 INFO:tasks.workunit.client.0.smithi049.stdout:9/950: dwrite d17/d21/fa4 [0,4194304] 0 2024-02-22T00:34:03.344 INFO:tasks.workunit.client.0.smithi049.stdout:2/862: rmdir d2/d9/dd/d4d/da7 39 2024-02-22T00:34:03.345 INFO:tasks.workunit.client.0.smithi049.stdout:4/926: dread d3/d22/d49/d57/fd3 [0,4194304] 0 2024-02-22T00:34:03.346 INFO:tasks.workunit.client.0.smithi049.stdout:9/951: fsync d17/d21/d4e/f10c 0 2024-02-22T00:34:03.347 INFO:tasks.workunit.client.0.smithi049.stdout:0/821: truncate d3/d92/fa4 1024025 0 2024-02-22T00:34:03.347 INFO:tasks.workunit.client.0.smithi049.stdout:7/905: dread d1/df/d62/f30 [0,4194304] 0 2024-02-22T00:34:03.350 INFO:tasks.workunit.client.0.smithi049.stdout:2/863: getdents d2 0 2024-02-22T00:34:03.353 INFO:tasks.workunit.client.0.smithi049.stdout:9/952: mkdir d17/d21/d4e/d89/d139 0 2024-02-22T00:34:03.353 INFO:tasks.workunit.client.0.smithi049.stdout:4/927: truncate d3/d22/d5c/d9a/fa4 831778 0 2024-02-22T00:34:03.354 INFO:tasks.workunit.client.0.smithi049.stdout:9/953: stat d17/d21/d85/cbd 0 2024-02-22T00:34:03.357 INFO:tasks.workunit.client.0.smithi049.stdout:9/954: readlink d17/d1c/l2e 0 2024-02-22T00:34:03.359 INFO:tasks.workunit.client.0.smithi049.stdout:4/928: mknod d3/c135 0 2024-02-22T00:34:03.362 INFO:tasks.workunit.client.0.smithi049.stdout:4/929: readlink d3/lb1 0 2024-02-22T00:34:03.364 INFO:tasks.workunit.client.0.smithi049.stdout:9/955: symlink d17/d1c/d25/d71/d73/l13a 0 2024-02-22T00:34:03.365 INFO:tasks.workunit.client.0.smithi049.stdout:2/864: dwrite d2/d9/dd/dbb/f107 [0,4194304] 0 2024-02-22T00:34:03.368 INFO:tasks.workunit.client.0.smithi049.stdout:5/765: dread d0/d20/d50/f38 [0,4194304] 0 2024-02-22T00:34:03.369 INFO:tasks.workunit.client.0.smithi049.stdout:9/956: mkdir d17/d1c/d8c/db0/d13b 0 2024-02-22T00:34:03.369 INFO:tasks.workunit.client.0.smithi049.stdout:2/865: chown d2/d9/de/d3a/f54 11 1 2024-02-22T00:34:03.369 INFO:tasks.workunit.client.0.smithi049.stdout:8/854: dwrite d1/d2/d5/d1b/d39/d81/df3/f8f [0,4194304] 0 2024-02-22T00:34:03.372 INFO:tasks.workunit.client.0.smithi049.stdout:5/766: write d0/d20/d50/d24/f75 [1911616,22551] 0 2024-02-22T00:34:03.375 INFO:tasks.workunit.client.0.smithi049.stdout:2/866: creat d2/d9/dd/dbb/f138 x:0 0 0 2024-02-22T00:34:03.377 INFO:tasks.workunit.client.0.smithi049.stdout:0/822: chown d3/l12 88280 1 2024-02-22T00:34:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:5/767: creat d0/d20/d84/da0/db6/dc3/d70/db1/d9e/f101 x:0 0 0 2024-02-22T00:34:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:4/930: link d3/d8/d10/d43/d4d/f82 d3/d22/d5c/da5/f136 0 2024-02-22T00:34:03.380 INFO:tasks.workunit.client.0.smithi049.stdout:7/906: write d1/d49/d5a/d112/d122/fc3 [854572,113592] 0 2024-02-22T00:34:03.381 INFO:tasks.workunit.client.0.smithi049.stdout:8/855: fdatasync d1/d2/d5/d1b/d39/d81/df3/fd5 0 2024-02-22T00:34:03.384 INFO:tasks.workunit.client.0.smithi049.stdout:0/823: creat d3/df/d7f/f100 x:0 0 0 2024-02-22T00:34:03.385 INFO:tasks.workunit.client.0.smithi049.stdout:5/768: symlink d0/d20/d50/d24/d3b/l102 0 2024-02-22T00:34:03.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/867: dwrite d2/d9/dd/d4d/d72/f125 [0,4194304] 0 2024-02-22T00:34:03.394 INFO:tasks.workunit.client.0.smithi049.stdout:0/824: dread d3/d1e/d58/f98 [0,4194304] 0 2024-02-22T00:34:03.395 INFO:tasks.workunit.client.0.smithi049.stdout:7/907: dread d1/df/d62/d57/f74 [0,4194304] 0 2024-02-22T00:34:03.401 INFO:tasks.workunit.client.0.smithi049.stdout:4/931: dwrite d3/d8/d10/d12/d3f/fa9 [0,4194304] 0 2024-02-22T00:34:03.401 INFO:tasks.workunit.client.0.smithi049.stdout:8/856: creat d1/d2/da5/d15/d30/d36/f126 x:0 0 0 2024-02-22T00:34:03.402 INFO:tasks.workunit.client.0.smithi049.stdout:2/868: symlink d2/d9/de/d10/d2e/d42/d80/d108/l139 0 2024-02-22T00:34:03.402 INFO:tasks.workunit.client.0.smithi049.stdout:5/769: mkdir d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d103 0 2024-02-22T00:34:03.405 INFO:tasks.workunit.client.0.smithi049.stdout:0/825: truncate d3/df/d48/d6f/d90/f31 2300141 0 2024-02-22T00:34:03.408 INFO:tasks.workunit.client.0.smithi049.stdout:2/869: unlink d2/d9/d17/c82 0 2024-02-22T00:34:03.410 INFO:tasks.workunit.client.0.smithi049.stdout:4/932: write d3/d8/d10/d43/d4d/f5f [953062,10981] 0 2024-02-22T00:34:03.411 INFO:tasks.workunit.client.0.smithi049.stdout:5/770: creat d0/d20/d50/d24/f104 x:0 0 0 2024-02-22T00:34:03.417 INFO:tasks.workunit.client.0.smithi049.stdout:0/826: symlink d3/df/d59/d8e/l101 0 2024-02-22T00:34:03.419 INFO:tasks.workunit.client.0.smithi049.stdout:9/957: dread d17/d21/d47/d5d/f133 [0,4194304] 0 2024-02-22T00:34:03.421 INFO:tasks.workunit.client.0.smithi049.stdout:5/771: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/f105 x:0 0 0 2024-02-22T00:34:03.422 INFO:tasks.workunit.client.0.smithi049.stdout:2/870: dwrite d2/d9/de/d10/d2e/f101 [0,4194304] 0 2024-02-22T00:34:03.422 INFO:tasks.workunit.client.0.smithi049.stdout:4/933: rename d3/d8/d10/d12/f23 to d3/d8/d10/d43/d4d/db9/d8a/d48/d60/f137 0 2024-02-22T00:34:03.424 INFO:tasks.workunit.client.0.smithi049.stdout:0/827: mknod d3/dcb/c102 0 2024-02-22T00:34:03.425 INFO:tasks.workunit.client.0.smithi049.stdout:4/934: dread - d3/d8/d10/d45/f11b zero size 2024-02-22T00:34:03.426 INFO:tasks.workunit.client.0.smithi049.stdout:9/958: truncate d17/d1c/d38/f52 1311245 0 2024-02-22T00:34:03.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:01.766362+0000 mgr.smithi161.sazlam (mgr.24369) 63 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 76 MiB/s rd, 261 MiB/s wr, 656 op/s 2024-02-22T00:34:03.431 INFO:tasks.workunit.client.0.smithi049.stdout:0/828: read d3/d6/d8/fb2 [3974916,22209] 0 2024-02-22T00:34:03.433 INFO:tasks.workunit.client.0.smithi049.stdout:4/935: truncate d3/d8/d10/d45/f55 8712660 0 2024-02-22T00:34:03.434 INFO:tasks.workunit.client.0.smithi049.stdout:9/959: read d17/d1c/d8c/db0/d103/f100 [334076,5083] 0 2024-02-22T00:34:03.436 INFO:tasks.workunit.client.0.smithi049.stdout:8/857: dread d1/d2/da5/d15/d30/d4b/d51/f6e [0,4194304] 0 2024-02-22T00:34:03.439 INFO:tasks.workunit.client.0.smithi049.stdout:8/858: stat d1/d2/d5/d1b/d39/d81/df3/l35 0 2024-02-22T00:34:03.440 INFO:tasks.workunit.client.0.smithi049.stdout:4/936: fdatasync d3/d22/d3d/f126 0 2024-02-22T00:34:03.441 INFO:tasks.workunit.client.0.smithi049.stdout:0/829: truncate d3/d6/f7b 2205181 0 2024-02-22T00:34:03.442 INFO:tasks.workunit.client.0.smithi049.stdout:5/772: dwrite d0/d20/d84/da0/db6/dc3/d70/fb4 [0,4194304] 0 2024-02-22T00:34:03.443 INFO:tasks.workunit.client.0.smithi049.stdout:4/937: chown d3/d8/d10/l7f 1958516 1 2024-02-22T00:34:03.445 INFO:tasks.workunit.client.0.smithi049.stdout:5/773: write d0/f63 [3131533,107293] 0 2024-02-22T00:34:03.446 INFO:tasks.workunit.client.0.smithi049.stdout:8/859: mknod d1/dd1/c127 0 2024-02-22T00:34:03.450 INFO:tasks.workunit.client.0.smithi049.stdout:9/960: dread d17/d1c/d25/d39/fb2 [0,4194304] 0 2024-02-22T00:34:03.451 INFO:tasks.workunit.client.0.smithi049.stdout:9/961: chown d17/f51 0 1 2024-02-22T00:34:03.452 INFO:tasks.workunit.client.0.smithi049.stdout:4/938: unlink d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/df1/f122 0 2024-02-22T00:34:03.453 INFO:tasks.workunit.client.0.smithi049.stdout:0/830: fsync d3/df/f7d 0 2024-02-22T00:34:03.456 INFO:tasks.workunit.client.0.smithi049.stdout:5/774: read d0/d20/d84/da0/db6/dc3/d6f/d94/f12 [253169,116172] 0 2024-02-22T00:34:03.456 INFO:tasks.workunit.client.0.smithi049.stdout:4/939: mkdir d3/d22/d5c/d9a/d138 0 2024-02-22T00:34:03.458 INFO:tasks.workunit.client.0.smithi049.stdout:5/775: symlink d0/d20/dad/l106 0 2024-02-22T00:34:03.461 INFO:tasks.workunit.client.0.smithi049.stdout:0/831: creat d3/df/d7f/f103 x:0 0 0 2024-02-22T00:34:03.462 INFO:tasks.workunit.client.0.smithi049.stdout:5/776: symlink d0/d20/d50/d24/d3b/l107 0 2024-02-22T00:34:03.462 INFO:tasks.workunit.client.0.smithi049.stdout:0/832: fsync d3/df/d59/d8e/fcd 0 2024-02-22T00:34:03.465 INFO:tasks.workunit.client.0.smithi049.stdout:4/940: dread d3/d8/d10/d45/f79 [0,4194304] 0 2024-02-22T00:34:03.468 INFO:tasks.workunit.client.0.smithi049.stdout:4/941: write d3/d22/d5c/f5b [6405127,42790] 0 2024-02-22T00:34:03.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/777: dwrite d0/d20/d50/fa5 [0,4194304] 0 2024-02-22T00:34:03.472 INFO:tasks.workunit.client.0.smithi049.stdout:4/942: creat d3/d22/d5c/da5/da8/f139 x:0 0 0 2024-02-22T00:34:03.473 INFO:tasks.workunit.client.0.smithi049.stdout:5/778: symlink d0/d20/dc5/l108 0 2024-02-22T00:34:03.479 INFO:tasks.workunit.client.0.smithi049.stdout:4/943: write d3/d33/fd2 [757012,53808] 0 2024-02-22T00:34:03.479 INFO:tasks.workunit.client.0.smithi049.stdout:5/779: mknod d0/d20/c109 0 2024-02-22T00:34:03.479 INFO:tasks.workunit.client.0.smithi049.stdout:7/908: truncate d1/df/d62/d57/fef 511503 0 2024-02-22T00:34:03.479 INFO:tasks.workunit.client.0.smithi049.stdout:5/780: mkdir d0/d20/dc5/df5/df9/d10a 0 2024-02-22T00:34:03.480 INFO:tasks.workunit.client.0.smithi049.stdout:5/781: chown d0/d20/d50/d24/cd7 849 1 2024-02-22T00:34:03.481 INFO:tasks.workunit.client.0.smithi049.stdout:5/782: stat d0/d20/l35 0 2024-02-22T00:34:03.485 INFO:tasks.workunit.client.0.smithi049.stdout:4/944: dwrite d3/d8/d10/d45/f79 [0,4194304] 0 2024-02-22T00:34:03.487 INFO:tasks.workunit.client.0.smithi049.stdout:5/783: unlink d0/d20/d84/da0/db6/dc3/d6f/d94/l11 0 2024-02-22T00:34:03.489 INFO:tasks.workunit.client.0.smithi049.stdout:4/945: creat d3/d8/d10/d43/d4d/db9/d92/f13a x:0 0 0 2024-02-22T00:34:03.491 INFO:tasks.workunit.client.0.smithi049.stdout:5/784: truncate d0/d20/d84/da0/db6/dc3/fb9 574046 0 2024-02-22T00:34:03.494 INFO:tasks.workunit.client.0.smithi049.stdout:4/946: creat d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/df1/d125/f13b x:0 0 0 2024-02-22T00:34:03.500 INFO:tasks.workunit.client.0.smithi049.stdout:4/947: link d3/d8/d10/d39/l86 d3/d8/d10/d43/d4d/db9/d8a/d48/d60/l13c 0 2024-02-22T00:34:03.502 INFO:tasks.workunit.client.0.smithi049.stdout:4/948: rmdir d3/d22/d5c/da5 39 2024-02-22T00:34:03.504 INFO:tasks.workunit.client.0.smithi049.stdout:4/949: chown f2 4 1 2024-02-22T00:34:03.506 INFO:tasks.workunit.client.0.smithi049.stdout:5/785: truncate d0/d20/d84/da0/db6/dc3/d6f/d94/f12 3932289 0 2024-02-22T00:34:03.508 INFO:tasks.workunit.client.0.smithi049.stdout:4/950: rename d3/d22/d5c/d35/c66 to d3/d22/df0/c13d 0 2024-02-22T00:34:03.509 INFO:tasks.workunit.client.0.smithi049.stdout:4/951: readlink d3/d8/d10/d43/l73 0 2024-02-22T00:34:03.513 INFO:tasks.workunit.client.0.smithi049.stdout:8/860: truncate d1/d2/da5/d15/d30/d36/d52/daf/dde/f118 508871 0 2024-02-22T00:34:03.517 INFO:tasks.workunit.client.0.smithi049.stdout:8/861: mknod d1/d2/da5/da3/c128 0 2024-02-22T00:34:03.521 INFO:tasks.workunit.client.0.smithi049.stdout:0/833: truncate d3/df/d48/d6f/d90/dcc/f5d 4145868 0 2024-02-22T00:34:03.524 INFO:tasks.workunit.client.0.smithi049.stdout:5/786: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/f97 [0,4194304] 0 2024-02-22T00:34:03.526 INFO:tasks.workunit.client.0.smithi049.stdout:4/952: dwrite d3/d22/d3d/f126 [0,4194304] 0 2024-02-22T00:34:03.530 INFO:tasks.workunit.client.0.smithi049.stdout:0/834: mknod d3/df/d59/d60/c104 0 2024-02-22T00:34:03.531 INFO:tasks.workunit.client.0.smithi049.stdout:5/787: creat d0/d20/d84/da0/db6/dc3/d64/f10b x:0 0 0 2024-02-22T00:34:03.540 INFO:tasks.workunit.client.0.smithi049.stdout:7/909: dwrite d1/f5f [0,4194304] 0 2024-02-22T00:34:03.545 INFO:tasks.workunit.client.0.smithi049.stdout:7/910: mkdir d1/d49/d11d/d143 0 2024-02-22T00:34:03.545 INFO:tasks.workunit.client.0.smithi049.stdout:5/788: dwrite d0/d20/d84/da0/db6/dc3/d6f/feb [0,4194304] 0 2024-02-22T00:34:03.550 INFO:tasks.workunit.client.0.smithi049.stdout:5/789: read d0/d20/d84/da0/db6/dc3/fac [414598,89417] 0 2024-02-22T00:34:03.551 INFO:tasks.workunit.client.0.smithi049.stdout:0/835: dread d3/d6/d8/f1a [0,4194304] 0 2024-02-22T00:34:03.554 INFO:tasks.workunit.client.0.smithi049.stdout:5/790: mknod d0/d20/d50/c10c 0 2024-02-22T00:34:03.555 INFO:tasks.workunit.client.0.smithi049.stdout:5/791: write d0/d20/d50/d24/fec [370171,20326] 0 2024-02-22T00:34:03.560 INFO:tasks.workunit.client.0.smithi049.stdout:5/792: rename d0/d20/d50/l56 to d0/d20/d84/da0/l10d 0 2024-02-22T00:34:03.560 INFO:tasks.workunit.client.0.smithi049.stdout:0/836: read d3/d6/f7b [1336382,79774] 0 2024-02-22T00:34:03.561 INFO:tasks.workunit.client.0.smithi049.stdout:7/911: symlink d1/l144 0 2024-02-22T00:34:03.563 INFO:tasks.workunit.client.0.smithi049.stdout:5/793: mkdir d0/d20/d84/da0/db6/dc3/dea/d10e 0 2024-02-22T00:34:03.567 INFO:tasks.workunit.client.0.smithi049.stdout:7/912: write d1/d41/d28/d10c/f12e [518774,129532] 0 2024-02-22T00:34:03.568 INFO:tasks.workunit.client.0.smithi049.stdout:5/794: mknod d0/d20/d84/da0/c10f 0 2024-02-22T00:34:03.570 INFO:tasks.workunit.client.0.smithi049.stdout:5/795: write d0/d20/d84/da0/db6/dc3/d70/db1/d9e/f101 [895474,16125] 0 2024-02-22T00:34:03.576 INFO:tasks.workunit.client.0.smithi049.stdout:8/862: dwrite d1/d2/da5/d15/d33/f48 [4194304,4194304] 0 2024-02-22T00:34:03.576 INFO:tasks.workunit.client.0.smithi049.stdout:7/913: unlink d1/df/d62/d1c/d6d/ce4 0 2024-02-22T00:34:03.584 INFO:tasks.workunit.client.0.smithi049.stdout:5/796: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/d74/db2/ff0 [0,4194304] 0 2024-02-22T00:34:03.587 INFO:tasks.workunit.client.0.smithi049.stdout:7/914: rename d1/df/d62/d1c/d1d/f34 to d1/d41/d55/f145 0 2024-02-22T00:34:03.591 INFO:tasks.workunit.client.0.smithi049.stdout:7/915: mknod d1/df/d62/d60/d7e/de6/d125/c146 0 2024-02-22T00:34:03.595 INFO:tasks.workunit.client.0.smithi049.stdout:5/797: dread d0/d20/d50/d24/f71 [0,4194304] 0 2024-02-22T00:34:03.600 INFO:tasks.workunit.client.0.smithi049.stdout:5/798: link d0/d20/d84/da0/db6/dc3/d6f/d94/d74/f100 d0/d20/dc5/f110 0 2024-02-22T00:34:03.610 INFO:tasks.workunit.client.0.smithi049.stdout:7/916: fsync d1/df/d62/d57/fef 0 2024-02-22T00:34:03.613 INFO:tasks.workunit.client.0.smithi049.stdout:5/799: dwrite d0/d20/d84/da0/db6/dc3/fac [0,4194304] 0 2024-02-22T00:34:03.616 INFO:tasks.workunit.client.0.smithi049.stdout:5/800: write d0/d20/d50/d24/f88 [3836222,47613] 0 2024-02-22T00:34:03.619 INFO:tasks.workunit.client.0.smithi049.stdout:5/801: write d0/d20/d84/da0/db6/dc3/d6f/d94/d74/db2/ff0 [788096,102532] 0 2024-02-22T00:34:03.622 INFO:tasks.workunit.client.0.smithi049.stdout:5/802: chown d0/d20/d84/da0/db6/dc3/d6f 3968 1 2024-02-22T00:34:03.625 INFO:tasks.workunit.client.0.smithi049.stdout:8/863: dwrite d1/d2/da5/ff5 [0,4194304] 0 2024-02-22T00:34:03.627 INFO:tasks.workunit.client.0.smithi049.stdout:5/803: symlink d0/l111 0 2024-02-22T00:34:03.638 INFO:tasks.workunit.client.0.smithi049.stdout:5/804: dwrite d0/d20/d50/d24/d3b/f49 [0,4194304] 0 2024-02-22T00:34:03.641 INFO:tasks.workunit.client.0.smithi049.stdout:5/805: mkdir d0/d20/dc5/d112 0 2024-02-22T00:34:03.643 INFO:tasks.workunit.client.0.smithi049.stdout:5/806: chown d0/d20/d50/d24/d3b/f49 72 1 2024-02-22T00:34:03.645 INFO:tasks.workunit.client.0.smithi049.stdout:5/807: mknod d0/d20/c113 0 2024-02-22T00:34:03.653 INFO:tasks.workunit.client.0.smithi049.stdout:8/864: dread d1/d2/da5/d15/d30/d4b/f7d [0,4194304] 0 2024-02-22T00:34:03.654 INFO:tasks.workunit.client.0.smithi049.stdout:5/808: rename d0/d20/dc5/df5/df9/d10a to d0/d20/d84/da0/db6/dc3/dea/d10e/d114 0 2024-02-22T00:34:03.655 INFO:tasks.workunit.client.0.smithi049.stdout:7/917: dwrite d1/df/d62/d57/f69 [0,4194304] 0 2024-02-22T00:34:03.661 INFO:tasks.workunit.client.0.smithi049.stdout:8/865: rename d1/d2/d5/d1b/d39/f72 to d1/d2/da5/da3/f129 0 2024-02-22T00:34:03.662 INFO:tasks.workunit.client.0.smithi049.stdout:7/918: fsync d1/df/d62/d60/d7e/fbb 0 2024-02-22T00:34:03.666 INFO:tasks.workunit.client.0.smithi049.stdout:5/809: rename d0/d20/d84/da0/db6/dc3/d64 to d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d115 0 2024-02-22T00:34:03.675 INFO:tasks.workunit.client.0.smithi049.stdout:7/919: fsync d1/d49/d4d/f86 0 2024-02-22T00:34:03.676 INFO:tasks.workunit.client.0.smithi049.stdout:5/810: dwrite d0/d20/d84/da0/db6/ff1 [0,4194304] 0 2024-02-22T00:34:03.679 INFO:tasks.workunit.client.0.smithi049.stdout:7/920: creat d1/d41/d55/f147 x:0 0 0 2024-02-22T00:34:03.681 INFO:tasks.workunit.client.0.smithi049.stdout:8/866: dread d1/d2/d5/d1b/d39/f54 [0,4194304] 0 2024-02-22T00:34:03.681 INFO:tasks.workunit.client.0.smithi049.stdout:5/811: link d0/d20/d50/d24/f75 d0/d20/dad/f116 0 2024-02-22T00:34:03.682 INFO:tasks.workunit.client.0.smithi049.stdout:7/921: stat d1/df/d62/d60/d7e/de6 0 2024-02-22T00:34:03.684 INFO:tasks.workunit.client.0.smithi049.stdout:5/812: mknod d0/d20/d84/da0/db6/dc3/dea/c117 0 2024-02-22T00:34:03.688 INFO:tasks.workunit.client.0.smithi049.stdout:5/813: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/f118 x:0 0 0 2024-02-22T00:34:03.758 INFO:tasks.workunit.client.0.smithi049.stdout:1/844: sync 2024-02-22T00:34:03.760 INFO:tasks.workunit.client.0.smithi049.stdout:1/845: write d2/d8/d4c/d5e/f119 [484509,79228] 0 2024-02-22T00:34:03.763 INFO:tasks.workunit.client.0.smithi049.stdout:1/846: truncate d2/d8/db/d25/d62/dcc/dea/f106 527120 0 2024-02-22T00:34:03.765 INFO:tasks.workunit.client.0.smithi049.stdout:7/922: rename d1/df/d62/d7a/c137 to d1/d41/dae/c148 0 2024-02-22T00:34:03.777 INFO:tasks.workunit.client.0.smithi049.stdout:7/923: getdents d1/df/d62/d60/d7e/de6/d125 0 2024-02-22T00:34:03.780 INFO:tasks.workunit.client.0.smithi049.stdout:8/867: write d1/d2/da5/d15/d65/d6a/faa [680559,88369] 0 2024-02-22T00:34:03.781 INFO:tasks.workunit.client.0.smithi049.stdout:7/924: unlink d1/d49/l90 0 2024-02-22T00:34:03.784 INFO:tasks.workunit.client.0.smithi049.stdout:1/847: write d2/d8/db/d25/d40/d41/d5b/f7c [3882964,115001] 0 2024-02-22T00:34:03.785 INFO:tasks.workunit.client.0.smithi049.stdout:7/925: fdatasync d1/d41/d28/fa0 0 2024-02-22T00:34:03.789 INFO:tasks.workunit.client.0.smithi049.stdout:1/848: dread d2/d8/db/d25/d40/d41/d84/dab/ff9 [0,4194304] 0 2024-02-22T00:34:03.797 INFO:tasks.workunit.client.0.smithi049.stdout:8/868: rename d1/d2/da5/d15/d30/d4b/d51/lfe to d1/l12a 0 2024-02-22T00:34:03.808 INFO:tasks.workunit.client.0.smithi049.stdout:1/849: mkdir d2/d7b/ddd/d11b 0 2024-02-22T00:34:03.811 INFO:tasks.workunit.client.0.smithi049.stdout:1/850: mkdir d2/d8/db/d25/d40/d71/d11c 0 2024-02-22T00:34:03.814 INFO:tasks.workunit.client.0.smithi049.stdout:1/851: fsync d2/d8/db/d25/d40/d41/fb9 0 2024-02-22T00:34:03.815 INFO:tasks.workunit.client.0.smithi049.stdout:1/852: fsync d2/d8/d4c/fe0 0 2024-02-22T00:34:03.816 INFO:tasks.workunit.client.0.smithi049.stdout:8/869: rmdir d1/d2/da5/d15/d30/d4b 39 2024-02-22T00:34:03.820 INFO:tasks.workunit.client.0.smithi049.stdout:8/870: dread d1/d2/d5/d1b/d39/f54 [0,4194304] 0 2024-02-22T00:34:03.821 INFO:tasks.workunit.client.0.smithi049.stdout:8/871: chown d1/d2/d5/d1b/c5d 1577 1 2024-02-22T00:34:03.839 INFO:tasks.workunit.client.0.smithi049.stdout:8/872: dread d1/d2/da5/deb/f5f [0,4194304] 0 2024-02-22T00:34:03.840 INFO:tasks.workunit.client.0.smithi049.stdout:1/853: write d2/d8/db/f12 [5909075,7431] 0 2024-02-22T00:34:03.841 INFO:tasks.workunit.client.0.smithi049.stdout:8/873: mkdir d1/d2/d5/d1b/d39/d81/dfc/d12b 0 2024-02-22T00:34:03.845 INFO:tasks.workunit.client.0.smithi049.stdout:1/854: creat d2/d8/db/d25/d40/d71/d11c/f11d x:0 0 0 2024-02-22T00:34:03.848 INFO:tasks.workunit.client.0.smithi049.stdout:1/855: creat d2/d8/db/d25/d62/dcc/f11e x:0 0 0 2024-02-22T00:34:03.853 INFO:tasks.workunit.client.0.smithi049.stdout:1/856: rmdir d2/d8/da/d8a 39 2024-02-22T00:34:03.869 INFO:tasks.workunit.client.0.smithi049.stdout:1/857: dread d2/d8/db/d25/d40/d41/d68/d78/fc5 [0,4194304] 0 2024-02-22T00:34:03.871 INFO:tasks.workunit.client.0.smithi049.stdout:8/874: dwrite d1/d2/d5/d1b/f99 [0,4194304] 0 2024-02-22T00:34:03.871 INFO:tasks.workunit.client.0.smithi049.stdout:1/858: fdatasync d2/d8/da/f3f 0 2024-02-22T00:34:03.873 INFO:tasks.workunit.client.0.smithi049.stdout:1/859: write d2/d8/da/f103 [333438,39165] 0 2024-02-22T00:34:03.874 INFO:tasks.workunit.client.0.smithi049.stdout:1/860: chown d2/da0 0 1 2024-02-22T00:34:03.880 INFO:tasks.workunit.client.0.smithi049.stdout:8/875: dread d1/d2/d5/d1b/d39/f54 [0,4194304] 0 2024-02-22T00:34:03.884 INFO:tasks.workunit.client.0.smithi049.stdout:8/876: dwrite d1/d2/d5/d56/fa4 [0,4194304] 0 2024-02-22T00:34:03.894 INFO:tasks.workunit.client.0.smithi049.stdout:1/861: dread d2/d8/db/f1c [0,4194304] 0 2024-02-22T00:34:03.895 INFO:tasks.workunit.client.0.smithi049.stdout:1/862: rename d2/d8/db to d2/d8/db/d11f 22 2024-02-22T00:34:03.898 INFO:tasks.workunit.client.0.smithi049.stdout:1/863: write d2/d8/db/f12 [1040900,89101] 0 2024-02-22T00:34:03.904 INFO:tasks.workunit.client.0.smithi049.stdout:1/864: symlink d2/d8/db/d25/d40/d41/d5b/d75/dd0/d104/l120 0 2024-02-22T00:34:03.906 INFO:tasks.workunit.client.0.smithi049.stdout:1/865: truncate d2/d8/db/d25/d40/ffc 187008 0 2024-02-22T00:34:03.909 INFO:tasks.workunit.client.0.smithi049.stdout:1/866: mknod d2/d8/db/d25/dda/c121 0 2024-02-22T00:34:03.911 INFO:tasks.workunit.client.0.smithi049.stdout:1/867: fsync d2/d8/db/d25/d40/d41/d5b/d75/fee 0 2024-02-22T00:34:03.913 INFO:tasks.workunit.client.0.smithi049.stdout:1/868: truncate d2/d8/db/d25/d40/de8/ff3 673575 0 2024-02-22T00:34:03.967 INFO:tasks.workunit.client.0.smithi049.stdout:2/871: sync 2024-02-22T00:34:03.967 INFO:tasks.workunit.client.0.smithi049.stdout:6/883: sync 2024-02-22T00:34:03.968 INFO:tasks.workunit.client.0.smithi049.stdout:3/736: sync 2024-02-22T00:34:03.970 INFO:tasks.workunit.client.0.smithi049.stdout:6/884: mkdir d3/d36/d132 0 2024-02-22T00:34:03.972 INFO:tasks.workunit.client.0.smithi049.stdout:6/885: fdatasync d3/d64/d60/da0/fd6 0 2024-02-22T00:34:03.973 INFO:tasks.workunit.client.0.smithi049.stdout:3/737: rename d0/d14/d4d/d4e/d4f/d5b/d66/f7d to d0/d14/d4d/d4e/d4f/d5b/d66/fe2 0 2024-02-22T00:34:03.975 INFO:tasks.workunit.client.0.smithi049.stdout:2/872: getdents d2/d9/de/d3a/d6d 0 2024-02-22T00:34:03.976 INFO:tasks.workunit.client.0.smithi049.stdout:3/738: rmdir d0/d14/d4d/d4e/d56/d5a 39 2024-02-22T00:34:03.985 INFO:tasks.workunit.client.0.smithi049.stdout:3/739: write d0/d14/d4d/f36 [4955159,61290] 0 2024-02-22T00:34:03.988 INFO:tasks.workunit.client.0.smithi049.stdout:3/740: mknod d0/dd/d26/ce3 0 2024-02-22T00:34:03.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/873: dread d2/d9/de/d15/d1b/f1f [0,4194304] 0 2024-02-22T00:34:03.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/886: dread d3/d37/fa5 [0,4194304] 0 2024-02-22T00:34:03.994 INFO:tasks.workunit.client.0.smithi049.stdout:3/741: rename d0/f75 to d0/d59/d8f/fe4 0 2024-02-22T00:34:03.994 INFO:tasks.workunit.client.0.smithi049.stdout:6/887: chown d3/fa1 1 1 2024-02-22T00:34:03.996 INFO:tasks.workunit.client.0.smithi049.stdout:6/888: fdatasync d3/d16/d32/d7b/fe3 0 2024-02-22T00:34:03.998 INFO:tasks.workunit.client.0.smithi049.stdout:6/889: chown d3/dcd/d103/f12f 316806 1 2024-02-22T00:34:04.000 INFO:tasks.workunit.client.0.smithi049.stdout:6/890: mkdir d3/dcd/d133 0 2024-02-22T00:34:04.002 INFO:tasks.workunit.client.0.smithi049.stdout:3/742: dwrite d0/dd/d26/fa7 [0,4194304] 0 2024-02-22T00:34:04.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/891: mknod d3/dcd/d133/c134 0 2024-02-22T00:34:04.004 INFO:tasks.workunit.client.0.smithi049.stdout:3/743: fdatasync d0/dd/d1e/f78 0 2024-02-22T00:34:04.004 INFO:tasks.workunit.client.0.smithi049.stdout:6/892: chown d3/d36/d132 4505890 1 2024-02-22T00:34:04.007 INFO:tasks.workunit.client.0.smithi049.stdout:3/744: mkdir d0/d59/d87/de5 0 2024-02-22T00:34:04.007 INFO:tasks.workunit.client.0.smithi049.stdout:2/874: dread d2/dda/d5d/fe3 [0,4194304] 0 2024-02-22T00:34:04.008 INFO:tasks.workunit.client.0.smithi049.stdout:6/893: chown d3/d64/d59/d72/d92/d6c/f9f 1873 1 2024-02-22T00:34:04.012 INFO:tasks.workunit.client.0.smithi049.stdout:6/894: creat d3/d64/d5f/f135 x:0 0 0 2024-02-22T00:34:04.015 INFO:tasks.workunit.client.0.smithi049.stdout:3/745: link d0/d59/l3d d0/d14/d4d/d4e/d56/d5a/dc4/le6 0 2024-02-22T00:34:04.018 INFO:tasks.workunit.client.0.smithi049.stdout:3/746: mkdir d0/d14/de7 0 2024-02-22T00:34:04.019 INFO:tasks.workunit.client.0.smithi049.stdout:2/875: dwrite d2/d9/dd/d4d/d5a/fb2 [0,4194304] 0 2024-02-22T00:34:04.024 INFO:tasks.workunit.client.0.smithi049.stdout:3/747: mknod d0/d59/d87/de5/ce8 0 2024-02-22T00:34:04.024 INFO:tasks.workunit.client.0.smithi049.stdout:6/895: dread d3/d64/d59/d72/d92/ffe [0,4194304] 0 2024-02-22T00:34:04.027 INFO:tasks.workunit.client.0.smithi049.stdout:3/748: mkdir d0/d59/d87/de5/de9 0 2024-02-22T00:34:04.031 INFO:tasks.workunit.client.0.smithi049.stdout:6/896: unlink d3/d64/d59/d72/d92/l81 0 2024-02-22T00:34:04.034 INFO:tasks.workunit.client.0.smithi049.stdout:2/876: creat d2/d9/dd/d4d/da7/dd2/f13a x:0 0 0 2024-02-22T00:34:04.035 INFO:tasks.workunit.client.0.smithi049.stdout:6/897: stat d3/d36/d57/d75 0 2024-02-22T00:34:04.036 INFO:tasks.workunit.client.0.smithi049.stdout:1/869: dwrite d2/d8/db/d25/d40/d41/d68/f80 [0,4194304] 0 2024-02-22T00:34:04.039 INFO:tasks.workunit.client.0.smithi049.stdout:6/898: fdatasync d3/f43 0 2024-02-22T00:34:04.041 INFO:tasks.workunit.client.0.smithi049.stdout:1/870: dread - d2/d8/db/d25/d40/d4d/f64 zero size 2024-02-22T00:34:04.044 INFO:tasks.workunit.client.0.smithi049.stdout:2/877: creat d2/d9/dd/d4d/d5a/f13b x:0 0 0 2024-02-22T00:34:04.048 INFO:tasks.workunit.client.0.smithi049.stdout:1/871: mknod d2/d8/d4c/d5e/c122 0 2024-02-22T00:34:04.053 INFO:tasks.workunit.client.0.smithi049.stdout:1/872: write d2/d8/db/f1a [1342066,61012] 0 2024-02-22T00:34:04.056 INFO:tasks.workunit.client.0.smithi049.stdout:6/899: dread d3/d64/f35 [0,4194304] 0 2024-02-22T00:34:04.071 INFO:tasks.workunit.client.0.smithi049.stdout:1/873: dwrite d2/f30 [0,4194304] 0 2024-02-22T00:34:04.077 INFO:tasks.workunit.client.0.smithi049.stdout:1/874: chown d2/d8/d4c/d5e/ld3 216552 1 2024-02-22T00:34:04.077 INFO:tasks.workunit.client.0.smithi049.stdout:3/749: dread d0/dd/f9 [0,4194304] 0 2024-02-22T00:34:04.088 INFO:tasks.workunit.client.0.smithi049.stdout:6/900: dread d3/d36/d70/dcc/d4d/fbb [4194304,4194304] 0 2024-02-22T00:34:04.097 INFO:tasks.workunit.client.0.smithi049.stdout:6/901: creat d3/d64/d59/d12d/f136 x:0 0 0 2024-02-22T00:34:04.099 INFO:tasks.workunit.client.0.smithi049.stdout:3/750: dread d0/d14/d4d/d4e/d4f/d5b/d76/fa0 [0,4194304] 0 2024-02-22T00:34:04.101 INFO:tasks.workunit.client.0.smithi049.stdout:6/902: symlink d3/d16/d45/dd0/l137 0 2024-02-22T00:34:04.102 INFO:tasks.workunit.client.0.smithi049.stdout:6/903: fdatasync d3/d36/fbc 0 2024-02-22T00:34:04.107 INFO:tasks.workunit.client.0.smithi049.stdout:3/751: creat d0/d14/d4d/d4e/d4f/d5b/fea x:0 0 0 2024-02-22T00:34:04.107 INFO:tasks.workunit.client.0.smithi049.stdout:6/904: mkdir d3/d64/d59/d72/d92/d112/d138 0 2024-02-22T00:34:04.120 INFO:tasks.workunit.client.0.smithi049.stdout:3/752: rmdir d0/d59/d87/de5/de9 0 2024-02-22T00:34:04.121 INFO:tasks.workunit.client.0.smithi049.stdout:0/837: sync 2024-02-22T00:34:04.121 INFO:tasks.workunit.client.0.smithi049.stdout:9/962: sync 2024-02-22T00:34:04.121 INFO:tasks.workunit.client.0.smithi049.stdout:4/953: sync 2024-02-22T00:34:04.125 INFO:tasks.workunit.client.0.smithi049.stdout:6/905: dwrite d3/d36/ffb [0,4194304] 0 2024-02-22T00:34:04.127 INFO:tasks.workunit.client.0.smithi049.stdout:9/963: mknod d17/d1c/d25/dba/dff/c13c 0 2024-02-22T00:34:04.127 INFO:tasks.workunit.client.0.smithi049.stdout:0/838: creat d3/df/d48/f105 x:0 0 0 2024-02-22T00:34:04.128 INFO:tasks.workunit.client.0.smithi049.stdout:3/753: mkdir d0/dd/d26/d2e/d52/d6e/deb 0 2024-02-22T00:34:04.129 INFO:tasks.workunit.client.0.smithi049.stdout:4/954: creat d3/d8/d10/d43/d4d/db9/d92/f13e x:0 0 0 2024-02-22T00:34:04.130 INFO:tasks.workunit.client.0.smithi049.stdout:0/839: chown d3/df/d59/d60/fd2 32 1 2024-02-22T00:34:04.134 INFO:tasks.workunit.client.0.smithi049.stdout:4/955: creat d3/d8/d10/d43/f13f x:0 0 0 2024-02-22T00:34:04.135 INFO:tasks.workunit.client.0.smithi049.stdout:3/754: creat d0/d14/d4d/d4e/d56/fec x:0 0 0 2024-02-22T00:34:04.137 INFO:tasks.workunit.client.0.smithi049.stdout:0/840: truncate d3/df/d48/d63/fec 750527 0 2024-02-22T00:34:04.140 INFO:tasks.workunit.client.0.smithi049.stdout:6/906: dwrite d3/d36/d70/dcc/d4d/fee [0,4194304] 0 2024-02-22T00:34:04.142 INFO:tasks.workunit.client.0.smithi049.stdout:9/964: dread d17/d21/d47/d7a/f98 [0,4194304] 0 2024-02-22T00:34:04.145 INFO:tasks.workunit.client.0.smithi049.stdout:4/956: mknod d3/d8/d10/d43/d4d/db9/de7/d124/c140 0 2024-02-22T00:34:04.146 INFO:tasks.workunit.client.0.smithi049.stdout:6/907: symlink d3/d36/d57/d75/l139 0 2024-02-22T00:34:04.147 INFO:tasks.workunit.client.0.smithi049.stdout:0/841: dread d3/df/d59/d8e/fa7 [0,4194304] 0 2024-02-22T00:34:04.153 INFO:tasks.workunit.client.0.smithi049.stdout:4/957: dwrite d3/d8/f9e [0,4194304] 0 2024-02-22T00:34:04.155 INFO:tasks.workunit.client.0.smithi049.stdout:3/755: truncate d0/dd/d1e/f24 580285 0 2024-02-22T00:34:04.158 INFO:tasks.workunit.client.0.smithi049.stdout:6/908: creat d3/d36/d70/dcc/d4d/d8b/df7/d11d/f13a x:0 0 0 2024-02-22T00:34:04.159 INFO:tasks.workunit.client.0.smithi049.stdout:4/958: readlink d3/d8/l1d 0 2024-02-22T00:34:04.161 INFO:tasks.workunit.client.0.smithi049.stdout:0/842: dwrite d3/df/d48/d63/fca [0,4194304] 0 2024-02-22T00:34:04.163 INFO:tasks.workunit.client.0.smithi049.stdout:3/756: mknod d0/dd/d1e/ced 0 2024-02-22T00:34:04.171 INFO:tasks.workunit.client.0.smithi049.stdout:0/843: write d3/df/d7f/f93 [9263535,24923] 0 2024-02-22T00:34:04.172 INFO:tasks.workunit.client.0.smithi049.stdout:9/965: dwrite d17/d21/f43 [0,4194304] 0 2024-02-22T00:34:04.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/757: read d0/d14/d4d/d4e/d56/f98 [511924,7573] 0 2024-02-22T00:34:04.177 INFO:tasks.workunit.client.0.smithi049.stdout:3/758: write d0/fdd [1136057,124142] 0 2024-02-22T00:34:04.180 INFO:tasks.workunit.client.0.smithi049.stdout:0/844: mknod d3/df/d48/d91/c106 0 2024-02-22T00:34:04.182 INFO:tasks.workunit.client.0.smithi049.stdout:5/814: sync 2024-02-22T00:34:04.185 INFO:tasks.workunit.client.0.smithi049.stdout:9/966: getdents d17/d1c/d38 0 2024-02-22T00:34:04.187 INFO:tasks.workunit.client.0.smithi049.stdout:4/959: dwrite d3/d8/d10/d43/d4d/db9/d92/f13e [0,4194304] 0 2024-02-22T00:34:04.188 INFO:tasks.workunit.client.0.smithi049.stdout:0/845: read - d3/d1e/ddf/ff5 zero size 2024-02-22T00:34:04.188 INFO:tasks.workunit.client.0.smithi049.stdout:6/909: dread d3/f20 [0,4194304] 0 2024-02-22T00:34:04.195 INFO:tasks.workunit.client.0.smithi049.stdout:4/960: mknod d3/d8/d10/d12/dd8/c141 0 2024-02-22T00:34:04.196 INFO:tasks.workunit.client.0.smithi049.stdout:3/759: write d0/dd/d1e/f47 [866748,105882] 0 2024-02-22T00:34:04.196 INFO:tasks.workunit.client.0.smithi049.stdout:1/875: dwrite d2/d8/d4c/d5e/f107 [0,4194304] 0 2024-02-22T00:34:04.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/846: fsync d3/df/d59/d8c/fd4 0 2024-02-22T00:34:04.202 INFO:tasks.workunit.client.0.smithi049.stdout:9/967: unlink d17/d1c/d25/d39/c109 0 2024-02-22T00:34:04.202 INFO:tasks.workunit.client.0.smithi049.stdout:1/876: write d2/ff6 [657349,75541] 0 2024-02-22T00:34:04.207 INFO:tasks.workunit.client.0.smithi049.stdout:9/968: fsync d17/d1c/d8c/ffe 0 2024-02-22T00:34:04.207 INFO:tasks.workunit.client.0.smithi049.stdout:6/910: link d3/d64/l46 d3/d36/d70/dcc/d4d/l13b 0 2024-02-22T00:34:04.209 INFO:tasks.workunit.client.0.smithi049.stdout:3/760: mknod d0/d14/d4d/d4e/d56/d5a/cee 0 2024-02-22T00:34:04.209 INFO:tasks.workunit.client.0.smithi049.stdout:4/961: truncate d3/d8/d10/d45/f12a 63563 0 2024-02-22T00:34:04.210 INFO:tasks.workunit.client.0.smithi049.stdout:5/815: rename d0/d20/d50/d24/l80 to d0/d20/d84/da0/db6/dc3/d6f/d94/d74/l119 0 2024-02-22T00:34:04.211 INFO:tasks.workunit.client.0.smithi049.stdout:1/877: mknod d2/d8/db/d25/d40/d4d/c123 0 2024-02-22T00:34:04.212 INFO:tasks.workunit.client.0.smithi049.stdout:9/969: mkdir d17/d1c/d25/d13d 0 2024-02-22T00:34:04.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/761: write d0/dd/d6f/fde [993573,37945] 0 2024-02-22T00:34:04.213 INFO:tasks.workunit.client.0.smithi049.stdout:9/970: fdatasync f10 0 2024-02-22T00:34:04.213 INFO:tasks.workunit.client.0.smithi049.stdout:4/962: mkdir d3/d22/d49/d57/d142 0 2024-02-22T00:34:04.216 INFO:tasks.workunit.client.0.smithi049.stdout:4/963: unlink d3/ce4 0 2024-02-22T00:34:04.216 INFO:tasks.workunit.client.0.smithi049.stdout:5/816: write d0/d20/d50/d24/d3b/f49 [1846613,34859] 0 2024-02-22T00:34:04.217 INFO:tasks.workunit.client.0.smithi049.stdout:1/878: write d2/d8/da/f3f [2627502,68478] 0 2024-02-22T00:34:04.219 INFO:tasks.workunit.client.0.smithi049.stdout:3/762: symlink d0/d59/d87/de5/lef 0 2024-02-22T00:34:04.221 INFO:tasks.workunit.client.0.smithi049.stdout:9/971: creat d17/d21/d3c/de3/f13e x:0 0 0 2024-02-22T00:34:04.223 INFO:tasks.workunit.client.0.smithi049.stdout:4/964: mkdir d3/d22/d5c/d9a/dd9/d143 0 2024-02-22T00:34:04.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/878: sync 2024-02-22T00:34:04.223 INFO:tasks.workunit.client.0.smithi049.stdout:7/926: sync 2024-02-22T00:34:04.223 INFO:tasks.workunit.client.0.smithi049.stdout:8/877: sync 2024-02-22T00:34:04.228 INFO:tasks.workunit.client.0.smithi049.stdout:9/972: mknod d17/d1c/d25/d71/c13f 0 2024-02-22T00:34:04.229 INFO:tasks.workunit.client.0.smithi049.stdout:1/879: dread d2/d8/db/d25/d62/f9a [0,4194304] 0 2024-02-22T00:34:04.230 INFO:tasks.workunit.client.0.smithi049.stdout:4/965: fdatasync d3/d8/d10/d43/d4d/db9/f59 0 2024-02-22T00:34:04.232 INFO:tasks.workunit.client.0.smithi049.stdout:8/878: chown d1/l3a 9409 1 2024-02-22T00:34:04.233 INFO:tasks.workunit.client.0.smithi049.stdout:6/911: link d3/d36/d70/laa d3/d36/d70/dcc/d4d/d8b/df7/d11d/l13c 0 2024-02-22T00:34:04.236 INFO:tasks.workunit.client.0.smithi049.stdout:3/763: dwrite d0/d59/d87/fad [0,4194304] 0 2024-02-22T00:34:04.239 INFO:tasks.workunit.client.0.smithi049.stdout:0/847: truncate d3/df/d7f/f93 2125038 0 2024-02-22T00:34:04.241 INFO:tasks.workunit.client.0.smithi049.stdout:5/817: truncate d0/d20/d84/da0/db6/dc3/fee 896632 0 2024-02-22T00:34:04.241 INFO:tasks.workunit.client.0.smithi049.stdout:1/880: read d2/d8/db/f12 [6127800,1723] 0 2024-02-22T00:34:04.242 INFO:tasks.workunit.client.0.smithi049.stdout:4/966: mkdir d3/d22/d5c/d5e/d144 0 2024-02-22T00:34:04.242 INFO:tasks.workunit.client.0.smithi049.stdout:8/879: write d1/d2/da5/d15/f23 [4427277,122054] 0 2024-02-22T00:34:04.249 INFO:tasks.workunit.client.0.smithi049.stdout:9/973: symlink d17/d21/d85/d8d/d11a/l140 0 2024-02-22T00:34:04.251 INFO:tasks.workunit.client.0.smithi049.stdout:7/927: dwrite d1/d41/dae/fdc [0,4194304] 0 2024-02-22T00:34:04.253 INFO:tasks.workunit.client.0.smithi049.stdout:8/880: chown d1/d2/da5/d15/d30/cdd 0 1 2024-02-22T00:34:04.254 INFO:tasks.workunit.client.0.smithi049.stdout:6/912: write d3/d16/d32/f73 [1340084,34677] 0 2024-02-22T00:34:04.257 INFO:tasks.workunit.client.0.smithi049.stdout:1/881: symlink d2/d69/dce/df0/l124 0 2024-02-22T00:34:04.258 INFO:tasks.workunit.client.0.smithi049.stdout:9/974: mknod d17/d21/d85/d8d/d11a/c141 0 2024-02-22T00:34:04.259 INFO:tasks.workunit.client.0.smithi049.stdout:2/879: dread d2/d9/de/d3a/fb4 [0,4194304] 0 2024-02-22T00:34:04.259 INFO:tasks.workunit.client.0.smithi049.stdout:8/881: stat d1/d2/da5/d15/lc7 0 2024-02-22T00:34:04.263 INFO:tasks.workunit.client.0.smithi049.stdout:4/967: mknod d3/d8/d10/d12/d3f/c145 0 2024-02-22T00:34:04.267 INFO:tasks.workunit.client.0.smithi049.stdout:1/882: chown d2/d8/db/d25/d62/fb5 1 1 2024-02-22T00:34:04.267 INFO:tasks.workunit.client.0.smithi049.stdout:6/913: write d3/d36/d70/dcc/d4d/fee [2890691,98246] 0 2024-02-22T00:34:04.269 INFO:tasks.workunit.client.0.smithi049.stdout:5/818: creat d0/d20/d50/f11a x:0 0 0 2024-02-22T00:34:04.269 INFO:tasks.workunit.client.0.smithi049.stdout:9/975: unlink d17/d21/d3c/f59 0 2024-02-22T00:34:04.270 INFO:tasks.workunit.client.0.smithi049.stdout:8/882: write d1/d2/d5/d1b/f10e [38504,87491] 0 2024-02-22T00:34:04.272 INFO:tasks.workunit.client.0.smithi049.stdout:4/968: stat d3/d22/d5c/d9a/ld0 0 2024-02-22T00:34:04.272 INFO:tasks.workunit.client.0.smithi049.stdout:3/764: dwrite d0/d14/f74 [0,4194304] 0 2024-02-22T00:34:04.279 INFO:tasks.workunit.client.0.smithi049.stdout:7/928: dread d1/d41/dae/fb9 [0,4194304] 0 2024-02-22T00:34:04.279 INFO:tasks.workunit.client.0.smithi049.stdout:3/765: chown d0/dd/d26/d63/fb7 127320507 1 2024-02-22T00:34:04.285 INFO:tasks.workunit.client.0.smithi049.stdout:9/976: getdents d17/d1c/d25/d39/d11f 0 2024-02-22T00:34:04.286 INFO:tasks.workunit.client.0.smithi049.stdout:7/929: dread - d1/d49/d5a/d13a/f13e zero size 2024-02-22T00:34:04.287 INFO:tasks.workunit.client.0.smithi049.stdout:6/914: mkdir d3/d64/d60/d13d 0 2024-02-22T00:34:04.288 INFO:tasks.workunit.client.0.smithi049.stdout:4/969: mkdir d3/d22/d5c/d35/d146 0 2024-02-22T00:34:04.290 INFO:tasks.workunit.client.0.smithi049.stdout:3/766: stat d0/d14/d4d/c79 0 2024-02-22T00:34:04.292 INFO:tasks.workunit.client.0.smithi049.stdout:8/883: mkdir d1/d2/d5/d12c 0 2024-02-22T00:34:04.294 INFO:tasks.workunit.client.0.smithi049.stdout:2/880: rename d2/d9/de/d10/d2e/d42/cc7 to d2/d9/de/d10/d2e/d42/c13c 0 2024-02-22T00:34:04.294 INFO:tasks.workunit.client.0.smithi049.stdout:5/819: truncate d0/d20/d84/da0/db6/dc3/d70/db1/d9e/f101 1140117 0 2024-02-22T00:34:04.296 INFO:tasks.workunit.client.0.smithi049.stdout:7/930: read d1/df/d62/f30 [1134458,112112] 0 2024-02-22T00:34:04.310 INFO:tasks.workunit.client.0.smithi049.stdout:1/883: dwrite d2/d8/db/d25/d40/d41/d5b/f7c [4194304,4194304] 0 2024-02-22T00:34:04.310 INFO:tasks.workunit.client.0.smithi049.stdout:6/915: mkdir d3/d36/d70/dcc/d4d/d13e 0 2024-02-22T00:34:04.314 INFO:tasks.workunit.client.0.smithi049.stdout:0/848: dwrite d3/df/d7f/f93 [0,4194304] 0 2024-02-22T00:34:04.316 INFO:tasks.workunit.client.0.smithi049.stdout:1/884: fdatasync d2/d8/db/ff8 0 2024-02-22T00:34:04.318 INFO:tasks.workunit.client.0.smithi049.stdout:9/977: dwrite d17/d1c/d25/dba/def/f120 [0,4194304] 0 2024-02-22T00:34:04.321 INFO:tasks.workunit.client.0.smithi049.stdout:0/849: creat d3/df/d48/d63/f107 x:0 0 0 2024-02-22T00:34:04.321 INFO:tasks.workunit.client.0.smithi049.stdout:4/970: truncate d3/d8/d10/d12/d3f/fa9 2194074 0 2024-02-22T00:34:04.323 INFO:tasks.workunit.client.0.smithi049.stdout:7/931: write d1/df/d62/d60/d7e/de6/ded/f119 [3445096,117635] 0 2024-02-22T00:34:04.324 INFO:tasks.workunit.client.0.smithi049.stdout:1/885: write d2/d8/d4c/d5e/f107 [1488736,51485] 0 2024-02-22T00:34:04.329 INFO:tasks.workunit.client.0.smithi049.stdout:2/881: creat d2/dda/d63/f13d x:0 0 0 2024-02-22T00:34:04.329 INFO:tasks.workunit.client.0.smithi049.stdout:8/884: dwrite d1/d2/d5/d56/fa4 [0,4194304] 0 2024-02-22T00:34:04.331 INFO:tasks.workunit.client.0.smithi049.stdout:6/916: fsync d3/d16/f1c 0 2024-02-22T00:34:04.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/885: chown d1/d2/db7/d100 37649412 1 2024-02-22T00:34:04.347 INFO:tasks.workunit.client.0.smithi049.stdout:5/820: mkdir d0/d20/d84/da0/db6/dc3/d6f/d94/d11b 0 2024-02-22T00:34:04.348 INFO:tasks.workunit.client.0.smithi049.stdout:0/850: symlink d3/df/d48/d6f/d90/l108 0 2024-02-22T00:34:04.350 INFO:tasks.workunit.client.0.smithi049.stdout:3/767: getdents d0/d14 0 2024-02-22T00:34:04.351 INFO:tasks.workunit.client.0.smithi049.stdout:5/821: dread - d0/d20/dad/daf/fe5 zero size 2024-02-22T00:34:04.353 INFO:tasks.workunit.client.0.smithi049.stdout:4/971: mkdir d3/d8/d10/d43/d4d/db9/d8a/d48/d89/d147 0 2024-02-22T00:34:04.353 INFO:tasks.workunit.client.0.smithi049.stdout:6/917: chown d3/d16/d3b/c5c 316 1 2024-02-22T00:34:04.355 INFO:tasks.workunit.client.0.smithi049.stdout:2/882: creat d2/d9/d17/dd6/f13e x:0 0 0 2024-02-22T00:34:04.355 INFO:tasks.workunit.client.0.smithi049.stdout:8/886: dread d1/d2/dd7/fe7 [0,4194304] 0 2024-02-22T00:34:04.355 INFO:tasks.workunit.client.0.smithi049.stdout:4/972: dread - d3/f12f zero size 2024-02-22T00:34:04.358 INFO:tasks.workunit.client.0.smithi049.stdout:3/768: rmdir d0/d14/d4d/d4e/d56/d5a/dbf 39 2024-02-22T00:34:04.358 INFO:tasks.workunit.client.0.smithi049.stdout:6/918: stat d3/d64/d59/d72/d92/db1/db3/d12e 0 2024-02-22T00:34:04.359 INFO:tasks.workunit.client.0.smithi049.stdout:2/883: chown d2/d9/de/l126 892 1 2024-02-22T00:34:04.360 INFO:tasks.workunit.client.0.smithi049.stdout:4/973: symlink d3/d22/df0/df4/l148 0 2024-02-22T00:34:04.361 INFO:tasks.workunit.client.0.smithi049.stdout:6/919: fsync d3/d64/d60/f9e 0 2024-02-22T00:34:04.362 INFO:tasks.workunit.client.0.smithi049.stdout:9/978: dread d17/d21/d4e/d89/d94/df0/f7c [0,4194304] 0 2024-02-22T00:34:04.363 INFO:tasks.workunit.client.0.smithi049.stdout:5/822: creat d0/d20/d84/da0/db6/dc3/d6f/d94/f11c x:0 0 0 2024-02-22T00:34:04.364 INFO:tasks.workunit.client.0.smithi049.stdout:3/769: fdatasync d0/d14/d4d/d4e/d56/d5a/dc4/fdb 0 2024-02-22T00:34:04.364 INFO:tasks.workunit.client.0.smithi049.stdout:4/974: read d3/d8/d10/d43/d4d/db9/d8a/f8b [385696,40844] 0 2024-02-22T00:34:04.365 INFO:tasks.workunit.client.0.smithi049.stdout:2/884: chown d2/d9/de/d3a/c50 48964756 1 2024-02-22T00:34:04.367 INFO:tasks.workunit.client.0.smithi049.stdout:6/920: chown d3/d36/d70/dcc/d4d/l127 2454 1 2024-02-22T00:34:04.367 INFO:tasks.workunit.client.0.smithi049.stdout:9/979: creat d17/d21/d85/d8d/f142 x:0 0 0 2024-02-22T00:34:04.369 INFO:tasks.workunit.client.0.smithi049.stdout:4/975: truncate d3/d8/d10/d39/f9f 4292690 0 2024-02-22T00:34:04.372 INFO:tasks.workunit.client.0.smithi049.stdout:2/885: mkdir d2/d9/dd/d4d/d5a/d13f 0 2024-02-22T00:34:04.376 INFO:tasks.workunit.client.0.smithi049.stdout:3/770: dread d0/d14/f57 [0,4194304] 0 2024-02-22T00:34:04.378 INFO:tasks.workunit.client.0.smithi049.stdout:2/886: getdents d2/d9/dd 0 2024-02-22T00:34:04.379 INFO:tasks.workunit.client.0.smithi049.stdout:9/980: dwrite d17/d1c/d25/d71/da3/fd0 [0,4194304] 0 2024-02-22T00:34:04.381 INFO:tasks.workunit.client.0.smithi049.stdout:5/823: write d0/d20/d50/d24/f75 [4953258,94267] 0 2024-02-22T00:34:04.391 INFO:tasks.workunit.client.0.smithi049.stdout:2/887: mkdir d2/d9/de/d3a/d6d/d140 0 2024-02-22T00:34:04.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/886: creat d2/d8/db/d25/d40/d71/f125 x:0 0 0 2024-02-22T00:34:04.391 INFO:tasks.workunit.client.0.smithi049.stdout:4/976: truncate d3/d8/d10/d12/d3f/fa9 2930339 0 2024-02-22T00:34:04.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/851: creat d3/df/d48/d63/de5/f109 x:0 0 0 2024-02-22T00:34:04.391 INFO:tasks.workunit.client.0.smithi049.stdout:9/981: creat d17/d21/d47/d7a/f143 x:0 0 0 2024-02-22T00:34:04.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/887: read - d2/d8/db/d25/d40/d71/f125 zero size 2024-02-22T00:34:04.393 INFO:tasks.workunit.client.0.smithi049.stdout:7/932: symlink d1/d49/d5a/l149 0 2024-02-22T00:34:04.394 INFO:tasks.workunit.client.0.smithi049.stdout:5/824: mknod d0/d20/d84/da0/db6/dc3/d6f/d94/d74/c11d 0 2024-02-22T00:34:04.394 INFO:tasks.workunit.client.0.smithi049.stdout:8/887: write d1/d4c/dda/f106 [981968,66387] 0 2024-02-22T00:34:04.397 INFO:tasks.workunit.client.0.smithi049.stdout:0/852: mkdir d3/df/d48/d63/de5/d10a 0 2024-02-22T00:34:04.399 INFO:tasks.workunit.client.0.smithi049.stdout:2/888: link d2/d9/de/d10/d2e/d42/d80/d108/c120 d2/d9/dd/c141 0 2024-02-22T00:34:04.399 INFO:tasks.workunit.client.0.smithi049.stdout:5/825: stat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/fe1 0 2024-02-22T00:34:04.400 INFO:tasks.workunit.client.0.smithi049.stdout:1/888: unlink d2/d8/d4c/f10e 0 2024-02-22T00:34:04.401 INFO:tasks.workunit.client.0.smithi049.stdout:8/888: write d1/d2/da5/d15/d30/d36/f126 [317438,130497] 0 2024-02-22T00:34:04.401 INFO:tasks.workunit.client.0.smithi049.stdout:9/982: getdents d17/d21/d3c/dbf/de0/d131 0 2024-02-22T00:34:04.404 INFO:tasks.workunit.client.0.smithi049.stdout:4/977: truncate d3/d8/f105 330266 0 2024-02-22T00:34:04.405 INFO:tasks.workunit.client.0.smithi049.stdout:2/889: write d2/d9/de/d3a/f54 [1033299,49389] 0 2024-02-22T00:34:04.408 INFO:tasks.workunit.client.0.smithi049.stdout:0/853: creat d3/df/d59/d60/de9/f10b x:0 0 0 2024-02-22T00:34:04.409 INFO:tasks.workunit.client.0.smithi049.stdout:9/983: mkdir d17/d21/d47/d5d/db4/d144 0 2024-02-22T00:34:04.412 INFO:tasks.workunit.client.0.smithi049.stdout:7/933: dwrite d1/d49/f53 [0,4194304] 0 2024-02-22T00:34:04.413 INFO:tasks.workunit.client.0.smithi049.stdout:1/889: dread - d2/d8/db/d25/d40/d41/d68/d78/fef zero size 2024-02-22T00:34:04.417 INFO:tasks.workunit.client.0.smithi049.stdout:2/890: write d2/d9/f6f [2547438,123207] 0 2024-02-22T00:34:04.419 INFO:tasks.workunit.client.0.smithi049.stdout:4/978: dread d3/d22/d5c/d9a/fa4 [0,4194304] 0 2024-02-22T00:34:04.419 INFO:tasks.workunit.client.0.smithi049.stdout:9/984: read d17/d21/d85/d8d/f92 [47471,96739] 0 2024-02-22T00:34:04.421 INFO:tasks.workunit.client.0.smithi049.stdout:9/985: chown d17/d1c/d25/d71/d73/f117 4828692 1 2024-02-22T00:34:04.422 INFO:tasks.workunit.client.0.smithi049.stdout:9/986: chown d17/d21/d4e/f10c 810786449 1 2024-02-22T00:34:04.425 INFO:tasks.workunit.client.0.smithi049.stdout:8/889: link d1/d2/da5/d15/d10f/f115 d1/d4c/dbf/f12d 0 2024-02-22T00:34:04.426 INFO:tasks.workunit.client.0.smithi049.stdout:4/979: chown d3/d22/d5c/da5/da8/f139 6731119 1 2024-02-22T00:34:04.426 INFO:tasks.workunit.client.0.smithi049.stdout:9/987: chown d17/d1c/d8c/db0/de9/c136 368282831 1 2024-02-22T00:34:04.426 INFO:tasks.workunit.client.0.smithi049.stdout:5/826: dread d0/d20/d84/da0/db6/dc3/fac [0,4194304] 0 2024-02-22T00:34:04.427 INFO:tasks.workunit.client.0.smithi049.stdout:2/891: rmdir d2/d9/dd/d4d/d72/da0 39 2024-02-22T00:34:04.428 INFO:tasks.workunit.client.0.smithi049.stdout:4/980: write d3/fdb [252168,42113] 0 2024-02-22T00:34:04.429 INFO:tasks.workunit.client.0.smithi049.stdout:7/934: rename d1/d41/d28/fa0 to d1/d41/d55/f14a 0 2024-02-22T00:34:04.432 INFO:tasks.workunit.client.0.smithi049.stdout:2/892: fdatasync d2/d9/de/fc0 0 2024-02-22T00:34:04.435 INFO:tasks.workunit.client.0.smithi049.stdout:2/893: readlink d2/l75 0 2024-02-22T00:34:04.435 INFO:tasks.workunit.client.0.smithi049.stdout:5/827: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/f11e x:0 0 0 2024-02-22T00:34:04.437 INFO:tasks.workunit.client.0.smithi049.stdout:2/894: chown d2/dda/d5d/c69 19051 1 2024-02-22T00:34:04.437 INFO:tasks.workunit.client.0.smithi049.stdout:5/828: fsync d0/d20/d50/f38 0 2024-02-22T00:34:04.439 INFO:tasks.workunit.client.0.smithi049.stdout:8/890: dread d1/d2/d5/d1b/d39/f54 [0,4194304] 0 2024-02-22T00:34:04.441 INFO:tasks.workunit.client.0.smithi049.stdout:5/829: write d0/f7e [1996721,110586] 0 2024-02-22T00:34:04.442 INFO:tasks.workunit.client.0.smithi049.stdout:9/988: dwrite d17/f51 [0,4194304] 0 2024-02-22T00:34:04.442 INFO:tasks.workunit.client.0.smithi049.stdout:7/935: creat d1/d49/d11d/d132/f14b x:0 0 0 2024-02-22T00:34:04.445 INFO:tasks.workunit.client.0.smithi049.stdout:8/891: chown d1/d2/d5/ce9 23793 1 2024-02-22T00:34:04.447 INFO:tasks.workunit.client.0.smithi049.stdout:4/981: dread d3/d22/d49/d57/fd3 [0,4194304] 0 2024-02-22T00:34:04.448 INFO:tasks.workunit.client.0.smithi049.stdout:7/936: mkdir d1/d41/d55/d14c 0 2024-02-22T00:34:04.449 INFO:tasks.workunit.client.0.smithi049.stdout:5/830: mkdir d0/d20/dc5/df5/d11f 0 2024-02-22T00:34:04.450 INFO:tasks.workunit.client.0.smithi049.stdout:2/895: getdents d2/d9/de/d15/d1b/dc4 0 2024-02-22T00:34:04.454 INFO:tasks.workunit.client.0.smithi049.stdout:8/892: fsync d1/d2/da5/d15/d30/d36/d52/daf/dcb/fe6 0 2024-02-22T00:34:04.456 INFO:tasks.workunit.client.0.smithi049.stdout:4/982: rename d3/d8/d10/d43/d4d/db9/d8a/laf to d3/d22/d5c/d5e/l149 0 2024-02-22T00:34:04.456 INFO:tasks.workunit.client.0.smithi049.stdout:9/989: creat d17/d21/d85/f145 x:0 0 0 2024-02-22T00:34:04.457 INFO:tasks.workunit.client.0.smithi049.stdout:2/896: symlink d2/d9/de/d10/d59/l142 0 2024-02-22T00:34:04.457 INFO:tasks.workunit.client.0.smithi049.stdout:9/990: readlink d17/d21/d85/l86 0 2024-02-22T00:34:04.457 INFO:tasks.workunit.client.0.smithi049.stdout:5/831: mknod d0/d26/c120 0 2024-02-22T00:34:04.461 INFO:tasks.workunit.client.0.smithi049.stdout:8/893: read - d1/d2/da5/d15/d30/d36/dcd/ff6 zero size 2024-02-22T00:34:04.461 INFO:tasks.workunit.client.0.smithi049.stdout:4/983: fsync d3/d8/d10/d43/d4d/db9/d8a/f129 0 2024-02-22T00:34:04.462 INFO:tasks.workunit.client.0.smithi049.stdout:9/991: mknod d17/d21/d3c/de3/c146 0 2024-02-22T00:34:04.465 INFO:tasks.workunit.client.0.smithi049.stdout:5/832: rename d0/d20/d50/d24/f75 to d0/d20/d50/d24/d54/f121 0 2024-02-22T00:34:04.467 INFO:tasks.workunit.client.0.smithi049.stdout:9/992: rename d17/d1c/d25/dba/def/ff2 to d17/d21/d3c/de3/f147 0 2024-02-22T00:34:04.468 INFO:tasks.workunit.client.0.smithi049.stdout:4/984: mknod d3/d8/d10/d45/dcd/c14a 0 2024-02-22T00:34:04.469 INFO:tasks.workunit.client.0.smithi049.stdout:9/993: write d17/d21/d85/d8d/f92 [2303042,26608] 0 2024-02-22T00:34:04.471 INFO:tasks.workunit.client.0.smithi049.stdout:5/833: readlink d0/d20/d84/da0/db6/dc3/d6f/d94/le6 0 2024-02-22T00:34:04.475 INFO:tasks.workunit.client.0.smithi049.stdout:4/985: unlink d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/d130/ffc 0 2024-02-22T00:34:04.477 INFO:tasks.workunit.client.0.smithi049.stdout:5/834: fdatasync d0/d20/dad/f8d 0 2024-02-22T00:34:04.478 INFO:tasks.workunit.client.0.smithi049.stdout:2/897: write d2/d9/dd/d4d/da7/f11a [3607053,23091] 0 2024-02-22T00:34:04.483 INFO:tasks.workunit.client.0.smithi049.stdout:2/898: write d2/d9/d17/fb1 [4025101,57919] 0 2024-02-22T00:34:04.485 INFO:tasks.workunit.client.0.smithi049.stdout:2/899: stat d2/d9/de/d10/d2e/fd7 0 2024-02-22T00:34:04.488 INFO:tasks.workunit.client.0.smithi049.stdout:4/986: link d3/d22/d5c/d9a/c109 d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/d11c/c14b 0 2024-02-22T00:34:04.489 INFO:tasks.workunit.client.0.smithi049.stdout:5/835: write d0/d20/d50/f38 [1811579,27076] 0 2024-02-22T00:34:04.490 INFO:tasks.workunit.client.0.smithi049.stdout:9/994: dread d17/d1c/d25/dba/f11e [0,4194304] 0 2024-02-22T00:34:04.496 INFO:tasks.workunit.client.0.smithi049.stdout:4/987: rename d3/d22/d49/lfb to d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/d130/l14c 0 2024-02-22T00:34:04.499 INFO:tasks.workunit.client.0.smithi049.stdout:1/890: dwrite d2/d8/db/d25/d40/d41/d68/d78/f92 [0,4194304] 0 2024-02-22T00:34:04.505 INFO:tasks.workunit.client.0.smithi049.stdout:1/891: symlink d2/d8/d4c/d5e/l126 0 2024-02-22T00:34:04.506 INFO:tasks.workunit.client.0.smithi049.stdout:0/854: write d3/df/d17/d50/fc2 [203688,129623] 0 2024-02-22T00:34:04.507 INFO:tasks.workunit.client.0.smithi049.stdout:9/995: dwrite d17/d21/f46 [0,4194304] 0 2024-02-22T00:34:04.512 INFO:tasks.workunit.client.0.smithi049.stdout:5/836: dwrite d0/d20/d84/da0/db6/dc3/d7c/f96 [0,4194304] 0 2024-02-22T00:34:04.516 INFO:tasks.workunit.client.0.smithi049.stdout:4/988: link d3/d8/d10/d43/d4d/f82 d3/d8/d10/d43/d4d/db9/d8a/d48/d89/db2/df1/d125/f14d 0 2024-02-22T00:34:04.516 INFO:tasks.workunit.client.0.smithi049.stdout:9/996: rmdir d17/d21/d3c/dbf 39 2024-02-22T00:34:04.517 INFO:tasks.workunit.client.0.smithi049.stdout:7/937: dwrite d1/d41/d55/d89/fc6 [0,4194304] 0 2024-02-22T00:34:04.519 INFO:tasks.workunit.client.0.smithi049.stdout:1/892: truncate d2/d8/db/d25/d40/d41/d84/f9c 4730601 0 2024-02-22T00:34:04.522 INFO:tasks.workunit.client.0.smithi049.stdout:7/938: write d1/df/d62/f12f [343649,4824] 0 2024-02-22T00:34:04.523 INFO:tasks.workunit.client.0.smithi049.stdout:5/837: symlink d0/d20/dc5/df5/d11f/l122 0 2024-02-22T00:34:04.526 INFO:tasks.workunit.client.0.smithi049.stdout:0/855: dwrite d3/df/d48/d6f/d7a/f82 [0,4194304] 0 2024-02-22T00:34:04.528 INFO:tasks.workunit.client.0.smithi049.stdout:4/989: creat d3/d8/f14e x:0 0 0 2024-02-22T00:34:04.535 INFO:tasks.workunit.client.0.smithi049.stdout:5/838: unlink d0/d20/d84/da0/db6/dc3/d6f/d94/l7 0 2024-02-22T00:34:04.535 INFO:tasks.workunit.client.0.smithi049.stdout:7/939: truncate d1/df/d62/d1c/d24/d2e/df0/ffb 206519 0 2024-02-22T00:34:04.535 INFO:tasks.workunit.client.0.smithi049.stdout:1/893: dread d2/da0/fd8 [0,4194304] 0 2024-02-22T00:34:04.537 INFO:tasks.workunit.client.0.smithi049.stdout:5/839: unlink d0/d20/l35 0 2024-02-22T00:34:04.543 INFO:tasks.workunit.client.0.smithi049.stdout:0/856: dwrite d3/f73 [0,4194304] 0 2024-02-22T00:34:04.543 INFO:tasks.workunit.client.0.smithi049.stdout:5/840: mkdir d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/df7/d123 0 2024-02-22T00:34:04.544 INFO:tasks.workunit.client.0.smithi049.stdout:7/940: mkdir d1/d14d 0 2024-02-22T00:34:04.545 INFO:tasks.workunit.client.0.smithi049.stdout:7/941: stat d1/df/d62/f30 0 2024-02-22T00:34:04.546 INFO:tasks.workunit.client.0.smithi049.stdout:5/841: creat d0/d20/dad/daf/f124 x:0 0 0 2024-02-22T00:34:04.547 INFO:tasks.workunit.client.0.smithi049.stdout:1/894: getdents d2/d8/db/d25/d40/d41/d100/d116 0 2024-02-22T00:34:04.548 INFO:tasks.workunit.client.0.smithi049.stdout:7/942: creat d1/d49/d11d/d132/f14e x:0 0 0 2024-02-22T00:34:04.549 INFO:tasks.workunit.client.0.smithi049.stdout:5/842: truncate d0/d20/d50/d24/f104 22465 0 2024-02-22T00:34:04.550 INFO:tasks.workunit.client.0.smithi049.stdout:7/943: write d1/d49/d5a/d112/d122/fc3 [470780,44607] 0 2024-02-22T00:34:04.554 INFO:tasks.workunit.client.0.smithi049.stdout:5/843: creat d0/d20/d84/da0/db6/dc3/d70/db1/dbe/f125 x:0 0 0 2024-02-22T00:34:04.555 INFO:tasks.workunit.client.0.smithi049.stdout:9/997: write d17/d1c/d25/d39/f3a [1437556,109673] 0 2024-02-22T00:34:04.556 INFO:tasks.workunit.client.0.smithi049.stdout:7/944: symlink d1/d49/d5a/d13a/l14f 0 2024-02-22T00:34:04.559 INFO:tasks.workunit.client.0.smithi049.stdout:5/844: mknod d0/d20/d84/da0/db6/dc3/d6f/da8/c126 0 2024-02-22T00:34:04.559 INFO:tasks.workunit.client.0.smithi049.stdout:4/990: truncate d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/ddd/ffd 967590 0 2024-02-22T00:34:04.561 INFO:tasks.workunit.client.0.smithi049.stdout:9/998: dread - d17/d21/d85/fed zero size 2024-02-22T00:34:04.562 INFO:tasks.workunit.client.0.smithi049.stdout:4/991: chown d3/d22/d5c/d5e/c96 804 1 2024-02-22T00:34:04.562 INFO:tasks.workunit.client.0.smithi049.stdout:7/945: creat d1/df/d62/d60/f150 x:0 0 0 2024-02-22T00:34:04.568 INFO:tasks.workunit.client.0.smithi049.stdout:7/946: mknod d1/d41/d55/d89/c151 0 2024-02-22T00:34:04.569 INFO:tasks.workunit.client.0.smithi049.stdout:5/845: dwrite d0/d20/d84/da0/db6/dc3/d70/db1/d9e/f101 [0,4194304] 0 2024-02-22T00:34:04.585 INFO:tasks.workunit.client.0.smithi049.stdout:1/895: dwrite d2/d8/da/f61 [0,4194304] 0 2024-02-22T00:34:04.610 INFO:tasks.workunit.client.0.smithi049.stdout:1/896: dwrite d2/d8/db/d25/d40/d41/d68/feb [0,4194304] 0 2024-02-22T00:34:04.615 INFO:tasks.workunit.client.0.smithi049.stdout:1/897: creat d2/d8/db/d25/d40/d41/d5b/d75/dd0/d104/f127 x:0 0 0 2024-02-22T00:34:04.616 INFO:tasks.workunit.client.0.smithi049.stdout:1/898: write d2/d8/db/d25/f48 [4001963,6090] 0 2024-02-22T00:34:04.621 INFO:tasks.workunit.client.0.smithi049.stdout:1/899: rename d2/d8/db/d25/d40/d41/f60 to d2/d8/db/f128 0 2024-02-22T00:34:04.629 INFO:tasks.workunit.client.0.smithi049.stdout:4/992: fsync d3/d22/d49/f85 0 2024-02-22T00:34:04.631 INFO:tasks.workunit.client.0.smithi049.stdout:1/900: link d2/d8/db/d25/d40/le2 d2/d7b/l129 0 2024-02-22T00:34:04.631 INFO:tasks.workunit.client.0.smithi049.stdout:9/999: dread d17/f1f [0,4194304] 0 2024-02-22T00:34:04.636 INFO:tasks.workunit.client.0.smithi049.stdout:5/846: unlink d0/d20/d84/da0/db6/dc3/d6f/d94/c4a 0 2024-02-22T00:34:04.642 INFO:tasks.workunit.client.0.smithi049.stdout:1/901: dwrite d2/d8/da/d8a/fca [4194304,4194304] 0 2024-02-22T00:34:04.648 INFO:tasks.workunit.client.0.smithi049.stdout:1/902: dread d2/d8/db/d25/d40/d41/d68/f80 [0,4194304] 0 2024-02-22T00:34:04.653 INFO:tasks.workunit.client.0.smithi049.stdout:5/847: dread d0/f32 [0,4194304] 0 2024-02-22T00:34:04.654 INFO:tasks.workunit.client.0.smithi049.stdout:1/903: rename d2/d8/db/d25/l9d to d2/d69/dc4/l12a 0 2024-02-22T00:34:04.655 INFO:tasks.workunit.client.0.smithi049.stdout:1/904: chown d2/d69/dce 10871 1 2024-02-22T00:34:04.659 INFO:tasks.workunit.client.0.smithi049.stdout:1/905: chown d2/f31 6114 1 2024-02-22T00:34:04.664 INFO:tasks.workunit.client.0.smithi049.stdout:1/906: dread d2/d8/fb8 [0,4194304] 0 2024-02-22T00:34:04.683 INFO:tasks.workunit.client.0.smithi049.stdout:1/907: dread d2/f4 [0,4194304] 0 2024-02-22T00:34:04.686 INFO:tasks.workunit.client.0.smithi049.stdout:5/848: mknod d0/d20/dad/c127 0 2024-02-22T00:34:04.686 INFO:tasks.workunit.client.0.smithi049.stdout:1/908: dread d2/d8/db/d25/d40/d41/d68/f80 [0,4194304] 0 2024-02-22T00:34:04.691 INFO:tasks.workunit.client.0.smithi049.stdout:5/849: getdents d0/d20/d84 0 2024-02-22T00:34:04.693 INFO:tasks.workunit.client.0.smithi049.stdout:5/850: creat d0/d20/dad/daf/f128 x:0 0 0 2024-02-22T00:34:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:4/993: creat d3/d22/d49/f14f x:0 0 0 2024-02-22T00:34:04.718 INFO:tasks.workunit.client.0.smithi049.stdout:1/909: mkdir d2/d8/db/d25/d40/d71/d11c/d12b 0 2024-02-22T00:34:04.719 INFO:tasks.workunit.client.0.smithi049.stdout:5/851: mknod d0/d20/d84/da0/db6/dc3/d70/db1/c129 0 2024-02-22T00:34:04.721 INFO:tasks.workunit.client.0.smithi049.stdout:4/994: creat d3/d22/d5c/da5/f150 x:0 0 0 2024-02-22T00:34:04.721 INFO:tasks.workunit.client.0.smithi049.stdout:1/910: truncate d2/d8/db/f2d 1125332 0 2024-02-22T00:34:04.721 INFO:tasks.workunit.client.0.smithi049.stdout:5/852: fsync d0/d20/d50/d24/f5a 0 2024-02-22T00:34:04.723 INFO:tasks.workunit.client.0.smithi049.stdout:5/853: stat d0/d20/dc5/df5 0 2024-02-22T00:34:04.725 INFO:tasks.workunit.client.0.smithi049.stdout:1/911: creat d2/d8/db/d25/d40/d41/d5b/d87/f12c x:0 0 0 2024-02-22T00:34:04.726 INFO:tasks.workunit.client.0.smithi049.stdout:5/854: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/df7/d123/f12a x:0 0 0 2024-02-22T00:34:04.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/855: write d0/d20/d84/da0/db6/dc3/d6f/d94/d74/f100 [159153,98285] 0 2024-02-22T00:34:04.732 INFO:tasks.workunit.client.0.smithi049.stdout:1/912: dwrite d2/d8/db/d25/d62/fb5 [0,4194304] 0 2024-02-22T00:34:04.734 INFO:tasks.workunit.client.0.smithi049.stdout:1/913: write d2/d69/dc4/ffa [278913,81703] 0 2024-02-22T00:34:04.743 INFO:tasks.workunit.client.0.smithi049.stdout:4/995: dread d3/d22/d5c/f5b [4194304,4194304] 0 2024-02-22T00:34:04.745 INFO:tasks.workunit.client.0.smithi049.stdout:1/914: dwrite d2/d8/db/d25/d40/d41/d5b/d75/fee [0,4194304] 0 2024-02-22T00:34:04.747 INFO:tasks.workunit.client.0.smithi049.stdout:5/856: dread d0/d20/d50/d24/f71 [0,4194304] 0 2024-02-22T00:34:04.748 INFO:tasks.workunit.client.0.smithi049.stdout:4/996: creat d3/d22/d49/d57/f151 x:0 0 0 2024-02-22T00:34:04.751 INFO:tasks.workunit.client.0.smithi049.stdout:4/997: write d3/d8/d10/d43/d4d/db9/d8a/d48/d89/dca/f10a [147105,100307] 0 2024-02-22T00:34:04.752 INFO:tasks.workunit.client.0.smithi049.stdout:5/857: truncate d0/d20/d84/da0/db6/dc3/d6f/d94/d74/f105 910905 0 2024-02-22T00:34:04.754 INFO:tasks.workunit.client.0.smithi049.stdout:5/858: chown d0/d20/d84/da0/db6/dc3/dea/cfb 1445956621 1 2024-02-22T00:34:04.754 INFO:tasks.workunit.client.0.smithi049.stdout:4/998: creat d3/d22/d5c/d9a/f152 x:0 0 0 2024-02-22T00:34:04.755 INFO:tasks.workunit.client.0.smithi049.stdout:4/999: chown d3/d22/d5c/d5e/d144 177893093 1 2024-02-22T00:34:04.756 INFO:tasks.workunit.client.0.smithi049.stdout:5/859: mknod d0/d20/dc5/df5/d11f/c12b 0 2024-02-22T00:34:04.758 INFO:tasks.workunit.client.0.smithi049.stdout:5/860: symlink d0/d20/d84/da0/db6/dc3/dea/l12c 0 2024-02-22T00:34:04.764 INFO:tasks.workunit.client.0.smithi049.stdout:5/861: dwrite d0/d20/dad/f5c [0,4194304] 0 2024-02-22T00:34:04.767 INFO:tasks.workunit.client.0.smithi049.stdout:5/862: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d115/f12d x:0 0 0 2024-02-22T00:34:04.771 INFO:tasks.workunit.client.0.smithi049.stdout:5/863: mkdir d0/d20/d84/da0/db6/dc3/dea/d12e 0 2024-02-22T00:34:04.776 INFO:tasks.workunit.client.0.smithi049.stdout:5/864: rename d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d115/f10b to d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d115/f12f 0 2024-02-22T00:34:04.786 INFO:tasks.workunit.client.0.smithi049.stdout:5/865: rename d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d115/f12f to d0/d20/d84/da0/db6/dc3/d7c/f130 0 2024-02-22T00:34:04.789 INFO:tasks.workunit.client.0.smithi049.stdout:5/866: read d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/fa7 [88043,102468] 0 2024-02-22T00:34:04.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/867: mkdir d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d131 0 2024-02-22T00:34:04.796 INFO:tasks.workunit.client.0.smithi049.stdout:5/868: mkdir d0/d20/d84/da0/db6/dc3/d6f/d94/d11b/d132 0 2024-02-22T00:34:04.797 INFO:tasks.workunit.client.0.smithi049.stdout:5/869: write d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d115/f12d [874787,86036] 0 2024-02-22T00:34:04.802 INFO:tasks.workunit.client.0.smithi049.stdout:5/870: getdents d0/d20/d84/da0/db6/dc3/d6f/d94 0 2024-02-22T00:34:04.803 INFO:tasks.workunit.client.0.smithi049.stdout:5/871: write d0/d20/d84/da0/db6/dc3/d6f/d94/d74/f118 [69103,126433] 0 2024-02-22T00:34:04.805 INFO:tasks.workunit.client.0.smithi049.stdout:5/872: truncate d0/d20/d84/da0/db6/f67 1032250 0 2024-02-22T00:34:04.808 INFO:tasks.workunit.client.0.smithi049.stdout:5/873: rename d0/d20/d50/d24/c69 to d0/d20/d50/d24/c133 0 2024-02-22T00:34:04.809 INFO:tasks.workunit.client.0.smithi049.stdout:5/874: chown d0/d20/dc5/df5/d11f/c12b 327694894 1 2024-02-22T00:34:04.812 INFO:tasks.workunit.client.0.smithi049.stdout:5/875: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d103/f134 x:0 0 0 2024-02-22T00:34:04.814 INFO:tasks.workunit.client.0.smithi049.stdout:5/876: symlink d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/df7/d123/l135 0 2024-02-22T00:34:04.819 INFO:tasks.workunit.client.0.smithi049.stdout:5/877: write d0/d20/d84/da0/db6/dc3/d70/db1/d9e/fc6 [21813,15977] 0 2024-02-22T00:34:04.820 INFO:tasks.workunit.client.0.smithi049.stdout:5/878: dread - d0/d20/d84/da0/db6/dc3/d70/db1/dbe/fff zero size 2024-02-22T00:34:04.822 INFO:tasks.workunit.client.0.smithi049.stdout:5/879: mkdir d0/d20/d136 0 2024-02-22T00:34:04.823 INFO:tasks.workunit.client.0.smithi049.stdout:5/880: fdatasync d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/fdc 0 2024-02-22T00:34:04.824 INFO:tasks.workunit.client.0.smithi049.stdout:5/881: write d0/d20/dc5/f110 [745186,62600] 0 2024-02-22T00:34:04.826 INFO:tasks.workunit.client.0.smithi049.stdout:5/882: read d0/d20/dad/f8d [2099800,99572] 0 2024-02-22T00:34:04.827 INFO:tasks.workunit.client.0.smithi049.stdout:5/883: write d0/d20/d50/f11a [756165,66557] 0 2024-02-22T00:34:04.830 INFO:tasks.workunit.client.0.smithi049.stdout:5/884: mknod d0/d20/d84/da0/db6/dc3/d70/c137 0 2024-02-22T00:34:04.833 INFO:tasks.workunit.client.0.smithi049.stdout:5/885: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/db2/f138 x:0 0 0 2024-02-22T00:34:04.849 INFO:tasks.workunit.client.0.smithi049.stdout:5/886: dread d0/d20/d84/da0/db6/dc3/d6f/d94/d74/db2/ff0 [0,4194304] 0 2024-02-22T00:34:04.850 INFO:tasks.workunit.client.0.smithi049.stdout:1/915: creat d2/d8/db/d25/d40/d41/d10f/f12d x:0 0 0 2024-02-22T00:34:04.854 INFO:tasks.workunit.client.0.smithi049.stdout:1/916: fdatasync d2/d8/db/d25/d40/d41/f73 0 2024-02-22T00:34:04.859 INFO:tasks.workunit.client.0.smithi049.stdout:5/887: dwrite d0/d20/d84/da0/db6/dc3/d70/db1/fc0 [4194304,4194304] 0 2024-02-22T00:34:04.864 INFO:tasks.workunit.client.0.smithi049.stdout:1/917: dwrite d2/d8/db/ff8 [0,4194304] 0 2024-02-22T00:34:04.866 INFO:tasks.workunit.client.0.smithi049.stdout:5/888: mknod d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/c139 0 2024-02-22T00:34:04.868 INFO:tasks.workunit.client.0.smithi049.stdout:1/918: fdatasync d2/d8/db/d25/d40/d41/d5b/fd9 0 2024-02-22T00:34:04.869 INFO:tasks.workunit.client.0.smithi049.stdout:1/919: chown d2/da0/f117 1243030906 1 2024-02-22T00:34:04.870 INFO:tasks.workunit.client.0.smithi049.stdout:5/889: mkdir d0/d20/dc5/d112/d13a 0 2024-02-22T00:34:04.870 INFO:tasks.workunit.client.0.smithi049.stdout:5/890: chown d0/d26/l7f 20 1 2024-02-22T00:34:04.873 INFO:tasks.workunit.client.0.smithi049.stdout:1/920: symlink d2/d7b/ddd/l12e 0 2024-02-22T00:34:04.876 INFO:tasks.workunit.client.0.smithi049.stdout:1/921: dread d2/d8/db/d25/d62/dcc/dea/f106 [0,4194304] 0 2024-02-22T00:34:04.884 INFO:tasks.workunit.client.0.smithi049.stdout:5/891: dwrite d0/f4e [0,4194304] 0 2024-02-22T00:34:04.890 INFO:tasks.workunit.client.0.smithi049.stdout:5/892: truncate d0/d20/f6a 610234 0 2024-02-22T00:34:04.893 INFO:tasks.workunit.client.0.smithi049.stdout:5/893: creat d0/d20/dc5/df5/d11f/f13b x:0 0 0 2024-02-22T00:34:04.901 INFO:tasks.workunit.client.0.smithi049.stdout:1/922: write d2/fb2 [16691,3971] 0 2024-02-22T00:34:04.906 INFO:tasks.workunit.client.0.smithi049.stdout:5/894: dwrite d0/d20/d84/da0/db6/dc3/fee [0,4194304] 0 2024-02-22T00:34:04.908 INFO:tasks.workunit.client.0.smithi049.stdout:6/921: sync 2024-02-22T00:34:04.916 INFO:tasks.workunit.client.0.smithi049.stdout:6/922: truncate d3/d64/d59/d72/d92/d6c/f11c 4605095 0 2024-02-22T00:34:04.918 INFO:tasks.workunit.client.0.smithi049.stdout:5/895: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/d74/f82 [0,4194304] 0 2024-02-22T00:34:04.920 INFO:tasks.workunit.client.0.smithi049.stdout:6/923: creat d3/d64/d60/f13f x:0 0 0 2024-02-22T00:34:04.928 INFO:tasks.workunit.client.0.smithi049.stdout:5/896: write d0/d20/d50/d24/f5a [4502445,113321] 0 2024-02-22T00:34:04.929 INFO:tasks.workunit.client.0.smithi049.stdout:1/923: write d2/d8/db/f90 [3759735,110168] 0 2024-02-22T00:34:04.933 INFO:tasks.workunit.client.0.smithi049.stdout:5/897: creat d0/d20/d84/da0/db6/dc3/d70/db1/d9e/f13c x:0 0 0 2024-02-22T00:34:04.934 INFO:tasks.workunit.client.0.smithi049.stdout:1/924: mkdir d2/d8/db/d25/d40/d41/d68/d78/d12f 0 2024-02-22T00:34:04.936 INFO:tasks.workunit.client.0.smithi049.stdout:6/924: dwrite d3/d16/d32/f5d [0,4194304] 0 2024-02-22T00:34:04.939 INFO:tasks.workunit.client.0.smithi049.stdout:5/898: creat d0/d20/d84/da0/db6/dc3/d6f/f13d x:0 0 0 2024-02-22T00:34:04.941 INFO:tasks.workunit.client.0.smithi049.stdout:5/899: chown d0/d20/d84/da0/db6/dc3/c73 13959127 1 2024-02-22T00:34:04.941 INFO:tasks.workunit.client.0.smithi049.stdout:6/925: creat d3/d36/d70/df8/d109/f140 x:0 0 0 2024-02-22T00:34:04.943 INFO:tasks.workunit.client.0.smithi049.stdout:1/925: rename d2/d8/db/d25/d40/d41/d5b/d75/dd0/c10c to d2/d8/db/d25/d40/d41/d5b/d75/dd0/c130 0 2024-02-22T00:34:04.945 INFO:tasks.workunit.client.0.smithi049.stdout:1/926: readlink d2/d8/db/l44 0 2024-02-22T00:34:04.949 INFO:tasks.workunit.client.0.smithi049.stdout:6/926: rename d3/d16/d3b/l48 to d3/d37/l141 0 2024-02-22T00:34:04.952 INFO:tasks.workunit.client.0.smithi049.stdout:5/900: dwrite d0/d20/d84/da0/db6/dc3/d6f/ff3 [0,4194304] 0 2024-02-22T00:34:04.955 INFO:tasks.workunit.client.0.smithi049.stdout:1/927: dread d2/d8/db/d25/d62/fdb [0,4194304] 0 2024-02-22T00:34:04.958 INFO:tasks.workunit.client.0.smithi049.stdout:1/928: read d2/d8/da/f103 [228698,44610] 0 2024-02-22T00:34:04.958 INFO:tasks.workunit.client.0.smithi049.stdout:5/901: creat d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/df7/f13e x:0 0 0 2024-02-22T00:34:04.963 INFO:tasks.workunit.client.0.smithi049.stdout:5/902: write d0/d20/d84/da0/db6/dc3/d6f/feb [1542232,95736] 0 2024-02-22T00:34:04.968 INFO:tasks.workunit.client.0.smithi049.stdout:5/903: mkdir d0/d20/d50/d24/d3b/d13f 0 2024-02-22T00:34:04.973 INFO:tasks.workunit.client.0.smithi049.stdout:6/927: dwrite d3/d36/d70/dcc/d4d/d8b/fe8 [0,4194304] 0 2024-02-22T00:34:04.980 INFO:tasks.workunit.client.0.smithi049.stdout:5/904: dwrite d0/d20/fef [0,4194304] 0 2024-02-22T00:34:04.980 INFO:tasks.workunit.client.0.smithi049.stdout:6/928: symlink d3/d64/l142 0 2024-02-22T00:34:04.984 INFO:tasks.workunit.client.0.smithi049.stdout:6/929: chown d3/d36/d70/df8/f107 1614 1 2024-02-22T00:34:04.985 INFO:tasks.workunit.client.0.smithi049.stdout:5/905: rmdir d0/d20/d84/da0 39 2024-02-22T00:34:04.985 INFO:tasks.workunit.client.0.smithi049.stdout:6/930: write d3/d16/d32/d7b/fe3 [494321,72222] 0 2024-02-22T00:34:04.989 INFO:tasks.workunit.client.0.smithi049.stdout:6/931: rmdir d3/d64/d59/d12d 39 2024-02-22T00:34:04.991 INFO:tasks.workunit.client.0.smithi049.stdout:6/932: fsync d3/d36/d70/dcc/d4d/d8b/fa7 0 2024-02-22T00:34:04.995 INFO:tasks.workunit.client.0.smithi049.stdout:5/906: symlink d0/d20/d84/da0/db6/l140 0 2024-02-22T00:34:04.995 INFO:tasks.workunit.client.0.smithi049.stdout:6/933: write d3/d16/f3c [4360740,18266] 0 2024-02-22T00:34:05.007 INFO:tasks.workunit.client.0.smithi049.stdout:1/929: dread d2/d8/db/d25/d40/d41/f4a [0,4194304] 0 2024-02-22T00:34:05.011 INFO:tasks.workunit.client.0.smithi049.stdout:6/934: dwrite d3/d36/d70/dcc/d4d/d8b/fe1 [0,4194304] 0 2024-02-22T00:34:05.018 INFO:tasks.workunit.client.0.smithi049.stdout:6/935: rename d3/d64/d60/dc2/d10e/d12c to d3/d36/d57/d75/dce/d130/d143 0 2024-02-22T00:34:05.019 INFO:tasks.workunit.client.0.smithi049.stdout:1/930: symlink d2/d8/db/d25/d40/l131 0 2024-02-22T00:34:05.023 INFO:tasks.workunit.client.0.smithi049.stdout:1/931: creat d2/d8/db/d25/d40/d71/f132 x:0 0 0 2024-02-22T00:34:05.028 INFO:tasks.workunit.client.0.smithi049.stdout:1/932: mkdir d2/d8/db/d25/d40/d4d/d102/d133 0 2024-02-22T00:34:05.029 INFO:tasks.workunit.client.0.smithi049.stdout:6/936: truncate d3/d36/d70/dcc/d4d/d8b/fa7 1569942 0 2024-02-22T00:34:05.034 INFO:tasks.workunit.client.0.smithi049.stdout:1/933: mknod d2/d8/db/d25/d40/de8/c134 0 2024-02-22T00:34:05.036 INFO:tasks.workunit.client.0.smithi049.stdout:5/907: dread d0/d20/d50/f83 [0,4194304] 0 2024-02-22T00:34:05.038 INFO:tasks.workunit.client.0.smithi049.stdout:6/937: rename d3/d64/d59/d72/d92/db1 to d3/d36/d70/df8/d144 0 2024-02-22T00:34:05.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/938: stat d3/dcd/d103 0 2024-02-22T00:34:05.041 INFO:tasks.workunit.client.0.smithi049.stdout:3/771: sync 2024-02-22T00:34:05.044 INFO:tasks.workunit.client.0.smithi049.stdout:3/772: chown d0/d14/d4d/d4e/d4f/d5b/d66 3 1 2024-02-22T00:34:05.052 INFO:tasks.workunit.client.0.smithi049.stdout:6/939: dwrite d3/d64/d59/ff4 [0,4194304] 0 2024-02-22T00:34:05.055 INFO:tasks.workunit.client.0.smithi049.stdout:1/934: getdents d2/d8/db/d25/d40/d41/d5b 0 2024-02-22T00:34:05.056 INFO:tasks.workunit.client.0.smithi049.stdout:3/773: mknod d0/d14/d4d/d4e/d56/dc1/cf0 0 2024-02-22T00:34:05.058 INFO:tasks.workunit.client.0.smithi049.stdout:5/908: dread d0/f4c [0,4194304] 0 2024-02-22T00:34:05.062 INFO:tasks.workunit.client.0.smithi049.stdout:0/857: sync 2024-02-22T00:34:05.062 INFO:tasks.workunit.client.0.smithi049.stdout:2/900: sync 2024-02-22T00:34:05.062 INFO:tasks.workunit.client.0.smithi049.stdout:8/894: sync 2024-02-22T00:34:05.062 INFO:tasks.workunit.client.0.smithi049.stdout:7/947: sync 2024-02-22T00:34:05.062 INFO:tasks.workunit.client.0.smithi049.stdout:1/935: mkdir d2/d8/db/d25/d40/d135 0 2024-02-22T00:34:05.067 INFO:tasks.workunit.client.0.smithi049.stdout:0/858: dread - d3/df/d7f/f103 zero size 2024-02-22T00:34:05.074 INFO:tasks.workunit.client.0.smithi049.stdout:2/901: symlink d2/d9/dd/d74/l143 0 2024-02-22T00:34:05.083 INFO:tasks.workunit.client.0.smithi049.stdout:3/774: dread d0/d14/f1d [4194304,4194304] 0 2024-02-22T00:34:05.083 INFO:tasks.workunit.client.0.smithi049.stdout:0/859: readlink d3/df/d17/d50/d62/ld6 0 2024-02-22T00:34:05.093 INFO:tasks.workunit.client.0.smithi049.stdout:8/895: link d1/d2/d5/d1b/l29 d1/d2/d5/d1b/d39/l12e 0 2024-02-22T00:34:05.098 INFO:tasks.workunit.client.0.smithi049.stdout:1/936: dwrite d2/d8/f13 [0,4194304] 0 2024-02-22T00:34:05.099 INFO:tasks.workunit.client.0.smithi049.stdout:5/909: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/f12 [0,4194304] 0 2024-02-22T00:34:05.103 INFO:tasks.workunit.client.0.smithi049.stdout:3/775: truncate d0/dd/f6a 350060 0 2024-02-22T00:34:05.107 INFO:tasks.workunit.client.0.smithi049.stdout:7/948: write d1/df/d62/d57/fef [667692,75055] 0 2024-02-22T00:34:05.107 INFO:tasks.workunit.client.0.smithi049.stdout:0/860: rename d3/df/d48/d6f/d7a/f82 to d3/df/d48/d91/f10c 0 2024-02-22T00:34:05.107 INFO:tasks.workunit.client.0.smithi049.stdout:5/910: mknod d0/d20/d84/da0/db6/dc3/d70/db1/dbe/c141 0 2024-02-22T00:34:05.109 INFO:tasks.workunit.client.0.smithi049.stdout:8/896: dread - d1/d2/da5/d15/d30/d4b/f119 zero size 2024-02-22T00:34:05.110 INFO:tasks.workunit.client.0.smithi049.stdout:6/940: dwrite d3/d36/d70/dcc/d4d/fbb [0,4194304] 0 2024-02-22T00:34:05.110 INFO:tasks.workunit.client.0.smithi049.stdout:2/902: dwrite d2/d9/de/d10/f19 [4194304,4194304] 0 2024-02-22T00:34:05.112 INFO:tasks.workunit.client.0.smithi049.stdout:3/776: stat d0/dd/d1e/f24 0 2024-02-22T00:34:05.116 INFO:tasks.workunit.client.0.smithi049.stdout:3/777: fdatasync d0/dd/f9 0 2024-02-22T00:34:05.119 INFO:tasks.workunit.client.0.smithi049.stdout:6/941: unlink d3/d16/d32/d7b/fe3 0 2024-02-22T00:34:05.120 INFO:tasks.workunit.client.0.smithi049.stdout:5/911: write d0/d20/d50/d24/f5a [4221528,30801] 0 2024-02-22T00:34:05.121 INFO:tasks.workunit.client.0.smithi049.stdout:6/942: chown d3/d64/d5f/f7d 1038 1 2024-02-22T00:34:05.123 INFO:tasks.workunit.client.0.smithi049.stdout:0/861: creat d3/df/d48/d63/de5/d10a/f10d x:0 0 0 2024-02-22T00:34:05.130 INFO:tasks.workunit.client.0.smithi049.stdout:8/897: chown d1/d2/d5/d1b/f99 18357964 1 2024-02-22T00:34:05.133 INFO:tasks.workunit.client.0.smithi049.stdout:1/937: truncate d2/d8/db/d25/d40/d41/d68/fa6 4901368 0 2024-02-22T00:34:05.140 INFO:tasks.workunit.client.0.smithi049.stdout:0/862: creat d3/df/d48/d63/de5/d10a/f10e x:0 0 0 2024-02-22T00:34:05.140 INFO:tasks.workunit.client.0.smithi049.stdout:6/943: dread d3/d64/d5f/f7d [0,4194304] 0 2024-02-22T00:34:05.142 INFO:tasks.workunit.client.0.smithi049.stdout:2/903: creat d2/d9/de/d10/f144 x:0 0 0 2024-02-22T00:34:05.145 INFO:tasks.workunit.client.0.smithi049.stdout:0/863: creat d3/d92/f10f x:0 0 0 2024-02-22T00:34:05.148 INFO:tasks.workunit.client.0.smithi049.stdout:2/904: truncate d2/f95 831058 0 2024-02-22T00:34:05.148 INFO:tasks.workunit.client.0.smithi049.stdout:1/938: creat d2/d8/da/d8a/f136 x:0 0 0 2024-02-22T00:34:05.151 INFO:tasks.workunit.client.0.smithi049.stdout:0/864: dread - d3/df/d48/fc4 zero size 2024-02-22T00:34:05.151 INFO:tasks.workunit.client.0.smithi049.stdout:1/939: dread - d2/da0/f117 zero size 2024-02-22T00:34:05.152 INFO:tasks.workunit.client.0.smithi049.stdout:6/944: mknod d3/d64/d59/d12d/c145 0 2024-02-22T00:34:05.153 INFO:tasks.workunit.client.0.smithi049.stdout:5/912: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/d74/d7a/d89/fdc [0,4194304] 0 2024-02-22T00:34:05.156 INFO:tasks.workunit.client.0.smithi049.stdout:0/865: write d3/d92/f10f [808122,15707] 0 2024-02-22T00:34:05.156 INFO:tasks.workunit.client.0.smithi049.stdout:2/905: chown d2/d9/dd/l116 2 1 2024-02-22T00:34:05.158 INFO:tasks.workunit.client.0.smithi049.stdout:3/778: dwrite d0/dd/d6f/f94 [0,4194304] 0 2024-02-22T00:34:05.162 INFO:tasks.workunit.client.0.smithi049.stdout:5/913: rmdir d0/d20/d84/da0 39 2024-02-22T00:34:05.162 INFO:tasks.workunit.client.0.smithi049.stdout:6/945: write d3/d64/d59/f77 [146887,100962] 0 2024-02-22T00:34:05.168 INFO:tasks.workunit.client.0.smithi049.stdout:3/779: stat d0/d14/d4d/d4e/fd5 0 2024-02-22T00:34:05.168 INFO:tasks.workunit.client.0.smithi049.stdout:0/866: dread - d3/df/d17/fbe zero size 2024-02-22T00:34:05.171 INFO:tasks.workunit.client.0.smithi049.stdout:5/914: read d0/d20/dad/f8d [1696887,92200] 0 2024-02-22T00:34:05.171 INFO:tasks.workunit.client.0.smithi049.stdout:8/898: dwrite d1/d2/d5/d56/dac/fe0 [0,4194304] 0 2024-02-22T00:34:05.172 INFO:tasks.workunit.client.0.smithi049.stdout:3/780: write d0/d59/d87/fad [1204219,32157] 0 2024-02-22T00:34:05.172 INFO:tasks.workunit.client.0.smithi049.stdout:2/906: unlink d2/d9/de/d10/d2e/d42/d80/le6 0 2024-02-22T00:34:05.173 INFO:tasks.workunit.client.0.smithi049.stdout:0/867: fsync d3/f49 0 2024-02-22T00:34:05.173 INFO:tasks.workunit.client.0.smithi049.stdout:1/940: truncate d2/d8/db/d25/d40/d41/d5b/d75/f110 48500 0 2024-02-22T00:34:05.178 INFO:tasks.workunit.client.0.smithi049.stdout:2/907: write d2/fd4 [142441,27910] 0 2024-02-22T00:34:05.180 INFO:tasks.workunit.client.0.smithi049.stdout:3/781: symlink d0/d59/lf1 0 2024-02-22T00:34:05.182 INFO:tasks.workunit.client.0.smithi049.stdout:5/915: fdatasync d0/d20/d84/da0/db6/dc3/d70/fb4 0 2024-02-22T00:34:05.185 INFO:tasks.workunit.client.0.smithi049.stdout:8/899: creat d1/d2/da5/d15/d65/f12f x:0 0 0 2024-02-22T00:34:05.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/782: symlink d0/dd/d26/d2e/d52/d6e/deb/lf2 0 2024-02-22T00:34:05.190 INFO:tasks.workunit.client.0.smithi049.stdout:8/900: chown d1/d2/d5/d1b/lf9 6937997 1 2024-02-22T00:34:05.192 INFO:tasks.workunit.client.0.smithi049.stdout:1/941: link d2/d8/db/d25/d40/d41/d84/dab/lf4 d2/d8/db/d25/d40/d135/l137 0 2024-02-22T00:34:05.192 INFO:tasks.workunit.client.0.smithi049.stdout:6/946: dread d3/f29 [0,4194304] 0 2024-02-22T00:34:05.194 INFO:tasks.workunit.client.0.smithi049.stdout:2/908: dwrite d2/d9/dd/d4d/d72/f12f [0,4194304] 0 2024-02-22T00:34:05.195 INFO:tasks.workunit.client.0.smithi049.stdout:3/783: stat d0/d14/d4d/d4e/d56/d5a/dbf 0 2024-02-22T00:34:05.200 INFO:tasks.workunit.client.0.smithi049.stdout:6/947: stat d3/d36/d70/df8/d144/c126 0 2024-02-22T00:34:05.202 INFO:tasks.workunit.client.0.smithi049.stdout:0/868: dwrite d3/df/d48/d91/f10c [0,4194304] 0 2024-02-22T00:34:05.206 INFO:tasks.workunit.client.0.smithi049.stdout:3/784: creat d0/d14/d4d/d4e/d56/d5a/dbc/ff3 x:0 0 0 2024-02-22T00:34:05.210 INFO:tasks.workunit.client.0.smithi049.stdout:6/948: chown d3/d64/d60/dc2/ff3 192918 1 2024-02-22T00:34:05.211 INFO:tasks.workunit.client.0.smithi049.stdout:2/909: read d2/d9/dd/d4d/d72/fdf [2298383,59346] 0 2024-02-22T00:34:05.211 INFO:tasks.workunit.client.0.smithi049.stdout:5/916: dwrite d0/d20/d84/da0/db6/dc3/d6f/d94/d74/db2/f138 [0,4194304] 0 2024-02-22T00:34:05.218 INFO:tasks.workunit.client.0.smithi049.stdout:6/949: stat d3/d64/d60/dc2/fdf 0 2024-02-22T00:34:05.218 INFO:tasks.workunit.client.0.smithi049.stdout:5/917: write d0/f37 [2680404,130425] 0 2024-02-22T00:34:05.218 INFO:tasks.workunit.client.0.smithi049.stdout:8/901: dwrite d1/d2/da5/d15/d33/fba [0,4194304] 0 2024-02-22T00:34:05.221 INFO:tasks.workunit.client.0.smithi049.stdout:2/910: write d2/d9/de/d10/d2e/d42/d80/dcc/f65 [1302131,130314] 0 2024-02-22T00:34:05.223 INFO:tasks.workunit.client.0.smithi049.stdout:2/911: stat d2 0 2024-02-22T00:34:05.223 INFO:tasks.workunit.client.0.smithi049.stdout:6/950: read d3/d64/d60/f9e [158293,19335] 0 2024-02-22T00:34:05.223 INFO:tasks.workunit.client.0.smithi049.stdout:1/942: dwrite d2/d8/da/f14 [4194304,4194304] 0 2024-02-22T00:34:05.224 INFO:tasks.workunit.client.0.smithi049.stdout:8/902: mkdir d1/d4c/dda/d130 0 2024-02-22T00:34:05.227 INFO:tasks.workunit.client.0.smithi049.stdout:5/918: rmdir d0/d20/d84/da0/db6/dc3/d70/db1/d9e 39 2024-02-22T00:34:05.229 INFO:tasks.workunit.client.0.smithi049.stdout:6/951: chown d3/d36/d70/dcc/d4d/d8b/df7/d11d/f13a 0 1 2024-02-22T00:34:05.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/912: creat d2/d9/dd/dbb/f145 x:0 0 0 2024-02-22T00:34:05.235 INFO:tasks.workunit.client.0.smithi049.stdout:6/952: symlink d3/d36/d70/dcc/d4d/d8b/df7/dfd/l146 0 2024-02-22T00:34:05.235 INFO:tasks.workunit.client.0.smithi049.stdout:1/943: link d2/d8/db/d25/d40/d41/d68/d78/cc3 d2/d8/db/d25/d40/d71/c138 0 2024-02-22T00:34:05.236 INFO:tasks.workunit.client.0.smithi049.stdout:2/913: write d2/d9/dd/d4d/d5a/f113 [484148,69892] 0 2024-02-22T00:34:05.240 INFO:tasks.workunit.client.0.smithi049.stdout:5/919: dwrite d0/d20/d50/f11a [0,4194304] 0 2024-02-22T00:34:05.242 INFO:tasks.workunit.client.0.smithi049.stdout:2/914: write d2/d9/de/d3a/f54 [1437217,120957] 0 2024-02-22T00:34:05.242 INFO:tasks.workunit.client.0.smithi049.stdout:1/944: write d2/d8/db/d25/d40/d41/d84/f9c [3185601,59151] 0 2024-02-22T00:34:05.250 INFO:tasks.workunit.client.0.smithi049.stdout:5/920: rename d0/d20/d84/da0 to d0/d20/dad/d142 0 2024-02-22T00:34:05.252 INFO:tasks.workunit.client.0.smithi049.stdout:1/945: getdents d2/d8/db/d25 0 2024-02-22T00:34:05.257 INFO:tasks.workunit.client.0.smithi049.stdout:1/946: write d2/f3 [3016426,69697] 0 2024-02-22T00:34:05.259 INFO:tasks.workunit.client.0.smithi049.stdout:5/921: dwrite d0/d20/d50/d24/fec [0,4194304] 0 2024-02-22T00:34:05.267 INFO:tasks.workunit.client.0.smithi049.stdout:6/953: write d3/f29 [1357070,117932] 0 2024-02-22T00:34:05.273 INFO:tasks.workunit.client.0.smithi049.stdout:6/954: getdents d3/d64/d59/d72/d92/d112 0 2024-02-22T00:34:05.275 INFO:tasks.workunit.client.0.smithi049.stdout:5/922: dwrite d0/d20/d50/d24/f71 [0,4194304] 0 2024-02-22T00:34:05.276 INFO:tasks.workunit.client.0.smithi049.stdout:6/955: chown d3/d16/d3b/c47 880 1 2024-02-22T00:34:05.282 INFO:tasks.workunit.client.0.smithi049.stdout:5/923: creat d0/d20/d50/d24/d3b/f143 x:0 0 0 2024-02-22T00:34:05.282 INFO:tasks.workunit.client.0.smithi049.stdout:8/903: dwrite d1/d2/d5/d56/dd2/fef [0,4194304] 0 2024-02-22T00:34:05.283 INFO:tasks.workunit.client.0.smithi049.stdout:6/956: write d3/f1a [2260694,86020] 0 2024-02-22T00:34:05.288 INFO:tasks.workunit.client.0.smithi049.stdout:6/957: write d3/d36/f9d [409486,71150] 0 2024-02-22T00:34:05.288 INFO:tasks.workunit.client.0.smithi049.stdout:5/924: chown d0/d20/d50/d24/d54/c60 4089827 1 2024-02-22T00:34:05.289 INFO:tasks.workunit.client.0.smithi049.stdout:6/958: write d3/d64/d59/f77 [1083378,113277] 0 2024-02-22T00:34:05.293 INFO:tasks.workunit.client.0.smithi049.stdout:6/959: fdatasync d3/f10 0 2024-02-22T00:34:05.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:03.766650+0000 mgr.smithi161.sazlam (mgr.24369) 64 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 60 MiB/s rd, 168 MiB/s wr, 472 op/s 2024-02-22T00:34:05.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:04.840537+0000 mon.smithi161 (mon.1) 65 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:34:05.295 INFO:tasks.workunit.client.0.smithi049.stdout:6/960: chown d3/d64/d60/l111 1417864112 1 2024-02-22T00:34:05.296 INFO:tasks.workunit.client.0.smithi049.stdout:5/925: getdents d0/d20/dad/d142/db6/dc3/d6f/d94/d9c 0 2024-02-22T00:34:05.298 INFO:tasks.workunit.client.0.smithi049.stdout:8/904: creat d1/d2/da5/d15/d30/d36/dcd/f131 x:0 0 0 2024-02-22T00:34:05.298 INFO:tasks.workunit.client.0.smithi049.stdout:5/926: readlink d0/d20/dc5/l108 0 2024-02-22T00:34:05.300 INFO:tasks.workunit.client.0.smithi049.stdout:1/947: dwrite d2/d8/db/f26 [0,4194304] 0 2024-02-22T00:34:05.301 INFO:tasks.workunit.client.0.smithi049.stdout:5/927: readlink d0/d20/d50/d24/d3b/lcf 0 2024-02-22T00:34:05.307 INFO:tasks.workunit.client.0.smithi049.stdout:1/948: chown d2/d8/db/f10d 142 1 2024-02-22T00:34:05.307 INFO:tasks.workunit.client.0.smithi049.stdout:1/949: truncate d2/d8/db/d25/d62/dcc/ffe 782021 0 2024-02-22T00:34:05.307 INFO:tasks.workunit.client.0.smithi049.stdout:5/928: unlink d0/d20/dad/d142/db6/ff1 0 2024-02-22T00:34:05.308 INFO:tasks.workunit.client.0.smithi049.stdout:8/905: creat d1/d2/da5/d15/d30/d36/d52/daf/dcb/f132 x:0 0 0 2024-02-22T00:34:05.308 INFO:tasks.workunit.client.0.smithi049.stdout:6/961: truncate d3/d36/d57/d75/fbf 537924 0 2024-02-22T00:34:05.309 INFO:tasks.workunit.client.0.smithi049.stdout:6/962: fsync d3/d16/f78 0 2024-02-22T00:34:05.316 INFO:tasks.workunit.client.0.smithi049.stdout:6/963: creat d3/d36/f147 x:0 0 0 2024-02-22T00:34:05.316 INFO:tasks.workunit.client.0.smithi049.stdout:6/964: read - d3/d64/d59/d72/d92/fbd zero size 2024-02-22T00:34:05.316 INFO:tasks.workunit.client.0.smithi049.stdout:1/950: link d2/d8/d4c/fe0 d2/d8/db/d25/d62/f139 0 2024-02-22T00:34:05.318 INFO:tasks.workunit.client.0.smithi049.stdout:6/965: mknod d3/d16/d45/c148 0 2024-02-22T00:34:05.322 INFO:tasks.workunit.client.0.smithi049.stdout:6/966: dread d3/f76 [0,4194304] 0 2024-02-22T00:34:05.324 INFO:tasks.workunit.client.0.smithi049.stdout:5/929: dwrite d0/d20/dad/d142/db6/dc3/d6f/d94/f98 [0,4194304] 0 2024-02-22T00:34:05.326 INFO:tasks.workunit.client.0.smithi049.stdout:6/967: creat d3/d36/d57/d75/dce/f149 x:0 0 0 2024-02-22T00:34:05.327 INFO:tasks.workunit.client.0.smithi049.stdout:8/906: write d1/d2/d5/d1b/d39/d81/df3/fd5 [662751,82098] 0 2024-02-22T00:34:05.329 INFO:tasks.workunit.client.0.smithi049.stdout:5/930: creat d0/d26/f144 x:0 0 0 2024-02-22T00:34:05.330 INFO:tasks.workunit.client.0.smithi049.stdout:6/968: creat d3/d64/d59/d72/d92/f14a x:0 0 0 2024-02-22T00:34:05.331 INFO:tasks.workunit.client.0.smithi049.stdout:5/931: write d0/d20/d50/fd0 [4981034,49996] 0 2024-02-22T00:34:05.333 INFO:tasks.workunit.client.0.smithi049.stdout:1/951: write d2/d8/f74 [1262492,58223] 0 2024-02-22T00:34:05.337 INFO:tasks.workunit.client.0.smithi049.stdout:1/952: fsync d2/d8/db/d25/d40/f54 0 2024-02-22T00:34:05.340 INFO:tasks.workunit.client.0.smithi049.stdout:1/953: chown d2/d8/db/d25/d40/d4d/ccd 1956 1 2024-02-22T00:34:05.342 INFO:tasks.workunit.client.0.smithi049.stdout:6/969: dwrite d3/d64/d60/f13f [0,4194304] 0 2024-02-22T00:34:05.346 INFO:tasks.workunit.client.0.smithi049.stdout:5/932: getdents d0/d26 0 2024-02-22T00:34:05.355 INFO:tasks.workunit.client.0.smithi049.stdout:1/954: mknod d2/d8/db/d25/d40/d41/d68/d78/d12f/c13a 0 2024-02-22T00:34:05.360 INFO:tasks.workunit.client.0.smithi049.stdout:8/907: dwrite d1/d2/da5/d15/d30/fcc [0,4194304] 0 2024-02-22T00:34:05.364 INFO:tasks.workunit.client.0.smithi049.stdout:5/933: dread - d0/d20/dad/d142/db6/dc3/d70/db1/d9e/f13c zero size 2024-02-22T00:34:05.366 INFO:tasks.workunit.client.0.smithi049.stdout:6/970: rename d3/d36/d70/dcc/d4d/f95 to d3/d36/d70/df8/d144/db3/d131/f14b 0 2024-02-22T00:34:05.368 INFO:tasks.workunit.client.0.smithi049.stdout:6/971: stat d3/d16/d32/l79 0 2024-02-22T00:34:05.373 INFO:tasks.workunit.client.0.smithi049.stdout:5/934: dwrite d0/d20/d50/ffc [0,4194304] 0 2024-02-22T00:34:05.375 INFO:tasks.workunit.client.0.smithi049.stdout:6/972: creat d3/d36/d70/dcc/d4d/f14c x:0 0 0 2024-02-22T00:34:05.377 INFO:tasks.workunit.client.0.smithi049.stdout:6/973: write d3/d64/d5f/f135 [16646,89409] 0 2024-02-22T00:34:05.381 INFO:tasks.workunit.client.0.smithi049.stdout:6/974: creat d3/d36/d57/d75/dce/d130/d143/f14d x:0 0 0 2024-02-22T00:34:05.383 INFO:tasks.workunit.client.0.smithi049.stdout:8/908: unlink d1/d2/d5/d1b/d39/f9d 0 2024-02-22T00:34:05.386 INFO:tasks.workunit.client.0.smithi049.stdout:6/975: creat d3/d64/f14e x:0 0 0 2024-02-22T00:34:05.386 INFO:tasks.workunit.client.0.smithi049.stdout:6/976: readlink d3/d64/d59/d72/la4 0 2024-02-22T00:34:05.387 INFO:tasks.workunit.client.0.smithi049.stdout:6/977: fdatasync d3/d36/d70/dcc/d4d/d8b/df7/d11d/f13a 0 2024-02-22T00:34:05.389 INFO:tasks.workunit.client.0.smithi049.stdout:1/955: rename d2/d7b/c10a to d2/d8/db/d25/d40/d41/d68/c13b 0 2024-02-22T00:34:05.391 INFO:tasks.workunit.client.0.smithi049.stdout:1/956: chown d2/d8/db/d25/d40/d41/d84/l8c 1025600404 1 2024-02-22T00:34:05.392 INFO:tasks.workunit.client.0.smithi049.stdout:5/935: rename d0/d20/dad/d142/db6/dc3/d7c/ldd to d0/d20/dad/d142/db6/dc3/dea/d10e/d114/l145 0 2024-02-22T00:34:05.396 INFO:tasks.workunit.client.0.smithi049.stdout:6/978: dwrite d3/d36/fbc [0,4194304] 0 2024-02-22T00:34:05.396 INFO:tasks.workunit.client.0.smithi049.stdout:5/936: write d0/d20/d50/d24/d3b/f49 [64635,19101] 0 2024-02-22T00:34:05.396 INFO:tasks.workunit.client.0.smithi049.stdout:1/957: symlink d2/d8/db/d25/d40/d41/d10f/l13c 0 2024-02-22T00:34:05.398 INFO:tasks.workunit.client.0.smithi049.stdout:6/979: unlink d3/d64/d60/da0/l128 0 2024-02-22T00:34:05.398 INFO:tasks.workunit.client.0.smithi049.stdout:1/958: write d2/d8/db/d25/d40/f4b [1148237,65329] 0 2024-02-22T00:34:05.400 INFO:tasks.workunit.client.0.smithi049.stdout:6/980: mknod d3/d36/d70/dcc/c14f 0 2024-02-22T00:34:05.400 INFO:tasks.workunit.client.0.smithi049.stdout:1/959: write d2/d69/dc4/f118 [980128,120229] 0 2024-02-22T00:34:05.401 INFO:tasks.workunit.client.0.smithi049.stdout:5/937: getdents d0/d20/dad/d142/db6/dc3/d6f/d94/d74/db2 0 2024-02-22T00:34:05.403 INFO:tasks.workunit.client.0.smithi049.stdout:1/960: dread - d2/d8/db/d25/d40/d41/d5b/d75/dd0/d104/f127 zero size 2024-02-22T00:34:05.404 INFO:tasks.workunit.client.0.smithi049.stdout:6/981: fdatasync d3/f14 0 2024-02-22T00:34:05.405 INFO:tasks.workunit.client.0.smithi049.stdout:6/982: write d3/dcd/f124 [704166,74512] 0 2024-02-22T00:34:05.406 INFO:tasks.workunit.client.0.smithi049.stdout:5/938: mknod d0/d20/dad/d142/db6/dc3/d6f/d94/d11b/d132/c146 0 2024-02-22T00:34:05.407 INFO:tasks.workunit.client.0.smithi049.stdout:1/961: symlink d2/d69/l13d 0 2024-02-22T00:34:05.408 INFO:tasks.workunit.client.0.smithi049.stdout:6/983: creat d3/d36/d70/df8/d144/db3/d131/f150 x:0 0 0 2024-02-22T00:34:05.409 INFO:tasks.workunit.client.0.smithi049.stdout:5/939: rmdir d0/d20/dad/d142/db6/dc3/d70/db1 39 2024-02-22T00:34:05.413 INFO:tasks.workunit.client.0.smithi049.stdout:5/940: mknod d0/d20/dad/d142/db6/dc3/d6f/c147 0 2024-02-22T00:34:05.418 INFO:tasks.workunit.client.0.smithi049.stdout:6/984: truncate d3/f14 1938990 0 2024-02-22T00:34:05.419 INFO:tasks.workunit.client.0.smithi049.stdout:1/962: link d2/cfb d2/d8/db/c13e 0 2024-02-22T00:34:05.419 INFO:tasks.workunit.client.0.smithi049.stdout:5/941: mkdir d0/d20/dad/d142/db6/dc3/d6f/d94/d11b/d132/d148 0 2024-02-22T00:34:05.422 INFO:tasks.workunit.client.0.smithi049.stdout:1/963: creat d2/d8/db/d25/d40/d41/d68/d78/f13f x:0 0 0 2024-02-22T00:34:05.425 INFO:tasks.workunit.client.0.smithi049.stdout:1/964: mknod d2/d7b/ddd/c140 0 2024-02-22T00:34:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:03.766650+0000 mgr.smithi161.sazlam (mgr.24369) 64 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 1.7 GiB data, 6.6 GiB used, 530 GiB / 536 GiB avail; 60 MiB/s rd, 168 MiB/s wr, 472 op/s 2024-02-22T00:34:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:04.840537+0000 mon.smithi161 (mon.1) 65 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:34:05.441 INFO:tasks.workunit.client.0.smithi049.stdout:1/965: truncate d2/d8/db/d25/d40/d41/d68/f80 28334 0 2024-02-22T00:34:05.444 INFO:tasks.workunit.client.0.smithi049.stdout:1/966: fdatasync d2/d8/db/d25/d40/f94 0 2024-02-22T00:34:05.445 INFO:tasks.workunit.client.0.smithi049.stdout:8/909: dwrite d1/f1e [0,4194304] 0 2024-02-22T00:34:05.446 INFO:tasks.workunit.client.0.smithi049.stdout:1/967: chown d2/d8/db/f26 4071 1 2024-02-22T00:34:05.454 INFO:tasks.workunit.client.0.smithi049.stdout:1/968: rename d2/d8/db/d25/d40/d41/d5b/f7c to d2/d8/db/d25/d40/d41/d100/d116/f141 0 2024-02-22T00:34:05.455 INFO:tasks.workunit.client.0.smithi049.stdout:8/910: dwrite d1/d2/da5/d15/d33/fba [0,4194304] 0 2024-02-22T00:34:05.456 INFO:tasks.workunit.client.0.smithi049.stdout:8/911: readlink d1/d2/d5/d56/dac/lfd 0 2024-02-22T00:34:05.458 INFO:tasks.workunit.client.0.smithi049.stdout:1/969: write d2/d8/db/d25/d40/d41/d10f/f12d [424665,116839] 0 2024-02-22T00:34:05.459 INFO:tasks.workunit.client.0.smithi049.stdout:8/912: write d1/d2/da5/d15/d30/d36/d52/daf/dcb/f132 [423302,53310] 0 2024-02-22T00:34:05.466 INFO:tasks.workunit.client.0.smithi049.stdout:1/970: dwrite d2/ff6 [0,4194304] 0 2024-02-22T00:34:05.468 INFO:tasks.workunit.client.0.smithi049.stdout:8/913: mkdir d1/d2/da5/d15/d30/d36/d52/daf/dde/d133 0 2024-02-22T00:34:05.471 INFO:tasks.workunit.client.0.smithi049.stdout:1/971: dread d2/da0/fd8 [0,4194304] 0 2024-02-22T00:34:05.473 INFO:tasks.workunit.client.0.smithi049.stdout:8/914: dread - d1/d2/da5/deb/f96 zero size 2024-02-22T00:34:05.478 INFO:tasks.workunit.client.0.smithi049.stdout:8/915: mknod d1/d2/d8c/d120/c134 0 2024-02-22T00:34:05.484 INFO:tasks.workunit.client.0.smithi049.stdout:8/916: dwrite d1/d2/da5/f104 [0,4194304] 0 2024-02-22T00:34:05.492 INFO:tasks.workunit.client.0.smithi049.stdout:1/972: dwrite d2/d8/db/d25/d40/d41/d68/d78/fef [0,4194304] 0 2024-02-22T00:34:05.499 INFO:tasks.workunit.client.0.smithi049.stdout:1/973: creat d2/d8/db/d25/d40/d41/d5b/f142 x:0 0 0 2024-02-22T00:34:05.501 INFO:tasks.workunit.client.0.smithi049.stdout:8/917: dread d1/d2/f3 [0,4194304] 0 2024-02-22T00:34:05.504 INFO:tasks.workunit.client.0.smithi049.stdout:1/974: creat d2/d8/db/d25/d40/d41/d68/d78/d12f/f143 x:0 0 0 2024-02-22T00:34:05.506 INFO:tasks.workunit.client.0.smithi049.stdout:1/975: truncate d2/d8/db/f1a 1996463 0 2024-02-22T00:34:05.514 INFO:tasks.workunit.client.0.smithi049.stdout:1/976: dwrite d2/fb2 [0,4194304] 0 2024-02-22T00:34:05.520 INFO:tasks.workunit.client.0.smithi049.stdout:8/918: dwrite d1/d2/da5/d15/d30/f71 [0,4194304] 0 2024-02-22T00:34:05.525 INFO:tasks.workunit.client.0.smithi049.stdout:8/919: creat d1/d2/d5/d1b/d39/d81/dfc/f135 x:0 0 0 2024-02-22T00:34:05.534 INFO:tasks.workunit.client.0.smithi049.stdout:8/920: rename d1/d2/da5/d15/c26 to d1/d2/d5/d1b/d39/d60/df2/c136 0 2024-02-22T00:34:05.534 INFO:tasks.workunit.client.0.smithi049.stdout:1/977: dwrite d2/d8/f27 [8388608,4194304] 0 2024-02-22T00:34:05.543 INFO:tasks.workunit.client.0.smithi049.stdout:1/978: write d2/d69/dc4/fcf [513262,79047] 0 2024-02-22T00:34:05.550 INFO:tasks.workunit.client.0.smithi049.stdout:8/921: dwrite d1/d2/da5/d15/d33/fbc [0,4194304] 0 2024-02-22T00:34:05.557 INFO:tasks.workunit.client.0.smithi049.stdout:1/979: link d2/d8/db/d25/d40/de8/c134 d2/d8/db/d25/d62/dcb/c144 0 2024-02-22T00:34:05.560 INFO:tasks.workunit.client.0.smithi049.stdout:1/980: mkdir d2/d8/db/d25/d40/d41/d5b/d75/d145 0 2024-02-22T00:34:05.573 INFO:tasks.workunit.client.0.smithi049.stdout:8/922: dwrite d1/dd1/fea [0,4194304] 0 2024-02-22T00:34:05.581 INFO:tasks.workunit.client.0.smithi049.stdout:1/981: write d2/d8/db/fbd [997996,101391] 0 2024-02-22T00:34:05.583 INFO:tasks.workunit.client.0.smithi049.stdout:8/923: dwrite d1/d2/da5/d15/d33/fbc [4194304,4194304] 0 2024-02-22T00:34:05.585 INFO:tasks.workunit.client.0.smithi049.stdout:1/982: fsync d2/d66/f96 0 2024-02-22T00:34:05.593 INFO:tasks.workunit.client.0.smithi049.stdout:8/924: dread - d1/d2/da5/d15/d30/d36/d52/daf/fb8 zero size 2024-02-22T00:34:05.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/925: mkdir d1/d2/da5/deb/d137 0 2024-02-22T00:34:05.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/926: write d1/d2/d5/f103 [454298,54063] 0 2024-02-22T00:34:05.602 INFO:tasks.workunit.client.0.smithi049.stdout:8/927: mkdir d1/d2/da5/d15/d30/d36/d138 0 2024-02-22T00:34:05.616 INFO:tasks.workunit.client.0.smithi049.stdout:8/928: dread d1/d2/d5/d1b/d39/d81/df3/fbb [0,4194304] 0 2024-02-22T00:34:05.623 INFO:tasks.workunit.client.0.smithi049.stdout:8/929: dwrite d1/d2/da5/d15/d30/f122 [0,4194304] 0 2024-02-22T00:34:05.626 INFO:tasks.workunit.client.0.smithi049.stdout:8/930: stat d1/d2/da5/d15/d30/d36/fb0 0 2024-02-22T00:34:05.635 INFO:tasks.workunit.client.0.smithi049.stdout:8/931: write d1/d2/da5/d15/d10f/f115 [478902,45783] 0 2024-02-22T00:34:05.638 INFO:tasks.workunit.client.0.smithi049.stdout:8/932: getdents d1/d2/da5/d15/d30/d4b/d51/d121 0 2024-02-22T00:34:05.640 INFO:tasks.workunit.client.0.smithi049.stdout:8/933: read d1/d2/da5/d15/d33/fbc [3127776,50998] 0 2024-02-22T00:34:05.643 INFO:tasks.workunit.client.0.smithi049.stdout:8/934: fdatasync d1/d2/f3 0 2024-02-22T00:34:05.644 INFO:tasks.workunit.client.0.smithi049.stdout:8/935: readlink d1/d2/da5/d15/d65/d6a/l8a 0 2024-02-22T00:34:05.646 INFO:tasks.workunit.client.0.smithi049.stdout:8/936: truncate d1/d2/da5/d15/f10b 622648 0 2024-02-22T00:34:05.651 INFO:tasks.workunit.client.0.smithi049.stdout:8/937: dread d1/d2/d5/d56/dd2/fef [0,4194304] 0 2024-02-22T00:34:05.652 INFO:tasks.workunit.client.0.smithi049.stdout:8/938: fsync d1/d2/da5/d15/d30/d36/fb0 0 2024-02-22T00:34:05.660 INFO:tasks.workunit.client.0.smithi049.stdout:8/939: truncate d1/d2/d5/d1b/d39/d81/df3/fd5 266911 0 2024-02-22T00:34:05.666 INFO:tasks.workunit.client.0.smithi049.stdout:7/949: sync 2024-02-22T00:34:05.666 INFO:tasks.workunit.client.0.smithi049.stdout:0/869: sync 2024-02-22T00:34:05.671 INFO:tasks.workunit.client.0.smithi049.stdout:0/870: chown d3/df/c39 0 1 2024-02-22T00:34:05.672 INFO:tasks.workunit.client.0.smithi049.stdout:0/871: dread - d3/df/d59/d60/de9/f10b zero size 2024-02-22T00:34:05.674 INFO:tasks.workunit.client.0.smithi049.stdout:0/872: chown d3/df/d7f/f93 558191 1 2024-02-22T00:34:05.674 INFO:tasks.workunit.client.0.smithi049.stdout:8/940: dread d1/d2/da5/f78 [0,4194304] 0 2024-02-22T00:34:05.677 INFO:tasks.workunit.client.0.smithi049.stdout:8/941: write d1/d2/d5/d1b/d39/d60/df2/f11f [876933,39630] 0 2024-02-22T00:34:05.677 INFO:tasks.workunit.client.0.smithi049.stdout:0/873: mknod d3/d6/d8/d36/c110 0 2024-02-22T00:34:05.679 INFO:tasks.workunit.client.0.smithi049.stdout:7/950: rename d1/df/d62/d57/lf8 to d1/df/d62/d48/l152 0 2024-02-22T00:34:05.681 INFO:tasks.workunit.client.0.smithi049.stdout:0/874: chown d3/d6/ddb 4 1 2024-02-22T00:34:05.683 INFO:tasks.workunit.client.0.smithi049.stdout:8/942: creat d1/d2/d5/d1b/d39/d60/da0/f139 x:0 0 0 2024-02-22T00:34:05.685 INFO:tasks.workunit.client.0.smithi049.stdout:8/943: fsync d1/d4c/f4f 0 2024-02-22T00:34:05.686 INFO:tasks.workunit.client.0.smithi049.stdout:0/875: unlink d3/d6/d8/d36/c8a 0 2024-02-22T00:34:05.687 INFO:tasks.workunit.client.0.smithi049.stdout:7/951: dwrite d1/d49/d5a/d13a/f13c [0,4194304] 0 2024-02-22T00:34:05.689 INFO:tasks.workunit.client.0.smithi049.stdout:0/876: write d3/d1e/d58/fa1 [58873,48933] 0 2024-02-22T00:34:05.693 INFO:tasks.workunit.client.0.smithi049.stdout:7/952: creat d1/d41/dae/f153 x:0 0 0 2024-02-22T00:34:05.700 INFO:tasks.workunit.client.0.smithi049.stdout:7/953: creat d1/df/d62/d1c/d6d/f154 x:0 0 0 2024-02-22T00:34:05.701 INFO:tasks.workunit.client.0.smithi049.stdout:0/877: dwrite d3/df/d48/f105 [0,4194304] 0 2024-02-22T00:34:05.701 INFO:tasks.workunit.client.0.smithi049.stdout:7/954: readlink d1/d49/d5a/d13a/l14f 0 2024-02-22T00:34:05.704 INFO:tasks.workunit.client.0.smithi049.stdout:0/878: write d3/df/d17/d50/ff8 [288632,128466] 0 2024-02-22T00:34:05.705 INFO:tasks.workunit.client.0.smithi049.stdout:0/879: fsync d3/d6/d29/f76 0 2024-02-22T00:34:05.706 INFO:tasks.workunit.client.0.smithi049.stdout:8/944: creat d1/d2/da5/d15/d30/d36/d52/daf/dde/f13a x:0 0 0 2024-02-22T00:34:05.715 INFO:tasks.workunit.client.0.smithi049.stdout:8/945: dwrite d1/d2/da5/d15/d30/d36/d52/daf/dde/f13a [0,4194304] 0 2024-02-22T00:34:05.725 INFO:tasks.workunit.client.0.smithi049.stdout:7/955: creat d1/df/d62/d1c/d1d/f155 x:0 0 0 2024-02-22T00:34:05.734 INFO:tasks.workunit.client.0.smithi049.stdout:0/880: dwrite d3/df/d48/d6f/d90/dcc/faa [0,4194304] 0 2024-02-22T00:34:05.738 INFO:tasks.workunit.client.0.smithi049.stdout:0/881: rename d3/df/d59/d8e/fa7 to d3/df/d59/d8e/f111 0 2024-02-22T00:34:05.740 INFO:tasks.workunit.client.0.smithi049.stdout:0/882: fsync d3/df/f7d 0 2024-02-22T00:34:05.741 INFO:tasks.workunit.client.0.smithi049.stdout:0/883: chown d3/d6/d8/d36/c110 12746039 1 2024-02-22T00:34:05.744 INFO:tasks.workunit.client.0.smithi049.stdout:0/884: truncate d3/df/d48/d63/de5/f109 570321 0 2024-02-22T00:34:05.746 INFO:tasks.workunit.client.0.smithi049.stdout:0/885: fsync d3/df/d59/d8c/fd4 0 2024-02-22T00:34:05.747 INFO:tasks.workunit.client.0.smithi049.stdout:7/956: dwrite d1/df/d62/d48/d8e/fbe [0,4194304] 0 2024-02-22T00:34:05.753 INFO:tasks.workunit.client.0.smithi049.stdout:0/886: getdents d3/df/d59/d8c 0 2024-02-22T00:34:05.758 INFO:tasks.workunit.client.0.smithi049.stdout:0/887: creat d3/df/d48/d6f/d90/f112 x:0 0 0 2024-02-22T00:34:05.758 INFO:tasks.workunit.client.0.smithi049.stdout:7/957: dwrite d1/df/d62/d48/d99/f13f [0,4194304] 0 2024-02-22T00:34:05.760 INFO:tasks.workunit.client.0.smithi049.stdout:7/958: fsync d1/df/d62/d57/f69 0 2024-02-22T00:34:05.767 INFO:tasks.workunit.client.0.smithi049.stdout:7/959: dwrite d1/df/d62/d60/fc7 [0,4194304] 0 2024-02-22T00:34:05.773 INFO:tasks.workunit.client.0.smithi049.stdout:0/888: getdents d3/df/d48/d63/de5/df6 0 2024-02-22T00:34:05.776 INFO:tasks.workunit.client.0.smithi049.stdout:0/889: mknod d3/df/d48/d63/de5/d10a/c113 0 2024-02-22T00:34:05.779 INFO:tasks.workunit.client.0.smithi049.stdout:7/960: dwrite d1/d41/dae/f153 [0,4194304] 0 2024-02-22T00:34:05.780 INFO:tasks.workunit.client.0.smithi049.stdout:0/890: symlink d3/d1e/ddf/l114 0 2024-02-22T00:34:05.787 INFO:tasks.workunit.client.0.smithi049.stdout:0/891: symlink d3/df/d48/d6f/d90/dcc/l115 0 2024-02-22T00:34:05.787 INFO:tasks.workunit.client.0.smithi049.stdout:7/961: symlink d1/d14d/l156 0 2024-02-22T00:34:05.788 INFO:tasks.workunit.client.0.smithi049.stdout:7/962: readlink d1/d41/d28/d71/d72/l81 0 2024-02-22T00:34:05.789 INFO:tasks.workunit.client.0.smithi049.stdout:0/892: chown d3/c3a 4097447 1 2024-02-22T00:34:05.792 INFO:tasks.workunit.client.0.smithi049.stdout:7/963: creat d1/df/d62/d60/d7e/de6/d125/f157 x:0 0 0 2024-02-22T00:34:05.796 INFO:tasks.workunit.client.0.smithi049.stdout:7/964: rename d1/df/d62/d1c/d24/f52 to d1/df/d62/d57/f158 0 2024-02-22T00:34:05.808 INFO:tasks.workunit.client.0.smithi049.stdout:0/893: dwrite d3/d6/f4d [0,4194304] 0 2024-02-22T00:34:05.809 INFO:tasks.workunit.client.0.smithi049.stdout:7/965: write f0 [1319122,76074] 0 2024-02-22T00:34:05.811 INFO:tasks.workunit.client.0.smithi049.stdout:0/894: symlink d3/d1e/l116 0 2024-02-22T00:34:05.812 INFO:tasks.workunit.client.0.smithi049.stdout:7/966: rmdir d1/df/d62/d60/d7e/de6/de8 39 2024-02-22T00:34:05.815 INFO:tasks.workunit.client.0.smithi049.stdout:0/895: symlink d3/d1e/l117 0 2024-02-22T00:34:05.817 INFO:tasks.workunit.client.0.smithi049.stdout:7/967: dread d1/d49/d4d/f75 [0,4194304] 0 2024-02-22T00:34:05.818 INFO:tasks.workunit.client.0.smithi049.stdout:0/896: dread - d3/d1e/f9a zero size 2024-02-22T00:34:05.825 INFO:tasks.workunit.client.0.smithi049.stdout:7/968: rename d1/l144 to d1/df/d62/l159 0 2024-02-22T00:34:05.826 INFO:tasks.workunit.client.0.smithi049.stdout:7/969: chown d1/d41/d28/d71/d72/l81 11557486 1 2024-02-22T00:34:05.829 INFO:tasks.workunit.client.0.smithi049.stdout:7/970: link d1/df/d62/d60/fc7 d1/df/d62/d1c/d6d/f15a 0 2024-02-22T00:34:05.868 INFO:tasks.workunit.client.0.smithi049.stdout:3/785: sync 2024-02-22T00:34:05.868 INFO:tasks.workunit.client.0.smithi049.stdout:2/915: sync 2024-02-22T00:34:05.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/786: getdents d0/d14/d4d/d4e/d56/d5a/dc4 0 2024-02-22T00:34:05.874 INFO:tasks.workunit.client.0.smithi049.stdout:3/787: fdatasync d0/fce 0 2024-02-22T00:34:05.875 INFO:tasks.workunit.client.0.smithi049.stdout:2/916: write d2/d9/de/d10/d59/f8f [767418,105469] 0 2024-02-22T00:34:05.877 INFO:tasks.workunit.client.0.smithi049.stdout:3/788: creat d0/dd/d26/d2e/ff4 x:0 0 0 2024-02-22T00:34:05.878 INFO:tasks.workunit.client.0.smithi049.stdout:2/917: symlink d2/d9/de/d10/d2e/d42/d131/l146 0 2024-02-22T00:34:05.879 INFO:tasks.workunit.client.0.smithi049.stdout:3/789: chown d0/d14/lba 2239045 1 2024-02-22T00:34:05.879 INFO:tasks.workunit.client.0.smithi049.stdout:2/918: fdatasync d2/d9/f6f 0 2024-02-22T00:34:05.880 INFO:tasks.workunit.client.0.smithi049.stdout:2/919: chown d2/d9/d17/l64 869164 1 2024-02-22T00:34:05.883 INFO:tasks.workunit.client.0.smithi049.stdout:2/920: read d2/d9/de/d3a/fb4 [1137597,19457] 0 2024-02-22T00:34:05.883 INFO:tasks.workunit.client.0.smithi049.stdout:0/897: truncate d3/df/d48/d91/f10c 1582567 0 2024-02-22T00:34:05.884 INFO:tasks.workunit.client.0.smithi049.stdout:3/790: rename d0/dd/d1e/ced to d0/d14/d4d/d4e/d56/d5a/dbf/cf5 0 2024-02-22T00:34:05.886 INFO:tasks.workunit.client.0.smithi049.stdout:0/898: creat d3/df/d59/d60/f118 x:0 0 0 2024-02-22T00:34:05.887 INFO:tasks.workunit.client.0.smithi049.stdout:2/921: creat d2/d9/dd/d4d/d5a/f147 x:0 0 0 2024-02-22T00:34:05.888 INFO:tasks.workunit.client.0.smithi049.stdout:3/791: mknod d0/d14/d4d/d4e/d4f/d5b/d76/cf6 0 2024-02-22T00:34:05.888 INFO:tasks.workunit.client.0.smithi049.stdout:7/971: write d1/d41/d55/f14a [2852191,72214] 0 2024-02-22T00:34:05.889 INFO:tasks.workunit.client.0.smithi049.stdout:3/792: chown d0/dd/d26/d63 683656 1 2024-02-22T00:34:05.890 INFO:tasks.workunit.client.0.smithi049.stdout:0/899: mkdir d3/df/d48/d6f/d119 0 2024-02-22T00:34:05.894 INFO:tasks.workunit.client.0.smithi049.stdout:2/922: link d2/d9/dd/dbb/f105 d2/d9/de/d3a/d6d/d140/f148 0 2024-02-22T00:34:05.898 INFO:tasks.workunit.client.0.smithi049.stdout:2/923: fsync d2/d9/de/d10/d59/ffe 0 2024-02-22T00:34:05.898 INFO:tasks.workunit.client.0.smithi049.stdout:3/793: dwrite d0/dd/d1e/f47 [0,4194304] 0 2024-02-22T00:34:05.901 INFO:tasks.workunit.client.0.smithi049.stdout:7/972: rename d1/df/d62/d48/d8e/fbe to d1/df/d62/d1c/d24/d2e/df0/f15b 0 2024-02-22T00:34:05.903 INFO:tasks.workunit.client.0.smithi049.stdout:3/794: unlink d0/c3f 0 2024-02-22T00:34:05.905 INFO:tasks.workunit.client.0.smithi049.stdout:2/924: mknod d2/d9/dd/d4d/d5a/c149 0 2024-02-22T00:34:05.909 INFO:tasks.workunit.client.0.smithi049.stdout:2/925: write d2/d9/de/d3a/d6d/d140/f148 [4145212,89661] 0 2024-02-22T00:34:05.910 INFO:tasks.workunit.client.0.smithi049.stdout:7/973: rmdir d1/d49/d5a/d13a 39 2024-02-22T00:34:05.917 INFO:tasks.workunit.client.0.smithi049.stdout:0/900: link d3/d6/d8/fba d3/d1e/d58/f11a 0 2024-02-22T00:34:05.918 INFO:tasks.workunit.client.0.smithi049.stdout:2/926: getdents d2/d9/de/d10/d2e/d42/d80 0 2024-02-22T00:34:05.919 INFO:tasks.workunit.client.0.smithi049.stdout:7/974: chown d1/d49/d5a/lee 1324517165 1 2024-02-22T00:34:05.921 INFO:tasks.workunit.client.0.smithi049.stdout:2/927: creat d2/dda/d5d/f14a x:0 0 0 2024-02-22T00:34:05.922 INFO:tasks.workunit.client.0.smithi049.stdout:2/928: chown d2/dda/d5d/f14a 953514 1 2024-02-22T00:34:05.925 INFO:tasks.workunit.client.0.smithi049.stdout:2/929: symlink d2/d9/dd/d74/l14b 0 2024-02-22T00:34:05.925 INFO:tasks.workunit.client.0.smithi049.stdout:7/975: creat d1/d41/d55/d14c/f15c x:0 0 0 2024-02-22T00:34:05.927 INFO:tasks.workunit.client.0.smithi049.stdout:3/795: dread d0/dd/fa3 [0,4194304] 0 2024-02-22T00:34:05.929 INFO:tasks.workunit.client.0.smithi049.stdout:7/976: chown d1/d41/d28/c10b 409956 1 2024-02-22T00:34:05.929 INFO:tasks.workunit.client.0.smithi049.stdout:3/796: rename d0/dd/f3 to d0/d59/ff7 0 2024-02-22T00:34:05.934 INFO:tasks.workunit.client.0.smithi049.stdout:3/797: mknod d0/d14/d4d/d4e/d4f/cf8 0 2024-02-22T00:34:05.934 INFO:tasks.workunit.client.0.smithi049.stdout:7/977: rmdir d1/df/d62/d1c/d6d 39 2024-02-22T00:34:05.935 INFO:tasks.workunit.client.0.smithi049.stdout:2/930: dwrite d2/d9/de/d3a/dc3/d11e/f124 [0,4194304] 0 2024-02-22T00:34:05.936 INFO:tasks.workunit.client.0.smithi049.stdout:2/931: fdatasync d2/dda/d63/f111 0 2024-02-22T00:34:05.939 INFO:tasks.workunit.client.0.smithi049.stdout:7/978: symlink d1/df/d62/d48/d8e/l15d 0 2024-02-22T00:34:05.939 INFO:tasks.workunit.client.0.smithi049.stdout:3/798: dread - d0/d14/d4d/d4e/d56/d5a/dc4/fc7 zero size 2024-02-22T00:34:05.941 INFO:tasks.workunit.client.0.smithi049.stdout:2/932: symlink d2/d9/de/d3a/d6d/da6/l14c 0 2024-02-22T00:34:05.943 INFO:tasks.workunit.client.0.smithi049.stdout:7/979: mknod d1/d41/d55/d14c/c15e 0 2024-02-22T00:34:05.944 INFO:tasks.workunit.client.0.smithi049.stdout:2/933: creat d2/d9/dd/d74/f14d x:0 0 0 2024-02-22T00:34:05.944 INFO:tasks.workunit.client.0.smithi049.stdout:0/901: write d3/d6/d8/f71 [685362,58028] 0 2024-02-22T00:34:05.950 INFO:tasks.workunit.client.0.smithi049.stdout:2/934: write d2/d9/de/d10/d2e/d42/f43 [1663735,17888] 0 2024-02-22T00:34:05.953 INFO:tasks.workunit.client.0.smithi049.stdout:7/980: dwrite d1/d41/d55/f14a [0,4194304] 0 2024-02-22T00:34:05.954 INFO:tasks.workunit.client.0.smithi049.stdout:3/799: truncate d0/dd/d26/d2e/f54 2961480 0 2024-02-22T00:34:05.954 INFO:tasks.workunit.client.0.smithi049.stdout:2/935: symlink d2/d9/de/d15/d1b/l14e 0 2024-02-22T00:34:05.958 INFO:tasks.workunit.client.0.smithi049.stdout:7/981: mknod d1/d49/d11d/c15f 0 2024-02-22T00:34:05.959 INFO:tasks.workunit.client.0.smithi049.stdout:3/800: creat d0/d14/d4d/d4e/d56/ff9 x:0 0 0 2024-02-22T00:34:05.963 INFO:tasks.workunit.client.0.smithi049.stdout:7/982: dread d1/d41/dae/f118 [0,4194304] 0 2024-02-22T00:34:05.963 INFO:tasks.workunit.client.0.smithi049.stdout:3/801: symlink d0/d59/lfa 0 2024-02-22T00:34:05.966 INFO:tasks.workunit.client.0.smithi049.stdout:0/902: dread d3/df/d48/d6f/d90/dcc/f5d [0,4194304] 0 2024-02-22T00:34:05.969 INFO:tasks.workunit.client.0.smithi049.stdout:7/983: symlink d1/d41/d28/d71/l160 0 2024-02-22T00:34:05.972 INFO:tasks.workunit.client.0.smithi049.stdout:3/802: dwrite d0/dd/f46 [0,4194304] 0 2024-02-22T00:34:05.977 INFO:tasks.workunit.client.0.smithi049.stdout:7/984: creat d1/df/d62/d60/d7e/de6/ded/f161 x:0 0 0 2024-02-22T00:34:05.980 INFO:tasks.workunit.client.0.smithi049.stdout:0/903: rename d3/df/d48/d6f/d7a/f9d to d3/f11b 0 2024-02-22T00:34:05.980 INFO:tasks.workunit.client.0.smithi049.stdout:3/803: rmdir d0/d14/d4d/d4e/d56 39 2024-02-22T00:34:05.981 INFO:tasks.workunit.client.0.smithi049.stdout:7/985: mknod d1/d41/d28/d71/d10a/c162 0 2024-02-22T00:34:05.983 INFO:tasks.workunit.client.0.smithi049.stdout:0/904: creat d3/df/d59/d60/de9/f11c x:0 0 0 2024-02-22T00:34:05.985 INFO:tasks.workunit.client.0.smithi049.stdout:7/986: creat d1/d49/f163 x:0 0 0 2024-02-22T00:34:05.985 INFO:tasks.workunit.client.0.smithi049.stdout:3/804: dread d0/d14/d4d/d4e/d4f/d5b/d76/fbe [0,4194304] 0 2024-02-22T00:34:05.986 INFO:tasks.workunit.client.0.smithi049.stdout:2/936: dread d2/d9/dd/d4d/d5a/fb2 [0,4194304] 0 2024-02-22T00:34:05.989 INFO:tasks.workunit.client.0.smithi049.stdout:7/987: write d1/d49/d5a/d13a/f13c [2109554,98440] 0 2024-02-22T00:34:05.993 INFO:tasks.workunit.client.0.smithi049.stdout:7/988: creat d1/df/d62/d48/d8e/f164 x:0 0 0 2024-02-22T00:34:05.995 INFO:tasks.workunit.client.0.smithi049.stdout:3/805: link d0/d59/d8f/cb0 d0/d14/d4d/d4e/d56/d5a/cfb 0 2024-02-22T00:34:05.995 INFO:tasks.workunit.client.0.smithi049.stdout:7/989: stat d1/df/d62/d60/ff5 0 2024-02-22T00:34:05.996 INFO:tasks.workunit.client.0.smithi049.stdout:2/937: dwrite d2/d9/dd/d4d/d72/f9a [0,4194304] 0 2024-02-22T00:34:05.998 INFO:tasks.workunit.client.0.smithi049.stdout:3/806: creat d0/d59/ffc x:0 0 0 2024-02-22T00:34:05.999 INFO:tasks.workunit.client.0.smithi049.stdout:2/938: read d2/d9/dd/d4d/d5a/fbf [125110,118247] 0 2024-02-22T00:34:06.001 INFO:tasks.workunit.client.0.smithi049.stdout:7/990: creat d1/d49/d5a/d112/d122/f165 x:0 0 0 2024-02-22T00:34:06.001 INFO:tasks.workunit.client.0.smithi049.stdout:2/939: stat d2/f6 0 2024-02-22T00:34:06.005 INFO:tasks.workunit.client.0.smithi049.stdout:2/940: read d2/d9/dd/d4d/da7/dd2/fe1 [850437,47755] 0 2024-02-22T00:34:06.006 INFO:tasks.workunit.client.0.smithi049.stdout:7/991: creat d1/d41/dae/f166 x:0 0 0 2024-02-22T00:34:06.009 INFO:tasks.workunit.client.0.smithi049.stdout:3/807: dwrite d0/d14/d4d/d4e/d4f/d5b/d66/f90 [4194304,4194304] 0 2024-02-22T00:34:06.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/941: write d2/d9/dd/d4d/d5a/fe5 [999199,126622] 0 2024-02-22T00:34:06.015 INFO:tasks.workunit.client.0.smithi049.stdout:7/992: symlink d1/df/d62/d48/d99/l167 0 2024-02-22T00:34:06.016 INFO:tasks.workunit.client.0.smithi049.stdout:7/993: dread - d1/df/d62/f140 zero size 2024-02-22T00:34:06.017 INFO:tasks.workunit.client.0.smithi049.stdout:7/994: chown d1/d41/ff6 811 1 2024-02-22T00:34:06.020 INFO:tasks.workunit.client.0.smithi049.stdout:7/995: fsync d1/df/fe9 0 2024-02-22T00:34:06.020 INFO:tasks.workunit.client.0.smithi049.stdout:3/808: link d0/d14/d4d/d4e/d4f/d5b/f7a d0/d14/d4d/d4e/d56/d5a/dbc/ffd 0 2024-02-22T00:34:06.022 INFO:tasks.workunit.client.0.smithi049.stdout:7/996: readlink d1/df/d62/d1c/d24/d2e/l3c 0 2024-02-22T00:34:06.027 INFO:tasks.workunit.client.0.smithi049.stdout:0/905: write d3/df/d17/fbe [592908,110368] 0 2024-02-22T00:34:06.027 INFO:tasks.workunit.client.0.smithi049.stdout:7/997: chown d1/df/d62/d48/c5b 1605200 1 2024-02-22T00:34:06.027 INFO:tasks.workunit.client.0.smithi049.stdout:3/809: rename d0/d14/d4d/d4e/d4f/d5b/d66/f70 to d0/dd/d26/d2e/d52/d6e/deb/ffe 0 2024-02-22T00:34:06.029 INFO:tasks.workunit.client.0.smithi049.stdout:6/985: sync 2024-02-22T00:34:06.029 INFO:tasks.workunit.client.0.smithi049.stdout:2/942: dwrite d2/d9/de/d3a/d6d/fd9 [0,4194304] 0 2024-02-22T00:34:06.037 INFO:tasks.workunit.client.0.smithi049.stdout:3/810: fsync d0/d14/d4d/d4e/d56/d5a/dbc/ffd 0 2024-02-22T00:34:06.038 INFO:tasks.workunit.client.0.smithi049.stdout:3/811: chown d0/dd/cd6 441 1 2024-02-22T00:34:06.039 INFO:tasks.workunit.client.0.smithi049.stdout:0/906: dwrite d3/df/fc5 [0,4194304] 0 2024-02-22T00:34:06.039 INFO:tasks.workunit.client.0.smithi049.stdout:7/998: link d1/d49/d5a/d112/d122/l9a d1/d41/d55/d89/l168 0 2024-02-22T00:34:06.040 INFO:tasks.workunit.client.0.smithi049.stdout:6/986: truncate d3/fa1 3872506 0 2024-02-22T00:34:06.041 INFO:tasks.workunit.client.0.smithi049.stdout:3/812: readlink d0/d14/d4d/d4e/d56/d5a/ld0 0 2024-02-22T00:34:06.044 INFO:tasks.workunit.client.0.smithi049.stdout:3/813: mknod d0/d59/d87/cff 0 2024-02-22T00:34:06.044 INFO:tasks.workunit.client.0.smithi049.stdout:0/907: mkdir d3/df/d59/d60/d11d 0 2024-02-22T00:34:06.046 INFO:tasks.workunit.client.0.smithi049.stdout:6/987: truncate d3/f43 11686 0 2024-02-22T00:34:06.046 INFO:tasks.workunit.client.0.smithi049.stdout:7/999: symlink d1/d41/d28/d10c/l169 0 2024-02-22T00:34:06.047 INFO:tasks.workunit.client.0.smithi049.stdout:0/908: symlink d3/d6/ddb/l11e 0 2024-02-22T00:34:06.048 INFO:tasks.workunit.client.0.smithi049.stdout:6/988: chown d3/d16/f10c 30086 1 2024-02-22T00:34:06.050 INFO:tasks.workunit.client.0.smithi049.stdout:0/909: chown d3/d6/d8/fba 956 1 2024-02-22T00:34:06.052 INFO:tasks.workunit.client.0.smithi049.stdout:0/910: fsync d3/fa9 0 2024-02-22T00:34:06.052 INFO:tasks.workunit.client.0.smithi049.stdout:3/814: rename d0/dd/d26/d2e/d52/d6e/l82 to d0/d14/d4d/d4e/l100 0 2024-02-22T00:34:06.053 INFO:tasks.workunit.client.0.smithi049.stdout:6/989: mkdir d3/d36/d70/dcc/d4d/d8b/d151 0 2024-02-22T00:34:06.053 INFO:tasks.workunit.client.0.smithi049.stdout:0/911: fsync d3/d1e/f6a 0 2024-02-22T00:34:06.055 INFO:tasks.workunit.client.0.smithi049.stdout:0/912: write d3/d92/f10f [821908,30882] 0 2024-02-22T00:34:06.057 INFO:tasks.workunit.client.0.smithi049.stdout:0/913: write d3/df/d17/fbe [1497435,93013] 0 2024-02-22T00:34:06.063 INFO:tasks.workunit.client.0.smithi049.stdout:6/990: rename d3/d36/d57/d75/dce/f149 to d3/d36/d70/dcc/d4d/d8b/f152 0 2024-02-22T00:34:06.068 INFO:tasks.workunit.client.0.smithi049.stdout:0/914: mkdir d3/d6/d11f 0 2024-02-22T00:34:06.068 INFO:tasks.workunit.client.0.smithi049.stdout:6/991: creat d3/d36/d70/df8/d144/db3/f153 x:0 0 0 2024-02-22T00:34:06.074 INFO:tasks.workunit.client.0.smithi049.stdout:6/992: symlink d3/d64/d60/da0/l154 0 2024-02-22T00:34:06.082 INFO:tasks.workunit.client.0.smithi049.stdout:6/993: rename d3/d64/d59/ff4 to d3/d64/d59/d72/d92/d112/d138/f155 0 2024-02-22T00:34:06.085 INFO:tasks.workunit.client.0.smithi049.stdout:6/994: mkdir d3/d37/d156 0 2024-02-22T00:34:06.090 INFO:tasks.workunit.client.0.smithi049.stdout:6/995: unlink d3/d36/d70/df8/d109/f140 0 2024-02-22T00:34:06.095 INFO:tasks.workunit.client.0.smithi049.stdout:6/996: write d3/d64/d60/f121 [272334,33975] 0 2024-02-22T00:34:06.100 INFO:tasks.workunit.client.0.smithi049.stdout:6/997: dread - d3/d64/d60/da0/ffa zero size 2024-02-22T00:34:06.103 INFO:tasks.workunit.client.0.smithi049.stdout:0/915: dwrite d3/d6/d8/d36/d81/fb1 [0,4194304] 0 2024-02-22T00:34:06.108 INFO:tasks.workunit.client.0.smithi049.stdout:6/998: mknod d3/d36/d70/df8/d144/c157 0 2024-02-22T00:34:06.109 INFO:tasks.workunit.client.0.smithi049.stdout:0/916: creat d3/d6/d8/d36/de6/f120 x:0 0 0 2024-02-22T00:34:06.123 INFO:tasks.workunit.client.0.smithi049.stdout:0/917: rename d3/df/d48/d63/fca to d3/d6/d8/de0/f121 0 2024-02-22T00:34:06.123 INFO:tasks.workunit.client.0.smithi049.stdout:6/999: dwrite d3/f76 [0,4194304] 0 2024-02-22T00:34:06.129 INFO:tasks.workunit.client.0.smithi049.stdout:0/918: rename d3/f49 to d3/d6/d11f/f122 0 2024-02-22T00:34:06.134 INFO:tasks.workunit.client.0.smithi049.stdout:0/919: mkdir d3/d6/d8/d36/d81/d123 0 2024-02-22T00:34:06.144 INFO:tasks.workunit.client.0.smithi049.stdout:0/920: dwrite d3/df/d48/d6f/d90/f31 [0,4194304] 0 2024-02-22T00:34:06.163 INFO:tasks.workunit.client.0.smithi049.stdout:0/921: write d3/df/d48/d91/fbf [109931,117398] 0 2024-02-22T00:34:06.172 INFO:tasks.workunit.client.0.smithi049.stdout:0/922: dwrite d3/df/d48/d6f/d90/dcc/faa [0,4194304] 0 2024-02-22T00:34:06.174 INFO:tasks.workunit.client.0.smithi049.stdout:0/923: stat d3/df/d48 0 2024-02-22T00:34:06.180 INFO:tasks.workunit.client.0.smithi049.stdout:0/924: write d3/f43 [1370584,99378] 0 2024-02-22T00:34:06.192 INFO:tasks.workunit.client.0.smithi049.stdout:0/925: link d3/df/d17/d50/d62/cee d3/d92/c124 0 2024-02-22T00:34:06.193 INFO:tasks.workunit.client.0.smithi049.stdout:0/926: write d3/d1e/d58/f7c [4716956,43925] 0 2024-02-22T00:34:06.199 INFO:tasks.workunit.client.0.smithi049.stdout:0/927: unlink d3/df/d48/d63/l8d 0 2024-02-22T00:34:06.203 INFO:tasks.workunit.client.0.smithi049.stdout:0/928: rename d3/d1e/l2a to d3/df/d48/d63/de5/l125 0 2024-02-22T00:34:06.207 INFO:tasks.workunit.client.0.smithi049.stdout:0/929: unlink d3/d6/d8/l3d 0 2024-02-22T00:34:06.208 INFO:tasks.workunit.client.0.smithi049.stdout:0/930: fsync d3/df/faf 0 2024-02-22T00:34:06.221 INFO:tasks.workunit.client.0.smithi049.stdout:0/931: dwrite d3/df/d17/d50/d62/fb3 [4194304,4194304] 0 2024-02-22T00:34:06.227 INFO:tasks.workunit.client.0.smithi049.stdout:0/932: dwrite d3/d92/f10f [0,4194304] 0 2024-02-22T00:34:06.236 INFO:tasks.workunit.client.0.smithi049.stdout:0/933: dwrite d3/df/fc5 [0,4194304] 0 2024-02-22T00:34:06.242 INFO:tasks.workunit.client.0.smithi049.stdout:0/934: read d3/d1e/d58/f8f [1496537,69868] 0 2024-02-22T00:34:06.244 INFO:tasks.workunit.client.0.smithi049.stdout:0/935: write d3/df/d17/f24 [7577132,34009] 0 2024-02-22T00:34:06.252 INFO:tasks.workunit.client.0.smithi049.stdout:0/936: dwrite d3/df/d7f/f100 [0,4194304] 0 2024-02-22T00:34:06.254 INFO:tasks.workunit.client.0.smithi049.stdout:0/937: write d3/df/d48/d91/fbf [896152,41807] 0 2024-02-22T00:34:06.263 INFO:tasks.workunit.client.0.smithi049.stdout:0/938: dwrite d3/d1e/ddf/ff5 [0,4194304] 0 2024-02-22T00:34:06.264 INFO:tasks.workunit.client.0.smithi049.stdout:5/942: sync 2024-02-22T00:34:06.273 INFO:tasks.workunit.client.0.smithi049.stdout:0/939: truncate d3/df/d17/f24 18381 0 2024-02-22T00:34:06.276 INFO:tasks.workunit.client.0.smithi049.stdout:5/943: dwrite d0/d20/dad/d142/db6/dc3/d70/db1/dbe/fff [0,4194304] 0 2024-02-22T00:34:06.276 INFO:tasks.workunit.client.0.smithi049.stdout:0/940: chown d3/d1e/c55 128 1 2024-02-22T00:34:06.279 INFO:tasks.workunit.client.0.smithi049.stdout:8/946: sync 2024-02-22T00:34:06.279 INFO:tasks.workunit.client.0.smithi049.stdout:2/943: sync 2024-02-22T00:34:06.279 INFO:tasks.workunit.client.0.smithi049.stdout:1/983: sync 2024-02-22T00:34:06.279 INFO:tasks.workunit.client.0.smithi049.stdout:3/815: sync 2024-02-22T00:34:06.281 INFO:tasks.workunit.client.0.smithi049.stdout:2/944: truncate d2/dda/d63/f13d 587353 0 2024-02-22T00:34:06.282 INFO:tasks.workunit.client.0.smithi049.stdout:8/947: write d1/d2/d5/d56/dd2/fef [667516,100170] 0 2024-02-22T00:34:06.284 INFO:tasks.workunit.client.0.smithi049.stdout:1/984: mknod d2/d8/db/c146 0 2024-02-22T00:34:06.286 INFO:tasks.workunit.client.0.smithi049.stdout:8/948: chown d1/d2/da5/d15/d30/d36/d52/c64 45677332 1 2024-02-22T00:34:06.290 INFO:tasks.workunit.client.0.smithi049.stdout:5/944: dwrite d0/f48 [0,4194304] 0 2024-02-22T00:34:06.293 INFO:tasks.workunit.client.0.smithi049.stdout:5/945: mkdir d0/d149 0 2024-02-22T00:34:06.293 INFO:tasks.workunit.client.0.smithi049.stdout:0/941: truncate d3/d1e/f5a 952250 0 2024-02-22T00:34:06.296 INFO:tasks.workunit.client.0.smithi049.stdout:1/985: getdents d2/d8/db/d25/d40/d71/d11c/d12b 0 2024-02-22T00:34:06.296 INFO:tasks.workunit.client.0.smithi049.stdout:8/949: read d1/d2/f9a [869883,67040] 0 2024-02-22T00:34:06.296 INFO:tasks.workunit.client.0.smithi049.stdout:5/946: creat d0/d20/dad/d142/db6/dc3/dea/d12e/f14a x:0 0 0 2024-02-22T00:34:06.304 INFO:tasks.workunit.client.0.smithi049.stdout:5/947: rename d0/d20/dad/d142/db6/dc3/d6f/d94/f12 to d0/d20/dad/f14b 0 2024-02-22T00:34:06.304 INFO:tasks.workunit.client.0.smithi049.stdout:5/948: write d0/f37 [5064793,40794] 0 2024-02-22T00:34:06.307 INFO:tasks.workunit.client.0.smithi049.stdout:1/986: link d2/d8/db/d25/d40/d41/d5b/fd9 d2/d8/d4c/f147 0 2024-02-22T00:34:06.308 INFO:tasks.workunit.client.0.smithi049.stdout:0/942: dread d3/f13 [0,4194304] 0 2024-02-22T00:34:06.312 INFO:tasks.workunit.client.0.smithi049.stdout:0/943: read d3/df/d48/d63/f97 [2728005,77583] 0 2024-02-22T00:34:06.315 INFO:tasks.workunit.client.0.smithi049.stdout:5/949: truncate d0/d20/dad/d142/db6/dc3/d6f/d94/d74/db2/f138 1250637 0 2024-02-22T00:34:06.317 INFO:tasks.workunit.client.0.smithi049.stdout:1/987: mkdir d2/d8/db/d25/d40/d4d/d102/d133/d148 0 2024-02-22T00:34:06.317 INFO:tasks.workunit.client.0.smithi049.stdout:8/950: dwrite d1/d2/da5/d15/d30/d36/d52/daf/fd9 [0,4194304] 0 2024-02-22T00:34:06.321 INFO:tasks.workunit.client.0.smithi049.stdout:8/951: write d1/f1e [1451947,91866] 0 2024-02-22T00:34:06.323 INFO:tasks.workunit.client.0.smithi049.stdout:8/952: write d1/d2/da5/d15/d30/d36/d52/daf/dde/f13a [5198781,125414] 0 2024-02-22T00:34:06.323 INFO:tasks.workunit.client.0.smithi049.stdout:5/950: creat d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d115/f14c x:0 0 0 2024-02-22T00:34:06.325 INFO:tasks.workunit.client.0.smithi049.stdout:0/944: symlink d3/df/d17/l126 0 2024-02-22T00:34:06.326 INFO:tasks.workunit.client.0.smithi049.stdout:1/988: mknod d2/d66/c149 0 2024-02-22T00:34:06.326 INFO:tasks.workunit.client.0.smithi049.stdout:5/951: chown d0/d20/dad/d142/db6/ced 3368 1 2024-02-22T00:34:06.326 INFO:tasks.workunit.client.0.smithi049.stdout:0/945: chown d3/df/d48/d6f/d7a/cd7 5038 1 2024-02-22T00:34:06.327 INFO:tasks.workunit.client.0.smithi049.stdout:1/989: read - d2/d8/db/f10d zero size 2024-02-22T00:34:06.328 INFO:tasks.workunit.client.0.smithi049.stdout:5/952: fsync d0/d20/dad/d142/db6/dc3/d7c/f96 0 2024-02-22T00:34:06.329 INFO:tasks.workunit.client.0.smithi049.stdout:1/990: read d2/d8/db/d25/f48 [611593,15810] 0 2024-02-22T00:34:06.331 INFO:tasks.workunit.client.0.smithi049.stdout:8/953: mknod d1/d2/da5/d15/d30/d4b/d51/c13b 0 2024-02-22T00:34:06.335 INFO:tasks.workunit.client.0.smithi049.stdout:5/953: mkdir d0/d20/dad/d142/db6/dc3/d6f/d94/d9c/d14d 0 2024-02-22T00:34:06.335 INFO:tasks.workunit.client.0.smithi049.stdout:1/991: symlink d2/d8/db/d25/d40/d41/d68/d78/l14a 0 2024-02-22T00:34:06.337 INFO:tasks.workunit.client.0.smithi049.stdout:1/992: fsync d2/d8/db/f10d 0 2024-02-22T00:34:06.340 INFO:tasks.workunit.client.0.smithi049.stdout:8/954: write d1/d2/da5/d15/d65/d6a/f11b [873490,111372] 0 2024-02-22T00:34:06.340 INFO:tasks.workunit.client.0.smithi049.stdout:1/993: chown d2/ff6 44329 1 2024-02-22T00:34:06.344 INFO:tasks.workunit.client.0.smithi049.stdout:8/955: chown d1/d2/d5/d1b/d39/f6c 32 1 2024-02-22T00:34:06.344 INFO:tasks.workunit.client.0.smithi049.stdout:5/954: dwrite d0/d20/dad/d142/db6/dc3/d6f/d94/d74/f105 [0,4194304] 0 2024-02-22T00:34:06.348 INFO:tasks.workunit.client.0.smithi049.stdout:8/956: creat d1/d2/dd7/f13c x:0 0 0 2024-02-22T00:34:06.350 INFO:tasks.workunit.client.0.smithi049.stdout:8/957: fdatasync d1/d2/d5/f2c 0 2024-02-22T00:34:06.350 INFO:tasks.workunit.client.0.smithi049.stdout:1/994: unlink d2/d8/db/d25/d40/d41/d68/f80 0 2024-02-22T00:34:06.350 INFO:tasks.workunit.client.0.smithi049.stdout:5/955: chown d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d115/lba 56363188 1 2024-02-22T00:34:06.350 INFO:tasks.workunit.client.0.smithi049.stdout:0/946: dread d3/d1e/d58/f8f [0,4194304] 0 2024-02-22T00:34:06.352 INFO:tasks.workunit.client.0.smithi049.stdout:0/947: chown d3/d6/d29 506 1 2024-02-22T00:34:06.363 INFO:tasks.workunit.client.0.smithi049.stdout:0/948: mknod d3/df/d17/d50/d62/c127 0 2024-02-22T00:34:06.367 INFO:tasks.workunit.client.0.smithi049.stdout:5/956: dwrite d0/d26/f144 [0,4194304] 0 2024-02-22T00:34:06.384 INFO:tasks.workunit.client.0.smithi049.stdout:0/949: rmdir d3/df/d17/d50/d62 39 2024-02-22T00:34:06.386 INFO:tasks.workunit.client.0.smithi049.stdout:8/958: link d1/d2/da5/d15/d30/d4b/d51/f6e d1/d2/da5/d15/d65/d6a/de5/f13d 0 2024-02-22T00:34:06.387 INFO:tasks.workunit.client.0.smithi049.stdout:0/950: truncate d3/df/d48/fc4 148280 0 2024-02-22T00:34:06.388 INFO:tasks.workunit.client.0.smithi049.stdout:8/959: mkdir d1/d2/da5/d15/d13e 0 2024-02-22T00:34:06.391 INFO:tasks.workunit.client.0.smithi049.stdout:0/951: mknod d3/df/d48/d63/de5/c128 0 2024-02-22T00:34:06.393 INFO:tasks.workunit.client.0.smithi049.stdout:8/960: dread d1/d2/d5/d1b/d39/d81/df3/fbb [0,4194304] 0 2024-02-22T00:34:06.425 INFO:tasks.workunit.client.0.smithi049.stdout:8/961: truncate d1/d2/da5/d15/d65/d6a/faa 707949 0 2024-02-22T00:34:06.432 INFO:tasks.workunit.client.0.smithi049.stdout:8/962: dwrite d1/d2/dd7/f13c [0,4194304] 0 2024-02-22T00:34:06.434 INFO:tasks.workunit.client.0.smithi049.stdout:8/963: creat d1/d2/d5/d1b/d39/d81/dfc/f13f x:0 0 0 2024-02-22T00:34:06.485 INFO:tasks.workunit.client.0.smithi049.stdout:8/964: write d1/d2/da5/d15/d30/d36/d52/daf/dde/f118 [306402,18251] 0 2024-02-22T00:34:06.489 INFO:tasks.workunit.client.0.smithi049.stdout:8/965: rename d1/d2/da5/d15/d65 to d1/d2/da5/d15/d10f/d140 0 2024-02-22T00:34:06.492 INFO:tasks.workunit.client.0.smithi049.stdout:8/966: symlink d1/d2/da5/d15/d30/d36/d52/daf/dde/l141 0 2024-02-22T00:34:06.496 INFO:tasks.workunit.client.0.smithi049.stdout:8/967: creat d1/d2/da5/d15/d10f/d140/d6a/de5/f142 x:0 0 0 2024-02-22T00:34:06.498 INFO:tasks.workunit.client.0.smithi049.stdout:8/968: fsync d1/d4c/fec 0 2024-02-22T00:34:06.506 INFO:tasks.workunit.client.0.smithi049.stdout:8/969: dwrite d1/d2/da5/d15/d10f/d140/f12f [0,4194304] 0 2024-02-22T00:34:06.514 INFO:tasks.workunit.client.0.smithi049.stdout:8/970: write d1/d4c/fec [555336,84573] 0 2024-02-22T00:34:06.519 INFO:tasks.workunit.client.0.smithi049.stdout:8/971: mkdir d1/d2/dd7/d143 0 2024-02-22T00:34:06.521 INFO:tasks.workunit.client.0.smithi049.stdout:8/972: chown d1/d2/da5/d15/d30/d4b/d51/le2 4 1 2024-02-22T00:34:06.525 INFO:tasks.workunit.client.0.smithi049.stdout:8/973: dread d1/d2/da5/d15/d30/f71 [0,4194304] 0 2024-02-22T00:34:06.528 INFO:tasks.workunit.client.0.smithi049.stdout:8/974: chown d1/d2/da5/da3/f129 620940802 1 2024-02-22T00:34:06.530 INFO:tasks.workunit.client.0.smithi049.stdout:8/975: getdents d1/d2/da5/d15/d30/d36/dcd/d10c 0 2024-02-22T00:34:06.536 INFO:tasks.workunit.client.0.smithi049.stdout:8/976: write d1/d2/d5/d1b/d39/d81/df3/fc3 [506702,48160] 0 2024-02-22T00:34:06.539 INFO:tasks.workunit.client.0.smithi049.stdout:8/977: dread d1/d2/da5/d15/d10f/f115 [0,4194304] 0 2024-02-22T00:34:06.543 INFO:tasks.workunit.client.0.smithi049.stdout:8/978: dread - d1/d2/da5/d15/d30/d36/d52/daf/dcb/fe6 zero size 2024-02-22T00:34:06.545 INFO:tasks.workunit.client.0.smithi049.stdout:8/979: creat d1/d2/da5/d15/d10f/d140/d6a/f144 x:0 0 0 2024-02-22T00:34:06.552 INFO:tasks.workunit.client.0.smithi049.stdout:8/980: dwrite d1/d2/da5/ff5 [0,4194304] 0 2024-02-22T00:34:06.553 INFO:tasks.workunit.client.0.smithi049.stdout:8/981: chown d1/d2/d5/d56/c5c 433181699 1 2024-02-22T00:34:06.556 INFO:tasks.workunit.client.0.smithi049.stdout:8/982: chown d1/d2/da5/deb/f5f 125 1 2024-02-22T00:34:06.558 INFO:tasks.workunit.client.0.smithi049.stdout:8/983: fdatasync d1/dd1/f10d 0 2024-02-22T00:34:06.562 INFO:tasks.workunit.client.0.smithi049.stdout:8/984: fdatasync d1/d2/d5/d1b/d39/d81/df3/fbb 0 2024-02-22T00:34:06.565 INFO:tasks.workunit.client.0.smithi049.stdout:8/985: mkdir d1/d2/d5/d1b/d39/d60/df2/d145 0 2024-02-22T00:34:06.572 INFO:tasks.workunit.client.0.smithi049.stdout:8/986: dwrite d1/dd1/fea [0,4194304] 0 2024-02-22T00:34:06.574 INFO:tasks.workunit.client.0.smithi049.stdout:8/987: read - d1/d2/da5/d15/d10f/d140/d6a/de5/f142 zero size 2024-02-22T00:34:06.582 INFO:tasks.workunit.client.0.smithi049.stdout:8/988: rename d1/d2/dd7/f13c to d1/d2/da5/d15/d30/d36/dcd/f146 0 2024-02-22T00:34:06.585 INFO:tasks.workunit.client.0.smithi049.stdout:8/989: symlink d1/d2/d5/d1b/d39/d60/df2/l147 0 2024-02-22T00:34:06.596 INFO:tasks.workunit.client.0.smithi049.stdout:8/990: dread d1/d2/d5/d1b/d39/d81/df3/fc3 [0,4194304] 0 2024-02-22T00:34:06.598 INFO:tasks.workunit.client.0.smithi049.stdout:8/991: stat d1/d2/da5/d15/d30/d36/d52/daf/dde/d133 0 2024-02-22T00:34:06.603 INFO:tasks.workunit.client.0.smithi049.stdout:8/992: rmdir d1/d2/da5/d15/d13e 0 2024-02-22T00:34:06.604 INFO:tasks.workunit.client.0.smithi049.stdout:8/993: read d1/d2/da5/d15/d33/fbc [1987242,35716] 0 2024-02-22T00:34:06.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/994: creat d1/d2/d5/d1b/d39/d81/dfc/d12b/f148 x:0 0 0 2024-02-22T00:34:06.607 INFO:tasks.workunit.client.0.smithi049.stdout:8/995: write d1/d2/f3 [5215746,76561] 0 2024-02-22T00:34:06.611 INFO:tasks.workunit.client.0.smithi049.stdout:8/996: truncate d1/d2/d5/d1b/f7f 2844014 0 2024-02-22T00:34:06.612 INFO:tasks.workunit.client.0.smithi049.stdout:8/997: stat d1/d2/d5/d1b/d39/d81/df3/l59 0 2024-02-22T00:34:06.615 INFO:tasks.workunit.client.0.smithi049.stdout:8/998: fdatasync d1/d2/da5/f78 0 2024-02-22T00:34:06.621 INFO:tasks.workunit.client.0.smithi049.stdout:8/999: dwrite d1/d2/d5/d56/fa4 [0,4194304] 0 2024-02-22T00:34:06.624 INFO:tasks.workunit.client.0.smithi049.stdout:3/816: sync 2024-02-22T00:34:06.634 INFO:tasks.workunit.client.0.smithi049.stdout:3/817: dwrite d0/d14/d4d/d4e/d4f/d5b/d76/fb9 [0,4194304] 0 2024-02-22T00:34:06.635 INFO:tasks.workunit.client.0.smithi049.stdout:3/818: readlink d0/d59/ld1 0 2024-02-22T00:34:06.643 INFO:tasks.workunit.client.0.smithi049.stdout:3/819: dwrite d0/d59/ffc [0,4194304] 0 2024-02-22T00:34:06.651 INFO:tasks.workunit.client.0.smithi049.stdout:3/820: getdents d0/dd/d26/d2e/d52 0 2024-02-22T00:34:06.651 INFO:tasks.workunit.client.0.smithi049.stdout:3/821: readlink d0/d59/ld1 0 2024-02-22T00:34:06.654 INFO:tasks.workunit.client.0.smithi049.stdout:3/822: creat d0/d14/d4d/d4e/d56/f101 x:0 0 0 2024-02-22T00:34:06.661 INFO:tasks.workunit.client.0.smithi049.stdout:3/823: truncate d0/d14/d4d/d4e/d4f/d5b/d76/fbe 102844 0 2024-02-22T00:34:06.675 INFO:tasks.workunit.client.0.smithi049.stdout:3/824: dread d0/d14/f8e [0,4194304] 0 2024-02-22T00:34:06.677 INFO:tasks.workunit.client.0.smithi049.stdout:3/825: rename d0/d14/d4d/d4e to d0/d14/d4d/d4e/d4f/d5b/d66/d102 22 2024-02-22T00:34:06.686 INFO:tasks.workunit.client.0.smithi049.stdout:3/826: dwrite d0/d14/db8/fb3 [0,4194304] 0 2024-02-22T00:34:06.690 INFO:tasks.workunit.client.0.smithi049.stdout:3/827: unlink d0/dd/d6f/f94 0 2024-02-22T00:34:06.690 INFO:tasks.workunit.client.0.smithi049.stdout:3/828: truncate d0/dd/fc0 847921 0 2024-02-22T00:34:06.693 INFO:tasks.workunit.client.0.smithi049.stdout:3/829: read d0/dd/d26/f30 [174605,71548] 0 2024-02-22T00:34:06.708 INFO:tasks.workunit.client.0.smithi049.stdout:3/830: dread d0/d59/d8f/fe4 [0,4194304] 0 2024-02-22T00:34:06.710 INFO:tasks.workunit.client.0.smithi049.stdout:3/831: truncate d0/d14/d4d/d4e/d56/dc1/dd3/fdc 49164 0 2024-02-22T00:34:06.712 INFO:tasks.workunit.client.0.smithi049.stdout:3/832: unlink d0/d14/d4d/ca2 0 2024-02-22T00:34:06.714 INFO:tasks.workunit.client.0.smithi049.stdout:3/833: mkdir d0/d14/d4d/d4e/d56/d5a/dc4/d103 0 2024-02-22T00:34:06.716 INFO:tasks.workunit.client.0.smithi049.stdout:3/834: fsync d0/d14/d4d/d4e/d56/d5a/f92 0 2024-02-22T00:34:06.722 INFO:tasks.workunit.client.0.smithi049.stdout:3/835: truncate d0/d14/d4d/d4e/fd4 3955285 0 2024-02-22T00:34:06.729 INFO:tasks.workunit.client.0.smithi049.stdout:3/836: dwrite d0/d59/ffc [4194304,4194304] 0 2024-02-22T00:34:06.731 INFO:tasks.workunit.client.0.smithi049.stdout:3/837: write d0/d14/db8/fb3 [5069238,113470] 0 2024-02-22T00:34:06.735 INFO:tasks.workunit.client.0.smithi049.stdout:3/838: unlink d0/dd/lbb 0 2024-02-22T00:34:06.737 INFO:tasks.workunit.client.0.smithi049.stdout:3/839: mkdir d0/d59/d87/d104 0 2024-02-22T00:34:06.937 INFO:tasks.workunit.client.0.smithi049.stdout:5/957: sync 2024-02-22T00:34:06.937 INFO:tasks.workunit.client.0.smithi049.stdout:2/945: sync 2024-02-22T00:34:06.937 INFO:tasks.workunit.client.0.smithi049.stdout:1/995: sync 2024-02-22T00:34:06.937 INFO:tasks.workunit.client.0.smithi049.stdout:0/952: sync 2024-02-22T00:34:06.940 INFO:tasks.workunit.client.0.smithi049.stdout:2/946: symlink d2/l14f 0 2024-02-22T00:34:06.940 INFO:tasks.workunit.client.0.smithi049.stdout:5/958: chown d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d7a/df7 3094 1 2024-02-22T00:34:06.944 INFO:tasks.workunit.client.0.smithi049.stdout:1/996: unlink d2/d8/db/d25/d40/d71/f125 0 2024-02-22T00:34:06.950 INFO:tasks.workunit.client.0.smithi049.stdout:5/959: mkdir d0/d20/dad/d142/db6/dc3/d6f/d94/d11b/d132/d148/d14e 0 2024-02-22T00:34:06.950 INFO:tasks.workunit.client.0.smithi049.stdout:5/960: readlink d0/l111 0 2024-02-22T00:34:06.955 INFO:tasks.workunit.client.0.smithi049.stdout:5/961: fdatasync d0/d20/dc5/df5/df9/ffd 0 2024-02-22T00:34:06.956 INFO:tasks.workunit.client.0.smithi049.stdout:0/953: symlink d3/df/d17/d50/d62/l129 0 2024-02-22T00:34:06.962 INFO:tasks.workunit.client.0.smithi049.stdout:2/947: rename d2/d9/de/d3a/d6d/da6/cc1 to d2/dda/d5d/c150 0 2024-02-22T00:34:06.966 INFO:tasks.workunit.client.0.smithi049.stdout:1/997: getdents d2/d8/db/d25/d40/d41/d10f 0 2024-02-22T00:34:06.966 INFO:tasks.workunit.client.0.smithi049.stdout:5/962: write d0/d20/dad/d142/db6/dc3/ff6 [677231,129800] 0 2024-02-22T00:34:06.967 INFO:tasks.workunit.client.0.smithi049.stdout:0/954: mkdir d3/d6/d8/d36/d81/dc3/d12a 0 2024-02-22T00:34:06.967 INFO:tasks.workunit.client.0.smithi049.stdout:2/948: creat d2/dda/d5d/d11f/f151 x:0 0 0 2024-02-22T00:34:06.968 INFO:tasks.workunit.client.0.smithi049.stdout:1/998: chown d2/d7b/ddd/d11b 240 1 2024-02-22T00:34:06.972 INFO:tasks.workunit.client.0.smithi049.stdout:5/963: fdatasync d0/d20/f7b 0 2024-02-22T00:34:06.972 INFO:tasks.workunit.client.0.smithi049.stdout:0/955: chown d3/d6/d8/d36/lc9 5733331 1 2024-02-22T00:34:06.972 INFO:tasks.workunit.client.0.smithi049.stdout:3/840: sync 2024-02-22T00:34:06.975 INFO:tasks.workunit.client.0.smithi049.stdout:3/841: dread - d0/d14/d4d/d4e/d56/dc1/fc6 zero size 2024-02-22T00:34:06.976 INFO:tasks.workunit.client.0.smithi049.stdout:5/964: creat d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d131/f14f x:0 0 0 2024-02-22T00:34:06.980 INFO:tasks.workunit.client.0.smithi049.stdout:0/956: link d3/fa9 d3/d6/d8/de0/f12b 0 2024-02-22T00:34:06.983 INFO:tasks.workunit.client.0.smithi049.stdout:2/949: truncate d2/d9/de/d15/f8b 7205140 0 2024-02-22T00:34:06.984 INFO:tasks.workunit.client.0.smithi049.stdout:5/965: link d0/d20/d50/cbc d0/d149/c150 0 2024-02-22T00:34:06.984 INFO:tasks.workunit.client.0.smithi049.stdout:3/842: dwrite d0/d14/f69 [0,4194304] 0 2024-02-22T00:34:06.986 INFO:tasks.workunit.client.0.smithi049.stdout:5/966: write d0/d20/dad/daf/fe5 [971885,53547] 0 2024-02-22T00:34:06.987 INFO:tasks.workunit.client.0.smithi049.stdout:1/999: write d2/d8/db/f1c [322470,80264] 0 2024-02-22T00:34:06.987 INFO:tasks.workunit.client.0.smithi049.stdout:3/843: dread - d0/d14/d4d/d4e/d56/dc1/fc6 zero size 2024-02-22T00:34:06.988 INFO:tasks.workunit.client.0.smithi049.stdout:2/950: fdatasync d2/d9/dd/d4d/d5a/fa3 0 2024-02-22T00:34:06.989 INFO:tasks.workunit.client.0.smithi049.stdout:2/951: dread - d2/dda/fed zero size 2024-02-22T00:34:06.994 INFO:tasks.workunit.client.0.smithi049.stdout:5/967: symlink d0/d20/dad/d142/db6/dc3/l151 0 2024-02-22T00:34:06.995 INFO:tasks.workunit.client.0.smithi049.stdout:3/844: dread d0/dd/f9 [0,4194304] 0 2024-02-22T00:34:06.997 INFO:tasks.workunit.client.0.smithi049.stdout:5/968: stat d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d7a/df7/f13e 0 2024-02-22T00:34:06.999 INFO:tasks.workunit.client.0.smithi049.stdout:2/952: creat d2/d9/de/d3a/d6d/d140/f152 x:0 0 0 2024-02-22T00:34:07.000 INFO:tasks.workunit.client.0.smithi049.stdout:3/845: mkdir d0/dd/d26/d2e/d52/d6e/deb/d105 0 2024-02-22T00:34:07.002 INFO:tasks.workunit.client.0.smithi049.stdout:0/957: dread d3/d1e/f6a [0,4194304] 0 2024-02-22T00:34:07.002 INFO:tasks.workunit.client.0.smithi049.stdout:5/969: read d0/d20/dad/d142/db6/dc3/d6f/f61 [192461,51810] 0 2024-02-22T00:34:07.003 INFO:tasks.workunit.client.0.smithi049.stdout:3/846: stat d0/d14/d4d/d4e/d4f/d5b 0 2024-02-22T00:34:07.004 INFO:tasks.workunit.client.0.smithi049.stdout:2/953: unlink d2/d9/de/d15/d1b/dc4/df7/l134 0 2024-02-22T00:34:07.006 INFO:tasks.workunit.client.0.smithi049.stdout:5/970: symlink d0/d20/dad/d142/db6/dc3/d7c/l152 0 2024-02-22T00:34:07.007 INFO:tasks.workunit.client.0.smithi049.stdout:3/847: creat d0/d14/d4d/d4e/d4f/d5b/d66/f106 x:0 0 0 2024-02-22T00:34:07.008 INFO:tasks.workunit.client.0.smithi049.stdout:5/971: read d0/d20/f6a [526060,126010] 0 2024-02-22T00:34:07.009 INFO:tasks.workunit.client.0.smithi049.stdout:3/848: write d0/dd/d26/d2e/f8d [3220172,52064] 0 2024-02-22T00:34:07.011 INFO:tasks.workunit.client.0.smithi049.stdout:0/958: link d3/cce d3/df/d17/d50/c12c 0 2024-02-22T00:34:07.011 INFO:tasks.workunit.client.0.smithi049.stdout:2/954: link d2/d9/de/d10/d2e/d42/d80/dcc/l98 d2/d9/dd/l153 0 2024-02-22T00:34:07.014 INFO:tasks.workunit.client.0.smithi049.stdout:2/955: write d2/d9/dd/d4d/d5a/f147 [40822,28582] 0 2024-02-22T00:34:07.014 INFO:tasks.workunit.client.0.smithi049.stdout:0/959: symlink d3/df/d48/l12d 0 2024-02-22T00:34:07.014 INFO:tasks.workunit.client.0.smithi049.stdout:5/972: rename d0/d20/dad/d142/db6/dc3/d7c/f96 to d0/d20/dc5/f153 0 2024-02-22T00:34:07.018 INFO:tasks.workunit.client.0.smithi049.stdout:3/849: getdents d0/d14/de7 0 2024-02-22T00:34:07.019 INFO:tasks.workunit.client.0.smithi049.stdout:0/960: read d3/d6/fd5 [1262623,13386] 0 2024-02-22T00:34:07.021 INFO:tasks.workunit.client.0.smithi049.stdout:3/850: mkdir d0/d59/d107 0 2024-02-22T00:34:07.022 INFO:tasks.workunit.client.0.smithi049.stdout:0/961: chown d3/df/d17/f24 847591467 1 2024-02-22T00:34:07.023 INFO:tasks.workunit.client.0.smithi049.stdout:5/973: mknod d0/d20/dad/d142/db6/dc3/d6f/d94/d11b/d132/d148/d14e/c154 0 2024-02-22T00:34:07.024 INFO:tasks.workunit.client.0.smithi049.stdout:0/962: chown d3/df/d48/d6f/d90/de3 7 1 2024-02-22T00:34:07.026 INFO:tasks.workunit.client.0.smithi049.stdout:5/974: symlink d0/d20/dad/l155 0 2024-02-22T00:34:07.028 INFO:tasks.workunit.client.0.smithi049.stdout:0/963: mkdir d3/df/d48/d6f/d90/dcc/d12e 0 2024-02-22T00:34:07.028 INFO:tasks.workunit.client.0.smithi049.stdout:3/851: rename d0/d14/d4d/d4e/d56/dc1/fc6 to d0/dd/d26/f108 0 2024-02-22T00:34:07.029 INFO:tasks.workunit.client.0.smithi049.stdout:3/852: chown d0/d59/d8f 31354099 1 2024-02-22T00:34:07.030 INFO:tasks.workunit.client.0.smithi049.stdout:5/975: rmdir d0/d20/dad/d142/db6/dc3/d6f/d94/d11b/d132/d148/d14e 39 2024-02-22T00:34:07.031 INFO:tasks.workunit.client.0.smithi049.stdout:2/956: dread d2/d9/de/d10/d59/f11d [0,4194304] 0 2024-02-22T00:34:07.034 INFO:tasks.workunit.client.0.smithi049.stdout:0/964: truncate d3/df/d48/fc4 669500 0 2024-02-22T00:34:07.037 INFO:tasks.workunit.client.0.smithi049.stdout:2/957: rename d2/d9/dd/d4d/cdb to d2/d9/de/d10/d2e/d42/d80/dcc/c154 0 2024-02-22T00:34:07.038 INFO:tasks.workunit.client.0.smithi049.stdout:3/853: getdents d0/d14/d4d/d4e/d56/d5a/dbc 0 2024-02-22T00:34:07.039 INFO:tasks.workunit.client.0.smithi049.stdout:3/854: chown d0/d59/ffc 880513397 1 2024-02-22T00:34:07.055 INFO:tasks.workunit.client.0.smithi049.stdout:2/958: dread d2/dda/d5d/fe3 [0,4194304] 0 2024-02-22T00:34:07.057 INFO:tasks.workunit.client.0.smithi049.stdout:5/976: dwrite d0/d20/dad/d142/db6/dc3/d6f/f61 [0,4194304] 0 2024-02-22T00:34:07.058 INFO:tasks.workunit.client.0.smithi049.stdout:3/855: dwrite d0/d14/d4d/d4e/d4f/d5b/d76/fa0 [0,4194304] 0 2024-02-22T00:34:07.059 INFO:tasks.workunit.client.0.smithi049.stdout:3/856: chown d0/d59/f42 1 1 2024-02-22T00:34:07.059 INFO:tasks.workunit.client.0.smithi049.stdout:5/977: chown d0/d20/dc5/df5/d11f/c12b 71251 1 2024-02-22T00:34:07.068 INFO:tasks.workunit.client.0.smithi049.stdout:3/857: creat d0/d59/d8f/f109 x:0 0 0 2024-02-22T00:34:07.068 INFO:tasks.workunit.client.0.smithi049.stdout:2/959: rename d2/d9/de/d10/d2e/f49 to d2/d9/dd/d4d/d72/d119/f155 0 2024-02-22T00:34:07.071 INFO:tasks.workunit.client.0.smithi049.stdout:3/858: write d0/f62 [2498555,124306] 0 2024-02-22T00:34:07.074 INFO:tasks.workunit.client.0.smithi049.stdout:2/960: chown d2/d9/dd/d4d/da7/dd2/f13a 107 1 2024-02-22T00:34:07.076 INFO:tasks.workunit.client.0.smithi049.stdout:3/859: creat d0/d14/db8/f10a x:0 0 0 2024-02-22T00:34:07.081 INFO:tasks.workunit.client.0.smithi049.stdout:2/961: rename d2/f95 to d2/dda/f156 0 2024-02-22T00:34:07.089 INFO:tasks.workunit.client.0.smithi049.stdout:3/860: truncate d0/d14/d4d/f36 4193453 0 2024-02-22T00:34:07.094 INFO:tasks.workunit.client.0.smithi049.stdout:2/962: creat d2/d9/dd/d4d/d72/f157 x:0 0 0 2024-02-22T00:34:07.095 INFO:tasks.workunit.client.0.smithi049.stdout:3/861: write d0/dd/d1e/f7f [4881208,106785] 0 2024-02-22T00:34:07.097 INFO:tasks.workunit.client.0.smithi049.stdout:2/963: chown d2/d9/de/d10/d2e/d42/d80/cb5 1 1 2024-02-22T00:34:07.098 INFO:tasks.workunit.client.0.smithi049.stdout:2/964: dread - d2/d9/dd/d74/f14d zero size 2024-02-22T00:34:07.099 INFO:tasks.workunit.client.0.smithi049.stdout:3/862: mkdir d0/d14/d4d/d4e/d56/dc1/d10b 0 2024-02-22T00:34:07.101 INFO:tasks.workunit.client.0.smithi049.stdout:3/863: creat d0/d59/f10c x:0 0 0 2024-02-22T00:34:07.106 INFO:tasks.workunit.client.0.smithi049.stdout:3/864: fsync d0/dd/d26/d2e/d52/f7c 0 2024-02-22T00:34:07.108 INFO:tasks.workunit.client.0.smithi049.stdout:3/865: write d0/f62 [1850590,52299] 0 2024-02-22T00:34:07.110 INFO:tasks.workunit.client.0.smithi049.stdout:2/965: dwrite d2/d9/dd/d4d/da7/f10d [4194304,4194304] 0 2024-02-22T00:34:07.112 INFO:tasks.workunit.client.0.smithi049.stdout:3/866: chown d0/dd/d26/d2e/d52/d6e/cda 42597138 1 2024-02-22T00:34:07.115 INFO:tasks.workunit.client.0.smithi049.stdout:5/978: creat d0/d20/dad/daf/f156 x:0 0 0 2024-02-22T00:34:07.117 INFO:tasks.workunit.client.0.smithi049.stdout:2/966: fdatasync d2/d9/dd/dbb/f145 0 2024-02-22T00:34:07.121 INFO:tasks.workunit.client.0.smithi049.stdout:3/867: link d0/dd/d26/d2e/d52/lc3 d0/d14/d4d/d4e/d56/dc1/l10d 0 2024-02-22T00:34:07.123 INFO:tasks.workunit.client.0.smithi049.stdout:2/967: getdents d2/d9/d17 0 2024-02-22T00:34:07.125 INFO:tasks.workunit.client.0.smithi049.stdout:3/868: mknod d0/d14/db8/c10e 0 2024-02-22T00:34:07.125 INFO:tasks.workunit.client.0.smithi049.stdout:2/968: readlink d2/d9/de/l126 0 2024-02-22T00:34:07.127 INFO:tasks.workunit.client.0.smithi049.stdout:2/969: readlink d2/d9/de/d10/d2e/d42/d80/lb9 0 2024-02-22T00:34:07.127 INFO:tasks.workunit.client.0.smithi049.stdout:5/979: link d0/d20/d50/d24/d54/c60 d0/d20/dad/d142/db6/c157 0 2024-02-22T00:34:07.130 INFO:tasks.workunit.client.0.smithi049.stdout:3/869: rename d0/d59 to d0/dd/d26/d10f 0 2024-02-22T00:34:07.131 INFO:tasks.workunit.client.0.smithi049.stdout:3/870: chown d0/d14/d4d/d4e/d56/fec 13105157 1 2024-02-22T00:34:07.131 INFO:tasks.workunit.client.0.smithi049.stdout:2/970: symlink d2/d9/de/d10/d2e/d42/d131/l158 0 2024-02-22T00:34:07.132 INFO:tasks.workunit.client.0.smithi049.stdout:3/871: fdatasync d0/d14/d4d/d4e/d56/fec 0 2024-02-22T00:34:07.135 INFO:tasks.workunit.client.0.smithi049.stdout:3/872: mknod d0/dd/d1e/c110 0 2024-02-22T00:34:07.136 INFO:tasks.workunit.client.0.smithi049.stdout:2/971: truncate d2/d9/de/d15/f8b 3009565 0 2024-02-22T00:34:07.139 INFO:tasks.workunit.client.0.smithi049.stdout:2/972: symlink d2/d9/dd/d74/l159 0 2024-02-22T00:34:07.141 INFO:tasks.workunit.client.0.smithi049.stdout:2/973: truncate d2/d9/dd/d4d/d5a/fe5 1727928 0 2024-02-22T00:34:07.142 INFO:tasks.workunit.client.0.smithi049.stdout:2/974: symlink d2/d9/d17/l15a 0 2024-02-22T00:34:07.145 INFO:tasks.workunit.client.0.smithi049.stdout:3/873: write d0/d14/d4d/d4e/f77 [2376870,53520] 0 2024-02-22T00:34:07.150 INFO:tasks.workunit.client.0.smithi049.stdout:2/975: rename d2/dda/d63/f111 to d2/f15b 0 2024-02-22T00:34:07.151 INFO:tasks.workunit.client.0.smithi049.stdout:2/976: chown d2/d9/dd/l116 40 1 2024-02-22T00:34:07.156 INFO:tasks.workunit.client.0.smithi049.stdout:3/874: truncate d0/dd/d26/fa7 1907238 0 2024-02-22T00:34:07.159 INFO:tasks.workunit.client.0.smithi049.stdout:3/875: creat d0/d14/f111 x:0 0 0 2024-02-22T00:34:07.160 INFO:tasks.workunit.client.0.smithi049.stdout:3/876: creat d0/d14/d4d/d4e/d56/dc1/dd3/f112 x:0 0 0 2024-02-22T00:34:07.161 INFO:tasks.workunit.client.0.smithi049.stdout:3/877: chown d0/d14/d4d/d4e/d4f/d5b/d76/cf6 592 1 2024-02-22T00:34:07.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:05.767090+0000 mgr.smithi161.sazlam (mgr.24369) 65 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 78 MiB/s rd, 207 MiB/s wr, 565 op/s 2024-02-22T00:34:07.185 INFO:tasks.workunit.client.0.smithi049.stdout:3/878: read d0/d14/f74 [3084717,73468] 0 2024-02-22T00:34:07.187 INFO:tasks.workunit.client.0.smithi049.stdout:2/977: dread d2/d9/de/d10/f31 [0,4194304] 0 2024-02-22T00:34:07.190 INFO:tasks.workunit.client.0.smithi049.stdout:2/978: fdatasync d2/d9/dd/d4d/d72/f12f 0 2024-02-22T00:34:07.194 INFO:tasks.workunit.client.0.smithi049.stdout:3/879: dwrite d0/d14/f5c [0,4194304] 0 2024-02-22T00:34:07.194 INFO:tasks.workunit.client.0.smithi049.stdout:2/979: getdents d2/d9/de/d3a/d93 0 2024-02-22T00:34:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:3/880: mknod d0/dd/d26/d2e/d52/d99/c113 0 2024-02-22T00:34:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:3/881: chown d0/dd/d26/d2e/f8d 7 1 2024-02-22T00:34:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:2/980: rename d2/d9/dd/d4d/d72/da0/dba/lc5 to d2/d9/dd/d74/l15c 0 2024-02-22T00:34:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:3/882: write d0/dd/d26/f30 [1201759,16181] 0 2024-02-22T00:34:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:2/981: write d2/d9/dd/d4d/da7/dd2/f13a [1000530,93076] 0 2024-02-22T00:34:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:2/982: chown d2/d9/de/d10/d2e/d42/d131/l158 4 1 2024-02-22T00:34:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:3/883: creat d0/dd/d26/d63/f114 x:0 0 0 2024-02-22T00:34:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:3/884: chown d0/dd/d26/d10f/cb1 1 1 2024-02-22T00:34:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:2/983: chown d2/d9/dd/ce8 2107032176 1 2024-02-22T00:34:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:3/885: mknod d0/d14/d4d/d4e/d56/dc1/d10b/c115 0 2024-02-22T00:34:07.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/886: truncate d0/dd/d26/d63/fb7 919812 0 2024-02-22T00:34:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:3/887: write d0/d14/d4d/d4e/d4f/d5b/d76/fb9 [2075652,108374] 0 2024-02-22T00:34:07.226 INFO:tasks.workunit.client.0.smithi049.stdout:2/984: dread d2/d9/f6f [0,4194304] 0 2024-02-22T00:34:07.231 INFO:tasks.workunit.client.0.smithi049.stdout:2/985: write d2/d9/de/d10/f19 [852847,114193] 0 2024-02-22T00:34:07.234 INFO:tasks.workunit.client.0.smithi049.stdout:2/986: creat d2/d9/de/d3a/d93/f15d x:0 0 0 2024-02-22T00:34:07.235 INFO:tasks.workunit.client.0.smithi049.stdout:3/888: dread d0/d14/d4d/d4e/d56/f98 [0,4194304] 0 2024-02-22T00:34:07.239 INFO:tasks.workunit.client.0.smithi049.stdout:3/889: rename d0/dd/d26/d2e/f84 to d0/d14/f116 0 2024-02-22T00:34:07.239 INFO:tasks.workunit.client.0.smithi049.stdout:3/890: fdatasync d0/dd/d26/d10f/ffc 0 2024-02-22T00:34:07.240 INFO:tasks.workunit.client.0.smithi049.stdout:2/987: getdents d2/d9/de/d10/d59 0 2024-02-22T00:34:07.241 INFO:tasks.workunit.client.0.smithi049.stdout:3/891: dread - d0/d14/d4d/d4e/d56/f101 zero size 2024-02-22T00:34:07.243 INFO:tasks.workunit.client.0.smithi049.stdout:3/892: write d0/d14/d4d/d4e/d56/ff9 [817211,75983] 0 2024-02-22T00:34:07.246 INFO:tasks.workunit.client.0.smithi049.stdout:2/988: getdents d2/d9/de/d10/d2e 0 2024-02-22T00:34:07.246 INFO:tasks.workunit.client.0.smithi049.stdout:3/893: symlink d0/dd/d26/l117 0 2024-02-22T00:34:07.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/894: creat d0/d14/d4d/d4e/d56/d5a/dc4/d103/f118 x:0 0 0 2024-02-22T00:34:07.254 INFO:tasks.workunit.client.0.smithi049.stdout:3/895: mknod d0/dd/d26/d63/c119 0 2024-02-22T00:34:07.258 INFO:tasks.workunit.client.0.smithi049.stdout:2/989: dwrite d2/d9/dd/d4d/d72/d119/f155 [0,4194304] 0 2024-02-22T00:34:07.259 INFO:tasks.workunit.client.0.smithi049.stdout:3/896: rename d0/dd/d26/d2e/d52/d6e to d0/d14/d4d/d4e/d56/d5a/dbc/d11a 0 2024-02-22T00:34:07.266 INFO:tasks.workunit.client.0.smithi049.stdout:2/990: write d2/d9/dd/d4d/da7/dd2/fe1 [1831234,100392] 0 2024-02-22T00:34:07.268 INFO:tasks.workunit.client.0.smithi049.stdout:3/897: dwrite d0/d14/f8e [4194304,4194304] 0 2024-02-22T00:34:07.270 INFO:tasks.workunit.client.0.smithi049.stdout:2/991: readlink d2/d9/dd/d4d/d72/da0/l130 0 2024-02-22T00:34:07.271 INFO:tasks.workunit.client.0.smithi049.stdout:2/992: chown d2/d9/de/d3a/dc3/ldc 672334 1 2024-02-22T00:34:07.271 INFO:tasks.workunit.client.0.smithi049.stdout:3/898: rmdir d0/dd/d26/d10f 39 2024-02-22T00:34:07.274 INFO:tasks.workunit.client.0.smithi049.stdout:2/993: chown d2/dda/d5d/fe3 566 1 2024-02-22T00:34:07.274 INFO:tasks.workunit.client.0.smithi049.stdout:3/899: chown d0/d14/d4d/d4e/d56/d5a/dbc/cd2 618606702 1 2024-02-22T00:34:07.286 INFO:tasks.workunit.client.0.smithi049.stdout:3/900: dwrite d0/d14/d4d/d4e/fd4 [0,4194304] 0 2024-02-22T00:34:07.289 INFO:tasks.workunit.client.0.smithi049.stdout:3/901: symlink d0/dd/d1e/l11b 0 2024-02-22T00:34:07.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:05.767090+0000 mgr.smithi161.sazlam (mgr.24369) 65 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 1.9 GiB data, 7.1 GiB used, 529 GiB / 536 GiB avail; 78 MiB/s rd, 207 MiB/s wr, 565 op/s 2024-02-22T00:34:07.294 INFO:tasks.workunit.client.0.smithi049.stdout:3/902: dwrite d0/dd/d26/f30 [0,4194304] 0 2024-02-22T00:34:07.312 INFO:tasks.workunit.client.0.smithi049.stdout:3/903: fsync d0/dd/d26/f30 0 2024-02-22T00:34:07.314 INFO:tasks.workunit.client.0.smithi049.stdout:3/904: truncate d0/dd/d26/d10f/f85 2502159 0 2024-02-22T00:34:07.320 INFO:tasks.workunit.client.0.smithi049.stdout:3/905: dwrite d0/d14/f74 [0,4194304] 0 2024-02-22T00:34:07.324 INFO:tasks.workunit.client.0.smithi049.stdout:3/906: symlink d0/d14/d4d/d4e/d56/d5a/dbc/d11a/deb/l11c 0 2024-02-22T00:34:07.327 INFO:tasks.workunit.client.0.smithi049.stdout:3/907: symlink d0/d14/d4d/d4e/d56/d5a/dc4/l11d 0 2024-02-22T00:34:07.336 INFO:tasks.workunit.client.0.smithi049.stdout:3/908: dread d0/fdd [0,4194304] 0 2024-02-22T00:34:07.337 INFO:tasks.workunit.client.0.smithi049.stdout:3/909: dread - d0/dd/d26/f108 zero size 2024-02-22T00:34:07.341 INFO:tasks.workunit.client.0.smithi049.stdout:3/910: dread d0/dd/f6a [0,4194304] 0 2024-02-22T00:34:07.345 INFO:tasks.workunit.client.0.smithi049.stdout:3/911: rmdir d0/dd/d26/d10f/d107 0 2024-02-22T00:34:07.350 INFO:tasks.workunit.client.0.smithi049.stdout:3/912: dwrite d0/dd/d26/d10f/ffc [4194304,4194304] 0 2024-02-22T00:34:07.354 INFO:tasks.workunit.client.0.smithi049.stdout:3/913: mkdir d0/d14/d4d/d4e/d56/d5a/dc4/d103/d11e 0 2024-02-22T00:34:07.358 INFO:tasks.workunit.client.0.smithi049.stdout:3/914: symlink d0/dd/d26/l11f 0 2024-02-22T00:34:07.359 INFO:tasks.workunit.client.0.smithi049.stdout:3/915: chown d0/dd/fa3 6 1 2024-02-22T00:34:07.374 INFO:tasks.workunit.client.0.smithi049.stdout:3/916: rmdir d0/d14/d4d/d4e/d56 39 2024-02-22T00:34:07.375 INFO:tasks.workunit.client.0.smithi049.stdout:3/917: write d0/d14/f5c [5207824,90537] 0 2024-02-22T00:34:07.386 INFO:tasks.workunit.client.0.smithi049.stdout:3/918: creat d0/dd/d6f/f120 x:0 0 0 2024-02-22T00:34:07.573 INFO:tasks.workunit.client.0.smithi049.stdout:0/965: sync 2024-02-22T00:34:07.575 INFO:tasks.workunit.client.0.smithi049.stdout:0/966: symlink d3/df/d59/d60/d11d/l12f 0 2024-02-22T00:34:07.576 INFO:tasks.workunit.client.0.smithi049.stdout:0/967: write d3/df/d59/d8e/fef [1709782,79410] 0 2024-02-22T00:34:07.713 INFO:tasks.workunit.client.0.smithi049.stdout:2/994: sync 2024-02-22T00:34:07.713 INFO:tasks.workunit.client.0.smithi049.stdout:5/980: sync 2024-02-22T00:34:07.713 INFO:tasks.workunit.client.0.smithi049.stdout:2/995: chown d2/d9/df2/f133 3523576 1 2024-02-22T00:34:07.715 INFO:tasks.workunit.client.0.smithi049.stdout:5/981: write d0/d20/dad/d142/db6/dc3/d70/db1/dbe/f125 [532021,4843] 0 2024-02-22T00:34:07.716 INFO:tasks.workunit.client.0.smithi049.stdout:2/996: write d2/d9/de/d15/d1b/f1f [357156,79015] 0 2024-02-22T00:34:07.725 INFO:tasks.workunit.client.0.smithi049.stdout:5/982: dwrite d0/d20/dad/d142/db6/dc3/d70/db1/d9e/f13c [0,4194304] 0 2024-02-22T00:34:07.728 INFO:tasks.workunit.client.0.smithi049.stdout:5/983: rmdir d0/d20/dad/d142/db6/dc3/d6f/d94 39 2024-02-22T00:34:07.732 INFO:tasks.workunit.client.0.smithi049.stdout:5/984: creat d0/d20/d50/f158 x:0 0 0 2024-02-22T00:34:07.738 INFO:tasks.workunit.client.0.smithi049.stdout:5/985: getdents d0/d20/d50 0 2024-02-22T00:34:07.746 INFO:tasks.workunit.client.0.smithi049.stdout:5/986: dwrite d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d7a/d89/fe1 [0,4194304] 0 2024-02-22T00:34:07.747 INFO:tasks.workunit.client.0.smithi049.stdout:5/987: write d0/d20/d50/f36 [4584157,54451] 0 2024-02-22T00:34:07.749 INFO:tasks.workunit.client.0.smithi049.stdout:5/988: fsync d0/d20/dad/d142/db6/dc3/dea/d12e/f14a 0 2024-02-22T00:34:07.758 INFO:tasks.workunit.client.0.smithi049.stdout:2/997: dread d2/d9/de/d3a/f56 [0,4194304] 0 2024-02-22T00:34:07.758 INFO:tasks.workunit.client.0.smithi049.stdout:5/989: dwrite d0/d20/dad/d142/db6/dc3/d70/db1/d9e/f101 [0,4194304] 0 2024-02-22T00:34:07.761 INFO:tasks.workunit.client.0.smithi049.stdout:2/998: creat d2/d9/de/d3a/d6d/da6/f15e x:0 0 0 2024-02-22T00:34:07.763 INFO:tasks.workunit.client.0.smithi049.stdout:5/990: mkdir d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d103/d159 0 2024-02-22T00:34:07.763 INFO:tasks.workunit.client.0.smithi049.stdout:5/991: readlink d0/d26/l4b 0 2024-02-22T00:34:07.766 INFO:tasks.workunit.client.0.smithi049.stdout:5/992: mknod d0/d20/dc5/df5/c15a 0 2024-02-22T00:34:07.770 INFO:tasks.workunit.client.0.smithi049.stdout:5/993: creat d0/d20/dad/d142/db6/dc3/d70/db1/f15b x:0 0 0 2024-02-22T00:34:07.775 INFO:tasks.workunit.client.0.smithi049.stdout:5/994: mknod d0/d20/dad/d142/db6/dc3/d6f/c15c 0 2024-02-22T00:34:07.777 INFO:tasks.workunit.client.0.smithi049.stdout:5/995: write d0/d20/dad/d142/db6/dc3/d6f/d94/fd [2911186,366] 0 2024-02-22T00:34:07.781 INFO:tasks.workunit.client.0.smithi049.stdout:5/996: mknod d0/d20/dad/d142/db6/dc3/d6f/d94/d74/c15d 0 2024-02-22T00:34:07.783 INFO:tasks.workunit.client.0.smithi049.stdout:5/997: dread - d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d103/f134 zero size 2024-02-22T00:34:07.788 INFO:tasks.workunit.client.0.smithi049.stdout:5/998: rename d0/d20/dad/d142/db6/dc3/d6f/d94/d74/d7a/d89/cd6 to d0/d20/dad/d142/db6/dc3/d6f/d94/c15e 0 2024-02-22T00:34:07.791 INFO:tasks.workunit.client.0.smithi049.stdout:2/999: dread d2/d9/dd/d4d/d5a/fa3 [0,4194304] 0 2024-02-22T00:34:07.793 INFO:tasks.workunit.client.0.smithi049.stdout:5/999: getdents d0/d20/dad/d142/db6/dc3/d70/db1/d9e 0 2024-02-22T00:34:07.823 INFO:tasks.workunit.client.0.smithi049.stdout:3/919: sync 2024-02-22T00:34:07.824 INFO:tasks.workunit.client.0.smithi049.stdout:3/920: stat d0/dd/c1c 0 2024-02-22T00:34:07.932 INFO:tasks.workunit.client.0.smithi049.stdout:0/968: sync 2024-02-22T00:34:07.933 INFO:tasks.workunit.client.0.smithi049.stdout:0/969: chown d3/d6/d29/f76 0 1 2024-02-22T00:34:07.976 INFO:tasks.workunit.client.0.smithi049.stdout:0/970: write d3/df/d48/d91/f10c [1855342,110878] 0 2024-02-22T00:34:07.976 INFO:tasks.workunit.client.0.smithi049.stdout:0/971: write d3/d6/d8/d36/d81/fb1 [4640121,84917] 0 2024-02-22T00:34:07.977 INFO:tasks.workunit.client.0.smithi049.stdout:0/972: readlink d3/d6/d8/d36/lc9 0 2024-02-22T00:34:07.981 INFO:tasks.workunit.client.0.smithi049.stdout:0/973: dread d3/d1e/f6a [0,4194304] 0 2024-02-22T00:34:07.983 INFO:tasks.workunit.client.0.smithi049.stdout:0/974: rmdir d3/df/d59/d8e 39 2024-02-22T00:34:07.984 INFO:tasks.workunit.client.0.smithi049.stdout:0/975: chown d3/df/d7f/f100 12 1 2024-02-22T00:34:07.990 INFO:tasks.workunit.client.0.smithi049.stdout:0/976: dwrite d3/d6/d29/f76 [0,4194304] 0 2024-02-22T00:34:07.994 INFO:tasks.workunit.client.0.smithi049.stdout:0/977: mkdir d3/d130 0 2024-02-22T00:34:08.000 INFO:tasks.workunit.client.0.smithi049.stdout:0/978: dwrite d3/df/d7f/fa3 [0,4194304] 0 2024-02-22T00:34:08.003 INFO:tasks.workunit.client.0.smithi049.stdout:0/979: symlink d3/df/d48/d6f/d90/de3/l131 0 2024-02-22T00:34:08.008 INFO:tasks.workunit.client.0.smithi049.stdout:0/980: mknod d3/df/d48/c132 0 2024-02-22T00:34:08.009 INFO:tasks.workunit.client.0.smithi049.stdout:0/981: stat d3/df/d48/l65 0 2024-02-22T00:34:08.012 INFO:tasks.workunit.client.0.smithi049.stdout:0/982: creat d3/df/d17/d50/d62/f133 x:0 0 0 2024-02-22T00:34:08.026 INFO:tasks.workunit.client.0.smithi049.stdout:0/983: dread d3/df/f2b [0,4194304] 0 2024-02-22T00:34:08.031 INFO:tasks.workunit.client.0.smithi049.stdout:0/984: symlink d3/d6/d8/l134 0 2024-02-22T00:34:08.031 INFO:tasks.workunit.client.0.smithi049.stdout:0/985: chown d3/d92/lb7 358 1 2024-02-22T00:34:08.031 INFO:tasks.workunit.client.0.smithi049.stdout:3/921: sync 2024-02-22T00:34:08.033 INFO:tasks.workunit.client.0.smithi049.stdout:3/922: symlink d0/dd/d26/d63/l121 0 2024-02-22T00:34:08.037 INFO:tasks.workunit.client.0.smithi049.stdout:0/986: mknod d3/df/d59/d8e/c135 0 2024-02-22T00:34:08.045 INFO:tasks.workunit.client.0.smithi049.stdout:0/987: write d3/df/d48/f52 [4627327,101271] 0 2024-02-22T00:34:08.047 INFO:tasks.workunit.client.0.smithi049.stdout:3/923: dwrite d0/dd/f9 [0,4194304] 0 2024-02-22T00:34:08.050 INFO:tasks.workunit.client.0.smithi049.stdout:0/988: symlink d3/d6/d8/d36/d81/d123/l136 0 2024-02-22T00:34:08.056 INFO:tasks.workunit.client.0.smithi049.stdout:3/924: dwrite d0/d14/d4d/d4e/d56/d5a/dc4/d103/f118 [0,4194304] 0 2024-02-22T00:34:08.063 INFO:tasks.workunit.client.0.smithi049.stdout:3/925: dwrite d0/d14/f8e [0,4194304] 0 2024-02-22T00:34:08.072 INFO:tasks.workunit.client.0.smithi049.stdout:3/926: write d0/dd/d26/d2e/d52/f7c [1444198,34323] 0 2024-02-22T00:34:08.079 INFO:tasks.workunit.client.0.smithi049.stdout:3/927: rename d0/c91 to d0/d14/d4d/d4e/d4f/d5b/c122 0 2024-02-22T00:34:08.080 INFO:tasks.workunit.client.0.smithi049.stdout:3/928: stat d0/d14/d4d/d4e/d4f/d5b/d76 0 2024-02-22T00:34:08.084 INFO:tasks.workunit.client.0.smithi049.stdout:3/929: symlink d0/d14/d4d/d4e/d56/l123 0 2024-02-22T00:34:08.084 INFO:tasks.workunit.client.0.smithi049.stdout:0/989: dread d3/df/d17/fbe [0,4194304] 0 2024-02-22T00:34:08.087 INFO:tasks.workunit.client.0.smithi049.stdout:3/930: mkdir d0/d124 0 2024-02-22T00:34:08.091 INFO:tasks.workunit.client.0.smithi049.stdout:3/931: creat d0/d14/d4d/d4e/d56/f125 x:0 0 0 2024-02-22T00:34:08.096 INFO:tasks.workunit.client.0.smithi049.stdout:3/932: dread d0/d14/f8e [4194304,4194304] 0 2024-02-22T00:34:08.102 INFO:tasks.workunit.client.0.smithi049.stdout:3/933: dwrite d0/dd/d1e/f78 [0,4194304] 0 2024-02-22T00:34:08.108 INFO:tasks.workunit.client.0.smithi049.stdout:3/934: dwrite d0/dd/d26/d2e/f8d [0,4194304] 0 2024-02-22T00:34:08.115 INFO:tasks.workunit.client.0.smithi049.stdout:3/935: link d0/dd/l8 d0/d14/d4d/d4e/d4f/d5b/d76/l126 0 2024-02-22T00:34:08.121 INFO:tasks.workunit.client.0.smithi049.stdout:0/990: dread d3/df/d48/f105 [0,4194304] 0 2024-02-22T00:34:08.123 INFO:tasks.workunit.client.0.smithi049.stdout:0/991: fsync d3/d6/d29/f3f 0 2024-02-22T00:34:08.123 INFO:tasks.workunit.client.0.smithi049.stdout:3/936: dwrite d0/dd/d26/f108 [0,4194304] 0 2024-02-22T00:34:08.124 INFO:tasks.workunit.client.0.smithi049.stdout:0/992: chown d3/f11b 0 1 2024-02-22T00:34:08.130 INFO:tasks.workunit.client.0.smithi049.stdout:3/937: getdents d0/dd/d1e 0 2024-02-22T00:34:08.135 INFO:tasks.workunit.client.0.smithi049.stdout:3/938: write d0/dd/d26/fa7 [818697,13433] 0 2024-02-22T00:34:08.135 INFO:tasks.workunit.client.0.smithi049.stdout:0/993: getdents d3/df/d48/d63/de5/d10a 0 2024-02-22T00:34:08.136 INFO:tasks.workunit.client.0.smithi049.stdout:0/994: read - d3/df/d48/d63/f107 zero size 2024-02-22T00:34:08.138 INFO:tasks.workunit.client.0.smithi049.stdout:0/995: chown d3/d6/d29/f3f 1330032 1 2024-02-22T00:34:08.139 INFO:tasks.workunit.client.0.smithi049.stdout:3/939: getdents d0/d14/d4d/d4e/d56/d5a/dbc/d11a/deb/d105 0 2024-02-22T00:34:08.139 INFO:tasks.workunit.client.0.smithi049.stdout:0/996: readlink d3/df/d48/d6f/lf2 0 2024-02-22T00:34:08.140 INFO:tasks.workunit.client.0.smithi049.stdout:3/940: readlink d0/d14/d4d/d4e/d56/d5a/dbf/ld8 0 2024-02-22T00:34:08.142 INFO:tasks.workunit.client.0.smithi049.stdout:3/941: symlink d0/dd/l127 0 2024-02-22T00:34:08.144 INFO:tasks.workunit.client.0.smithi049.stdout:3/942: rmdir d0/dd/d26/d2e 39 2024-02-22T00:34:08.147 INFO:tasks.workunit.client.0.smithi049.stdout:3/943: rename d0/d14/db8/f10a to d0/d124/f128 0 2024-02-22T00:34:08.154 INFO:tasks.workunit.client.0.smithi049.stdout:0/997: write d3/f13 [1236576,34684] 0 2024-02-22T00:34:08.157 INFO:tasks.workunit.client.0.smithi049.stdout:0/998: symlink d3/d6/d11f/l137 0 2024-02-22T00:34:08.161 INFO:tasks.workunit.client.0.smithi049.stdout:0/999: dread d3/df/d48/fc4 [0,4194304] 0 2024-02-22T00:34:08.162 INFO:tasks.workunit.client.0.smithi049.stdout:3/944: dread d0/f68 [0,4194304] 0 2024-02-22T00:34:08.164 INFO:tasks.workunit.client.0.smithi049.stdout:3/945: getdents d0/d14/de7 0 2024-02-22T00:34:08.165 INFO:tasks.workunit.client.0.smithi049.stdout:3/946: chown d0/dd/d6f/lac 6907151 1 2024-02-22T00:34:08.166 INFO:tasks.workunit.client.0.smithi049.stdout:3/947: truncate d0/fce 690784 0 2024-02-22T00:34:08.167 INFO:tasks.workunit.client.0.smithi049.stdout:3/948: dread - d0/d14/d4d/d4e/d4f/d5b/fea zero size 2024-02-22T00:34:08.182 INFO:tasks.workunit.client.0.smithi049.stdout:3/949: dread d0/dd/f4c [0,4194304] 0 2024-02-22T00:34:08.184 INFO:tasks.workunit.client.0.smithi049.stdout:3/950: unlink d0/d14/f74 0 2024-02-22T00:34:08.187 INFO:tasks.workunit.client.0.smithi049.stdout:3/951: creat d0/d14/d4d/d4e/d56/dc1/dd3/f129 x:0 0 0 2024-02-22T00:34:08.190 INFO:tasks.workunit.client.0.smithi049.stdout:3/952: creat d0/d14/d4d/d4e/d56/d5a/dbc/d11a/deb/d105/f12a x:0 0 0 2024-02-22T00:34:08.197 INFO:tasks.workunit.client.0.smithi049.stdout:3/953: dwrite d0/d14/d4d/d4e/fd4 [4194304,4194304] 0 2024-02-22T00:34:08.201 INFO:tasks.workunit.client.0.smithi049.stdout:3/954: mkdir d0/dd/d26/d12b 0 2024-02-22T00:34:08.204 INFO:tasks.workunit.client.0.smithi049.stdout:3/955: unlink d0/d14/f69 0 2024-02-22T00:34:08.205 INFO:tasks.workunit.client.0.smithi049.stdout:3/956: stat d0/d14/d4d/d4e/d56/d5a/dbc/d11a/deb/lf2 0 2024-02-22T00:34:08.207 INFO:tasks.workunit.client.0.smithi049.stdout:3/957: mknod d0/dd/d26/d10f/c12c 0 2024-02-22T00:34:08.210 INFO:tasks.workunit.client.0.smithi049.stdout:3/958: symlink d0/d14/d4d/d4e/d4f/d5b/l12d 0 2024-02-22T00:34:08.212 INFO:tasks.workunit.client.0.smithi049.stdout:3/959: write d0/dd/d26/fa7 [2820982,32147] 0 2024-02-22T00:34:08.213 INFO:tasks.workunit.client.0.smithi049.stdout:3/960: stat d0/d14/d4d/d4e/d4f/d5b/fea 0 2024-02-22T00:34:08.215 INFO:tasks.workunit.client.0.smithi049.stdout:3/961: creat d0/d14/d4d/d4e/d4f/d5b/d66/f12e x:0 0 0 2024-02-22T00:34:08.218 INFO:tasks.workunit.client.0.smithi049.stdout:3/962: mknod d0/d14/d4d/d4e/d56/d5a/dc4/d103/d11e/c12f 0 2024-02-22T00:34:08.221 INFO:tasks.workunit.client.0.smithi049.stdout:3/963: rename d0/dd/d6f/cca to d0/dd/d26/d63/c130 0 2024-02-22T00:34:08.227 INFO:tasks.workunit.client.0.smithi049.stdout:3/964: dwrite d0/d14/d4d/d4e/d4f/d5b/d76/fa0 [0,4194304] 0 2024-02-22T00:34:08.228 INFO:tasks.workunit.client.0.smithi049.stdout:3/965: dread - d0/dd/d26/d10f/d8f/f109 zero size 2024-02-22T00:34:08.234 INFO:tasks.workunit.client.0.smithi049.stdout:3/966: creat d0/d14/d4d/d4e/d56/d5a/dbc/d11a/deb/d105/f131 x:0 0 0 2024-02-22T00:34:08.235 INFO:tasks.workunit.client.0.smithi049.stdout:3/967: readlink d0/d14/d4d/d4e/d56/dc1/l10d 0 2024-02-22T00:34:08.236 INFO:tasks.workunit.client.0.smithi049.stdout:3/968: chown d0/dd/d1e/ccf 1 1 2024-02-22T00:34:08.240 INFO:tasks.workunit.client.0.smithi049.stdout:3/969: dread d0/dd/d6f/fde [0,4194304] 0 2024-02-22T00:34:08.242 INFO:tasks.workunit.client.0.smithi049.stdout:3/970: rmdir d0/d14/d4d/d4e/d56/d5a/dbc/d11a 39 2024-02-22T00:34:08.242 INFO:tasks.workunit.client.0.smithi049.stdout:3/971: chown d0/dd/d1e/ccf 529 1 2024-02-22T00:34:08.245 INFO:tasks.workunit.client.0.smithi049.stdout:3/972: rename d0/d14/f1b to d0/d14/d4d/d4e/d56/d5a/dbf/f132 0 2024-02-22T00:34:08.248 INFO:tasks.workunit.client.0.smithi049.stdout:3/973: write d0/d14/d4d/d4e/d56/d5a/dbc/d11a/deb/d105/f131 [268962,90013] 0 2024-02-22T00:34:08.252 INFO:tasks.workunit.client.0.smithi049.stdout:3/974: creat d0/d14/d4d/d4e/d56/d5a/dbc/f133 x:0 0 0 2024-02-22T00:34:08.255 INFO:tasks.workunit.client.0.smithi049.stdout:3/975: mkdir d0/dd/d1e/d134 0 2024-02-22T00:34:08.269 INFO:tasks.workunit.client.0.smithi049.stdout:3/976: write d0/dd/d26/d2e/fa5 [96457,41338] 0 2024-02-22T00:34:08.275 INFO:tasks.workunit.client.0.smithi049.stdout:3/977: truncate d0/d14/f8e 815732 0 2024-02-22T00:34:08.279 INFO:tasks.workunit.client.0.smithi049.stdout:3/978: creat d0/d14/d4d/d4e/d56/d5a/dbc/d11a/deb/f135 x:0 0 0 2024-02-22T00:34:08.282 INFO:tasks.workunit.client.0.smithi049.stdout:3/979: rename d0/dd/d26/d2e/d52 to d0/d14/d4d/d4e/d4f/d5b/d76/d136 0 2024-02-22T00:34:08.288 INFO:tasks.workunit.client.0.smithi049.stdout:3/980: rmdir d0/d14/d4d/d4e/d56 39 2024-02-22T00:34:08.292 INFO:tasks.workunit.client.0.smithi049.stdout:3/981: unlink d0/d14/d4d/d4e/d56/d5a/dbc/d11a/deb/f135 0 2024-02-22T00:34:08.295 INFO:tasks.workunit.client.0.smithi049.stdout:3/982: rename d0/d14/d4d/d4e/l5f to d0/d14/d4d/d4e/d56/d5a/dc4/l137 0 2024-02-22T00:34:08.626 INFO:tasks.workunit.client.0.smithi049.stdout:3/983: sync 2024-02-22T00:34:08.629 INFO:tasks.workunit.client.0.smithi049.stdout:3/984: mkdir d0/dd/d26/d12b/d138 0 2024-02-22T00:34:08.633 INFO:tasks.workunit.client.0.smithi049.stdout:3/985: dread d0/d14/d4d/d4e/d56/d5a/dc4/d103/f118 [0,4194304] 0 2024-02-22T00:34:08.636 INFO:tasks.workunit.client.0.smithi049.stdout:3/986: creat d0/dd/d26/d10f/d8f/f139 x:0 0 0 2024-02-22T00:34:08.637 INFO:tasks.workunit.client.0.smithi049.stdout:3/987: fdatasync d0/d14/d4d/d4e/d4f/d5b/d66/f12e 0 2024-02-22T00:34:08.638 INFO:tasks.workunit.client.0.smithi049.stdout:3/988: read d0/dd/d26/f2b [1297193,12175] 0 2024-02-22T00:34:08.639 INFO:tasks.workunit.client.0.smithi049.stdout:3/989: dread - d0/dd/d26/d63/f114 zero size 2024-02-22T00:34:08.641 INFO:tasks.workunit.client.0.smithi049.stdout:3/990: write d0/d14/d4d/d4e/d4f/d5b/fea [552108,125030] 0 2024-02-22T00:34:08.644 INFO:tasks.workunit.client.0.smithi049.stdout:3/991: mkdir d0/d14/d4d/d4e/d56/d5a/dc4/d103/d11e/d13a 0 2024-02-22T00:34:08.647 INFO:tasks.workunit.client.0.smithi049.stdout:3/992: mknod d0/dd/d26/d2e/c13b 0 2024-02-22T00:34:08.648 INFO:tasks.workunit.client.0.smithi049.stdout:3/993: write d0/dd/d26/d2e/f54 [1165008,124546] 0 2024-02-22T00:34:08.666 INFO:tasks.workunit.client.0.smithi049.stdout:3/994: dwrite d0/dd/d26/d2e/f44 [0,4194304] 0 2024-02-22T00:34:08.668 INFO:tasks.workunit.client.0.smithi049.stdout:3/995: truncate d0/dd/d26/d10f/d8f/f139 418352 0 2024-02-22T00:34:08.671 INFO:tasks.workunit.client.0.smithi049.stdout:3/996: creat d0/dd/d26/d10f/d87/de5/f13c x:0 0 0 2024-02-22T00:34:08.672 INFO:tasks.workunit.client.0.smithi049.stdout:3/997: stat d0/dd/d26/d10f/d87/de5 0 2024-02-22T00:34:08.679 INFO:tasks.workunit.client.0.smithi049.stdout:3/998: dwrite d0/d14/d4d/d4e/d56/d5a/dbc/ff3 [0,4194304] 0 2024-02-22T00:34:08.682 INFO:tasks.workunit.client.0.smithi049.stdout:3/999: symlink d0/dd/d1e/l13d 0 2024-02-22T00:34:08.688 INFO:tasks.workunit.client.0.smithi049.stderr:+ rm -rf -- ./tmp.S1GSSG7cOq 2024-02-22T00:34:09.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:07.767532+0000 mgr.smithi161.sazlam (mgr.24369) 66 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 199 MiB/s wr, 542 op/s 2024-02-22T00:34:09.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:07.767532+0000 mgr.smithi161.sazlam (mgr.24369) 66 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 199 MiB/s wr, 542 op/s 2024-02-22T00:34:11.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:09.767855+0000 mgr.smithi161.sazlam (mgr.24369) 67 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 159 MiB/s wr, 451 op/s 2024-02-22T00:34:11.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:09.767855+0000 mgr.smithi161.sazlam (mgr.24369) 67 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 59 MiB/s rd, 159 MiB/s wr, 451 op/s 2024-02-22T00:34:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:11.219304+0000 mon.smithi049 (mon.0) 703 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:11.231007+0000 mon.smithi049 (mon.0) 704 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:12.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:34:11.268185+0000 mgr.smithi161.sazlam (mgr.24369) 68 : cephadm [INF] Reconfiguring grafana.smithi049 (dependencies changed)... 2024-02-22T00:34:12.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:34:11.281167+0000 mgr.smithi161.sazlam (mgr.24369) 69 : cephadm [INF] Reconfiguring daemon grafana.smithi049 on smithi049 2024-02-22T00:34:12.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:11.768307+0000 mgr.smithi161.sazlam (mgr.24369) 70 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 66 MiB/s rd, 180 MiB/s wr, 592 op/s 2024-02-22T00:34:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:11.219304+0000 mon.smithi049 (mon.0) 703 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:12.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:11.231007+0000 mon.smithi049 (mon.0) 704 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:12.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:34:11.268185+0000 mgr.smithi161.sazlam (mgr.24369) 68 : cephadm [INF] Reconfiguring grafana.smithi049 (dependencies changed)... 2024-02-22T00:34:12.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:34:11.281167+0000 mgr.smithi161.sazlam (mgr.24369) 69 : cephadm [INF] Reconfiguring daemon grafana.smithi049 on smithi049 2024-02-22T00:34:12.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:11.768307+0000 mgr.smithi161.sazlam (mgr.24369) 70 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 66 MiB/s rd, 180 MiB/s wr, 592 op/s 2024-02-22T00:34:15.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:13.768703+0000 mgr.smithi161.sazlam (mgr.24369) 71 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 96 MiB/s wr, 359 op/s 2024-02-22T00:34:15.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:13.768703+0000 mgr.smithi161.sazlam (mgr.24369) 71 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 2.3 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 96 MiB/s wr, 359 op/s 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.773+0000 7f8576303700 1 -- 172.21.15.49:0/4179507991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 msgr2=0x7f85700f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.773+0000 7f8576303700 1 --2- 172.21.15.49:0/4179507991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 0x7f85700f7df0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f85580047f0 tx=0x7f8558009cb0).stop 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.773+0000 7f8576303700 1 -- 172.21.15.49:0/4179507991 shutdown_connections 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.773+0000 7f8576303700 1 --2- 172.21.15.49:0/4179507991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 0x7f85700f7df0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.773+0000 7f8576303700 1 --2- 172.21.15.49:0/4179507991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85700f66f0 0x7f85700f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.773+0000 7f8576303700 1 -- 172.21.15.49:0/4179507991 >> 172.21.15.49:0/4179507991 conn(0x7f85700f1e50 msgr2=0x7f85700f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.773+0000 7f8576303700 1 -- 172.21.15.49:0/4179507991 shutdown_connections 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.774+0000 7f8576303700 1 -- 172.21.15.49:0/4179507991 wait complete. 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.774+0000 7f8576303700 1 Processor -- start 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.774+0000 7f8576303700 1 -- start start 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.774+0000 7f8576303700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85700f66f0 0x7f8570108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:15.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.774+0000 7f8576303700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 0x7f8570108540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.774+0000 7f8576303700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8570108af0 con 0x7f85700f66f0 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.774+0000 7f8576303700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8570108c30 con 0x7f85700f7990 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85700f66f0 0x7f8570108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85700f66f0 0x7f8570108050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58540/0 (socket says 172.21.15.49:58540) 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f8567fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 0x7f8570108540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856ffff700 1 -- 172.21.15.49:0/2338625085 learned_addr learned my addr 172.21.15.49:0/2338625085 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856ffff700 1 -- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 msgr2=0x7f8570108540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856ffff700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 0x7f8570108540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856ffff700 1 -- 172.21.15.49:0/2338625085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558005040 con 0x7f85700f66f0 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f8567fff700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 0x7f8570108540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856ffff700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85700f66f0 0x7f8570108050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f856000e8c0 tx=0x7f856000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:15.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856dffb700 1 -- 172.21.15.49:0/2338625085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8560007b40 con 0x7f85700f66f0 2024-02-22T00:34:15.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857010d6d0 con 0x7f85700f66f0 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.776+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857010dc90 con 0x7f85700f66f0 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.775+0000 7f856dffb700 1 -- 172.21.15.49:0/2338625085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f856000f040 con 0x7f85700f66f0 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.776+0000 7f856dffb700 1 -- 172.21.15.49:0/2338625085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8560014880 con 0x7f85700f66f0 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.777+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8550005150 con 0x7f85700f66f0 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.777+0000 7f856dffb700 1 -- 172.21.15.49:0/2338625085 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f8560007ca0 con 0x7f85700f66f0 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.778+0000 7f856dffb700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f855c06b1d0 0x7f855c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.778+0000 7f856dffb700 1 -- 172.21.15.49:0/2338625085 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f8560083ec0 con 0x7f85700f66f0 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.778+0000 7f8567fff700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f855c06b1d0 0x7f855c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:15.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.778+0000 7f8567fff700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f855c06b1d0 0x7f855c06d690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8558009bc0 tx=0x7f8558009cb0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:15.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:15.783+0000 7f856dffb700 1 -- 172.21.15.49:0/2338625085 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f8560051fe0 con 0x7f85700f66f0 2024-02-22T00:34:16.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.070+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8550000bf0 con 0x7f855c06b1d0 2024-02-22T00:34:16.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.071+0000 7f856dffb700 1 -- 172.21.15.49:0/2338625085 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f8550000bf0 con 0x7f855c06b1d0 2024-02-22T00:34:16.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.073+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f855c06b1d0 msgr2=0x7f855c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:16.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.073+0000 7f8576303700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f855c06b1d0 0x7f855c06d690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f8558009bc0 tx=0x7f8558009cb0).stop 2024-02-22T00:34:16.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.073+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85700f66f0 msgr2=0x7f8570108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:16.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.073+0000 7f8576303700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85700f66f0 0x7f8570108050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f856000e8c0 tx=0x7f856000b040).stop 2024-02-22T00:34:16.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.074+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 shutdown_connections 2024-02-22T00:34:16.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.074+0000 7f8576303700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f855c06b1d0 0x7f855c06d690 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.074+0000 7f8576303700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f85700f66f0 0x7f8570108050 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.074+0000 7f8576303700 1 --2- 172.21.15.49:0/2338625085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85700f7990 0x7f8570108540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.074+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 >> 172.21.15.49:0/2338625085 conn(0x7f85700f1e50 msgr2=0x7f8570060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:16.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.074+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 shutdown_connections 2024-02-22T00:34:16.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.074+0000 7f8576303700 1 -- 172.21.15.49:0/2338625085 wait complete. 2024-02-22T00:34:16.089 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:34:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.200+0000 7f0382a45700 1 -- 172.21.15.49:0/2664422420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f7990 msgr2=0x7f037c0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.200+0000 7f0382a45700 1 --2- 172.21.15.49:0/2664422420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f7990 0x7f037c0f7df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f03700047f0 tx=0x7f0370009cb0).stop 2024-02-22T00:34:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.200+0000 7f0382a45700 1 -- 172.21.15.49:0/2664422420 shutdown_connections 2024-02-22T00:34:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.200+0000 7f0382a45700 1 --2- 172.21.15.49:0/2664422420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f7990 0x7f037c0f7df0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.200+0000 7f0382a45700 1 --2- 172.21.15.49:0/2664422420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037c0f66f0 0x7f037c0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.200+0000 7f0382a45700 1 -- 172.21.15.49:0/2664422420 >> 172.21.15.49:0/2664422420 conn(0x7f037c0f1e50 msgr2=0x7f037c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:16.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.201+0000 7f0382a45700 1 -- 172.21.15.49:0/2664422420 shutdown_connections 2024-02-22T00:34:16.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.201+0000 7f0382a45700 1 -- 172.21.15.49:0/2664422420 wait complete. 2024-02-22T00:34:16.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.201+0000 7f0382a45700 1 Processor -- start 2024-02-22T00:34:16.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f0382a45700 1 -- start start 2024-02-22T00:34:16.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f0382a45700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f66f0 0x7f037c108090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:16.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f0382a45700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037c0f7990 0x7f037c108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:16.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f0382a45700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c108b30 con 0x7f037c0f66f0 2024-02-22T00:34:16.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f0382a45700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c108c70 con 0x7f037c0f7990 2024-02-22T00:34:16.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f037bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f66f0 0x7f037c108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:16.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f037bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f66f0 0x7f037c108090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58544/0 (socket says 172.21.15.49:58544) 2024-02-22T00:34:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f037bfff700 1 -- 172.21.15.49:0/3996368673 learned_addr learned my addr 172.21.15.49:0/3996368673 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f037b7fe700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037c0f7990 0x7f037c108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f037bfff700 1 -- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037c0f7990 msgr2=0x7f037c108580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f037bfff700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037c0f7990 0x7f037c108580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.202+0000 7f037bfff700 1 -- 172.21.15.49:0/3996368673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0370005040 con 0x7f037c0f66f0 2024-02-22T00:34:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.203+0000 7f037bfff700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f66f0 0x7f037c108090 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f036c00e8c0 tx=0x7f036c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.203+0000 7f03797fa700 1 -- 172.21.15.49:0/3996368673 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c007b40 con 0x7f037c0f66f0 2024-02-22T00:34:16.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.203+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c10d710 con 0x7f037c0f66f0 2024-02-22T00:34:16.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.203+0000 7f03797fa700 1 -- 172.21.15.49:0/3996368673 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f036c00f040 con 0x7f037c0f66f0 2024-02-22T00:34:16.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.203+0000 7f03797fa700 1 -- 172.21.15.49:0/3996368673 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c014880 con 0x7f037c0f66f0 2024-02-22T00:34:16.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.203+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c10dcd0 con 0x7f037c0f66f0 2024-02-22T00:34:16.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.204+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c0fffe0 con 0x7f037c0f66f0 2024-02-22T00:34:16.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.205+0000 7f03797fa700 1 -- 172.21.15.49:0/3996368673 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f036c007ca0 con 0x7f037c0f66f0 2024-02-22T00:34:16.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.206+0000 7f03797fa700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0364066dc0 0x7f0364069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:16.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.206+0000 7f03797fa700 1 -- 172.21.15.49:0/3996368673 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f036c0844f0 con 0x7f037c0f66f0 2024-02-22T00:34:16.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.206+0000 7f037b7fe700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0364066dc0 0x7f0364069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:16.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.207+0000 7f037b7fe700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0364066dc0 0x7f0364069280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f03700047c0 tx=0x7f0370009cb0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:16.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.210+0000 7f03797fa700 1 -- 172.21.15.49:0/3996368673 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f036c052610 con 0x7f037c0f66f0 2024-02-22T00:34:16.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.511+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f037c059120 con 0x7f0364066dc0 2024-02-22T00:34:16.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.512+0000 7f03797fa700 1 -- 172.21.15.49:0/3996368673 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f037c059120 con 0x7f0364066dc0 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0364066dc0 msgr2=0x7f0364069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0364066dc0 0x7f0364069280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f03700047c0 tx=0x7f0370009cb0).stop 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f66f0 msgr2=0x7f037c108090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f66f0 0x7f037c108090 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f036c00e8c0 tx=0x7f036c00b040).stop 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 shutdown_connections 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0364066dc0 0x7f0364069280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f037c0f66f0 0x7f037c108090 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 --2- 172.21.15.49:0/3996368673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f037c0f7990 0x7f037c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 >> 172.21.15.49:0/3996368673 conn(0x7f037c0f1e50 msgr2=0x7f037c0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 shutdown_connections 2024-02-22T00:34:16.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.514+0000 7f0382a45700 1 -- 172.21.15.49:0/3996368673 wait complete. 2024-02-22T00:34:16.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.655+0000 7f880aa4f700 1 -- 172.21.15.49:0/3622038623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804061280 msgr2=0x7f88040f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:16.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.655+0000 7f880aa4f700 1 --2- 172.21.15.49:0/3622038623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804061280 0x7f88040f81c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f87f8004730 tx=0x7f87f8009cb0).stop 2024-02-22T00:34:16.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.657+0000 7f880aa4f700 1 -- 172.21.15.49:0/3622038623 shutdown_connections 2024-02-22T00:34:16.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.657+0000 7f880aa4f700 1 --2- 172.21.15.49:0/3622038623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88040f8740 0x7f88040fabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.657+0000 7f880aa4f700 1 --2- 172.21.15.49:0/3622038623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8804061280 0x7f88040f81c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.657+0000 7f880aa4f700 1 -- 172.21.15.49:0/3622038623 >> 172.21.15.49:0/3622038623 conn(0x7f88040f1e50 msgr2=0x7f88040f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:16.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.657+0000 7f880aa4f700 1 -- 172.21.15.49:0/3622038623 shutdown_connections 2024-02-22T00:34:16.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.657+0000 7f880aa4f700 1 -- 172.21.15.49:0/3622038623 wait complete. 2024-02-22T00:34:16.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.658+0000 7f880aa4f700 1 Processor -- start 2024-02-22T00:34:16.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.658+0000 7f880aa4f700 1 -- start start 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.658+0000 7f880aa4f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8804061280 0x7f8804069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.658+0000 7f880aa4f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88040f8740 0x7f880406a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.658+0000 7f880aa4f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880406aac0 con 0x7f88040f8740 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.658+0000 7f880aa4f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880406ac00 con 0x7f8804061280 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.658+0000 7f8803fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8804061280 0x7f8804069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.658+0000 7f8803fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8804061280 0x7f8804069fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:54552/0 (socket says 172.21.15.49:54552) 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.659+0000 7f8803fff700 1 -- 172.21.15.49:0/3532791704 learned_addr learned my addr 172.21.15.49:0/3532791704 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.659+0000 7f88037fe700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88040f8740 0x7f880406a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:16.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.660+0000 7f88037fe700 1 -- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8804061280 msgr2=0x7f8804069fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.660+0000 7f88037fe700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8804061280 0x7f8804069fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.660+0000 7f88037fe700 1 -- 172.21.15.49:0/3532791704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8005040 con 0x7f88040f8740 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.660+0000 7f88037fe700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88040f8740 0x7f880406a4c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f87f40026e0 tx=0x7f87f4009dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.660+0000 7f88017fa700 1 -- 172.21.15.49:0/3532791704 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f4007d20 con 0x7f88040f8740 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.660+0000 7f88017fa700 1 -- 172.21.15.49:0/3532791704 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87f4007e80 con 0x7f88040f8740 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.661+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88040fc830 con 0x7f88040f8740 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.661+0000 7f88017fa700 1 -- 172.21.15.49:0/3532791704 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87f4024b40 con 0x7f88040f8740 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.661+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88040fcd20 con 0x7f88040f8740 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.663+0000 7f88017fa700 1 -- 172.21.15.49:0/3532791704 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7f87f4024db0 con 0x7f88040f8740 2024-02-22T00:34:16.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.663+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88041065c0 con 0x7f88040f8740 2024-02-22T00:34:16.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.664+0000 7f88017fa700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f87ec066dc0 0x7f87ec069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:16.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.664+0000 7f88017fa700 1 -- 172.21.15.49:0/3532791704 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f87f4095090 con 0x7f88040f8740 2024-02-22T00:34:16.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.665+0000 7f8803fff700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f87ec066dc0 0x7f87ec069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:16.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.665+0000 7f8803fff700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f87ec066dc0 0x7f87ec069280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f87f8004e50 tx=0x7f87f8009cb0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:16.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:16.671+0000 7f88017fa700 1 -- 172.21.15.49:0/3532791704 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f87f405f6c0 con 0x7f88040f8740 2024-02-22T00:34:17.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.066+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8804059120 con 0x7f87ec066dc0 2024-02-22T00:34:17.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.077+0000 7f88017fa700 1 -- 172.21.15.49:0/3532791704 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f8804059120 con 0x7f87ec066dc0 2024-02-22T00:34:17.079 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:34:17.079 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 starting - - - - 2024-02-22T00:34:17.079 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (8m) 70s ago 8m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:34:17.079 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (8m) 71s ago 8m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:34:17.079 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (7m) 70s ago 8m 54.7M - 8.3.5 dad864ee21e9 d07a1ce3ae93 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (3m) 70s ago 3m 13.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (3m) 70s ago 3m 96.8M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (3m) 71s ago 3m 13.3M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (3m) 71s ago 3m 75.0M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:9283 running (10m) 70s ago 10m 182M - 16.2.14-550-geb66ed92 7403d1862307 c15a70e0a1be 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 running (97s) 71s ago 8m 483M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d128d026ba47 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (10m) 70s ago 10m 50.4M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (7m) 71s ago 7m 43.5M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (8m) 70s ago 8m 22.8M - 1.3.1 1dbe0e931976 22b6c923dd53 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (7m) 71s ago 7m 21.5M - 1.3.1 1dbe0e931976 3bd6815e682e 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 70s ago 7m 93.7M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:34:17.080 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6m) 70s ago 6m 103M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:34:17.081 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 70s ago 6m 85.9M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:34:17.081 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (5m) 71s ago 5m 102M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:34:17.081 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (5m) 71s ago 5m 96.4M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:34:17.081 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (5m) 71s ago 5m 90.7M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:34:17.081 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (7m) 71s ago 7m 60.3M - 2.33.4 514e6a882f6e 0880324bb723 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.079+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f87ec066dc0 msgr2=0x7f87ec069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.079+0000 7f880aa4f700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f87ec066dc0 0x7f87ec069280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f87f8004e50 tx=0x7f87f8009cb0).stop 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.079+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88040f8740 msgr2=0x7f880406a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.079+0000 7f880aa4f700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88040f8740 0x7f880406a4c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f87f40026e0 tx=0x7f87f4009dc0).stop 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.080+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 shutdown_connections 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.080+0000 7f880aa4f700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f87ec066dc0 0x7f87ec069280 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.080+0000 7f880aa4f700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8804061280 0x7f8804069fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.080+0000 7f880aa4f700 1 --2- 172.21.15.49:0/3532791704 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88040f8740 0x7f880406a4c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.080+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 >> 172.21.15.49:0/3532791704 conn(0x7f88040f1e50 msgr2=0x7f88040f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.080+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 shutdown_connections 2024-02-22T00:34:17.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.080+0000 7f880aa4f700 1 -- 172.21.15.49:0/3532791704 wait complete. 2024-02-22T00:34:17.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:15.769061+0000 mgr.smithi161.sazlam (mgr.24369) 72 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 36 MiB/s rd, 97 MiB/s wr, 478 op/s 2024-02-22T00:34:17.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:16.072376+0000 mgr.smithi161.sazlam (mgr.24369) 73 : audit [DBG] from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:17.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.226+0000 7fd61809e700 1 -- 172.21.15.49:0/4112136006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 msgr2=0x7fd6100f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:17.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.226+0000 7fd61809e700 1 --2- 172.21.15.49:0/4112136006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 0x7fd6100f6b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd608009b60 tx=0x7fd608004d10).stop 2024-02-22T00:34:17.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.226+0000 7fd61809e700 1 -- 172.21.15.49:0/4112136006 shutdown_connections 2024-02-22T00:34:17.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.226+0000 7fd61809e700 1 --2- 172.21.15.49:0/4112136006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6100f7990 0x7fd6100f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.226+0000 7fd61809e700 1 --2- 172.21.15.49:0/4112136006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 0x7fd6100f6b10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.226+0000 7fd61809e700 1 -- 172.21.15.49:0/4112136006 >> 172.21.15.49:0/4112136006 conn(0x7fd6100f1e50 msgr2=0x7fd6100f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.226+0000 7fd61809e700 1 -- 172.21.15.49:0/4112136006 shutdown_connections 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.226+0000 7fd61809e700 1 -- 172.21.15.49:0/4112136006 wait complete. 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd61809e700 1 Processor -- start 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd61809e700 1 -- start start 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd61809e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 0x7fd610120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd61809e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6100f7990 0x7fd610120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd61809e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd610121120 con 0x7fd6100f7990 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd61809e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd610121260 con 0x7fd6100f66f0 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd615e3a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 0x7fd610120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd615e3a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 0x7fd610120680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:54574/0 (socket says 172.21.15.49:54574) 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.227+0000 7fd615e3a700 1 -- 172.21.15.49:0/3031749872 learned_addr learned my addr 172.21.15.49:0/3031749872 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:17.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.228+0000 7fd615639700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6100f7990 0x7fd610120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.228+0000 7fd615e3a700 1 -- 172.21.15.49:0/3031749872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6100f7990 msgr2=0x7fd610120b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.228+0000 7fd615e3a700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6100f7990 0x7fd610120b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.228+0000 7fd615e3a700 1 -- 172.21.15.49:0/3031749872 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080097c0 con 0x7fd6100f66f0 2024-02-22T00:34:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.228+0000 7fd615e3a700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 0x7fd610120680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd608003380 tx=0x7fd608004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.228+0000 7fd606ffd700 1 -- 172.21.15.49:0/3031749872 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd60800e070 con 0x7fd6100f66f0 2024-02-22T00:34:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.228+0000 7fd606ffd700 1 -- 172.21.15.49:0/3031749872 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd608007e90 con 0x7fd6100f66f0 2024-02-22T00:34:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.229+0000 7fd606ffd700 1 -- 172.21.15.49:0/3031749872 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd60801a070 con 0x7fd6100f66f0 2024-02-22T00:34:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.229+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd610060590 con 0x7fd6100f66f0 2024-02-22T00:34:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.229+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd610060ad0 con 0x7fd6100f66f0 2024-02-22T00:34:17.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.230+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd610064a00 con 0x7fd6100f66f0 2024-02-22T00:34:17.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.231+0000 7fd606ffd700 1 -- 172.21.15.49:0/3031749872 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7fd60801f9b0 con 0x7fd6100f66f0 2024-02-22T00:34:17.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.232+0000 7fd606ffd700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd5fc066e10 0x7fd5fc0692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:17.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.232+0000 7fd606ffd700 1 -- 172.21.15.49:0/3031749872 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fd608087a90 con 0x7fd6100f66f0 2024-02-22T00:34:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.233+0000 7fd615639700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd5fc066e10 0x7fd5fc0692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.234+0000 7fd615639700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd5fc066e10 0x7fd5fc0692d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd60c008cc0 tx=0x7fd60c01c040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.239+0000 7fd606ffd700 1 -- 172.21.15.49:0/3031749872 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fd608055af0 con 0x7fd6100f66f0 2024-02-22T00:34:17.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:15.769061+0000 mgr.smithi161.sazlam (mgr.24369) 72 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 2.0 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 36 MiB/s rd, 97 MiB/s wr, 478 op/s 2024-02-22T00:34:17.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:16.072376+0000 mgr.smithi161.sazlam (mgr.24369) 73 : audit [DBG] from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:17.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.669+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd610125c40 con 0x7fd6100f66f0 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1, 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:34:17.674 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 13, 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:34:17.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.670+0000 7fd606ffd700 1 -- 172.21.15.49:0/3031749872 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+858 (secure 0 0 0) 0x7fd6080556e0 con 0x7fd6100f66f0 2024-02-22T00:34:17.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd5fc066e10 msgr2=0x7fd5fc0692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:17.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd5fc066e10 0x7fd5fc0692d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd60c008cc0 tx=0x7fd60c01c040).stop 2024-02-22T00:34:17.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 msgr2=0x7fd610120680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:17.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 0x7fd610120680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd608003380 tx=0x7fd608004d10).stop 2024-02-22T00:34:17.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 shutdown_connections 2024-02-22T00:34:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd5fc066e10 0x7fd5fc0692d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6100f66f0 0x7fd610120680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 --2- 172.21.15.49:0/3031749872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6100f7990 0x7fd610120b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 >> 172.21.15.49:0/3031749872 conn(0x7fd6100f1e50 msgr2=0x7fd610067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 shutdown_connections 2024-02-22T00:34:17.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.674+0000 7fd61809e700 1 -- 172.21.15.49:0/3031749872 wait complete. 2024-02-22T00:34:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.816+0000 7fd62ed56700 1 -- 172.21.15.49:0/434713462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 msgr2=0x7fd6280f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.816+0000 7fd62ed56700 1 --2- 172.21.15.49:0/434713462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 0x7fd6280f6b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fd61c0047f0 tx=0x7fd61c009cb0).stop 2024-02-22T00:34:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.816+0000 7fd62ed56700 1 -- 172.21.15.49:0/434713462 shutdown_connections 2024-02-22T00:34:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.816+0000 7fd62ed56700 1 --2- 172.21.15.49:0/434713462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280f7990 0x7fd6280f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.816+0000 7fd62ed56700 1 --2- 172.21.15.49:0/434713462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 0x7fd6280f6b10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.816+0000 7fd62ed56700 1 -- 172.21.15.49:0/434713462 >> 172.21.15.49:0/434713462 conn(0x7fd6280f1e50 msgr2=0x7fd6280f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.816+0000 7fd62ed56700 1 -- 172.21.15.49:0/434713462 shutdown_connections 2024-02-22T00:34:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.816+0000 7fd62ed56700 1 -- 172.21.15.49:0/434713462 wait complete. 2024-02-22T00:34:17.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62ed56700 1 Processor -- start 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62ed56700 1 -- start start 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62ed56700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 0x7fd6280fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62ed56700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280f7990 0x7fd6280f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62ed56700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280fac20 con 0x7fd6280f66f0 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62ed56700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62810bd80 con 0x7fd6280f7990 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62caf2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 0x7fd6280fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62caf2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 0x7fd6280fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58590/0 (socket says 172.21.15.49:58590) 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd62caf2700 1 -- 172.21.15.49:0/12493393 learned_addr learned my addr 172.21.15.49:0/12493393 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.817+0000 7fd627fff700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280f7990 0x7fd6280f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd62caf2700 1 -- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280f7990 msgr2=0x7fd6280f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd62caf2700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280f7990 0x7fd6280f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:17.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd62caf2700 1 -- 172.21.15.49:0/12493393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c005040 con 0x7fd6280f66f0 2024-02-22T00:34:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd62caf2700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 0x7fd6280fa670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fd61c013560 tx=0x7fd61c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd625ffb700 1 -- 172.21.15.49:0/12493393 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd61c018070 con 0x7fd6280f66f0 2024-02-22T00:34:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd625ffb700 1 -- 172.21.15.49:0/12493393 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd61c007e90 con 0x7fd6280f66f0 2024-02-22T00:34:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd625ffb700 1 -- 172.21.15.49:0/12493393 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd61c01c380 con 0x7fd6280f66f0 2024-02-22T00:34:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62810bfa0 con 0x7fd6280f66f0 2024-02-22T00:34:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.818+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6280f9590 con 0x7fd6280f66f0 2024-02-22T00:34:17.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.820+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6280feeb0 con 0x7fd6280f66f0 2024-02-22T00:34:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.820+0000 7fd625ffb700 1 -- 172.21.15.49:0/12493393 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) v1 ==== 84066+0+0 (secure 0 0 0) 0x7fd61c0123c0 con 0x7fd6280f66f0 2024-02-22T00:34:17.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.821+0000 7fd625ffb700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd618066dc0 0x7fd618069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.821+0000 7fd625ffb700 1 -- 172.21.15.49:0/12493393 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fd61c085020 con 0x7fd6280f66f0 2024-02-22T00:34:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.821+0000 7fd627fff700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd618066dc0 0x7fd618069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:17.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.822+0000 7fd627fff700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd618066dc0 0x7fd618069280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd6140048b0 tx=0x7fd61400b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:17.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:17.826+0000 7fd625ffb700 1 -- 172.21.15.49:0/12493393 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fd61c053140 con 0x7fd6280f66f0 2024-02-22T00:34:18.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.127+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6280f9910 con 0x7fd618066dc0 2024-02-22T00:34:18.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.128+0000 7fd625ffb700 1 -- 172.21.15.49:0/12493393 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fd6280f9910 con 0x7fd618066dc0 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "1/2 daemons upgraded", 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:34:18.131 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd618066dc0 msgr2=0x7fd618069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd618066dc0 0x7fd618069280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fd6140048b0 tx=0x7fd61400b040).stop 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 msgr2=0x7fd6280fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 0x7fd6280fa670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fd61c013560 tx=0x7fd61c009cb0).stop 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 shutdown_connections 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fd618066dc0 0x7fd618069280 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6280f66f0 0x7fd6280fa670 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 --2- 172.21.15.49:0/12493393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6280f7990 0x7fd6280f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.131+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 >> 172.21.15.49:0/12493393 conn(0x7fd6280f1e50 msgr2=0x7fd6280fc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:18.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.132+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 shutdown_connections 2024-02-22T00:34:18.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:18.132+0000 7fd62ed56700 1 -- 172.21.15.49:0/12493393 wait complete. 2024-02-22T00:34:18.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:16.513109+0000 mgr.smithi161.sazlam (mgr.24369) 74 : audit [DBG] from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:18.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:17.068364+0000 mgr.smithi161.sazlam (mgr.24369) 75 : audit [DBG] from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:18.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:17.670398+0000 mon.smithi161 (mon.1) 66 : audit [DBG] from='client.? 172.21.15.49:0/3031749872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:34:18.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:16.513109+0000 mgr.smithi161.sazlam (mgr.24369) 74 : audit [DBG] from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:18.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:17.068364+0000 mgr.smithi161.sazlam (mgr.24369) 75 : audit [DBG] from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:18.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:17.670398+0000 mon.smithi161 (mon.1) 66 : audit [DBG] from='client.? 172.21.15.49:0/3031749872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:34:19.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:17.769416+0000 mgr.smithi161.sazlam (mgr.24369) 76 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 19 MiB/s rd, 58 MiB/s wr, 403 op/s 2024-02-22T00:34:19.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:18.129197+0000 mgr.smithi161.sazlam (mgr.24369) 77 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:19.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:17.769416+0000 mgr.smithi161.sazlam (mgr.24369) 76 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 19 MiB/s rd, 58 MiB/s wr, 403 op/s 2024-02-22T00:34:19.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:18.129197+0000 mgr.smithi161.sazlam (mgr.24369) 77 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:21.113 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:19.769705+0000 mgr.smithi161.sazlam (mgr.24369) 78 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 6.9 MiB/s rd, 22 MiB/s wr, 277 op/s 2024-02-22T00:34:21.113 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:19.840969+0000 mon.smithi161 (mon.1) 67 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:34:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:19.769705+0000 mgr.smithi161.sazlam (mgr.24369) 78 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 6.9 MiB/s rd, 22 MiB/s wr, 277 op/s 2024-02-22T00:34:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:19.840969+0000 mon.smithi161 (mon.1) 67 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:34:23.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:21.770172+0000 mgr.smithi161.sazlam (mgr.24369) 79 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 6.9 MiB/s rd, 22 MiB/s wr, 428 op/s 2024-02-22T00:34:23.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:21.842646+0000 mon.smithi049 (mon.0) 705 : cluster [DBG] mgrmap e24: smithi161.sazlam(active, since 92s), standbys: smithi049.rjblpr 2024-02-22T00:34:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:21.770172+0000 mgr.smithi161.sazlam (mgr.24369) 79 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 6.9 MiB/s rd, 22 MiB/s wr, 428 op/s 2024-02-22T00:34:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:21.842646+0000 mon.smithi049 (mon.0) 705 : cluster [DBG] mgrmap e24: smithi161.sazlam(active, since 92s), standbys: smithi049.rjblpr 2024-02-22T00:34:25.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:23.770510+0000 mgr.smithi161.sazlam (mgr.24369) 80 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 286 op/s 2024-02-22T00:34:25.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:23.770510+0000 mgr.smithi161.sazlam (mgr.24369) 80 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 31 KiB/s rd, 1.3 MiB/s wr, 286 op/s 2024-02-22T00:34:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:25.770967+0000 mgr.smithi161.sazlam (mgr.24369) 81 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 854 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 407 op/s 2024-02-22T00:34:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:25.770967+0000 mgr.smithi161.sazlam (mgr.24369) 81 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 854 MiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 48 KiB/s rd, 1.8 MiB/s wr, 407 op/s 2024-02-22T00:34:28.016 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-22T00:34:28.016 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-22T00:34:29.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:27.771343+0000 mgr.smithi161.sazlam (mgr.24369) 82 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 767 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 315 op/s 2024-02-22T00:34:29.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:27.771343+0000 mgr.smithi161.sazlam (mgr.24369) 82 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 767 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 315 op/s 2024-02-22T00:34:31.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:29.771672+0000 mgr.smithi161.sazlam (mgr.24369) 83 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 767 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 297 op/s 2024-02-22T00:34:31.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:29.771672+0000 mgr.smithi161.sazlam (mgr.24369) 83 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 767 MiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 297 op/s 2024-02-22T00:34:33.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:31.772158+0000 mgr.smithi161.sazlam (mgr.24369) 84 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.9 MiB/s wr, 422 op/s 2024-02-22T00:34:33.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:31.772158+0000 mgr.smithi161.sazlam (mgr.24369) 84 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.9 MiB/s wr, 422 op/s 2024-02-22T00:34:35.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:33.772576+0000 mgr.smithi161.sazlam (mgr.24369) 85 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.3 MiB/s wr, 271 op/s 2024-02-22T00:34:35.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:34.842094+0000 mon.smithi161 (mon.1) 68 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:34:35.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:33.772576+0000 mgr.smithi161.sazlam (mgr.24369) 85 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.3 MiB/s wr, 271 op/s 2024-02-22T00:34:35.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:34.842094+0000 mon.smithi161 (mon.1) 68 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:34:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:35.773072+0000 mgr.smithi161.sazlam (mgr.24369) 86 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 278 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.7 MiB/s wr, 414 op/s 2024-02-22T00:34:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:35.773072+0000 mgr.smithi161.sazlam (mgr.24369) 86 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 278 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.7 MiB/s wr, 414 op/s 2024-02-22T00:34:39.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:37.773437+0000 mgr.smithi161.sazlam (mgr.24369) 87 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.4 MiB/s wr, 336 op/s 2024-02-22T00:34:39.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:37.773437+0000 mgr.smithi161.sazlam (mgr.24369) 87 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.4 MiB/s wr, 336 op/s 2024-02-22T00:34:40.872 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:39.773739+0000 mgr.smithi161.sazlam (mgr.24369) 88 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.3 MiB/s wr, 310 op/s 2024-02-22T00:34:41.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:39.773739+0000 mgr.smithi161.sazlam (mgr.24369) 88 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.3 MiB/s wr, 310 op/s 2024-02-22T00:34:43.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:41.774176+0000 mgr.smithi161.sazlam (mgr.24369) 89 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 520 op/s 2024-02-22T00:34:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:41.774176+0000 mgr.smithi161.sazlam (mgr.24369) 89 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 520 op/s 2024-02-22T00:34:45.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:43.774446+0000 mgr.smithi161.sazlam (mgr.24369) 90 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 396 op/s 2024-02-22T00:34:45.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:44.809346+0000 mon.smithi049 (mon.0) 706 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:45.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:44.816400+0000 mon.smithi049 (mon.0) 707 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:45.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:43.774446+0000 mgr.smithi161.sazlam (mgr.24369) 90 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 279 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 396 op/s 2024-02-22T00:34:45.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:44.809346+0000 mon.smithi049 (mon.0) 706 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:45.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:44.816400+0000 mon.smithi049 (mon.0) 707 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:34:44.856672+0000 mgr.smithi161.sazlam (mgr.24369) 91 : cephadm [INF] Reconfiguring node-exporter.smithi049 (dependencies changed)... 2024-02-22T00:34:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:45 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:34:44.857074+0000 mgr.smithi161.sazlam (mgr.24369) 92 : cephadm [INF] Reconfiguring daemon node-exporter.smithi049 on smithi049 2024-02-22T00:34:46.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:34:44.856672+0000 mgr.smithi161.sazlam (mgr.24369) 91 : cephadm [INF] Reconfiguring node-exporter.smithi049 (dependencies changed)... 2024-02-22T00:34:46.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:45 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:34:44.857074+0000 mgr.smithi161.sazlam (mgr.24369) 92 : cephadm [INF] Reconfiguring daemon node-exporter.smithi049 on smithi049 2024-02-22T00:34:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:45.774789+0000 mgr.smithi161.sazlam (mgr.24369) 93 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.7 MiB/s wr, 546 op/s 2024-02-22T00:34:47.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:45.774789+0000 mgr.smithi161.sazlam (mgr.24369) 93 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.7 MiB/s wr, 546 op/s 2024-02-22T00:34:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.264+0000 7fe970aa5700 1 -- 172.21.15.49:0/3598205186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 msgr2=0x7fe96c0f80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.264+0000 7fe970aa5700 1 --2- 172.21.15.49:0/3598205186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 0x7fe96c0f80e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fe95c0047f0 tx=0x7fe95c009cb0).stop 2024-02-22T00:34:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.264+0000 7fe970aa5700 1 -- 172.21.15.49:0/3598205186 shutdown_connections 2024-02-22T00:34:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.264+0000 7fe970aa5700 1 --2- 172.21.15.49:0/3598205186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe96c0f69c0 0x7fe96c0f6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.264+0000 7fe970aa5700 1 --2- 172.21.15.49:0/3598205186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 0x7fe96c0f80e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.264+0000 7fe970aa5700 1 -- 172.21.15.49:0/3598205186 >> 172.21.15.49:0/3598205186 conn(0x7fe96c0f15d0 msgr2=0x7fe96c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.264+0000 7fe970aa5700 1 -- 172.21.15.49:0/3598205186 shutdown_connections 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.264+0000 7fe970aa5700 1 -- 172.21.15.49:0/3598205186 wait complete. 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.265+0000 7fe970aa5700 1 Processor -- start 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.265+0000 7fe970aa5700 1 -- start start 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.265+0000 7fe970aa5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe96c0f69c0 0x7fe96c106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.265+0000 7fe970aa5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 0x7fe96c107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.265+0000 7fe970aa5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c107a30 con 0x7fe96c0f7cc0 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.265+0000 7fe970aa5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c107b70 con 0x7fe96c0f69c0 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.265+0000 7fe969d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 0x7fe96c107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.265+0000 7fe96a59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe96c0f69c0 0x7fe96c106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe969d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 0x7fe96c107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56594/0 (socket says 172.21.15.49:56594) 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe969d9b700 1 -- 172.21.15.49:0/720086150 learned_addr learned my addr 172.21.15.49:0/720086150 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe96a59c700 1 -- 172.21.15.49:0/720086150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 msgr2=0x7fe96c107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe96a59c700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 0x7fe96c107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe96a59c700 1 -- 172.21.15.49:0/720086150 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c005040 con 0x7fe96c0f69c0 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe96a59c700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe96c0f69c0 0x7fe96c106f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe95c013560 tx=0x7fe95c009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe95b7fe700 1 -- 172.21.15.49:0/720086150 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe95c018070 con 0x7fe96c0f69c0 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c10c5b0 con 0x7fe96c0f69c0 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe95b7fe700 1 -- 172.21.15.49:0/720086150 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe95c007e90 con 0x7fe96c0f69c0 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe95b7fe700 1 -- 172.21.15.49:0/720086150 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe95c0123c0 con 0x7fe96c0f69c0 2024-02-22T00:34:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.266+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c10cb70 con 0x7fe96c0f69c0 2024-02-22T00:34:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.267+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c0fef00 con 0x7fe96c0f69c0 2024-02-22T00:34:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.268+0000 7fe95b7fe700 1 -- 172.21.15.49:0/720086150 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 24) v1 ==== 83964+0+0 (secure 0 0 0) 0x7fe95c01d420 con 0x7fe96c0f69c0 2024-02-22T00:34:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.268+0000 7fe95b7fe700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fe954066ca0 0x7fe954069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.268+0000 7fe95b7fe700 1 -- 172.21.15.49:0/720086150 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fe95c084df0 con 0x7fe96c0f69c0 2024-02-22T00:34:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.268+0000 7fe969d9b700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fe954066ca0 0x7fe954069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.269+0000 7fe969d9b700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fe954066ca0 0x7fe954069160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe9600041d0 tx=0x7fe96000b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:48.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.274+0000 7fe95b7fe700 1 -- 172.21.15.49:0/720086150 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fe95c052ff0 con 0x7fe96c0f69c0 2024-02-22T00:34:48.367 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-22T00:34:48.367 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-22T00:34:48.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.568+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe96c059120 con 0x7fe954066ca0 2024-02-22T00:34:48.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.569+0000 7fe95b7fe700 1 -- 172.21.15.49:0/720086150 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe96c059120 con 0x7fe954066ca0 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fe954066ca0 msgr2=0x7fe954069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fe954066ca0 0x7fe954069160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe9600041d0 tx=0x7fe96000b040).stop 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe96c0f69c0 msgr2=0x7fe96c106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe96c0f69c0 0x7fe96c106f90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe95c013560 tx=0x7fe95c009cb0).stop 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 shutdown_connections 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fe954066ca0 0x7fe954069160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe96c0f69c0 0x7fe96c106f90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 --2- 172.21.15.49:0/720086150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe96c0f7cc0 0x7fe96c107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 >> 172.21.15.49:0/720086150 conn(0x7fe96c0f15d0 msgr2=0x7fe96c0fb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:48.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 shutdown_connections 2024-02-22T00:34:48.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.571+0000 7fe970aa5700 1 -- 172.21.15.49:0/720086150 wait complete. 2024-02-22T00:34:48.585 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:34:48.594 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:47.328247+0000 mon.smithi049 (mon.0) 708 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:48.594 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:47.336325+0000 mon.smithi049 (mon.0) 709 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:48.594 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:34:47.375423+0000 mgr.smithi161.sazlam (mgr.24369) 94 : cephadm [INF] Reconfiguring node-exporter.smithi161 (dependencies changed)... 2024-02-22T00:34:48.594 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:34:47.375752+0000 mgr.smithi161.sazlam (mgr.24369) 95 : cephadm [INF] Reconfiguring daemon node-exporter.smithi161 on smithi161 2024-02-22T00:34:48.594 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:47.775133+0000 mgr.smithi161.sazlam (mgr.24369) 96 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 461 op/s 2024-02-22T00:34:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:47.328247+0000 mon.smithi049 (mon.0) 708 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:47.336325+0000 mon.smithi049 (mon.0) 709 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:34:47.375423+0000 mgr.smithi161.sazlam (mgr.24369) 94 : cephadm [INF] Reconfiguring node-exporter.smithi161 (dependencies changed)... 2024-02-22T00:34:48.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:34:47.375752+0000 mgr.smithi161.sazlam (mgr.24369) 95 : cephadm [INF] Reconfiguring daemon node-exporter.smithi161 on smithi161 2024-02-22T00:34:48.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:47.775133+0000 mgr.smithi161.sazlam (mgr.24369) 96 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.7 MiB/s wr, 461 op/s 2024-02-22T00:34:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.678+0000 7f25519d6700 1 -- 172.21.15.49:0/4271300969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 msgr2=0x7f254c0ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.678+0000 7f25519d6700 1 --2- 172.21.15.49:0/4271300969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 0x7f254c0ff130 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f2540004820 tx=0x7f2540009cb0).stop 2024-02-22T00:34:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.678+0000 7f25519d6700 1 -- 172.21.15.49:0/4271300969 shutdown_connections 2024-02-22T00:34:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.678+0000 7f25519d6700 1 --2- 172.21.15.49:0/4271300969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 0x7f254c0ff130 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.679+0000 7f25519d6700 1 --2- 172.21.15.49:0/4271300969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f254c061200 0x7f254c0fc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.679+0000 7f25519d6700 1 -- 172.21.15.49:0/4271300969 >> 172.21.15.49:0/4271300969 conn(0x7f254c0f1e50 msgr2=0x7f254c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.679+0000 7f25519d6700 1 -- 172.21.15.49:0/4271300969 shutdown_connections 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.679+0000 7f25519d6700 1 -- 172.21.15.49:0/4271300969 wait complete. 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.679+0000 7f25519d6700 1 Processor -- start 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.679+0000 7f25519d6700 1 -- start start 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f25519d6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f254c061200 0x7f254c10a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f25519d6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 0x7f254c10a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f25519d6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c10acc0 con 0x7f254c0fcd40 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f25519d6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c10ae00 con 0x7f254c061200 2024-02-22T00:34:48.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f254a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 0x7f254c10a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f254a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 0x7f254c10a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56624/0 (socket says 172.21.15.49:56624) 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f254affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f254c061200 0x7f254c10a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f254a7fc700 1 -- 172.21.15.49:0/3830074626 learned_addr learned my addr 172.21.15.49:0/3830074626 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f254a7fc700 1 -- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f254c061200 msgr2=0x7f254c10a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f254a7fc700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f254c061200 0x7f254c10a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f254a7fc700 1 -- 172.21.15.49:0/3830074626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2540005040 con 0x7f254c0fcd40 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f254a7fc700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 0x7f254c10a710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f2540004e50 tx=0x7f2540009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f2533fff700 1 -- 172.21.15.49:0/3830074626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2540018070 con 0x7f254c0fcd40 2024-02-22T00:34:48.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f2533fff700 1 -- 172.21.15.49:0/3830074626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2540007e90 con 0x7f254c0fcd40 2024-02-22T00:34:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c10f840 con 0x7f254c0fcd40 2024-02-22T00:34:48.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f2533fff700 1 -- 172.21.15.49:0/3830074626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f254001c3c0 con 0x7f254c0fcd40 2024-02-22T00:34:48.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.680+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c10fe00 con 0x7f254c0fcd40 2024-02-22T00:34:48.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.681+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c1021e0 con 0x7f254c0fcd40 2024-02-22T00:34:48.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.682+0000 7f2533fff700 1 -- 172.21.15.49:0/3830074626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 83964+0+0 (secure 0 0 0) 0x7f254001d420 con 0x7f254c0fcd40 2024-02-22T00:34:48.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.682+0000 7f2533fff700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2534066ca0 0x7f2534069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:48.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.682+0000 7f2533fff700 1 -- 172.21.15.49:0/3830074626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f25400854c0 con 0x7f254c0fcd40 2024-02-22T00:34:48.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.682+0000 7f254affd700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2534066ca0 0x7f2534069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:48.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.683+0000 7f254affd700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2534066ca0 0x7f2534069160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f253c004ee0 tx=0x7f253c00b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:48.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.688+0000 7f2533fff700 1 -- 172.21.15.49:0/3830074626 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f2540053780 con 0x7f254c0fcd40 2024-02-22T00:34:48.748 DEBUG:teuthology.parallel:result is None 2024-02-22T00:34:48.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.936+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f254c059120 con 0x7f2534066ca0 2024-02-22T00:34:48.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.938+0000 7f2533fff700 1 -- 172.21.15.49:0/3830074626 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f254c059120 con 0x7f2534066ca0 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2534066ca0 msgr2=0x7f2534069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2534066ca0 0x7f2534069160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f253c004ee0 tx=0x7f253c00b040).stop 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 msgr2=0x7f254c10a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 0x7f254c10a710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f2540004e50 tx=0x7f2540009cb0).stop 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 shutdown_connections 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2534066ca0 0x7f2534069160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f254c061200 0x7f254c10a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 --2- 172.21.15.49:0/3830074626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f254c0fcd40 0x7f254c10a710 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:48.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.941+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 >> 172.21.15.49:0/3830074626 conn(0x7f254c0f1e50 msgr2=0x7f254c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:48.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.942+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 shutdown_connections 2024-02-22T00:34:48.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:48.942+0000 7f25519d6700 1 -- 172.21.15.49:0/3830074626 wait complete. 2024-02-22T00:34:49.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.084+0000 7f0d35f25700 1 -- 172.21.15.49:0/3749180653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f8cb0 msgr2=0x7f0d300f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:49.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.084+0000 7f0d35f25700 1 --2- 172.21.15.49:0/3749180653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f8cb0 0x7f0d300f9110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f0d240047f0 tx=0x7f0d24009cb0).stop 2024-02-22T00:34:49.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.084+0000 7f0d35f25700 1 -- 172.21.15.49:0/3749180653 shutdown_connections 2024-02-22T00:34:49.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.084+0000 7f0d35f25700 1 --2- 172.21.15.49:0/3749180653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f8cb0 0x7f0d300f9110 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.084+0000 7f0d35f25700 1 --2- 172.21.15.49:0/3749180653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d300f7a10 0x7f0d300f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:34:49.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.084+0000 7f0d35f25700 1 -- 172.21.15.49:0/3749180653 >> 172.21.15.49:0/3749180653 conn(0x7f0d300f3150 msgr2=0x7f0d300f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:49.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.084+0000 7f0d35f25700 1 -- 172.21.15.49:0/3749180653 shutdown_connections 2024-02-22T00:34:49.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.085+0000 7f0d35f25700 1 -- 172.21.15.49:0/3749180653 wait complete. 2024-02-22T00:34:49.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.085+0000 7f0d35f25700 1 Processor -- start 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.085+0000 7f0d35f25700 1 -- start start 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d35f25700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f7a10 0x7f0d30108210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d35f25700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d300f8cb0 0x7f0d30108700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d35f25700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30108d40 con 0x7f0d300f7a10 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d35f25700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30108e80 con 0x7f0d300f8cb0 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d2f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f7a10 0x7f0d30108210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d2f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f7a10 0x7f0d30108210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56648/0 (socket says 172.21.15.49:56648) 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d2f7fe700 1 -- 172.21.15.49:0/499520791 learned_addr learned my addr 172.21.15.49:0/499520791 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d2f7fe700 1 -- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d300f8cb0 msgr2=0x7f0d30108700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d2f7fe700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d300f8cb0 0x7f0d30108700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:34:49.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.086+0000 7f0d2f7fe700 1 -- 172.21.15.49:0/499520791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24005040 con 0x7f0d300f7a10 2024-02-22T00:34:49.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.087+0000 7f0d2f7fe700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f7a10 0x7f0d30108210 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f0d2000b480 tx=0x7f0d200090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:49.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.087+0000 7f0d2cff9700 1 -- 172.21.15.49:0/499520791 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d20002500 con 0x7f0d300f7a10 2024-02-22T00:34:49.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.087+0000 7f0d2cff9700 1 -- 172.21.15.49:0/499520791 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d20002b10 con 0x7f0d300f7a10 2024-02-22T00:34:49.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.087+0000 7f0d2cff9700 1 -- 172.21.15.49:0/499520791 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d20012d60 con 0x7f0d300f7a10 2024-02-22T00:34:49.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.087+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3010d920 con 0x7f0d300f7a10 2024-02-22T00:34:49.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.088+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3010de60 con 0x7f0d300f7a10 2024-02-22T00:34:49.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.090+0000 7f0d2cff9700 1 -- 172.21.15.49:0/499520791 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 83964+0+0 (secure 0 0 0) 0x7f0d20002660 con 0x7f0d300f7a10 2024-02-22T00:34:49.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.090+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3005fb50 con 0x7f0d300f7a10 2024-02-22T00:34:49.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.090+0000 7f0d2cff9700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0d18066cf0 0x7f0d180691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:49.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.090+0000 7f0d2cff9700 1 -- 172.21.15.49:0/499520791 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f0d20083d20 con 0x7f0d300f7a10 2024-02-22T00:34:49.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.091+0000 7f0d2effd700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0d18066cf0 0x7f0d180691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:49.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.093+0000 7f0d2effd700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0d18066cf0 0x7f0d180691b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0d24013620 tx=0x7f0d24009cb0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:49.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.097+0000 7f0d2cff9700 1 -- 172.21.15.49:0/499520791 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f0d200520e0 con 0x7f0d300f7a10 2024-02-22T00:34:49.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.349+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d30059120 con 0x7f0d18066cf0 2024-02-22T00:34:49.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.361+0000 7f0d2cff9700 1 -- 172.21.15.49:0/499520791 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0d30059120 con 0x7f0d18066cf0 2024-02-22T00:34:49.363 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 starting - - - - 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (9m) 102s ago 9m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (8m) 103s ago 8m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 starting - - - - 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (4m) 102s ago 4m 13.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (4m) 102s ago 4m 96.8M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (3m) 103s ago 3m 13.3M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (4m) 103s ago 4m 75.0M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:9283 running (10m) 102s ago 10m 182M - 16.2.14-550-geb66ed92 7403d1862307 c15a70e0a1be 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 running (2m) 103s ago 8m 483M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d128d026ba47 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (10m) 102s ago 10m 50.4M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (8m) 103s ago 8m 43.5M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:34:49.364 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 starting - - - - 2024-02-22T00:34:49.365 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (8m) 103s ago 8m 21.5M - 1.3.1 1dbe0e931976 3bd6815e682e 2024-02-22T00:34:49.365 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 102s ago 7m 93.7M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:34:49.365 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 102s ago 7m 103M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:34:49.365 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 102s ago 6m 85.9M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:34:49.365 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (6m) 103s ago 6m 102M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:34:49.365 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (6m) 103s ago 6m 96.4M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:34:49.365 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (5m) 103s ago 5m 90.7M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:34:49.365 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (8m) 103s ago 8m 60.3M - 2.33.4 514e6a882f6e 0880324bb723 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.363+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0d18066cf0 msgr2=0x7f0d180691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.363+0000 7f0d35f25700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0d18066cf0 0x7f0d180691b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0d24013620 tx=0x7f0d24009cb0).stop 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.363+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f7a10 msgr2=0x7f0d30108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.363+0000 7f0d35f25700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f7a10 0x7f0d30108210 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f0d2000b480 tx=0x7f0d200090f0).stop 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.364+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 shutdown_connections 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.364+0000 7f0d35f25700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f0d18066cf0 0x7f0d180691b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.364+0000 7f0d35f25700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d300f7a10 0x7f0d30108210 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.364+0000 7f0d35f25700 1 --2- 172.21.15.49:0/499520791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d300f8cb0 0x7f0d30108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:34:49.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.364+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 >> 172.21.15.49:0/499520791 conn(0x7f0d300f3150 msgr2=0x7f0d300fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.364+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 shutdown_connections 2024-02-22T00:34:49.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.364+0000 7f0d35f25700 1 -- 172.21.15.49:0/499520791 wait complete. 2024-02-22T00:34:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.491+0000 7f31f8b3e700 1 -- 172.21.15.49:0/4206907977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 msgr2=0x7f31f40f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.491+0000 7f31f8b3e700 1 --2- 172.21.15.49:0/4206907977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 0x7f31f40f6b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f31e40047f0 tx=0x7f31e4009cb0).stop 2024-02-22T00:34:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.492+0000 7f31f8b3e700 1 -- 172.21.15.49:0/4206907977 shutdown_connections 2024-02-22T00:34:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.492+0000 7f31f8b3e700 1 --2- 172.21.15.49:0/4206907977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31f40f7990 0x7f31f40f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.492+0000 7f31f8b3e700 1 --2- 172.21.15.49:0/4206907977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 0x7f31f40f6b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.492+0000 7f31f8b3e700 1 -- 172.21.15.49:0/4206907977 >> 172.21.15.49:0/4206907977 conn(0x7f31f40f1e50 msgr2=0x7f31f40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.492+0000 7f31f8b3e700 1 -- 172.21.15.49:0/4206907977 shutdown_connections 2024-02-22T00:34:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.492+0000 7f31f8b3e700 1 -- 172.21.15.49:0/4206907977 wait complete. 2024-02-22T00:34:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f8b3e700 1 Processor -- start 2024-02-22T00:34:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f8b3e700 1 -- start start 2024-02-22T00:34:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f8b3e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 0x7f31f40610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:49.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f8b3e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31f40f7990 0x7f31f410cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f8b3e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f410d230 con 0x7f31f40f66f0 2024-02-22T00:34:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f8b3e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f410d370 con 0x7f31f40f7990 2024-02-22T00:34:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f1d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31f40f7990 0x7f31f410cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f1d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31f40f7990 0x7f31f410cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:54942/0 (socket says 172.21.15.49:54942) 2024-02-22T00:34:49.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f1d9b700 1 -- 172.21.15.49:0/727302399 learned_addr learned my addr 172.21.15.49:0/727302399 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f259c700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 0x7f31f40610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f1d9b700 1 -- 172.21.15.49:0/727302399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 msgr2=0x7f31f40610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f1d9b700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 0x7f31f40610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.493+0000 7f31f1d9b700 1 -- 172.21.15.49:0/727302399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4005040 con 0x7f31f40f7990 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.494+0000 7f31f259c700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 0x7f31f40610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.494+0000 7f31f1d9b700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31f40f7990 0x7f31f410cd40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f31e80041d0 tx=0x7f31e8009f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.494+0000 7f31e37fe700 1 -- 172.21.15.49:0/727302399 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31e8002d90 con 0x7f31f40f7990 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.494+0000 7f31e37fe700 1 -- 172.21.15.49:0/727302399 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31e800f040 con 0x7f31f40f7990 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.494+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f4106b70 con 0x7f31f40f7990 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.494+0000 7f31e37fe700 1 -- 172.21.15.49:0/727302399 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31e800d800 con 0x7f31f40f7990 2024-02-22T00:34:49.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.494+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f4107130 con 0x7f31f40f7990 2024-02-22T00:34:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.495+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f40feeb0 con 0x7f31f40f7990 2024-02-22T00:34:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.495+0000 7f31e37fe700 1 -- 172.21.15.49:0/727302399 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 24) v1 ==== 83964+0+0 (secure 0 0 0) 0x7f31e800da70 con 0x7f31f40f7990 2024-02-22T00:34:49.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.496+0000 7f31e37fe700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f31dc066ca0 0x7f31dc069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.496+0000 7f31e37fe700 1 -- 172.21.15.49:0/727302399 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f31e8084130 con 0x7f31f40f7990 2024-02-22T00:34:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.496+0000 7f31f259c700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f31dc066ca0 0x7f31dc069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:49.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.496+0000 7f31f259c700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f31dc066ca0 0x7f31dc069160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f31e40043d0 tx=0x7f31e400b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:49.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.501+0000 7f31e37fe700 1 -- 172.21.15.49:0/727302399 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f31e80523b0 con 0x7f31f40f7990 2024-02-22T00:34:49.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:48.569982+0000 mgr.smithi161.sazlam (mgr.24369) 97 : audit [DBG] from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:49.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:48.939152+0000 mgr.smithi161.sazlam (mgr.24369) 98 : audit [DBG] from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:49.718 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:48.569982+0000 mgr.smithi161.sazlam (mgr.24369) 97 : audit [DBG] from='client.24471 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:49.718 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:48.939152+0000 mgr.smithi161.sazlam (mgr.24369) 98 : audit [DBG] from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:49.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.879+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f31f41008c0 con 0x7f31f40f7990 2024-02-22T00:34:49.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.879+0000 7f31e37fe700 1 -- 172.21.15.49:0/727302399 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+858 (secure 0 0 0) 0x7f31e8051fa0 con 0x7f31f40f7990 2024-02-22T00:34:49.882 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:34:49.882 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:34:49.882 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:34:49.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:34:49.882 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:34:49.882 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1, 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 13, 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:34:49.883 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:34:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f31dc066ca0 msgr2=0x7f31dc069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f31dc066ca0 0x7f31dc069160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f31e40043d0 tx=0x7f31e400b040).stop 2024-02-22T00:34:49.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31f40f7990 msgr2=0x7f31f410cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31f40f7990 0x7f31f410cd40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f31e80041d0 tx=0x7f31e8009f60).stop 2024-02-22T00:34:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 shutdown_connections 2024-02-22T00:34:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f31dc066ca0 0x7f31dc069160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31f40f66f0 0x7f31f40610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 --2- 172.21.15.49:0/727302399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31f40f7990 0x7f31f410cd40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 >> 172.21.15.49:0/727302399 conn(0x7f31f40f1e50 msgr2=0x7f31f40fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 shutdown_connections 2024-02-22T00:34:49.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:49.882+0000 7f31f8b3e700 1 -- 172.21.15.49:0/727302399 wait complete. 2024-02-22T00:34:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.032+0000 7fa203060700 1 -- 172.21.15.49:0/2774472670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 msgr2=0x7fa1fc0fe180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.032+0000 7fa203060700 1 --2- 172.21.15.49:0/2774472670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 0x7fa1fc0fe180 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fa1f00047f0 tx=0x7fa1f0009cb0).stop 2024-02-22T00:34:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.032+0000 7fa203060700 1 -- 172.21.15.49:0/2774472670 shutdown_connections 2024-02-22T00:34:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.032+0000 7fa203060700 1 --2- 172.21.15.49:0/2774472670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc0fe670 0x7fa1fc0ff080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:34:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.032+0000 7fa203060700 1 --2- 172.21.15.49:0/2774472670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 0x7fa1fc0fe180 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.032+0000 7fa203060700 1 -- 172.21.15.49:0/2774472670 >> 172.21.15.49:0/2774472670 conn(0x7fa1fc06d0d0 msgr2=0x7fa1fc06f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:50.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.032+0000 7fa203060700 1 -- 172.21.15.49:0/2774472670 shutdown_connections 2024-02-22T00:34:50.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.033+0000 7fa203060700 1 -- 172.21.15.49:0/2774472670 wait complete. 2024-02-22T00:34:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa203060700 1 Processor -- start 2024-02-22T00:34:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa203060700 1 -- start start 2024-02-22T00:34:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa203060700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 0x7fa1fc1172d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa203060700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc0fe670 0x7fa1fc1177c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa203060700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc117e50 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa203060700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc117f90 con 0x7fa1fc0fe670 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa200dfc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 0x7fa1fc1172d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa200dfc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 0x7fa1fc1172d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56674/0 (socket says 172.21.15.49:56674) 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa200dfc700 1 -- 172.21.15.49:0/960841831 learned_addr learned my addr 172.21.15.49:0/960841831 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.034+0000 7fa1fbfff700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc0fe670 0x7fa1fc1177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa200dfc700 1 -- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc0fe670 msgr2=0x7fa1fc1177c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa200dfc700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc0fe670 0x7fa1fc1177c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa200dfc700 1 -- 172.21.15.49:0/960841831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f0005040 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa200dfc700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 0x7fa1fc1172d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fa1f0013620 tx=0x7fa1f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa1f9ffb700 1 -- 172.21.15.49:0/960841831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f000e030 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa203060700 1 -- 172.21.15.49:0/960841831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc11c480 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa1f9ffb700 1 -- 172.21.15.49:0/960841831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa1f0007e90 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa1f9ffb700 1 -- 172.21.15.49:0/960841831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f0018070 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.035+0000 7fa203060700 1 -- 172.21.15.49:0/960841831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc11c960 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.037+0000 7fa1e77fe700 1 -- 172.21.15.49:0/960841831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc005120 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.039+0000 7fa1f9ffb700 1 -- 172.21.15.49:0/960841831 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 83964+0+0 (secure 0 0 0) 0x7fa1f001d420 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.039+0000 7fa1f9ffb700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fa1ec066ca0 0x7fa1ec069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:34:50.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.039+0000 7fa1fbfff700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fa1ec066ca0 0x7fa1ec069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:34:50.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.040+0000 7fa1fbfff700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fa1ec066ca0 0x7fa1ec069160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa1e8006fd0 tx=0x7fa1e8009060).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:34:50.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.042+0000 7fa1f9ffb700 1 -- 172.21.15.49:0/960841831 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fa1f00543d0 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.044+0000 7fa1f9ffb700 1 -- 172.21.15.49:0/960841831 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fa1f0050070 con 0x7fa1fc0fdd60 2024-02-22T00:34:50.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.279+0000 7fa1e77fe700 1 -- 172.21.15.49:0/960841831 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1dc000bc0 con 0x7fa1ec066ca0 2024-02-22T00:34:50.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.280+0000 7fa1f9ffb700 1 -- 172.21.15.49:0/960841831 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fa1dc000bc0 con 0x7fa1ec066ca0 2024-02-22T00:34:50.282 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:34:50.283 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:34:50.283 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:34:50.283 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:34:50.283 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-02-22T00:34:50.283 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "1/2 daemons upgraded", 2024-02-22T00:34:50.283 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-02-22T00:34:50.283 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:34:50.283 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 -- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fa1ec066ca0 msgr2=0x7fa1ec069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fa1ec066ca0 0x7fa1ec069160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa1e8006fd0 tx=0x7fa1e8009060).stop 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 -- 172.21.15.49:0/960841831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 msgr2=0x7fa1fc1172d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 0x7fa1fc1172d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fa1f0013620 tx=0x7fa1f0009cb0).stop 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 -- 172.21.15.49:0/960841831 shutdown_connections 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7fa1ec066ca0 0x7fa1ec069160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1fc0fdd60 0x7fa1fc1172d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 --2- 172.21.15.49:0/960841831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc0fe670 0x7fa1fc1177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 -- 172.21.15.49:0/960841831 >> 172.21.15.49:0/960841831 conn(0x7fa1fc06d0d0 msgr2=0x7fa1fc102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 -- 172.21.15.49:0/960841831 shutdown_connections 2024-02-22T00:34:50.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:34:50.282+0000 7fa1e77fe700 1 -- 172.21.15.49:0/960841831 wait complete. 2024-02-22T00:34:51.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:49.351063+0000 mgr.smithi161.sazlam (mgr.24369) 99 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:51.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:49.775441+0000 mgr.smithi161.sazlam (mgr.24369) 100 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-02-22T00:34:51.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:49.842727+0000 mon.smithi049 (mon.0) 710 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:51.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:49.843072+0000 mon.smithi161 (mon.1) 69 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:34:51.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:49.847593+0000 mon.smithi049 (mon.0) 711 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:51.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:49.880648+0000 mon.smithi161 (mon.1) 70 : audit [DBG] from='client.? 172.21.15.49:0/727302399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:34:51.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:34:49.897175+0000 mgr.smithi161.sazlam (mgr.24369) 101 : cephadm [INF] Reconfiguring prometheus.smithi161 (dependencies changed)... 2024-02-22T00:34:51.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:34:50.133910+0000 mgr.smithi161.sazlam (mgr.24369) 102 : cephadm [INF] Reconfiguring daemon prometheus.smithi161 on smithi161 2024-02-22T00:34:51.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:49.351063+0000 mgr.smithi161.sazlam (mgr.24369) 99 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:51.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:49.775441+0000 mgr.smithi161.sazlam (mgr.24369) 100 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 281 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-02-22T00:34:51.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:49.842727+0000 mon.smithi049 (mon.0) 710 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:51.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:49.843072+0000 mon.smithi161 (mon.1) 69 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:34:51.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:49.847593+0000 mon.smithi049 (mon.0) 711 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:34:51.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:49.880648+0000 mon.smithi161 (mon.1) 70 : audit [DBG] from='client.? 172.21.15.49:0/727302399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:34:51.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:34:49.897175+0000 mgr.smithi161.sazlam (mgr.24369) 101 : cephadm [INF] Reconfiguring prometheus.smithi161 (dependencies changed)... 2024-02-22T00:34:51.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:34:50.133910+0000 mgr.smithi161.sazlam (mgr.24369) 102 : cephadm [INF] Reconfiguring daemon prometheus.smithi161 on smithi161 2024-02-22T00:34:52.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:51 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:34:50.281138+0000 mgr.smithi161.sazlam (mgr.24369) 103 : audit [DBG] from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:52.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:51 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:34:50.281138+0000 mgr.smithi161.sazlam (mgr.24369) 103 : audit [DBG] from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:34:53.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:51.775916+0000 mgr.smithi161.sazlam (mgr.24369) 104 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 59 KiB/s rd, 2.1 MiB/s wr, 630 op/s 2024-02-22T00:34:53.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:51.775916+0000 mgr.smithi161.sazlam (mgr.24369) 104 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 59 KiB/s rd, 2.1 MiB/s wr, 630 op/s 2024-02-22T00:34:55.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:53.776259+0000 mgr.smithi161.sazlam (mgr.24369) 105 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-02-22T00:34:55.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:53.776259+0000 mgr.smithi161.sazlam (mgr.24369) 105 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-02-22T00:34:57.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:55.776730+0000 mgr.smithi161.sazlam (mgr.24369) 106 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 534 op/s 2024-02-22T00:34:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:55.776730+0000 mgr.smithi161.sazlam (mgr.24369) 106 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 534 op/s 2024-02-22T00:34:59.054 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:34:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:57.777090+0000 mgr.smithi161.sazlam (mgr.24369) 107 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 264 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.6 MiB/s wr, 406 op/s 2024-02-22T00:34:59.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:34:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:57.777090+0000 mgr.smithi161.sazlam (mgr.24369) 107 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 264 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.6 MiB/s wr, 406 op/s 2024-02-22T00:35:01.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:34:59.777404+0000 mgr.smithi161.sazlam (mgr.24369) 108 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 264 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.2 MiB/s wr, 347 op/s 2024-02-22T00:35:01.198 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:34:59.777404+0000 mgr.smithi161.sazlam (mgr.24369) 108 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 264 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.2 MiB/s wr, 347 op/s 2024-02-22T00:35:03.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:01.777851+0000 mgr.smithi161.sazlam (mgr.24369) 109 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 1.5 MiB/s wr, 441 op/s 2024-02-22T00:35:03.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:01.777851+0000 mgr.smithi161.sazlam (mgr.24369) 109 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 1.5 MiB/s wr, 441 op/s 2024-02-22T00:35:05.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:03.778170+0000 mgr.smithi161.sazlam (mgr.24369) 110 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 829 KiB/s wr, 230 op/s 2024-02-22T00:35:05.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:03.977276+0000 mon.smithi049 (mon.0) 712 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:05.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:03.981947+0000 mon.smithi049 (mon.0) 713 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:04.031693+0000 mon.smithi161 (mon.1) 71 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:04.032036+0000 mgr.smithi161.sazlam (mgr.24369) 111 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:04.035184+0000 mon.smithi161 (mon.1) 72 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:04.035484+0000 mgr.smithi161.sazlam (mgr.24369) 112 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:04.038158+0000 mon.smithi161 (mon.1) 73 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:04.038520+0000 mgr.smithi161.sazlam (mgr.24369) 113 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:04.046861+0000 mon.smithi161 (mon.1) 74 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:04.049967+0000 mgr.smithi161.sazlam (mgr.24369) 114 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi161.sazlam) 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:04.050631+0000 mgr.smithi161.sazlam (mgr.24369) 115 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi161.sazlam) 2024-02-22T00:35:05.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:04.841396+0000 mon.smithi161 (mon.1) 75 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:03.778170+0000 mgr.smithi161.sazlam (mgr.24369) 110 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 829 KiB/s wr, 230 op/s 2024-02-22T00:35:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:03.977276+0000 mon.smithi049 (mon.0) 712 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:03.981947+0000 mon.smithi049 (mon.0) 713 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:04.031693+0000 mon.smithi161 (mon.1) 71 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:35:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:04.032036+0000 mgr.smithi161.sazlam (mgr.24369) 111 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:35:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:04.035184+0000 mon.smithi161 (mon.1) 72 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:35:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:04.035484+0000 mgr.smithi161.sazlam (mgr.24369) 112 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:35:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:04.038158+0000 mon.smithi161 (mon.1) 73 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:35:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:04.038520+0000 mgr.smithi161.sazlam (mgr.24369) 113 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:35:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:04.046861+0000 mon.smithi161 (mon.1) 74 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:04.049967+0000 mgr.smithi161.sazlam (mgr.24369) 114 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi161.sazlam) 2024-02-22T00:35:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:04.050631+0000 mgr.smithi161.sazlam (mgr.24369) 115 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi161.sazlam) 2024-02-22T00:35:05.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:04.841396+0000 mon.smithi161 (mon.1) 75 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:07.084 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:05.778558+0000 mgr.smithi161.sazlam (mgr.24369) 116 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 901 KiB/s wr, 305 op/s 2024-02-22T00:35:07.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:05.778558+0000 mgr.smithi161.sazlam (mgr.24369) 116 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 901 KiB/s wr, 305 op/s 2024-02-22T00:35:09.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:07.779034+0000 mgr.smithi161.sazlam (mgr.24369) 117 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 789 KiB/s wr, 224 op/s 2024-02-22T00:35:09.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:08.072180+0000 mgr.smithi161.sazlam (mgr.24369) 118 : cephadm [INF] Upgrade: Updating mgr.smithi049.rjblpr 2024-02-22T00:35:09.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:08.079633+0000 mon.smithi049 (mon.0) 714 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:09.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:08.083444+0000 mon.smithi161 (mon.1) 76 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rjblpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:35:09.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:08.083972+0000 mon.smithi049 (mon.0) 715 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rjblpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:35:09.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:08.086202+0000 mon.smithi161 (mon.1) 77 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:35:09.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:08.087299+0000 mon.smithi161 (mon.1) 78 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:35:09.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:08.088693+0000 mgr.smithi161.sazlam (mgr.24369) 119 : cephadm [INF] Deploying daemon mgr.smithi049.rjblpr on smithi049 2024-02-22T00:35:09.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:07.779034+0000 mgr.smithi161.sazlam (mgr.24369) 117 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 789 KiB/s wr, 224 op/s 2024-02-22T00:35:09.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:08.072180+0000 mgr.smithi161.sazlam (mgr.24369) 118 : cephadm [INF] Upgrade: Updating mgr.smithi049.rjblpr 2024-02-22T00:35:09.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:08.079633+0000 mon.smithi049 (mon.0) 714 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:09.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:08.083444+0000 mon.smithi161 (mon.1) 76 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rjblpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:35:09.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:08.083972+0000 mon.smithi049 (mon.0) 715 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rjblpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:35:09.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:08.086202+0000 mon.smithi161 (mon.1) 77 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:35:09.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:08.087299+0000 mon.smithi161 (mon.1) 78 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:35:09.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:08.088693+0000 mgr.smithi161.sazlam (mgr.24369) 119 : cephadm [INF] Deploying daemon mgr.smithi049.rjblpr on smithi049 2024-02-22T00:35:11.432 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:09.779418+0000 mgr.smithi161.sazlam (mgr.24369) 120 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 741 KiB/s wr, 202 op/s 2024-02-22T00:35:11.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:09.779418+0000 mgr.smithi161.sazlam (mgr.24369) 120 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 266 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 741 KiB/s wr, 202 op/s 2024-02-22T00:35:12.807 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:11.779880+0000 mgr.smithi161.sazlam (mgr.24369) 121 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 965 KiB/s wr, 282 op/s 2024-02-22T00:35:12.807 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:11.805726+0000 mon.smithi049 (mon.0) 716 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:12.807 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:11.811797+0000 mon.smithi049 (mon.0) 717 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:12.807 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:11.813157+0000 mon.smithi161 (mon.1) 79 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:12.807 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:12.187558+0000 mon.smithi049 (mon.0) 718 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:12.807 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:12.196574+0000 mon.smithi049 (mon.0) 719 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:13.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:11.779880+0000 mgr.smithi161.sazlam (mgr.24369) 121 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 965 KiB/s wr, 282 op/s 2024-02-22T00:35:13.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:11.805726+0000 mon.smithi049 (mon.0) 716 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:13.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:11.811797+0000 mon.smithi049 (mon.0) 717 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:13.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:11.813157+0000 mon.smithi161 (mon.1) 79 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:13.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:12.187558+0000 mon.smithi049 (mon.0) 718 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:13.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:12.196574+0000 mon.smithi049 (mon.0) 719 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:14.809 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:13.780374+0000 mgr.smithi161.sazlam (mgr.24369) 122 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 628 KiB/s wr, 188 op/s 2024-02-22T00:35:15.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:13.780374+0000 mgr.smithi161.sazlam (mgr.24369) 122 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 263 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 628 KiB/s wr, 188 op/s 2024-02-22T00:35:17.093 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:16 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:15.780747+0000 mgr.smithi161.sazlam (mgr.24369) 123 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 968 KiB/s wr, 273 op/s 2024-02-22T00:35:17.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:15.780747+0000 mgr.smithi161.sazlam (mgr.24369) 123 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 264 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 968 KiB/s wr, 273 op/s 2024-02-22T00:35:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:16.938364+0000 mon.smithi049 (mon.0) 720 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:16.944356+0000 mon.smithi049 (mon.0) 721 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:17.732650+0000 mon.smithi049 (mon.0) 722 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:17.738693+0000 mon.smithi049 (mon.0) 723 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:18.307 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:16.938364+0000 mon.smithi049 (mon.0) 720 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:18.307 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:16.944356+0000 mon.smithi049 (mon.0) 721 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:18.307 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:17.732650+0000 mon.smithi049 (mon.0) 722 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:18.307 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:17 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:17.738693+0000 mon.smithi049 (mon.0) 723 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:19.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:17.781100+0000 mgr.smithi161.sazlam (mgr.24369) 124 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 897 KiB/s wr, 209 op/s 2024-02-22T00:35:19.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:17.997125+0000 mon.smithi049 (mon.0) 724 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:19.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:18.002981+0000 mon.smithi049 (mon.0) 725 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:19.358 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:17.781100+0000 mgr.smithi161.sazlam (mgr.24369) 124 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 897 KiB/s wr, 209 op/s 2024-02-22T00:35:19.358 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:17.997125+0000 mon.smithi049 (mon.0) 724 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:19.358 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:18.002981+0000 mon.smithi049 (mon.0) 725 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:20.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:19.842079+0000 mon.smithi161 (mon.1) 80 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:20.188 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-22T00:35:20.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-22T00:35:20.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:19.842079+0000 mon.smithi161 (mon.1) 80 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:20.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.393+0000 7f3778b00700 1 -- 172.21.15.49:0/1692195505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 msgr2=0x7f37740f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.393+0000 7f3778b00700 1 --2- 172.21.15.49:0/1692195505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 0x7f37740f6b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f37640047f0 tx=0x7f3764009cb0).stop 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.393+0000 7f3778b00700 1 -- 172.21.15.49:0/1692195505 shutdown_connections 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.393+0000 7f3778b00700 1 --2- 172.21.15.49:0/1692195505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37740f7990 0x7f37740f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.393+0000 7f3778b00700 1 --2- 172.21.15.49:0/1692195505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 0x7f37740f6b10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.393+0000 7f3778b00700 1 -- 172.21.15.49:0/1692195505 >> 172.21.15.49:0/1692195505 conn(0x7f37740f1e50 msgr2=0x7f37740f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.393+0000 7f3778b00700 1 -- 172.21.15.49:0/1692195505 shutdown_connections 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.393+0000 7f3778b00700 1 -- 172.21.15.49:0/1692195505 wait complete. 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f3778b00700 1 Processor -- start 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f3778b00700 1 -- start start 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f3778b00700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 0x7f3774107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f3778b00700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37740f7990 0x7f3774108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:20.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f3778b00700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774108a40 con 0x7f37740f66f0 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f3778b00700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3774108b80 con 0x7f37740f7990 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f377259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 0x7f3774107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f377259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 0x7f3774107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51636/0 (socket says 172.21.15.49:51636) 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f377259c700 1 -- 172.21.15.49:0/2780145470 learned_addr learned my addr 172.21.15.49:0/2780145470 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.394+0000 7f3771d9b700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37740f7990 0x7f3774108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f377259c700 1 -- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37740f7990 msgr2=0x7f3774108490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f377259c700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37740f7990 0x7f3774108490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f377259c700 1 -- 172.21.15.49:0/2780145470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764005040 con 0x7f37740f66f0 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f377259c700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 0x7f3774107fa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3764013620 tx=0x7f3764009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f37637fe700 1 -- 172.21.15.49:0/2780145470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f376400e030 con 0x7f37740f66f0 2024-02-22T00:35:20.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f37637fe700 1 -- 172.21.15.49:0/2780145470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3764007e90 con 0x7f37740f66f0 2024-02-22T00:35:20.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774062760 con 0x7f37740f66f0 2024-02-22T00:35:20.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f37637fe700 1 -- 172.21.15.49:0/2780145470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3764018070 con 0x7f37740f66f0 2024-02-22T00:35:20.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.395+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774062d20 con 0x7f37740f66f0 2024-02-22T00:35:20.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.397+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37740feed0 con 0x7f37740f66f0 2024-02-22T00:35:20.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.397+0000 7f37637fe700 1 -- 172.21.15.49:0/2780145470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 83964+0+0 (secure 0 0 0) 0x7f376401d420 con 0x7f37740f66f0 2024-02-22T00:35:20.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.397+0000 7f37637fe700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f375c066ca0 0x7f375c069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:20.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.397+0000 7f37637fe700 1 -- 172.21.15.49:0/2780145470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f37640853a0 con 0x7f37740f66f0 2024-02-22T00:35:20.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.398+0000 7f3771d9b700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f375c066ca0 0x7f375c069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:20.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.398+0000 7f3771d9b700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f375c066ca0 0x7f375c069160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3768004de0 tx=0x7f376800b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:20.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.403+0000 7f37637fe700 1 -- 172.21.15.49:0/2780145470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f37640536e0 con 0x7f37740f66f0 2024-02-22T00:35:20.508 DEBUG:teuthology.parallel:result is None 2024-02-22T00:35:20.508 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-22T00:35:20.557 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-22T00:35:20.557 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-22T00:35:20.597 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-22T00:35:20.597 DEBUG:teuthology.parallel:result is None 2024-02-22T00:35:20.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.672+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37740fbdd0 con 0x7f375c066ca0 2024-02-22T00:35:20.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.674+0000 7f37637fe700 1 -- 172.21.15.49:0/2780145470 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f37740fbdd0 con 0x7f375c066ca0 2024-02-22T00:35:20.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f375c066ca0 msgr2=0x7f375c069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f375c066ca0 0x7f375c069160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3768004de0 tx=0x7f376800b040).stop 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 msgr2=0x7f3774107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 0x7f3774107fa0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3764013620 tx=0x7f3764009cb0).stop 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 shutdown_connections 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f375c066ca0 0x7f375c069160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37740f66f0 0x7f3774107fa0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 --2- 172.21.15.49:0/2780145470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37740f7990 0x7f3774108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 >> 172.21.15.49:0/2780145470 conn(0x7f37740f1e50 msgr2=0x7f3774060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 shutdown_connections 2024-02-22T00:35:20.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.676+0000 7f3778b00700 1 -- 172.21.15.49:0/2780145470 wait complete. 2024-02-22T00:35:20.689 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:35:20.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.780+0000 7f2e905c2700 1 -- 172.21.15.49:0/590124538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f7a10 msgr2=0x7f2e880f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.780+0000 7f2e905c2700 1 --2- 172.21.15.49:0/590124538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f7a10 0x7f2e880f7e30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f2e840047f0 tx=0x7f2e84009cb0).stop 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.780+0000 7f2e905c2700 1 -- 172.21.15.49:0/590124538 shutdown_connections 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.780+0000 7f2e905c2700 1 --2- 172.21.15.49:0/590124538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e880f8cb0 0x7f2e880f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.780+0000 7f2e905c2700 1 --2- 172.21.15.49:0/590124538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f7a10 0x7f2e880f7e30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.780+0000 7f2e905c2700 1 -- 172.21.15.49:0/590124538 >> 172.21.15.49:0/590124538 conn(0x7f2e880f3150 msgr2=0x7f2e880f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.780+0000 7f2e905c2700 1 -- 172.21.15.49:0/590124538 shutdown_connections 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.780+0000 7f2e905c2700 1 -- 172.21.15.49:0/590124538 wait complete. 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e905c2700 1 Processor -- start 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e905c2700 1 -- start start 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e905c2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e880f7a10 0x7f2e8806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e905c2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f8cb0 0x7f2e8806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e905c2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8806cf80 con 0x7f2e880f8cb0 2024-02-22T00:35:20.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e905c2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8806b520 con 0x7f2e880f7a10 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e8db5d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f8cb0 0x7f2e8806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e8db5d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f8cb0 0x7f2e8806b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51650/0 (socket says 172.21.15.49:51650) 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.781+0000 7f2e8db5d700 1 -- 172.21.15.49:0/198020796 learned_addr learned my addr 172.21.15.49:0/198020796 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e8e35e700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e880f7a10 0x7f2e8806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e8db5d700 1 -- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e880f7a10 msgr2=0x7f2e8806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e8db5d700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e880f7a10 0x7f2e8806c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e8db5d700 1 -- 172.21.15.49:0/198020796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84005040 con 0x7f2e880f8cb0 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e8db5d700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f8cb0 0x7f2e8806b030 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f2e780041d0 tx=0x7f2e78009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e7f7fe700 1 -- 172.21.15.49:0/198020796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e78007b40 con 0x7f2e880f8cb0 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e7f7fe700 1 -- 172.21.15.49:0/198020796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2e7800f040 con 0x7f2e880f8cb0 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8806b7a0 con 0x7f2e880f8cb0 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e7f7fe700 1 -- 172.21.15.49:0/198020796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e780147b0 con 0x7f2e880f8cb0 2024-02-22T00:35:20.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.782+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8806bd60 con 0x7f2e880f8cb0 2024-02-22T00:35:20.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.783+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8805fb50 con 0x7f2e880f8cb0 2024-02-22T00:35:20.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.784+0000 7f2e7f7fe700 1 -- 172.21.15.49:0/198020796 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) v1 ==== 83964+0+0 (secure 0 0 0) 0x7f2e78009110 con 0x7f2e880f8cb0 2024-02-22T00:35:20.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.784+0000 7f2e7f7fe700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2e74066ca0 0x7f2e74069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:20.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.784+0000 7f2e7f7fe700 1 -- 172.21.15.49:0/198020796 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f2e78084000 con 0x7f2e880f8cb0 2024-02-22T00:35:20.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.784+0000 7f2e8e35e700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2e74066ca0 0x7f2e74069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:20.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.785+0000 7f2e8e35e700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2e74066ca0 0x7f2e74069160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2e84004f10 tx=0x7f2e8400b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:20.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:20.789+0000 7f2e7f7fe700 1 -- 172.21.15.49:0/198020796 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f2e78052340 con 0x7f2e880f8cb0 2024-02-22T00:35:21.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.008+0000 7f2e7f7fe700 1 -- 172.21.15.49:0/198020796 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 25) v1 ==== 90687+0+0 (secure 0 0 0) 0x7f2e7804ece0 con 0x7f2e880f8cb0 2024-02-22T00:35:21.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.017+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e88059120 con 0x7f2e74066ca0 2024-02-22T00:35:21.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.018+0000 7f2e7f7fe700 1 -- 172.21.15.49:0/198020796 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f2e88059120 con 0x7f2e74066ca0 2024-02-22T00:35:21.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2e74066ca0 msgr2=0x7f2e74069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2e74066ca0 0x7f2e74069160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2e84004f10 tx=0x7f2e8400b040).stop 2024-02-22T00:35:21.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f8cb0 msgr2=0x7f2e8806b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f8cb0 0x7f2e8806b030 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f2e780041d0 tx=0x7f2e78009f60).stop 2024-02-22T00:35:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 shutdown_connections 2024-02-22T00:35:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f2e74066ca0 0x7f2e74069160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e880f7a10 0x7f2e8806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 --2- 172.21.15.49:0/198020796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e880f8cb0 0x7f2e8806b030 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 >> 172.21.15.49:0/198020796 conn(0x7f2e880f3150 msgr2=0x7f2e880fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 shutdown_connections 2024-02-22T00:35:21.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.020+0000 7f2e905c2700 1 -- 172.21.15.49:0/198020796 wait complete. 2024-02-22T00:35:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.122+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/3999405292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 msgr2=0x7f9b040f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.122+0000 7f9b0a0a9700 1 --2- 172.21.15.49:0/3999405292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 0x7f9b040f9110 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f9af80047f0 tx=0x7f9af8009cb0).stop 2024-02-22T00:35:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.122+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/3999405292 shutdown_connections 2024-02-22T00:35:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.122+0000 7f9b0a0a9700 1 --2- 172.21.15.49:0/3999405292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 0x7f9b040f9110 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.122+0000 7f9b0a0a9700 1 --2- 172.21.15.49:0/3999405292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b040f7a10 0x7f9b040f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.122+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/3999405292 >> 172.21.15.49:0/3999405292 conn(0x7f9b040f3150 msgr2=0x7f9b040f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.122+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/3999405292 shutdown_connections 2024-02-22T00:35:21.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.122+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/3999405292 wait complete. 2024-02-22T00:35:21.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b0a0a9700 1 Processor -- start 2024-02-22T00:35:21.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b0a0a9700 1 -- start start 2024-02-22T00:35:21.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b0a0a9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b040f7a10 0x7f9b04108270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:21.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b0a0a9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 0x7f9b04108760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b0a0a9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04108d10 con 0x7f9b040f8cb0 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b0a0a9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04108e50 con 0x7f9b040f7a10 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b02ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 0x7f9b04108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b02ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 0x7f9b04108760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51662/0 (socket says 172.21.15.49:51662) 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b02ffd700 1 -- 172.21.15.49:0/4162945171 learned_addr learned my addr 172.21.15.49:0/4162945171 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.123+0000 7f9b037fe700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b040f7a10 0x7f9b04108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b02ffd700 1 -- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b040f7a10 msgr2=0x7f9b04108270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b02ffd700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b040f7a10 0x7f9b04108270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b02ffd700 1 -- 172.21.15.49:0/4162945171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8005040 con 0x7f9b040f8cb0 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b02ffd700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 0x7f9b04108760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f9af8013560 tx=0x7f9af8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b00ff9700 1 -- 172.21.15.49:0/4162945171 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af8018070 con 0x7f9b040f8cb0 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b00ff9700 1 -- 172.21.15.49:0/4162945171 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9af8007e90 con 0x7f9b040f8cb0 2024-02-22T00:35:21.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b00ff9700 1 -- 172.21.15.49:0/4162945171 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9af801c380 con 0x7f9b040f8cb0 2024-02-22T00:35:21.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0410d890 con 0x7f9b040f8cb0 2024-02-22T00:35:21.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.124+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0410de50 con 0x7f9b040f8cb0 2024-02-22T00:35:21.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.126+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0405fb50 con 0x7f9b040f8cb0 2024-02-22T00:35:21.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.126+0000 7f9b00ff9700 1 -- 172.21.15.49:0/4162945171 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 25) v1 ==== 90687+0+0 (secure 0 0 0) 0x7f9af80123c0 con 0x7f9b040f8cb0 2024-02-22T00:35:21.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.126+0000 7f9b00ff9700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9aec06c6a0 0x7f9aec06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:21.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.126+0000 7f9b00ff9700 1 -- 172.21.15.49:0/4162945171 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f9af808c340 con 0x7f9b040f8cb0 2024-02-22T00:35:21.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.127+0000 7f9b037fe700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9aec06c6a0 0x7f9aec06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:21.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.127+0000 7f9b037fe700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9aec06c6a0 0x7f9aec06eb60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9b040f8b10 tx=0x7f9af400b040).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:21.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.131+0000 7f9b00ff9700 1 -- 172.21.15.49:0/4162945171 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f9af805a540 con 0x7f9b040f8cb0 2024-02-22T00:35:21.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:19.781416+0000 mgr.smithi161.sazlam (mgr.24369) 125 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 564 KiB/s wr, 175 op/s 2024-02-22T00:35:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:20.059973+0000 mon.smithi049 (mon.0) 726 : cluster [DBG] Standby manager daemon smithi049.rjblpr restarted 2024-02-22T00:35:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:20.060066+0000 mon.smithi049 (mon.0) 727 : cluster [DBG] Standby manager daemon smithi049.rjblpr started 2024-02-22T00:35:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:20.062823+0000 mon.smithi049 (mon.0) 728 : audit [DBG] from='mgr.? 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rjblpr/crt"}]: dispatch 2024-02-22T00:35:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:20.063753+0000 mon.smithi049 (mon.0) 729 : audit [DBG] from='mgr.? 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:35:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:20.065829+0000 mon.smithi049 (mon.0) 730 : audit [DBG] from='mgr.? 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rjblpr/key"}]: dispatch 2024-02-22T00:35:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:21 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:20.066870+0000 mon.smithi049 (mon.0) 731 : audit [DBG] from='mgr.? 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:35:21.314 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:19.781416+0000 mgr.smithi161.sazlam (mgr.24369) 125 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 16 KiB/s rd, 564 KiB/s wr, 175 op/s 2024-02-22T00:35:21.314 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:20.059973+0000 mon.smithi049 (mon.0) 726 : cluster [DBG] Standby manager daemon smithi049.rjblpr restarted 2024-02-22T00:35:21.315 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:20.060066+0000 mon.smithi049 (mon.0) 727 : cluster [DBG] Standby manager daemon smithi049.rjblpr started 2024-02-22T00:35:21.315 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:20.062823+0000 mon.smithi049 (mon.0) 728 : audit [DBG] from='mgr.? 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rjblpr/crt"}]: dispatch 2024-02-22T00:35:21.315 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:20.063753+0000 mon.smithi049 (mon.0) 729 : audit [DBG] from='mgr.? 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:35:21.315 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:20.065829+0000 mon.smithi049 (mon.0) 730 : audit [DBG] from='mgr.? 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi049.rjblpr/key"}]: dispatch 2024-02-22T00:35:21.315 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:21 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:20.066870+0000 mon.smithi049 (mon.0) 731 : audit [DBG] from='mgr.? 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:35:21.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.447+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 --> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b04102200 con 0x7f9aec06c6a0 2024-02-22T00:35:21.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.456+0000 7f9b00ff9700 1 -- 172.21.15.49:0/4162945171 <== mgr.24369 v2:172.21.15.161:6828/2756597363 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9b04102200 con 0x7f9aec06c6a0 2024-02-22T00:35:21.459 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:35:21.459 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (70s) 4s ago 9m 17.2M - 0.23.0 ba2b418f427c ec5dfa13626b 2024-02-22T00:35:21.459 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (9m) 4s ago 9m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:35:21.459 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (9m) 3s ago 9m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:35:21.459 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (37s) 4s ago 9m 44.8M - 8.3.5 dad864ee21e9 8d9bb59370a9 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (4m) 4s ago 4m 14.1M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (4m) 4s ago 4m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (4m) 3s ago 4m 14.1M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (4m) 3s ago 4m 125M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (10s) 4s ago 11m 71.0M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 running (2m) 3s ago 9m 500M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d128d026ba47 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (11m) 4s ago 11m 52.7M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (9m) 3s ago 9m 46.4M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (34s) 4s ago 9m 11.0M - 1.3.1 1dbe0e931976 648ac19e6ed3 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (32s) 3s ago 8m 11.8M - 1.3.1 1dbe0e931976 29d749a30965 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (8m) 4s ago 8m 220M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 4s ago 7m 233M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:35:21.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (7m) 4s ago 7m 193M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:35:21.461 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (7m) 3s ago 7m 258M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:35:21.461 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (6m) 3s ago 6m 226M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:35:21.461 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (6m) 3s ago 6m 219M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:35:21.461 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (18s) 3s ago 8m 46.1M - 2.33.4 514e6a882f6e d2c7ec3185ea 2024-02-22T00:35:21.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9aec06c6a0 msgr2=0x7f9aec06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9aec06c6a0 0x7f9aec06eb60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9b040f8b10 tx=0x7f9af400b040).stop 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 msgr2=0x7f9b04108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 0x7f9b04108760 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f9af8013560 tx=0x7f9af8009cb0).stop 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 shutdown_connections 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:6828/2756597363,v1:172.21.15.161:6829/2756597363] conn(0x7f9aec06c6a0 0x7f9aec06eb60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b040f7a10 0x7f9b04108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 --2- 172.21.15.49:0/4162945171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b040f8cb0 0x7f9b04108760 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 >> 172.21.15.49:0/4162945171 conn(0x7f9b040f3150 msgr2=0x7f9b040fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 shutdown_connections 2024-02-22T00:35:21.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.459+0000 7f9b0a0a9700 1 -- 172.21.15.49:0/4162945171 wait complete. 2024-02-22T00:35:21.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.564+0000 7f7260cd9700 1 -- 172.21.15.49:0/182284093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c0fa980 msgr2=0x7f725c0fcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.564+0000 7f7260cd9700 1 --2- 172.21.15.49:0/182284093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c0fa980 0x7f725c0fcd70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f724c0047f0 tx=0x7f724c009cb0).stop 2024-02-22T00:35:21.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.564+0000 7f7260cd9700 1 -- 172.21.15.49:0/182284093 shutdown_connections 2024-02-22T00:35:21.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.564+0000 7f7260cd9700 1 --2- 172.21.15.49:0/182284093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c0fa980 0x7f725c0fcd70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.564+0000 7f7260cd9700 1 --2- 172.21.15.49:0/182284093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f725c061770 0x7f725c0fa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.564+0000 7f7260cd9700 1 -- 172.21.15.49:0/182284093 >> 172.21.15.49:0/182284093 conn(0x7f725c0f1f10 msgr2=0x7f725c0f4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:21.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.564+0000 7f7260cd9700 1 -- 172.21.15.49:0/182284093 shutdown_connections 2024-02-22T00:35:21.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.564+0000 7f7260cd9700 1 -- 172.21.15.49:0/182284093 wait complete. 2024-02-22T00:35:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.565+0000 7f7260cd9700 1 Processor -- start 2024-02-22T00:35:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.565+0000 7f7260cd9700 1 -- start start 2024-02-22T00:35:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.565+0000 7f7260cd9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c061770 0x7f725c10a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.565+0000 7f7260cd9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f725c0fa980 0x7f725c10a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:21.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.565+0000 7f7260cd9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c10ad80 con 0x7f725c061770 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.565+0000 7f7260cd9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c10aec0 con 0x7f725c0fa980 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f725a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c061770 0x7f725c10a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f725a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c061770 0x7f725c10a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40404/0 (socket says 172.21.15.49:40404) 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f725a59c700 1 -- 172.21.15.49:0/2815530934 learned_addr learned my addr 172.21.15.49:0/2815530934 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f7259d9b700 1 --2- 172.21.15.49:0/2815530934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f725c0fa980 0x7f725c10a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f725a59c700 1 -- 172.21.15.49:0/2815530934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f725c0fa980 msgr2=0x7f725c10a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f725a59c700 1 --2- 172.21.15.49:0/2815530934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f725c0fa980 0x7f725c10a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f725a59c700 1 -- 172.21.15.49:0/2815530934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c005040 con 0x7f725c061770 2024-02-22T00:35:21.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f7259d9b700 1 --2- 172.21.15.49:0/2815530934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f725c0fa980 0x7f725c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:35:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f725a59c700 1 --2- 172.21.15.49:0/2815530934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c061770 0x7f725c10a2e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f725000e8c0 tx=0x7f725000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f724b7fe700 1 -- 172.21.15.49:0/2815530934 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7250007b40 con 0x7f725c061770 2024-02-22T00:35:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f724b7fe700 1 -- 172.21.15.49:0/2815530934 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f725000f040 con 0x7f725c061770 2024-02-22T00:35:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.566+0000 7f724b7fe700 1 -- 172.21.15.49:0/2815530934 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7250014880 con 0x7f725c061770 2024-02-22T00:35:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.567+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c10f960 con 0x7f725c061770 2024-02-22T00:35:21.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.567+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c10ff20 con 0x7f725c061770 2024-02-22T00:35:21.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.568+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c0fffe0 con 0x7f725c061770 2024-02-22T00:35:21.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.568+0000 7f724b7fe700 1 -- 172.21.15.49:0/2815530934 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 26) v1 ==== 45181+0+0 (secure 0 0 0) 0x7f7250007ca0 con 0x7f725c061770 2024-02-22T00:35:21.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.568+0000 7f724b7fe700 1 -- 172.21.15.49:0/2815530934 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f725004b060 con 0x7f725c061770 2024-02-22T00:35:21.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.575+0000 7f724b7fe700 1 -- 172.21.15.49:0/2815530934 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f72500090d0 con 0x7f725c061770 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.968+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f725c110710 con 0x7f725c061770 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.969+0000 7f724b7fe700 1 -- 172.21.15.49:0/2815530934 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+749 (secure 0 0 0) 0x7f72500133c0 con 0x7f725c061770 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:35:21.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 12, 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:35:21.973 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:35:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.972+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c061770 msgr2=0x7f725c10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.972+0000 7f7260cd9700 1 --2- 172.21.15.49:0/2815530934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c061770 0x7f725c10a2e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f725000e8c0 tx=0x7f725000b040).stop 2024-02-22T00:35:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.972+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 shutdown_connections 2024-02-22T00:35:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.972+0000 7f7260cd9700 1 --2- 172.21.15.49:0/2815530934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f725c0fa980 0x7f725c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.972+0000 7f7260cd9700 1 --2- 172.21.15.49:0/2815530934 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f725c061770 0x7f725c10a2e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.972+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 >> 172.21.15.49:0/2815530934 conn(0x7f725c0f1f10 msgr2=0x7f725c0fb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.972+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 shutdown_connections 2024-02-22T00:35:21.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:21.972+0000 7f7260cd9700 1 -- 172.21.15.49:0/2815530934 wait complete. 2024-02-22T00:35:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.083+0000 7f12bbfff700 1 -- 172.21.15.49:0/89421984 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b4013a70 con 0x7f12c40fa960 2024-02-22T00:35:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.084+0000 7f12cb2fe700 1 -- 172.21.15.49:0/89421984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40fa960 msgr2=0x7f12c40fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:22.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.084+0000 7f12cb2fe700 1 --2- 172.21.15.49:0/89421984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40fa960 0x7f12c40fcdb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f12b40047f0 tx=0x7f12b4009cb0).stop 2024-02-22T00:35:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.084+0000 7f12cb2fe700 1 -- 172.21.15.49:0/89421984 shutdown_connections 2024-02-22T00:35:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.084+0000 7f12cb2fe700 1 --2- 172.21.15.49:0/89421984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40fa960 0x7f12c40fcdb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.084+0000 7f12cb2fe700 1 --2- 172.21.15.49:0/89421984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c40611e0 0x7f12c40fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.084+0000 7f12cb2fe700 1 -- 172.21.15.49:0/89421984 >> 172.21.15.49:0/89421984 conn(0x7f12c40f1e50 msgr2=0x7f12c40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.084+0000 7f12cb2fe700 1 -- 172.21.15.49:0/89421984 shutdown_connections 2024-02-22T00:35:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.084+0000 7f12cb2fe700 1 -- 172.21.15.49:0/89421984 wait complete. 2024-02-22T00:35:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12cb2fe700 1 Processor -- start 2024-02-22T00:35:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12cb2fe700 1 -- start start 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12cb2fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40611e0 0x7f12c4107f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12cb2fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c40fa960 0x7f12c4108430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12cb2fe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41089e0 con 0x7f12c40611e0 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12cb2fe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4108b20 con 0x7f12c40fa960 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12c909a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40611e0 0x7f12c4107f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12c909a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40611e0 0x7f12c4107f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40502/0 (socket says 172.21.15.49:40502) 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12c909a700 1 -- 172.21.15.49:0/1117611617 learned_addr learned my addr 172.21.15.49:0/1117611617 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12c8899700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c40fa960 0x7f12c4108430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12c909a700 1 -- 172.21.15.49:0/1117611617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c40fa960 msgr2=0x7f12c4108430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.085+0000 7f12c909a700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c40fa960 0x7f12c4108430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.086+0000 7f12c909a700 1 -- 172.21.15.49:0/1117611617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b4005040 con 0x7f12c40611e0 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.086+0000 7f12c909a700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40611e0 0x7f12c4107f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f12c00041d0 tx=0x7f12c0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:22.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.086+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12c0007b40 con 0x7f12c40611e0 2024-02-22T00:35:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.086+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c410d5c0 con 0x7f12c40611e0 2024-02-22T00:35:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.086+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f12c000f040 con 0x7f12c40611e0 2024-02-22T00:35:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.086+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12c00147b0 con 0x7f12c40611e0 2024-02-22T00:35:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.086+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c410db80 con 0x7f12c40611e0 2024-02-22T00:35:22.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.087+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 26) v1 ==== 45181+0+0 (secure 0 0 0) 0x7f12c0014a50 con 0x7f12c40611e0 2024-02-22T00:35:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.087+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f12c004b600 con 0x7f12c40611e0 2024-02-22T00:35:22.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.088+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c40fffc0 con 0x7f12c40611e0 2024-02-22T00:35:22.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.093+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f12c001e440 con 0x7f12c40611e0 2024-02-22T00:35:22.253 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:20.674544+0000 mgr.smithi161.sazlam (mgr.24369) 126 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:21.011004+0000 mon.smithi049 (mon.0) 732 : cluster [DBG] mgrmap e25: smithi161.sazlam(active, since 2m), standbys: smithi049.rjblpr 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.018753+0000 mgr.smithi161.sazlam (mgr.24369) 127 : audit [DBG] from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.372260+0000 mon.smithi049 (mon.0) 733 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.389867+0000 mon.smithi049 (mon.0) 734 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.393214+0000 mon.smithi161 (mon.1) 81 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.394011+0000 mon.smithi161 (mon.1) 82 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.399108+0000 mon.smithi049 (mon.0) 735 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.537230+0000 mon.smithi161 (mon.1) 83 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.542259+0000 mon.smithi161 (mon.1) 84 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr fail", "who": "smithi161.sazlam"}]: dispatch 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.542676+0000 mon.smithi049 (mon.0) 736 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr fail", "who": "smithi161.sazlam"}]: dispatch 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:21.548648+0000 mon.smithi049 (mon.0) 737 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-02-22T00:35:22.254 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.548913+0000 mon.smithi049 (mon.0) 738 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd='[{"prefix": "mgr fail", "who": "smithi161.sazlam"}]': finished 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:21.548988+0000 mon.smithi049 (mon.0) 739 : cluster [DBG] mgrmap e26: smithi049.rjblpr(active, starting, since 0.00591869s) 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.550902+0000 mon.smithi049 (mon.0) 740 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.551042+0000 mon.smithi049 (mon.0) 741 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.552865+0000 mon.smithi049 (mon.0) 742 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.553118+0000 mon.smithi049 (mon.0) 743 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.553329+0000 mon.smithi049 (mon.0) 744 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.553561+0000 mon.smithi049 (mon.0) 745 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.553848+0000 mon.smithi049 (mon.0) 746 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.554046+0000 mon.smithi049 (mon.0) 747 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.554275+0000 mon.smithi049 (mon.0) 748 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.554539+0000 mon.smithi049 (mon.0) 749 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.554771+0000 mon.smithi049 (mon.0) 750 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.555028+0000 mon.smithi049 (mon.0) 751 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.555313+0000 mon.smithi049 (mon.0) 752 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:35:22.255 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.555516+0000 mon.smithi049 (mon.0) 753 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.555808+0000 mon.smithi049 (mon.0) 754 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.556160+0000 mon.smithi049 (mon.0) 755 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:21.592879+0000 mon.smithi049 (mon.0) 756 : cluster [INF] Manager daemon smithi049.rjblpr is now available 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.626060+0000 mon.smithi049 (mon.0) 757 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.628496+0000 mon.smithi049 (mon.0) 758 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.650351+0000 mon.smithi049 (mon.0) 759 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.659583+0000 mon.smithi049 (mon.0) 760 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.673809+0000 mon.smithi049 (mon.0) 761 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:35:22.256 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:21.970252+0000 mon.smithi049 (mon.0) 762 : audit [DBG] from='client.? 172.21.15.49:0/2815530934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:35:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:20.674544+0000 mgr.smithi161.sazlam (mgr.24369) 126 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:21.011004+0000 mon.smithi049 (mon.0) 732 : cluster [DBG] mgrmap e25: smithi161.sazlam(active, since 2m), standbys: smithi049.rjblpr 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.018753+0000 mgr.smithi161.sazlam (mgr.24369) 127 : audit [DBG] from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.372260+0000 mon.smithi049 (mon.0) 733 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.389867+0000 mon.smithi049 (mon.0) 734 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.393214+0000 mon.smithi161 (mon.1) 81 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.394011+0000 mon.smithi161 (mon.1) 82 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.399108+0000 mon.smithi049 (mon.0) 735 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.537230+0000 mon.smithi161 (mon.1) 83 : audit [DBG] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.542259+0000 mon.smithi161 (mon.1) 84 : audit [INF] from='mgr.24369 172.21.15.161:0/1635783625' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr fail", "who": "smithi161.sazlam"}]: dispatch 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.542676+0000 mon.smithi049 (mon.0) 736 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "mgr fail", "who": "smithi161.sazlam"}]: dispatch 2024-02-22T00:35:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:21.548648+0000 mon.smithi049 (mon.0) 737 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.548913+0000 mon.smithi049 (mon.0) 738 : audit [INF] from='mgr.24369 ' entity='mgr.smithi161.sazlam' cmd='[{"prefix": "mgr fail", "who": "smithi161.sazlam"}]': finished 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:21.548988+0000 mon.smithi049 (mon.0) 739 : cluster [DBG] mgrmap e26: smithi049.rjblpr(active, starting, since 0.00591869s) 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.550902+0000 mon.smithi049 (mon.0) 740 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.551042+0000 mon.smithi049 (mon.0) 741 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.552865+0000 mon.smithi049 (mon.0) 742 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.553118+0000 mon.smithi049 (mon.0) 743 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.553329+0000 mon.smithi049 (mon.0) 744 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.553561+0000 mon.smithi049 (mon.0) 745 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.553848+0000 mon.smithi049 (mon.0) 746 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.554046+0000 mon.smithi049 (mon.0) 747 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.554275+0000 mon.smithi049 (mon.0) 748 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.554539+0000 mon.smithi049 (mon.0) 749 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.554771+0000 mon.smithi049 (mon.0) 750 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:35:22.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.555028+0000 mon.smithi049 (mon.0) 751 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.555313+0000 mon.smithi049 (mon.0) 752 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.555516+0000 mon.smithi049 (mon.0) 753 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.555808+0000 mon.smithi049 (mon.0) 754 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.556160+0000 mon.smithi049 (mon.0) 755 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:21.592879+0000 mon.smithi049 (mon.0) 756 : cluster [INF] Manager daemon smithi049.rjblpr is now available 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.626060+0000 mon.smithi049 (mon.0) 757 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.628496+0000 mon.smithi049 (mon.0) 758 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.650351+0000 mon.smithi049 (mon.0) 759 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.659583+0000 mon.smithi049 (mon.0) 760 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.673809+0000 mon.smithi049 (mon.0) 761 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:35:22.431 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:21.970252+0000 mon.smithi049 (mon.0) 762 : audit [DBG] from='client.? 172.21.15.49:0/2815530934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:35:22.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.548+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 27) v1 ==== 45602+0+0 (secure 0 0 0) 0x7f12c0009110 con 0x7f12c40611e0 2024-02-22T00:35:22.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.548+0000 7f12ba7fc700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12b003d380 0x7f12b003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:22.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.548+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12b003fc60 con 0x7f12b003d380 2024-02-22T00:35:22.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.562+0000 7f12c8899700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12b003d380 0x7f12b003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:22.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.563+0000 7f12c8899700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12b003d380 0x7f12b003f770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f12b4004f10 tx=0x7f12b400b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.565+0000 7f12ba7fc700 1 -- 172.21.15.49:0/1117611617 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f12b003fc60 con 0x7f12b003d380 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:35:22.568 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/2 daemons upgraded", 2024-02-22T00:35:22.569 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-02-22T00:35:22.569 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:35:22.569 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:35:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12b003d380 msgr2=0x7f12b003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12b003d380 0x7f12b003f770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f12b4004f10 tx=0x7f12b400b040).stop 2024-02-22T00:35:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40611e0 msgr2=0x7f12c4107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40611e0 0x7f12c4107f40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f12c00041d0 tx=0x7f12c0009f60).stop 2024-02-22T00:35:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 shutdown_connections 2024-02-22T00:35:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12b003d380 0x7f12b003f770 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:22.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12c40611e0 0x7f12c4107f40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:22.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 --2- 172.21.15.49:0/1117611617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12c40fa960 0x7f12c4108430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:22.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 >> 172.21.15.49:0/1117611617 conn(0x7f12c40f1e50 msgr2=0x7f12c40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:22.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 shutdown_connections 2024-02-22T00:35:22.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:22.568+0000 7f12cb2fe700 1 -- 172.21.15.49:0/1117611617 wait complete. 2024-02-22T00:35:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:22.551183+0000 mon.smithi049 (mon.0) 763 : cluster [DBG] mgrmap e27: smithi049.rjblpr(active, since 1.00811s) 2024-02-22T00:35:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:22.566443+0000 mgr.smithi049.rjblpr (mgr.14674) 1 : audit [DBG] from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:22.567805+0000 mgr.smithi049.rjblpr (mgr.14674) 2 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:23.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:22.551183+0000 mon.smithi049 (mon.0) 763 : cluster [DBG] mgrmap e27: smithi049.rjblpr(active, since 1.00811s) 2024-02-22T00:35:23.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:22.566443+0000 mgr.smithi049.rjblpr (mgr.14674) 1 : audit [DBG] from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:23.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:22.567805+0000 mgr.smithi049.rjblpr (mgr.14674) 2 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:24.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:22.729349+0000 mgr.smithi049.rjblpr (mgr.14674) 3 : cephadm [INF] [22/Feb/2024:00:35:22] ENGINE Bus STARTING 2024-02-22T00:35:24.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:22.846556+0000 mgr.smithi049.rjblpr (mgr.14674) 4 : cephadm [INF] [22/Feb/2024:00:35:22] ENGINE Serving on https://172.21.15.49:7150 2024-02-22T00:35:24.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:22.947652+0000 mgr.smithi049.rjblpr (mgr.14674) 5 : cephadm [INF] [22/Feb/2024:00:35:22] ENGINE Serving on http://172.21.15.49:8765 2024-02-22T00:35:24.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:22.947746+0000 mgr.smithi049.rjblpr (mgr.14674) 6 : cephadm [INF] [22/Feb/2024:00:35:22] ENGINE Bus STARTED 2024-02-22T00:35:24.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:23.554955+0000 mgr.smithi049.rjblpr (mgr.14674) 7 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:24.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:22.729349+0000 mgr.smithi049.rjblpr (mgr.14674) 3 : cephadm [INF] [22/Feb/2024:00:35:22] ENGINE Bus STARTING 2024-02-22T00:35:24.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:22.846556+0000 mgr.smithi049.rjblpr (mgr.14674) 4 : cephadm [INF] [22/Feb/2024:00:35:22] ENGINE Serving on https://172.21.15.49:7150 2024-02-22T00:35:24.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:22.947652+0000 mgr.smithi049.rjblpr (mgr.14674) 5 : cephadm [INF] [22/Feb/2024:00:35:22] ENGINE Serving on http://172.21.15.49:8765 2024-02-22T00:35:24.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:22.947746+0000 mgr.smithi049.rjblpr (mgr.14674) 6 : cephadm [INF] [22/Feb/2024:00:35:22] ENGINE Bus STARTED 2024-02-22T00:35:24.950 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:23.554955+0000 mgr.smithi049.rjblpr (mgr.14674) 7 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:25.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:24.560777+0000 mon.smithi049 (mon.0) 764 : cluster [DBG] mgrmap e28: smithi049.rjblpr(active, since 3s) 2024-02-22T00:35:25.842 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:24.560777+0000 mon.smithi049 (mon.0) 764 : cluster [DBG] mgrmap e28: smithi049.rjblpr(active, since 3s) 2024-02-22T00:35:26.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:25.555292+0000 mgr.smithi049.rjblpr (mgr.14674) 8 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:26.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:25.685718+0000 mon.smithi049 (mon.0) 765 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:26.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:25.689624+0000 mon.smithi049 (mon.0) 766 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:26.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:26.378010+0000 mon.smithi049 (mon.0) 767 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:26.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:26.381438+0000 mon.smithi049 (mon.0) 768 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:27.020 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:25.555292+0000 mgr.smithi049.rjblpr (mgr.14674) 8 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:27.020 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:25.685718+0000 mon.smithi049 (mon.0) 765 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:27.020 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:25.689624+0000 mon.smithi049 (mon.0) 766 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:27.020 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:26.378010+0000 mon.smithi049 (mon.0) 767 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:27.020 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:26.381438+0000 mon.smithi049 (mon.0) 768 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.020 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:26.751521+0000 mon.smithi049 (mon.0) 769 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.020 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:26.756383+0000 mon.smithi049 (mon.0) 770 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.020 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:27.440485+0000 mon.smithi049 (mon.0) 771 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.021 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:27.444224+0000 mon.smithi049 (mon.0) 772 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.021 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:27.555561+0000 mgr.smithi049.rjblpr (mgr.14674) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:28.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:26.751521+0000 mon.smithi049 (mon.0) 769 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:26.756383+0000 mon.smithi049 (mon.0) 770 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:27.440485+0000 mon.smithi049 (mon.0) 771 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:27.444224+0000 mon.smithi049 (mon.0) 772 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:28.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:27.555561+0000 mgr.smithi049.rjblpr (mgr.14674) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:29.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:28.629767+0000 mon.smithi049 (mon.0) 773 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:35:29.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:28.630916+0000 mon.smithi161 (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.161:0/811961722' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:35:29.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:28.631408+0000 mon.smithi161 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.161:0/811961722' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:35:29.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:28.633298+0000 mon.smithi161 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.161:0/811961722' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:35:29.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:28.634157+0000 mon.smithi161 (mon.1) 88 : audit [DBG] from='mgr.? 172.21.15.161:0/811961722' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:35:29.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:28.629767+0000 mon.smithi049 (mon.0) 773 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:35:29.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:28.630916+0000 mon.smithi161 (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.161:0/811961722' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:35:29.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:28.631408+0000 mon.smithi161 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.161:0/811961722' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:35:29.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:28.633298+0000 mon.smithi161 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.161:0/811961722' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:35:29.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:28.634157+0000 mon.smithi161 (mon.1) 88 : audit [DBG] from='mgr.? 172.21.15.161:0/811961722' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:35:30.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:29.456912+0000 mon.smithi049 (mon.0) 774 : cluster [DBG] mgrmap e29: smithi049.rjblpr(active, since 7s), standbys: smithi161.sazlam 2024-02-22T00:35:30.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:29.457079+0000 mon.smithi049 (mon.0) 775 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:35:30.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:29.556069+0000 mgr.smithi049.rjblpr (mgr.14674) 10 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 KiB/s wr, 18 op/s 2024-02-22T00:35:30.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:29.456912+0000 mon.smithi049 (mon.0) 774 : cluster [DBG] mgrmap e29: smithi049.rjblpr(active, since 7s), standbys: smithi161.sazlam 2024-02-22T00:35:30.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:29.457079+0000 mon.smithi049 (mon.0) 775 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:35:30.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:29.556069+0000 mgr.smithi049.rjblpr (mgr.14674) 10 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 KiB/s wr, 18 op/s 2024-02-22T00:35:32.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:31.556565+0000 mgr.smithi049.rjblpr (mgr.14674) 11 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 911 B/s wr, 14 op/s 2024-02-22T00:35:33.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:31.556565+0000 mgr.smithi049.rjblpr (mgr.14674) 11 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 911 B/s wr, 14 op/s 2024-02-22T00:35:34.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:33.557058+0000 mgr.smithi049.rjblpr (mgr.14674) 12 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 931 B/s wr, 11 op/s 2024-02-22T00:35:35.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:33.557058+0000 mgr.smithi049.rjblpr (mgr.14674) 12 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 931 B/s wr, 11 op/s 2024-02-22T00:35:36.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:35.557464+0000 mgr.smithi049.rjblpr (mgr.14674) 13 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 853 B/s wr, 10 op/s 2024-02-22T00:35:37.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:35.557464+0000 mgr.smithi049.rjblpr (mgr.14674) 13 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 853 B/s wr, 10 op/s 2024-02-22T00:35:37.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:36.650692+0000 mon.smithi049 (mon.0) 776 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:38.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:36.650692+0000 mon.smithi049 (mon.0) 776 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:38.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:37.557824+0000 mgr.smithi049.rjblpr (mgr.14674) 14 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 853 B/s wr, 10 op/s 2024-02-22T00:35:39.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:37.557824+0000 mgr.smithi049.rjblpr (mgr.14674) 14 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 853 B/s wr, 10 op/s 2024-02-22T00:35:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:39.139916+0000 mon.smithi049 (mon.0) 777 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:39.143863+0000 mon.smithi049 (mon.0) 778 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:39.145108+0000 mon.smithi049 (mon.0) 779 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:35:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:39.145787+0000 mon.smithi049 (mon.0) 780 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:35:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:39.146697+0000 mgr.smithi049.rjblpr (mgr.14674) 15 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:35:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:39.146864+0000 mgr.smithi049.rjblpr (mgr.14674) 16 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:35:40.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:39.411185+0000 mgr.smithi049.rjblpr (mgr.14674) 17 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:35:40.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:39.411357+0000 mgr.smithi049.rjblpr (mgr.14674) 18 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:35:40.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:39.558236+0000 mgr.smithi049.rjblpr (mgr.14674) 19 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 853 B/s wr, 10 op/s 2024-02-22T00:35:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:39.139916+0000 mon.smithi049 (mon.0) 777 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:39.143863+0000 mon.smithi049 (mon.0) 778 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:39.145108+0000 mon.smithi049 (mon.0) 779 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:35:40.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:39.145787+0000 mon.smithi049 (mon.0) 780 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:35:40.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:39.146697+0000 mgr.smithi049.rjblpr (mgr.14674) 15 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:35:40.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:39.146864+0000 mgr.smithi049.rjblpr (mgr.14674) 16 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:35:40.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:39.411185+0000 mgr.smithi049.rjblpr (mgr.14674) 17 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:35:40.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:39.411357+0000 mgr.smithi049.rjblpr (mgr.14674) 18 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:35:40.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:39.558236+0000 mgr.smithi049.rjblpr (mgr.14674) 19 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 853 B/s wr, 10 op/s 2024-02-22T00:35:41.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:39.675384+0000 mgr.smithi049.rjblpr (mgr.14674) 20 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:39.675556+0000 mgr.smithi049.rjblpr (mgr.14674) 21 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:39.939762+0000 mgr.smithi049.rjblpr (mgr.14674) 22 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:39.939939+0000 mgr.smithi049.rjblpr (mgr.14674) 23 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:40.208344+0000 mon.smithi049 (mon.0) 781 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:40.210448+0000 mon.smithi049 (mon.0) 782 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:40.213502+0000 mon.smithi049 (mon.0) 783 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:40.216095+0000 mon.smithi049 (mon.0) 784 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:40.219217+0000 mon.smithi049 (mon.0) 785 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:40.351157+0000 mgr.smithi049.rjblpr (mgr.14674) 24 : cephadm [INF] Reconfiguring prometheus.smithi161 (dependencies changed)... 2024-02-22T00:35:41.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:41 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:40.601354+0000 mgr.smithi049.rjblpr (mgr.14674) 25 : cephadm [INF] Reconfiguring daemon prometheus.smithi161 on smithi161 2024-02-22T00:35:41.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:39.675384+0000 mgr.smithi049.rjblpr (mgr.14674) 20 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:35:41.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:39.675556+0000 mgr.smithi049.rjblpr (mgr.14674) 21 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:35:41.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:39.939762+0000 mgr.smithi049.rjblpr (mgr.14674) 22 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:35:41.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:39.939939+0000 mgr.smithi049.rjblpr (mgr.14674) 23 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:35:41.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:40.208344+0000 mon.smithi049 (mon.0) 781 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:40.210448+0000 mon.smithi049 (mon.0) 782 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:40.213502+0000 mon.smithi049 (mon.0) 783 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:40.216095+0000 mon.smithi049 (mon.0) 784 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:40.219217+0000 mon.smithi049 (mon.0) 785 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:40.351157+0000 mgr.smithi049.rjblpr (mgr.14674) 24 : cephadm [INF] Reconfiguring prometheus.smithi161 (dependencies changed)... 2024-02-22T00:35:41.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:41 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:40.601354+0000 mgr.smithi049.rjblpr (mgr.14674) 25 : cephadm [INF] Reconfiguring daemon prometheus.smithi161 on smithi161 2024-02-22T00:35:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:41.558708+0000 mgr.smithi049.rjblpr (mgr.14674) 26 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-22T00:35:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:41.558708+0000 mgr.smithi049.rjblpr (mgr.14674) 26 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-22T00:35:44.919 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:43.559477+0000 mgr.smithi049.rjblpr (mgr.14674) 27 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-22T00:35:44.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:43.559477+0000 mgr.smithi049.rjblpr (mgr.14674) 27 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-22T00:35:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:45.559872+0000 mgr.smithi049.rjblpr (mgr.14674) 28 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:46.015823+0000 mon.smithi049 (mon.0) 786 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:46.020338+0000 mon.smithi049 (mon.0) 787 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:46.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:46.036710+0000 mon.smithi049 (mon.0) 788 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:35:46.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:46.043473+0000 mon.smithi049 (mon.0) 789 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:45.559872+0000 mgr.smithi049.rjblpr (mgr.14674) 28 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:46.015823+0000 mon.smithi049 (mon.0) 786 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:46.020338+0000 mon.smithi049 (mon.0) 787 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:46.036710+0000 mon.smithi049 (mon.0) 788 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:35:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:46.043473+0000 mon.smithi049 (mon.0) 789 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:47.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:47 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:46.037246+0000 mgr.smithi049.rjblpr (mgr.14674) 29 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:35:48.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:47 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:46.037246+0000 mgr.smithi049.rjblpr (mgr.14674) 29 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:35:48.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:47.560289+0000 mgr.smithi049.rjblpr (mgr.14674) 30 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:49.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:47.560289+0000 mgr.smithi049.rjblpr (mgr.14674) 30 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:48.767605+0000 mon.smithi049 (mon.0) 790 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:35:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:48.768633+0000 mon.smithi049 (mon.0) 791 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:35:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:49 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:48.769601+0000 mon.smithi049 (mon.0) 792 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:35:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:48.767605+0000 mon.smithi049 (mon.0) 790 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:35:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:48.768633+0000 mon.smithi049 (mon.0) 791 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:35:50.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:48.769601+0000 mon.smithi049 (mon.0) 792 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:35:50.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:48.767180+0000 mgr.smithi049.rjblpr (mgr.14674) 31 : cephadm [INF] Upgrade: Updating mgr.smithi161.sazlam 2024-02-22T00:35:50.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:35:48.770561+0000 mgr.smithi049.rjblpr (mgr.14674) 32 : cephadm [INF] Deploying daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:35:50.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:49.560798+0000 mgr.smithi049.rjblpr (mgr.14674) 33 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:51.030 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:48.767180+0000 mgr.smithi049.rjblpr (mgr.14674) 31 : cephadm [INF] Upgrade: Updating mgr.smithi161.sazlam 2024-02-22T00:35:51.031 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:35:48.770561+0000 mgr.smithi049.rjblpr (mgr.14674) 32 : cephadm [INF] Deploying daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:35:51.031 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:49.560798+0000 mgr.smithi049.rjblpr (mgr.14674) 33 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 -- 172.21.15.49:0/2228013040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f66f0 msgr2=0x7f36fc0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 --2- 172.21.15.49:0/2228013040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f66f0 0x7f36fc0f6b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f36f00047f0 tx=0x7f36f0009cb0).stop 2024-02-22T00:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 -- 172.21.15.49:0/2228013040 shutdown_connections 2024-02-22T00:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 --2- 172.21.15.49:0/2228013040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0f7990 0x7f36fc0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 --2- 172.21.15.49:0/2228013040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f66f0 0x7f36fc0f6b10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 -- 172.21.15.49:0/2228013040 >> 172.21.15.49:0/2228013040 conn(0x7f36fc0f1e50 msgr2=0x7f36fc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 -- 172.21.15.49:0/2228013040 shutdown_connections 2024-02-22T00:35:52.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 -- 172.21.15.49:0/2228013040 wait complete. 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.687+0000 7f3703114700 1 Processor -- start 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f3703114700 1 -- start start 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f3703114700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0f66f0 0x7f36fc0fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f3703114700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f7990 0x7f36fc0f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f3703114700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0fac20 con 0x7f36fc0f7990 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f3703114700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0f91c0 con 0x7f36fc0f66f0 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f36fbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f7990 0x7f36fc0f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f3700eb0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0f66f0 0x7f36fc0fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f3700eb0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0f66f0 0x7f36fc0fa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.49:42916/0 (socket says 172.21.15.49:42916) 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f3700eb0700 1 -- 172.21.15.49:0/1464586615 learned_addr learned my addr 172.21.15.49:0/1464586615 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f36fbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f7990 0x7f36fc0f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34928/0 (socket says 172.21.15.49:34928) 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f36fbfff700 1 -- 172.21.15.49:0/1464586615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0f66f0 msgr2=0x7f36fc0fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f36fbfff700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0f66f0 0x7f36fc0fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:52.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f36fbfff700 1 -- 172.21.15.49:0/1464586615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f0005040 con 0x7f36fc0f7990 2024-02-22T00:35:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.688+0000 7f36fbfff700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f7990 0x7f36fc0f8cd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f36e8002700 tx=0x7f36e8009e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.689+0000 7f36f9ffb700 1 -- 172.21.15.49:0/1464586615 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36e8007b40 con 0x7f36fc0f7990 2024-02-22T00:35:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.689+0000 7f36f9ffb700 1 -- 172.21.15.49:0/1464586615 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f36e800f040 con 0x7f36fc0f7990 2024-02-22T00:35:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.689+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc0f9440 con 0x7f36fc0f7990 2024-02-22T00:35:52.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.689+0000 7f36f9ffb700 1 -- 172.21.15.49:0/1464586615 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36e8014780 con 0x7f36fc0f7990 2024-02-22T00:35:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.689+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc0f9a00 con 0x7f36fc0f7990 2024-02-22T00:35:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.690+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc0feeb0 con 0x7f36fc0f7990 2024-02-22T00:35:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.690+0000 7f36f9ffb700 1 -- 172.21.15.49:0/1464586615 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 90787+0+0 (secure 0 0 0) 0x7f36e8007ca0 con 0x7f36fc0f7990 2024-02-22T00:35:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.691+0000 7f36f9ffb700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f36ec06c7c0 0x7f36ec06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.691+0000 7f36f9ffb700 1 -- 172.21.15.49:0/1464586615 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f36e808b830 con 0x7f36fc0f7990 2024-02-22T00:35:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.691+0000 7f3700eb0700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f36ec06c7c0 0x7f36ec06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:52.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.691+0000 7f3700eb0700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f36ec06c7c0 0x7f36ec06ec80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f36f0004f10 tx=0x7f36f000b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:52.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.696+0000 7f36f9ffb700 1 -- 172.21.15.49:0/1464586615 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f36e8059710 con 0x7f36fc0f7990 2024-02-22T00:35:52.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.913+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36fc0ff070 con 0x7f36ec06c7c0 2024-02-22T00:35:52.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.915+0000 7f36f9ffb700 1 -- 172.21.15.49:0/1464586615 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f36fc0ff070 con 0x7f36ec06c7c0 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f36ec06c7c0 msgr2=0x7f36ec06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f36ec06c7c0 0x7f36ec06ec80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f36f0004f10 tx=0x7f36f000b040).stop 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f7990 msgr2=0x7f36fc0f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f7990 0x7f36fc0f8cd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f36e8002700 tx=0x7f36e8009e40).stop 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 shutdown_connections 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f36ec06c7c0 0x7f36ec06ec80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0f66f0 0x7f36fc0fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 --2- 172.21.15.49:0/1464586615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f36fc0f7990 0x7f36fc0f8cd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 >> 172.21.15.49:0/1464586615 conn(0x7f36fc0f1e50 msgr2=0x7f36fc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 shutdown_connections 2024-02-22T00:35:52.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:52.917+0000 7f3703114700 1 -- 172.21.15.49:0/1464586615 wait complete. 2024-02-22T00:35:52.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:51.561215+0000 mgr.smithi049.rjblpr (mgr.14674) 34 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:52.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:51.650880+0000 mon.smithi049 (mon.0) 793 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:52.930 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:35:53.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.020+0000 7f35d05bf700 1 -- 172.21.15.49:0/3167967195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f8aa0 msgr2=0x7f35c80f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.020+0000 7f35d05bf700 1 --2- 172.21.15.49:0/3167967195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f8aa0 0x7f35c80f8f00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f35bc0047f0 tx=0x7f35bc009cb0).stop 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.020+0000 7f35d05bf700 1 -- 172.21.15.49:0/3167967195 shutdown_connections 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.020+0000 7f35d05bf700 1 --2- 172.21.15.49:0/3167967195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f8aa0 0x7f35c80f8f00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.020+0000 7f35d05bf700 1 --2- 172.21.15.49:0/3167967195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c80f7800 0x7f35c80f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.020+0000 7f35d05bf700 1 -- 172.21.15.49:0/3167967195 >> 172.21.15.49:0/3167967195 conn(0x7f35c80f2f80 msgr2=0x7f35c80f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.020+0000 7f35d05bf700 1 -- 172.21.15.49:0/3167967195 shutdown_connections 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.020+0000 7f35d05bf700 1 -- 172.21.15.49:0/3167967195 wait complete. 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35d05bf700 1 Processor -- start 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35d05bf700 1 -- start start 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35d05bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f7800 0x7f35c8107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35d05bf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c80f8aa0 0x7f35c8108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35d05bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8108a00 con 0x7f35c80f7800 2024-02-22T00:35:53.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35d05bf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c8108b40 con 0x7f35c80f8aa0 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35ce35b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f7800 0x7f35c8107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35ce35b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f7800 0x7f35c8107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34940/0 (socket says 172.21.15.49:34940) 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35ce35b700 1 -- 172.21.15.49:0/1604580075 learned_addr learned my addr 172.21.15.49:0/1604580075 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.021+0000 7f35cdb5a700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c80f8aa0 0x7f35c8108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35ce35b700 1 -- 172.21.15.49:0/1604580075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c80f8aa0 msgr2=0x7f35c8108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35ce35b700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c80f8aa0 0x7f35c8108450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35ce35b700 1 -- 172.21.15.49:0/1604580075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc005040 con 0x7f35c80f7800 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35ce35b700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f7800 0x7f35c8107f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f35c400c790 tx=0x7f35c4007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35bb7fe700 1 -- 172.21.15.49:0/1604580075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c400e680 con 0x7f35c80f7800 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c810d5e0 con 0x7f35c80f7800 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35bb7fe700 1 -- 172.21.15.49:0/1604580075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f35c400ec90 con 0x7f35c80f7800 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35bb7fe700 1 -- 172.21.15.49:0/1604580075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c4013e20 con 0x7f35c80f7800 2024-02-22T00:35:53.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.022+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c810dba0 con 0x7f35c80f7800 2024-02-22T00:35:53.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.023+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c80fffc0 con 0x7f35c80f7800 2024-02-22T00:35:53.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.023+0000 7f35bb7fe700 1 -- 172.21.15.49:0/1604580075 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 90787+0+0 (secure 0 0 0) 0x7f35c400e7e0 con 0x7f35c80f7800 2024-02-22T00:35:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.024+0000 7f35bb7fe700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f35b406c760 0x7f35b406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.024+0000 7f35bb7fe700 1 -- 172.21.15.49:0/1604580075 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f35c408bb80 con 0x7f35c80f7800 2024-02-22T00:35:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.024+0000 7f35cdb5a700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f35b406c760 0x7f35b406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:53.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.024+0000 7f35cdb5a700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f35b406c760 0x7f35b406ec20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f35bc004f10 tx=0x7f35bc00b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:53.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.028+0000 7f35bb7fe700 1 -- 172.21.15.49:0/1604580075 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f35c4059b70 con 0x7f35c80f7800 2024-02-22T00:35:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:51.561215+0000 mgr.smithi049.rjblpr (mgr.14674) 34 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:51.650880+0000 mon.smithi049 (mon.0) 793 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:35:53.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.250+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35c8059120 con 0x7f35b406c760 2024-02-22T00:35:53.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.251+0000 7f35bb7fe700 1 -- 172.21.15.49:0/1604580075 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f35c8059120 con 0x7f35b406c760 2024-02-22T00:35:53.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f35b406c760 msgr2=0x7f35b406ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f35b406c760 0x7f35b406ec20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f35bc004f10 tx=0x7f35bc00b040).stop 2024-02-22T00:35:53.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f7800 msgr2=0x7f35c8107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f7800 0x7f35c8107f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f35c400c790 tx=0x7f35c4007f10).stop 2024-02-22T00:35:53.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 shutdown_connections 2024-02-22T00:35:53.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f35b406c760 0x7f35b406ec20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35c80f7800 0x7f35c8107f60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 --2- 172.21.15.49:0/1604580075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35c80f8aa0 0x7f35c8108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 >> 172.21.15.49:0/1604580075 conn(0x7f35c80f2f80 msgr2=0x7f35c80fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 shutdown_connections 2024-02-22T00:35:53.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.254+0000 7f35d05bf700 1 -- 172.21.15.49:0/1604580075 wait complete. 2024-02-22T00:35:53.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.356+0000 7f4071721700 1 -- 172.21.15.49:0/1240109735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f5af0 msgr2=0x7f406c0f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.356+0000 7f4071721700 1 --2- 172.21.15.49:0/1240109735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f5af0 0x7f406c0f5f10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f40540047f0 tx=0x7f4054009cb0).stop 2024-02-22T00:35:53.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.356+0000 7f4071721700 1 -- 172.21.15.49:0/1240109735 shutdown_connections 2024-02-22T00:35:53.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.356+0000 7f4071721700 1 --2- 172.21.15.49:0/1240109735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f406c0f6490 0x7f406c0f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.356+0000 7f4071721700 1 --2- 172.21.15.49:0/1240109735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f5af0 0x7f406c0f5f10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.356+0000 7f4071721700 1 -- 172.21.15.49:0/1240109735 >> 172.21.15.49:0/1240109735 conn(0x7f406c0f1610 msgr2=0x7f406c0f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:53.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.356+0000 7f4071721700 1 -- 172.21.15.49:0/1240109735 shutdown_connections 2024-02-22T00:35:53.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.356+0000 7f4071721700 1 -- 172.21.15.49:0/1240109735 wait complete. 2024-02-22T00:35:53.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f4071721700 1 Processor -- start 2024-02-22T00:35:53.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f4071721700 1 -- start start 2024-02-22T00:35:53.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f4071721700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f406c0f5af0 0x7f406c108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f4071721700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f6490 0x7f406c108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f4071721700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c108b20 con 0x7f406c0f6490 2024-02-22T00:35:53.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f4071721700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c108c60 con 0x7f406c0f5af0 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f406a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f6490 0x7f406c108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f406affd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f406c0f5af0 0x7f406c108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f406a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f6490 0x7f406c108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34966/0 (socket says 172.21.15.49:34966) 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.357+0000 7f406a7fc700 1 -- 172.21.15.49:0/1251199189 learned_addr learned my addr 172.21.15.49:0/1251199189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f406a7fc700 1 -- 172.21.15.49:0/1251199189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f406c0f5af0 msgr2=0x7f406c108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f406a7fc700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f406c0f5af0 0x7f406c108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f406a7fc700 1 -- 172.21.15.49:0/1251199189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054005040 con 0x7f406c0f6490 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f406a7fc700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f6490 0x7f406c108570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f405c002780 tx=0x7f405c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f4063fff700 1 -- 172.21.15.49:0/1251199189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c007b40 con 0x7f406c0f6490 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f4063fff700 1 -- 172.21.15.49:0/1251199189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f405c00f040 con 0x7f406c0f6490 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c10d700 con 0x7f406c0f6490 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f4063fff700 1 -- 172.21.15.49:0/1251199189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f405c014780 con 0x7f406c0f6490 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.358+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c10dcc0 con 0x7f406c0f6490 2024-02-22T00:35:53.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.359+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c100040 con 0x7f406c0f6490 2024-02-22T00:35:53.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.360+0000 7f4063fff700 1 -- 172.21.15.49:0/1251199189 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 90787+0+0 (secure 0 0 0) 0x7f405c007ca0 con 0x7f406c0f6490 2024-02-22T00:35:53.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.360+0000 7f4063fff700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f405806c7c0 0x7f405806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.360+0000 7f4063fff700 1 -- 172.21.15.49:0/1251199189 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f405c08b940 con 0x7f406c0f6490 2024-02-22T00:35:53.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.360+0000 7f406affd700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f405806c7c0 0x7f405806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:53.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.361+0000 7f406affd700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f405806c7c0 0x7f405806ec80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4054004f10 tx=0x7f405400b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:53.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.365+0000 7f4063fff700 1 -- 172.21.15.49:0/1251199189 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f405c059820 con 0x7f406c0f6490 2024-02-22T00:35:53.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.575+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f406c059120 con 0x7f405806c7c0 2024-02-22T00:35:53.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.585+0000 7f4063fff700 1 -- 172.21.15.49:0/1251199189 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f406c059120 con 0x7f405806c7c0 2024-02-22T00:35:53.587 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:35:53.587 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (103s) 26s ago 10m 17.2M - 0.23.0 ba2b418f427c ec5dfa13626b 2024-02-22T00:35:53.587 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (10m) 26s ago 10m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:35:53.587 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (9m) 27s ago 9m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (69s) 26s ago 10m 45.0M - 8.3.5 dad864ee21e9 8d9bb59370a9 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (5m) 26s ago 5m 14.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (5m) 26s ago 5m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (5m) 27s ago 5m 14.3M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (5m) 27s ago 5m 121M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (42s) 26s ago 11m 468M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283 running (3m) 27s ago 9m 63.0M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d128d026ba47 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (11m) 26s ago 11m 56.9M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (9m) 27s ago 9m 51.8M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (66s) 26s ago 9m 12.1M - 1.3.1 1dbe0e931976 648ac19e6ed3 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (64s) 27s ago 9m 19.0M - 1.3.1 1dbe0e931976 29d749a30965 2024-02-22T00:35:53.588 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (9m) 26s ago 9m 223M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:35:53.589 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (8m) 26s ago 8m 238M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:35:53.589 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (7m) 26s ago 7m 198M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:35:53.589 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (7m) 27s ago 7m 261M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:35:53.589 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (7m) 27s ago 7m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:35:53.589 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (6m) 27s ago 6m 220M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:35:53.589 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 starting - - - - 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f405806c7c0 msgr2=0x7f405806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f405806c7c0 0x7f405806ec80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f4054004f10 tx=0x7f405400b040).stop 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f6490 msgr2=0x7f406c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f6490 0x7f406c108570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f405c002780 tx=0x7f405c009ee0).stop 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 shutdown_connections 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f405806c7c0 0x7f405806ec80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f406c0f5af0 0x7f406c108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 --2- 172.21.15.49:0/1251199189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f406c0f6490 0x7f406c108570 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 >> 172.21.15.49:0/1251199189 conn(0x7f406c0f1610 msgr2=0x7f406c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 shutdown_connections 2024-02-22T00:35:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.587+0000 7f4071721700 1 -- 172.21.15.49:0/1251199189 wait complete. 2024-02-22T00:35:53.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.688+0000 7fef518b2700 1 -- 172.21.15.49:0/4135812063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c0fa950 msgr2=0x7fef4c0fcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.688+0000 7fef518b2700 1 --2- 172.21.15.49:0/4135812063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c0fa950 0x7fef4c0fcd40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fef340047f0 tx=0x7fef34009cb0).stop 2024-02-22T00:35:53.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.689+0000 7fef518b2700 1 -- 172.21.15.49:0/4135812063 shutdown_connections 2024-02-22T00:35:53.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.689+0000 7fef518b2700 1 --2- 172.21.15.49:0/4135812063 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c0fa950 0x7fef4c0fcd40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.689+0000 7fef518b2700 1 --2- 172.21.15.49:0/4135812063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef4c061790 0x7fef4c0fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.689+0000 7fef518b2700 1 -- 172.21.15.49:0/4135812063 >> 172.21.15.49:0/4135812063 conn(0x7fef4c0f1ee0 msgr2=0x7fef4c0f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:53.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.689+0000 7fef518b2700 1 -- 172.21.15.49:0/4135812063 shutdown_connections 2024-02-22T00:35:53.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.689+0000 7fef518b2700 1 -- 172.21.15.49:0/4135812063 wait complete. 2024-02-22T00:35:53.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.689+0000 7fef518b2700 1 Processor -- start 2024-02-22T00:35:53.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.689+0000 7fef518b2700 1 -- start start 2024-02-22T00:35:53.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef518b2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c061790 0x7fef4c0f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef518b2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef4c0fa950 0x7fef4c0f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef518b2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0f82b0 con 0x7fef4c061790 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef518b2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0f6850 con 0x7fef4c0fa950 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef4affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c061790 0x7fef4c0f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef4affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c061790 0x7fef4c0f7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34982/0 (socket says 172.21.15.49:34982) 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef4affd700 1 -- 172.21.15.49:0/288630597 learned_addr learned my addr 172.21.15.49:0/288630597 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef4a7fc700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef4c0fa950 0x7fef4c0f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef4affd700 1 -- 172.21.15.49:0/288630597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef4c0fa950 msgr2=0x7fef4c0f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef4affd700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef4c0fa950 0x7fef4c0f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef4affd700 1 -- 172.21.15.49:0/288630597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef34005040 con 0x7fef4c061790 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef4affd700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c061790 0x7fef4c0f7d00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fef3c00e8c0 tx=0x7fef3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef43fff700 1 -- 172.21.15.49:0/288630597 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3c007b40 con 0x7fef4c061790 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef43fff700 1 -- 172.21.15.49:0/288630597 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef3c00f040 con 0x7fef4c061790 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c0f6ad0 con 0x7fef4c061790 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef43fff700 1 -- 172.21.15.49:0/288630597 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3c014880 con 0x7fef4c061790 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.690+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c0f7090 con 0x7fef4c061790 2024-02-22T00:35:53.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.691+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c0fffb0 con 0x7fef4c061790 2024-02-22T00:35:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.692+0000 7fef43fff700 1 -- 172.21.15.49:0/288630597 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 90787+0+0 (secure 0 0 0) 0x7fef3c007ca0 con 0x7fef4c061790 2024-02-22T00:35:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.692+0000 7fef43fff700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fef3806c7c0 0x7fef3806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:53.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.692+0000 7fef43fff700 1 -- 172.21.15.49:0/288630597 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fef3c08b6b0 con 0x7fef4c061790 2024-02-22T00:35:53.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.692+0000 7fef4a7fc700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fef3806c7c0 0x7fef3806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:53.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.693+0000 7fef4a7fc700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fef3806c7c0 0x7fef3806ec80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fef340047c0 tx=0x7fef34009cb0).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:53.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.697+0000 7fef43fff700 1 -- 172.21.15.49:0/288630597 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fef3c059590 con 0x7fef4c061790 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.975+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fef4c101e20 con 0x7fef4c061790 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.975+0000 7fef43fff700 1 -- 172.21.15.49:0/288630597 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+749 (secure 0 0 0) 0x7fef3c059120 con 0x7fef4c061790 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:35:53.978 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 12, 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:35:53.979 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:35:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fef3806c7c0 msgr2=0x7fef3806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fef3806c7c0 0x7fef3806ec80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fef340047c0 tx=0x7fef34009cb0).stop 2024-02-22T00:35:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c061790 msgr2=0x7fef4c0f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c061790 0x7fef4c0f7d00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fef3c00e8c0 tx=0x7fef3c00b040).stop 2024-02-22T00:35:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 shutdown_connections 2024-02-22T00:35:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fef3806c7c0 0x7fef3806ec80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef4c061790 0x7fef4c0f7d00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 --2- 172.21.15.49:0/288630597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef4c0fa950 0x7fef4c0f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.977+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 >> 172.21.15.49:0/288630597 conn(0x7fef4c0f1ee0 msgr2=0x7fef4c0f42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.978+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 shutdown_connections 2024-02-22T00:35:53.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:53.978+0000 7fef518b2700 1 -- 172.21.15.49:0/288630597 wait complete. 2024-02-22T00:35:54.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.080+0000 7f384c1c9700 1 -- 172.21.15.49:0/1754599066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f8cb0 msgr2=0x7f38440f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:54.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.080+0000 7f384c1c9700 1 --2- 172.21.15.49:0/1754599066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f8cb0 0x7f38440f9110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f38340047f0 tx=0x7f3834009cb0).stop 2024-02-22T00:35:54.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.080+0000 7f384c1c9700 1 -- 172.21.15.49:0/1754599066 shutdown_connections 2024-02-22T00:35:54.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.080+0000 7f384c1c9700 1 --2- 172.21.15.49:0/1754599066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f8cb0 0x7f38440f9110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:54.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.080+0000 7f384c1c9700 1 --2- 172.21.15.49:0/1754599066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38440f7a10 0x7f38440f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:54.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.080+0000 7f384c1c9700 1 -- 172.21.15.49:0/1754599066 >> 172.21.15.49:0/1754599066 conn(0x7f38440f3150 msgr2=0x7f38440f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:54.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.081+0000 7f384c1c9700 1 -- 172.21.15.49:0/1754599066 shutdown_connections 2024-02-22T00:35:54.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.081+0000 7f384c1c9700 1 -- 172.21.15.49:0/1754599066 wait complete. 2024-02-22T00:35:54.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.081+0000 7f384c1c9700 1 Processor -- start 2024-02-22T00:35:54.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.081+0000 7f384c1c9700 1 -- start start 2024-02-22T00:35:54.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f384c1c9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f7a10 0x7f3844108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:54.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f384c1c9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38440f8cb0 0x7f3844108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:54.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f384c1c9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844108c30 con 0x7f38440f7a10 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f384c1c9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3844108d70 con 0x7f38440f8cb0 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f3849f65700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f7a10 0x7f3844108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f3849f65700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f7a10 0x7f3844108190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34992/0 (socket says 172.21.15.49:34992) 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f3849f65700 1 -- 172.21.15.49:0/545363230 learned_addr learned my addr 172.21.15.49:0/545363230 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f3849764700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38440f8cb0 0x7f3844108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f3849f65700 1 -- 172.21.15.49:0/545363230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38440f8cb0 msgr2=0x7f3844108680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f3849f65700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38440f8cb0 0x7f3844108680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f3849f65700 1 -- 172.21.15.49:0/545363230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3834005040 con 0x7f38440f7a10 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f3849f65700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f7a10 0x7f3844108190 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f384000c790 tx=0x7f3840007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f383affd700 1 -- 172.21.15.49:0/545363230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f384000e680 con 0x7f38440f7a10 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f383affd700 1 -- 172.21.15.49:0/545363230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f384000ec90 con 0x7f38440f7a10 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384410d810 con 0x7f38440f7a10 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f383affd700 1 -- 172.21.15.49:0/545363230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3840012da0 con 0x7f38440f7a10 2024-02-22T00:35:54.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.082+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384410ddd0 con 0x7f38440f7a10 2024-02-22T00:35:54.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.083+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384405fb50 con 0x7f38440f7a10 2024-02-22T00:35:54.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.084+0000 7f383affd700 1 -- 172.21.15.49:0/545363230 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 29) v1 ==== 90787+0+0 (secure 0 0 0) 0x7f384000e7e0 con 0x7f38440f7a10 2024-02-22T00:35:54.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.084+0000 7f383affd700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f383006c7c0 0x7f383006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:35:54.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.085+0000 7f383affd700 1 -- 172.21.15.49:0/545363230 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f384008b1e0 con 0x7f38440f7a10 2024-02-22T00:35:54.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.085+0000 7f3849764700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f383006c7c0 0x7f383006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:35:54.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.085+0000 7f3849764700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f383006c7c0 0x7f383006ec80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3834004f10 tx=0x7f383400b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:35:54.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.089+0000 7f383affd700 1 -- 172.21.15.49:0/545363230 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f3840059280 con 0x7f38440f7a10 2024-02-22T00:35:54.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.304+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3844059120 con 0x7f383006c7c0 2024-02-22T00:35:54.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.305+0000 7f383affd700 1 -- 172.21.15.49:0/545363230 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f3844059120 con 0x7f383006c7c0 2024-02-22T00:35:54.307 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:35:54.307 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:35:54.307 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:35:54.307 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:35:54.307 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:35:54.307 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-02-22T00:35:54.308 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:35:54.308 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/2 daemons upgraded", 2024-02-22T00:35:54.308 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mgr daemons", 2024-02-22T00:35:54.308 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:35:54.308 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:35:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f383006c7c0 msgr2=0x7f383006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f383006c7c0 0x7f383006ec80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3834004f10 tx=0x7f383400b040).stop 2024-02-22T00:35:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f7a10 msgr2=0x7f3844108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:35:54.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f7a10 0x7f3844108190 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f384000c790 tx=0x7f3840007f90).stop 2024-02-22T00:35:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 shutdown_connections 2024-02-22T00:35:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f383006c7c0 0x7f383006ec80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38440f7a10 0x7f3844108190 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 --2- 172.21.15.49:0/545363230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38440f8cb0 0x7f3844108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:35:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 >> 172.21.15.49:0/545363230 conn(0x7f38440f3150 msgr2=0x7f38440fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:35:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 shutdown_connections 2024-02-22T00:35:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:35:54.307+0000 7f384c1c9700 1 -- 172.21.15.49:0/545363230 wait complete. 2024-02-22T00:35:54.923 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:52.915820+0000 mgr.smithi049.rjblpr (mgr.14674) 35 : audit [DBG] from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:54.923 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:53.252487+0000 mgr.smithi049.rjblpr (mgr.14674) 36 : audit [DBG] from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:54.923 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:53.561635+0000 mgr.smithi049.rjblpr (mgr.14674) 37 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:54.923 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:53.577066+0000 mgr.smithi049.rjblpr (mgr.14674) 38 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:54.923 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:53.976637+0000 mon.smithi049 (mon.0) 794 : audit [DBG] from='client.? 172.21.15.49:0/288630597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:35:54.924 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:54.383516+0000 mon.smithi049 (mon.0) 795 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:54.924 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:54.387031+0000 mon.smithi049 (mon.0) 796 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:54.924 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:54.397123+0000 mon.smithi049 (mon.0) 797 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:52.915820+0000 mgr.smithi049.rjblpr (mgr.14674) 35 : audit [DBG] from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:53.252487+0000 mgr.smithi049.rjblpr (mgr.14674) 36 : audit [DBG] from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:53.561635+0000 mgr.smithi049.rjblpr (mgr.14674) 37 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:53.577066+0000 mgr.smithi049.rjblpr (mgr.14674) 38 : audit [DBG] from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:53.976637+0000 mon.smithi049 (mon.0) 794 : audit [DBG] from='client.? 172.21.15.49:0/288630597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:35:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:54.383516+0000 mon.smithi049 (mon.0) 795 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:54.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:54.387031+0000 mon.smithi049 (mon.0) 796 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:54.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:54.397123+0000 mon.smithi049 (mon.0) 797 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:35:55.712 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:54.305893+0000 mgr.smithi049.rjblpr (mgr.14674) 39 : audit [DBG] from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:55.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:55 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:54.305893+0000 mgr.smithi049.rjblpr (mgr.14674) 39 : audit [DBG] from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:35:56.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:55.561972+0000 mgr.smithi049.rjblpr (mgr.14674) 40 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:56.938 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:55.561972+0000 mgr.smithi049.rjblpr (mgr.14674) 40 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:58.905 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:57.562507+0000 mgr.smithi049.rjblpr (mgr.14674) 41 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:58.906 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:58.226762+0000 mon.smithi049 (mon.0) 798 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:58.906 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:58.231462+0000 mon.smithi049 (mon.0) 799 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:58.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:57.562507+0000 mgr.smithi049.rjblpr (mgr.14674) 41 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:35:58.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:58.226762+0000 mon.smithi049 (mon.0) 798 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:35:58.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:58.231462+0000 mon.smithi049 (mon.0) 799 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:00.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:58.917229+0000 mon.smithi049 (mon.0) 800 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:00.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:35:58.921831+0000 mon.smithi049 (mon.0) 801 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:00.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:35:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:35:59.563115+0000 mgr.smithi049.rjblpr (mgr.14674) 42 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:00.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:58.917229+0000 mon.smithi049 (mon.0) 800 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:00.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:35:58.921831+0000 mon.smithi049 (mon.0) 801 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:00.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:35:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:35:59.563115+0000 mgr.smithi049.rjblpr (mgr.14674) 42 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:01.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:01.500129+0000 mon.smithi049 (mon.0) 802 : cluster [DBG] Standby manager daemon smithi161.sazlam restarted 2024-02-22T00:36:01.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:01.500275+0000 mon.smithi049 (mon.0) 803 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:36:01.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:01.501441+0000 mon.smithi161 (mon.1) 89 : audit [DBG] from='mgr.? 172.21.15.161:0/1439355034' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:36:01.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:01.501882+0000 mon.smithi161 (mon.1) 90 : audit [DBG] from='mgr.? 172.21.15.161:0/1439355034' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:36:01.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:01.503991+0000 mon.smithi161 (mon.1) 91 : audit [DBG] from='mgr.? 172.21.15.161:0/1439355034' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:36:01.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:01.504932+0000 mon.smithi161 (mon.1) 92 : audit [DBG] from='mgr.? 172.21.15.161:0/1439355034' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:36:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:01.500129+0000 mon.smithi049 (mon.0) 802 : cluster [DBG] Standby manager daemon smithi161.sazlam restarted 2024-02-22T00:36:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:01.500275+0000 mon.smithi049 (mon.0) 803 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:36:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:01.501441+0000 mon.smithi161 (mon.1) 89 : audit [DBG] from='mgr.? 172.21.15.161:0/1439355034' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:36:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:01.501882+0000 mon.smithi161 (mon.1) 90 : audit [DBG] from='mgr.? 172.21.15.161:0/1439355034' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:36:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:01.503991+0000 mon.smithi161 (mon.1) 91 : audit [DBG] from='mgr.? 172.21.15.161:0/1439355034' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:36:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:01.504932+0000 mon.smithi161 (mon.1) 92 : audit [DBG] from='mgr.? 172.21.15.161:0/1439355034' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:36:02.838 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:01.560629+0000 mon.smithi049 (mon.0) 804 : cluster [DBG] mgrmap e30: smithi049.rjblpr(active, since 40s), standbys: smithi161.sazlam 2024-02-22T00:36:02.838 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:01.563485+0000 mgr.smithi049.rjblpr (mgr.14674) 43 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:02.838 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.199824+0000 mon.smithi049 (mon.0) 805 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.838 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.204408+0000 mon.smithi049 (mon.0) 806 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.838 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.205370+0000 mon.smithi049 (mon.0) 807 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:36:02.838 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.206308+0000 mon.smithi049 (mon.0) 808 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.210819+0000 mon.smithi049 (mon.0) 809 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.349313+0000 mon.smithi049 (mon.0) 810 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.352039+0000 mon.smithi049 (mon.0) 811 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.357064+0000 mon.smithi049 (mon.0) 812 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.357934+0000 mon.smithi049 (mon.0) 813 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.rjblpr"}]: dispatch 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.361080+0000 mon.smithi049 (mon.0) 814 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.rjblpr"}]': finished 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.361735+0000 mon.smithi049 (mon.0) 815 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.sazlam"}]: dispatch 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.364658+0000 mon.smithi049 (mon.0) 816 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.sazlam"}]': finished 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.367173+0000 mon.smithi049 (mon.0) 817 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.371640+0000 mon.smithi049 (mon.0) 818 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.372614+0000 mon.smithi049 (mon.0) 819 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.377164+0000 mon.smithi049 (mon.0) 820 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.839 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.378207+0000 mon.smithi049 (mon.0) 821 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.382398+0000 mon.smithi049 (mon.0) 822 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.383496+0000 mon.smithi049 (mon.0) 823 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.387439+0000 mon.smithi049 (mon.0) 824 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.388459+0000 mon.smithi049 (mon.0) 825 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.392238+0000 mon.smithi049 (mon.0) 826 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.393262+0000 mon.smithi049 (mon.0) 827 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.396989+0000 mon.smithi049 (mon.0) 828 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.398082+0000 mon.smithi049 (mon.0) 829 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:02.840 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:02.401753+0000 mon.smithi049 (mon.0) 830 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:01.560629+0000 mon.smithi049 (mon.0) 804 : cluster [DBG] mgrmap e30: smithi049.rjblpr(active, since 40s), standbys: smithi161.sazlam 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:01.563485+0000 mgr.smithi049.rjblpr (mgr.14674) 43 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.199824+0000 mon.smithi049 (mon.0) 805 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.204408+0000 mon.smithi049 (mon.0) 806 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.205370+0000 mon.smithi049 (mon.0) 807 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.206308+0000 mon.smithi049 (mon.0) 808 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.210819+0000 mon.smithi049 (mon.0) 809 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.349313+0000 mon.smithi049 (mon.0) 810 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.352039+0000 mon.smithi049 (mon.0) 811 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.357064+0000 mon.smithi049 (mon.0) 812 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.357934+0000 mon.smithi049 (mon.0) 813 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.rjblpr"}]: dispatch 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.361080+0000 mon.smithi049 (mon.0) 814 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi049.rjblpr"}]': finished 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.361735+0000 mon.smithi049 (mon.0) 815 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.sazlam"}]: dispatch 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.364658+0000 mon.smithi049 (mon.0) 816 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi161.sazlam"}]': finished 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.367173+0000 mon.smithi049 (mon.0) 817 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.371640+0000 mon.smithi049 (mon.0) 818 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.372614+0000 mon.smithi049 (mon.0) 819 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.377164+0000 mon.smithi049 (mon.0) 820 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.378207+0000 mon.smithi049 (mon.0) 821 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.382398+0000 mon.smithi049 (mon.0) 822 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.383496+0000 mon.smithi049 (mon.0) 823 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.387439+0000 mon.smithi049 (mon.0) 824 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.388459+0000 mon.smithi049 (mon.0) 825 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.392238+0000 mon.smithi049 (mon.0) 826 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.393262+0000 mon.smithi049 (mon.0) 827 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:03.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.396989+0000 mon.smithi049 (mon.0) 828 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.398082+0000 mon.smithi049 (mon.0) 829 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:03.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:02.401753+0000 mon.smithi049 (mon.0) 830 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:02.352718+0000 mgr.smithi049.rjblpr (mgr.14674) 44 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-22T00:36:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:02.367870+0000 mgr.smithi049.rjblpr (mgr.14674) 45 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-22T00:36:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:02.373232+0000 mgr.smithi049.rjblpr (mgr.14674) 46 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-22T00:36:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:02.378820+0000 mgr.smithi049.rjblpr (mgr.14674) 47 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-22T00:36:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:02.384087+0000 mgr.smithi049.rjblpr (mgr.14674) 48 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-02-22T00:36:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:02.389028+0000 mgr.smithi049.rjblpr (mgr.14674) 49 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-22T00:36:03.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:02.393819+0000 mgr.smithi049.rjblpr (mgr.14674) 50 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-22T00:36:03.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:02.398636+0000 mgr.smithi049.rjblpr (mgr.14674) 51 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-02-22T00:36:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:02.352718+0000 mgr.smithi049.rjblpr (mgr.14674) 44 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-22T00:36:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:02.367870+0000 mgr.smithi049.rjblpr (mgr.14674) 45 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-22T00:36:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:02.373232+0000 mgr.smithi049.rjblpr (mgr.14674) 46 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-22T00:36:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:02.378820+0000 mgr.smithi049.rjblpr (mgr.14674) 47 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-02-22T00:36:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:02.384087+0000 mgr.smithi049.rjblpr (mgr.14674) 48 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-02-22T00:36:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:02.389028+0000 mgr.smithi049.rjblpr (mgr.14674) 49 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-22T00:36:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:02.393819+0000 mgr.smithi049.rjblpr (mgr.14674) 50 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-22T00:36:04.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:02.398636+0000 mgr.smithi049.rjblpr (mgr.14674) 51 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-02-22T00:36:04.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:03.563946+0000 mgr.smithi049.rjblpr (mgr.14674) 52 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:05.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:03.563946+0000 mgr.smithi049.rjblpr (mgr.14674) 52 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:05.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:04.170348+0000 mgr.smithi049.rjblpr (mgr.14674) 53 : cephadm [INF] Upgrade: Updating node-exporter.smithi049 (1/2) 2024-02-22T00:36:05.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:05 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:04.170692+0000 mgr.smithi049.rjblpr (mgr.14674) 54 : cephadm [INF] Deploying daemon node-exporter.smithi049 on smithi049 2024-02-22T00:36:06.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:04.170348+0000 mgr.smithi049.rjblpr (mgr.14674) 53 : cephadm [INF] Upgrade: Updating node-exporter.smithi049 (1/2) 2024-02-22T00:36:06.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:04.170692+0000 mgr.smithi049.rjblpr (mgr.14674) 54 : cephadm [INF] Deploying daemon node-exporter.smithi049 on smithi049 2024-02-22T00:36:06.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:05.564253+0000 mgr.smithi049.rjblpr (mgr.14674) 55 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:07.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:05.564253+0000 mgr.smithi049.rjblpr (mgr.14674) 55 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:06.651235+0000 mon.smithi049 (mon.0) 831 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:36:08.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:06.651235+0000 mon.smithi049 (mon.0) 831 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:36:08.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:07.564511+0000 mgr.smithi049.rjblpr (mgr.14674) 56 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:09.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:07.564511+0000 mgr.smithi049.rjblpr (mgr.14674) 56 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:08.650922+0000 mon.smithi049 (mon.0) 832 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:09.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:08.654890+0000 mon.smithi049 (mon.0) 833 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:09.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:08.650922+0000 mon.smithi049 (mon.0) 832 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:09.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:08.654890+0000 mon.smithi049 (mon.0) 833 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:09.565163+0000 mgr.smithi049.rjblpr (mgr.14674) 57 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:09.565163+0000 mgr.smithi049.rjblpr (mgr.14674) 57 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:11.765 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:10.217355+0000 mgr.smithi049.rjblpr (mgr.14674) 58 : cephadm [INF] Upgrade: Updating node-exporter.smithi161 (2/2) 2024-02-22T00:36:11.765 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:10.217829+0000 mgr.smithi049.rjblpr (mgr.14674) 59 : cephadm [INF] Deploying daemon node-exporter.smithi161 on smithi161 2024-02-22T00:36:11.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:10.217355+0000 mgr.smithi049.rjblpr (mgr.14674) 58 : cephadm [INF] Upgrade: Updating node-exporter.smithi161 (2/2) 2024-02-22T00:36:11.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:10.217829+0000 mgr.smithi049.rjblpr (mgr.14674) 59 : cephadm [INF] Deploying daemon node-exporter.smithi161 on smithi161 2024-02-22T00:36:12.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:11.565599+0000 mgr.smithi049.rjblpr (mgr.14674) 60 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:13.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:11.565599+0000 mgr.smithi049.rjblpr (mgr.14674) 60 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:14.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:13.566235+0000 mgr.smithi049.rjblpr (mgr.14674) 61 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:15.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:13.566235+0000 mgr.smithi049.rjblpr (mgr.14674) 61 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:16.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:14.913397+0000 mon.smithi049 (mon.0) 834 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:16.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:14.918602+0000 mon.smithi049 (mon.0) 835 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:16.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:14.942574+0000 mon.smithi049 (mon.0) 836 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:16.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:15.213943+0000 mon.smithi049 (mon.0) 837 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:16.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:15.219648+0000 mon.smithi049 (mon.0) 838 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:16.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:15.566533+0000 mgr.smithi049.rjblpr (mgr.14674) 62 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:16.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:14.913397+0000 mon.smithi049 (mon.0) 834 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:16.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:14.918602+0000 mon.smithi049 (mon.0) 835 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:16.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:14.942574+0000 mon.smithi049 (mon.0) 836 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:16.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:15.213943+0000 mon.smithi049 (mon.0) 837 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:16.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:15.219648+0000 mon.smithi049 (mon.0) 838 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:16.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:15.566533+0000 mgr.smithi049.rjblpr (mgr.14674) 62 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:18.660 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:17.566792+0000 mgr.smithi049.rjblpr (mgr.14674) 63 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:18.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:17.566792+0000 mgr.smithi049.rjblpr (mgr.14674) 63 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:20.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:18.997422+0000 mon.smithi049 (mon.0) 839 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:19.001891+0000 mon.smithi049 (mon.0) 840 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:19.074443+0000 mon.smithi049 (mon.0) 841 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:19.078569+0000 mon.smithi049 (mon.0) 842 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:19.567230+0000 mgr.smithi049.rjblpr (mgr.14674) 64 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:20.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:19.648189+0000 mon.smithi049 (mon.0) 843 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:19.652124+0000 mon.smithi049 (mon.0) 844 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:19.763499+0000 mon.smithi049 (mon.0) 845 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:19.767475+0000 mon.smithi049 (mon.0) 846 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.296 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:18.997422+0000 mon.smithi049 (mon.0) 839 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.296 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:19.001891+0000 mon.smithi049 (mon.0) 840 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.296 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:19.074443+0000 mon.smithi049 (mon.0) 841 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:19.078569+0000 mon.smithi049 (mon.0) 842 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:19.567230+0000 mgr.smithi049.rjblpr (mgr.14674) 64 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:20.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:19.648189+0000 mon.smithi049 (mon.0) 843 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:19.652124+0000 mon.smithi049 (mon.0) 844 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:19.763499+0000 mon.smithi049 (mon.0) 845 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:20.297 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:19 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:19.767475+0000 mon.smithi049 (mon.0) 846 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:22.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:21.567529+0000 mgr.smithi049.rjblpr (mgr.14674) 65 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:22.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:21.652947+0000 mon.smithi049 (mon.0) 847 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:36:23.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:21.567529+0000 mgr.smithi049.rjblpr (mgr.14674) 65 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:23.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:21.652947+0000 mon.smithi049 (mon.0) 847 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:36:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.423+0000 7f6a2d245700 1 -- 172.21.15.49:0/62778296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f7800 msgr2=0x7f6a280f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.423+0000 7f6a2d245700 1 --2- 172.21.15.49:0/62778296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f7800 0x7f6a280f7c20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f6a100047f0 tx=0x7f6a10009cb0).stop 2024-02-22T00:36:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.423+0000 7f6a2d245700 1 -- 172.21.15.49:0/62778296 shutdown_connections 2024-02-22T00:36:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.423+0000 7f6a2d245700 1 --2- 172.21.15.49:0/62778296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a280f8aa0 0x7f6a280f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.423+0000 7f6a2d245700 1 --2- 172.21.15.49:0/62778296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f7800 0x7f6a280f7c20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.423+0000 7f6a2d245700 1 -- 172.21.15.49:0/62778296 >> 172.21.15.49:0/62778296 conn(0x7f6a280f2f80 msgr2=0x7f6a280f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.423+0000 7f6a2d245700 1 -- 172.21.15.49:0/62778296 shutdown_connections 2024-02-22T00:36:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.423+0000 7f6a2d245700 1 -- 172.21.15.49:0/62778296 wait complete. 2024-02-22T00:36:24.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2d245700 1 Processor -- start 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2d245700 1 -- start start 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2d245700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a280f7800 0x7f6a2806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2d245700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f8aa0 0x7f6a2806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2d245700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2806cf80 con 0x7f6a280f8aa0 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2d245700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2806b520 con 0x7f6a280f7800 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f8aa0 0x7f6a2806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f8aa0 0x7f6a2806b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44826/0 (socket says 172.21.15.49:44826) 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a2659c700 1 -- 172.21.15.49:0/138994864 learned_addr learned my addr 172.21.15.49:0/138994864 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.424+0000 7f6a26d9d700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a280f7800 0x7f6a2806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a2659c700 1 -- 172.21.15.49:0/138994864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a280f7800 msgr2=0x7f6a2806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a2659c700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a280f7800 0x7f6a2806c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a2659c700 1 -- 172.21.15.49:0/138994864 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10005040 con 0x7f6a280f8aa0 2024-02-22T00:36:24.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a26d9d700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a280f7800 0x7f6a2806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:36:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a2659c700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f8aa0 0x7f6a2806b030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f6a180041d0 tx=0x7f6a18009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a1ffff700 1 -- 172.21.15.49:0/138994864 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a18002d90 con 0x7f6a280f8aa0 2024-02-22T00:36:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2806b7a0 con 0x7f6a280f8aa0 2024-02-22T00:36:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a1ffff700 1 -- 172.21.15.49:0/138994864 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a1800f040 con 0x7f6a280f8aa0 2024-02-22T00:36:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a1ffff700 1 -- 172.21.15.49:0/138994864 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1800d800 con 0x7f6a280f8aa0 2024-02-22T00:36:24.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.425+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2806bd60 con 0x7f6a280f8aa0 2024-02-22T00:36:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:23.042522+0000 mon.smithi049 (mon.0) 848 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:23.046797+0000 mon.smithi049 (mon.0) 849 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:23.568120+0000 mgr.smithi049.rjblpr (mgr.14674) 66 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:24.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.426+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a280fffc0 con 0x7f6a280f8aa0 2024-02-22T00:36:24.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.427+0000 7f6a1ffff700 1 -- 172.21.15.49:0/138994864 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 30) v1 ==== 90787+0+0 (secure 0 0 0) 0x7f6a1800dac0 con 0x7f6a280f8aa0 2024-02-22T00:36:24.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.427+0000 7f6a1ffff700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6a1406c7c0 0x7f6a1406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:24.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.427+0000 7f6a1ffff700 1 -- 172.21.15.49:0/138994864 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f6a1808baf0 con 0x7f6a280f8aa0 2024-02-22T00:36:24.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.427+0000 7f6a26d9d700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6a1406c7c0 0x7f6a1406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:24.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.428+0000 7f6a26d9d700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6a1406c7c0 0x7f6a1406ec80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6a10004f10 tx=0x7f6a1000b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:24.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.432+0000 7f6a1ffff700 1 -- 172.21.15.49:0/138994864 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f6a18059910 con 0x7f6a280f8aa0 2024-02-22T00:36:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:23.042522+0000 mon.smithi049 (mon.0) 848 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:23.046797+0000 mon.smithi049 (mon.0) 849 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:24.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:23.568120+0000 mgr.smithi049.rjblpr (mgr.14674) 66 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:24.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.648+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a28059120 con 0x7f6a1406c7c0 2024-02-22T00:36:24.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.649+0000 7f6a1ffff700 1 -- 172.21.15.49:0/138994864 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f6a28059120 con 0x7f6a1406c7c0 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6a1406c7c0 msgr2=0x7f6a1406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6a1406c7c0 0x7f6a1406ec80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6a10004f10 tx=0x7f6a1000b040).stop 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f8aa0 msgr2=0x7f6a2806b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f8aa0 0x7f6a2806b030 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f6a180041d0 tx=0x7f6a18009f60).stop 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 shutdown_connections 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6a1406c7c0 0x7f6a1406ec80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a280f7800 0x7f6a2806c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 --2- 172.21.15.49:0/138994864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a280f8aa0 0x7f6a2806b030 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 >> 172.21.15.49:0/138994864 conn(0x7f6a280f2f80 msgr2=0x7f6a280fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:24.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 shutdown_connections 2024-02-22T00:36:24.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.651+0000 7f6a2d245700 1 -- 172.21.15.49:0/138994864 wait complete. 2024-02-22T00:36:24.664 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.754+0000 7f939707c700 1 -- 172.21.15.49:0/1625046544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 msgr2=0x7f93900f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.754+0000 7f939707c700 1 --2- 172.21.15.49:0/1625046544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 0x7f93900f7df0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f937c0047f0 tx=0x7f937c009cb0).stop 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.754+0000 7f939707c700 1 -- 172.21.15.49:0/1625046544 shutdown_connections 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.754+0000 7f939707c700 1 --2- 172.21.15.49:0/1625046544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 0x7f93900f7df0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.754+0000 7f939707c700 1 --2- 172.21.15.49:0/1625046544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93900f66f0 0x7f93900f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.754+0000 7f939707c700 1 -- 172.21.15.49:0/1625046544 >> 172.21.15.49:0/1625046544 conn(0x7f93900f1e50 msgr2=0x7f93900f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.754+0000 7f939707c700 1 -- 172.21.15.49:0/1625046544 shutdown_connections 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.754+0000 7f939707c700 1 -- 172.21.15.49:0/1625046544 wait complete. 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f939707c700 1 Processor -- start 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f939707c700 1 -- start start 2024-02-22T00:36:24.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f939707c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93900f66f0 0x7f9390108060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f939707c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 0x7f9390108550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f939707c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390108b00 con 0x7f93900f7990 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f939707c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9390108c40 con 0x7f93900f66f0 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f938ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 0x7f9390108550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f938ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 0x7f9390108550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44852/0 (socket says 172.21.15.49:44852) 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.755+0000 7f938ffff700 1 -- 172.21.15.49:0/1514920701 learned_addr learned my addr 172.21.15.49:0/1514920701 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f9394e18700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93900f66f0 0x7f9390108060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f938ffff700 1 -- 172.21.15.49:0/1514920701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93900f66f0 msgr2=0x7f9390108060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f938ffff700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93900f66f0 0x7f9390108060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f938ffff700 1 -- 172.21.15.49:0/1514920701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c005040 con 0x7f93900f7990 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f938ffff700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 0x7f9390108550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f937c013560 tx=0x7f937c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f938dffb700 1 -- 172.21.15.49:0/1514920701 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937c018070 con 0x7f93900f7990 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939010d680 con 0x7f93900f7990 2024-02-22T00:36:24.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f938dffb700 1 -- 172.21.15.49:0/1514920701 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f937c007e90 con 0x7f93900f7990 2024-02-22T00:36:24.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f938dffb700 1 -- 172.21.15.49:0/1514920701 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937c01c5e0 con 0x7f93900f7990 2024-02-22T00:36:24.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.756+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939010dc40 con 0x7f93900f7990 2024-02-22T00:36:24.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.757+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93900feeb0 con 0x7f93900f7990 2024-02-22T00:36:24.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.758+0000 7f938dffb700 1 -- 172.21.15.49:0/1514920701 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 30) v1 ==== 90787+0+0 (secure 0 0 0) 0x7f937c0123c0 con 0x7f93900f7990 2024-02-22T00:36:24.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.758+0000 7f938dffb700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f938006c7c0 0x7f938006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:24.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.758+0000 7f938dffb700 1 -- 172.21.15.49:0/1514920701 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f937c08c870 con 0x7f93900f7990 2024-02-22T00:36:24.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.758+0000 7f9394e18700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f938006c7c0 0x7f938006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:24.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.758+0000 7f9394e18700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f938006c7c0 0x7f938006ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f93900f77f0 tx=0x7f938400b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:24.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.763+0000 7f938dffb700 1 -- 172.21.15.49:0/1514920701 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f937c05a750 con 0x7f93900f7990 2024-02-22T00:36:24.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.976+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f939010e280 con 0x7f938006c7c0 2024-02-22T00:36:24.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.977+0000 7f938dffb700 1 -- 172.21.15.49:0/1514920701 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f939010e280 con 0x7f938006c7c0 2024-02-22T00:36:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f938006c7c0 msgr2=0x7f938006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f938006c7c0 0x7f938006ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f93900f77f0 tx=0x7f938400b040).stop 2024-02-22T00:36:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 msgr2=0x7f9390108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:24.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 0x7f9390108550 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f937c013560 tx=0x7f937c009cb0).stop 2024-02-22T00:36:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 shutdown_connections 2024-02-22T00:36:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f938006c7c0 0x7f938006ec80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93900f66f0 0x7f9390108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 --2- 172.21.15.49:0/1514920701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f93900f7990 0x7f9390108550 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 >> 172.21.15.49:0/1514920701 conn(0x7f93900f1e50 msgr2=0x7f9390060d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 shutdown_connections 2024-02-22T00:36:24.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:24.979+0000 7f939707c700 1 -- 172.21.15.49:0/1514920701 wait complete. 2024-02-22T00:36:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.081+0000 7fda62c41700 1 -- 172.21.15.49:0/932028870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 msgr2=0x7fda5c0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.081+0000 7fda62c41700 1 --2- 172.21.15.49:0/932028870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 0x7fda5c0f7df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fda480047f0 tx=0x7fda48009cb0).stop 2024-02-22T00:36:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.081+0000 7fda62c41700 1 -- 172.21.15.49:0/932028870 shutdown_connections 2024-02-22T00:36:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.081+0000 7fda62c41700 1 --2- 172.21.15.49:0/932028870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 0x7fda5c0f7df0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.081+0000 7fda62c41700 1 --2- 172.21.15.49:0/932028870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c0f66f0 0x7fda5c0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.081+0000 7fda62c41700 1 -- 172.21.15.49:0/932028870 >> 172.21.15.49:0/932028870 conn(0x7fda5c0f1e50 msgr2=0x7fda5c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.081+0000 7fda62c41700 1 -- 172.21.15.49:0/932028870 shutdown_connections 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.081+0000 7fda62c41700 1 -- 172.21.15.49:0/932028870 wait complete. 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda62c41700 1 Processor -- start 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda62c41700 1 -- start start 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda62c41700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c0f66f0 0x7fda5c060ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda62c41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 0x7fda5c10cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda62c41700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c10d290 con 0x7fda5c0f7990 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda62c41700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c10d3d0 con 0x7fda5c0f66f0 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 0x7fda5c10cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 0x7fda5c10cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44868/0 (socket says 172.21.15.49:44868) 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda5bfff700 1 -- 172.21.15.49:0/691888062 learned_addr learned my addr 172.21.15.49:0/691888062 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda609dd700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c0f66f0 0x7fda5c060ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda5bfff700 1 -- 172.21.15.49:0/691888062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c0f66f0 msgr2=0x7fda5c060ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda5bfff700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c0f66f0 0x7fda5c060ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda5bfff700 1 -- 172.21.15.49:0/691888062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48005040 con 0x7fda5c0f7990 2024-02-22T00:36:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.082+0000 7fda5bfff700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 0x7fda5c10cda0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fda4800b120 tx=0x7fda48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.083+0000 7fda59ffb700 1 -- 172.21.15.49:0/691888062 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda4800e030 con 0x7fda5c0f7990 2024-02-22T00:36:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.083+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c10d570 con 0x7fda5c0f7990 2024-02-22T00:36:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.083+0000 7fda59ffb700 1 -- 172.21.15.49:0/691888062 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fda48007e90 con 0x7fda5c0f7990 2024-02-22T00:36:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.083+0000 7fda59ffb700 1 -- 172.21.15.49:0/691888062 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda48018070 con 0x7fda5c0f7990 2024-02-22T00:36:25.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.083+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c10dad0 con 0x7fda5c0f7990 2024-02-22T00:36:25.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.084+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5c0feeb0 con 0x7fda5c0f7990 2024-02-22T00:36:25.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.084+0000 7fda59ffb700 1 -- 172.21.15.49:0/691888062 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 30) v1 ==== 90787+0+0 (secure 0 0 0) 0x7fda4801d420 con 0x7fda5c0f7990 2024-02-22T00:36:25.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.085+0000 7fda59ffb700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fda4c06c7c0 0x7fda4c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.085+0000 7fda59ffb700 1 -- 172.21.15.49:0/691888062 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fda4808cff0 con 0x7fda5c0f7990 2024-02-22T00:36:25.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.085+0000 7fda609dd700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fda4c06c7c0 0x7fda4c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:25.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.085+0000 7fda609dd700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fda4c06c7c0 0x7fda4c06ec80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fda5c0f77f0 tx=0x7fda50009040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:25.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.089+0000 7fda59ffb700 1 -- 172.21.15.49:0/691888062 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fda4805ae30 con 0x7fda5c0f7990 2024-02-22T00:36:25.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.295+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda5c059120 con 0x7fda4c06c7c0 2024-02-22T00:36:25.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.305+0000 7fda59ffb700 1 -- 172.21.15.49:0/691888062 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fda5c059120 con 0x7fda4c06c7c0 2024-02-22T00:36:25.307 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:36:25.307 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (2m) 6s ago 10m 17.9M - 0.23.0 ba2b418f427c ec5dfa13626b 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (10m) 6s ago 10m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (10m) 6s ago 10m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (101s) 6s ago 10m 46.7M - 8.3.5 dad864ee21e9 8d9bb59370a9 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (5m) 6s ago 5m 14.7M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (5m) 6s ago 5m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (5m) 6s ago 5m 14.7M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (5m) 6s ago 5m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (74s) 6s ago 12m 493M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (31s) 6s ago 10m 445M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (12m) 6s ago 12m 55.9M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (10m) 6s ago 10m 51.3M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (17s) 6s ago 10m 8019k - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (10s) 6s ago 9m 3506k - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:36:25.308 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (9m) 6s ago 9m 223M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:36:25.309 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (8m) 6s ago 8m 236M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:36:25.309 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (8m) 6s ago 8m 198M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:36:25.309 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (8m) 6s ago 8m 260M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:36:25.309 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (7m) 6s ago 7m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:36:25.311 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (7m) 6s ago 7m 221M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:36:25.311 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (39s) 6s ago 9m 56.9M - 2.33.4 514e6a882f6e 35fc158ca9d4 2024-02-22T00:36:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fda4c06c7c0 msgr2=0x7fda4c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fda4c06c7c0 0x7fda4c06ec80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fda5c0f77f0 tx=0x7fda50009040).stop 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 msgr2=0x7fda5c10cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 0x7fda5c10cda0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fda4800b120 tx=0x7fda48009cb0).stop 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 shutdown_connections 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fda4c06c7c0 0x7fda4c06ec80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda5c0f66f0 0x7fda5c060ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 --2- 172.21.15.49:0/691888062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fda5c0f7990 0x7fda5c10cda0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 >> 172.21.15.49:0/691888062 conn(0x7fda5c0f1e50 msgr2=0x7fda5c0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 shutdown_connections 2024-02-22T00:36:25.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.307+0000 7fda62c41700 1 -- 172.21.15.49:0/691888062 wait complete. 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.407+0000 7efd475ef700 1 -- 172.21.15.49:0/4246387804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 msgr2=0x7efd400f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.407+0000 7efd475ef700 1 --2- 172.21.15.49:0/4246387804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 0x7efd400f6b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7efd3c0047f0 tx=0x7efd3c009cb0).stop 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.407+0000 7efd475ef700 1 -- 172.21.15.49:0/4246387804 shutdown_connections 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.407+0000 7efd475ef700 1 --2- 172.21.15.49:0/4246387804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd400f7990 0x7efd400f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.407+0000 7efd475ef700 1 --2- 172.21.15.49:0/4246387804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 0x7efd400f6b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.407+0000 7efd475ef700 1 -- 172.21.15.49:0/4246387804 >> 172.21.15.49:0/4246387804 conn(0x7efd400f1e50 msgr2=0x7efd400f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd475ef700 1 -- 172.21.15.49:0/4246387804 shutdown_connections 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd475ef700 1 -- 172.21.15.49:0/4246387804 wait complete. 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd475ef700 1 Processor -- start 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd475ef700 1 -- start start 2024-02-22T00:36:25.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd475ef700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 0x7efd40107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd475ef700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd400f7990 0x7efd40108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd475ef700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd40108a40 con 0x7efd400f66f0 2024-02-22T00:36:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd475ef700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd40108b80 con 0x7efd400f7990 2024-02-22T00:36:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.408+0000 7efd4538b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 0x7efd40107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd4538b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 0x7efd40107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44880/0 (socket says 172.21.15.49:44880) 2024-02-22T00:36:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd4538b700 1 -- 172.21.15.49:0/119550417 learned_addr learned my addr 172.21.15.49:0/119550417 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:25.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd44b8a700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd400f7990 0x7efd40108490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:25.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd4538b700 1 -- 172.21.15.49:0/119550417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd400f7990 msgr2=0x7efd40108490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd4538b700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd400f7990 0x7efd40108490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd4538b700 1 -- 172.21.15.49:0/119550417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c005040 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd4538b700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 0x7efd40107fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7efd3c013620 tx=0x7efd3c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd367fc700 1 -- 172.21.15.49:0/119550417 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3c00e070 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd367fc700 1 -- 172.21.15.49:0/119550417 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd3c007e90 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4010d5c0 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd367fc700 1 -- 172.21.15.49:0/119550417 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3c018070 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.409+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4010db80 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.410+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd400feed0 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.411+0000 7efd367fc700 1 -- 172.21.15.49:0/119550417 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 30) v1 ==== 90787+0+0 (secure 0 0 0) 0x7efd3c01d420 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.411+0000 7efd367fc700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7efd2c06c7c0 0x7efd2c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.411+0000 7efd367fc700 1 -- 172.21.15.49:0/119550417 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7efd3c08c650 con 0x7efd400f66f0 2024-02-22T00:36:25.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.411+0000 7efd44b8a700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7efd2c06c7c0 0x7efd2c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:25.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.412+0000 7efd44b8a700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7efd2c06c7c0 0x7efd2c06ec80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7efd30004de0 tx=0x7efd3000b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.416+0000 7efd367fc700 1 -- 172.21.15.49:0/119550417 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7efd3c05a530 con 0x7efd400f66f0 2024-02-22T00:36:25.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:25 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:24.650080+0000 mgr.smithi049.rjblpr (mgr.14674) 67 : audit [DBG] from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:25.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:24.650080+0000 mgr.smithi049.rjblpr (mgr.14674) 67 : audit [DBG] from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:25.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.696+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd4010e1c0 con 0x7efd400f66f0 2024-02-22T00:36:25.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.696+0000 7efd367fc700 1 -- 172.21.15.49:0/119550417 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+749 (secure 0 0 0) 0x7efd3c05a0c0 con 0x7efd400f66f0 2024-02-22T00:36:25.699 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:36:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:36:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:36:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:36:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:36:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:36:25.699 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 12, 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:36:25.700 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:36:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7efd2c06c7c0 msgr2=0x7efd2c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7efd2c06c7c0 0x7efd2c06ec80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7efd30004de0 tx=0x7efd3000b040).stop 2024-02-22T00:36:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 msgr2=0x7efd40107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 0x7efd40107fa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7efd3c013620 tx=0x7efd3c009cb0).stop 2024-02-22T00:36:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 shutdown_connections 2024-02-22T00:36:25.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7efd2c06c7c0 0x7efd2c06ec80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd400f66f0 0x7efd40107fa0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 --2- 172.21.15.49:0/119550417 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd400f7990 0x7efd40108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.698+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 >> 172.21.15.49:0/119550417 conn(0x7efd400f1e50 msgr2=0x7efd40060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:25.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.699+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 shutdown_connections 2024-02-22T00:36:25.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.699+0000 7efd475ef700 1 -- 172.21.15.49:0/119550417 wait complete. 2024-02-22T00:36:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.801+0000 7fe67039d700 1 -- 172.21.15.49:0/1873736583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f8cb0 msgr2=0x7fe6680f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.801+0000 7fe67039d700 1 --2- 172.21.15.49:0/1873736583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f8cb0 0x7fe6680f9110 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fe6580047f0 tx=0x7fe658009cb0).stop 2024-02-22T00:36:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.802+0000 7fe67039d700 1 -- 172.21.15.49:0/1873736583 shutdown_connections 2024-02-22T00:36:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.802+0000 7fe67039d700 1 --2- 172.21.15.49:0/1873736583 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f8cb0 0x7fe6680f9110 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.802+0000 7fe67039d700 1 --2- 172.21.15.49:0/1873736583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6680f7a10 0x7fe6680f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.802+0000 7fe67039d700 1 -- 172.21.15.49:0/1873736583 >> 172.21.15.49:0/1873736583 conn(0x7fe6680f3150 msgr2=0x7fe6680f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.802+0000 7fe67039d700 1 -- 172.21.15.49:0/1873736583 shutdown_connections 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.802+0000 7fe67039d700 1 -- 172.21.15.49:0/1873736583 wait complete. 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.802+0000 7fe67039d700 1 Processor -- start 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.802+0000 7fe67039d700 1 -- start start 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe67039d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f7a10 0x7fe66806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe67039d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6680f8cb0 0x7fe66806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe67039d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66806cf80 con 0x7fe6680f7a10 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe67039d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66806b520 con 0x7fe6680f8cb0 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66e139700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f7a10 0x7fe66806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66e139700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f7a10 0x7fe66806c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44898/0 (socket says 172.21.15.49:44898) 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66e139700 1 -- 172.21.15.49:0/4233805157 learned_addr learned my addr 172.21.15.49:0/4233805157 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:25.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66d938700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6680f8cb0 0x7fe66806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66e139700 1 -- 172.21.15.49:0/4233805157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6680f8cb0 msgr2=0x7fe66806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66e139700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6680f8cb0 0x7fe66806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66e139700 1 -- 172.21.15.49:0/4233805157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658005040 con 0x7fe6680f7a10 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66d938700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6680f8cb0 0x7fe66806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe66e139700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f7a10 0x7fe66806c9d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fe664002820 tx=0x7fe664009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe65f7fe700 1 -- 172.21.15.49:0/4233805157 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe664002d60 con 0x7fe6680f7a10 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe65f7fe700 1 -- 172.21.15.49:0/4233805157 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe66400f040 con 0x7fe6680f7a10 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66806b7a0 con 0x7fe6680f7a10 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.803+0000 7fe65f7fe700 1 -- 172.21.15.49:0/4233805157 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe66400d820 con 0x7fe6680f7a10 2024-02-22T00:36:25.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.804+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66806bd60 con 0x7fe6680f7a10 2024-02-22T00:36:25.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.804+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66805fb50 con 0x7fe6680f7a10 2024-02-22T00:36:25.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.805+0000 7fe65f7fe700 1 -- 172.21.15.49:0/4233805157 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 30) v1 ==== 90787+0+0 (secure 0 0 0) 0x7fe66400dae0 con 0x7fe6680f7a10 2024-02-22T00:36:25.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.805+0000 7fe65f7fe700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe65406c760 0x7fe65406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:25.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.806+0000 7fe65f7fe700 1 -- 172.21.15.49:0/4233805157 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fe66408b6a0 con 0x7fe6680f7a10 2024-02-22T00:36:25.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.806+0000 7fe66d938700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe65406c760 0x7fe65406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:25.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.806+0000 7fe66d938700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe65406c760 0x7fe65406ec20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe6580043d0 tx=0x7fe65800b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:25.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:25.810+0000 7fe65f7fe700 1 -- 172.21.15.49:0/4233805157 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fe664059580 con 0x7fe6680f7a10 2024-02-22T00:36:26.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.027+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe668102230 con 0x7fe65406c760 2024-02-22T00:36:26.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.028+0000 7fe65f7fe700 1 -- 172.21.15.49:0/4233805157 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fe658007e90 con 0x7fe65406c760 2024-02-22T00:36:26.030 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/2 daemons upgraded", 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:36:26.031 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe65406c760 msgr2=0x7fe65406ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe65406c760 0x7fe65406ec20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe6580043d0 tx=0x7fe65800b040).stop 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f7a10 msgr2=0x7fe66806c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f7a10 0x7fe66806c9d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fe664002820 tx=0x7fe664009f00).stop 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 shutdown_connections 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe65406c760 0x7fe65406ec20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe6680f7a10 0x7fe66806c9d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 --2- 172.21.15.49:0/4233805157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6680f8cb0 0x7fe66806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 >> 172.21.15.49:0/4233805157 conn(0x7fe6680f3150 msgr2=0x7fe6680fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 shutdown_connections 2024-02-22T00:36:26.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:26.030+0000 7fe67039d700 1 -- 172.21.15.49:0/4233805157 wait complete. 2024-02-22T00:36:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:24.978090+0000 mgr.smithi049.rjblpr (mgr.14674) 68 : audit [DBG] from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:25.297038+0000 mgr.smithi049.rjblpr (mgr.14674) 69 : audit [DBG] from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:25.568430+0000 mgr.smithi049.rjblpr (mgr.14674) 70 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:25.697698+0000 mon.smithi049 (mon.0) 850 : audit [DBG] from='client.? 172.21.15.49:0/119550417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:24.978090+0000 mgr.smithi049.rjblpr (mgr.14674) 68 : audit [DBG] from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:25.297038+0000 mgr.smithi049.rjblpr (mgr.14674) 69 : audit [DBG] from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:25.568430+0000 mgr.smithi049.rjblpr (mgr.14674) 70 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:25.697698+0000 mon.smithi049 (mon.0) 850 : audit [DBG] from='client.? 172.21.15.49:0/119550417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.029119+0000 mgr.smithi049.rjblpr (mgr.14674) 71 : audit [DBG] from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.785837+0000 mon.smithi049 (mon.0) 851 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.790513+0000 mon.smithi049 (mon.0) 852 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.791437+0000 mon.smithi049 (mon.0) 853 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.792333+0000 mon.smithi049 (mon.0) 854 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.796940+0000 mon.smithi049 (mon.0) 855 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.940189+0000 mon.smithi049 (mon.0) 856 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.943039+0000 mon.smithi049 (mon.0) 857 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.946052+0000 mon.smithi049 (mon.0) 858 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.409 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.947174+0000 mon.smithi049 (mon.0) 859 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.410 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.948236+0000 mon.smithi049 (mon.0) 860 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.410 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.949289+0000 mon.smithi049 (mon.0) 861 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.410 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.950333+0000 mon.smithi049 (mon.0) 862 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.410 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.951383+0000 mon.smithi049 (mon.0) 863 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.410 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.952531+0000 mon.smithi049 (mon.0) 864 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.410 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:27 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:26.953997+0000 mon.smithi049 (mon.0) 865 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.029119+0000 mgr.smithi049.rjblpr (mgr.14674) 71 : audit [DBG] from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.785837+0000 mon.smithi049 (mon.0) 851 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.790513+0000 mon.smithi049 (mon.0) 852 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.791437+0000 mon.smithi049 (mon.0) 853 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:36:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.792333+0000 mon.smithi049 (mon.0) 854 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.796940+0000 mon.smithi049 (mon.0) 855 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.940189+0000 mon.smithi049 (mon.0) 856 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.943039+0000 mon.smithi049 (mon.0) 857 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.946052+0000 mon.smithi049 (mon.0) 858 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.947174+0000 mon.smithi049 (mon.0) 859 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.948236+0000 mon.smithi049 (mon.0) 860 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.949289+0000 mon.smithi049 (mon.0) 861 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.950333+0000 mon.smithi049 (mon.0) 862 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.951383+0000 mon.smithi049 (mon.0) 863 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.952531+0000 mon.smithi049 (mon.0) 864 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:27.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:27 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:26.953997+0000 mon.smithi049 (mon.0) 865 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:28.368 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:27.568734+0000 mgr.smithi049.rjblpr (mgr.14674) 72 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:27.568734+0000 mgr.smithi049.rjblpr (mgr.14674) 72 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:29.321 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:28.422502+0000 mgr.smithi049.rjblpr (mgr.14674) 73 : cephadm [INF] Upgrade: Updating prometheus.smithi161 2024-02-22T00:36:29.322 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:28.665420+0000 mgr.smithi049.rjblpr (mgr.14674) 74 : cephadm [INF] Deploying daemon prometheus.smithi161 on smithi161 2024-02-22T00:36:29.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:28.422502+0000 mgr.smithi049.rjblpr (mgr.14674) 73 : cephadm [INF] Upgrade: Updating prometheus.smithi161 2024-02-22T00:36:29.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:28.665420+0000 mgr.smithi049.rjblpr (mgr.14674) 74 : cephadm [INF] Deploying daemon prometheus.smithi161 on smithi161 2024-02-22T00:36:30.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:29.569290+0000 mgr.smithi049.rjblpr (mgr.14674) 75 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:29.569290+0000 mgr.smithi049.rjblpr (mgr.14674) 75 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:32.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:31.569633+0000 mgr.smithi049.rjblpr (mgr.14674) 76 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:32.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:31.569633+0000 mgr.smithi049.rjblpr (mgr.14674) 76 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:34.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:33.570259+0000 mgr.smithi049.rjblpr (mgr.14674) 77 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:34.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:33.821439+0000 mon.smithi049 (mon.0) 866 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:34.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:33.826570+0000 mon.smithi049 (mon.0) 867 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:34.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:33.845434+0000 mon.smithi049 (mon.0) 868 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:34.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:33.570259+0000 mgr.smithi049.rjblpr (mgr.14674) 77 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:34.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:33.821439+0000 mon.smithi049 (mon.0) 866 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:34.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:33.826570+0000 mon.smithi049 (mon.0) 867 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:34.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:33.845434+0000 mon.smithi049 (mon.0) 868 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:36.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:35.570714+0000 mgr.smithi049.rjblpr (mgr.14674) 78 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:37.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:35.570714+0000 mgr.smithi049.rjblpr (mgr.14674) 78 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:37.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:36.653599+0000 mon.smithi049 (mon.0) 869 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:36:37.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:37.328146+0000 mon.smithi049 (mon.0) 870 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:37.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:37 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:37.333077+0000 mon.smithi049 (mon.0) 871 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:38.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:36.653599+0000 mon.smithi049 (mon.0) 869 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:36:38.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:37.328146+0000 mon.smithi049 (mon.0) 870 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:38.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:37.333077+0000 mon.smithi049 (mon.0) 871 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:38.762 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:37.571235+0000 mgr.smithi049.rjblpr (mgr.14674) 79 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:38.762 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:37.967679+0000 mon.smithi049 (mon.0) 872 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:38.762 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:37.973052+0000 mon.smithi049 (mon.0) 873 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:38.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:37.571235+0000 mgr.smithi049.rjblpr (mgr.14674) 79 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:38.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:37.967679+0000 mon.smithi049 (mon.0) 872 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:38.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:37.973052+0000 mon.smithi049 (mon.0) 873 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:40.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:40 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:39.571789+0000 mgr.smithi049.rjblpr (mgr.14674) 80 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:40.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:40 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:39.571789+0000 mgr.smithi049.rjblpr (mgr.14674) 80 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.200801+0000 mon.smithi049 (mon.0) 874 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.205650+0000 mon.smithi049 (mon.0) 875 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.206620+0000 mon.smithi049 (mon.0) 876 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.207510+0000 mon.smithi049 (mon.0) 877 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.212506+0000 mon.smithi049 (mon.0) 878 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.350326+0000 mon.smithi049 (mon.0) 879 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.350818+0000 mgr.smithi049.rjblpr (mgr.14674) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.356807+0000 mon.smithi049 (mon.0) 880 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.359735+0000 mon.smithi049 (mon.0) 881 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.500 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.362896+0000 mon.smithi049 (mon.0) 882 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.364041+0000 mon.smithi049 (mon.0) 883 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.365362+0000 mon.smithi049 (mon.0) 884 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.366470+0000 mon.smithi049 (mon.0) 885 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.367564+0000 mon.smithi049 (mon.0) 886 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.368683+0000 mon.smithi049 (mon.0) 887 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.369909+0000 mon.smithi049 (mon.0) 888 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.371473+0000 mon.smithi049 (mon.0) 889 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:41.372871+0000 mon.smithi049 (mon.0) 890 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.501 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:41.572167+0000 mgr.smithi049.rjblpr (mgr.14674) 82 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.200801+0000 mon.smithi049 (mon.0) 874 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.205650+0000 mon.smithi049 (mon.0) 875 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.206620+0000 mon.smithi049 (mon.0) 876 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.207510+0000 mon.smithi049 (mon.0) 877 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.212506+0000 mon.smithi049 (mon.0) 878 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.350326+0000 mon.smithi049 (mon.0) 879 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.350818+0000 mgr.smithi049.rjblpr (mgr.14674) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.356807+0000 mon.smithi049 (mon.0) 880 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.359735+0000 mon.smithi049 (mon.0) 881 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.362896+0000 mon.smithi049 (mon.0) 882 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.364041+0000 mon.smithi049 (mon.0) 883 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.365362+0000 mon.smithi049 (mon.0) 884 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.366470+0000 mon.smithi049 (mon.0) 885 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.367564+0000 mon.smithi049 (mon.0) 886 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.368683+0000 mon.smithi049 (mon.0) 887 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.369909+0000 mon.smithi049 (mon.0) 888 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.371473+0000 mon.smithi049 (mon.0) 889 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:41.372871+0000 mon.smithi049 (mon.0) 890 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:42.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:41.572167+0000 mgr.smithi049.rjblpr (mgr.14674) 82 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:44.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:42.940850+0000 mgr.smithi049.rjblpr (mgr.14674) 83 : cephadm [INF] Upgrade: Updating alertmanager.smithi049 2024-02-22T00:36:44.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:42.948405+0000 mgr.smithi049.rjblpr (mgr.14674) 84 : cephadm [INF] Deploying daemon alertmanager.smithi049 on smithi049 2024-02-22T00:36:44.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:43.572871+0000 mgr.smithi049.rjblpr (mgr.14674) 85 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:45.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:42.940850+0000 mgr.smithi049.rjblpr (mgr.14674) 83 : cephadm [INF] Upgrade: Updating alertmanager.smithi049 2024-02-22T00:36:45.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:42.948405+0000 mgr.smithi049.rjblpr (mgr.14674) 84 : cephadm [INF] Deploying daemon alertmanager.smithi049 on smithi049 2024-02-22T00:36:45.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:43.572871+0000 mgr.smithi049.rjblpr (mgr.14674) 85 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:45.573346+0000 mgr.smithi049.rjblpr (mgr.14674) 86 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:45.573346+0000 mgr.smithi049.rjblpr (mgr.14674) 86 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:48.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:47.573717+0000 mgr.smithi049.rjblpr (mgr.14674) 87 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:48.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:48.237955+0000 mon.smithi049 (mon.0) 891 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:48.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:48.241807+0000 mon.smithi049 (mon.0) 892 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:48.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:48.272626+0000 mon.smithi049 (mon.0) 893 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:48.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:47.573717+0000 mgr.smithi049.rjblpr (mgr.14674) 87 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:48.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:48.237955+0000 mon.smithi049 (mon.0) 891 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:48.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:48.241807+0000 mon.smithi049 (mon.0) 892 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:48.949 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:48.272626+0000 mon.smithi049 (mon.0) 893 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:50.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:49.573993+0000 mgr.smithi049.rjblpr (mgr.14674) 88 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:51.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:49.573993+0000 mgr.smithi049.rjblpr (mgr.14674) 88 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:52.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:51.574342+0000 mgr.smithi049.rjblpr (mgr.14674) 89 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:52.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:51.653706+0000 mon.smithi049 (mon.0) 894 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:36:52.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:51.913951+0000 mon.smithi049 (mon.0) 895 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:52.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:51.919615+0000 mon.smithi049 (mon.0) 896 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:52.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:52.518421+0000 mon.smithi049 (mon.0) 897 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:52.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:52.522506+0000 mon.smithi049 (mon.0) 898 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:51.574342+0000 mgr.smithi049.rjblpr (mgr.14674) 89 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:36:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:51.653706+0000 mon.smithi049 (mon.0) 894 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:36:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:51.913951+0000 mon.smithi049 (mon.0) 895 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:51.919615+0000 mon.smithi049 (mon.0) 896 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:53.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:52.518421+0000 mon.smithi049 (mon.0) 897 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:53.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:52.522506+0000 mon.smithi049 (mon.0) 898 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:53.210974+0000 mon.smithi049 (mon.0) 899 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:53.214980+0000 mon.smithi049 (mon.0) 900 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:54.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:53.529268+0000 mon.smithi049 (mon.0) 901 : cluster [DBG] mgrmap e31: smithi049.rjblpr(active, since 91s), standbys: smithi161.sazlam 2024-02-22T00:36:54.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:53.575024+0000 mgr.smithi049.rjblpr (mgr.14674) 90 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:36:54.640 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:53.210974+0000 mon.smithi049 (mon.0) 899 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:54.640 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:53.214980+0000 mon.smithi049 (mon.0) 900 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:54.641 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:53.529268+0000 mon.smithi049 (mon.0) 901 : cluster [DBG] mgrmap e31: smithi049.rjblpr(active, since 91s), standbys: smithi161.sazlam 2024-02-22T00:36:54.641 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:53.575024+0000 mgr.smithi049.rjblpr (mgr.14674) 90 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:36:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.139+0000 7f3ee4a57700 1 -- 172.21.15.49:0/509582619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 msgr2=0x7f3ee00f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.139+0000 7f3ee4a57700 1 --2- 172.21.15.49:0/509582619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 0x7f3ee00f7c00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f3ed00047f0 tx=0x7f3ed0009cb0).stop 2024-02-22T00:36:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.139+0000 7f3ee4a57700 1 -- 172.21.15.49:0/509582619 shutdown_connections 2024-02-22T00:36:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.139+0000 7f3ee4a57700 1 --2- 172.21.15.49:0/509582619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee00f8a80 0x7f3ee00f8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.139+0000 7f3ee4a57700 1 --2- 172.21.15.49:0/509582619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 0x7f3ee00f7c00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.139+0000 7f3ee4a57700 1 -- 172.21.15.49:0/509582619 >> 172.21.15.49:0/509582619 conn(0x7f3ee00f2f80 msgr2=0x7f3ee00f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.139+0000 7f3ee4a57700 1 -- 172.21.15.49:0/509582619 shutdown_connections 2024-02-22T00:36:56.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.139+0000 7f3ee4a57700 1 -- 172.21.15.49:0/509582619 wait complete. 2024-02-22T00:36:56.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ee4a57700 1 Processor -- start 2024-02-22T00:36:56.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ee4a57700 1 -- start start 2024-02-22T00:36:56.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ee4a57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 0x7f3ee0107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ee4a57700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee00f8a80 0x7f3ee0108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ee4a57700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee01089f0 con 0x7f3ee00f77e0 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ee4a57700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee0108b30 con 0x7f3ee00f8a80 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ede59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 0x7f3ee0107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ede59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 0x7f3ee0107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53820/0 (socket says 172.21.15.49:53820) 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.140+0000 7f3ede59c700 1 -- 172.21.15.49:0/555937430 learned_addr learned my addr 172.21.15.49:0/555937430 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3eddd9b700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee00f8a80 0x7f3ee0108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ede59c700 1 -- 172.21.15.49:0/555937430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee00f8a80 msgr2=0x7f3ee0108440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ede59c700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee00f8a80 0x7f3ee0108440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ede59c700 1 -- 172.21.15.49:0/555937430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0005040 con 0x7f3ee00f77e0 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ede59c700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 0x7f3ee0107f50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3ed0013620 tx=0x7f3ed0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ecf7fe700 1 -- 172.21.15.49:0/555937430 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ed000e070 con 0x7f3ee00f77e0 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ecf7fe700 1 -- 172.21.15.49:0/555937430 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ed0007e90 con 0x7f3ee00f77e0 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee0109470 con 0x7f3ee00f77e0 2024-02-22T00:36:56.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ecf7fe700 1 -- 172.21.15.49:0/555937430 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ed0018070 con 0x7f3ee00f77e0 2024-02-22T00:36:56.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.141+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee01099d0 con 0x7f3ee00f77e0 2024-02-22T00:36:56.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.142+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee0046ce0 con 0x7f3ee00f77e0 2024-02-22T00:36:56.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.143+0000 7f3ecf7fe700 1 -- 172.21.15.49:0/555937430 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f3ed001d420 con 0x7f3ee00f77e0 2024-02-22T00:36:56.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.143+0000 7f3ecf7fe700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f3ec806c6f0 0x7f3ec806ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.143+0000 7f3ecf7fe700 1 -- 172.21.15.49:0/555937430 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f3ed008c450 con 0x7f3ee00f77e0 2024-02-22T00:36:56.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.143+0000 7f3eddd9b700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f3ec806c6f0 0x7f3ec806ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:56.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.143+0000 7f3eddd9b700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f3ec806c6f0 0x7f3ec806ebb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3ed4009170 tx=0x7f3ed4009d60).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:56.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.148+0000 7f3ecf7fe700 1 -- 172.21.15.49:0/555937430 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f3ed005a550 con 0x7f3ee00f77e0 2024-02-22T00:36:56.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.381+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ee0101fd0 con 0x7f3ec806c6f0 2024-02-22T00:36:56.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.382+0000 7f3ecf7fe700 1 -- 172.21.15.49:0/555937430 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3ee0101fd0 con 0x7f3ec806c6f0 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f3ec806c6f0 msgr2=0x7f3ec806ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f3ec806c6f0 0x7f3ec806ebb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f3ed4009170 tx=0x7f3ed4009d60).stop 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 msgr2=0x7f3ee0107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 0x7f3ee0107f50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3ed0013620 tx=0x7f3ed0009cb0).stop 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 shutdown_connections 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f3ec806c6f0 0x7f3ec806ebb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ee00f77e0 0x7f3ee0107f50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 --2- 172.21.15.49:0/555937430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ee00f8a80 0x7f3ee0108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 >> 172.21.15.49:0/555937430 conn(0x7f3ee00f2f80 msgr2=0x7f3ee00fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 shutdown_connections 2024-02-22T00:36:56.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.384+0000 7f3ee4a57700 1 -- 172.21.15.49:0/555937430 wait complete. 2024-02-22T00:36:56.396 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:36:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.498+0000 7f64a4102700 1 -- 172.21.15.49:0/3838664371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c0fa940 msgr2=0x7f649c0fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.498+0000 7f64a4102700 1 --2- 172.21.15.49:0/3838664371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c0fa940 0x7f649c0fcd30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f648c0047f0 tx=0x7f648c009cb0).stop 2024-02-22T00:36:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.498+0000 7f64a4102700 1 -- 172.21.15.49:0/3838664371 shutdown_connections 2024-02-22T00:36:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.498+0000 7f64a4102700 1 --2- 172.21.15.49:0/3838664371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c0fa940 0x7f649c0fcd30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.498+0000 7f64a4102700 1 --2- 172.21.15.49:0/3838664371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f649c061790 0x7f649c0fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:36:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.498+0000 7f64a4102700 1 -- 172.21.15.49:0/3838664371 >> 172.21.15.49:0/3838664371 conn(0x7f649c0f1eb0 msgr2=0x7f649c0f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.498+0000 7f64a4102700 1 -- 172.21.15.49:0/3838664371 shutdown_connections 2024-02-22T00:36:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.498+0000 7f64a4102700 1 -- 172.21.15.49:0/3838664371 wait complete. 2024-02-22T00:36:56.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a4102700 1 Processor -- start 2024-02-22T00:36:56.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a4102700 1 -- start start 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a4102700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c061790 0x7f649c1080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a4102700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f649c0fa940 0x7f649c108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a4102700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c108bd0 con 0x7f649c061790 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a4102700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c108d10 con 0x7f649c0fa940 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a1e9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c061790 0x7f649c1080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a1e9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c061790 0x7f649c1080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53830/0 (socket says 172.21.15.49:53830) 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a1e9e700 1 -- 172.21.15.49:0/3251225243 learned_addr learned my addr 172.21.15.49:0/3251225243 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a169d700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f649c0fa940 0x7f649c108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a1e9e700 1 -- 172.21.15.49:0/3251225243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f649c0fa940 msgr2=0x7f649c108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a1e9e700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f649c0fa940 0x7f649c108590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a1e9e700 1 -- 172.21.15.49:0/3251225243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c005040 con 0x7f649c061790 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a169d700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f649c0fa940 0x7f649c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.499+0000 7f64a1e9e700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c061790 0x7f649c1080a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f649800b480 tx=0x7f64980090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.500+0000 7f6492ffd700 1 -- 172.21.15.49:0/3251225243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6498002500 con 0x7f649c061790 2024-02-22T00:36:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.500+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c10d7b0 con 0x7f649c061790 2024-02-22T00:36:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.500+0000 7f6492ffd700 1 -- 172.21.15.49:0/3251225243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6498002b10 con 0x7f649c061790 2024-02-22T00:36:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.500+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c10dcf0 con 0x7f649c061790 2024-02-22T00:36:56.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.500+0000 7f6492ffd700 1 -- 172.21.15.49:0/3251225243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6498012d60 con 0x7f649c061790 2024-02-22T00:36:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.501+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c100040 con 0x7f649c061790 2024-02-22T00:36:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.501+0000 7f6492ffd700 1 -- 172.21.15.49:0/3251225243 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f6498002660 con 0x7f649c061790 2024-02-22T00:36:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.502+0000 7f6492ffd700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f648806c6a0 0x7f648806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.502+0000 7f6492ffd700 1 -- 172.21.15.49:0/3251225243 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f649808b810 con 0x7f649c061790 2024-02-22T00:36:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.502+0000 7f64a169d700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f648806c6a0 0x7f648806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:56.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.502+0000 7f64a169d700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f648806c6a0 0x7f648806eb60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f648c0043d0 tx=0x7f648c00b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:56.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.508+0000 7f6492ffd700 1 -- 172.21.15.49:0/3251225243 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f6498059910 con 0x7f649c061790 2024-02-22T00:36:56.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.736+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f649c059120 con 0x7f648806c6a0 2024-02-22T00:36:56.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.737+0000 7f6492ffd700 1 -- 172.21.15.49:0/3251225243 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f649c059120 con 0x7f648806c6a0 2024-02-22T00:36:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f648806c6a0 msgr2=0x7f648806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f648806c6a0 0x7f648806eb60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f648c0043d0 tx=0x7f648c00b040).stop 2024-02-22T00:36:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c061790 msgr2=0x7f649c1080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c061790 0x7f649c1080a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f649800b480 tx=0x7f64980090f0).stop 2024-02-22T00:36:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 shutdown_connections 2024-02-22T00:36:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f648806c6a0 0x7f648806eb60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f649c061790 0x7f649c1080a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 --2- 172.21.15.49:0/3251225243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f649c0fa940 0x7f649c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 >> 172.21.15.49:0/3251225243 conn(0x7f649c0f1eb0 msgr2=0x7f649c0f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 shutdown_connections 2024-02-22T00:36:56.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.739+0000 7f64a4102700 1 -- 172.21.15.49:0/3251225243 wait complete. 2024-02-22T00:36:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.841+0000 7fad577a6700 1 -- 172.21.15.49:0/3461009476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad50061280 msgr2=0x7fad500fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.841+0000 7fad577a6700 1 --2- 172.21.15.49:0/3461009476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad50061280 0x7fad500fa3d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fad4c0047f0 tx=0x7fad4c009cb0).stop 2024-02-22T00:36:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.841+0000 7fad577a6700 1 -- 172.21.15.49:0/3461009476 shutdown_connections 2024-02-22T00:36:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.841+0000 7fad577a6700 1 --2- 172.21.15.49:0/3461009476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad500fa950 0x7fad500fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.841+0000 7fad577a6700 1 --2- 172.21.15.49:0/3461009476 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad50061280 0x7fad500fa3d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.841+0000 7fad577a6700 1 -- 172.21.15.49:0/3461009476 >> 172.21.15.49:0/3461009476 conn(0x7fad500f1e50 msgr2=0x7fad500f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad577a6700 1 -- 172.21.15.49:0/3461009476 shutdown_connections 2024-02-22T00:36:56.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad577a6700 1 -- 172.21.15.49:0/3461009476 wait complete. 2024-02-22T00:36:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad577a6700 1 Processor -- start 2024-02-22T00:36:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad577a6700 1 -- start start 2024-02-22T00:36:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad577a6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad50061280 0x7fad500f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad577a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad500fa950 0x7fad500f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad577a6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500f8220 con 0x7fad500fa950 2024-02-22T00:36:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad577a6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad500f67c0 con 0x7fad50061280 2024-02-22T00:36:56.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.842+0000 7fad54d41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad500fa950 0x7fad500f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad54d41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad500fa950 0x7fad500f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53858/0 (socket says 172.21.15.49:53858) 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad54d41700 1 -- 172.21.15.49:0/698833659 learned_addr learned my addr 172.21.15.49:0/698833659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad55542700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad50061280 0x7fad500f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad54d41700 1 -- 172.21.15.49:0/698833659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad50061280 msgr2=0x7fad500f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad54d41700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad50061280 0x7fad500f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad54d41700 1 -- 172.21.15.49:0/698833659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c005040 con 0x7fad500fa950 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad54d41700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad500fa950 0x7fad500f62d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fad40002780 tx=0x7fad40009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad467fc700 1 -- 172.21.15.49:0/698833659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad40007b40 con 0x7fad500fa950 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad467fc700 1 -- 172.21.15.49:0/698833659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad4000f040 con 0x7fad500fa950 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad500f6a40 con 0x7fad500fa950 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad467fc700 1 -- 172.21.15.49:0/698833659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad40014780 con 0x7fad500fa950 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.843+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad500f7000 con 0x7fad500fa950 2024-02-22T00:36:56.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.844+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad500fffe0 con 0x7fad500fa950 2024-02-22T00:36:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.845+0000 7fad467fc700 1 -- 172.21.15.49:0/698833659 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7fad40007ca0 con 0x7fad500fa950 2024-02-22T00:36:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.845+0000 7fad467fc700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fad3c06c6a0 0x7fad3c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.845+0000 7fad467fc700 1 -- 172.21.15.49:0/698833659 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fad4008b570 con 0x7fad500fa950 2024-02-22T00:36:56.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.845+0000 7fad55542700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fad3c06c6a0 0x7fad3c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:56.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.846+0000 7fad55542700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fad3c06c6a0 0x7fad3c06eb60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fad4c004f10 tx=0x7fad4c00b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:56.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:56.850+0000 7fad467fc700 1 -- 172.21.15.49:0/698833659 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fad40059670 con 0x7fad500fa950 2024-02-22T00:36:56.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:55.575302+0000 mgr.smithi049.rjblpr (mgr.14674) 91 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:36:56.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.289425+0000 mon.smithi049 (mon.0) 902 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.293371+0000 mon.smithi049 (mon.0) 903 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.294088+0000 mon.smithi049 (mon.0) 904 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.294704+0000 mon.smithi049 (mon.0) 905 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.298384+0000 mon.smithi049 (mon.0) 906 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.433307+0000 mon.smithi049 (mon.0) 907 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.439215+0000 mon.smithi049 (mon.0) 908 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.441373+0000 mon.smithi049 (mon.0) 909 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.443485+0000 mon.smithi049 (mon.0) 910 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.444424+0000 mon.smithi049 (mon.0) 911 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.445348+0000 mon.smithi049 (mon.0) 912 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.446246+0000 mon.smithi049 (mon.0) 913 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.447183+0000 mon.smithi049 (mon.0) 914 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.448131+0000 mon.smithi049 (mon.0) 915 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.449145+0000 mon.smithi049 (mon.0) 916 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.450335+0000 mon.smithi049 (mon.0) 917 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.451439+0000 mon.smithi049 (mon.0) 918 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:56.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.452586+0000 mon.smithi049 (mon.0) 919 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:55.575302+0000 mgr.smithi049.rjblpr (mgr.14674) 91 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.289425+0000 mon.smithi049 (mon.0) 902 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.293371+0000 mon.smithi049 (mon.0) 903 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.294088+0000 mon.smithi049 (mon.0) 904 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.294704+0000 mon.smithi049 (mon.0) 905 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.298384+0000 mon.smithi049 (mon.0) 906 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.433307+0000 mon.smithi049 (mon.0) 907 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.439215+0000 mon.smithi049 (mon.0) 908 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.441373+0000 mon.smithi049 (mon.0) 909 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.443485+0000 mon.smithi049 (mon.0) 910 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.444424+0000 mon.smithi049 (mon.0) 911 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.445348+0000 mon.smithi049 (mon.0) 912 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.446246+0000 mon.smithi049 (mon.0) 913 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.447183+0000 mon.smithi049 (mon.0) 914 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.448131+0000 mon.smithi049 (mon.0) 915 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.449145+0000 mon.smithi049 (mon.0) 916 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.450335+0000 mon.smithi049 (mon.0) 917 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.451439+0000 mon.smithi049 (mon.0) 918 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.452586+0000 mon.smithi049 (mon.0) 919 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:57.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.061+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad50059120 con 0x7fad3c06c6a0 2024-02-22T00:36:57.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.072+0000 7fad467fc700 1 -- 172.21.15.49:0/698833659 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fad50059120 con 0x7fad3c06c6a0 2024-02-22T00:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (9s) 4s ago 11m 16.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:36:57.074 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (11m) 4s ago 11m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (10m) 5s ago 10m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (2m) 4s ago 11m 46.2M - 8.3.5 dad864ee21e9 8d9bb59370a9 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (6m) 4s ago 6m 14.8M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (6m) 4s ago 6m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (6m) 5s ago 6m 14.8M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (6m) 5s ago 6m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (105s) 4s ago 12m 497M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (63s) 5s ago 10m 446M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (12m) 4s ago 12m 58.8M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (10m) 5s ago 10m 54.7M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (48s) 4s ago 11m 8627k - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:36:57.075 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (42s) 5s ago 10m 13.9M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (10m) 4s ago 10m 223M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (9m) 4s ago 9m 236M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (9m) 4s ago 9m 199M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (8m) 5s ago 8m 260M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (8m) 5s ago 8m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (7m) 5s ago 7m 221M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:36:57.076 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (23s) 5s ago 10m 44.1M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fad3c06c6a0 msgr2=0x7fad3c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fad3c06c6a0 0x7fad3c06eb60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fad4c004f10 tx=0x7fad4c00b040).stop 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad500fa950 msgr2=0x7fad500f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad500fa950 0x7fad500f62d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fad40002780 tx=0x7fad40009ee0).stop 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 shutdown_connections 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fad3c06c6a0 0x7fad3c06eb60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad50061280 0x7fad500f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 --2- 172.21.15.49:0/698833659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad500fa950 0x7fad500f62d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 >> 172.21.15.49:0/698833659 conn(0x7fad500f1e50 msgr2=0x7fad500f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:57.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 shutdown_connections 2024-02-22T00:36:57.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.074+0000 7fad577a6700 1 -- 172.21.15.49:0/698833659 wait complete. 2024-02-22T00:36:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.176+0000 7fe391a91700 1 -- 172.21.15.49:0/170295139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f8aa0 msgr2=0x7fe38c0f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.176+0000 7fe391a91700 1 --2- 172.21.15.49:0/170295139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f8aa0 0x7fe38c0f8f00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fe37c0047f0 tx=0x7fe37c009cb0).stop 2024-02-22T00:36:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.176+0000 7fe391a91700 1 -- 172.21.15.49:0/170295139 shutdown_connections 2024-02-22T00:36:57.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.176+0000 7fe391a91700 1 --2- 172.21.15.49:0/170295139 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f8aa0 0x7fe38c0f8f00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.176+0000 7fe391a91700 1 --2- 172.21.15.49:0/170295139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c0f7800 0x7fe38c0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.176+0000 7fe391a91700 1 -- 172.21.15.49:0/170295139 >> 172.21.15.49:0/170295139 conn(0x7fe38c0f2f80 msgr2=0x7fe38c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:57.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.176+0000 7fe391a91700 1 -- 172.21.15.49:0/170295139 shutdown_connections 2024-02-22T00:36:57.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.176+0000 7fe391a91700 1 -- 172.21.15.49:0/170295139 wait complete. 2024-02-22T00:36:57.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.177+0000 7fe391a91700 1 Processor -- start 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe391a91700 1 -- start start 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe391a91700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f7800 0x7fe38c105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe391a91700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c0f8aa0 0x7fe38c106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe391a91700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c106910 con 0x7fe38c0f7800 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe391a91700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c106a50 con 0x7fe38c0f8aa0 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe38b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f7800 0x7fe38c105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe38b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f7800 0x7fe38c105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53868/0 (socket says 172.21.15.49:53868) 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe38b7fe700 1 -- 172.21.15.49:0/1276284666 learned_addr learned my addr 172.21.15.49:0/1276284666 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe38affd700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c0f8aa0 0x7fe38c106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe38b7fe700 1 -- 172.21.15.49:0/1276284666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c0f8aa0 msgr2=0x7fe38c106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe38b7fe700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c0f8aa0 0x7fe38c106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe38b7fe700 1 -- 172.21.15.49:0/1276284666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c005040 con 0x7fe38c0f7800 2024-02-22T00:36:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.178+0000 7fe38b7fe700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f7800 0x7fe38c105e70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fe38000e910 tx=0x7fe38000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.179+0000 7fe388f74700 1 -- 172.21.15.49:0/1276284666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe380007b40 con 0x7fe38c0f7800 2024-02-22T00:36:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.179+0000 7fe388f74700 1 -- 172.21.15.49:0/1276284666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe38000f040 con 0x7fe38c0f7800 2024-02-22T00:36:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.179+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c10b4f0 con 0x7fe38c0f7800 2024-02-22T00:36:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.179+0000 7fe388f74700 1 -- 172.21.15.49:0/1276284666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe380014910 con 0x7fe38c0f7800 2024-02-22T00:36:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.179+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c10bab0 con 0x7fe38c0f7800 2024-02-22T00:36:57.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.180+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c0fffe0 con 0x7fe38c0f7800 2024-02-22T00:36:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.180+0000 7fe388f74700 1 -- 172.21.15.49:0/1276284666 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7fe380007ca0 con 0x7fe38c0f7800 2024-02-22T00:36:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.181+0000 7fe388f74700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe37406c6a0 0x7fe37406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.181+0000 7fe388f74700 1 -- 172.21.15.49:0/1276284666 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fe38008b140 con 0x7fe38c0f7800 2024-02-22T00:36:57.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.181+0000 7fe38affd700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe37406c6a0 0x7fe37406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:57.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.181+0000 7fe38affd700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe37406c6a0 0x7fe37406eb60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe37c0047c0 tx=0x7fe37c009cb0).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:57.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.186+0000 7fe388f74700 1 -- 172.21.15.49:0/1276284666 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fe380059240 con 0x7fe38c0f7800 2024-02-22T00:36:57.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.476+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe38c0fcf60 con 0x7fe38c0f7800 2024-02-22T00:36:57.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.476+0000 7fe388f74700 1 -- 172.21.15.49:0/1276284666 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+749 (secure 0 0 0) 0x7fe380058dd0 con 0x7fe38c0f7800 2024-02-22T00:36:57.479 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:36:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:36:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:36:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:36:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:36:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:36:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:36:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:36:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:36:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:36:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:36:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:36:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:36:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:36:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 12, 2024-02-22T00:36:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:36:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:36:57.481 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:36:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe37406c6a0 msgr2=0x7fe37406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe37406c6a0 0x7fe37406eb60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe37c0047c0 tx=0x7fe37c009cb0).stop 2024-02-22T00:36:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f7800 msgr2=0x7fe38c105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f7800 0x7fe38c105e70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fe38000e910 tx=0x7fe38000b040).stop 2024-02-22T00:36:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 shutdown_connections 2024-02-22T00:36:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fe37406c6a0 0x7fe37406eb60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe38c0f7800 0x7fe38c105e70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 --2- 172.21.15.49:0/1276284666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe38c0f8aa0 0x7fe38c106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 >> 172.21.15.49:0/1276284666 conn(0x7fe38c0f2f80 msgr2=0x7fe38c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.478+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 shutdown_connections 2024-02-22T00:36:57.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.479+0000 7fe391a91700 1 -- 172.21.15.49:0/1276284666 wait complete. 2024-02-22T00:36:57.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.582+0000 7fb56a649700 1 -- 172.21.15.49:0/749190217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f8cb0 msgr2=0x7fb5640f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.582+0000 7fb56a649700 1 --2- 172.21.15.49:0/749190217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f8cb0 0x7fb5640f9110 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fb5580047f0 tx=0x7fb558009cb0).stop 2024-02-22T00:36:57.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.582+0000 7fb56a649700 1 -- 172.21.15.49:0/749190217 shutdown_connections 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.582+0000 7fb56a649700 1 --2- 172.21.15.49:0/749190217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f8cb0 0x7fb5640f9110 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.582+0000 7fb56a649700 1 --2- 172.21.15.49:0/749190217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5640f7a10 0x7fb5640f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.582+0000 7fb56a649700 1 -- 172.21.15.49:0/749190217 >> 172.21.15.49:0/749190217 conn(0x7fb5640f3150 msgr2=0x7fb5640f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.582+0000 7fb56a649700 1 -- 172.21.15.49:0/749190217 shutdown_connections 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.582+0000 7fb56a649700 1 -- 172.21.15.49:0/749190217 wait complete. 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb56a649700 1 Processor -- start 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb56a649700 1 -- start start 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb56a649700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f7a10 0x7fb56406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb56a649700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5640f8cb0 0x7fb56406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb56a649700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56406cf80 con 0x7fb5640f7a10 2024-02-22T00:36:57.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb56a649700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56406b520 con 0x7fb5640f8cb0 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb563fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f7a10 0x7fb56406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb563fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f7a10 0x7fb56406c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53894/0 (socket says 172.21.15.49:53894) 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb563fff700 1 -- 172.21.15.49:0/4273478114 learned_addr learned my addr 172.21.15.49:0/4273478114 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb5637fe700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5640f8cb0 0x7fb56406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb563fff700 1 -- 172.21.15.49:0/4273478114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5640f8cb0 msgr2=0x7fb56406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb563fff700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5640f8cb0 0x7fb56406b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.583+0000 7fb563fff700 1 -- 172.21.15.49:0/4273478114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558005040 con 0x7fb5640f7a10 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.584+0000 7fb563fff700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f7a10 0x7fb56406c9d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fb554002820 tx=0x7fb554009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.584+0000 7fb5617fa700 1 -- 172.21.15.49:0/4273478114 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb554007b40 con 0x7fb5640f7a10 2024-02-22T00:36:57.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.584+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56406b7a0 con 0x7fb5640f7a10 2024-02-22T00:36:57.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.584+0000 7fb5617fa700 1 -- 172.21.15.49:0/4273478114 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb55400f040 con 0x7fb5640f7a10 2024-02-22T00:36:57.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.584+0000 7fb5617fa700 1 -- 172.21.15.49:0/4273478114 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb554014820 con 0x7fb5640f7a10 2024-02-22T00:36:57.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.584+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56406bd60 con 0x7fb5640f7a10 2024-02-22T00:36:57.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.585+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56405fb50 con 0x7fb5640f7a10 2024-02-22T00:36:57.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.586+0000 7fb5617fa700 1 -- 172.21.15.49:0/4273478114 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7fb554014ae0 con 0x7fb5640f7a10 2024-02-22T00:36:57.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.586+0000 7fb5617fa700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fb54c06c6a0 0x7fb54c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:36:57.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.586+0000 7fb5617fa700 1 -- 172.21.15.49:0/4273478114 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fb55408b6c0 con 0x7fb5640f7a10 2024-02-22T00:36:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.586+0000 7fb5637fe700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fb54c06c6a0 0x7fb54c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:36:57.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.587+0000 7fb5637fe700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fb54c06c6a0 0x7fb54c06eb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb558004f10 tx=0x7fb55800b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:36:57.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.591+0000 7fb5617fa700 1 -- 172.21.15.49:0/4273478114 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fb554059870 con 0x7fb5640f7a10 2024-02-22T00:36:57.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.810+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb564059120 con 0x7fb54c06c6a0 2024-02-22T00:36:57.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.811+0000 7fb5617fa700 1 -- 172.21.15.49:0/4273478114 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fb564059120 con 0x7fb54c06c6a0 2024-02-22T00:36:57.813 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:36:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:36:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:36:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-22T00:36:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:36:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-02-22T00:36:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:36:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/2 daemons upgraded", 2024-02-22T00:36:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading grafana daemons", 2024-02-22T00:36:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:36:57.814 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:36:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fb54c06c6a0 msgr2=0x7fb54c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fb54c06c6a0 0x7fb54c06eb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb558004f10 tx=0x7fb55800b040).stop 2024-02-22T00:36:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f7a10 msgr2=0x7fb56406c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:36:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f7a10 0x7fb56406c9d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fb554002820 tx=0x7fb554009f00).stop 2024-02-22T00:36:57.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 shutdown_connections 2024-02-22T00:36:57.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fb54c06c6a0 0x7fb54c06eb60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5640f7a10 0x7fb56406c9d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 --2- 172.21.15.49:0/4273478114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5640f8cb0 0x7fb56406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:36:57.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 >> 172.21.15.49:0/4273478114 conn(0x7fb5640f3150 msgr2=0x7fb5640fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:36:57.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 shutdown_connections 2024-02-22T00:36:57.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:36:57.813+0000 7fb56a649700 1 -- 172.21.15.49:0/4273478114 wait complete. 2024-02-22T00:36:57.888 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.382208+0000 mgr.smithi049.rjblpr (mgr.14674) 92 : audit [DBG] from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:57.888 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.433653+0000 mgr.smithi049.rjblpr (mgr.14674) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:36:57.888 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:57 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:57.477471+0000 mon.smithi049 (mon.0) 920 : audit [DBG] from='client.? 172.21.15.49:0/1276284666' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:58.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.382208+0000 mgr.smithi049.rjblpr (mgr.14674) 92 : audit [DBG] from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:58.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.433653+0000 mgr.smithi049.rjblpr (mgr.14674) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T00:36:58.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:57.477471+0000 mon.smithi049 (mon.0) 920 : audit [DBG] from='client.? 172.21.15.49:0/1276284666' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:36:58.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:56.737165+0000 mgr.smithi049.rjblpr (mgr.14674) 94 : audit [DBG] from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:58.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:57.063503+0000 mgr.smithi049.rjblpr (mgr.14674) 95 : audit [DBG] from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:58.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:57.575655+0000 mgr.smithi049.rjblpr (mgr.14674) 96 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:36:59.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:56.737165+0000 mgr.smithi049.rjblpr (mgr.14674) 94 : audit [DBG] from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:59.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:57.063503+0000 mgr.smithi049.rjblpr (mgr.14674) 95 : audit [DBG] from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:59.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:57.575655+0000 mgr.smithi049.rjblpr (mgr.14674) 96 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:36:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:36:57.812063+0000 mgr.smithi049.rjblpr (mgr.14674) 97 : audit [DBG] from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:36:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:57.924624+0000 mgr.smithi049.rjblpr (mgr.14674) 98 : cephadm [INF] Upgrade: Updating grafana.smithi049 2024-02-22T00:36:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:36:59 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:36:57.937388+0000 mgr.smithi049.rjblpr (mgr.14674) 99 : cephadm [INF] Deploying daemon grafana.smithi049 on smithi049 2024-02-22T00:37:00.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:36:57.812063+0000 mgr.smithi049.rjblpr (mgr.14674) 97 : audit [DBG] from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:00.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:57.924624+0000 mgr.smithi049.rjblpr (mgr.14674) 98 : cephadm [INF] Upgrade: Updating grafana.smithi049 2024-02-22T00:37:00.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:36:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:36:57.937388+0000 mgr.smithi049.rjblpr (mgr.14674) 99 : cephadm [INF] Deploying daemon grafana.smithi049 on smithi049 2024-02-22T00:37:00.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:36:59.575935+0000 mgr.smithi049.rjblpr (mgr.14674) 100 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:37:01.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:36:59.575935+0000 mgr.smithi049.rjblpr (mgr.14674) 100 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:37:02.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:01.576264+0000 mgr.smithi049.rjblpr (mgr.14674) 101 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:37:02.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:02.512898+0000 mon.smithi049 (mon.0) 921 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:02.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:02.517825+0000 mon.smithi049 (mon.0) 922 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:02.714 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:02.562491+0000 mon.smithi049 (mon.0) 923 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:03.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:01.576264+0000 mgr.smithi049.rjblpr (mgr.14674) 101 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:37:03.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:02.512898+0000 mon.smithi049 (mon.0) 921 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:02.517825+0000 mon.smithi049 (mon.0) 922 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:02.562491+0000 mon.smithi049 (mon.0) 923 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:04.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:04 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:03.576871+0000 mgr.smithi049.rjblpr (mgr.14674) 102 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:37:05.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:03.576871+0000 mgr.smithi049.rjblpr (mgr.14674) 102 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:37:06.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:06 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:05.577172+0000 mgr.smithi049.rjblpr (mgr.14674) 103 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:07.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:05.577172+0000 mgr.smithi049.rjblpr (mgr.14674) 103 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:06.653816+0000 mon.smithi049 (mon.0) 924 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:37:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:06.740666+0000 mon.smithi049 (mon.0) 925 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:06.744811+0000 mon.smithi049 (mon.0) 926 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:07.429938+0000 mon.smithi049 (mon.0) 927 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:07 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:07.433820+0000 mon.smithi049 (mon.0) 928 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:08.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:06.653816+0000 mon.smithi049 (mon.0) 924 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:37:08.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:06.740666+0000 mon.smithi049 (mon.0) 925 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:08.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:06.744811+0000 mon.smithi049 (mon.0) 926 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:08.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:07.429938+0000 mon.smithi049 (mon.0) 927 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:07.433820+0000 mon.smithi049 (mon.0) 928 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:08.836 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:07.577531+0000 mgr.smithi049.rjblpr (mgr.14674) 104 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:09.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:07.577531+0000 mgr.smithi049.rjblpr (mgr.14674) 104 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:09.577892+0000 mgr.smithi049.rjblpr (mgr.14674) 105 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.558054+0000 mon.smithi049 (mon.0) 929 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.562189+0000 mon.smithi049 (mon.0) 930 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.562963+0000 mon.smithi049 (mon.0) 931 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.563648+0000 mon.smithi049 (mon.0) 932 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:10 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.567451+0000 mon.smithi049 (mon.0) 933 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:11.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:09.577892+0000 mgr.smithi049.rjblpr (mgr.14674) 105 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:11.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.558054+0000 mon.smithi049 (mon.0) 929 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:11.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.562189+0000 mon.smithi049 (mon.0) 930 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:11.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.562963+0000 mon.smithi049 (mon.0) 931 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:11.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.563648+0000 mon.smithi049 (mon.0) 932 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:11.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.567451+0000 mon.smithi049 (mon.0) 933 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:11.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.702432+0000 mon.smithi049 (mon.0) 934 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:37:11.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.708176+0000 mon.smithi049 (mon.0) 935 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:11.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.710407+0000 mon.smithi049 (mon.0) 936 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.712535+0000 mon.smithi049 (mon.0) 937 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.713403+0000 mon.smithi049 (mon.0) 938 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.714236+0000 mon.smithi049 (mon.0) 939 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.715109+0000 mon.smithi049 (mon.0) 940 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.715970+0000 mon.smithi049 (mon.0) 941 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.716821+0000 mon.smithi049 (mon.0) 942 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.717728+0000 mon.smithi049 (mon.0) 943 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.718835+0000 mon.smithi049 (mon.0) 944 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.719868+0000 mon.smithi049 (mon.0) 945 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.720913+0000 mon.smithi049 (mon.0) 946 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.721994+0000 mon.smithi049 (mon.0) 947 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.722952+0000 mon.smithi049 (mon.0) 948 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.723939+0000 mon.smithi049 (mon.0) 949 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:11.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.728955+0000 mon.smithi049 (mon.0) 950 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.730524+0000 mon.smithi049 (mon.0) 951 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.733898+0000 mon.smithi049 (mon.0) 952 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.734524+0000 mon.smithi049 (mon.0) 953 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.737512+0000 mon.smithi049 (mon.0) 954 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.738052+0000 mon.smithi049 (mon.0) 955 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.738541+0000 mon.smithi049 (mon.0) 956 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.739002+0000 mon.smithi049 (mon.0) 957 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.739486+0000 mon.smithi049 (mon.0) 958 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.742544+0000 mon.smithi049 (mon.0) 959 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.743122+0000 mon.smithi049 (mon.0) 960 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-22T00:37:11.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.746165+0000 mon.smithi049 (mon.0) 961 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-22T00:37:11.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.746729+0000 mon.smithi049 (mon.0) 962 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:11.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.747246+0000 mon.smithi049 (mon.0) 963 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-22T00:37:11.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.750289+0000 mon.smithi049 (mon.0) 964 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-22T00:37:11.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.750868+0000 mon.smithi049 (mon.0) 965 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-22T00:37:11.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.753629+0000 mon.smithi049 (mon.0) 966 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-22T00:37:11.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.754213+0000 mon.smithi049 (mon.0) 967 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-22T00:37:11.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.757034+0000 mon.smithi049 (mon.0) 968 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-22T00:37:11.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.757620+0000 mon.smithi049 (mon.0) 969 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-22T00:37:11.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.762599+0000 mon.smithi049 (mon.0) 970 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-22T00:37:11.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.763190+0000 mon.smithi049 (mon.0) 971 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:11.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.763681+0000 mon.smithi049 (mon.0) 972 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:11.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.764146+0000 mon.smithi049 (mon.0) 973 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.764603+0000 mon.smithi049 (mon.0) 974 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.765044+0000 mon.smithi049 (mon.0) 975 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.765511+0000 mon.smithi049 (mon.0) 976 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.765970+0000 mon.smithi049 (mon.0) 977 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.768975+0000 mon.smithi049 (mon.0) 978 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.769820+0000 mon.smithi049 (mon.0) 979 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.771800+0000 mon.smithi049 (mon.0) 980 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.772137+0000 mon.smithi049 (mon.0) 981 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:11.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.773419+0000 mon.smithi049 (mon.0) 982 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:11.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.773978+0000 mon.smithi049 (mon.0) 983 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:11.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.777633+0000 mon.smithi049 (mon.0) 984 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:11.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.915455+0000 mon.smithi049 (mon.0) 985 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:11.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.916853+0000 mon.smithi049 (mon.0) 986 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:11.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.917469+0000 mon.smithi049 (mon.0) 987 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:11.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:11 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.922175+0000 mon.smithi049 (mon.0) 988 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:12.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.702432+0000 mon.smithi049 (mon.0) 934 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:37:12.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.708176+0000 mon.smithi049 (mon.0) 935 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:12.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.710407+0000 mon.smithi049 (mon.0) 936 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.712535+0000 mon.smithi049 (mon.0) 937 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.713403+0000 mon.smithi049 (mon.0) 938 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.714236+0000 mon.smithi049 (mon.0) 939 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.715109+0000 mon.smithi049 (mon.0) 940 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.715970+0000 mon.smithi049 (mon.0) 941 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.716821+0000 mon.smithi049 (mon.0) 942 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.717728+0000 mon.smithi049 (mon.0) 943 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.718835+0000 mon.smithi049 (mon.0) 944 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.719868+0000 mon.smithi049 (mon.0) 945 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.720913+0000 mon.smithi049 (mon.0) 946 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.721994+0000 mon.smithi049 (mon.0) 947 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.722952+0000 mon.smithi049 (mon.0) 948 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.723939+0000 mon.smithi049 (mon.0) 949 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.728955+0000 mon.smithi049 (mon.0) 950 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.730524+0000 mon.smithi049 (mon.0) 951 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.733898+0000 mon.smithi049 (mon.0) 952 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.734524+0000 mon.smithi049 (mon.0) 953 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.737512+0000 mon.smithi049 (mon.0) 954 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.738052+0000 mon.smithi049 (mon.0) 955 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.738541+0000 mon.smithi049 (mon.0) 956 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.739002+0000 mon.smithi049 (mon.0) 957 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.739486+0000 mon.smithi049 (mon.0) 958 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.742544+0000 mon.smithi049 (mon.0) 959 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.743122+0000 mon.smithi049 (mon.0) 960 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.746165+0000 mon.smithi049 (mon.0) 961 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.746729+0000 mon.smithi049 (mon.0) 962 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:12.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.747246+0000 mon.smithi049 (mon.0) 963 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.750289+0000 mon.smithi049 (mon.0) 964 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.750868+0000 mon.smithi049 (mon.0) 965 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.753629+0000 mon.smithi049 (mon.0) 966 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.754213+0000 mon.smithi049 (mon.0) 967 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.757034+0000 mon.smithi049 (mon.0) 968 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.757620+0000 mon.smithi049 (mon.0) 969 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.762599+0000 mon.smithi049 (mon.0) 970 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.763190+0000 mon.smithi049 (mon.0) 971 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.763681+0000 mon.smithi049 (mon.0) 972 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.764146+0000 mon.smithi049 (mon.0) 973 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.764603+0000 mon.smithi049 (mon.0) 974 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.765044+0000 mon.smithi049 (mon.0) 975 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:12.047 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.765511+0000 mon.smithi049 (mon.0) 976 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.765970+0000 mon.smithi049 (mon.0) 977 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.768975+0000 mon.smithi049 (mon.0) 978 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.769820+0000 mon.smithi049 (mon.0) 979 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.771800+0000 mon.smithi049 (mon.0) 980 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.772137+0000 mon.smithi049 (mon.0) 981 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.773419+0000 mon.smithi049 (mon.0) 982 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.773978+0000 mon.smithi049 (mon.0) 983 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.777633+0000 mon.smithi049 (mon.0) 984 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.915455+0000 mon.smithi049 (mon.0) 985 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.916853+0000 mon.smithi049 (mon.0) 986 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.917469+0000 mon.smithi049 (mon.0) 987 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:12.048 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.922175+0000 mon.smithi049 (mon.0) 988 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:12.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:10.702781+0000 mgr.smithi049.rjblpr (mgr.14674) 106 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:37:12.954 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:37:10.724487+0000 mgr.smithi049.rjblpr (mgr.14674) 107 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-22T00:37:12.954 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:37:10.769447+0000 mgr.smithi049.rjblpr (mgr.14674) 108 : cephadm [INF] Upgrade: Complete! 2024-02-22T00:37:12.954 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:11.578295+0000 mgr.smithi049.rjblpr (mgr.14674) 109 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:12.955 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:12 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:11.666851+0000 mon.smithi049 (mon.0) 989 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:13.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:10.702781+0000 mgr.smithi049.rjblpr (mgr.14674) 106 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-22T00:37:13.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:37:10.724487+0000 mgr.smithi049.rjblpr (mgr.14674) 107 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-22T00:37:13.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:37:10.769447+0000 mgr.smithi049.rjblpr (mgr.14674) 108 : cephadm [INF] Upgrade: Complete! 2024-02-22T00:37:13.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:11.578295+0000 mgr.smithi049.rjblpr (mgr.14674) 109 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:13.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:11.666851+0000 mon.smithi049 (mon.0) 989 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:14.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:14 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:13.578764+0000 mgr.smithi049.rjblpr (mgr.14674) 110 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:15.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:13.578764+0000 mgr.smithi049.rjblpr (mgr.14674) 110 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:16.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:15 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:15.579204+0000 mgr.smithi049.rjblpr (mgr.14674) 111 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:16.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:15.579204+0000 mgr.smithi049.rjblpr (mgr.14674) 111 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:18.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:18 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:17.579852+0000 mgr.smithi049.rjblpr (mgr.14674) 112 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:19.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:17.579852+0000 mgr.smithi049.rjblpr (mgr.14674) 112 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:20.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:20 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:19.580389+0000 mgr.smithi049.rjblpr (mgr.14674) 113 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:21.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:19.580389+0000 mgr.smithi049.rjblpr (mgr.14674) 113 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:22.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:21.580769+0000 mgr.smithi049.rjblpr (mgr.14674) 114 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:22.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:22 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:21.654563+0000 mon.smithi049 (mon.0) 990 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:37:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:21.580769+0000 mgr.smithi049.rjblpr (mgr.14674) 114 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:23.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:21.654563+0000 mon.smithi049 (mon.0) 990 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:37:23.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:22.647171+0000 mon.smithi049 (mon.0) 991 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:37:24.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:22.647171+0000 mon.smithi049 (mon.0) 991 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:37:24.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:23.581390+0000 mgr.smithi049.rjblpr (mgr.14674) 115 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:25.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:23.581390+0000 mgr.smithi049.rjblpr (mgr.14674) 115 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:26.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:25.581917+0000 mgr.smithi049.rjblpr (mgr.14674) 116 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:27.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:26 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:25.581917+0000 mgr.smithi049.rjblpr (mgr.14674) 116 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:27.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.930+0000 7f12fad09700 1 -- 172.21.15.49:0/1518292917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406cbd0 msgr2=0x7f12f406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:27.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.930+0000 7f12fad09700 1 --2- 172.21.15.49:0/1518292917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406cbd0 0x7f12f406b0d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f12e40047f0 tx=0x7f12e4009cb0).stop 2024-02-22T00:37:27.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.930+0000 7f12fad09700 1 -- 172.21.15.49:0/1518292917 shutdown_connections 2024-02-22T00:37:27.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.930+0000 7f12fad09700 1 --2- 172.21.15.49:0/1518292917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f406b5c0 0x7f12f406ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.930+0000 7f12fad09700 1 --2- 172.21.15.49:0/1518292917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406cbd0 0x7f12f406b0d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.930+0000 7f12fad09700 1 -- 172.21.15.49:0/1518292917 >> 172.21.15.49:0/1518292917 conn(0x7f12f40f3150 msgr2=0x7f12f40f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.930+0000 7f12fad09700 1 -- 172.21.15.49:0/1518292917 shutdown_connections 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.930+0000 7f12fad09700 1 -- 172.21.15.49:0/1518292917 wait complete. 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12fad09700 1 Processor -- start 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12fad09700 1 -- start start 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12fad09700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406b5c0 0x7f12f410a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12fad09700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f406cbd0 0x7f12f410a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12fad09700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f410ae70 con 0x7f12f406b5c0 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12fad09700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f410afb0 con 0x7f12f406cbd0 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12f8aa5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406b5c0 0x7f12f410a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12f8aa5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406b5c0 0x7f12f410a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40574/0 (socket says 172.21.15.49:40574) 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12f8aa5700 1 -- 172.21.15.49:0/2534392814 learned_addr learned my addr 172.21.15.49:0/2534392814 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:27.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.931+0000 7f12f3fff700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f406cbd0 0x7f12f410a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12f8aa5700 1 -- 172.21.15.49:0/2534392814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f406cbd0 msgr2=0x7f12f410a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12f8aa5700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f406cbd0 0x7f12f410a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12f8aa5700 1 -- 172.21.15.49:0/2534392814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e4005040 con 0x7f12f406b5c0 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12f3fff700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f406cbd0 0x7f12f410a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12f8aa5700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406b5c0 0x7f12f410a3d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f12e4013620 tx=0x7f12e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12f1ffb700 1 -- 172.21.15.49:0/2534392814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12e400e030 con 0x7f12f406b5c0 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12f1ffb700 1 -- 172.21.15.49:0/2534392814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f12e4007e90 con 0x7f12f406b5c0 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f410f9f0 con 0x7f12f406b5c0 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12f1ffb700 1 -- 172.21.15.49:0/2534392814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12e4018070 con 0x7f12f406b5c0 2024-02-22T00:37:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.932+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f410ffb0 con 0x7f12f406b5c0 2024-02-22T00:37:27.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.933+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f405fb50 con 0x7f12f406b5c0 2024-02-22T00:37:27.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.934+0000 7f12f1ffb700 1 -- 172.21.15.49:0/2534392814 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f12e401d420 con 0x7f12f406b5c0 2024-02-22T00:37:27.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.934+0000 7f12f1ffb700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12dc06c6b0 0x7f12dc06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:27.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.934+0000 7f12f1ffb700 1 -- 172.21.15.49:0/2534392814 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f12e408cc50 con 0x7f12f406b5c0 2024-02-22T00:37:27.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.934+0000 7f12f3fff700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12dc06c6b0 0x7f12dc06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:27.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.935+0000 7f12f3fff700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12dc06c6b0 0x7f12dc06eb70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f12e8009250 tx=0x7f12e8009da0).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:27.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:27.939+0000 7f12f1ffb700 1 -- 172.21.15.49:0/2534392814 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f12e405ad50 con 0x7f12f406b5c0 2024-02-22T00:37:28.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.155+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12f4059120 con 0x7f12dc06c6b0 2024-02-22T00:37:28.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.156+0000 7f12f1ffb700 1 -- 172.21.15.49:0/2534392814 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f12f4059120 con 0x7f12dc06c6b0 2024-02-22T00:37:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12dc06c6b0 msgr2=0x7f12dc06eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12dc06c6b0 0x7f12dc06eb70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f12e8009250 tx=0x7f12e8009da0).stop 2024-02-22T00:37:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406b5c0 msgr2=0x7f12f410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406b5c0 0x7f12f410a3d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f12e4013620 tx=0x7f12e4009cb0).stop 2024-02-22T00:37:28.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 shutdown_connections 2024-02-22T00:37:28.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f12dc06c6b0 0x7f12dc06eb70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:28.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f12f406b5c0 0x7f12f410a3d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:28.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 --2- 172.21.15.49:0/2534392814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12f406cbd0 0x7f12f410a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:28.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 >> 172.21.15.49:0/2534392814 conn(0x7f12f40f3150 msgr2=0x7f12f40fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:28.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 shutdown_connections 2024-02-22T00:37:28.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:28.158+0000 7f12fad09700 1 -- 172.21.15.49:0/2534392814 wait complete. 2024-02-22T00:37:28.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:27.582361+0000 mgr.smithi049.rjblpr (mgr.14674) 117 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:28.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-22T00:37:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:28 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:27.582361+0000 mgr.smithi049.rjblpr (mgr.14674) 117 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:29.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:29 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:28.157059+0000 mgr.smithi049.rjblpr (mgr.14674) 118 : audit [DBG] from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:29 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:28.157059+0000 mgr.smithi049.rjblpr (mgr.14674) 118 : audit [DBG] from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.856+0000 7f684e70e700 1 -- 172.21.15.49:0/3098017290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fd8f0 msgr2=0x7f68480fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.856+0000 7f684e70e700 1 --2- 172.21.15.49:0/3098017290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fd8f0 0x7f68480fdcd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f68380047f0 tx=0x7f6838009cb0).stop 2024-02-22T00:37:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.856+0000 7f684e70e700 1 -- 172.21.15.49:0/3098017290 shutdown_connections 2024-02-22T00:37:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.856+0000 7f684e70e700 1 --2- 172.21.15.49:0/3098017290 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68480fe250 0x7f68480f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.856+0000 7f684e70e700 1 --2- 172.21.15.49:0/3098017290 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fd8f0 0x7f68480fdcd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.856+0000 7f684e70e700 1 -- 172.21.15.49:0/3098017290 >> 172.21.15.49:0/3098017290 conn(0x7f68480f34b0 msgr2=0x7f68480f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.856+0000 7f684e70e700 1 -- 172.21.15.49:0/3098017290 shutdown_connections 2024-02-22T00:37:30.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.856+0000 7f684e70e700 1 -- 172.21.15.49:0/3098017290 wait complete. 2024-02-22T00:37:30.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.857+0000 7f684e70e700 1 Processor -- start 2024-02-22T00:37:30.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.857+0000 7f684e70e700 1 -- start start 2024-02-22T00:37:30.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.857+0000 7f684e70e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68480fd8f0 0x7f684810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.857+0000 7f684e70e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fe250 0x7f684810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f684e70e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684810ead0 con 0x7f68480fe250 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f684e70e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684810ec10 con 0x7f68480fd8f0 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fe250 0x7f684810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fe250 0x7f684810e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40602/0 (socket says 172.21.15.49:40602) 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68477fe700 1 -- 172.21.15.49:0/2832669317 learned_addr learned my addr 172.21.15.49:0/2832669317 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f6847fff700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68480fd8f0 0x7f684810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68477fe700 1 -- 172.21.15.49:0/2832669317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68480fd8f0 msgr2=0x7f684810dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68477fe700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68480fd8f0 0x7f684810dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68477fe700 1 -- 172.21.15.49:0/2832669317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838005040 con 0x7f68480fe250 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68477fe700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fe250 0x7f684810e4d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f683c002780 tx=0x7f683c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68457fa700 1 -- 172.21.15.49:0/2832669317 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683c007b40 con 0x7f68480fe250 2024-02-22T00:37:30.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68481082a0 con 0x7f68480fe250 2024-02-22T00:37:30.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68457fa700 1 -- 172.21.15.49:0/2832669317 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f683c00f040 con 0x7f68480fe250 2024-02-22T00:37:30.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f68457fa700 1 -- 172.21.15.49:0/2832669317 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683c014780 con 0x7f68480fe250 2024-02-22T00:37:30.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.858+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6848108860 con 0x7f68480fe250 2024-02-22T00:37:30.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.859+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684805f590 con 0x7f68480fe250 2024-02-22T00:37:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.860+0000 7f68457fa700 1 -- 172.21.15.49:0/2832669317 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f683c007ca0 con 0x7f68480fe250 2024-02-22T00:37:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.860+0000 7f68457fa700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f683006c6b0 0x7f683006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.860+0000 7f68457fa700 1 -- 172.21.15.49:0/2832669317 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f683c08b710 con 0x7f68480fe250 2024-02-22T00:37:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.860+0000 7f6847fff700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f683006c6b0 0x7f683006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:30.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.861+0000 7f6847fff700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f683006c6b0 0x7f683006eb70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6838004f10 tx=0x7f6838009cb0).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:30.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:30.865+0000 7f68457fa700 1 -- 172.21.15.49:0/2832669317 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f683c059750 con 0x7f68480fe250 2024-02-22T00:37:30.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:29.582823+0000 mgr.smithi049.rjblpr (mgr.14674) 119 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:31.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:30 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:29.582823+0000 mgr.smithi049.rjblpr (mgr.14674) 119 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.146+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6848047540 con 0x7f68480fe250 2024-02-22T00:37:31.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.147+0000 7f68457fa700 1 -- 172.21.15.49:0/2832669317 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+749 (secure 0 0 0) 0x7f683c0592e0 con 0x7f68480fe250 2024-02-22T00:37:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f683006c6b0 msgr2=0x7f683006eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f683006c6b0 0x7f683006eb70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6838004f10 tx=0x7f6838009cb0).stop 2024-02-22T00:37:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fe250 msgr2=0x7f684810e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fe250 0x7f684810e4d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f683c002780 tx=0x7f683c009ee0).stop 2024-02-22T00:37:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 shutdown_connections 2024-02-22T00:37:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f683006c6b0 0x7f683006eb70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68480fd8f0 0x7f684810dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 --2- 172.21.15.49:0/2832669317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68480fe250 0x7f684810e4d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 >> 172.21.15.49:0/2832669317 conn(0x7f68480f34b0 msgr2=0x7f68480fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 shutdown_connections 2024-02-22T00:37:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:31.149+0000 7f684e70e700 1 -- 172.21.15.49:0/2832669317 wait complete. 2024-02-22T00:37:31.161 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:37:31.768 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:31 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:31.147206+0000 mon.smithi049 (mon.0) 992 : audit [DBG] from='client.? 172.21.15.49:0/2832669317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:31.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-22T00:37:32.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:31 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:31.147206+0000 mon.smithi049 (mon.0) 992 : audit [DBG] from='client.? 172.21.15.49:0/2832669317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:32.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:32 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:31.583201+0000 mgr.smithi049.rjblpr (mgr.14674) 120 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:33.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:32 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:31.583201+0000 mgr.smithi049.rjblpr (mgr.14674) 120 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:33.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.715+0000 7f8b78a67700 1 -- 172.21.15.49:0/3832108692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 msgr2=0x7f8b74101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.715+0000 7f8b78a67700 1 --2- 172.21.15.49:0/3832108692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 0x7f8b74101910 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8b680047f0 tx=0x7f8b68009cb0).stop 2024-02-22T00:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.715+0000 7f8b78a67700 1 -- 172.21.15.49:0/3832108692 shutdown_connections 2024-02-22T00:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.715+0000 7f8b78a67700 1 --2- 172.21.15.49:0/3832108692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 0x7f8b74101910 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.715+0000 7f8b78a67700 1 --2- 172.21.15.49:0/3832108692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b740f88a0 0x7f8b740f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.715+0000 7f8b78a67700 1 -- 172.21.15.49:0/3832108692 >> 172.21.15.49:0/3832108692 conn(0x7f8b74070590 msgr2=0x7f8b740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.715+0000 7f8b78a67700 1 -- 172.21.15.49:0/3832108692 shutdown_connections 2024-02-22T00:37:33.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.715+0000 7f8b78a67700 1 -- 172.21.15.49:0/3832108692 wait complete. 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.716+0000 7f8b78a67700 1 Processor -- start 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.716+0000 7f8b78a67700 1 -- start start 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.716+0000 7f8b78a67700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b740f88a0 0x7f8b7410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.716+0000 7f8b78a67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 0x7f8b7410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.716+0000 7f8b78a67700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7410eb70 con 0x7f8b740f9200 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.716+0000 7f8b78a67700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7410ecb0 con 0x7f8b740f88a0 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b71d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 0x7f8b7410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b71d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 0x7f8b7410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57264/0 (socket says 172.21.15.49:57264) 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b71d9b700 1 -- 172.21.15.49:0/3898460628 learned_addr learned my addr 172.21.15.49:0/3898460628 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b7259c700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b740f88a0 0x7f8b7410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b71d9b700 1 -- 172.21.15.49:0/3898460628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b740f88a0 msgr2=0x7f8b7410e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:33.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b71d9b700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b740f88a0 0x7f8b7410e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b71d9b700 1 -- 172.21.15.49:0/3898460628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b68005040 con 0x7f8b740f9200 2024-02-22T00:37:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b7259c700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b740f88a0 0x7f8b7410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:37:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b71d9b700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 0x7f8b7410e570 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f8b6800b120 tx=0x7f8b68009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b637fe700 1 -- 172.21.15.49:0/3898460628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b6800e030 con 0x7f8b740f9200 2024-02-22T00:37:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b741082e0 con 0x7f8b740f9200 2024-02-22T00:37:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b637fe700 1 -- 172.21.15.49:0/3898460628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b68007e90 con 0x7f8b740f9200 2024-02-22T00:37:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b637fe700 1 -- 172.21.15.49:0/3898460628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b68018070 con 0x7f8b740f9200 2024-02-22T00:37:33.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.717+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b741087c0 con 0x7f8b740f9200 2024-02-22T00:37:33.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.718+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7405f590 con 0x7f8b740f9200 2024-02-22T00:37:33.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.719+0000 7f8b637fe700 1 -- 172.21.15.49:0/3898460628 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f8b6801d420 con 0x7f8b740f9200 2024-02-22T00:37:33.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.719+0000 7f8b637fe700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f8b5c06c6a0 0x7f8b5c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:33.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.719+0000 7f8b637fe700 1 -- 172.21.15.49:0/3898460628 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f8b6808cc40 con 0x7f8b740f9200 2024-02-22T00:37:33.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.719+0000 7f8b7259c700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f8b5c06c6a0 0x7f8b5c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:33.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.720+0000 7f8b7259c700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f8b5c06c6a0 0x7f8b5c06eb60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8b64004b80 tx=0x7f8b64009040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:33.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:33.724+0000 7f8b637fe700 1 -- 172.21.15.49:0/3898460628 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f8b6805ad40 con 0x7f8b740f9200 2024-02-22T00:37:34.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.007+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b74047540 con 0x7f8b740f9200 2024-02-22T00:37:34.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.008+0000 7f8b637fe700 1 -- 172.21.15.49:0/3898460628 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+749 (secure 0 0 0) 0x7f8b6805a8d0 con 0x7f8b740f9200 2024-02-22T00:37:34.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f8b5c06c6a0 msgr2=0x7f8b5c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:34.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f8b5c06c6a0 0x7f8b5c06eb60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f8b64004b80 tx=0x7f8b64009040).stop 2024-02-22T00:37:34.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 msgr2=0x7f8b7410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:34.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 0x7f8b7410e570 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f8b6800b120 tx=0x7f8b68009cb0).stop 2024-02-22T00:37:34.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 shutdown_connections 2024-02-22T00:37:34.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f8b5c06c6a0 0x7f8b5c06eb60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b740f88a0 0x7f8b7410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 --2- 172.21.15.49:0/3898460628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b740f9200 0x7f8b7410e570 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 >> 172.21.15.49:0/3898460628 conn(0x7f8b74070590 msgr2=0x7f8b740fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 shutdown_connections 2024-02-22T00:37:34.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:34.010+0000 7f8b78a67700 1 -- 172.21.15.49:0/3898460628 wait complete. 2024-02-22T00:37:34.023 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)" 2024-02-22T00:37:34.634 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-22T00:37:34.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:33.583643+0000 mgr.smithi049.rjblpr (mgr.14674) 121 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:34.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:34 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:34.008861+0000 mon.smithi049 (mon.0) 993 : audit [DBG] from='client.? 172.21.15.49:0/3898460628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:35.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:33.583643+0000 mgr.smithi049.rjblpr (mgr.14674) 121 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:35.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:34 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:34.008861+0000 mon.smithi049 (mon.0) 993 : audit [DBG] from='client.? 172.21.15.49:0/3898460628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:35.885 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:34.678909+0000 mon.smithi049 (mon.0) 994 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:37:36.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:35 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:34.678909+0000 mon.smithi049 (mon.0) 994 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:37:36.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.389+0000 7f6eca63c700 1 -- 172.21.15.49:0/2747360168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 msgr2=0x7f6ec4101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:36.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.389+0000 7f6eca63c700 1 --2- 172.21.15.49:0/2747360168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 0x7f6ec4101910 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f6eb80047f0 tx=0x7f6eb8009cb0).stop 2024-02-22T00:37:36.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.389+0000 7f6eca63c700 1 -- 172.21.15.49:0/2747360168 shutdown_connections 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.389+0000 7f6eca63c700 1 --2- 172.21.15.49:0/2747360168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 0x7f6ec4101910 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.389+0000 7f6eca63c700 1 --2- 172.21.15.49:0/2747360168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40f88a0 0x7f6ec40f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.389+0000 7f6eca63c700 1 -- 172.21.15.49:0/2747360168 >> 172.21.15.49:0/2747360168 conn(0x7f6ec4070590 msgr2=0x7f6ec40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.389+0000 7f6eca63c700 1 -- 172.21.15.49:0/2747360168 shutdown_connections 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.389+0000 7f6eca63c700 1 -- 172.21.15.49:0/2747360168 wait complete. 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6eca63c700 1 Processor -- start 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6eca63c700 1 -- start start 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6eca63c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40f88a0 0x7f6ec410e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6eca63c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 0x7f6ec410e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6eca63c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec410eb80 con 0x7f6ec40f9200 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6eca63c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec410ecc0 con 0x7f6ec40f88a0 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6ec37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 0x7f6ec410e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:36.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6ec37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 0x7f6ec410e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57294/0 (socket says 172.21.15.49:57294) 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6ec37fe700 1 -- 172.21.15.49:0/3469865592 learned_addr learned my addr 172.21.15.49:0/3469865592 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.390+0000 7f6ec3fff700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40f88a0 0x7f6ec410e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6ec37fe700 1 -- 172.21.15.49:0/3469865592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40f88a0 msgr2=0x7f6ec410e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6ec37fe700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40f88a0 0x7f6ec410e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6ec37fe700 1 -- 172.21.15.49:0/3469865592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8005040 con 0x7f6ec40f9200 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6ec37fe700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 0x7f6ec410e580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f6eb8005010 tx=0x7f6eb8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6ec17fa700 1 -- 172.21.15.49:0/3469865592 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb800e030 con 0x7f6ec40f9200 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6ec17fa700 1 -- 172.21.15.49:0/3469865592 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6eb8007e90 con 0x7f6ec40f9200 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec41082f0 con 0x7f6ec40f9200 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6ec17fa700 1 -- 172.21.15.49:0/3469865592 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb8018070 con 0x7f6ec40f9200 2024-02-22T00:37:36.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.391+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec41087d0 con 0x7f6ec40f9200 2024-02-22T00:37:36.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.392+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec405f590 con 0x7f6ec40f9200 2024-02-22T00:37:36.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.392+0000 7f6ec17fa700 1 -- 172.21.15.49:0/3469865592 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f6eb801d6e0 con 0x7f6ec40f9200 2024-02-22T00:37:36.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.393+0000 7f6ec17fa700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6eac06c630 0x7f6eac06eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:36.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.393+0000 7f6ec17fa700 1 -- 172.21.15.49:0/3469865592 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f6eb808ca00 con 0x7f6ec40f9200 2024-02-22T00:37:36.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.393+0000 7f6ec3fff700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6eac06c630 0x7f6eac06eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:36.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.393+0000 7f6ec3fff700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6eac06c630 0x7f6eac06eaf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6eb4009170 tx=0x7f6eb4009da0).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:36.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.397+0000 7f6ec17fa700 1 -- 172.21.15.49:0/3469865592 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f6eb805ab00 con 0x7f6ec40f9200 2024-02-22T00:37:36.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.679+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ec4047540 con 0x7f6ec40f9200 2024-02-22T00:37:36.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.679+0000 7f6ec17fa700 1 -- 172.21.15.49:0/3469865592 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+749 (secure 0 0 0) 0x7f6eb805a690 con 0x7f6ec40f9200 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.681+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6eac06c630 msgr2=0x7f6eac06eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.681+0000 7f6eca63c700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6eac06c630 0x7f6eac06eaf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6eb4009170 tx=0x7f6eb4009da0).stop 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.681+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 msgr2=0x7f6ec410e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.681+0000 7f6eca63c700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 0x7f6ec410e580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f6eb8005010 tx=0x7f6eb8009cb0).stop 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.682+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 shutdown_connections 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.682+0000 7f6eca63c700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f6eac06c630 0x7f6eac06eaf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.682+0000 7f6eca63c700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40f88a0 0x7f6ec410e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.682+0000 7f6eca63c700 1 --2- 172.21.15.49:0/3469865592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec40f9200 0x7f6ec410e580 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:36.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.682+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 >> 172.21.15.49:0/3469865592 conn(0x7f6ec4070590 msgr2=0x7f6ec40fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:36.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.682+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 shutdown_connections 2024-02-22T00:37:36.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:36.682+0000 7f6eca63c700 1 -- 172.21.15.49:0/3469865592 wait complete. 2024-02-22T00:37:36.696 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:37:37.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:35.583973+0000 mgr.smithi049.rjblpr (mgr.14674) 122 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:37.003 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:36.654336+0000 mon.smithi049 (mon.0) 995 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:37:37.004 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:36 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:36.680750+0000 mon.smithi049 (mon.0) 996 : audit [DBG] from='client.? 172.21.15.49:0/3469865592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:37.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:35.583973+0000 mgr.smithi049.rjblpr (mgr.14674) 122 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:37.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:36.654336+0000 mon.smithi049 (mon.0) 995 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:37:37.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:36 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:36.680750+0000 mon.smithi049 (mon.0) 996 : audit [DBG] from='client.? 172.21.15.49:0/3469865592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:37:37.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-22T00:37:38.841 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:38 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:37.584360+0000 mgr.smithi049.rjblpr (mgr.14674) 123 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:39.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:38 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:37.584360+0000 mgr.smithi049.rjblpr (mgr.14674) 123 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.067+0000 7f98edcbe700 1 -- 172.21.15.49:0/4064082451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 msgr2=0x7f98e80f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.067+0000 7f98edcbe700 1 --2- 172.21.15.49:0/4064082451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 0x7f98e80f6960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f98d80047f0 tx=0x7f98d8009cb0).stop 2024-02-22T00:37:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.067+0000 7f98edcbe700 1 -- 172.21.15.49:0/4064082451 shutdown_connections 2024-02-22T00:37:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.067+0000 7f98edcbe700 1 --2- 172.21.15.49:0/4064082451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 0x7f98e80f6960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.067+0000 7f98edcbe700 1 --2- 172.21.15.49:0/4064082451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e80fc820 0x7f98e80fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:37:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.067+0000 7f98edcbe700 1 -- 172.21.15.49:0/4064082451 >> 172.21.15.49:0/4064082451 conn(0x7f98e80f2400 msgr2=0x7f98e80f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.067+0000 7f98edcbe700 1 -- 172.21.15.49:0/4064082451 shutdown_connections 2024-02-22T00:37:39.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.067+0000 7f98edcbe700 1 -- 172.21.15.49:0/4064082451 wait complete. 2024-02-22T00:37:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.068+0000 7f98edcbe700 1 Processor -- start 2024-02-22T00:37:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.068+0000 7f98edcbe700 1 -- start start 2024-02-22T00:37:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98edcbe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e80fc820 0x7f98e8109200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98edcbe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 0x7f98e81096f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:39.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98edcbe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8109c70 con 0x7f98e80fd180 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98edcbe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8109db0 con 0x7f98e80fc820 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 0x7f98e81096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 0x7f98e81096f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57314/0 (socket says 172.21.15.49:57314) 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e6ffd700 1 -- 172.21.15.49:0/3084314524 learned_addr learned my addr 172.21.15.49:0/3084314524 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e77fe700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e80fc820 0x7f98e8109200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e6ffd700 1 -- 172.21.15.49:0/3084314524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e80fc820 msgr2=0x7f98e8109200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e6ffd700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e80fc820 0x7f98e8109200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e6ffd700 1 -- 172.21.15.49:0/3084314524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8005040 con 0x7f98e80fd180 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e6ffd700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 0x7f98e81096f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f98d80099f0 tx=0x7f98d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e4ff9700 1 -- 172.21.15.49:0/3084314524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d800e030 con 0x7f98e80fd180 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e4ff9700 1 -- 172.21.15.49:0/3084314524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98d8007e90 con 0x7f98e80fd180 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e810a000 con 0x7f98e80fd180 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98e4ff9700 1 -- 172.21.15.49:0/3084314524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d8018070 con 0x7f98e80fd180 2024-02-22T00:37:39.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.069+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e8112540 con 0x7f98e80fd180 2024-02-22T00:37:39.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.070+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e805f510 con 0x7f98e80fd180 2024-02-22T00:37:39.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.071+0000 7f98e4ff9700 1 -- 172.21.15.49:0/3084314524 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f98d801d420 con 0x7f98e80fd180 2024-02-22T00:37:39.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.072+0000 7f98e4ff9700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f98d406c6a0 0x7f98d406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:39.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.072+0000 7f98e77fe700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f98d406c6a0 0x7f98d406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:39.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.072+0000 7f98e4ff9700 1 -- 172.21.15.49:0/3084314524 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f98d808cab0 con 0x7f98e80fd180 2024-02-22T00:37:39.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.072+0000 7f98e77fe700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f98d406c6a0 0x7f98d406eb60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f98d0006fd0 tx=0x7f98d0009060).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:39.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.076+0000 7f98e4ff9700 1 -- 172.21.15.49:0/3084314524 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f98d8057120 con 0x7f98e80fd180 2024-02-22T00:37:39.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:39.290+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e8059120 con 0x7f98d406c6a0 2024-02-22T00:37:40.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:39.292029+0000 mgr.smithi049.rjblpr (mgr.14674) 124 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:40.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:39 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:39.584782+0000 mgr.smithi049.rjblpr (mgr.14674) 125 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:40.110 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:39.292029+0000 mgr.smithi049.rjblpr (mgr.14674) 124 : audit [DBG] from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:40.110 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:39 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:39.584782+0000 mgr.smithi049.rjblpr (mgr.14674) 125 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:40.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.759+0000 7f98e4ff9700 1 -- 172.21.15.49:0/3084314524 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7f98e8059120 con 0x7f98d406c6a0 2024-02-22T00:37:40.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f98d406c6a0 msgr2=0x7f98d406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:40.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f98d406c6a0 0x7f98d406eb60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f98d0006fd0 tx=0x7f98d0009060).stop 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 msgr2=0x7f98e81096f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 0x7f98e81096f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f98d80099f0 tx=0x7f98d8009cb0).stop 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 shutdown_connections 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f98d406c6a0 0x7f98d406eb60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98e80fc820 0x7f98e8109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 --2- 172.21.15.49:0/3084314524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f98e80fd180 0x7f98e81096f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 >> 172.21.15.49:0/3084314524 conn(0x7f98e80f2400 msgr2=0x7f98e80fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 shutdown_connections 2024-02-22T00:37:40.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:40.762+0000 7f98edcbe700 1 -- 172.21.15.49:0/3084314524 wait complete. 2024-02-22T00:37:40.776 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:37:41.355 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph orch ps' 2024-02-22T00:37:42.754 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:41.585084+0000 mgr.smithi049.rjblpr (mgr.14674) 126 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:43.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:41.585084+0000 mgr.smithi049.rjblpr (mgr.14674) 126 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:43.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.277+0000 7fd7fd317700 1 -- 172.21.15.49:0/762256574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 msgr2=0x7fd7f80fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.277+0000 7fd7fd317700 1 --2- 172.21.15.49:0/762256574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 0x7fd7f80fdcb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fd7e80047f0 tx=0x7fd7e8009cb0).stop 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.277+0000 7fd7fd317700 1 -- 172.21.15.49:0/762256574 shutdown_connections 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.277+0000 7fd7fd317700 1 --2- 172.21.15.49:0/762256574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f80fe230 0x7fd7f80f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.277+0000 7fd7fd317700 1 --2- 172.21.15.49:0/762256574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 0x7fd7f80fdcb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.277+0000 7fd7fd317700 1 -- 172.21.15.49:0/762256574 >> 172.21.15.49:0/762256574 conn(0x7fd7f806cea0 msgr2=0x7fd7f806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.277+0000 7fd7fd317700 1 -- 172.21.15.49:0/762256574 shutdown_connections 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.277+0000 7fd7fd317700 1 -- 172.21.15.49:0/762256574 wait complete. 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.278+0000 7fd7fd317700 1 Processor -- start 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.278+0000 7fd7fd317700 1 -- start start 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.278+0000 7fd7fd317700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 0x7fd7f80f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.278+0000 7fd7fd317700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f80fe230 0x7fd7f80f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:43.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.278+0000 7fd7fd317700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80f7c30 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.278+0000 7fd7fd317700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80f7d70 con 0x7fd7f80fe230 2024-02-22T00:37:43.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 0x7fd7f80f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:43.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 0x7fd7f80f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35616/0 (socket says 172.21.15.49:35616) 2024-02-22T00:37:43.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f6ffd700 1 -- 172.21.15.49:0/1939854047 learned_addr learned my addr 172.21.15.49:0/1939854047 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f67fc700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f80fe230 0x7fd7f80f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:43.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f6ffd700 1 -- 172.21.15.49:0/1939854047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f80fe230 msgr2=0x7fd7f80f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f6ffd700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f80fe230 0x7fd7f80f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f6ffd700 1 -- 172.21.15.49:0/1939854047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8005040 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f67fc700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f80fe230 0x7fd7f80f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7f6ffd700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 0x7fd7f80f7250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fd7e800b120 tx=0x7fd7e8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7dffff700 1 -- 172.21.15.49:0/1939854047 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7e800e030 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7dffff700 1 -- 172.21.15.49:0/1939854047 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd7e8007e90 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7dffff700 1 -- 172.21.15.49:0/1939854047 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7e8018070 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f80f7fc0 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.279+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f8114740 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.280+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f8047540 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.281+0000 7fd7dffff700 1 -- 172.21.15.49:0/1939854047 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7fd7e801d420 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.281+0000 7fd7dffff700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fd7e006c6a0 0x7fd7e006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:43.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.281+0000 7fd7dffff700 1 -- 172.21.15.49:0/1939854047 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fd7e808cb60 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.281+0000 7fd7f67fc700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fd7e006c6a0 0x7fd7e006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:43.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.282+0000 7fd7f67fc700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fd7e006c6a0 0x7fd7e006eb60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd7f80f89f0 tx=0x7fd7ec008040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:43.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.286+0000 7fd7dffff700 1 -- 172.21.15.49:0/1939854047 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fd7e80571d0 con 0x7fd7f80fd8d0 2024-02-22T00:37:43.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.493+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f80f8150 con 0x7fd7e006c6a0 2024-02-22T00:37:43.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.503+0000 7fd7dffff700 1 -- 172.21.15.49:0/1939854047 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd7f80f8150 con 0x7fd7e006c6a0 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (56s) 36s ago 12m 16.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (12m) 36s ago 12m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (11m) 51s ago 11m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (41s) 36s ago 11m 37.9M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (6m) 36s ago 6m 14.9M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (7m) 36s ago 7m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (6m) 51s ago 6m 14.8M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (6m) 51s ago 6m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (2m) 36s ago 13m 497M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (109s) 51s ago 11m 446M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (13m) 36s ago 13m 60.0M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (11m) 51s ago 11m 54.7M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:37:43.506 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (95s) 36s ago 11m 8858k - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:37:43.507 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (89s) 51s ago 11m 13.9M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:37:43.507 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (10m) 36s ago 10m 223M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:37:43.507 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (10m) 36s ago 10m 236M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:37:43.507 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (9m) 36s ago 9m 198M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:37:43.507 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (9m) 51s ago 9m 260M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:37:43.507 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (8m) 51s ago 8m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:37:43.507 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (8m) 51s ago 8m 221M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:37:43.507 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (70s) 51s ago 11m 44.1M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fd7e006c6a0 msgr2=0x7fd7e006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fd7e006c6a0 0x7fd7e006eb60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd7f80f89f0 tx=0x7fd7ec008040).stop 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 msgr2=0x7fd7f80f7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 0x7fd7f80f7250 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fd7e800b120 tx=0x7fd7e8009cb0).stop 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 shutdown_connections 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7fd7e006c6a0 0x7fd7e006eb60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7f80fd8d0 0x7fd7f80f7250 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 --2- 172.21.15.49:0/1939854047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f80fe230 0x7fd7f80f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:43.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.505+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 >> 172.21.15.49:0/1939854047 conn(0x7fd7f806cea0 msgr2=0x7fd7f8100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.506+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 shutdown_connections 2024-02-22T00:37:43.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:43.506+0000 7fd7fd317700 1 -- 172.21.15.49:0/1939854047 wait complete. 2024-02-22T00:37:44.217 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-22T00:37:44.218 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:37:44.218 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-22T00:37:44.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:43.495503+0000 mgr.smithi049.rjblpr (mgr.14674) 127 : audit [DBG] from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:44.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:43.585554+0000 mgr.smithi049.rjblpr (mgr.14674) 128 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:45.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:43.495503+0000 mgr.smithi049.rjblpr (mgr.14674) 127 : audit [DBG] from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:45.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:44 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:43.585554+0000 mgr.smithi049.rjblpr (mgr.14674) 128 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 -- 172.21.15.49:0/3319409334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 msgr2=0x7f74a00fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 --2- 172.21.15.49:0/3319409334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 0x7f74a00fcbd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f74900047f0 tx=0x7f7490009cb0).stop 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 -- 172.21.15.49:0/3319409334 shutdown_connections 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 --2- 172.21.15.49:0/3319409334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74a00fd150 0x7f74a00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 --2- 172.21.15.49:0/3319409334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 0x7f74a00fcbd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 -- 172.21.15.49:0/3319409334 >> 172.21.15.49:0/3319409334 conn(0x7f74a0070590 msgr2=0x7f74a00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 -- 172.21.15.49:0/3319409334 shutdown_connections 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 -- 172.21.15.49:0/3319409334 wait complete. 2024-02-22T00:37:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 Processor -- start 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.019+0000 7f74a669e700 1 -- start start 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f74a669e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 0x7f74a00f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f74a669e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74a00fd150 0x7f74a00f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f74a669e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00f8f20 con 0x7f74a00fc7f0 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f74a669e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00f9060 con 0x7f74a00fd150 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 0x7f74a00f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 0x7f74a00f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35624/0 (socket says 172.21.15.49:35624) 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749ffff700 1 -- 172.21.15.49:0/4252427429 learned_addr learned my addr 172.21.15.49:0/4252427429 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749f7fe700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74a00fd150 0x7f74a00f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749ffff700 1 -- 172.21.15.49:0/4252427429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74a00fd150 msgr2=0x7f74a00f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749ffff700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74a00fd150 0x7f74a00f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749ffff700 1 -- 172.21.15.49:0/4252427429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490005040 con 0x7f74a00fc7f0 2024-02-22T00:37:46.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749f7fe700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74a00fd150 0x7f74a00f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:37:46.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.020+0000 7f749ffff700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 0x7f74a00f8540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f749000b120 tx=0x7f7490009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:46.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.021+0000 7f749d7fa700 1 -- 172.21.15.49:0/4252427429 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f749000e030 con 0x7f74a00fc7f0 2024-02-22T00:37:46.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.021+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a00f92b0 con 0x7f74a00fc7f0 2024-02-22T00:37:46.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.021+0000 7f749d7fa700 1 -- 172.21.15.49:0/4252427429 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7490007e90 con 0x7f74a00fc7f0 2024-02-22T00:37:46.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.021+0000 7f749d7fa700 1 -- 172.21.15.49:0/4252427429 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7490018070 con 0x7f74a00fc7f0 2024-02-22T00:37:46.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.021+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a01145d0 con 0x7f74a00fc7f0 2024-02-22T00:37:46.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.022+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a005f590 con 0x7f74a00fc7f0 2024-02-22T00:37:46.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.022+0000 7f749d7fa700 1 -- 172.21.15.49:0/4252427429 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f749001d420 con 0x7f74a00fc7f0 2024-02-22T00:37:46.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.022+0000 7f749d7fa700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f748806c6a0 0x7f748806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:46.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.023+0000 7f749d7fa700 1 -- 172.21.15.49:0/4252427429 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f749008cc00 con 0x7f74a00fc7f0 2024-02-22T00:37:46.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.023+0000 7f749f7fe700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f748806c6a0 0x7f748806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:46.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.023+0000 7f749f7fe700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f748806c6a0 0x7f748806eb60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f74a00f9ce0 tx=0x7f7494009040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:46.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.027+0000 7f749d7fa700 1 -- 172.21.15.49:0/4252427429 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f7490092020 con 0x7f74a00fc7f0 2024-02-22T00:37:46.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.223+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f74a0047540 con 0x7f74a00fc7f0 2024-02-22T00:37:46.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.227+0000 7f749d7fa700 1 -- 172.21.15.49:0/4252427429 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v49)=0 v49) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7490057270 con 0x7f74a00fc7f0 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.229+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f748806c6a0 msgr2=0x7f748806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.229+0000 7f74a669e700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f748806c6a0 0x7f748806eb60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f74a00f9ce0 tx=0x7f7494009040).stop 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 msgr2=0x7f74a00f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 0x7f74a00f8540 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f749000b120 tx=0x7f7490009cb0).stop 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 shutdown_connections 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f748806c6a0 0x7f748806eb60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f74a00fc7f0 0x7f74a00f8540 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 --2- 172.21.15.49:0/4252427429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74a00fd150 0x7f74a00f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:46.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 >> 172.21.15.49:0/4252427429 conn(0x7f74a0070590 msgr2=0x7f74a0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 shutdown_connections 2024-02-22T00:37:46.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:46.230+0000 7f74a669e700 1 -- 172.21.15.49:0/4252427429 wait complete. 2024-02-22T00:37:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:45.585968+0000 mgr.smithi049.rjblpr (mgr.14674) 129 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:46.228673+0000 mon.smithi049 (mon.0) 997 : audit [INF] from='client.? 172.21.15.49:0/4252427429' entity='client.admin' 2024-02-22T00:37:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:46.251142+0000 mon.smithi049 (mon.0) 998 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:46.617362+0000 mon.smithi049 (mon.0) 999 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:46.618072+0000 mon.smithi049 (mon.0) 1000 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:46 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:46.622525+0000 mon.smithi049 (mon.0) 1001 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:46.961 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-22T00:37:46.961 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:37:46.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-22T00:37:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:45.585968+0000 mgr.smithi049.rjblpr (mgr.14674) 129 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:46.228673+0000 mon.smithi049 (mon.0) 997 : audit [INF] from='client.? 172.21.15.49:0/4252427429' entity='client.admin' 2024-02-22T00:37:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:46.251142+0000 mon.smithi049 (mon.0) 998 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:46.617362+0000 mon.smithi049 (mon.0) 999 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:46.618072+0000 mon.smithi049 (mon.0) 1000 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:46 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:46.622525+0000 mon.smithi049 (mon.0) 1001 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.745+0000 7f9caa5ab700 1 -- 172.21.15.49:0/3221603810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 msgr2=0x7f9ca40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.745+0000 7f9caa5ab700 1 --2- 172.21.15.49:0/3221603810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 0x7f9ca40fcbd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f9c940047f0 tx=0x7f9c94009cb0).stop 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.745+0000 7f9caa5ab700 1 -- 172.21.15.49:0/3221603810 shutdown_connections 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.745+0000 7f9caa5ab700 1 --2- 172.21.15.49:0/3221603810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40fd150 0x7f9ca40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.745+0000 7f9caa5ab700 1 --2- 172.21.15.49:0/3221603810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 0x7f9ca40fcbd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.745+0000 7f9caa5ab700 1 -- 172.21.15.49:0/3221603810 >> 172.21.15.49:0/3221603810 conn(0x7f9ca4070590 msgr2=0x7f9ca40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.745+0000 7f9caa5ab700 1 -- 172.21.15.49:0/3221603810 shutdown_connections 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.746+0000 7f9caa5ab700 1 -- 172.21.15.49:0/3221603810 wait complete. 2024-02-22T00:37:48.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.746+0000 7f9caa5ab700 1 Processor -- start 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.746+0000 7f9caa5ab700 1 -- start start 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.746+0000 7f9caa5ab700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 0x7f9ca410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9caa5ab700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40fd150 0x7f9ca410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9caa5ab700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca410eae0 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9caa5ab700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca410ec20 con 0x7f9ca40fd150 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 0x7f9ca410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 0x7f9ca410dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35646/0 (socket says 172.21.15.49:35646) 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca3fff700 1 -- 172.21.15.49:0/785856830 learned_addr learned my addr 172.21.15.49:0/785856830 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca37fe700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40fd150 0x7f9ca410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca3fff700 1 -- 172.21.15.49:0/785856830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40fd150 msgr2=0x7f9ca410e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca3fff700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40fd150 0x7f9ca410e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca3fff700 1 -- 172.21.15.49:0/785856830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94005040 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca37fe700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40fd150 0x7f9ca410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:37:48.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca3fff700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 0x7f9ca410dff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f9c9400b120 tx=0x7f9c94009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca17fa700 1 -- 172.21.15.49:0/785856830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c9400e030 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca4108250 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca17fa700 1 -- 172.21.15.49:0/785856830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c94007e90 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9ca17fa700 1 -- 172.21.15.49:0/785856830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c94018070 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.747+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca41087b0 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.748+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca405f590 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.749+0000 7f9ca17fa700 1 -- 172.21.15.49:0/785856830 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f9c9401d420 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.749+0000 7f9ca17fa700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f9c8c06c6a0 0x7f9c8c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:48.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.749+0000 7f9ca17fa700 1 -- 172.21.15.49:0/785856830 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f9c9408cc20 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.749+0000 7f9ca37fe700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f9c8c06c6a0 0x7f9c8c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:48.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.750+0000 7f9ca37fe700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f9c8c06c6a0 0x7f9c8c06eb60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9ca4109930 tx=0x7f9c98009040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:48.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.754+0000 7f9ca17fa700 1 -- 172.21.15.49:0/785856830 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f9c9405ad20 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:48 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:47.586356+0000 mgr.smithi049.rjblpr (mgr.14674) 130 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:48.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.951+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f9ca4047540 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.951+0000 7f9ca17fa700 1 -- 172.21.15.49:0/785856830 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v49)=0 v49) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9c9405a8b0 con 0x7f9ca40fc7f0 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.953+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f9c8c06c6a0 msgr2=0x7f9c8c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.953+0000 7f9caa5ab700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f9c8c06c6a0 0x7f9c8c06eb60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9ca4109930 tx=0x7f9c98009040).stop 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.953+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 msgr2=0x7f9ca410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.953+0000 7f9caa5ab700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 0x7f9ca410dff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f9c9400b120 tx=0x7f9c94009cb0).stop 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.954+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 shutdown_connections 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.954+0000 7f9caa5ab700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f9c8c06c6a0 0x7f9c8c06eb60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.954+0000 7f9caa5ab700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ca40fc7f0 0x7f9ca410dff0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.954+0000 7f9caa5ab700 1 --2- 172.21.15.49:0/785856830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40fd150 0x7f9ca410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.954+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 >> 172.21.15.49:0/785856830 conn(0x7f9ca4070590 msgr2=0x7f9ca4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:48.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.954+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 shutdown_connections 2024-02-22T00:37:48.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:48.954+0000 7f9caa5ab700 1 -- 172.21.15.49:0/785856830 wait complete. 2024-02-22T00:37:49.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:48 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:47.586356+0000 mgr.smithi049.rjblpr (mgr.14674) 130 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:49.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-22T00:37:50.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:50 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:49.586644+0000 mgr.smithi049.rjblpr (mgr.14674) 131 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:51.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:49.586644+0000 mgr.smithi049.rjblpr (mgr.14674) 131 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:51.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.351+0000 7f67887c1700 1 -- 172.21.15.49:0/620421561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fd150 msgr2=0x7f67800f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:51.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.351+0000 7f67887c1700 1 --2- 172.21.15.49:0/620421561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fd150 0x7f67800f6930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f677c0047f0 tx=0x7f677c009cb0).stop 2024-02-22T00:37:51.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.351+0000 7f67887c1700 1 -- 172.21.15.49:0/620421561 shutdown_connections 2024-02-22T00:37:51.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.351+0000 7f67887c1700 1 --2- 172.21.15.49:0/620421561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fd150 0x7f67800f6930 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.351+0000 7f67887c1700 1 --2- 172.21.15.49:0/620421561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67800fc7f0 0x7f67800fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.351+0000 7f67887c1700 1 -- 172.21.15.49:0/620421561 >> 172.21.15.49:0/620421561 conn(0x7f6780070590 msgr2=0x7f67800f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.351+0000 7f67887c1700 1 -- 172.21.15.49:0/620421561 shutdown_connections 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.351+0000 7f67887c1700 1 -- 172.21.15.49:0/620421561 wait complete. 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f67887c1700 1 Processor -- start 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f67887c1700 1 -- start start 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f67887c1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fc7f0 0x7f678010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f67887c1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67800fd150 0x7f678010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f67887c1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678010eab0 con 0x7f67800fc7f0 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f67887c1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678010ebf0 con 0x7f67800fd150 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f678655d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fc7f0 0x7f678010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f678655d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fc7f0 0x7f678010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35678/0 (socket says 172.21.15.49:35678) 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f678655d700 1 -- 172.21.15.49:0/1542159232 learned_addr learned my addr 172.21.15.49:0/1542159232 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:51.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.352+0000 7f6785d5c700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67800fd150 0x7f678010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f678655d700 1 -- 172.21.15.49:0/1542159232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67800fd150 msgr2=0x7f678010e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f678655d700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67800fd150 0x7f678010e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f678655d700 1 -- 172.21.15.49:0/1542159232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c005040 con 0x7f67800fc7f0 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f678655d700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fc7f0 0x7f678010dfc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f6770002770 tx=0x7f6770002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f67777fe700 1 -- 172.21.15.49:0/1542159232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6770007b40 con 0x7f67800fc7f0 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f67777fe700 1 -- 172.21.15.49:0/1542159232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f677000f040 con 0x7f67800fc7f0 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6780108280 con 0x7f67800fc7f0 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f67777fe700 1 -- 172.21.15.49:0/1542159232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6770014820 con 0x7f67800fc7f0 2024-02-22T00:37:51.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.353+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67801087c0 con 0x7f67800fc7f0 2024-02-22T00:37:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.354+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678005f590 con 0x7f67800fc7f0 2024-02-22T00:37:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.354+0000 7f67777fe700 1 -- 172.21.15.49:0/1542159232 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f6770007ca0 con 0x7f67800fc7f0 2024-02-22T00:37:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.355+0000 7f67777fe700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f676c06c6a0 0x7f676c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.355+0000 7f67777fe700 1 -- 172.21.15.49:0/1542159232 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f677008b240 con 0x7f67800fc7f0 2024-02-22T00:37:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.355+0000 7f6785d5c700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f676c06c6a0 0x7f676c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:51.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.355+0000 7f6785d5c700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f676c06c6a0 0x7f676c06eb60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6780109900 tx=0x7f677c00b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:51.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.360+0000 7f67777fe700 1 -- 172.21.15.49:0/1542159232 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f6770059340 con 0x7f67800fc7f0 2024-02-22T00:37:51.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.557+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f6780047540 con 0x7f67800fc7f0 2024-02-22T00:37:51.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.557+0000 7f67777fe700 1 -- 172.21.15.49:0/1542159232 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v49)=0 v49) v1 ==== 163+0+0 (secure 0 0 0) 0x7f6780047540 con 0x7f67800fc7f0 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.559+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f676c06c6a0 msgr2=0x7f676c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.559+0000 7f67887c1700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f676c06c6a0 0x7f676c06eb60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6780109900 tx=0x7f677c00b040).stop 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.559+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fc7f0 msgr2=0x7f678010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.559+0000 7f67887c1700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fc7f0 0x7f678010dfc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f6770002770 tx=0x7f6770002a80).stop 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.560+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 shutdown_connections 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.560+0000 7f67887c1700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f676c06c6a0 0x7f676c06eb60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.560+0000 7f67887c1700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67800fc7f0 0x7f678010dfc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.560+0000 7f67887c1700 1 --2- 172.21.15.49:0/1542159232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67800fd150 0x7f678010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.560+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 >> 172.21.15.49:0/1542159232 conn(0x7f6780070590 msgr2=0x7f6780060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.560+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 shutdown_connections 2024-02-22T00:37:51.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:51.560+0000 7f67887c1700 1 -- 172.21.15.49:0/1542159232 wait complete. 2024-02-22T00:37:52.215 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-22T00:37:52.659 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:51.587295+0000 mgr.smithi049.rjblpr (mgr.14674) 132 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:52.659 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:52 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:51.655616+0000 mon.smithi049 (mon.0) 1002 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:37:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:51.587295+0000 mgr.smithi049.rjblpr (mgr.14674) 132 : cluster [DBG] pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:53.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:52 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:51.655616+0000 mon.smithi049 (mon.0) 1002 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:37:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.041+0000 7f88f84da700 1 -- 172.21.15.49:0/2860641672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f88a0 msgr2=0x7f88f00f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.041+0000 7f88f84da700 1 --2- 172.21.15.49:0/2860641672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f88a0 0x7f88f00f8c80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f88ec0047f0 tx=0x7f88ec009cb0).stop 2024-02-22T00:37:54.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.041+0000 7f88f84da700 1 -- 172.21.15.49:0/2860641672 shutdown_connections 2024-02-22T00:37:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.041+0000 7f88f84da700 1 --2- 172.21.15.49:0/2860641672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88f00f9200 0x7f88f0101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:37:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.041+0000 7f88f84da700 1 --2- 172.21.15.49:0/2860641672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f88a0 0x7f88f00f8c80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.041+0000 7f88f84da700 1 -- 172.21.15.49:0/2860641672 >> 172.21.15.49:0/2860641672 conn(0x7f88f0070590 msgr2=0x7f88f00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.041+0000 7f88f84da700 1 -- 172.21.15.49:0/2860641672 shutdown_connections 2024-02-22T00:37:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.041+0000 7f88f84da700 1 -- 172.21.15.49:0/2860641672 wait complete. 2024-02-22T00:37:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.042+0000 7f88f84da700 1 Processor -- start 2024-02-22T00:37:54.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.042+0000 7f88f84da700 1 -- start start 2024-02-22T00:37:54.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.042+0000 7f88f84da700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88f00f88a0 0x7f88f010e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:54.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f84da700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f9200 0x7f88f010e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:54.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f84da700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f010ebf0 con 0x7f88f00f9200 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f84da700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0108280 con 0x7f88f00f88a0 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f5a75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f9200 0x7f88f010e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f5a75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f9200 0x7f88f010e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45290/0 (socket says 172.21.15.49:45290) 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f5a75700 1 -- 172.21.15.49:0/4223802498 learned_addr learned my addr 172.21.15.49:0/4223802498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f5a75700 1 -- 172.21.15.49:0/4223802498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88f00f88a0 msgr2=0x7f88f010e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f5a75700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88f00f88a0 0x7f88f010e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f5a75700 1 -- 172.21.15.49:0/4223802498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec005040 con 0x7f88f00f9200 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f5a75700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f9200 0x7f88f010e560 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f88e400b4b0 tx=0x7f88e40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88e37fe700 1 -- 172.21.15.49:0/4223802498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88e4002500 con 0x7f88f00f9200 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f0108530 con 0x7f88f00f9200 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88e37fe700 1 -- 172.21.15.49:0/4223802498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88e4002b10 con 0x7f88f00f9200 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88e37fe700 1 -- 172.21.15.49:0/4223802498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88e4012cf0 con 0x7f88f00f9200 2024-02-22T00:37:54.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.043+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f0108a70 con 0x7f88f00f9200 2024-02-22T00:37:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.044+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f005f590 con 0x7f88f00f9200 2024-02-22T00:37:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.045+0000 7f88e37fe700 1 -- 172.21.15.49:0/4223802498 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f88e4002660 con 0x7f88f00f9200 2024-02-22T00:37:54.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.045+0000 7f88e37fe700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f88dc06c6a0 0x7f88dc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.045+0000 7f88e37fe700 1 -- 172.21.15.49:0/4223802498 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f88e408b750 con 0x7f88f00f9200 2024-02-22T00:37:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.045+0000 7f88f6276700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f88dc06c6a0 0x7f88dc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:54.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.046+0000 7f88f6276700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f88dc06c6a0 0x7f88dc06eb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f88ec0047f0 tx=0x7f88ec009cb0).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:54.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.050+0000 7f88e37fe700 1 -- 172.21.15.49:0/4223802498 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f88e4059850 con 0x7f88f00f9200 2024-02-22T00:37:54.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.247+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f88f0047540 con 0x7f88f00f9200 2024-02-22T00:37:54.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.248+0000 7f88e37fe700 1 -- 172.21.15.49:0/4223802498 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v49)=0 v49) v1 ==== 135+0+0 (secure 0 0 0) 0x7f88e40593e0 con 0x7f88f00f9200 2024-02-22T00:37:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f88dc06c6a0 msgr2=0x7f88dc06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f88dc06c6a0 0x7f88dc06eb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f88ec0047f0 tx=0x7f88ec009cb0).stop 2024-02-22T00:37:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f9200 msgr2=0x7f88f010e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:54.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f9200 0x7f88f010e560 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f88e400b4b0 tx=0x7f88e40090f0).stop 2024-02-22T00:37:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 shutdown_connections 2024-02-22T00:37:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f88dc06c6a0 0x7f88dc06eb60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88f00f88a0 0x7f88f010e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:37:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 --2- 172.21.15.49:0/4223802498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88f00f9200 0x7f88f010e560 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 >> 172.21.15.49:0/4223802498 conn(0x7f88f0070590 msgr2=0x7f88f01001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 shutdown_connections 2024-02-22T00:37:54.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:54.250+0000 7f88f84da700 1 -- 172.21.15.49:0/4223802498 wait complete. 2024-02-22T00:37:54.893 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:54 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:53.587983+0000 mgr.smithi049.rjblpr (mgr.14674) 133 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:54.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-22T00:37:55.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:53.587983+0000 mgr.smithi049.rjblpr (mgr.14674) 133 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:56.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:55.588439+0000 mgr.smithi049.rjblpr (mgr.14674) 134 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 -- 172.21.15.49:0/1475445679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 msgr2=0x7f3468101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 --2- 172.21.15.49:0/1475445679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 0x7f3468101910 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f34500047f0 tx=0x7f3450009cb0).stop 2024-02-22T00:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 -- 172.21.15.49:0/1475445679 shutdown_connections 2024-02-22T00:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 --2- 172.21.15.49:0/1475445679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 0x7f3468101910 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 --2- 172.21.15.49:0/1475445679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34680f88a0 0x7f34680f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:56.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 -- 172.21.15.49:0/1475445679 >> 172.21.15.49:0/1475445679 conn(0x7f3468070590 msgr2=0x7f34680f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 -- 172.21.15.49:0/1475445679 shutdown_connections 2024-02-22T00:37:56.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 -- 172.21.15.49:0/1475445679 wait complete. 2024-02-22T00:37:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.964+0000 7f346dd60700 1 Processor -- start 2024-02-22T00:37:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f346dd60700 1 -- start start 2024-02-22T00:37:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f346dd60700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34680f88a0 0x7f346810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f346dd60700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 0x7f346810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:56.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f346dd60700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346810eb70 con 0x7f34680f9200 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f346dd60700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346810ecb0 con 0x7f34680f88a0 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f3466ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 0x7f346810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f3466ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 0x7f346810e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45310/0 (socket says 172.21.15.49:45310) 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f3466ffd700 1 -- 172.21.15.49:0/2851825517 learned_addr learned my addr 172.21.15.49:0/2851825517 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f34677fe700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34680f88a0 0x7f346810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f3466ffd700 1 -- 172.21.15.49:0/2851825517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34680f88a0 msgr2=0x7f346810e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f3466ffd700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34680f88a0 0x7f346810e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f3466ffd700 1 -- 172.21.15.49:0/2851825517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450005040 con 0x7f34680f9200 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.965+0000 7f3466ffd700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 0x7f346810e570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f3450005010 tx=0x7f3450009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.966+0000 7f3464ff9700 1 -- 172.21.15.49:0/2851825517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f345000e030 con 0x7f34680f9200 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.966+0000 7f3464ff9700 1 -- 172.21.15.49:0/2851825517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3450007e90 con 0x7f34680f9200 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.966+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34681082e0 con 0x7f34680f9200 2024-02-22T00:37:56.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.966+0000 7f3464ff9700 1 -- 172.21.15.49:0/2851825517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3450018070 con 0x7f34680f9200 2024-02-22T00:37:56.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.966+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34681087c0 con 0x7f34680f9200 2024-02-22T00:37:56.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.967+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346805f590 con 0x7f34680f9200 2024-02-22T00:37:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.967+0000 7f3464ff9700 1 -- 172.21.15.49:0/2851825517 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f345001d670 con 0x7f34680f9200 2024-02-22T00:37:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.968+0000 7f3464ff9700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f345406c6a0 0x7f345406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:37:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.968+0000 7f3464ff9700 1 -- 172.21.15.49:0/2851825517 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f345008cf50 con 0x7f34680f9200 2024-02-22T00:37:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.968+0000 7f34677fe700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f345406c6a0 0x7f345406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:37:56.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.968+0000 7f34677fe700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f345406c6a0 0x7f345406eb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3458004e60 tx=0x7f345800b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:37:56.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:56.972+0000 7f3464ff9700 1 -- 172.21.15.49:0/2851825517 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f345005b050 con 0x7f34680f9200 2024-02-22T00:37:57.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:55.588439+0000 mgr.smithi049.rjblpr (mgr.14674) 134 : cluster [DBG] pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:57.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.187+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "target": ["mon-mgr", ""]}) v1 -- 0x7f34680fee10 con 0x7f345406c6a0 2024-02-22T00:37:57.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.192+0000 7f3464ff9700 1 -- 172.21.15.49:0/2851825517 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f34680fee10 con 0x7f345406c6a0 2024-02-22T00:37:57.194 INFO:teuthology.orchestra.run.smithi049.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:37:57.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f345406c6a0 msgr2=0x7f345406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:57.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f345406c6a0 0x7f345406eb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3458004e60 tx=0x7f345800b040).stop 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 msgr2=0x7f346810e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 0x7f346810e570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f3450005010 tx=0x7f3450009cb0).stop 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 shutdown_connections 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f345406c6a0 0x7f345406eb60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34680f88a0 0x7f346810e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 --2- 172.21.15.49:0/2851825517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34680f9200 0x7f346810e570 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.194+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 >> 172.21.15.49:0/2851825517 conn(0x7f3468070590 msgr2=0x7f34680fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.195+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 shutdown_connections 2024-02-22T00:37:57.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:37:57.195+0000 7f346dd60700 1 -- 172.21.15.49:0/2851825517 wait complete. 2024-02-22T00:37:57.902 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-22T00:37:57.902 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T00:37:57.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:57.189159+0000 mgr.smithi049.rjblpr (mgr.14674) 135 : audit [DBG] from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:37:57.189704+0000 mgr.smithi049.rjblpr (mgr.14674) 136 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:57.193510+0000 mon.smithi049 (mon.0) 1003 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:57.243625+0000 mon.smithi049 (mon.0) 1004 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:57.245085+0000 mon.smithi049 (mon.0) 1005 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:57.245690+0000 mon.smithi049 (mon.0) 1006 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:57.250051+0000 mon.smithi049 (mon.0) 1007 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:37:57.388130+0000 mgr.smithi049.rjblpr (mgr.14674) 137 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:37:58.464 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:37:58 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:57.588847+0000 mgr.smithi049.rjblpr (mgr.14674) 138 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:37:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:57.189159+0000 mgr.smithi049.rjblpr (mgr.14674) 135 : audit [DBG] from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:37:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:37:57.189704+0000 mgr.smithi049.rjblpr (mgr.14674) 136 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:37:58.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:57.193510+0000 mon.smithi049 (mon.0) 1003 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:58.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:57.243625+0000 mon.smithi049 (mon.0) 1004 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:37:58.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:57.245085+0000 mon.smithi049 (mon.0) 1005 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:37:58.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:57.245690+0000 mon.smithi049 (mon.0) 1006 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:37:58.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:57.250051+0000 mon.smithi049 (mon.0) 1007 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:37:58.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:37:57.388130+0000 mgr.smithi049.rjblpr (mgr.14674) 137 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:37:58.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:37:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:57.588847+0000 mgr.smithi049.rjblpr (mgr.14674) 138 : cluster [DBG] pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 -- 172.21.15.49:0/3718902396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 msgr2=0x7f79c40f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 --2- 172.21.15.49:0/3718902396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 0x7f79c40f6ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f79c0004820 tx=0x7f79c0009cb0).stop 2024-02-22T00:38:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 -- 172.21.15.49:0/3718902396 shutdown_connections 2024-02-22T00:38:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 --2- 172.21.15.49:0/3718902396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c40f6fc0 0x7f79c4103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:38:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 --2- 172.21.15.49:0/3718902396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 0x7f79c40f6ad0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 -- 172.21.15.49:0/3718902396 >> 172.21.15.49:0/3718902396 conn(0x7f79c4070590 msgr2=0x7f79c40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 -- 172.21.15.49:0/3718902396 shutdown_connections 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 -- 172.21.15.49:0/3718902396 wait complete. 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 Processor -- start 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.707+0000 7f79cb443700 1 -- start start 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79cb443700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 0x7f79c4110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79cb443700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c40f6fc0 0x7f79c4110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79cb443700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4110d90 con 0x7f79c40f66f0 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79cb443700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4110ed0 con 0x7f79c40f6fc0 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c91df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 0x7f79c4110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c91df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 0x7f79c4110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45324/0 (socket says 172.21.15.49:45324) 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c91df700 1 -- 172.21.15.49:0/1878286015 learned_addr learned my addr 172.21.15.49:0/1878286015 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c89de700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c40f6fc0 0x7f79c4110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c91df700 1 -- 172.21.15.49:0/1878286015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c40f6fc0 msgr2=0x7f79c4110700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c91df700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c40f6fc0 0x7f79c4110700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c91df700 1 -- 172.21.15.49:0/1878286015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c0005040 con 0x7f79c40f66f0 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c89de700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c40f6fc0 0x7f79c4110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79c91df700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 0x7f79c4110210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f79c0004f00 tx=0x7f79c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79ba7fc700 1 -- 172.21.15.49:0/1878286015 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c000e030 con 0x7f79c40f66f0 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79ba7fc700 1 -- 172.21.15.49:0/1878286015 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f79c0007e90 con 0x7f79c40f66f0 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.708+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c410a500 con 0x7f79c40f66f0 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.709+0000 7f79ba7fc700 1 -- 172.21.15.49:0/1878286015 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c0018070 con 0x7f79c40f66f0 2024-02-22T00:38:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.709+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c410a9e0 con 0x7f79c40f66f0 2024-02-22T00:38:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.710+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c405f590 con 0x7f79c40f66f0 2024-02-22T00:38:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.710+0000 7f79ba7fc700 1 -- 172.21.15.49:0/1878286015 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f79c001d420 con 0x7f79c40f66f0 2024-02-22T00:38:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.711+0000 7f79ba7fc700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f79b006c6a0 0x7f79b006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.711+0000 7f79ba7fc700 1 -- 172.21.15.49:0/1878286015 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f79c008cbb0 con 0x7f79c40f66f0 2024-02-22T00:38:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.711+0000 7f79c89de700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f79b006c6a0 0x7f79b006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.711+0000 7f79c89de700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f79b006c6a0 0x7f79b006eb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f79c410bb90 tx=0x7f79b4008040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:00.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.715+0000 7f79ba7fc700 1 -- 172.21.15.49:0/1878286015 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f79c0093080 con 0x7f79c40f66f0 2024-02-22T00:38:00.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:37:59.589210+0000 mgr.smithi049.rjblpr (mgr.14674) 139 : cluster [DBG] pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:00.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:59.760230+0000 mon.smithi049 (mon.0) 1008 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:00.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:59.761595+0000 mon.smithi049 (mon.0) 1009 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:00.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:59.766156+0000 mon.smithi049 (mon.0) 1010 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:00.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:59.767581+0000 mon.smithi049 (mon.0) 1011 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:00.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:59.771565+0000 mon.smithi049 (mon.0) 1012 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:00.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:37:59.772518+0000 mon.smithi049 (mon.0) 1013 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T00:38:00.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.934+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79c41012d0 con 0x7f79b006c6a0 2024-02-22T00:38:00.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.935+0000 7f79ba7fc700 1 -- 172.21.15.49:0/1878286015 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f79c41012d0 con 0x7f79b006c6a0 2024-02-22T00:38:00.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f79b006c6a0 msgr2=0x7f79b006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:00.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f79b006c6a0 0x7f79b006eb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f79c410bb90 tx=0x7f79b4008040).stop 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 msgr2=0x7f79c4110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 0x7f79c4110210 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f79c0004f00 tx=0x7f79c0009cb0).stop 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 shutdown_connections 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f79b006c6a0 0x7f79b006eb60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79c40f66f0 0x7f79c4110210 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 --2- 172.21.15.49:0/1878286015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79c40f6fc0 0x7f79c4110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 >> 172.21.15.49:0/1878286015 conn(0x7f79c4070590 msgr2=0x7f79c406d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 shutdown_connections 2024-02-22T00:38:00.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:00.937+0000 7f79cb443700 1 -- 172.21.15.49:0/1878286015 wait complete. 2024-02-22T00:38:00.949 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:38:01.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:37:59.589210+0000 mgr.smithi049.rjblpr (mgr.14674) 139 : cluster [DBG] pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:01.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:59.760230+0000 mon.smithi049 (mon.0) 1008 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:01.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:59.761595+0000 mon.smithi049 (mon.0) 1009 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:01.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:59.766156+0000 mon.smithi049 (mon.0) 1010 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:01.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:59.767581+0000 mon.smithi049 (mon.0) 1011 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:01.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:59.771565+0000 mon.smithi049 (mon.0) 1012 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:01.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:37:59.772518+0000 mon.smithi049 (mon.0) 1013 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T00:38:01.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.045+0000 7f299809d700 1 -- 172.21.15.49:0/1408498673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 msgr2=0x7f29900fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.045+0000 7f299809d700 1 --2- 172.21.15.49:0/1408498673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 0x7f29900fdcf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f2988009b60 tx=0x7f2988004d10).stop 2024-02-22T00:38:01.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.045+0000 7f299809d700 1 -- 172.21.15.49:0/1408498673 shutdown_connections 2024-02-22T00:38:01.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.045+0000 7f299809d700 1 --2- 172.21.15.49:0/1408498673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29900fe270 0x7f29900f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.045+0000 7f299809d700 1 --2- 172.21.15.49:0/1408498673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 0x7f29900fdcf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.045+0000 7f299809d700 1 -- 172.21.15.49:0/1408498673 >> 172.21.15.49:0/1408498673 conn(0x7f29900f3530 msgr2=0x7f29900f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:01.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.045+0000 7f299809d700 1 -- 172.21.15.49:0/1408498673 shutdown_connections 2024-02-22T00:38:01.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.045+0000 7f299809d700 1 -- 172.21.15.49:0/1408498673 wait complete. 2024-02-22T00:38:01.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f299809d700 1 Processor -- start 2024-02-22T00:38:01.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f299809d700 1 -- start start 2024-02-22T00:38:01.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f299809d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 0x7f299010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f299809d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29900fe270 0x7f299010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f299809d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299010ead0 con 0x7f29900fd910 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f299809d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299010ec10 con 0x7f29900fe270 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f2995e39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 0x7f299010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f2995e39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 0x7f299010dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45338/0 (socket says 172.21.15.49:45338) 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.046+0000 7f2995e39700 1 -- 172.21.15.49:0/2817032992 learned_addr learned my addr 172.21.15.49:0/2817032992 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f2995e39700 1 -- 172.21.15.49:0/2817032992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29900fe270 msgr2=0x7f299010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f2995638700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29900fe270 0x7f299010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f2995e39700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29900fe270 0x7f299010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f2995e39700 1 -- 172.21.15.49:0/2817032992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880097c0 con 0x7f29900fd910 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f2995638700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29900fe270 0x7f299010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f2995e39700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 0x7f299010dfe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f2988009040 tx=0x7f2988004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:01.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f298effd700 1 -- 172.21.15.49:0/2817032992 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f298800e070 con 0x7f29900fd910 2024-02-22T00:38:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2990108240 con 0x7f29900fd910 2024-02-22T00:38:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f298effd700 1 -- 172.21.15.49:0/2817032992 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f298800bec0 con 0x7f29900fd910 2024-02-22T00:38:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f298effd700 1 -- 172.21.15.49:0/2817032992 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2988019070 con 0x7f29900fd910 2024-02-22T00:38:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.047+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2990108720 con 0x7f29900fd910 2024-02-22T00:38:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.048+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299005f570 con 0x7f29900fd910 2024-02-22T00:38:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.049+0000 7f298effd700 1 -- 172.21.15.49:0/2817032992 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f29880139d0 con 0x7f29900fd910 2024-02-22T00:38:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.049+0000 7f298effd700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f297806c6a0 0x7f297806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.049+0000 7f298effd700 1 -- 172.21.15.49:0/2817032992 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f298808ca40 con 0x7f29900fd910 2024-02-22T00:38:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.049+0000 7f2995638700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f297806c6a0 0x7f297806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.049+0000 7f2995638700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f297806c6a0 0x7f297806eb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2984009a00 tx=0x7f298400b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.053+0000 7f298effd700 1 -- 172.21.15.49:0/2817032992 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f298805ab40 con 0x7f29900fd910 2024-02-22T00:38:01.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.273+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29900ffc60 con 0x7f297806c6a0 2024-02-22T00:38:01.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.274+0000 7f298effd700 1 -- 172.21.15.49:0/2817032992 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f29900ffc60 con 0x7f297806c6a0 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f297806c6a0 msgr2=0x7f297806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f297806c6a0 0x7f297806eb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2984009a00 tx=0x7f298400b040).stop 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 msgr2=0x7f299010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 0x7f299010dfe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f2988009040 tx=0x7f2988004d10).stop 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 shutdown_connections 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f297806c6a0 0x7f297806eb60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29900fd910 0x7f299010dfe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 --2- 172.21.15.49:0/2817032992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29900fe270 0x7f299010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.276+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 >> 172.21.15.49:0/2817032992 conn(0x7f29900f3530 msgr2=0x7f29900fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:01.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.277+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 shutdown_connections 2024-02-22T00:38:01.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.277+0000 7f299809d700 1 -- 172.21.15.49:0/2817032992 wait complete. 2024-02-22T00:38:01.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.378+0000 7f26449b0700 1 -- 172.21.15.49:0/2712257964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 msgr2=0x7f26400fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.378+0000 7f26449b0700 1 --2- 172.21.15.49:0/2712257964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 0x7f26400fdcd0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f2630009b60 tx=0x7f2630004d10).stop 2024-02-22T00:38:01.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.378+0000 7f26449b0700 1 -- 172.21.15.49:0/2712257964 shutdown_connections 2024-02-22T00:38:01.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.378+0000 7f26449b0700 1 --2- 172.21.15.49:0/2712257964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26400fe250 0x7f26400f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.378+0000 7f26449b0700 1 --2- 172.21.15.49:0/2712257964 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 0x7f26400fdcd0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.378+0000 7f26449b0700 1 -- 172.21.15.49:0/2712257964 >> 172.21.15.49:0/2712257964 conn(0x7f26400f34b0 msgr2=0x7f26400f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:01.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.378+0000 7f26449b0700 1 -- 172.21.15.49:0/2712257964 shutdown_connections 2024-02-22T00:38:01.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.378+0000 7f26449b0700 1 -- 172.21.15.49:0/2712257964 wait complete. 2024-02-22T00:38:01.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.379+0000 7f26449b0700 1 Processor -- start 2024-02-22T00:38:01.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.379+0000 7f26449b0700 1 -- start start 2024-02-22T00:38:01.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f26449b0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 0x7f264010e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f26449b0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26400fe250 0x7f264010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f26449b0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264010ebd0 con 0x7f26400fd8f0 2024-02-22T00:38:01.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f26449b0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264010ed10 con 0x7f26400fe250 2024-02-22T00:38:01.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f263e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 0x7f264010e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f263e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 0x7f264010e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45356/0 (socket says 172.21.15.49:45356) 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f263e59c700 1 -- 172.21.15.49:0/2690913383 learned_addr learned my addr 172.21.15.49:0/2690913383 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f263dd9b700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26400fe250 0x7f264010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f263e59c700 1 -- 172.21.15.49:0/2690913383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26400fe250 msgr2=0x7f264010e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f263e59c700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26400fe250 0x7f264010e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f263e59c700 1 -- 172.21.15.49:0/2690913383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300097c0 con 0x7f26400fd8f0 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.380+0000 7f263e59c700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 0x7f264010e0e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f263000c010 tx=0x7f2630004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.381+0000 7f262f7fe700 1 -- 172.21.15.49:0/2690913383 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f263000e070 con 0x7f26400fd8f0 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.381+0000 7f262f7fe700 1 -- 172.21.15.49:0/2690913383 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2630007e90 con 0x7f26400fd8f0 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.381+0000 7f262f7fe700 1 -- 172.21.15.49:0/2690913383 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2630018070 con 0x7f26400fd8f0 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.381+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2640108340 con 0x7f26400fd8f0 2024-02-22T00:38:01.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.381+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2640108820 con 0x7f26400fd8f0 2024-02-22T00:38:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.382+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264005f590 con 0x7f26400fd8f0 2024-02-22T00:38:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.382+0000 7f262f7fe700 1 -- 172.21.15.49:0/2690913383 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f263001da60 con 0x7f26400fd8f0 2024-02-22T00:38:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.383+0000 7f262f7fe700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f262806c6a0 0x7f262806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.383+0000 7f262f7fe700 1 -- 172.21.15.49:0/2690913383 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f263008caf0 con 0x7f26400fd8f0 2024-02-22T00:38:01.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.383+0000 7f263dd9b700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f262806c6a0 0x7f262806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:01.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.383+0000 7f263dd9b700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f262806c6a0 0x7f262806eb60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2640109a20 tx=0x7f263400b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:01.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.387+0000 7f262f7fe700 1 -- 172.21.15.49:0/2690913383 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f263005abf0 con 0x7f26400fd8f0 2024-02-22T00:38:01.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.594+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2640108b50 con 0x7f262806c6a0 2024-02-22T00:38:01.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.604+0000 7f262f7fe700 1 -- 172.21.15.49:0/2690913383 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2640108b50 con 0x7f262806c6a0 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (74s) 54s ago 12m 16.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (12m) 54s ago 12m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (11m) 69s ago 11m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (59s) 54s ago 12m 37.9M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (7m) 54s ago 7m 14.9M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (7m) 54s ago 7m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (7m) 69s ago 7m 14.8M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (7m) 69s ago 7m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (2m) 54s ago 13m 497M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:38:01.607 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (2m) 69s ago 11m 446M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (13m) 54s ago 13m 60.0M 2048M 16.2.14-550-geb66ed92 7403d1862307 74dfb5559ec5 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (11m) 69s ago 11m 54.7M 2048M 16.2.14-550-geb66ed92 7403d1862307 f78a00eee456 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (113s) 54s ago 12m 8858k - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (107s) 69s ago 11m 13.9M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (11m) 54s ago 11m 223M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (10m) 54s ago 10m 236M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (10m) 54s ago 10m 198M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (9m) 69s ago 9m 260M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (9m) 69s ago 9m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (8m) 69s ago 8m 221M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:38:01.608 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (88s) 69s ago 11m 44.1M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:38:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f262806c6a0 msgr2=0x7f262806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f262806c6a0 0x7f262806eb60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2640109a20 tx=0x7f263400b040).stop 2024-02-22T00:38:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 msgr2=0x7f264010e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 0x7f264010e0e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f263000c010 tx=0x7f2630004d10).stop 2024-02-22T00:38:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 shutdown_connections 2024-02-22T00:38:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f262806c6a0 0x7f262806eb60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26400fd8f0 0x7f264010e0e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 --2- 172.21.15.49:0/2690913383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26400fe250 0x7f264010e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 >> 172.21.15.49:0/2690913383 conn(0x7f26400f34b0 msgr2=0x7f26400fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:01.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 shutdown_connections 2024-02-22T00:38:01.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.606+0000 7f26449b0700 1 -- 172.21.15.49:0/2690913383 wait complete. 2024-02-22T00:38:01.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.718+0000 7ff77e9ea700 1 -- 172.21.15.49:0/207277456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6fe0 msgr2=0x7ff778103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.718+0000 7ff77e9ea700 1 --2- 172.21.15.49:0/207277456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6fe0 0x7ff778103d80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff76c0047f0 tx=0x7ff76c009cb0).stop 2024-02-22T00:38:01.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.718+0000 7ff77e9ea700 1 -- 172.21.15.49:0/207277456 shutdown_connections 2024-02-22T00:38:01.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.718+0000 7ff77e9ea700 1 --2- 172.21.15.49:0/207277456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6fe0 0x7ff778103d80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.718+0000 7ff77e9ea700 1 --2- 172.21.15.49:0/207277456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7780f6710 0x7ff7780f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.718+0000 7ff77e9ea700 1 -- 172.21.15.49:0/207277456 >> 172.21.15.49:0/207277456 conn(0x7ff778070590 msgr2=0x7ff7780f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:01.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.718+0000 7ff77e9ea700 1 -- 172.21.15.49:0/207277456 shutdown_connections 2024-02-22T00:38:01.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.718+0000 7ff77e9ea700 1 -- 172.21.15.49:0/207277456 wait complete. 2024-02-22T00:38:01.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff77e9ea700 1 Processor -- start 2024-02-22T00:38:01.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff77e9ea700 1 -- start start 2024-02-22T00:38:01.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff77e9ea700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6710 0x7ff778110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff77e9ea700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7780f6fe0 0x7ff778110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff77e9ea700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff778110d60 con 0x7ff7780f6710 2024-02-22T00:38:01.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff77e9ea700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff778110ea0 con 0x7ff7780f6fe0 2024-02-22T00:38:01.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff777fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6710 0x7ff778110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:01.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff777fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6710 0x7ff778110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40242/0 (socket says 172.21.15.49:40242) 2024-02-22T00:38:01.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff777fff700 1 -- 172.21.15.49:0/218565816 learned_addr learned my addr 172.21.15.49:0/218565816 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.719+0000 7ff7777fe700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7780f6fe0 0x7ff778110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff777fff700 1 -- 172.21.15.49:0/218565816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7780f6fe0 msgr2=0x7ff778110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff777fff700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7780f6fe0 0x7ff778110760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff777fff700 1 -- 172.21.15.49:0/218565816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c005040 con 0x7ff7780f6710 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff777fff700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6710 0x7ff778110270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ff7680041d0 tx=0x7ff768009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff7757fa700 1 -- 172.21.15.49:0/218565816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff768007b40 con 0x7ff7780f6710 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77810a530 con 0x7ff7780f6710 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff7757fa700 1 -- 172.21.15.49:0/218565816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff76800f040 con 0x7ff7780f6710 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff7757fa700 1 -- 172.21.15.49:0/218565816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7680137d0 con 0x7ff7780f6710 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.720+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77810aa70 con 0x7ff7780f6710 2024-02-22T00:38:01.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.721+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77805f590 con 0x7ff7780f6710 2024-02-22T00:38:01.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.722+0000 7ff7757fa700 1 -- 172.21.15.49:0/218565816 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7ff768007ca0 con 0x7ff7780f6710 2024-02-22T00:38:01.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.722+0000 7ff7757fa700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7ff76006c6a0 0x7ff76006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:01.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.723+0000 7ff7757fa700 1 -- 172.21.15.49:0/218565816 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7ff76808b160 con 0x7ff7780f6710 2024-02-22T00:38:01.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.723+0000 7ff7777fe700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7ff76006c6a0 0x7ff76006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:01.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.723+0000 7ff7777fe700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7ff76006c6a0 0x7ff76006eb60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff76c004f10 tx=0x7ff76c00b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:01.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:01.727+0000 7ff7757fa700 1 -- 172.21.15.49:0/218565816 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7ff768059260 con 0x7ff7780f6710 2024-02-22T00:38:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:37:59.760550+0000 mgr.smithi049.rjblpr (mgr.14674) 140 : cephadm [INF] Upgrade: Target is version 18.2.1-638-gc1dc18f4 (reef) 2024-02-22T00:38:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:37:59.760607+0000 mgr.smithi049.rjblpr (mgr.14674) 141 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0, digests ['quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0'] 2024-02-22T00:38:01.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:37:59.768154+0000 mgr.smithi049.rjblpr (mgr.14674) 142 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-22T00:38:02.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.022+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff778047540 con 0x7ff7780f6710 2024-02-22T00:38:02.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.022+0000 7ff7757fa700 1 -- 172.21.15.49:0/218565816 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+749 (secure 0 0 0) 0x7ff768058df0 con 0x7ff7780f6710 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:38:02.025 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:38:02.026 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:38:02.026 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:38:02.026 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:38:02.026 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 12, 2024-02-22T00:38:02.026 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:38:02.026 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:38:02.026 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:38:02.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7ff76006c6a0 msgr2=0x7ff76006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7ff76006c6a0 0x7ff76006eb60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff76c004f10 tx=0x7ff76c00b040).stop 2024-02-22T00:38:02.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6710 msgr2=0x7ff778110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6710 0x7ff778110270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ff7680041d0 tx=0x7ff768009f60).stop 2024-02-22T00:38:02.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 shutdown_connections 2024-02-22T00:38:02.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7ff76006c6a0 0x7ff76006eb60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7780f6710 0x7ff778110270 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 --2- 172.21.15.49:0/218565816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7780f6fe0 0x7ff778110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 >> 172.21.15.49:0/218565816 conn(0x7ff778070590 msgr2=0x7ff77806d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:02.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 shutdown_connections 2024-02-22T00:38:02.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.024+0000 7ff77e9ea700 1 -- 172.21.15.49:0/218565816 wait complete. 2024-02-22T00:38:02.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:37:59.760550+0000 mgr.smithi049.rjblpr (mgr.14674) 140 : cephadm [INF] Upgrade: Target is version 18.2.1-638-gc1dc18f4 (reef) 2024-02-22T00:38:02.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:37:59.760607+0000 mgr.smithi049.rjblpr (mgr.14674) 141 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0, digests ['quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0'] 2024-02-22T00:38:02.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:37:59.768154+0000 mgr.smithi049.rjblpr (mgr.14674) 142 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-22T00:38:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.129+0000 7f58e2dae700 1 -- 172.21.15.49:0/609611070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fe270 msgr2=0x7f58dc0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.129+0000 7f58e2dae700 1 --2- 172.21.15.49:0/609611070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fe270 0x7f58dc0f7a50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f58c80047f0 tx=0x7f58c8009cb0).stop 2024-02-22T00:38:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.129+0000 7f58e2dae700 1 -- 172.21.15.49:0/609611070 shutdown_connections 2024-02-22T00:38:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.129+0000 7f58e2dae700 1 --2- 172.21.15.49:0/609611070 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fe270 0x7f58dc0f7a50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.129+0000 7f58e2dae700 1 --2- 172.21.15.49:0/609611070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58dc0fd910 0x7f58dc0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.129+0000 7f58e2dae700 1 -- 172.21.15.49:0/609611070 >> 172.21.15.49:0/609611070 conn(0x7f58dc0f3530 msgr2=0x7f58dc0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:02.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.130+0000 7f58e2dae700 1 -- 172.21.15.49:0/609611070 shutdown_connections 2024-02-22T00:38:02.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.130+0000 7f58e2dae700 1 -- 172.21.15.49:0/609611070 wait complete. 2024-02-22T00:38:02.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.130+0000 7f58e2dae700 1 Processor -- start 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.130+0000 7f58e2dae700 1 -- start start 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e2dae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fd910 0x7f58dc10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e2dae700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58dc0fe270 0x7f58dc10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e2dae700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc10eae0 con 0x7f58dc0fd910 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e2dae700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc10ec20 con 0x7f58dc0fe270 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e0b4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fd910 0x7f58dc10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e0b4a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fd910 0x7f58dc10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40260/0 (socket says 172.21.15.49:40260) 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e0b4a700 1 -- 172.21.15.49:0/3113418168 learned_addr learned my addr 172.21.15.49:0/3113418168 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58dbfff700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58dc0fe270 0x7f58dc10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e0b4a700 1 -- 172.21.15.49:0/3113418168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58dc0fe270 msgr2=0x7f58dc10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e0b4a700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58dc0fe270 0x7f58dc10e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e0b4a700 1 -- 172.21.15.49:0/3113418168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8005040 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58e0b4a700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fd910 0x7f58dc10dff0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f58d000c740 tx=0x7f58d0007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.131+0000 7f58d9ffb700 1 -- 172.21.15.49:0/3113418168 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58d000e680 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.132+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc1082b0 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.132+0000 7f58d9ffb700 1 -- 172.21.15.49:0/3113418168 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f58d000ec90 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.132+0000 7f58d9ffb700 1 -- 172.21.15.49:0/3113418168 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58d0013d60 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.132+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc108870 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.133+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc05f570 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.133+0000 7f58d9ffb700 1 -- 172.21.15.49:0/3113418168 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f58d000e7e0 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.133+0000 7f58d9ffb700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f58cc06c6f0 0x7f58cc06ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.134+0000 7f58d9ffb700 1 -- 172.21.15.49:0/3113418168 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f58d008bb10 con 0x7f58dc0fd910 2024-02-22T00:38:02.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.134+0000 7f58dbfff700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f58cc06c6f0 0x7f58cc06ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:02.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.134+0000 7f58dbfff700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f58cc06c6f0 0x7f58cc06ebb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f58c8004f10 tx=0x7f58c800b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:02.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.138+0000 7f58d9ffb700 1 -- 172.21.15.49:0/3113418168 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f58d0059b50 con 0x7f58dc0fd910 2024-02-22T00:38:02.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.385+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f58dc047540 con 0x7f58dc0fd910 2024-02-22T00:38:02.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.385+0000 7f58d9ffb700 1 -- 172.21.15.49:0/3113418168 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1771 (secure 0 0 0) 0x7f58d00596e0 con 0x7f58dc0fd910 2024-02-22T00:38:02.388 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:38:02.388 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:38:02.389 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:38:02.390 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:38:02.391 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:02.392 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f58cc06c6f0 msgr2=0x7f58cc06ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f58cc06c6f0 0x7f58cc06ebb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f58c8004f10 tx=0x7f58c800b040).stop 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fd910 msgr2=0x7f58dc10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fd910 0x7f58dc10dff0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f58d000c740 tx=0x7f58d0007ef0).stop 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 shutdown_connections 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f58cc06c6f0 0x7f58cc06ebb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58dc0fd910 0x7f58dc10dff0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 --2- 172.21.15.49:0/3113418168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58dc0fe270 0x7f58dc10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 >> 172.21.15.49:0/3113418168 conn(0x7f58dc0f3530 msgr2=0x7f58dc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 shutdown_connections 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.388+0000 7f58e2dae700 1 -- 172.21.15.49:0/3113418168 wait complete. 2024-02-22T00:38:02.393 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:38:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.493+0000 7f96016f2700 1 -- 172.21.15.49:0/875019569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fd8f0 msgr2=0x7f95fc0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.493+0000 7f96016f2700 1 --2- 172.21.15.49:0/875019569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fd8f0 0x7f95fc0fdcd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f95ec0047f0 tx=0x7f95ec009cb0).stop 2024-02-22T00:38:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.493+0000 7f96016f2700 1 -- 172.21.15.49:0/875019569 shutdown_connections 2024-02-22T00:38:02.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.493+0000 7f96016f2700 1 --2- 172.21.15.49:0/875019569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95fc0fe250 0x7f95fc0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.493+0000 7f96016f2700 1 --2- 172.21.15.49:0/875019569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fd8f0 0x7f95fc0fdcd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.493+0000 7f96016f2700 1 -- 172.21.15.49:0/875019569 >> 172.21.15.49:0/875019569 conn(0x7f95fc0f34b0 msgr2=0x7f95fc0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.493+0000 7f96016f2700 1 -- 172.21.15.49:0/875019569 shutdown_connections 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.493+0000 7f96016f2700 1 -- 172.21.15.49:0/875019569 wait complete. 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.494+0000 7f96016f2700 1 Processor -- start 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.494+0000 7f96016f2700 1 -- start start 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.494+0000 7f96016f2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95fc0fd8f0 0x7f95fc10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.494+0000 7f96016f2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fe250 0x7f95fc10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.494+0000 7f96016f2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc10ead0 con 0x7f95fc0fe250 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.494+0000 7f96016f2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc10ec10 con 0x7f95fc0fd8f0 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95fa7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fe250 0x7f95fc10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95fa7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fe250 0x7f95fc10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40286/0 (socket says 172.21.15.49:40286) 2024-02-22T00:38:02.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95fa7fc700 1 -- 172.21.15.49:0/1156065451 learned_addr learned my addr 172.21.15.49:0/1156065451 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95fa7fc700 1 -- 172.21.15.49:0/1156065451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95fc0fd8f0 msgr2=0x7f95fc10dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95fa7fc700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95fc0fd8f0 0x7f95fc10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95fa7fc700 1 -- 172.21.15.49:0/1156065451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec005040 con 0x7f95fc0fe250 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95fa7fc700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fe250 0x7f95fc10e4d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f95f000c710 tx=0x7f95f0007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95e3fff700 1 -- 172.21.15.49:0/1156065451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95f000e680 con 0x7f95fc0fe250 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc1082a0 con 0x7f95fc0fe250 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95e3fff700 1 -- 172.21.15.49:0/1156065451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f95f000ec90 con 0x7f95fc0fe250 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f95e3fff700 1 -- 172.21.15.49:0/1156065451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95f0013cd0 con 0x7f95fc0fe250 2024-02-22T00:38:02.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.495+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc108860 con 0x7f95fc0fe250 2024-02-22T00:38:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.496+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc05f590 con 0x7f95fc0fe250 2024-02-22T00:38:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.497+0000 7f95e3fff700 1 -- 172.21.15.49:0/1156065451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f95f0013410 con 0x7f95fc0fe250 2024-02-22T00:38:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.497+0000 7f95e3fff700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f95e406c6a0 0x7f95e406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.497+0000 7f95e3fff700 1 -- 172.21.15.49:0/1156065451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f95f008ba30 con 0x7f95fc0fe250 2024-02-22T00:38:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.497+0000 7f95faffd700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f95e406c6a0 0x7f95e406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:02.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.498+0000 7f95faffd700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f95e406c6a0 0x7f95e406eb60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f95ec0047f0 tx=0x7f95ec009cb0).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:02.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.502+0000 7f95e3fff700 1 -- 172.21.15.49:0/1156065451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f95f0059b30 con 0x7f95fc0fe250 2024-02-22T00:38:02.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.719+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 --> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95fc108ae0 con 0x7f95e406c6a0 2024-02-22T00:38:02.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.720+0000 7f95e3fff700 1 -- 172.21.15.49:0/1156065451 <== mgr.14674 v2:172.21.15.49:6800/825337018 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f95fc108ae0 con 0x7f95e406c6a0 2024-02-22T00:38:02.722 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:38:02.722 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:38:02.722 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:38:02.722 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:38:02.723 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:38:02.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr" 2024-02-22T00:38:02.723 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:38:02.723 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "2/21 daemons upgraded", 2024-02-22T00:38:02.723 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mon daemons", 2024-02-22T00:38:02.723 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:38:02.723 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:38:02.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f95e406c6a0 msgr2=0x7f95e406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f95e406c6a0 0x7f95e406eb60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f95ec0047f0 tx=0x7f95ec009cb0).stop 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fe250 msgr2=0x7f95fc10e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fe250 0x7f95fc10e4d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f95f000c710 tx=0x7f95f0007ec0).stop 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 shutdown_connections 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f95e406c6a0 0x7f95e406eb60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95fc0fd8f0 0x7f95fc10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 --2- 172.21.15.49:0/1156065451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95fc0fe250 0x7f95fc10e4d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 >> 172.21.15.49:0/1156065451 conn(0x7f95fc0f34b0 msgr2=0x7f95fc0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 shutdown_connections 2024-02-22T00:38:02.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.722+0000 7f96016f2700 1 -- 172.21.15.49:0/1156065451 wait complete. 2024-02-22T00:38:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.828+0000 7f1050b9a700 1 -- 172.21.15.49:0/3229657446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fd150 msgr2=0x7f104c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.828+0000 7f1050b9a700 1 --2- 172.21.15.49:0/3229657446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fd150 0x7f104c0f6930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f10340047f0 tx=0x7f1034009cb0).stop 2024-02-22T00:38:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.828+0000 7f1050b9a700 1 -- 172.21.15.49:0/3229657446 shutdown_connections 2024-02-22T00:38:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.828+0000 7f1050b9a700 1 --2- 172.21.15.49:0/3229657446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fd150 0x7f104c0f6930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.828+0000 7f1050b9a700 1 --2- 172.21.15.49:0/3229657446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f104c0fc7f0 0x7f104c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.828+0000 7f1050b9a700 1 -- 172.21.15.49:0/3229657446 >> 172.21.15.49:0/3229657446 conn(0x7f104c070590 msgr2=0x7f104c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.828+0000 7f1050b9a700 1 -- 172.21.15.49:0/3229657446 shutdown_connections 2024-02-22T00:38:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.828+0000 7f1050b9a700 1 -- 172.21.15.49:0/3229657446 wait complete. 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f1050b9a700 1 Processor -- start 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f1050b9a700 1 -- start start 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f1050b9a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fc7f0 0x7f104c10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f1050b9a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f104c0fd150 0x7f104c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f1050b9a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c10ead0 con 0x7f104c0fc7f0 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f1050b9a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c10ec10 con 0x7f104c0fd150 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f104a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fc7f0 0x7f104c10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f104a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fc7f0 0x7f104c10dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40310/0 (socket says 172.21.15.49:40310) 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.829+0000 7f104a59c700 1 -- 172.21.15.49:0/1616538904 learned_addr learned my addr 172.21.15.49:0/1616538904 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f1049d9b700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f104c0fd150 0x7f104c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f104a59c700 1 -- 172.21.15.49:0/1616538904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f104c0fd150 msgr2=0x7f104c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f104a59c700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f104c0fd150 0x7f104c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:02.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f104a59c700 1 -- 172.21.15.49:0/1616538904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034005040 con 0x7f104c0fc7f0 2024-02-22T00:38:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f104a59c700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fc7f0 0x7f104c10dfe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f103c00c790 tx=0x7f103c00cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f10437fe700 1 -- 172.21.15.49:0/1616538904 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c0106f0 con 0x7f104c0fc7f0 2024-02-22T00:38:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f10437fe700 1 -- 172.21.15.49:0/1616538904 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f103c010d00 con 0x7f104c0fc7f0 2024-02-22T00:38:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c1082a0 con 0x7f104c0fc7f0 2024-02-22T00:38:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f10437fe700 1 -- 172.21.15.49:0/1616538904 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c012e50 con 0x7f104c0fc7f0 2024-02-22T00:38:02.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.830+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104c108860 con 0x7f104c0fc7f0 2024-02-22T00:38:02.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.831+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104c05f590 con 0x7f104c0fc7f0 2024-02-22T00:38:02.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.832+0000 7f10437fe700 1 -- 172.21.15.49:0/1616538904 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 31) v1 ==== 90685+0+0 (secure 0 0 0) 0x7f103c010850 con 0x7f104c0fc7f0 2024-02-22T00:38:02.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.832+0000 7f10437fe700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f103806c6a0 0x7f103806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:02.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.832+0000 7f10437fe700 1 -- 172.21.15.49:0/1616538904 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f103c08b090 con 0x7f104c0fc7f0 2024-02-22T00:38:02.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.832+0000 7f1049d9b700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f103806c6a0 0x7f103806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:02.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.832+0000 7f1049d9b700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f103806c6a0 0x7f103806eb60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1034004f10 tx=0x7f103400b040).ready entity=mgr.14674 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:02.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:02.837+0000 7f10437fe700 1 -- 172.21.15.49:0/1616538904 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f103c059190 con 0x7f104c0fc7f0 2024-02-22T00:38:02.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:00.936000+0000 mgr.smithi049.rjblpr (mgr.14674) 143 : audit [DBG] from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:02.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:01.275502+0000 mgr.smithi049.rjblpr (mgr.14674) 144 : audit [DBG] from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:02.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cluster 2024-02-22T00:38:01.589465+0000 mgr.smithi049.rjblpr (mgr.14674) 145 : cluster [DBG] pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:02.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:01.596695+0000 mgr.smithi049.rjblpr (mgr.14674) 146 : audit [DBG] from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:02.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: cephadm 2024-02-22T00:38:01.690326+0000 mgr.smithi049.rjblpr (mgr.14674) 147 : cephadm [INF] Upgrade: Updating mon.smithi049 2024-02-22T00:38:02.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:01.696389+0000 mon.smithi049 (mon.0) 1014 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:02.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:01.697167+0000 mon.smithi049 (mon.0) 1015 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:02.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:01.697813+0000 mon.smithi049 (mon.0) 1016 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:02.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:01.698441+0000 mon.smithi049 (mon.0) 1017 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:02.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:02.023386+0000 mon.smithi049 (mon.0) 1018 : audit [DBG] from='client.? 172.21.15.49:0/218565816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:02.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:02 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: audit 2024-02-22T00:38:02.386857+0000 mon.smithi049 (mon.0) 1019 : audit [DBG] from='client.? 172.21.15.49:0/3113418168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:38:03.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:00.936000+0000 mgr.smithi049.rjblpr (mgr.14674) 143 : audit [DBG] from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:01.275502+0000 mgr.smithi049.rjblpr (mgr.14674) 144 : audit [DBG] from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:01.589465+0000 mgr.smithi049.rjblpr (mgr.14674) 145 : cluster [DBG] pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:01.596695+0000 mgr.smithi049.rjblpr (mgr.14674) 146 : audit [DBG] from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:01.690326+0000 mgr.smithi049.rjblpr (mgr.14674) 147 : cephadm [INF] Upgrade: Updating mon.smithi049 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:01.696389+0000 mon.smithi049 (mon.0) 1014 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:01.697167+0000 mon.smithi049 (mon.0) 1015 : audit [INF] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:01.697813+0000 mon.smithi049 (mon.0) 1016 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:01.698441+0000 mon.smithi049 (mon.0) 1017 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:03.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:02.023386+0000 mon.smithi049 (mon.0) 1018 : audit [DBG] from='client.? 172.21.15.49:0/218565816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:03.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:02.386857+0000 mon.smithi049 (mon.0) 1019 : audit [DBG] from='client.? 172.21.15.49:0/3113418168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:38:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.115+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f104c109770 con 0x7f104c0fc7f0 2024-02-22T00:38:03.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.116+0000 7f10437fe700 1 -- 172.21.15.49:0/1616538904 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f103c058d20 con 0x7f104c0fc7f0 2024-02-22T00:38:03.118 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_OK 2024-02-22T00:38:03.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f103806c6a0 msgr2=0x7f103806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:03.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f103806c6a0 0x7f103806eb60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1034004f10 tx=0x7f103400b040).stop 2024-02-22T00:38:03.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fc7f0 msgr2=0x7f104c10dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:03.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fc7f0 0x7f104c10dfe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f103c00c790 tx=0x7f103c00cb50).stop 2024-02-22T00:38:03.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 shutdown_connections 2024-02-22T00:38:03.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:6800/825337018,v1:172.21.15.49:6801/825337018] conn(0x7f103806c6a0 0x7f103806eb60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:03.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f104c0fc7f0 0x7f104c10dfe0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:03.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 --2- 172.21.15.49:0/1616538904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f104c0fd150 0x7f104c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:03.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 >> 172.21.15.49:0/1616538904 conn(0x7f104c070590 msgr2=0x7f104c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:03.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 shutdown_connections 2024-02-22T00:38:03.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:03.118+0000 7f1050b9a700 1 -- 172.21.15.49:0/1616538904 wait complete. 2024-02-22T00:38:03.601 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:03 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:38:03.601 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:38:03.597+0000 7f5c22229700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-22T00:38:03.601 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:03 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[67324]: debug 2024-02-22T00:38:03.597+0000 7f5c22229700 -1 mon.smithi049@0(leader) e2 *** Got Signal Terminated *** 2024-02-22T00:38:04.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:03 smithi049 bash[132492]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049 2024-02-22T00:38:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi049.service: Succeeded. 2024-02-22T00:38:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 systemd[1]: Stopped Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:38:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 systemd[1]: Starting Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: set uid:gid to 167:167 (ceph:ceph) 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable), process ceph-mon, pid 7 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: pidfile_write: ignore empty --pid-file 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: load: jerasure load: lrc 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: RocksDB version: 7.9.2 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Git sha 0 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Compile date 2024-02-21 21:10:13 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: DB SUMMARY 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: DB Session ID: G44MZ1RWFKPRWGBUTNOV 2024-02-22T00:38:05.173 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: CURRENT file: CURRENT 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: IDENTITY file: IDENTITY 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: MANIFEST file: MANIFEST-000008 size: 1174 Bytes 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi049/store.db dir, Total Num: 1, files: 000026.sst 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi049/store.db: 000024.log size: 2004167 ; 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.error_if_exists: 0 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.create_if_missing: 0 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.paranoid_checks: 1 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.env: 0x5596b3cd0720 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.fs: PosixFileSystem 2024-02-22T00:38:05.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.info_log: 0x5596b6bd1360 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_file_opening_threads: 16 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.statistics: (nil) 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.use_fsync: 0 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_log_file_size: 0 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.keep_log_file_num: 1000 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.recycle_log_file_num: 0 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.allow_fallocate: 1 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.allow_mmap_reads: 0 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.allow_mmap_writes: 0 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.use_direct_reads: 0 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T00:38:05.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.create_missing_column_families: 0 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.db_log_dir: 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.wal_dir: 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.advise_random_on_open: 1 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.db_write_buffer_size: 0 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.write_buffer_manager: 0x5596b5e42140 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T00:38:05.176 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.rate_limiter: (nil) 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.wal_recovery_mode: 2 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.enable_thread_tracking: 0 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.enable_pipelined_write: 0 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.unordered_write: 0 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.row_cache: None 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.wal_filter: None 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T00:38:05.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.allow_ingest_behind: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.two_write_queues: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.manual_wal_flush: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.wal_compression: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.atomic_flush: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.log_readahead_size: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.best_efforts_recovery: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.allow_data_in_errors: 0 2024-02-22T00:38:05.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.db_host_id: __hostname__ 2024-02-22T00:38:05.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-22T00:38:05.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_background_jobs: 2 2024-02-22T00:38:05.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_background_compactions: -1 2024-02-22T00:38:05.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_subcompactions: 1 2024-02-22T00:38:05.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T00:38:05.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T00:38:05.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T00:38:05.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_total_wal_size: 0 2024-02-22T00:38:05.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T00:38:05.181 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_open_files: -1 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bytes_per_sync: 0 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_readahead_size: 0 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_background_flushes: -1 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Compression algorithms supported: 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T00:38:05.182 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: kZSTD supported: 0 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: kXpressCompression supported: 0 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: kLZ4HCCompression supported: 1 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: kZlibCompression supported: 1 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: kSnappyCompression supported: 1 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: kLZ4Compression supported: 1 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: kBZip2Compression supported: 0 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000008 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-22T00:38:05.183 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.merge_operator: 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_filter: None 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_filter_factory: None 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.sst_partitioner_factory: None 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5596b6bd1480) 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks: 1 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T00:38:05.184 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: pin_top_level_index_and_filter: 1 2024-02-22T00:38:05.185 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_type: 0 2024-02-22T00:38:05.185 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_index_type: 0 2024-02-22T00:38:05.185 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_shortening: 1 2024-02-22T00:38:05.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-22T00:38:05.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: checksum: 4 2024-02-22T00:38:05.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: no_block_cache: 0 2024-02-22T00:38:05.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache: 0x5596b5ee31f0 2024-02-22T00:38:05.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_name: BinnedLRUCache 2024-02-22T00:38:05.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_options: 2024-02-22T00:38:05.187 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: capacity : 536870912 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_shard_bits : 4 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: strict_capacity_limit : 0 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: high_pri_pool_ratio: 0.000 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_cache_compressed: (nil) 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: persistent_cache: (nil) 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size: 4096 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_size_deviation: 10 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_restart_interval: 16 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: index_block_restart_interval: 1 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: metadata_block_size: 4096 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: partition_filters: 0 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: use_delta_encoding: 1 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: filter_policy: bloomfilter 2024-02-22T00:38:05.188 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: whole_key_filtering: 1 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: verify_compression: 0 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: read_amp_bytes_per_bit: 0 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: format_version: 5 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_index_compression: 1 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: block_align: 0 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_auto_readahead_size: 262144 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: prepopulate_block_cache: 0 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: initial_auto_readahead_size: 8192 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: num_file_reads_for_auto_readahead: 2 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.write_buffer_size: 33554432 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_write_buffer_number: 2 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression: NoCompression 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression: Disabled 2024-02-22T00:38:05.189 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.prefix_extractor: nullptr 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.num_levels: 7 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T00:38:05.190 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:38:05.191 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-22T00:38:05.191 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T00:38:05.191 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-22T00:38:05.191 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-22T00:38:05.191 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T00:38:05.191 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.level: 32767 2024-02-22T00:38:05.191 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.strategy: 0 2024-02-22T00:38:05.192 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T00:38:05.192 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:38:05.192 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-22T00:38:05.193 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-22T00:38:05.193 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.enabled: false 2024-02-22T00:38:05.193 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-22T00:38:05.193 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T00:38:05.193 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T00:38:05.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T00:38:05.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.target_file_size_base: 67108864 2024-02-22T00:38:05.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T00:38:05.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T00:38:05.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T00:38:05.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T00:38:05.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T00:38:05.194 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.arena_block_size: 1048576 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.disable_auto_compactions: 0 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T00:38:05.195 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.table_properties_collectors: 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.inplace_update_support: 0 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T00:38:05.196 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.bloom_locality: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.max_successive_merges: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.paranoid_file_checks: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.force_consistency_checks: 1 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.report_bg_io_stats: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.ttl: 2592000 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.enable_blob_files: false 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.min_blob_size: 0 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.blob_file_size: 268435456 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-22T00:38:05.197 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.blob_file_starting_level: 0 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 26.sst 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi049/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 28, last_sequence is 11336, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 24 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ef426461-1657-46e3-955e-86ee50373a59 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708562284886648, "job": 1, "event": "recovery_started", "wal_files": [24]} 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #24 mode 2 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708562284892738, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 29, "file_size": 1998430, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11337, "largest_seqno": 11778, "table_properties": {"data_size": 1994775, "index_size": 2193, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 453, "raw_key_size": 3658, "raw_average_key_size": 21, "raw_value_size": 1989856, "raw_average_value_size": 11844, "num_data_blocks": 98, "num_entries": 168, "num_filter_entries": 168, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708562284, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ef426461-1657-46e3-955e-86ee50373a59", "db_session_id": "G44MZ1RWFKPRWGBUTNOV", "orig_file_number": 29, "seqno_to_time_mapping": "N/A"}} 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708562284892834, "job": 1, "event": "recovery_finished"} 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/version_set.cc:5047] Creating manifest 31 2024-02-22T00:38:05.198 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi049/store.db/000024.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5596b5f80000 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: DB pointer 0x5596b5f6e000 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** DB Stats ** 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2024-02-22T00:38:05.199 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L0 1/0 1.91 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 530.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: L6 1/0 26.70 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Sum 2/0 28.60 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 530.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 530.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** Compaction Stats [default] ** 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 530.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.200 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Cumulative compaction: 0.00 GB write, 223.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Interval compaction: 0.00 GB write, 223.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Block cache BinnedLRUCache@0x5596b5ee31f0#7 capacity: 512.00 MB usage: 2.83 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.50 KB,9.53674e-05%) IndexBlock(1,2.33 KB,0.000444055%) Misc(1,0.00 KB,0%) 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: starting mon.smithi049 rank 0 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi049 fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: mon.smithi049@-1(???) e2 preinit fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:38:05.201 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: mon.smithi049@-1(???).mds e16 new map 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: mon.smithi049@-1(???).mds e16 print_map 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: e16 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: legacy client fscid: 1 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Filesystem 'cephfs' (1) 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: fs_name cephfs 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: epoch 16 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: tableserver 0 2024-02-22T00:38:05.202 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: root 0 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: session_timeout 60 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: session_autoclose 300 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_file_size 1099511627776 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_xattr_size 65536 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: required_client_features {} 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: last_failure 0 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: last_failure_osd_epoch 0 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: max_mds 2 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: in 0,1 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: up {0=14438,1=24271} 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: failed 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: damaged 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: stopped 2024-02-22T00:38:05.203 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: data_pools [3] 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: metadata_pool 2 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: inline_data disabled 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: balancer 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: bal_rank_mask -1 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: standby_count_wanted 1 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: Standby daemons: 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout: [mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: mon.smithi049@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-22T00:38:05.204 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: mon.smithi049@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T00:38:05.205 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: mon.smithi049@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T00:38:05.205 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: mon.smithi049@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T00:38:05.205 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 ceph-mon[132694]: mon.smithi049@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-22T00:38:05.205 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 bash[132657]: f7281f90682edcb658bbb2f6cb36a0ca49083fdc5d00297e77d35d4f89fdc7ac 2024-02-22T00:38:05.205 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:04 smithi049 systemd[1]: Started Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:38:05.481 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:03.589998+0000 mgr.smithi049.rjblpr (mgr.14674) 150 : cluster [DBG] pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:05.481 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:03.605748+0000 mon.smithi161 (mon.1) 93 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:38:05.481 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:03.605942+0000 mon.smithi161 (mon.1) 94 : audit [DBG] from='mgr.14674 172.21.15.49:0/3045893970' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:38:05.481 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:05.105404+0000 mon.smithi049 (mon.0) 1 : cluster [INF] mon.smithi049 calling monitor election 2024-02-22T00:38:05.482 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:05.118472+0000 mon.smithi049 (mon.0) 2 : cluster [INF] mon.smithi049 is new leader, mons smithi049,smithi161 in quorum (ranks 0,1) 2024-02-22T00:38:05.482 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:05.122614+0000 mon.smithi049 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-22T00:38:05.482 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:05.123074+0000 mon.smithi049 (mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:38:05.482 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:05.123126+0000 mon.smithi049 (mon.0) 5 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-02-22T00:38:05.482 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:05.124026+0000 mon.smithi049 (mon.0) 6 : cluster [DBG] mgrmap e31: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:05.482 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:05.138979+0000 mon.smithi049 (mon.0) 7 : cluster [DBG] mgrmap e32: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:05.482 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:05.139007+0000 mon.smithi049 (mon.0) 8 : cluster [INF] overall HEALTH_OK 2024-02-22T00:38:05.482 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:05.139079+0000 mon.smithi049 (mon.0) 9 : audit [INF] from='mgr.14674 ' entity='' 2024-02-22T00:38:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:11.993789+0000 mon.smithi049 (mon.0) 10 : cluster [DBG] Standby manager daemon smithi161.sazlam restarted 2024-02-22T00:38:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:11.993862+0000 mon.smithi049 (mon.0) 11 : cluster [DBG] Standby manager daemon smithi161.sazlam started 2024-02-22T00:38:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:11.995092+0000 mon.smithi161 (mon.1) 95 : audit [DBG] from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:38:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:11.995466+0000 mon.smithi161 (mon.1) 96 : audit [DBG] from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:38:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:11.997303+0000 mon.smithi161 (mon.1) 97 : audit [DBG] from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:38:12.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:11.998234+0000 mon.smithi161 (mon.1) 98 : audit [DBG] from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:38:12.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:12 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:38:12.297+0000 7f3eaefd4700 -1 mon.smithi161@1(peon).osd e48 update_from_paxos full map CRC mismatch, resetting to canonical 2024-02-22T00:38:13.391 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.048741+0000 mon.smithi049 (mon.0) 12 : cluster [DBG] mgrmap e33: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:13.391 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.296145+0000 mon.smithi049 (mon.0) 13 : cluster [INF] Active manager daemon smithi049.rjblpr restarted 2024-02-22T00:38:13.391 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.296432+0000 mon.smithi049 (mon.0) 14 : cluster [INF] Activating manager daemon smithi049.rjblpr 2024-02-22T00:38:13.391 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.301240+0000 mon.smithi049 (mon.0) 15 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-02-22T00:38:13.391 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.301498+0000 mon.smithi049 (mon.0) 16 : cluster [DBG] mgrmap e34: smithi049.rjblpr(active, starting, since 0.00515539s), standbys: smithi161.sazlam 2024-02-22T00:38:13.391 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.302501+0000 mon.smithi049 (mon.0) 17 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.302702+0000 mon.smithi049 (mon.0) 18 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.303851+0000 mon.smithi049 (mon.0) 19 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.304130+0000 mon.smithi049 (mon.0) 20 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.304397+0000 mon.smithi049 (mon.0) 21 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.304695+0000 mon.smithi049 (mon.0) 22 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.304968+0000 mon.smithi049 (mon.0) 23 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.305233+0000 mon.smithi049 (mon.0) 24 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.305470+0000 mon.smithi049 (mon.0) 25 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.305724+0000 mon.smithi049 (mon.0) 26 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:38:13.392 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.305937+0000 mon.smithi049 (mon.0) 27 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.306198+0000 mon.smithi049 (mon.0) 28 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.306453+0000 mon.smithi049 (mon.0) 29 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.306730+0000 mon.smithi049 (mon.0) 30 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.306994+0000 mon.smithi049 (mon.0) 31 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.307347+0000 mon.smithi049 (mon.0) 32 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.307763+0000 mon.smithi049 (mon.0) 33 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.325880+0000 mon.smithi049 (mon.0) 34 : cluster [INF] Manager daemon smithi049.rjblpr is now available 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.347286+0000 mon.smithi049 (mon.0) 35 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.349857+0000 mon.smithi049 (mon.0) 36 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.369549+0000 mon.smithi049 (mon.0) 37 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.378306+0000 mon.smithi049 (mon.0) 38 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:38:13.393 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:12.385746+0000 mon.smithi049 (mon.0) 39 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:38:13.394 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:13 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.423266+0000 osd.5 (osd.5) 3 : cluster [WRN] failed to encode map e48 with expected crc 2024-02-22T00:38:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.302166+0000 osd.0 (osd.0) 3 : cluster [WRN] failed to encode map e48 with expected crc 2024-02-22T00:38:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:12.423263+0000 osd.3 (osd.3) 3 : cluster [WRN] failed to encode map e48 with expected crc 2024-02-22T00:38:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:14 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:13.306441+0000 mon.smithi049 (mon.0) 40 : cluster [DBG] mgrmap e35: smithi049.rjblpr(active, since 1.01009s), standbys: smithi161.sazlam 2024-02-22T00:38:15.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:13.720953+0000 mgr.smithi049.rjblpr (mgr.34104) 2 : cephadm [INF] [22/Feb/2024:00:38:13] ENGINE Bus STARTING 2024-02-22T00:38:15.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:13.822723+0000 mgr.smithi049.rjblpr (mgr.34104) 3 : cephadm [INF] [22/Feb/2024:00:38:13] ENGINE Serving on http://172.21.15.49:8765 2024-02-22T00:38:15.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:13.940851+0000 mgr.smithi049.rjblpr (mgr.34104) 4 : cephadm [INF] [22/Feb/2024:00:38:13] ENGINE Serving on https://172.21.15.49:7150 2024-02-22T00:38:15.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:13.941013+0000 mgr.smithi049.rjblpr (mgr.34104) 5 : cephadm [INF] [22/Feb/2024:00:38:13] ENGINE Bus STARTED 2024-02-22T00:38:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:14.305402+0000 mgr.smithi049.rjblpr (mgr.34104) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:16 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:15.314010+0000 mon.smithi049 (mon.0) 41 : cluster [DBG] mgrmap e36: smithi049.rjblpr(active, since 3s), standbys: smithi161.sazlam 2024-02-22T00:38:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:16.305878+0000 mgr.smithi049.rjblpr (mgr.34104) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:17.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:16.361868+0000 mon.smithi049 (mon.0) 42 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:17.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:16.365867+0000 mon.smithi049 (mon.0) 43 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:17.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:16.819446+0000 mon.smithi049 (mon.0) 44 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:17.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:16.824041+0000 mon.smithi049 (mon.0) 45 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:17.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:17.004131+0000 mon.smithi049 (mon.0) 46 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:17.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:17.008474+0000 mon.smithi049 (mon.0) 47 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:17.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:17 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:17.065930+0000 mon.smithi049 (mon.0) 48 : cluster [DBG] mgrmap e37: smithi049.rjblpr(active, since 4s), standbys: smithi161.sazlam 2024-02-22T00:38:18.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:17.508574+0000 mon.smithi049 (mon.0) 49 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:18.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:17.513095+0000 mon.smithi049 (mon.0) 50 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:19.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:18.306246+0000 mgr.smithi049.rjblpr (mgr.34104) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:20.306658+0000 mgr.smithi049.rjblpr (mgr.34104) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-22T00:38:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.033721+0000 mgr.smithi049.rjblpr (mgr.34104) 10 : cephadm [INF] Detected new or changed devices on smithi049 2024-02-22T00:38:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:21.038251+0000 mon.smithi049 (mon.0) 51 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:21.042959+0000 mon.smithi049 (mon.0) 52 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:22.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:21.044215+0000 mon.smithi049 (mon.0) 53 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:22.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:21.044859+0000 mon.smithi049 (mon.0) 54 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:38:22.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.045824+0000 mgr.smithi049.rjblpr (mgr.34104) 11 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:38:22.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:22 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.045999+0000 mgr.smithi049.rjblpr (mgr.34104) 12 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.310194+0000 mgr.smithi049.rjblpr (mgr.34104) 13 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.310399+0000 mgr.smithi049.rjblpr (mgr.34104) 14 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.574723+0000 mgr.smithi049.rjblpr (mgr.34104) 15 : cephadm [INF] Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.574874+0000 mgr.smithi049.rjblpr (mgr.34104) 16 : cephadm [INF] Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.838742+0000 mgr.smithi049.rjblpr (mgr.34104) 17 : cephadm [INF] Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:21.838894+0000 mgr.smithi049.rjblpr (mgr.34104) 18 : cephadm [INF] Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:22.107328+0000 mon.smithi049 (mon.0) 55 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:22.112494+0000 mon.smithi049 (mon.0) 56 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:22.115932+0000 mon.smithi049 (mon.0) 57 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:22.118808+0000 mon.smithi049 (mon.0) 58 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:22.121971+0000 mon.smithi049 (mon.0) 59 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:22.259771+0000 mon.smithi049 (mon.0) 60 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:23.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:22.262127+0000 mon.smithi049 (mon.0) 61 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:23.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:23 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:22.263107+0000 mon.smithi049 (mon.0) 62 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T00:38:24.492 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cluster 2024-02-22T00:38:22.306909+0000 mgr.smithi049.rjblpr (mgr.34104) 19 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-22T00:38:24.492 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:23.786965+0000 mon.smithi049 (mon.0) 63 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:24.492 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:23.787951+0000 mon.smithi049 (mon.0) 64 : audit [INF] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:24.492 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:23.788710+0000 mon.smithi049 (mon.0) 65 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:24.492 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:24 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: audit 2024-02-22T00:38:23.789478+0000 mon.smithi049 (mon.0) 66 : audit [DBG] from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:25.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:23.782046+0000 mgr.smithi049.rjblpr (mgr.34104) 20 : cephadm [INF] Upgrade: Updating mon.smithi161 2024-02-22T00:38:25.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: cephadm 2024-02-22T00:38:23.790479+0000 mgr.smithi049.rjblpr (mgr.34104) 21 : cephadm [INF] Deploying daemon mon.smithi161 on smithi161 2024-02-22T00:38:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:25 smithi161 systemd[1]: Stopping Ceph mon.smithi161 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:38:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:38:25.796+0000 7f3eb57e1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi161 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-22T00:38:26.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[70375]: debug 2024-02-22T00:38:25.796+0000 7f3eb57e1700 -1 mon.smithi161@1(peon) e2 *** Got Signal Terminated *** 2024-02-22T00:38:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:26 smithi161 bash[113250]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161 2024-02-22T00:38:27.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:26 smithi161 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi161.service: Succeeded. 2024-02-22T00:38:27.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:26 smithi161 systemd[1]: Stopped Ceph mon.smithi161 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:38:27.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:26 smithi161 systemd[1]: Starting Ceph mon.smithi161 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:38:27.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: set uid:gid to 167:167 (ceph:ceph) 2024-02-22T00:38:27.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable), process ceph-mon, pid 7 2024-02-22T00:38:27.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: pidfile_write: ignore empty --pid-file 2024-02-22T00:38:27.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: load: jerasure load: lrc 2024-02-22T00:38:27.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: RocksDB version: 7.9.2 2024-02-22T00:38:27.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Git sha 0 2024-02-22T00:38:27.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Compile date 2024-02-21 21:10:13 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: DB SUMMARY 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: DB Session ID: ZBU4X5IAVTCPSE1TGBUM 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: CURRENT file: CURRENT 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: IDENTITY file: IDENTITY 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: MANIFEST file: MANIFEST-000005 size: 1193 Bytes 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi161/store.db dir, Total Num: 1, files: 000025.sst 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi161/store.db: 000023.log size: 6999699 ; 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.error_if_exists: 0 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.create_if_missing: 0 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.paranoid_checks: 1 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-22T00:38:27.546 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.env: 0x55a30cef0720 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.fs: PosixFileSystem 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.info_log: 0x55a30fda1360 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_file_opening_threads: 16 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.statistics: (nil) 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.use_fsync: 0 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_log_file_size: 0 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.keep_log_file_num: 1000 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.recycle_log_file_num: 0 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.allow_fallocate: 1 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.allow_mmap_reads: 0 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.allow_mmap_writes: 0 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.use_direct_reads: 0 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T00:38:27.547 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.create_missing_column_families: 0 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.db_log_dir: 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.wal_dir: 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.advise_random_on_open: 1 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.db_write_buffer_size: 0 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.write_buffer_manager: 0x55a30f012140 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T00:38:27.548 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.rate_limiter: (nil) 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.wal_recovery_mode: 2 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.enable_thread_tracking: 0 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.enable_pipelined_write: 0 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.unordered_write: 0 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.row_cache: None 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.wal_filter: None 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T00:38:27.549 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.allow_ingest_behind: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.two_write_queues: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.manual_wal_flush: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.wal_compression: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.atomic_flush: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.log_readahead_size: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.best_efforts_recovery: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.allow_data_in_errors: 0 2024-02-22T00:38:27.550 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.db_host_id: __hostname__ 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_background_jobs: 2 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_background_compactions: -1 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_subcompactions: 1 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_total_wal_size: 0 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T00:38:27.551 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_open_files: -1 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bytes_per_sync: 0 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_readahead_size: 0 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_background_flushes: -1 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Compression algorithms supported: 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: kZSTD supported: 0 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: kXpressCompression supported: 0 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: kLZ4HCCompression supported: 1 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: kZlibCompression supported: 1 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: kSnappyCompression supported: 1 2024-02-22T00:38:27.552 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: kLZ4Compression supported: 1 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: kBZip2Compression supported: 0 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000005 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.merge_operator: 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_filter: None 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_filter_factory: None 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.sst_partitioner_factory: None 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a30fda1480) 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: cache_index_and_filter_blocks: 1 2024-02-22T00:38:27.553 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: pin_top_level_index_and_filter: 1 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_type: 0 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_block_index_type: 0 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_shortening: 1 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: checksum: 4 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: no_block_cache: 0 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache: 0x55a30f0b31f0 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_name: BinnedLRUCache 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_options: 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: capacity : 536870912 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: num_shard_bits : 4 2024-02-22T00:38:27.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: strict_capacity_limit : 0 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: high_pri_pool_ratio: 0.000 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_cache_compressed: (nil) 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: persistent_cache: (nil) 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_size: 4096 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_size_deviation: 10 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_restart_interval: 16 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: index_block_restart_interval: 1 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: metadata_block_size: 4096 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: partition_filters: 0 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: use_delta_encoding: 1 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: filter_policy: bloomfilter 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: whole_key_filtering: 1 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: verify_compression: 0 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: read_amp_bytes_per_bit: 0 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: format_version: 5 2024-02-22T00:38:27.555 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_index_compression: 1 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: block_align: 0 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_auto_readahead_size: 262144 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: prepopulate_block_cache: 0 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: initial_auto_readahead_size: 8192 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: num_file_reads_for_auto_readahead: 2 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.write_buffer_size: 33554432 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_write_buffer_number: 2 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression: NoCompression 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression: Disabled 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.prefix_extractor: nullptr 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.num_levels: 7 2024-02-22T00:38:27.556 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-22T00:38:27.557 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.level: 32767 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.strategy: 0 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.enabled: false 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T00:38:27.558 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.target_file_size_base: 67108864 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T00:38:27.559 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.arena_block_size: 1048576 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.disable_auto_compactions: 0 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T00:38:27.560 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.table_properties_collectors: 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.inplace_update_support: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.bloom_locality: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.max_successive_merges: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.paranoid_file_checks: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.force_consistency_checks: 1 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.report_bg_io_stats: 0 2024-02-22T00:38:27.561 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.ttl: 2592000 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.enable_blob_files: false 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.min_blob_size: 0 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.blob_file_size: 268435456 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.blob_file_starting_level: 0 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 25.sst 2024-02-22T00:38:27.562 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi161/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 11883, log_number is 23,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 23 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a474cb95-ee58-430d-9c2c-8a142d6b1bcf 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708562307228151, "job": 1, "event": "recovery_started", "wal_files": [23]} 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #23 mode 2 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708562307246822, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 28, "file_size": 4588456, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11888, "largest_seqno": 12816, "table_properties": {"data_size": 4582524, "index_size": 4145, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 6483, "raw_average_key_size": 21, "raw_value_size": 4573583, "raw_average_value_size": 15044, "num_data_blocks": 182, "num_entries": 304, "num_filter_entries": 304, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708562307, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a474cb95-ee58-430d-9c2c-8a142d6b1bcf", "db_session_id": "ZBU4X5IAVTCPSE1TGBUM", "orig_file_number": 28, "seqno_to_time_mapping": "N/A"}} 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708562307246947, "job": 1, "event": "recovery_finished"} 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/version_set.cc:5047] Creating manifest 30 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi161/store.db/000023.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a30f150000 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: DB pointer 0x55a30f13e000 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** DB Stats ** 2024-02-22T00:38:27.563 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L0 1/0 4.38 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 603.7 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: L6 1/0 26.70 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Sum 2/0 31.07 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 603.7 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-02-22T00:38:27.564 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 603.7 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** Compaction Stats [default] ** 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 603.7 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T00:38:27.565 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Cumulative compaction: 0.00 GB write, 198.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Interval compaction: 0.00 GB write, 198.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Block cache BinnedLRUCache@0x55a30f0b31f0#7 capacity: 512.00 MB usage: 5.48 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000172853%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: starting mon.smithi161 rank 1 at public addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] at bind addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi161 fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: mon.smithi161@-1(???) e2 preinit fsid 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: mon.smithi161@-1(???).mds e16 new map 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: mon.smithi161@-1(???).mds e16 print_map 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: e16 2024-02-22T00:38:27.566 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: legacy client fscid: 1 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Filesystem 'cephfs' (1) 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: fs_name cephfs 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: epoch 16 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: tableserver 0 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: root 0 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: session_timeout 60 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: session_autoclose 300 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_file_size 1099511627776 2024-02-22T00:38:27.567 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_xattr_size 65536 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: required_client_features {} 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: last_failure 0 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: last_failure_osd_epoch 0 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: max_mds 2 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: in 0,1 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: up {0=14438,1=24271} 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: failed 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: damaged 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: stopped 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: data_pools [3] 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: metadata_pool 2 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: inline_data disabled 2024-02-22T00:38:27.568 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: balancer 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: bal_rank_mask -1 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: standby_count_wanted 1 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: Standby daemons: 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout: [mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: mon.smithi161@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: mon.smithi161@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: mon.smithi161@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T00:38:27.569 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: mon.smithi161@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T00:38:27.570 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 ceph-mon[113442]: mon.smithi161@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-22T00:38:27.570 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 bash[113404]: e7bd6d48df73517262ed2d01bf0a6f70397d2394be32c99b3c93acd0cf32b1f7 2024-02-22T00:38:27.570 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:27 smithi161 systemd[1]: Started Ceph mon.smithi161 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:38:28.553 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mkfs 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:38:28.554 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mkfs 9923b37e-d118-11ee-95bd-87774f69a715 2024-02-22T00:38:28.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:38:28.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:28.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:28.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:28.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:28.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Reconfiguring prometheus.smithi161 (dependencies changed)... 2024-02-22T00:38:28.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Reconfiguring daemon prometheus.smithi161 on smithi161 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Updating mgr.smithi161.sazlam 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Deploying daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all mgr 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all rgw 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all rbd-mirror 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all ceph-exporter 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all iscsi 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all nfs 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all nvmeof 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Updating node-exporter.smithi049 (1/2) 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Deploying daemon node-exporter.smithi049 on smithi049 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Updating node-exporter.smithi161 (2/2) 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Deploying daemon node-exporter.smithi161 on smithi161 2024-02-22T00:38:28.930 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Updating prometheus.smithi161 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Deploying daemon prometheus.smithi161 on smithi161 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Updating alertmanager.smithi049 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Deploying daemon alertmanager.smithi049 on smithi049 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Updating grafana.smithi049 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Deploying daemon grafana.smithi049 on smithi049 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Finalizing container_image settings 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Complete! 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v65: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v66: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v68: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v69: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.931 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v70: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v71: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v72: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v73: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:38:28.932 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Target is version 18.2.1-638-gc1dc18f4 (reef) 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0, digests ['quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0'] 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all mgr 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Updating mon.smithi049 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mon.smithi049 calling monitor election 2024-02-22T00:38:28.933 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mon.smithi049 is new leader, mons smithi049,smithi161 in quorum (ranks 0,1) 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: osdmap e47: 6 total, 6 up, 6 in 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mgrmap e31: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mgrmap e32: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: overall HEALTH_OK 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Standby manager daemon smithi161.sazlam restarted 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Standby manager daemon smithi161.sazlam started 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:38:28.934 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mgrmap e33: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Active manager daemon smithi049.rjblpr restarted 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Activating manager daemon smithi049.rjblpr 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: osdmap e48: 6 total, 6 up, 6 in 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mgrmap e34: smithi049.rjblpr(active, starting, since 0.00515539s), standbys: smithi161.sazlam 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: failed to encode map e48 with expected crc 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:38:28.935 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Manager daemon smithi049.rjblpr is now available 2024-02-22T00:38:28.936 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: failed to encode map e48 with expected crc 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: failed to encode map e48 with expected crc 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mgrmap e35: smithi049.rjblpr(active, since 1.01009s), standbys: smithi161.sazlam 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: [22/Feb/2024:00:38:13] ENGINE Bus STARTING 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: [22/Feb/2024:00:38:13] ENGINE Serving on http://172.21.15.49:8765 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: [22/Feb/2024:00:38:13] ENGINE Serving on https://172.21.15.49:7150 2024-02-22T00:38:28.937 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: [22/Feb/2024:00:38:13] ENGINE Bus STARTED 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mgrmap e36: smithi049.rjblpr(active, since 3s), standbys: smithi161.sazlam 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mgrmap e37: smithi049.rjblpr(active, since 4s), standbys: smithi161.sazlam 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.938 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Detected new or changed devices on smithi049 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:38:28.939 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T00:38:28.940 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Upgrade: Updating mon.smithi161 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: Deploying daemon mon.smithi161 on smithi161 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: overall HEALTH_OK 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mon.smithi161 calling monitor election 2024-02-22T00:38:28.941 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mon.smithi049 calling monitor election 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mon.smithi049 is new leader, mons smithi049,smithi161 in quorum (ranks 0,1) 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: monmap e3: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: osdmap e48: 6 total, 6 up, 6 in 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: mgrmap e37: smithi049.rjblpr(active, since 15s), standbys: smithi161.sazlam 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: overall HEALTH_OK 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:28.942 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:29.033 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:38:29.033 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:29.033 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:29.033 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:29.033 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:29.033 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Reconfiguring prometheus.smithi161 (dependencies changed)... 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Reconfiguring daemon prometheus.smithi161 on smithi161 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Updating mgr.smithi161.sazlam 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Deploying daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all mgr 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all rgw 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all rbd-mirror 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all ceph-exporter 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all iscsi 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all nfs 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all nvmeof 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Updating node-exporter.smithi049 (1/2) 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Deploying daemon node-exporter.smithi049 on smithi049 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Updating node-exporter.smithi161 (2/2) 2024-02-22T00:38:29.034 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Deploying daemon node-exporter.smithi161 on smithi161 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Updating prometheus.smithi161 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Deploying daemon prometheus.smithi161 on smithi161 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Updating alertmanager.smithi049 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Deploying daemon alertmanager.smithi049 on smithi049 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Updating grafana.smithi049 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Deploying daemon grafana.smithi049 on smithi049 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Finalizing container_image settings 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Complete! 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v65: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v66: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v68: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.035 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v69: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.036 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:38:29.036 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v70: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.036 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v71: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v72: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v73: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.037 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:c1dc18f444603397768fcb7c34a8488b10284df6 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Target is version 18.2.1-638-gc1dc18f4 (reef) 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0, digests ['quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0'] 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all mgr 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Updating mon.smithi049 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mon.smithi049 calling monitor election 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mon.smithi049 is new leader, mons smithi049,smithi161 in quorum (ranks 0,1) 2024-02-22T00:38:29.038 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: monmap e2: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: osdmap e47: 6 total, 6 up, 6 in 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mgrmap e31: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mgrmap e32: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: overall HEALTH_OK 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Standby manager daemon smithi161.sazlam restarted 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Standby manager daemon smithi161.sazlam started 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/crt"}]: dispatch 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi161.sazlam/key"}]: dispatch 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.? 172.21.15.161:0/3024598489' entity='mgr.smithi161.sazlam' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mgrmap e33: smithi049.rjblpr(active, since 2m), standbys: smithi161.sazlam 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Active manager daemon smithi049.rjblpr restarted 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Activating manager daemon smithi049.rjblpr 2024-02-22T00:38:29.039 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: osdmap e48: 6 total, 6 up, 6 in 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mgrmap e34: smithi049.rjblpr(active, starting, since 0.00515539s), standbys: smithi161.sazlam 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: failed to encode map e48 with expected crc 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi049.rjblpr", "id": "smithi049.rjblpr"}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr metadata", "who": "smithi161.sazlam", "id": "smithi161.sazlam"}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:38:29.040 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Manager daemon smithi049.rjblpr is now available 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/mirror_snapshot_schedule"}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi049.rjblpr/trash_purge_schedule"}]: dispatch 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: failed to encode map e48 with expected crc 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: failed to encode map e48 with expected crc 2024-02-22T00:38:29.041 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mgrmap e35: smithi049.rjblpr(active, since 1.01009s), standbys: smithi161.sazlam 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: [22/Feb/2024:00:38:13] ENGINE Bus STARTING 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: [22/Feb/2024:00:38:13] ENGINE Serving on http://172.21.15.49:8765 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: [22/Feb/2024:00:38:13] ENGINE Serving on https://172.21.15.49:7150 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: [22/Feb/2024:00:38:13] ENGINE Bus STARTED 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mgrmap e36: smithi049.rjblpr(active, since 3s), standbys: smithi161.sazlam 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mgrmap e37: smithi049.rjblpr(active, since 4s), standbys: smithi161.sazlam 2024-02-22T00:38:29.042 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Detected new or changed devices on smithi049 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi049:/etc/ceph/ceph.conf 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi161:/etc/ceph/ceph.conf 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.conf 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-02-22T00:38:29.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Updating smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/config/ceph.client.admin.keyring 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Upgrade: Updating mon.smithi161 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:29.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: Deploying daemon mon.smithi161 on smithi161 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: overall HEALTH_OK 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi049"}]: dispatch 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mon.smithi161 calling monitor election 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mon.smithi049 calling monitor election 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mon.smithi049 is new leader, mons smithi049,smithi161 in quorum (ranks 0,1) 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mon metadata", "id": "smithi161"}]: dispatch 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: monmap e3: 2 mons at {smithi049=[v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0],smithi161=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi161.wycpud=up:active} 2 up:standby 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: osdmap e48: 6 total, 6 up, 6 in 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: mgrmap e37: smithi049.rjblpr(active, since 15s), standbys: smithi161.sazlam 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: overall HEALTH_OK 2024-02-22T00:38:29.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:29.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:38:29.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:29 smithi049 ceph-mon[132694]: pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-22T00:38:30.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:29 smithi161 ceph-mon[113442]: pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-22T00:38:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:32 smithi049 ceph-mon[132694]: pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-22T00:38:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:32.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:32 smithi161 ceph-mon[113442]: pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-22T00:38:32.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:32.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:32.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:32.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.235+0000 7fb57a23c700 1 -- 172.21.15.49:0/3942407210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 msgr2=0x7fb5740fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.235+0000 7fb57a23c700 1 --2- 172.21.15.49:0/3942407210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 0x7fb5740fcbd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb5640047f0 tx=0x7fb564009cb0).stop 2024-02-22T00:38:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.235+0000 7fb57a23c700 1 -- 172.21.15.49:0/3942407210 shutdown_connections 2024-02-22T00:38:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.235+0000 7fb57a23c700 1 --2- 172.21.15.49:0/3942407210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5740fd150 0x7fb5740f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.235+0000 7fb57a23c700 1 --2- 172.21.15.49:0/3942407210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 0x7fb5740fcbd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.235+0000 7fb57a23c700 1 -- 172.21.15.49:0/3942407210 >> 172.21.15.49:0/3942407210 conn(0x7fb574070590 msgr2=0x7fb5740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:33.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.235+0000 7fb57a23c700 1 -- 172.21.15.49:0/3942407210 shutdown_connections 2024-02-22T00:38:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.235+0000 7fb57a23c700 1 -- 172.21.15.49:0/3942407210 wait complete. 2024-02-22T00:38:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb57a23c700 1 Processor -- start 2024-02-22T00:38:33.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb57a23c700 1 -- start start 2024-02-22T00:38:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb57a23c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 0x7fb5741091f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb57a23c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5740fd150 0x7fb5741096e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb57a23c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb574109bd0 con 0x7fb5740fc7f0 2024-02-22T00:38:33.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb57a23c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb574109d10 con 0x7fb5740fd150 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb5737fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 0x7fb5741091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb5737fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 0x7fb5741091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58258/0 (socket says 172.21.15.49:58258) 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.236+0000 7fb5737fe700 1 -- 172.21.15.49:0/3966047469 learned_addr learned my addr 172.21.15.49:0/3966047469 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb572ffd700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5740fd150 0x7fb5741096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb5737fe700 1 -- 172.21.15.49:0/3966047469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5740fd150 msgr2=0x7fb5741096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb5737fe700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5740fd150 0x7fb5741096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb5737fe700 1 -- 172.21.15.49:0/3966047469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564005040 con 0x7fb5740fc7f0 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb5737fe700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 0x7fb5741091f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb564009380 tx=0x7fb564009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb570ff9700 1 -- 172.21.15.49:0/3966047469 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb564018070 con 0x7fb5740fc7f0 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb570ff9700 1 -- 172.21.15.49:0/3966047469 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb564007e90 con 0x7fb5740fc7f0 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb574109f60 con 0x7fb5740fc7f0 2024-02-22T00:38:33.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb570ff9700 1 -- 172.21.15.49:0/3966047469 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5640123c0 con 0x7fb5740fc7f0 2024-02-22T00:38:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.237+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb574112550 con 0x7fb5740fc7f0 2024-02-22T00:38:33.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.238+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57405f590 con 0x7fb5740fc7f0 2024-02-22T00:38:33.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.239+0000 7fb570ff9700 1 -- 172.21.15.49:0/3966047469 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fb56401d420 con 0x7fb5740fc7f0 2024-02-22T00:38:33.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.239+0000 7fb570ff9700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb55c06cbc0 0x7fb55c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.239+0000 7fb570ff9700 1 -- 172.21.15.49:0/3966047469 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fb56408cc00 con 0x7fb5740fc7f0 2024-02-22T00:38:33.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.239+0000 7fb572ffd700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb55c06cbc0 0x7fb55c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.240+0000 7fb572ffd700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb55c06cbc0 0x7fb55c06f080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb574060ee0 tx=0x7fb56800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:33.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.244+0000 7fb570ff9700 1 -- 172.21.15.49:0/3966047469 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb564092020 con 0x7fb5740fc7f0 2024-02-22T00:38:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.463+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb574059120 con 0x7fb55c06cbc0 2024-02-22T00:38:33.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.465+0000 7fb570ff9700 1 -- 172.21.15.49:0/3966047469 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb574059120 con 0x7fb55c06cbc0 2024-02-22T00:38:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb55c06cbc0 msgr2=0x7fb55c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb55c06cbc0 0x7fb55c06f080 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb574060ee0 tx=0x7fb56800b040).stop 2024-02-22T00:38:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 msgr2=0x7fb5741091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 0x7fb5741091f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb564009380 tx=0x7fb564009cb0).stop 2024-02-22T00:38:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 shutdown_connections 2024-02-22T00:38:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb55c06cbc0 0x7fb55c06f080 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5740fc7f0 0x7fb5741091f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 --2- 172.21.15.49:0/3966047469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5740fd150 0x7fb5741096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 >> 172.21.15.49:0/3966047469 conn(0x7fb574070590 msgr2=0x7fb5740fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 shutdown_connections 2024-02-22T00:38:33.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.467+0000 7fb57a23c700 1 -- 172.21.15.49:0/3966047469 wait complete. 2024-02-22T00:38:33.479 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:38:33.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:33 smithi161 ceph-mon[113442]: pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.570+0000 7ff89aeaf700 1 -- 172.21.15.49:0/3877783722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 msgr2=0x7ff8940f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.570+0000 7ff89aeaf700 1 --2- 172.21.15.49:0/3877783722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 0x7ff8940f6930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff8800047f0 tx=0x7ff880009cb0).stop 2024-02-22T00:38:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.570+0000 7ff89aeaf700 1 -- 172.21.15.49:0/3877783722 shutdown_connections 2024-02-22T00:38:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.570+0000 7ff89aeaf700 1 --2- 172.21.15.49:0/3877783722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 0x7ff8940f6930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.570+0000 7ff89aeaf700 1 --2- 172.21.15.49:0/3877783722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8940fc7f0 0x7ff8940fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.570+0000 7ff89aeaf700 1 -- 172.21.15.49:0/3877783722 >> 172.21.15.49:0/3877783722 conn(0x7ff894070590 msgr2=0x7ff8940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.570+0000 7ff89aeaf700 1 -- 172.21.15.49:0/3877783722 shutdown_connections 2024-02-22T00:38:33.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.570+0000 7ff89aeaf700 1 -- 172.21.15.49:0/3877783722 wait complete. 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff89aeaf700 1 Processor -- start 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff89aeaf700 1 -- start start 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff89aeaf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8940fc7f0 0x7ff8941091f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff89aeaf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 0x7ff8941096e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff89aeaf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894109bd0 con 0x7ff8940fd150 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff89aeaf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894109d10 con 0x7ff8940fc7f0 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff893fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 0x7ff8941096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff893fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 0x7ff8941096e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58270/0 (socket says 172.21.15.49:58270) 2024-02-22T00:38:33.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff893fff700 1 -- 172.21.15.49:0/1688533621 learned_addr learned my addr 172.21.15.49:0/1688533621 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.571+0000 7ff898c4b700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8940fc7f0 0x7ff8941091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff893fff700 1 -- 172.21.15.49:0/1688533621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8940fc7f0 msgr2=0x7ff8941091f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff893fff700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8940fc7f0 0x7ff8941091f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff893fff700 1 -- 172.21.15.49:0/1688533621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880005040 con 0x7ff8940fd150 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff893fff700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 0x7ff8941096e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff880000c00 tx=0x7ff880009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff891ffb700 1 -- 172.21.15.49:0/1688533621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff880018070 con 0x7ff8940fd150 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff891ffb700 1 -- 172.21.15.49:0/1688533621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff880007e90 con 0x7ff8940fd150 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff891ffb700 1 -- 172.21.15.49:0/1688533621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88001de20 con 0x7ff8940fd150 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff894109f60 con 0x7ff8940fd150 2024-02-22T00:38:33.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.572+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff894112550 con 0x7ff8940fd150 2024-02-22T00:38:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.573+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89405f590 con 0x7ff8940fd150 2024-02-22T00:38:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.574+0000 7ff891ffb700 1 -- 172.21.15.49:0/1688533621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7ff88001d420 con 0x7ff8940fd150 2024-02-22T00:38:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.574+0000 7ff891ffb700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff88406cb60 0x7ff88406f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.574+0000 7ff891ffb700 1 -- 172.21.15.49:0/1688533621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7ff88008cac0 con 0x7ff8940fd150 2024-02-22T00:38:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.574+0000 7ff898c4b700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff88406cb60 0x7ff88406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.575+0000 7ff898c4b700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff88406cb60 0x7ff88406f020 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff888004ee0 tx=0x7ff88800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:33.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.579+0000 7ff891ffb700 1 -- 172.21.15.49:0/1688533621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff880056a10 con 0x7ff8940fd150 2024-02-22T00:38:33.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:33 smithi049 ceph-mon[132694]: pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:33.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.794+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff894059120 con 0x7ff88406cb60 2024-02-22T00:38:33.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.795+0000 7ff891ffb700 1 -- 172.21.15.49:0/1688533621 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff894059120 con 0x7ff88406cb60 2024-02-22T00:38:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff88406cb60 msgr2=0x7ff88406f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff88406cb60 0x7ff88406f020 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff888004ee0 tx=0x7ff88800b040).stop 2024-02-22T00:38:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 msgr2=0x7ff8941096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 0x7ff8941096e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff880000c00 tx=0x7ff880009cb0).stop 2024-02-22T00:38:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 shutdown_connections 2024-02-22T00:38:33.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff88406cb60 0x7ff88406f020 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8940fc7f0 0x7ff8941091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 --2- 172.21.15.49:0/1688533621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff8940fd150 0x7ff8941096e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 >> 172.21.15.49:0/1688533621 conn(0x7ff894070590 msgr2=0x7ff8940fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 shutdown_connections 2024-02-22T00:38:33.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.798+0000 7ff89aeaf700 1 -- 172.21.15.49:0/1688533621 wait complete. 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 -- 172.21.15.49:0/1183436605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 msgr2=0x7f750c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 --2- 172.21.15.49:0/1183436605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 0x7f750c0fdcd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f74fc0047f0 tx=0x7f74fc009cb0).stop 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 -- 172.21.15.49:0/1183436605 shutdown_connections 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 --2- 172.21.15.49:0/1183436605 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750c0fe250 0x7f750c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 --2- 172.21.15.49:0/1183436605 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 0x7f750c0fdcd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 -- 172.21.15.49:0/1183436605 >> 172.21.15.49:0/1183436605 conn(0x7f750c0f34b0 msgr2=0x7f750c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 -- 172.21.15.49:0/1183436605 shutdown_connections 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 -- 172.21.15.49:0/1183436605 wait complete. 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.900+0000 7f7511ece700 1 Processor -- start 2024-02-22T00:38:33.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f7511ece700 1 -- start start 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f7511ece700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 0x7f750c10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f7511ece700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750c0fe250 0x7f750c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f7511ece700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c10ead0 con 0x7f750c0fd8f0 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f7511ece700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c10ec10 con 0x7f750c0fe250 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 0x7f750c10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f750b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 0x7f750c10dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58294/0 (socket says 172.21.15.49:58294) 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f750b7fe700 1 -- 172.21.15.49:0/514419411 learned_addr learned my addr 172.21.15.49:0/514419411 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f750affd700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750c0fe250 0x7f750c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f750b7fe700 1 -- 172.21.15.49:0/514419411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750c0fe250 msgr2=0x7f750c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f750b7fe700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750c0fe250 0x7f750c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.901+0000 7f750b7fe700 1 -- 172.21.15.49:0/514419411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc005040 con 0x7f750c0fd8f0 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.902+0000 7f750b7fe700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 0x7f750c10dfe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f74fc00b120 tx=0x7f74fc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.902+0000 7f7508ff9700 1 -- 172.21.15.49:0/514419411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74fc00e030 con 0x7f750c0fd8f0 2024-02-22T00:38:33.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.902+0000 7f7508ff9700 1 -- 172.21.15.49:0/514419411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74fc007e90 con 0x7f750c0fd8f0 2024-02-22T00:38:33.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.902+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c108240 con 0x7f750c0fd8f0 2024-02-22T00:38:33.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.902+0000 7f7508ff9700 1 -- 172.21.15.49:0/514419411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74fc018070 con 0x7f750c0fd8f0 2024-02-22T00:38:33.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.902+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c1087a0 con 0x7f750c0fd8f0 2024-02-22T00:38:33.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.903+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c05f590 con 0x7f750c0fd8f0 2024-02-22T00:38:33.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.903+0000 7f7508ff9700 1 -- 172.21.15.49:0/514419411 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f74fc01d420 con 0x7f750c0fd8f0 2024-02-22T00:38:33.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.903+0000 7f7508ff9700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f806cbc0 0x7f74f806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:33.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.904+0000 7f7508ff9700 1 -- 172.21.15.49:0/514419411 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f74fc08d2a0 con 0x7f750c0fd8f0 2024-02-22T00:38:33.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.904+0000 7f750affd700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f806cbc0 0x7f74f806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:33.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.904+0000 7f750affd700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f806cbc0 0x7f74f806f080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f750c109920 tx=0x7f74f4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:33.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:33.908+0000 7f7508ff9700 1 -- 172.21.15.49:0/514419411 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f74fc05ac80 con 0x7f750c0fd8f0 2024-02-22T00:38:34.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.123+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f750c0ffc40 con 0x7f74f806cbc0 2024-02-22T00:38:34.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.134+0000 7f7508ff9700 1 -- 172.21.15.49:0/514419411 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f750c0ffc40 con 0x7f74f806cbc0 2024-02-22T00:38:34.136 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:38:34.136 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (106s) 17s ago 12m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:38:34.136 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (12m) 17s ago 12m 6639k - 16.2.14-550-geb66ed92 7403d1862307 e7b6500edd1a 2024-02-22T00:38:34.136 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (12m) 2s ago 12m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:38:34.136 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (92s) 17s ago 12m 82.0M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (7m) 17s ago 7m 15.5M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (7m) 17s ago 7m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (7m) 2s ago 7m 15.6M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (7m) 2s ago 7m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (3m) 17s ago 14m 467M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (2m) 2s ago 12m 447M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (29s) 17s ago 14m 26.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (7s) 2s ago 12m 26.3M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (2m) 17s ago 12m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (2m) 2s ago 12m 17.4M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (11m) 17s ago 11m 223M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (11m) 17s ago 11m 236M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:38:34.137 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (10m) 17s ago 10m 198M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:38:34.138 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (10m) 2s ago 10m 259M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:38:34.138 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (9m) 2s ago 9m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:38:34.138 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (9m) 2s ago 9m 220M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:38:34.138 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (2m) 2s ago 11m 54.5M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:38:34.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f806cbc0 msgr2=0x7f74f806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f806cbc0 0x7f74f806f080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f750c109920 tx=0x7f74f4009040).stop 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 msgr2=0x7f750c10dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 0x7f750c10dfe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f74fc00b120 tx=0x7f74fc009cb0).stop 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 shutdown_connections 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f806cbc0 0x7f74f806f080 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f750c0fd8f0 0x7f750c10dfe0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 --2- 172.21.15.49:0/514419411 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750c0fe250 0x7f750c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 >> 172.21.15.49:0/514419411 conn(0x7f750c0f34b0 msgr2=0x7f750c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 shutdown_connections 2024-02-22T00:38:34.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.136+0000 7f7511ece700 1 -- 172.21.15.49:0/514419411 wait complete. 2024-02-22T00:38:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.237+0000 7f7166343700 1 -- 172.21.15.49:0/2283365753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 msgr2=0x7f7160101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.237+0000 7f7166343700 1 --2- 172.21.15.49:0/2283365753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 0x7f7160101910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f71540047f0 tx=0x7f7154009cb0).stop 2024-02-22T00:38:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.237+0000 7f7166343700 1 -- 172.21.15.49:0/2283365753 shutdown_connections 2024-02-22T00:38:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.237+0000 7f7166343700 1 --2- 172.21.15.49:0/2283365753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 0x7f7160101910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.237+0000 7f7166343700 1 --2- 172.21.15.49:0/2283365753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71600f88a0 0x7f71600f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.237+0000 7f7166343700 1 -- 172.21.15.49:0/2283365753 >> 172.21.15.49:0/2283365753 conn(0x7f7160070590 msgr2=0x7f71600f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.237+0000 7f7166343700 1 -- 172.21.15.49:0/2283365753 shutdown_connections 2024-02-22T00:38:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.237+0000 7f7166343700 1 -- 172.21.15.49:0/2283365753 wait complete. 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f7166343700 1 Processor -- start 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f7166343700 1 -- start start 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f7166343700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71600f88a0 0x7f716010e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f7166343700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 0x7f716010e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f7166343700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716010ec80 con 0x7f71600f9200 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f7166343700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716010edc0 con 0x7f71600f88a0 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f715f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 0x7f716010e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f715f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 0x7f716010e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58302/0 (socket says 172.21.15.49:58302) 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f715f7fe700 1 -- 172.21.15.49:0/4237970965 learned_addr learned my addr 172.21.15.49:0/4237970965 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.238+0000 7f715ffff700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71600f88a0 0x7f716010e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f715f7fe700 1 -- 172.21.15.49:0/4237970965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71600f88a0 msgr2=0x7f716010e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f715f7fe700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71600f88a0 0x7f716010e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f715f7fe700 1 -- 172.21.15.49:0/4237970965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7154005040 con 0x7f71600f9200 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f715ffff700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71600f88a0 0x7f716010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f715f7fe700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 0x7f716010e680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7154009380 tx=0x7f7154009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f715d7fa700 1 -- 172.21.15.49:0/4237970965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7154018070 con 0x7f71600f9200 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71601083f0 con 0x7f71600f9200 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f715d7fa700 1 -- 172.21.15.49:0/4237970965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7154007e90 con 0x7f71600f9200 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f715d7fa700 1 -- 172.21.15.49:0/4237970965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71540123c0 con 0x7f71600f9200 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.239+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71601088d0 con 0x7f71600f9200 2024-02-22T00:38:34.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.240+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716005f590 con 0x7f71600f9200 2024-02-22T00:38:34.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.240+0000 7f715d7fa700 1 -- 172.21.15.49:0/4237970965 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f715401d420 con 0x7f71600f9200 2024-02-22T00:38:34.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.241+0000 7f715d7fa700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f714806cbc0 0x7f714806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.241+0000 7f715d7fa700 1 -- 172.21.15.49:0/4237970965 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f715408cb10 con 0x7f71600f9200 2024-02-22T00:38:34.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.241+0000 7f715ffff700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f714806cbc0 0x7f714806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.241+0000 7f715ffff700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f714806cbc0 0x7f714806f080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7150007bf0 tx=0x7f715000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.245+0000 7f715d7fa700 1 -- 172.21.15.49:0/4237970965 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f715405a4f0 con 0x7f71600f9200 2024-02-22T00:38:34.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.527+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7160109840 con 0x7f71600f9200 2024-02-22T00:38:34.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.527+0000 7f715d7fa700 1 -- 172.21.15.49:0/4237970965 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f715405a080 con 0x7f71600f9200 2024-02-22T00:38:34.529 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:38:34.530 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:38:34.531 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 10, 2024-02-22T00:38:34.531 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:38:34.531 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:38:34.531 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:38:34.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f714806cbc0 msgr2=0x7f714806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f714806cbc0 0x7f714806f080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7150007bf0 tx=0x7f715000b040).stop 2024-02-22T00:38:34.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 msgr2=0x7f716010e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 0x7f716010e680 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7154009380 tx=0x7f7154009cb0).stop 2024-02-22T00:38:34.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 shutdown_connections 2024-02-22T00:38:34.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f714806cbc0 0x7f714806f080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71600f88a0 0x7f716010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 --2- 172.21.15.49:0/4237970965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71600f9200 0x7f716010e680 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 >> 172.21.15.49:0/4237970965 conn(0x7f7160070590 msgr2=0x7f71601012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:34.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 shutdown_connections 2024-02-22T00:38:34.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.529+0000 7f7166343700 1 -- 172.21.15.49:0/4237970965 wait complete. 2024-02-22T00:38:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:34 smithi161 ceph-mon[113442]: from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:34 smithi161 ceph-mon[113442]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:34 smithi161 ceph-mon[113442]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.632+0000 7f837de5b700 1 -- 172.21.15.49:0/4035476943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 msgr2=0x7f83780fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.632+0000 7f837de5b700 1 --2- 172.21.15.49:0/4035476943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 0x7f83780fdcd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f83680047f0 tx=0x7f8368009cb0).stop 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.632+0000 7f837de5b700 1 -- 172.21.15.49:0/4035476943 shutdown_connections 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.632+0000 7f837de5b700 1 --2- 172.21.15.49:0/4035476943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83780fe250 0x7f83780f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.632+0000 7f837de5b700 1 --2- 172.21.15.49:0/4035476943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 0x7f83780fdcd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.632+0000 7f837de5b700 1 -- 172.21.15.49:0/4035476943 >> 172.21.15.49:0/4035476943 conn(0x7f83780f34b0 msgr2=0x7f83780f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.632+0000 7f837de5b700 1 -- 172.21.15.49:0/4035476943 shutdown_connections 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.632+0000 7f837de5b700 1 -- 172.21.15.49:0/4035476943 wait complete. 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f837de5b700 1 Processor -- start 2024-02-22T00:38:34.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f837de5b700 1 -- start start 2024-02-22T00:38:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f837de5b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 0x7f8378110200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f837de5b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83780fe250 0x7f83781106f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f837de5b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378110cf0 con 0x7f83780fd8f0 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f837de5b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8378110e30 con 0x7f83780fe250 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f83777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 0x7f8378110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f83777fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 0x7f8378110200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58314/0 (socket says 172.21.15.49:58314) 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f83777fe700 1 -- 172.21.15.49:0/3610564602 learned_addr learned my addr 172.21.15.49:0/3610564602 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f8376ffd700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83780fe250 0x7f83781106f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f83777fe700 1 -- 172.21.15.49:0/3610564602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83780fe250 msgr2=0x7f83781106f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f83777fe700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83780fe250 0x7f83781106f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.633+0000 7f83777fe700 1 -- 172.21.15.49:0/3610564602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368005040 con 0x7f83780fd8f0 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.634+0000 7f83777fe700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 0x7f8378110200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f83680043a0 tx=0x7f8368009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.634+0000 7f8374ff9700 1 -- 172.21.15.49:0/3610564602 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836800e030 con 0x7f83780fd8f0 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.634+0000 7f8374ff9700 1 -- 172.21.15.49:0/3610564602 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8368007e90 con 0x7f83780fd8f0 2024-02-22T00:38:34.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.634+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837810a460 con 0x7f83780fd8f0 2024-02-22T00:38:34.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.634+0000 7f8374ff9700 1 -- 172.21.15.49:0/3610564602 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8368018070 con 0x7f83780fd8f0 2024-02-22T00:38:34.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.634+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837810a9c0 con 0x7f83780fd8f0 2024-02-22T00:38:34.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.635+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837805fdb0 con 0x7f83780fd8f0 2024-02-22T00:38:34.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.635+0000 7f8374ff9700 1 -- 172.21.15.49:0/3610564602 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f836801d420 con 0x7f83780fd8f0 2024-02-22T00:38:34.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.636+0000 7f8374ff9700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f836006cb50 0x7f836006f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.636+0000 7f8374ff9700 1 -- 172.21.15.49:0/3610564602 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f836808d2c0 con 0x7f83780fd8f0 2024-02-22T00:38:34.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.636+0000 7f8376ffd700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f836006cb50 0x7f836006f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.636+0000 7f8376ffd700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f836006cb50 0x7f836006f010 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f837810bb40 tx=0x7f836c009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:34.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.640+0000 7f8374ff9700 1 -- 172.21.15.49:0/3610564602 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f836805aca0 con 0x7f83780fd8f0 2024-02-22T00:38:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:34 smithi049 ceph-mon[132694]: from='client.34124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:34 smithi049 ceph-mon[132694]: from='client.34128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:34 smithi049 ceph-mon[132694]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:34.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.881+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f837810b980 con 0x7f83780fd8f0 2024-02-22T00:38:34.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.881+0000 7f8374ff9700 1 -- 172.21.15.49:0/3610564602 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f836805a830 con 0x7f83780fd8f0 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:38:34.921 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:38:34.922 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:38:34.923 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:38:34.924 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:34.924 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:38:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f836006cb50 msgr2=0x7f836006f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f836006cb50 0x7f836006f010 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f837810bb40 tx=0x7f836c009d60).stop 2024-02-22T00:38:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 msgr2=0x7f8378110200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 0x7f8378110200 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f83680043a0 tx=0x7f8368009cb0).stop 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 shutdown_connections 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f836006cb50 0x7f836006f010 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83780fd8f0 0x7f8378110200 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 --2- 172.21.15.49:0/3610564602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83780fe250 0x7f83781106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 >> 172.21.15.49:0/3610564602 conn(0x7f83780f34b0 msgr2=0x7f837806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 shutdown_connections 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.883+0000 7f837de5b700 1 -- 172.21.15.49:0/3610564602 wait complete. 2024-02-22T00:38:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:38:34.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.986+0000 7fea8acde700 1 -- 172.21.15.49:0/1491226641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 msgr2=0x7fea840f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.986+0000 7fea8acde700 1 --2- 172.21.15.49:0/1491226641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 0x7fea840f8c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fea780047f0 tx=0x7fea78009cb0).stop 2024-02-22T00:38:34.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.986+0000 7fea8acde700 1 -- 172.21.15.49:0/1491226641 shutdown_connections 2024-02-22T00:38:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.986+0000 7fea8acde700 1 --2- 172.21.15.49:0/1491226641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea840f9200 0x7fea84101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.986+0000 7fea8acde700 1 --2- 172.21.15.49:0/1491226641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 0x7fea840f8c80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.986+0000 7fea8acde700 1 -- 172.21.15.49:0/1491226641 >> 172.21.15.49:0/1491226641 conn(0x7fea84070590 msgr2=0x7fea840f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.986+0000 7fea8acde700 1 -- 172.21.15.49:0/1491226641 shutdown_connections 2024-02-22T00:38:34.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.986+0000 7fea8acde700 1 -- 172.21.15.49:0/1491226641 wait complete. 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea8acde700 1 Processor -- start 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea8acde700 1 -- start start 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea8acde700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 0x7fea8410e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea8acde700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea840f9200 0x7fea8410e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea8acde700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8410eb10 con 0x7fea840f88a0 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea8acde700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8410ec50 con 0x7fea840f9200 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea88a7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 0x7fea8410e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea88a7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 0x7fea8410e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58338/0 (socket says 172.21.15.49:58338) 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea88a7a700 1 -- 172.21.15.49:0/3828999487 learned_addr learned my addr 172.21.15.49:0/3828999487 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea83fff700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea840f9200 0x7fea8410e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea88a7a700 1 -- 172.21.15.49:0/3828999487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea840f9200 msgr2=0x7fea8410e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:34.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea88a7a700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea840f9200 0x7fea8410e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea88a7a700 1 -- 172.21.15.49:0/3828999487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78005040 con 0x7fea840f88a0 2024-02-22T00:38:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.987+0000 7fea83fff700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea840f9200 0x7fea8410e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:38:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.988+0000 7fea88a7a700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 0x7fea8410e020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fea78005010 tx=0x7fea78009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.988+0000 7fea81ffb700 1 -- 172.21.15.49:0/3828999487 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7800e030 con 0x7fea840f88a0 2024-02-22T00:38:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.988+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea84108280 con 0x7fea840f88a0 2024-02-22T00:38:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.988+0000 7fea81ffb700 1 -- 172.21.15.49:0/3828999487 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea78007e90 con 0x7fea840f88a0 2024-02-22T00:38:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.988+0000 7fea81ffb700 1 -- 172.21.15.49:0/3828999487 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea78018070 con 0x7fea840f88a0 2024-02-22T00:38:34.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.988+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea84108760 con 0x7fea840f88a0 2024-02-22T00:38:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.989+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8405f590 con 0x7fea840f88a0 2024-02-22T00:38:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.990+0000 7fea81ffb700 1 -- 172.21.15.49:0/3828999487 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fea7801d6e0 con 0x7fea840f88a0 2024-02-22T00:38:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.990+0000 7fea81ffb700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea7406cb60 0x7fea7406f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.990+0000 7fea81ffb700 1 -- 172.21.15.49:0/3828999487 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fea7808d2a0 con 0x7fea840f88a0 2024-02-22T00:38:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.990+0000 7fea83fff700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea7406cb60 0x7fea7406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:34.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.991+0000 7fea83fff700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea7406cb60 0x7fea7406f020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fea84109960 tx=0x7fea7000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:34.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:34.995+0000 7fea81ffb700 1 -- 172.21.15.49:0/3828999487 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fea7805ac80 con 0x7fea840f88a0 2024-02-22T00:38:35.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.212+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea841097b0 con 0x7fea7406cb60 2024-02-22T00:38:35.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.213+0000 7fea81ffb700 1 -- 172.21.15.49:0/3828999487 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fea841097b0 con 0x7fea7406cb60 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "mon" 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "4/21 daemons upgraded", 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mon daemons", 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:38:35.216 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.215+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea7406cb60 msgr2=0x7fea7406f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.215+0000 7fea8acde700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea7406cb60 0x7fea7406f020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fea84109960 tx=0x7fea7000b040).stop 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.215+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 msgr2=0x7fea8410e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.215+0000 7fea8acde700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 0x7fea8410e020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fea78005010 tx=0x7fea78009cb0).stop 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.216+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 shutdown_connections 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.216+0000 7fea8acde700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea7406cb60 0x7fea7406f020 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.216+0000 7fea8acde700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea840f88a0 0x7fea8410e020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.216+0000 7fea8acde700 1 --2- 172.21.15.49:0/3828999487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea840f9200 0x7fea8410e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.216+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 >> 172.21.15.49:0/3828999487 conn(0x7fea84070590 msgr2=0x7fea840fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:35.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.216+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 shutdown_connections 2024-02-22T00:38:35.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.216+0000 7fea8acde700 1 -- 172.21.15.49:0/3828999487 wait complete. 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.320+0000 7fdd5d450700 1 -- 172.21.15.49:0/1691781166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 msgr2=0x7fdd580fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.320+0000 7fdd5d450700 1 --2- 172.21.15.49:0/1691781166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 0x7fdd580fcbd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fdd480047f0 tx=0x7fdd48009cb0).stop 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.320+0000 7fdd5d450700 1 -- 172.21.15.49:0/1691781166 shutdown_connections 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.320+0000 7fdd5d450700 1 --2- 172.21.15.49:0/1691781166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd580fd150 0x7fdd580f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.320+0000 7fdd5d450700 1 --2- 172.21.15.49:0/1691781166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 0x7fdd580fcbd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.320+0000 7fdd5d450700 1 -- 172.21.15.49:0/1691781166 >> 172.21.15.49:0/1691781166 conn(0x7fdd58070590 msgr2=0x7fdd580f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.320+0000 7fdd5d450700 1 -- 172.21.15.49:0/1691781166 shutdown_connections 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.320+0000 7fdd5d450700 1 -- 172.21.15.49:0/1691781166 wait complete. 2024-02-22T00:38:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd5d450700 1 Processor -- start 2024-02-22T00:38:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd5d450700 1 -- start start 2024-02-22T00:38:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd5d450700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 0x7fdd58107d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd5d450700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd580fd150 0x7fdd58108270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd5d450700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58106010 con 0x7fdd580fc7f0 2024-02-22T00:38:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd5d450700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58106150 con 0x7fdd580fd150 2024-02-22T00:38:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd56ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 0x7fdd58107d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd56ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 0x7fdd58107d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58360/0 (socket says 172.21.15.49:58360) 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd56ffd700 1 -- 172.21.15.49:0/993996687 learned_addr learned my addr 172.21.15.49:0/993996687 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.321+0000 7fdd567fc700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd580fd150 0x7fdd58108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd56ffd700 1 -- 172.21.15.49:0/993996687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd580fd150 msgr2=0x7fdd58108270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd56ffd700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd580fd150 0x7fdd58108270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd56ffd700 1 -- 172.21.15.49:0/993996687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48005040 con 0x7fdd580fc7f0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd56ffd700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 0x7fdd58107d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdd48005010 tx=0x7fdd48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd3ffff700 1 -- 172.21.15.49:0/993996687 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd4800e030 con 0x7fdd580fc7f0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd3ffff700 1 -- 172.21.15.49:0/993996687 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd48007e90 con 0x7fdd580fc7f0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd3ffff700 1 -- 172.21.15.49:0/993996687 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd48018070 con 0x7fdd580fc7f0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd581063d0 con 0x7fdd580fc7f0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.322+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd58106930 con 0x7fdd580fc7f0 2024-02-22T00:38:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.323+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5805f590 con 0x7fdd580fc7f0 2024-02-22T00:38:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.324+0000 7fdd3ffff700 1 -- 172.21.15.49:0/993996687 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fdd4801d670 con 0x7fdd580fc7f0 2024-02-22T00:38:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.324+0000 7fdd3ffff700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4006cbc0 0x7fdd4006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:38:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.324+0000 7fdd3ffff700 1 -- 172.21.15.49:0/993996687 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fdd4808d1f0 con 0x7fdd580fc7f0 2024-02-22T00:38:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.324+0000 7fdd567fc700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4006cbc0 0x7fdd4006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:38:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.325+0000 7fdd567fc700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4006cbc0 0x7fdd4006f080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdd58107710 tx=0x7fdd4c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:38:35.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.329+0000 7fdd3ffff700 1 -- 172.21.15.49:0/993996687 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdd48057080 con 0x7fdd580fc7f0 2024-02-22T00:38:35.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:35.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4237970965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:35.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3610564602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:38:35.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: Detected new or changed devices on smithi161 2024-02-22T00:38:35.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:35.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:35.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:35.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:38:35.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:35 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.625+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdd58047540 con 0x7fdd580fc7f0 2024-02-22T00:38:35.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.625+0000 7fdd3ffff700 1 -- 172.21.15.49:0/993996687 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdd4805a6a0 con 0x7fdd580fc7f0 2024-02-22T00:38:35.627 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_OK 2024-02-22T00:38:35.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4006cbc0 msgr2=0x7fdd4006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:35.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4006cbc0 0x7fdd4006f080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fdd58107710 tx=0x7fdd4c00b040).stop 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 msgr2=0x7fdd58107d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 0x7fdd58107d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdd48005010 tx=0x7fdd48009cb0).stop 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 shutdown_connections 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4006cbc0 0x7fdd4006f080 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd580fc7f0 0x7fdd58107d80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 --2- 172.21.15.49:0/993996687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd580fd150 0x7fdd58108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 >> 172.21.15.49:0/993996687 conn(0x7fdd58070590 msgr2=0x7fdd580fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 shutdown_connections 2024-02-22T00:38:35.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:38:35.627+0000 7fdd5d450700 1 -- 172.21.15.49:0/993996687 wait complete. 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4237970965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3610564602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: Detected new or changed devices on smithi161 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:38:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:35 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:36 smithi161 ceph-mon[113442]: from='client.34144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:36 smithi161 ceph-mon[113442]: Reconfiguring mon.smithi049 (monmap changed)... 2024-02-22T00:38:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:36 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:36.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:36 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:36.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:36 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:36.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:36 smithi161 ceph-mon[113442]: Reconfiguring daemon mon.smithi049 on smithi049 2024-02-22T00:38:36.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:36 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/993996687' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:38:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:36 smithi049 ceph-mon[132694]: from='client.34144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:38:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:36 smithi049 ceph-mon[132694]: Reconfiguring mon.smithi049 (monmap changed)... 2024-02-22T00:38:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:36 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:36 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:36 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:36 smithi049 ceph-mon[132694]: Reconfiguring daemon mon.smithi049 on smithi049 2024-02-22T00:38:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:36 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/993996687' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:38:38.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:37 smithi161 ceph-mon[113442]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:38.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:38.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:38.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:37 smithi161 ceph-mon[113442]: Reconfiguring mgr.smithi049.rjblpr (monmap changed)... 2024-02-22T00:38:38.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rjblpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:38:38.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:38:38.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:38.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:37 smithi161 ceph-mon[113442]: Reconfiguring daemon mgr.smithi049.rjblpr on smithi049 2024-02-22T00:38:38.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:37 smithi049 ceph-mon[132694]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:38.150 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:38.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:38.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:37 smithi049 ceph-mon[132694]: Reconfiguring mgr.smithi049.rjblpr (monmap changed)... 2024-02-22T00:38:38.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi049.rjblpr", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:38:38.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:38:38.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:38.151 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:37 smithi049 ceph-mon[132694]: Reconfiguring daemon mgr.smithi049.rjblpr on smithi049 2024-02-22T00:38:39.301 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:39 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:39.301 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:39 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:39.301 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:39 smithi049 ceph-mon[132694]: Reconfiguring crash.smithi049 (monmap changed)... 2024-02-22T00:38:39.301 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:39 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:38:39.301 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:39 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:39.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:39 smithi049 ceph-mon[132694]: Reconfiguring daemon crash.smithi049 on smithi049 2024-02-22T00:38:39.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:39 smithi049 ceph-mon[132694]: pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:39 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:39 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:39 smithi161 ceph-mon[113442]: Reconfiguring crash.smithi049 (monmap changed)... 2024-02-22T00:38:39.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:39 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:38:39.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:39 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:39.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:39 smithi161 ceph-mon[113442]: Reconfiguring daemon crash.smithi049 on smithi049 2024-02-22T00:38:39.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:39 smithi161 ceph-mon[113442]: pgmap v16: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:40.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:40 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:40.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:40 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:40.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:40 smithi049 ceph-mon[132694]: Reconfiguring osd.0 (monmap changed)... 2024-02-22T00:38:40.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:40 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T00:38:40.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:40 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:40.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:40 smithi049 ceph-mon[132694]: Reconfiguring daemon osd.0 on smithi049 2024-02-22T00:38:41.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:40 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:41.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:40 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:41.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:40 smithi161 ceph-mon[113442]: Reconfiguring osd.0 (monmap changed)... 2024-02-22T00:38:41.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:40 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T00:38:41.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:40 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:41.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:40 smithi161 ceph-mon[113442]: Reconfiguring daemon osd.0 on smithi049 2024-02-22T00:38:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:42 smithi049 ceph-mon[132694]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:42 smithi049 ceph-mon[132694]: Reconfiguring osd.1 (monmap changed)... 2024-02-22T00:38:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T00:38:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:42.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:42 smithi049 ceph-mon[132694]: Reconfiguring daemon osd.1 on smithi049 2024-02-22T00:38:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:42 smithi161 ceph-mon[113442]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:42 smithi161 ceph-mon[113442]: Reconfiguring osd.1 (monmap changed)... 2024-02-22T00:38:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T00:38:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:42 smithi161 ceph-mon[113442]: Reconfiguring daemon osd.1 on smithi049 2024-02-22T00:38:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:38:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T00:38:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:38:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T00:38:43.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:44.407 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:44 smithi049 ceph-mon[132694]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:44.408 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:44 smithi049 ceph-mon[132694]: Reconfiguring osd.2 (monmap changed)... 2024-02-22T00:38:44.408 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:44 smithi049 ceph-mon[132694]: Reconfiguring daemon osd.2 on smithi049 2024-02-22T00:38:44.408 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:44.408 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:44.408 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.vwomak", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:38:44.408 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:44 smithi161 ceph-mon[113442]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:44 smithi161 ceph-mon[113442]: Reconfiguring osd.2 (monmap changed)... 2024-02-22T00:38:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:44 smithi161 ceph-mon[113442]: Reconfiguring daemon osd.2 on smithi049 2024-02-22T00:38:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:44.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:44.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.vwomak", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:38:44.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:45.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:45 smithi049 ceph-mon[132694]: Reconfiguring mds.cephfs.smithi049.vwomak (monmap changed)... 2024-02-22T00:38:45.303 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:45 smithi049 ceph-mon[132694]: Reconfiguring daemon mds.cephfs.smithi049.vwomak on smithi049 2024-02-22T00:38:45.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:45 smithi161 ceph-mon[113442]: Reconfiguring mds.cephfs.smithi049.vwomak (monmap changed)... 2024-02-22T00:38:45.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:45 smithi161 ceph-mon[113442]: Reconfiguring daemon mds.cephfs.smithi049.vwomak on smithi049 2024-02-22T00:38:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:46 smithi049 ceph-mon[132694]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.rrqshp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:38:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:46 smithi161 ceph-mon[113442]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.rrqshp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:38:46.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:47.403 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:47 smithi161 ceph-mon[113442]: Reconfiguring mds.cephfs.smithi049.rrqshp (monmap changed)... 2024-02-22T00:38:47.403 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:47 smithi161 ceph-mon[113442]: Reconfiguring daemon mds.cephfs.smithi049.rrqshp on smithi049 2024-02-22T00:38:47.403 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:47 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:47.403 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:47 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:47.403 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:47 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:38:47.403 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:47 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:47 smithi049 ceph-mon[132694]: Reconfiguring mds.cephfs.smithi049.rrqshp (monmap changed)... 2024-02-22T00:38:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:47 smithi049 ceph-mon[132694]: Reconfiguring daemon mds.cephfs.smithi049.rrqshp on smithi049 2024-02-22T00:38:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:47 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:47 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:47 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:38:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:47 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:48 smithi049 ceph-mon[132694]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:48 smithi049 ceph-mon[132694]: Reconfiguring crash.smithi161 (monmap changed)... 2024-02-22T00:38:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:48 smithi049 ceph-mon[132694]: Reconfiguring daemon crash.smithi161 on smithi161 2024-02-22T00:38:48.446 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:48 smithi161 ceph-mon[113442]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:48.446 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:48 smithi161 ceph-mon[113442]: Reconfiguring crash.smithi161 (monmap changed)... 2024-02-22T00:38:48.446 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:48 smithi161 ceph-mon[113442]: Reconfiguring daemon crash.smithi161 on smithi161 2024-02-22T00:38:49.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:49 smithi161 ceph-mon[113442]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:49.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:49 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:49.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:49 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:49.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:49 smithi161 ceph-mon[113442]: Reconfiguring mgr.smithi161.sazlam (monmap changed)... 2024-02-22T00:38:49.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:49 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:38:49.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:49 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:38:49.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:49 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:49.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:49 smithi161 ceph-mon[113442]: Reconfiguring daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:38:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:49 smithi049 ceph-mon[132694]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:49 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:49 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:49 smithi049 ceph-mon[132694]: Reconfiguring mgr.smithi161.sazlam (monmap changed)... 2024-02-22T00:38:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:49 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi161.sazlam", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T00:38:49.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:49 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T00:38:49.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:49 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:49.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:49 smithi049 ceph-mon[132694]: Reconfiguring daemon mgr.smithi161.sazlam on smithi161 2024-02-22T00:38:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:51 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:51 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:51 smithi049 ceph-mon[132694]: Reconfiguring mon.smithi161 (monmap changed)... 2024-02-22T00:38:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:51 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:51 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:51 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:51 smithi049 ceph-mon[132694]: Reconfiguring daemon mon.smithi161 on smithi161 2024-02-22T00:38:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:51 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:51 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:51 smithi161 ceph-mon[113442]: Reconfiguring mon.smithi161 (monmap changed)... 2024-02-22T00:38:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:51 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T00:38:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:51 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T00:38:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:51 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:51 smithi161 ceph-mon[113442]: Reconfiguring daemon mon.smithi161 on smithi161 2024-02-22T00:38:52.385 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:52 smithi161 ceph-mon[113442]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:52.386 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:52 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:52.386 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:52 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:52.386 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:52 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T00:38:52.386 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:52 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:52 smithi049 ceph-mon[132694]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:52 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:52 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:52 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T00:38:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:52 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:53.208 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:53 smithi161 ceph-mon[113442]: Reconfiguring osd.3 (monmap changed)... 2024-02-22T00:38:53.208 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:53 smithi161 ceph-mon[113442]: Reconfiguring daemon osd.3 on smithi161 2024-02-22T00:38:53.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:53 smithi049 ceph-mon[132694]: Reconfiguring osd.3 (monmap changed)... 2024-02-22T00:38:53.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:53 smithi049 ceph-mon[132694]: Reconfiguring daemon osd.3 on smithi161 2024-02-22T00:38:54.424 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:54 smithi161 ceph-mon[113442]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:54.424 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:54 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:54.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:54 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:54.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:54 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T00:38:54.425 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:54 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:54 smithi049 ceph-mon[132694]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:54 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:54 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:54 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T00:38:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:54 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:55.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:55 smithi049 ceph-mon[132694]: Reconfiguring osd.4 (monmap changed)... 2024-02-22T00:38:55.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:55 smithi049 ceph-mon[132694]: Reconfiguring daemon osd.4 on smithi161 2024-02-22T00:38:55.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:55 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:55.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:55 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:55.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:55 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T00:38:55.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:55 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:55.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:55 smithi161 ceph-mon[113442]: Reconfiguring osd.4 (monmap changed)... 2024-02-22T00:38:55.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:55 smithi161 ceph-mon[113442]: Reconfiguring daemon osd.4 on smithi161 2024-02-22T00:38:55.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:55 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:55.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:55 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:55.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:55 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T00:38:55.510 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:55 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:56 smithi049 ceph-mon[132694]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:56 smithi049 ceph-mon[132694]: Reconfiguring osd.5 (monmap changed)... 2024-02-22T00:38:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:56 smithi049 ceph-mon[132694]: Reconfiguring daemon osd.5 on smithi161 2024-02-22T00:38:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:56 smithi161 ceph-mon[113442]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:56 smithi161 ceph-mon[113442]: Reconfiguring osd.5 (monmap changed)... 2024-02-22T00:38:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:56 smithi161 ceph-mon[113442]: Reconfiguring daemon osd.5 on smithi161 2024-02-22T00:38:57.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:57 smithi161 ceph-mon[113442]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:57.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:57.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:57.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:57 smithi161 ceph-mon[113442]: Reconfiguring mds.cephfs.smithi161.wycpud (monmap changed)... 2024-02-22T00:38:57.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.wycpud", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:38:57.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:57.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:57 smithi161 ceph-mon[113442]: Reconfiguring daemon mds.cephfs.smithi161.wycpud on smithi161 2024-02-22T00:38:57.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:38:58.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:57 smithi049 ceph-mon[132694]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:38:58.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:58.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:58.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:57 smithi049 ceph-mon[132694]: Reconfiguring mds.cephfs.smithi161.wycpud (monmap changed)... 2024-02-22T00:38:58.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.wycpud", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:38:58.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:58.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:57 smithi049 ceph-mon[132694]: Reconfiguring daemon mds.cephfs.smithi161.wycpud on smithi161 2024-02-22T00:38:58.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:38:59.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:59 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:59.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:59 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:59.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:59 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.plrhpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:38:59.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:38:59 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:38:59.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:59 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:59.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:59 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:38:59.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:59 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.plrhpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:38:59.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:38:59 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: Reconfiguring mds.cephfs.smithi161.plrhpg (monmap changed)... 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: Reconfiguring daemon mds.cephfs.smithi161.plrhpg on smithi161 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all mon 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]: dispatch 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]': finished 2024-02-22T00:39:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]: dispatch 2024-02-22T00:39:00.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:00 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]': finished 2024-02-22T00:39:00.556 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: Reconfiguring mds.cephfs.smithi161.plrhpg (monmap changed)... 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: Reconfiguring daemon mds.cephfs.smithi161.plrhpg on smithi161 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all mon 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]: dispatch 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi049"}]': finished 2024-02-22T00:39:00.557 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]: dispatch 2024-02-22T00:39:00.558 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:00 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi161"}]': finished 2024-02-22T00:39:01.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:01 smithi161 ceph-mon[113442]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:01 smithi049 ceph-mon[132694]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:02 smithi049 ceph-mon[132694]: Upgrade: Updating crash.smithi049 (1/2) 2024-02-22T00:39:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:02 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:02 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:39:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:02 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:02 smithi049 ceph-mon[132694]: Deploying daemon crash.smithi049 on smithi049 2024-02-22T00:39:02.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:02 smithi161 ceph-mon[113442]: Upgrade: Updating crash.smithi049 (1/2) 2024-02-22T00:39:02.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:02 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:02.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:02 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi049", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:39:02.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:02 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:02.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:02 smithi161 ceph-mon[113442]: Deploying daemon crash.smithi049 on smithi049 2024-02-22T00:39:03.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:03 smithi049 ceph-mon[132694]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:03.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:03 smithi161 ceph-mon[113442]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.746+0000 7fc7bc829700 1 -- 172.21.15.49:0/1869728046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fd8f0 msgr2=0x7fc7b80fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.746+0000 7fc7bc829700 1 --2- 172.21.15.49:0/1869728046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fd8f0 0x7fc7b80fdcd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc7a80047f0 tx=0x7fc7a8009cb0).stop 2024-02-22T00:39:05.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.746+0000 7fc7bc829700 1 -- 172.21.15.49:0/1869728046 shutdown_connections 2024-02-22T00:39:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.746+0000 7fc7bc829700 1 --2- 172.21.15.49:0/1869728046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80fe250 0x7fc7b80f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.746+0000 7fc7bc829700 1 --2- 172.21.15.49:0/1869728046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fd8f0 0x7fc7b80fdcd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.746+0000 7fc7bc829700 1 -- 172.21.15.49:0/1869728046 >> 172.21.15.49:0/1869728046 conn(0x7fc7b80f34b0 msgr2=0x7fc7b80f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.746+0000 7fc7bc829700 1 -- 172.21.15.49:0/1869728046 shutdown_connections 2024-02-22T00:39:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.746+0000 7fc7bc829700 1 -- 172.21.15.49:0/1869728046 wait complete. 2024-02-22T00:39:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.747+0000 7fc7bc829700 1 Processor -- start 2024-02-22T00:39:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.747+0000 7fc7bc829700 1 -- start start 2024-02-22T00:39:05.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.747+0000 7fc7bc829700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80fd8f0 0x7fc7b810e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.747+0000 7fc7bc829700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fe250 0x7fc7b810e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.747+0000 7fc7bc829700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b810ec00 con 0x7fc7b80fe250 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.747+0000 7fc7bc829700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b810ed40 con 0x7fc7b80fd8f0 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fe250 0x7fc7b810e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fe250 0x7fc7b810e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44800/0 (socket says 172.21.15.49:44800) 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b5d9b700 1 -- 172.21.15.49:0/2895031181 learned_addr learned my addr 172.21.15.49:0/2895031181 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b659c700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80fd8f0 0x7fc7b810e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b5d9b700 1 -- 172.21.15.49:0/2895031181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80fd8f0 msgr2=0x7fc7b810e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:05.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b5d9b700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80fd8f0 0x7fc7b810e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b5d9b700 1 -- 172.21.15.49:0/2895031181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8005040 con 0x7fc7b80fe250 2024-02-22T00:39:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b659c700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80fd8f0 0x7fc7b810e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:39:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7b5d9b700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fe250 0x7fc7b810e600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc7ac00e940 tx=0x7fc7ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7a77fe700 1 -- 172.21.15.49:0/2895031181 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7ac007b40 con 0x7fc7b80fe250 2024-02-22T00:39:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7a77fe700 1 -- 172.21.15.49:0/2895031181 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc7ac00f040 con 0x7fc7b80fe250 2024-02-22T00:39:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b8108370 con 0x7fc7b80fe250 2024-02-22T00:39:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7a77fe700 1 -- 172.21.15.49:0/2895031181 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7ac0148e0 con 0x7fc7b80fe250 2024-02-22T00:39:05.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.748+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b8108930 con 0x7fc7b80fe250 2024-02-22T00:39:05.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.750+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b805f590 con 0x7fc7b80fe250 2024-02-22T00:39:05.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.750+0000 7fc7a77fe700 1 -- 172.21.15.49:0/2895031181 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fc7ac007ca0 con 0x7fc7b80fe250 2024-02-22T00:39:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.750+0000 7fc7a77fe700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006cbc0 0x7fc7a006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.751+0000 7fc7a77fe700 1 -- 172.21.15.49:0/2895031181 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fc7ac08b8f0 con 0x7fc7b80fe250 2024-02-22T00:39:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.751+0000 7fc7b659c700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006cbc0 0x7fc7a006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:05.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.751+0000 7fc7b659c700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006cbc0 0x7fc7a006f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc7a80047c0 tx=0x7fc7a8009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.755+0000 7fc7a77fe700 1 -- 172.21.15.49:0/2895031181 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc7ac0592d0 con 0x7fc7b80fe250 2024-02-22T00:39:05.883 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:05 smithi161 ceph-mon[113442]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:05.883 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:05 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:05.883 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:05 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:05.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.971+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7b8108ba0 con 0x7fc7a006cbc0 2024-02-22T00:39:05.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.973+0000 7fc7a77fe700 1 -- 172.21.15.49:0/2895031181 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc7b8108ba0 con 0x7fc7a006cbc0 2024-02-22T00:39:05.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006cbc0 msgr2=0x7fc7a006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:05.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006cbc0 0x7fc7a006f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc7a80047c0 tx=0x7fc7a8009cb0).stop 2024-02-22T00:39:05.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fe250 msgr2=0x7fc7b810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:05.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fe250 0x7fc7b810e600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc7ac00e940 tx=0x7fc7ac00b040).stop 2024-02-22T00:39:05.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 shutdown_connections 2024-02-22T00:39:05.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006cbc0 0x7fc7a006f080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:05.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b80fd8f0 0x7fc7b810e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:05.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 --2- 172.21.15.49:0/2895031181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b80fe250 0x7fc7b810e600 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:05.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 >> 172.21.15.49:0/2895031181 conn(0x7fc7b80f34b0 msgr2=0x7fc7b80fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:05.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 shutdown_connections 2024-02-22T00:39:05.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:05.975+0000 7fc7bc829700 1 -- 172.21.15.49:0/2895031181 wait complete. 2024-02-22T00:39:05.987 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:39:06.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.078+0000 7f99a4ecf700 1 -- 172.21.15.49:0/3809231668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fc7f0 msgr2=0x7f99a00fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.078+0000 7f99a4ecf700 1 --2- 172.21.15.49:0/3809231668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fc7f0 0x7f99a00fcbd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f99900047f0 tx=0x7f9990009cb0).stop 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.078+0000 7f99a4ecf700 1 -- 172.21.15.49:0/3809231668 shutdown_connections 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.078+0000 7f99a4ecf700 1 --2- 172.21.15.49:0/3809231668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a00fd150 0x7f99a00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.078+0000 7f99a4ecf700 1 --2- 172.21.15.49:0/3809231668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fc7f0 0x7f99a00fcbd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.078+0000 7f99a4ecf700 1 -- 172.21.15.49:0/3809231668 >> 172.21.15.49:0/3809231668 conn(0x7f99a0070590 msgr2=0x7f99a00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.078+0000 7f99a4ecf700 1 -- 172.21.15.49:0/3809231668 shutdown_connections 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.078+0000 7f99a4ecf700 1 -- 172.21.15.49:0/3809231668 wait complete. 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f99a4ecf700 1 Processor -- start 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f99a4ecf700 1 -- start start 2024-02-22T00:39:06.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f99a4ecf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a00fc7f0 0x7f99a01090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f99a4ecf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fd150 0x7f99a01095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f99a4ecf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0109ad0 con 0x7f99a00fd150 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f99a4ecf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0109c10 con 0x7f99a00fc7f0 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f999dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fd150 0x7f99a01095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f999dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fd150 0x7f99a01095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44820/0 (socket says 172.21.15.49:44820) 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f999dd9b700 1 -- 172.21.15.49:0/1176494366 learned_addr learned my addr 172.21.15.49:0/1176494366 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f999e59c700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a00fc7f0 0x7f99a01090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f999dd9b700 1 -- 172.21.15.49:0/1176494366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a00fc7f0 msgr2=0x7f99a01090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f999dd9b700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a00fc7f0 0x7f99a01090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.079+0000 7f999dd9b700 1 -- 172.21.15.49:0/1176494366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990005040 con 0x7f99a00fd150 2024-02-22T00:39:06.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.080+0000 7f999e59c700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a00fc7f0 0x7f99a01090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:39:06.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.080+0000 7f999dd9b700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fd150 0x7f99a01095e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f99880044e0 tx=0x7f9988002b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:06.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.080+0000 7f99977fe700 1 -- 172.21.15.49:0/1176494366 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9988007b40 con 0x7f99a00fd150 2024-02-22T00:39:06.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.080+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a0109ec0 con 0x7f99a00fd150 2024-02-22T00:39:06.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.080+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a0112430 con 0x7f99a00fd150 2024-02-22T00:39:06.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.080+0000 7f99977fe700 1 -- 172.21.15.49:0/1176494366 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f998800f040 con 0x7f99a00fd150 2024-02-22T00:39:06.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.080+0000 7f99977fe700 1 -- 172.21.15.49:0/1176494366 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f998800d580 con 0x7f99a00fd150 2024-02-22T00:39:06.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.081+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9980005150 con 0x7f99a00fd150 2024-02-22T00:39:06.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.081+0000 7f99977fe700 1 -- 172.21.15.49:0/1176494366 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f9988007ca0 con 0x7f99a00fd150 2024-02-22T00:39:06.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.082+0000 7f99977fe700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998c06cbc0 0x7f998c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.082+0000 7f99977fe700 1 -- 172.21.15.49:0/1176494366 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f998808b890 con 0x7f99a00fd150 2024-02-22T00:39:06.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.082+0000 7f999e59c700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998c06cbc0 0x7f998c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.082+0000 7f999e59c700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998c06cbc0 0x7f998c06f080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9990004540 tx=0x7f999000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:06.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.086+0000 7f99977fe700 1 -- 172.21.15.49:0/1176494366 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f99880557e0 con 0x7f99a00fd150 2024-02-22T00:39:06.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:05 smithi049 ceph-mon[132694]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:06.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:05 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:06.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:05 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.302+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9980000bf0 con 0x7f998c06cbc0 2024-02-22T00:39:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.303+0000 7f99977fe700 1 -- 172.21.15.49:0/1176494366 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f9980000bf0 con 0x7f998c06cbc0 2024-02-22T00:39:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998c06cbc0 msgr2=0x7f998c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998c06cbc0 0x7f998c06f080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9990004540 tx=0x7f999000b040).stop 2024-02-22T00:39:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fd150 msgr2=0x7f99a01095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fd150 0x7f99a01095e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f99880044e0 tx=0x7f9988002b00).stop 2024-02-22T00:39:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 shutdown_connections 2024-02-22T00:39:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998c06cbc0 0x7f998c06f080 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a00fc7f0 0x7f99a01090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 --2- 172.21.15.49:0/1176494366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99a00fd150 0x7f99a01095e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 >> 172.21.15.49:0/1176494366 conn(0x7f99a0070590 msgr2=0x7f99a00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 shutdown_connections 2024-02-22T00:39:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.305+0000 7f99a4ecf700 1 -- 172.21.15.49:0/1176494366 wait complete. 2024-02-22T00:39:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.406+0000 7f28bc896700 1 -- 172.21.15.49:0/921195002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fc7f0 msgr2=0x7f28b80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.406+0000 7f28bc896700 1 --2- 172.21.15.49:0/921195002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fc7f0 0x7f28b80fcbd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f28a80047f0 tx=0x7f28a8009cb0).stop 2024-02-22T00:39:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.406+0000 7f28bc896700 1 -- 172.21.15.49:0/921195002 shutdown_connections 2024-02-22T00:39:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.406+0000 7f28bc896700 1 --2- 172.21.15.49:0/921195002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b80fd150 0x7f28b80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.406+0000 7f28bc896700 1 --2- 172.21.15.49:0/921195002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fc7f0 0x7f28b80fcbd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.406+0000 7f28bc896700 1 -- 172.21.15.49:0/921195002 >> 172.21.15.49:0/921195002 conn(0x7f28b8070590 msgr2=0x7f28b80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.406+0000 7f28bc896700 1 -- 172.21.15.49:0/921195002 shutdown_connections 2024-02-22T00:39:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.406+0000 7f28bc896700 1 -- 172.21.15.49:0/921195002 wait complete. 2024-02-22T00:39:06.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.407+0000 7f28bc896700 1 Processor -- start 2024-02-22T00:39:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.407+0000 7f28bc896700 1 -- start start 2024-02-22T00:39:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28bc896700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b80fc7f0 0x7f28b81091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28bc896700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fd150 0x7f28b81096c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28bc896700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8109bb0 con 0x7f28b80fd150 2024-02-22T00:39:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28bc896700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b8109cf0 con 0x7f28b80fc7f0 2024-02-22T00:39:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28b5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fd150 0x7f28b81096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28b5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fd150 0x7f28b81096c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44830/0 (socket says 172.21.15.49:44830) 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28b5d9b700 1 -- 172.21.15.49:0/1577565233 learned_addr learned my addr 172.21.15.49:0/1577565233 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28b659c700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b80fc7f0 0x7f28b81091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28b5d9b700 1 -- 172.21.15.49:0/1577565233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b80fc7f0 msgr2=0x7f28b81091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28b5d9b700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b80fc7f0 0x7f28b81091d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28b5d9b700 1 -- 172.21.15.49:0/1577565233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a8005040 con 0x7f28b80fd150 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28b5d9b700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fd150 0x7f28b81096c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f28a000e8c0 tx=0x7f28a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28af7fe700 1 -- 172.21.15.49:0/1577565233 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28a0007b40 con 0x7f28b80fd150 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28af7fe700 1 -- 172.21.15.49:0/1577565233 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f28a000f040 con 0x7f28b80fd150 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b8109fa0 con 0x7f28b80fd150 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.408+0000 7f28af7fe700 1 -- 172.21.15.49:0/1577565233 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28a0014830 con 0x7f28b80fd150 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.409+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b81125c0 con 0x7f28b80fd150 2024-02-22T00:39:06.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.409+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b805f590 con 0x7f28b80fd150 2024-02-22T00:39:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.410+0000 7f28af7fe700 1 -- 172.21.15.49:0/1577565233 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f28a0014af0 con 0x7f28b80fd150 2024-02-22T00:39:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.410+0000 7f28af7fe700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f28a406cbc0 0x7f28a406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.410+0000 7f28af7fe700 1 -- 172.21.15.49:0/1577565233 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f28a008bb10 con 0x7f28b80fd150 2024-02-22T00:39:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.410+0000 7f28b659c700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f28a406cbc0 0x7f28a406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.411+0000 7f28b659c700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f28a406cbc0 0x7f28a406f080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f28a8004540 tx=0x7f28a8009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:06.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.415+0000 7f28af7fe700 1 -- 172.21.15.49:0/1577565233 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f28a0055a60 con 0x7f28b80fd150 2024-02-22T00:39:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.623+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f28b8060d50 con 0x7f28a406cbc0 2024-02-22T00:39:06.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.633+0000 7f28af7fe700 1 -- 172.21.15.49:0/1577565233 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f28b8060d50 con 0x7f28a406cbc0 2024-02-22T00:39:06.635 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:39:06.636 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (2m) 49s ago 13m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:39:06.636 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 starting - - - - 2024-02-22T00:39:06.636 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (12m) 35s ago 12m 6643k - 16.2.14-550-geb66ed92 7403d1862307 9d2e53d9857e 2024-02-22T00:39:06.636 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (2m) 49s ago 13m 82.0M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:39:06.636 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (8m) 49s ago 8m 15.5M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:39:06.636 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (8m) 49s ago 8m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:39:06.636 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (8m) 35s ago 8m 15.6M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (8m) 35s ago 8m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (3m) 49s ago 14m 467M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (3m) 35s ago 12m 447M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (62s) 49s ago 14m 26.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (39s) 35s ago 12m 26.3M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (2m) 49s ago 13m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (2m) 35s ago 12m 17.4M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (12m) 49s ago 12m 223M 1910M 16.2.14-550-geb66ed92 7403d1862307 7aa1d93ab3bd 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (11m) 49s ago 11m 236M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (11m) 49s ago 11m 198M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (10m) 35s ago 10m 259M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:39:06.637 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (10m) 35s ago 10m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:39:06.638 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (9m) 35s ago 9m 220M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:39:06.638 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (2m) 35s ago 12m 54.5M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:39:06.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f28a406cbc0 msgr2=0x7f28a406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f28a406cbc0 0x7f28a406f080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f28a8004540 tx=0x7f28a8009cb0).stop 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fd150 msgr2=0x7f28b81096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fd150 0x7f28b81096c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f28a000e8c0 tx=0x7f28a000b040).stop 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 shutdown_connections 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f28a406cbc0 0x7f28a406f080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b80fc7f0 0x7f28b81091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 --2- 172.21.15.49:0/1577565233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b80fd150 0x7f28b81096c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 >> 172.21.15.49:0/1577565233 conn(0x7f28b8070590 msgr2=0x7f28b80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 shutdown_connections 2024-02-22T00:39:06.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.635+0000 7f28bc896700 1 -- 172.21.15.49:0/1577565233 wait complete. 2024-02-22T00:39:06.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.736+0000 7f520fff8700 1 -- 172.21.15.49:0/3962550289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fc7f0 msgr2=0x7f52080fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.736+0000 7f520fff8700 1 --2- 172.21.15.49:0/3962550289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fc7f0 0x7f52080fcbd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f51fc0047f0 tx=0x7f51fc009cb0).stop 2024-02-22T00:39:06.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.736+0000 7f520fff8700 1 -- 172.21.15.49:0/3962550289 shutdown_connections 2024-02-22T00:39:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.736+0000 7f520fff8700 1 --2- 172.21.15.49:0/3962550289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52080fd150 0x7f52080f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.736+0000 7f520fff8700 1 --2- 172.21.15.49:0/3962550289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fc7f0 0x7f52080fcbd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.736+0000 7f520fff8700 1 -- 172.21.15.49:0/3962550289 >> 172.21.15.49:0/3962550289 conn(0x7f5208070590 msgr2=0x7f52080f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.736+0000 7f520fff8700 1 -- 172.21.15.49:0/3962550289 shutdown_connections 2024-02-22T00:39:06.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.736+0000 7f520fff8700 1 -- 172.21.15.49:0/3962550289 wait complete. 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520fff8700 1 Processor -- start 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520fff8700 1 -- start start 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520fff8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52080fc7f0 0x7f520810cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520fff8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fd150 0x7f520810d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520fff8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520810d9f0 con 0x7f52080fd150 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520fff8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520810db30 con 0x7f52080fc7f0 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520d593700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fd150 0x7f520810d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520d593700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fd150 0x7f520810d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44842/0 (socket says 172.21.15.49:44842) 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520d593700 1 -- 172.21.15.49:0/1598118414 learned_addr learned my addr 172.21.15.49:0/1598118414 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:06.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520dd94700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52080fc7f0 0x7f520810cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.737+0000 7f520d593700 1 -- 172.21.15.49:0/1598118414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52080fc7f0 msgr2=0x7f520810cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.738+0000 7f520d593700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52080fc7f0 0x7f520810cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.738+0000 7f520d593700 1 -- 172.21.15.49:0/1598118414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc005040 con 0x7f52080fd150 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.738+0000 7f520d593700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fd150 0x7f520810d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5204002780 tx=0x7f5204009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.738+0000 7f51faffd700 1 -- 172.21.15.49:0/1598118414 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5204007b40 con 0x7f52080fd150 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.738+0000 7f51faffd700 1 -- 172.21.15.49:0/1598118414 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f520400f040 con 0x7f52080fd150 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.738+0000 7f51faffd700 1 -- 172.21.15.49:0/1598118414 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5204014780 con 0x7f52080fd150 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.738+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52081071c0 con 0x7f52080fd150 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.738+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5208107780 con 0x7f52080fd150 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.739+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520805f590 con 0x7f52080fd150 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.739+0000 7f51faffd700 1 -- 172.21.15.49:0/1598118414 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f5204007ca0 con 0x7f52080fd150 2024-02-22T00:39:06.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.740+0000 7f51faffd700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51f406cbc0 0x7f51f406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:06.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.740+0000 7f51faffd700 1 -- 172.21.15.49:0/1598118414 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f520408bda0 con 0x7f52080fd150 2024-02-22T00:39:06.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.740+0000 7f520dd94700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51f406cbc0 0x7f51f406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:06.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.740+0000 7f520dd94700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51f406cbc0 0x7f51f406f080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f51fc004f10 tx=0x7f51fc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:06.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:06.744+0000 7f51faffd700 1 -- 172.21.15.49:0/1598118414 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5204059780 con 0x7f52080fd150 2024-02-22T00:39:07.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.025+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5208047540 con 0x7f52080fd150 2024-02-22T00:39:07.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.026+0000 7f51faffd700 1 -- 172.21.15.49:0/1598118414 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f5204059310 con 0x7f52080fd150 2024-02-22T00:39:07.029 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:39:07.029 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:39:07.029 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:39:07.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:39:07.030 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:39:07.030 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:39:07.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:39:07.030 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:39:07.030 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T00:39:07.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:39:07.031 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:39:07.031 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:39:07.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:39:07.031 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:39:07.031 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 10, 2024-02-22T00:39:07.031 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:39:07.031 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:39:07.031 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:39:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51f406cbc0 msgr2=0x7f51f406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51f406cbc0 0x7f51f406f080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f51fc004f10 tx=0x7f51fc00b040).stop 2024-02-22T00:39:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fd150 msgr2=0x7f520810d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fd150 0x7f520810d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5204002780 tx=0x7f5204009ee0).stop 2024-02-22T00:39:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 shutdown_connections 2024-02-22T00:39:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51f406cbc0 0x7f51f406f080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52080fc7f0 0x7f520810cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 --2- 172.21.15.49:0/1598118414 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52080fd150 0x7f520810d3f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 >> 172.21.15.49:0/1598118414 conn(0x7f5208070590 msgr2=0x7f52080fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:07.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 shutdown_connections 2024-02-22T00:39:07.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.028+0000 7f520fff8700 1 -- 172.21.15.49:0/1598118414 wait complete. 2024-02-22T00:39:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:06 smithi161 ceph-mon[113442]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:06 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:06 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:39:07.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:06 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.133+0000 7f88c77f6700 1 -- 172.21.15.49:0/1321825039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fd150 msgr2=0x7f88c00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.133+0000 7f88c77f6700 1 --2- 172.21.15.49:0/1321825039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fd150 0x7f88c00f6930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f88b40047f0 tx=0x7f88b4009cb0).stop 2024-02-22T00:39:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.133+0000 7f88c77f6700 1 -- 172.21.15.49:0/1321825039 shutdown_connections 2024-02-22T00:39:07.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.133+0000 7f88c77f6700 1 --2- 172.21.15.49:0/1321825039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fd150 0x7f88c00f6930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.133+0000 7f88c77f6700 1 --2- 172.21.15.49:0/1321825039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88c00fc7f0 0x7f88c00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.133+0000 7f88c77f6700 1 -- 172.21.15.49:0/1321825039 >> 172.21.15.49:0/1321825039 conn(0x7f88c0070590 msgr2=0x7f88c00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:07.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.133+0000 7f88c77f6700 1 -- 172.21.15.49:0/1321825039 shutdown_connections 2024-02-22T00:39:07.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.133+0000 7f88c77f6700 1 -- 172.21.15.49:0/1321825039 wait complete. 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c77f6700 1 Processor -- start 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c77f6700 1 -- start start 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c77f6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fc7f0 0x7f88c01101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c77f6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88c00fd150 0x7f88c01106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c77f6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0110cc0 con 0x7f88c00fc7f0 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c77f6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c0110e00 con 0x7f88c00fd150 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c5592700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fc7f0 0x7f88c01101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c5592700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fc7f0 0x7f88c01101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44856/0 (socket says 172.21.15.49:44856) 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c5592700 1 -- 172.21.15.49:0/2603268574 learned_addr learned my addr 172.21.15.49:0/2603268574 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:07.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c4d91700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88c00fd150 0x7f88c01106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c5592700 1 -- 172.21.15.49:0/2603268574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88c00fd150 msgr2=0x7f88c01106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c5592700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88c00fd150 0x7f88c01106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c5592700 1 -- 172.21.15.49:0/2603268574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4005040 con 0x7f88c00fc7f0 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.134+0000 7f88c5592700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fc7f0 0x7f88c01101d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f88bc00c740 tx=0x7f88bc007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.135+0000 7f88b27fc700 1 -- 172.21.15.49:0/2603268574 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88bc00e680 con 0x7f88c00fc7f0 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.135+0000 7f88b27fc700 1 -- 172.21.15.49:0/2603268574 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88bc00ec90 con 0x7f88c00fc7f0 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.135+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c010a490 con 0x7f88c00fc7f0 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.135+0000 7f88b27fc700 1 -- 172.21.15.49:0/2603268574 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88bc013d30 con 0x7f88c00fc7f0 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.135+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c010aa50 con 0x7f88c00fc7f0 2024-02-22T00:39:07.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.136+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c005f590 con 0x7f88c00fc7f0 2024-02-22T00:39:07.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.136+0000 7f88b27fc700 1 -- 172.21.15.49:0/2603268574 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f88bc013410 con 0x7f88c00fc7f0 2024-02-22T00:39:07.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.137+0000 7f88b27fc700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88ac06cbc0 0x7f88ac06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.137+0000 7f88b27fc700 1 -- 172.21.15.49:0/2603268574 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f88bc08c0b0 con 0x7f88c00fc7f0 2024-02-22T00:39:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.137+0000 7f88c4d91700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88ac06cbc0 0x7f88ac06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.137+0000 7f88c4d91700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88ac06cbc0 0x7f88ac06f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f88c010bb10 tx=0x7f88b4009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:07.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.141+0000 7f88b27fc700 1 -- 172.21.15.49:0/2603268574 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f88bc059ba0 con 0x7f88c00fc7f0 2024-02-22T00:39:07.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:06 smithi049 ceph-mon[132694]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:07.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:06 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:07.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:06 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi161", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-22T00:39:07.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:06 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:07.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.382+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f88c010b950 con 0x7f88c00fc7f0 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.382+0000 7f88b27fc700 1 -- 172.21.15.49:0/2603268574 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f88bc059730 con 0x7f88c00fc7f0 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:39:07.385 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:39:07.386 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:39:07.387 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:39:07.388 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:39:07.388 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:39:07.388 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:39:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.384+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88ac06cbc0 msgr2=0x7f88ac06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.384+0000 7f88c77f6700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88ac06cbc0 0x7f88ac06f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f88c010bb10 tx=0x7f88b4009cb0).stop 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.384+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fc7f0 msgr2=0x7f88c01101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.384+0000 7f88c77f6700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fc7f0 0x7f88c01101d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f88bc00c740 tx=0x7f88bc007ef0).stop 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.385+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 shutdown_connections 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.385+0000 7f88c77f6700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88ac06cbc0 0x7f88ac06f080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.385+0000 7f88c77f6700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f88c00fc7f0 0x7f88c01101d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.385+0000 7f88c77f6700 1 --2- 172.21.15.49:0/2603268574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88c00fd150 0x7f88c01106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.385+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 >> 172.21.15.49:0/2603268574 conn(0x7f88c0070590 msgr2=0x7f88c0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.385+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 shutdown_connections 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.385+0000 7f88c77f6700 1 -- 172.21.15.49:0/2603268574 wait complete. 2024-02-22T00:39:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.487+0000 7fcf90180700 1 -- 172.21.15.49:0/4176035942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fc7f0 msgr2=0x7fcf880fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.487+0000 7fcf90180700 1 --2- 172.21.15.49:0/4176035942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fc7f0 0x7fcf880fcbd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcf840047f0 tx=0x7fcf84009cb0).stop 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.487+0000 7fcf90180700 1 -- 172.21.15.49:0/4176035942 shutdown_connections 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.487+0000 7fcf90180700 1 --2- 172.21.15.49:0/4176035942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf880fd150 0x7fcf880f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.487+0000 7fcf90180700 1 --2- 172.21.15.49:0/4176035942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fc7f0 0x7fcf880fcbd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.487+0000 7fcf90180700 1 -- 172.21.15.49:0/4176035942 >> 172.21.15.49:0/4176035942 conn(0x7fcf88070590 msgr2=0x7fcf880f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.488+0000 7fcf90180700 1 -- 172.21.15.49:0/4176035942 shutdown_connections 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.488+0000 7fcf90180700 1 -- 172.21.15.49:0/4176035942 wait complete. 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.488+0000 7fcf90180700 1 Processor -- start 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.488+0000 7fcf90180700 1 -- start start 2024-02-22T00:39:07.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.488+0000 7fcf90180700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf880fc7f0 0x7fcf880f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.488+0000 7fcf90180700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fd150 0x7fcf880f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.488+0000 7fcf90180700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880f8f20 con 0x7fcf880fd150 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.488+0000 7fcf90180700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880f9060 con 0x7fcf880fc7f0 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8d71b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fd150 0x7fcf880f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8d71b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fd150 0x7fcf880f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44884/0 (socket says 172.21.15.49:44884) 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8d71b700 1 -- 172.21.15.49:0/1913682453 learned_addr learned my addr 172.21.15.49:0/1913682453 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8df1c700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf880fc7f0 0x7fcf880f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8d71b700 1 -- 172.21.15.49:0/1913682453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf880fc7f0 msgr2=0x7fcf880f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8d71b700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf880fc7f0 0x7fcf880f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8d71b700 1 -- 172.21.15.49:0/1913682453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84005040 con 0x7fcf880fd150 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8df1c700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf880fc7f0 0x7fcf880f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf8d71b700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fd150 0x7fcf880f8a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcf78002820 tx=0x7fcf78009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf7effd700 1 -- 172.21.15.49:0/1913682453 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf78007b40 con 0x7fcf880fd150 2024-02-22T00:39:07.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf7effd700 1 -- 172.21.15.49:0/1913682453 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcf7800f040 con 0x7fcf880fd150 2024-02-22T00:39:07.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf880f9310 con 0x7fcf880fd150 2024-02-22T00:39:07.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf7effd700 1 -- 172.21.15.49:0/1913682453 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf78014910 con 0x7fcf880fd150 2024-02-22T00:39:07.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.489+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf88114710 con 0x7fcf880fd150 2024-02-22T00:39:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.490+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8805f590 con 0x7fcf880fd150 2024-02-22T00:39:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.491+0000 7fcf7effd700 1 -- 172.21.15.49:0/1913682453 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fcf78007ca0 con 0x7fcf880fd150 2024-02-22T00:39:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.491+0000 7fcf7effd700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcf7406cbc0 0x7fcf7406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.491+0000 7fcf7effd700 1 -- 172.21.15.49:0/1913682453 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fcf7808b830 con 0x7fcf880fd150 2024-02-22T00:39:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.491+0000 7fcf8df1c700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcf7406cbc0 0x7fcf7406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.492+0000 7fcf8df1c700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcf7406cbc0 0x7fcf7406f080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcf84004540 tx=0x7fcf8400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:07.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.496+0000 7fcf7effd700 1 -- 172.21.15.49:0/1913682453 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcf78055780 con 0x7fcf880fd150 2024-02-22T00:39:07.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.711+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf880fb5a0 con 0x7fcf7406cbc0 2024-02-22T00:39:07.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.712+0000 7fcf7effd700 1 -- 172.21.15.49:0/1913682453 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fcf880fb5a0 con 0x7fcf7406cbc0 2024-02-22T00:39:07.714 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:39:07.714 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:39:07.714 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout: "mon" 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "4/21 daemons upgraded", 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading crash daemons", 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:39:07.715 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcf7406cbc0 msgr2=0x7fcf7406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcf7406cbc0 0x7fcf7406f080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcf84004540 tx=0x7fcf8400b040).stop 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fd150 msgr2=0x7fcf880f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fd150 0x7fcf880f8a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcf78002820 tx=0x7fcf78009f20).stop 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 shutdown_connections 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcf7406cbc0 0x7fcf7406f080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf880fc7f0 0x7fcf880f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 --2- 172.21.15.49:0/1913682453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf880fd150 0x7fcf880f8a30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 >> 172.21.15.49:0/1913682453 conn(0x7fcf88070590 msgr2=0x7fcf88060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 shutdown_connections 2024-02-22T00:39:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.714+0000 7fcf90180700 1 -- 172.21.15.49:0/1913682453 wait complete. 2024-02-22T00:39:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.815+0000 7f7978d58700 1 -- 172.21.15.49:0/2914438270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fd150 msgr2=0x7f79740f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.815+0000 7f7978d58700 1 --2- 172.21.15.49:0/2914438270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fd150 0x7f79740f6930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f79680047f0 tx=0x7f7968009cb0).stop 2024-02-22T00:39:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.816+0000 7f7978d58700 1 -- 172.21.15.49:0/2914438270 shutdown_connections 2024-02-22T00:39:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.816+0000 7f7978d58700 1 --2- 172.21.15.49:0/2914438270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fd150 0x7f79740f6930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.816+0000 7f7978d58700 1 --2- 172.21.15.49:0/2914438270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79740fc7f0 0x7f79740fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.816+0000 7f7978d58700 1 -- 172.21.15.49:0/2914438270 >> 172.21.15.49:0/2914438270 conn(0x7f7974070590 msgr2=0x7f79740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.816+0000 7f7978d58700 1 -- 172.21.15.49:0/2914438270 shutdown_connections 2024-02-22T00:39:07.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.816+0000 7f7978d58700 1 -- 172.21.15.49:0/2914438270 wait complete. 2024-02-22T00:39:07.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.816+0000 7f7978d58700 1 Processor -- start 2024-02-22T00:39:07.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.816+0000 7f7978d58700 1 -- start start 2024-02-22T00:39:07.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f7978d58700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fc7f0 0x7f79740f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f7978d58700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79740fd150 0x7f79740f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f7978d58700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79740f8f20 con 0x7f79740fc7f0 2024-02-22T00:39:07.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f7978d58700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79740f9060 con 0x7f79740fd150 2024-02-22T00:39:07.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f797259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fc7f0 0x7f79740f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f797259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fc7f0 0x7f79740f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44904/0 (socket says 172.21.15.49:44904) 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f797259c700 1 -- 172.21.15.49:0/3622387041 learned_addr learned my addr 172.21.15.49:0/3622387041 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f7971d9b700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79740fd150 0x7f79740f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f797259c700 1 -- 172.21.15.49:0/3622387041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79740fd150 msgr2=0x7f79740f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f797259c700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79740fd150 0x7f79740f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f797259c700 1 -- 172.21.15.49:0/3622387041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968005040 con 0x7f79740fc7f0 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f797259c700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fc7f0 0x7f79740f8540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f79640041d0 tx=0x7f7964009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f79637fe700 1 -- 172.21.15.49:0/3622387041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7964007b40 con 0x7f79740fc7f0 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f79637fe700 1 -- 172.21.15.49:0/3622387041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f796400f040 con 0x7f79740fc7f0 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79740f9310 con 0x7f79740fc7f0 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.817+0000 7f79637fe700 1 -- 172.21.15.49:0/3622387041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79640147b0 con 0x7f79740fc7f0 2024-02-22T00:39:07.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.818+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79741146a0 con 0x7f79740fc7f0 2024-02-22T00:39:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.818+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797405f590 con 0x7f79740fc7f0 2024-02-22T00:39:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.819+0000 7f79637fe700 1 -- 172.21.15.49:0/3622387041 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f7964009110 con 0x7f79740fc7f0 2024-02-22T00:39:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.819+0000 7f79637fe700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f795c06cbc0 0x7f795c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:07.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.819+0000 7f79637fe700 1 -- 172.21.15.49:0/3622387041 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f796408bf80 con 0x7f79740fc7f0 2024-02-22T00:39:07.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.819+0000 7f7971d9b700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f795c06cbc0 0x7f795c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:07.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.820+0000 7f7971d9b700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f795c06cbc0 0x7f795c06f080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f79740f9ce0 tx=0x7f7968009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:07.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:07.824+0000 7f79637fe700 1 -- 172.21.15.49:0/3622387041 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7964055ed0 con 0x7f79740fc7f0 2024-02-22T00:39:08.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:07 smithi161 ceph-mon[113442]: Upgrade: Updating crash.smithi161 (2/2) 2024-02-22T00:39:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:07 smithi161 ceph-mon[113442]: Deploying daemon crash.smithi161 on smithi161 2024-02-22T00:39:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:07 smithi161 ceph-mon[113442]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:07 smithi161 ceph-mon[113442]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:07 smithi161 ceph-mon[113442]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:07 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1598118414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:08.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:07 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2603268574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:39:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.104+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7974047540 con 0x7f79740fc7f0 2024-02-22T00:39:08.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.104+0000 7f79637fe700 1 -- 172.21.15.49:0/3622387041 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f79640594f0 con 0x7f79740fc7f0 2024-02-22T00:39:08.106 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_OK 2024-02-22T00:39:08.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f795c06cbc0 msgr2=0x7f795c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:08.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f795c06cbc0 0x7f795c06f080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f79740f9ce0 tx=0x7f7968009cb0).stop 2024-02-22T00:39:08.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fc7f0 msgr2=0x7f79740f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:08.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fc7f0 0x7f79740f8540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f79640041d0 tx=0x7f7964009f60).stop 2024-02-22T00:39:08.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 shutdown_connections 2024-02-22T00:39:08.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f795c06cbc0 0x7f795c06f080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:08.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79740fc7f0 0x7f79740f8540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:08.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 --2- 172.21.15.49:0/3622387041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79740fd150 0x7f79740f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:08.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 >> 172.21.15.49:0/3622387041 conn(0x7f7974070590 msgr2=0x7f7974060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:08.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 shutdown_connections 2024-02-22T00:39:08.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:08.106+0000 7f7978d58700 1 -- 172.21.15.49:0/3622387041 wait complete. 2024-02-22T00:39:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:07 smithi049 ceph-mon[132694]: Upgrade: Updating crash.smithi161 (2/2) 2024-02-22T00:39:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:07 smithi049 ceph-mon[132694]: Deploying daemon crash.smithi161 on smithi161 2024-02-22T00:39:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:07 smithi049 ceph-mon[132694]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:07 smithi049 ceph-mon[132694]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:07 smithi049 ceph-mon[132694]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:07 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1598118414' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:08.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:07 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2603268574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:39:09.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:08 smithi161 ceph-mon[113442]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:09.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:08 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3622387041' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:39:09.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:08 smithi049 ceph-mon[132694]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:09.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:08 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3622387041' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:39:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:09 smithi161 ceph-mon[113442]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:10.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:09 smithi049 ceph-mon[132694]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:11.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:11.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:11.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:11.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:11.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:11.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:12.067 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:11 smithi049 ceph-mon[132694]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:12.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:11 smithi161 ceph-mon[113442]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:13.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:12 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:39:13.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:12 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:39:14.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:13 smithi049 ceph-mon[132694]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:14.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:14.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:14.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:13 smithi161 ceph-mon[113442]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:14.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:14.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.310 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:15 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.310 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:15 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.310 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:15 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.310 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:15 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.310 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:15 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.311 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:15 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:15 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:15 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.442 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:15 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:15 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:15 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:15.443 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:15 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:16 smithi049 ceph-mon[132694]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:16 smithi161 ceph-mon[113442]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:18.234 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:18 smithi049 ceph-mon[132694]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:18.234 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:18.234 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:18 smithi161 ceph-mon[113442]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.536 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.536 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.536 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:19.536 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:39:19.536 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.536 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:19.536 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all crash 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]: dispatch 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]': finished 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]: dispatch 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]': finished 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T00:39:19.537 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:19 smithi049 ceph-mon[132694]: Upgrade: osd.0 is safe to restart 2024-02-22T00:39:19.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all crash 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]: dispatch 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi049"}]': finished 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]: dispatch 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi161"}]': finished 2024-02-22T00:39:19.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T00:39:19.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T00:39:19.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:19 smithi161 ceph-mon[113442]: Upgrade: osd.0 is safe to restart 2024-02-22T00:39:21.147 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:20 smithi049 ceph-mon[132694]: Upgrade: Updating osd.0 2024-02-22T00:39:21.148 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:20 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:21.148 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:20 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T00:39:21.148 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:20 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:21.148 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:20 smithi049 ceph-mon[132694]: Deploying daemon osd.0 on smithi049 2024-02-22T00:39:21.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:20 smithi161 ceph-mon[113442]: Upgrade: Updating osd.0 2024-02-22T00:39:21.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:20 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:20 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T00:39:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:20 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:21.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:20 smithi161 ceph-mon[113442]: Deploying daemon osd.0 on smithi049 2024-02-22T00:39:22.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:21 smithi049 ceph-mon[132694]: pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:21 smithi161 ceph-mon[113442]: pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:23.061 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:22 smithi049 systemd[1]: Stopping Ceph osd.0 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:39:23.428 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[79957]: debug 2024-02-22T00:39:23.057+0000 7f216037f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T00:39:23.428 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[79957]: debug 2024-02-22T00:39:23.057+0000 7f216037f700 -1 osd.0 48 *** Got signal Terminated *** 2024-02-22T00:39:23.428 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:23 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[79957]: debug 2024-02-22T00:39:23.057+0000 7f216037f700 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T00:39:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:23 smithi049 ceph-mon[132694]: pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:23 smithi049 ceph-mon[132694]: osd.0 marked itself down and dead 2024-02-22T00:39:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:23 smithi161 ceph-mon[113442]: pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:23 smithi161 ceph-mon[113442]: osd.0 marked itself down and dead 2024-02-22T00:39:24.678 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:24 smithi049 bash[146889]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0 2024-02-22T00:39:25.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:24 smithi049 ceph-mon[132694]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:39:25.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:24 smithi049 ceph-mon[132694]: failed to encode map e49 with expected crc 2024-02-22T00:39:25.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:24 smithi049 ceph-mon[132694]: osdmap e49: 6 total, 5 up, 6 in 2024-02-22T00:39:25.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:24 smithi161 ceph-mon[113442]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:39:25.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:24 smithi161 ceph-mon[113442]: failed to encode map e49 with expected crc 2024-02-22T00:39:25.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:24 smithi161 ceph-mon[113442]: osdmap e49: 6 total, 5 up, 6 in 2024-02-22T00:39:26.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:25 smithi049 ceph-mon[132694]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:26.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:25 smithi049 ceph-mon[132694]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:25 smithi049 ceph-mon[132694]: osdmap e50: 6 total, 5 up, 6 in 2024-02-22T00:39:26.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:25 smithi049 ceph-mon[132694]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:25 smithi049 ceph-mon[132694]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:25 smithi049 ceph-mon[132694]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:25 smithi049 ceph-mon[132694]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:25 smithi049 ceph-mon[132694]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.179 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:25 smithi049 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.0.service: Succeeded. 2024-02-22T00:39:26.179 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:25 smithi049 systemd[1]: Stopped Ceph osd.0 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:39:26.179 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:26 smithi049 systemd[1]: Starting Ceph osd.0 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:39:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:25 smithi161 ceph-mon[113442]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:25 smithi161 ceph-mon[113442]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:25 smithi161 ceph-mon[113442]: osdmap e50: 6 total, 5 up, 6 in 2024-02-22T00:39:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:25 smithi161 ceph-mon[113442]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:25 smithi161 ceph-mon[113442]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:25 smithi161 ceph-mon[113442]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:25 smithi161 ceph-mon[113442]: failed to encode map e50 with expected crc 2024-02-22T00:39:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:25 smithi161 ceph-mon[113442]: failed to encode map e50 with expected crc 2024-02-22T00:39:27.292 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:26 smithi049 bash[147162]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-22T00:39:27.292 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:26 smithi049 bash[147162]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-22T00:39:27.293 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:26 smithi049 bash[147162]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-22T00:39:27.293 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:26 smithi049 bash[147162]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-22T00:39:27.293 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:26 smithi049 bash[147162]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-22T00:39:27.293 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:26 smithi049 bash[147162]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-22T00:39:27.293 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:26 smithi049 bash[147162]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-22T00:39:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:27 smithi161 ceph-mon[113442]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:27 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:27 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:39:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:27 smithi049 ceph-mon[132694]: pgmap v42: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:27 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:27 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:39:28.428 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:27 smithi049 ceph-osd[147465]: -- 172.21.15.49:0/150821511 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5651c0c264e0 con 0x5651c0bf6c00 2024-02-22T00:39:28.429 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:28 smithi049 bash[147427]: d9c71a2330460c0b91f0284421e36c126076acab1c69d34ffff8df44afb06a12 2024-02-22T00:39:28.429 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:28 smithi049 systemd[1]: Started Ceph osd.0 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:39:28.928 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:28 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[147442]: 2024-02-22T00:39:28.503+0000 7f4e92fc8640 -1 Falling back to public interface 2024-02-22T00:39:29.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:29 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:29.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:29 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:29.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:29 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:29.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:29 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:29.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:29 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:29.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:29 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:30 smithi049 ceph-mon[132694]: pgmap v43: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:30 smithi049 ceph-mon[132694]: Health check failed: Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded (PG_DEGRADED) 2024-02-22T00:39:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:30 smithi161 ceph-mon[113442]: pgmap v43: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:30 smithi161 ceph-mon[113442]: Health check failed: Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded (PG_DEGRADED) 2024-02-22T00:39:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:32 smithi049 ceph-mon[132694]: pgmap v44: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:32 smithi161 ceph-mon[113442]: pgmap v44: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:33.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:33 smithi161 ceph-mon[113442]: pgmap v45: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:33.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:33.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:33.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:33.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:33.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:33 smithi049 ceph-mon[132694]: pgmap v45: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:33.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:33.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:33.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:33.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:35.428 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[147442]: 2024-02-22T00:39:35.086+0000 7f4e92fc8640 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-22T00:39:35.928 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[147442]: 2024-02-22T00:39:35.522+0000 7f4e92fc8640 -1 osd.0 48 log_to_monitors true 2024-02-22T00:39:35.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:35 smithi049 ceph-mon[132694]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:35.929 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:35 smithi049 ceph-mon[132694]: from='osd.0 [v2:172.21.15.49:6802/2349267451,v1:172.21.15.49:6803/2349267451]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T00:39:36.233 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 00:39:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[147442]: 2024-02-22T00:39:35.943+0000 7f4e84421700 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:39:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:35 smithi161 ceph-mon[113442]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:35 smithi161 ceph-mon[113442]: from='osd.0 [v2:172.21.15.49:6802/2349267451,v1:172.21.15.49:6803/2349267451]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T00:39:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: failed to encode map e51 with expected crc 2024-02-22T00:39:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: from='osd.0 [v2:172.21.15.49:6802/2349267451,v1:172.21.15.49:6803/2349267451]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T00:39:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: osdmap e51: 6 total, 5 up, 6 in 2024-02-22T00:39:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: from='osd.0 [v2:172.21.15.49:6802/2349267451,v1:172.21.15.49:6803/2349267451]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:39:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:37.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:37.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:39:37.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:36 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:37.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: failed to encode map e51 with expected crc 2024-02-22T00:39:37.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: from='osd.0 [v2:172.21.15.49:6802/2349267451,v1:172.21.15.49:6803/2349267451]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T00:39:37.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: osdmap e51: 6 total, 5 up, 6 in 2024-02-22T00:39:37.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: from='osd.0 [v2:172.21.15.49:6802/2349267451,v1:172.21.15.49:6803/2349267451]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:39:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:39:37.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:36 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:38.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.221+0000 7fbc0411c700 1 -- 172.21.15.49:0/2384391848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 msgr2=0x7fbbfc0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.221+0000 7fbc0411c700 1 --2- 172.21.15.49:0/2384391848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 0x7fbbfc0f6930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fbbf80047f0 tx=0x7fbbf8009cb0).stop 2024-02-22T00:39:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.221+0000 7fbc0411c700 1 -- 172.21.15.49:0/2384391848 shutdown_connections 2024-02-22T00:39:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.221+0000 7fbc0411c700 1 --2- 172.21.15.49:0/2384391848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 0x7fbbfc0f6930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.221+0000 7fbc0411c700 1 --2- 172.21.15.49:0/2384391848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbfc0fc7f0 0x7fbbfc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.221+0000 7fbc0411c700 1 -- 172.21.15.49:0/2384391848 >> 172.21.15.49:0/2384391848 conn(0x7fbbfc070590 msgr2=0x7fbbfc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.221+0000 7fbc0411c700 1 -- 172.21.15.49:0/2384391848 shutdown_connections 2024-02-22T00:39:38.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.221+0000 7fbc0411c700 1 -- 172.21.15.49:0/2384391848 wait complete. 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc0411c700 1 Processor -- start 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc0411c700 1 -- start start 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc0411c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbfc0fc7f0 0x7fbbfc1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc0411c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 0x7fbbfc1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc0411c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc110cc0 con 0x7fbbfc0fd150 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc0411c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbfc110e00 con 0x7fbbfc0fc7f0 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc016b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 0x7fbbfc1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc016b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 0x7fbbfc1106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51694/0 (socket says 172.21.15.49:51694) 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.222+0000 7fbc016b7700 1 -- 172.21.15.49:0/29246065 learned_addr learned my addr 172.21.15.49:0/29246065 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbc01eb8700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbfc0fc7f0 0x7fbbfc1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbc016b7700 1 -- 172.21.15.49:0/29246065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbfc0fc7f0 msgr2=0x7fbbfc1101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbc016b7700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbfc0fc7f0 0x7fbbfc1101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbc016b7700 1 -- 172.21.15.49:0/29246065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8005040 con 0x7fbbfc0fd150 2024-02-22T00:39:38.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbc016b7700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 0x7fbbfc1106c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbbf80099f0 tx=0x7fbbf8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:38.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbbf2ffd700 1 -- 172.21.15.49:0/29246065 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbf800e030 con 0x7fbbfc0fd150 2024-02-22T00:39:38.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbbf2ffd700 1 -- 172.21.15.49:0/29246065 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbbf8007e90 con 0x7fbbfc0fd150 2024-02-22T00:39:38.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbfc10a430 con 0x7fbbfc0fd150 2024-02-22T00:39:38.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbbf2ffd700 1 -- 172.21.15.49:0/29246065 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbf8018070 con 0x7fbbfc0fd150 2024-02-22T00:39:38.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.223+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbfc10a990 con 0x7fbbfc0fd150 2024-02-22T00:39:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.224+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbfc05f590 con 0x7fbbfc0fd150 2024-02-22T00:39:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.225+0000 7fbbf2ffd700 1 -- 172.21.15.49:0/29246065 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fbbf80094c0 con 0x7fbbfc0fd150 2024-02-22T00:39:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.225+0000 7fbbf2ffd700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbbe806cbc0 0x7fbbe806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.225+0000 7fbbf2ffd700 1 -- 172.21.15.49:0/29246065 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fbbf808d1f0 con 0x7fbbfc0fd150 2024-02-22T00:39:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.225+0000 7fbc01eb8700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbbe806cbc0 0x7fbbe806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:38.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.226+0000 7fbc01eb8700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbbe806cbc0 0x7fbbe806f080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbbec004dc0 tx=0x7fbbec00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:38.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.230+0000 7fbbf2ffd700 1 -- 172.21.15.49:0/29246065 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbbf805abd0 con 0x7fbbfc0fd150 2024-02-22T00:39:38.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:38.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:39:38.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: failed to encode map e52 with expected crc 2024-02-22T00:39:38.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: osd.0 [v2:172.21.15.49:6802/2349267451,v1:172.21.15.49:6803/2349267451] boot 2024-02-22T00:39:38.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: osdmap e52: 6 total, 6 up, 6 in 2024-02-22T00:39:38.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:39:38.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: failed to encode map e51 with expected crc 2024-02-22T00:39:38.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: failed to encode map e51 with expected crc 2024-02-22T00:39:38.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: failed to encode map e51 with expected crc 2024-02-22T00:39:38.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:38.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:38.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:38.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:38.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T00:39:38.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T00:39:38.298 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:37 smithi161 ceph-mon[113442]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: failed to encode map e52 with expected crc 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: osd.0 [v2:172.21.15.49:6802/2349267451,v1:172.21.15.49:6803/2349267451] boot 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: osdmap e52: 6 total, 6 up, 6 in 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: failed to encode map e51 with expected crc 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: failed to encode map e51 with expected crc 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: failed to encode map e51 with expected crc 2024-02-22T00:39:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:39:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T00:39:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T00:39:38.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:37 smithi049 ceph-mon[132694]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-22T00:39:38.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.446+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbfc10afd0 con 0x7fbbe806cbc0 2024-02-22T00:39:38.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.447+0000 7fbbf2ffd700 1 -- 172.21.15.49:0/29246065 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fbbfc10afd0 con 0x7fbbe806cbc0 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbbe806cbc0 msgr2=0x7fbbe806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbbe806cbc0 0x7fbbe806f080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fbbec004dc0 tx=0x7fbbec00b040).stop 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 msgr2=0x7fbbfc1106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 0x7fbbfc1106c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbbf80099f0 tx=0x7fbbf8009cb0).stop 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 shutdown_connections 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbbe806cbc0 0x7fbbe806f080 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbfc0fc7f0 0x7fbbfc1101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 --2- 172.21.15.49:0/29246065 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbbfc0fd150 0x7fbbfc1106c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 >> 172.21.15.49:0/29246065 conn(0x7fbbfc070590 msgr2=0x7fbbfc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:38.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 shutdown_connections 2024-02-22T00:39:38.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.449+0000 7fbc0411c700 1 -- 172.21.15.49:0/29246065 wait complete. 2024-02-22T00:39:38.461 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.551+0000 7ffbceb18700 1 -- 172.21.15.49:0/1585921435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 msgr2=0x7ffbc80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.551+0000 7ffbceb18700 1 --2- 172.21.15.49:0/1585921435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 0x7ffbc80f6930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ffbb40047f0 tx=0x7ffbb4009cb0).stop 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 -- 172.21.15.49:0/1585921435 shutdown_connections 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 --2- 172.21.15.49:0/1585921435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 0x7ffbc80f6930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 --2- 172.21.15.49:0/1585921435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbc80fc7f0 0x7ffbc80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 -- 172.21.15.49:0/1585921435 >> 172.21.15.49:0/1585921435 conn(0x7ffbc8070590 msgr2=0x7ffbc80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 -- 172.21.15.49:0/1585921435 shutdown_connections 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 -- 172.21.15.49:0/1585921435 wait complete. 2024-02-22T00:39:38.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 Processor -- start 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 -- start start 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.552+0000 7ffbceb18700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbc80fc7f0 0x7ffbc810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbceb18700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 0x7ffbc810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbceb18700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc810ead0 con 0x7ffbc80fd150 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbceb18700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc810ec10 con 0x7ffbc80fc7f0 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 0x7ffbc810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc7fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 0x7ffbc810e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51708/0 (socket says 172.21.15.49:51708) 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc7fff700 1 -- 172.21.15.49:0/1686753806 learned_addr learned my addr 172.21.15.49:0/1686753806 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc7fff700 1 -- 172.21.15.49:0/1686753806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbc80fc7f0 msgr2=0x7ffbc810dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc7fff700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbc80fc7f0 0x7ffbc810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc7fff700 1 -- 172.21.15.49:0/1686753806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4005040 con 0x7ffbc80fd150 2024-02-22T00:39:38.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc7fff700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 0x7ffbc810e4d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ffbb40099f0 tx=0x7ffbb4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:38.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc5ffb700 1 -- 172.21.15.49:0/1686753806 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb400e030 con 0x7ffbc80fd150 2024-02-22T00:39:38.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc5ffb700 1 -- 172.21.15.49:0/1686753806 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffbb4007e90 con 0x7ffbc80fd150 2024-02-22T00:39:38.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc8108240 con 0x7ffbc80fd150 2024-02-22T00:39:38.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbc5ffb700 1 -- 172.21.15.49:0/1686753806 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb4018070 con 0x7ffbc80fd150 2024-02-22T00:39:38.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.553+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc81087a0 con 0x7ffbc80fd150 2024-02-22T00:39:38.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.554+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc805f590 con 0x7ffbc80fd150 2024-02-22T00:39:38.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.555+0000 7ffbc5ffb700 1 -- 172.21.15.49:0/1686753806 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7ffbb4009590 con 0x7ffbc80fd150 2024-02-22T00:39:38.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.555+0000 7ffbc5ffb700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffbb806cb60 0x7ffbb806f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.556+0000 7ffbcc8b4700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffbb806cb60 0x7ffbb806f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:38.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.556+0000 7ffbc5ffb700 1 -- 172.21.15.49:0/1686753806 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6051+0+0 (secure 0 0 0) 0x7ffbb408d2e0 con 0x7ffbc80fd150 2024-02-22T00:39:38.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.556+0000 7ffbcc8b4700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffbb806cb60 0x7ffbb806f020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ffbbc004b90 tx=0x7ffbbc009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:38.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.560+0000 7ffbc5ffb700 1 -- 172.21.15.49:0/1686753806 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffbb405ac00 con 0x7ffbc80fd150 2024-02-22T00:39:38.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.779+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbc8108e30 con 0x7ffbb806cb60 2024-02-22T00:39:38.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.780+0000 7ffbc5ffb700 1 -- 172.21.15.49:0/1686753806 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffbc8108e30 con 0x7ffbb806cb60 2024-02-22T00:39:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffbb806cb60 msgr2=0x7ffbb806f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffbb806cb60 0x7ffbb806f020 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ffbbc004b90 tx=0x7ffbbc009b60).stop 2024-02-22T00:39:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 msgr2=0x7ffbc810e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 0x7ffbc810e4d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ffbb40099f0 tx=0x7ffbb4009cb0).stop 2024-02-22T00:39:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 shutdown_connections 2024-02-22T00:39:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffbb806cb60 0x7ffbb806f020 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbc80fc7f0 0x7ffbc810dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:39:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 --2- 172.21.15.49:0/1686753806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffbc80fd150 0x7ffbc810e4d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 >> 172.21.15.49:0/1686753806 conn(0x7ffbc8070590 msgr2=0x7ffbc8060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 shutdown_connections 2024-02-22T00:39:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.782+0000 7ffbceb18700 1 -- 172.21.15.49:0/1686753806 wait complete. 2024-02-22T00:39:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.884+0000 7f3adac1f700 1 -- 172.21.15.49:0/807952423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 msgr2=0x7f3ad40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.884+0000 7f3adac1f700 1 --2- 172.21.15.49:0/807952423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 0x7f3ad40f6930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3ac00047f0 tx=0x7f3ac0009cb0).stop 2024-02-22T00:39:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.884+0000 7f3adac1f700 1 -- 172.21.15.49:0/807952423 shutdown_connections 2024-02-22T00:39:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.884+0000 7f3adac1f700 1 --2- 172.21.15.49:0/807952423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 0x7f3ad40f6930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.884+0000 7f3adac1f700 1 --2- 172.21.15.49:0/807952423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad40fc7f0 0x7f3ad40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.884+0000 7f3adac1f700 1 -- 172.21.15.49:0/807952423 >> 172.21.15.49:0/807952423 conn(0x7f3ad4070590 msgr2=0x7f3ad40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.884+0000 7f3adac1f700 1 -- 172.21.15.49:0/807952423 shutdown_connections 2024-02-22T00:39:38.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.884+0000 7f3adac1f700 1 -- 172.21.15.49:0/807952423 wait complete. 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3adac1f700 1 Processor -- start 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3adac1f700 1 -- start start 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3adac1f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad40fc7f0 0x7f3ad410dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3adac1f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 0x7f3ad410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3adac1f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad410ead0 con 0x7f3ad40fd150 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3adac1f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad410ec10 con 0x7f3ad40fc7f0 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 0x7f3ad410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 0x7f3ad410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51728/0 (socket says 172.21.15.49:51728) 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.885+0000 7f3ad3fff700 1 -- 172.21.15.49:0/2221584723 learned_addr learned my addr 172.21.15.49:0/2221584723 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad89bb700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad40fc7f0 0x7f3ad410dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:38.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad3fff700 1 -- 172.21.15.49:0/2221584723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad40fc7f0 msgr2=0x7f3ad410dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad3fff700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad40fc7f0 0x7f3ad410dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad3fff700 1 -- 172.21.15.49:0/2221584723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac0005040 con 0x7f3ad40fd150 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad89bb700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad40fc7f0 0x7f3ad410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad3fff700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 0x7f3ad410e4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3ac00099f0 tx=0x7f3ac0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad1ffb700 1 -- 172.21.15.49:0/2221584723 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac000e030 con 0x7f3ad40fd150 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad1ffb700 1 -- 172.21.15.49:0/2221584723 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ac0007e90 con 0x7f3ad40fd150 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad4108240 con 0x7f3ad40fd150 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3ad1ffb700 1 -- 172.21.15.49:0/2221584723 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac0018070 con 0x7f3ad40fd150 2024-02-22T00:39:38.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.886+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad41087a0 con 0x7f3ad40fd150 2024-02-22T00:39:38.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.887+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad405f590 con 0x7f3ad40fd150 2024-02-22T00:39:38.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.888+0000 7f3ad1ffb700 1 -- 172.21.15.49:0/2221584723 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f3ac001d420 con 0x7f3ad40fd150 2024-02-22T00:39:38.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.888+0000 7f3ad1ffb700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3ac406cbc0 0x7f3ac406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:38.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.888+0000 7f3ad89bb700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3ac406cbc0 0x7f3ac406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:38.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.888+0000 7f3ad1ffb700 1 -- 172.21.15.49:0/2221584723 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f3ac008d420 con 0x7f3ad40fd150 2024-02-22T00:39:38.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.889+0000 7f3ad89bb700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3ac406cbc0 0x7f3ac406f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3ac80041d0 tx=0x7f3ac8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:38.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:38.893+0000 7f3ad1ffb700 1 -- 172.21.15.49:0/2221584723 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3ac005ae00 con 0x7f3ad40fd150 2024-02-22T00:39:39.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.102+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ad4108de0 con 0x7f3ac406cbc0 2024-02-22T00:39:39.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.112+0000 7f3ad1ffb700 1 -- 172.21.15.49:0/2221584723 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3ad4108de0 con 0x7f3ac406cbc0 2024-02-22T00:39:39.116 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:39:39.116 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (2m) 6s ago 14m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:39:39.116 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (34s) 6s ago 13m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:39:39.116 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (29s) 25s ago 13m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:39:39.116 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (2m) 6s ago 13m 85.0M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:39:39.117 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (8m) 6s ago 8m 16.0M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:39:39.117 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (8m) 6s ago 8m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:39:39.117 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (8m) 25s ago 8m 15.8M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:39:39.117 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (8m) 25s ago 8m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:39:39.117 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (4m) 6s ago 15m 493M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:39:39.117 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (3m) 25s ago 13m 447M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:39:39.117 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (94s) 6s ago 15m 42.7M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (72s) 25s ago 13m 35.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (3m) 6s ago 13m 16.9M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (3m) 25s ago 13m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (11s) 6s ago 12m 13.9M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (12m) 6s ago 12m 236M 1910M 16.2.14-550-geb66ed92 7403d1862307 05728c165879 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (11m) 6s ago 11m 198M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (11m) 25s ago 11m 259M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (10m) 25s ago 10m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (10m) 25s ago 10m 220M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:39:39.118 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (3m) 25s ago 12m 56.7M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3ac406cbc0 msgr2=0x7f3ac406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3ac406cbc0 0x7f3ac406f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3ac80041d0 tx=0x7f3ac8009040).stop 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 msgr2=0x7f3ad410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 0x7f3ad410e4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f3ac00099f0 tx=0x7f3ac0009cb0).stop 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 shutdown_connections 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3ac406cbc0 0x7f3ac406f080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ad40fc7f0 0x7f3ad410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 --2- 172.21.15.49:0/2221584723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ad40fd150 0x7f3ad410e4d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 >> 172.21.15.49:0/2221584723 conn(0x7f3ad4070590 msgr2=0x7f3ad4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:39.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 shutdown_connections 2024-02-22T00:39:39.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.114+0000 7f3adac1f700 1 -- 172.21.15.49:0/2221584723 wait complete. 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.214+0000 7ff271f6c700 1 -- 172.21.15.49:0/4159057772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f88a0 msgr2=0x7ff26c0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.214+0000 7ff271f6c700 1 --2- 172.21.15.49:0/4159057772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f88a0 0x7ff26c0f8c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff25c0047f0 tx=0x7ff25c009cb0).stop 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.215+0000 7ff271f6c700 1 -- 172.21.15.49:0/4159057772 shutdown_connections 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.215+0000 7ff271f6c700 1 --2- 172.21.15.49:0/4159057772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0f9200 0x7ff26c101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.215+0000 7ff271f6c700 1 --2- 172.21.15.49:0/4159057772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f88a0 0x7ff26c0f8c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.215+0000 7ff271f6c700 1 -- 172.21.15.49:0/4159057772 >> 172.21.15.49:0/4159057772 conn(0x7ff26c070590 msgr2=0x7ff26c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.215+0000 7ff271f6c700 1 -- 172.21.15.49:0/4159057772 shutdown_connections 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.215+0000 7ff271f6c700 1 -- 172.21.15.49:0/4159057772 wait complete. 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.215+0000 7ff271f6c700 1 Processor -- start 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.215+0000 7ff271f6c700 1 -- start start 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff271f6c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0f88a0 0x7ff26c0f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff271f6c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f9200 0x7ff26c0f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff271f6c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0f7230 con 0x7ff26c0f9200 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff271f6c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0f7370 con 0x7ff26c0f88a0 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff26affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f9200 0x7ff26c0f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff26affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f9200 0x7ff26c0f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51744/0 (socket says 172.21.15.49:51744) 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff26affd700 1 -- 172.21.15.49:0/3377994103 learned_addr learned my addr 172.21.15.49:0/3377994103 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff26b7fe700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0f88a0 0x7ff26c0f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff26affd700 1 -- 172.21.15.49:0/3377994103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0f88a0 msgr2=0x7ff26c0f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff26affd700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0f88a0 0x7ff26c0f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff26affd700 1 -- 172.21.15.49:0/3377994103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c005040 con 0x7ff26c0f9200 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff26affd700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f9200 0x7ff26c0f6d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff2600041d0 tx=0x7ff260009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff268ff9700 1 -- 172.21.15.49:0/3377994103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff260002d90 con 0x7ff26c0f9200 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff268ff9700 1 -- 172.21.15.49:0/3377994103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff26000f040 con 0x7ff26c0f9200 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c0f7620 con 0x7ff26c0f9200 2024-02-22T00:39:39.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff268ff9700 1 -- 172.21.15.49:0/3377994103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff26000d800 con 0x7ff26c0f9200 2024-02-22T00:39:39.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.216+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c114680 con 0x7ff26c0f9200 2024-02-22T00:39:39.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.217+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c05f590 con 0x7ff26c0f9200 2024-02-22T00:39:39.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.218+0000 7ff268ff9700 1 -- 172.21.15.49:0/3377994103 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7ff26000da70 con 0x7ff26c0f9200 2024-02-22T00:39:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.219+0000 7ff268ff9700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff25406cbc0 0x7ff25406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.219+0000 7ff26b7fe700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff25406cbc0 0x7ff25406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.219+0000 7ff268ff9700 1 -- 172.21.15.49:0/3377994103 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6051+0+0 (secure 0 0 0) 0x7ff26008bf00 con 0x7ff26c0f9200 2024-02-22T00:39:39.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.219+0000 7ff26b7fe700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff25406cbc0 0x7ff25406f080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff25c004f10 tx=0x7ff25c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:39.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.223+0000 7ff268ff9700 1 -- 172.21.15.49:0/3377994103 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff260055e50 con 0x7ff26c0f9200 2024-02-22T00:39:39.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:38 smithi161 ceph-mon[113442]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:38 smithi161 ceph-mon[113442]: osdmap e53: 6 total, 6 up, 6 in 2024-02-22T00:39:39.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:38 smithi161 ceph-mon[113442]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:38 smithi161 ceph-mon[113442]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:38 smithi161 ceph-mon[113442]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:38 smithi161 ceph-mon[113442]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:38 smithi161 ceph-mon[113442]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:38 smithi049 ceph-mon[132694]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:38 smithi049 ceph-mon[132694]: osdmap e53: 6 total, 6 up, 6 in 2024-02-22T00:39:39.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:38 smithi049 ceph-mon[132694]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:38 smithi049 ceph-mon[132694]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:38 smithi049 ceph-mon[132694]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:38 smithi049 ceph-mon[132694]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:38 smithi049 ceph-mon[132694]: failed to encode map e53 with expected crc 2024-02-22T00:39:39.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.505+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff26c0f7d30 con 0x7ff26c0f9200 2024-02-22T00:39:39.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.505+0000 7ff268ff9700 1 -- 172.21.15.49:0/3377994103 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7ff260059470 con 0x7ff26c0f9200 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 5, 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 1 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:39:39.508 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:39:39.509 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:39:39.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:39:39.509 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:39:39.509 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 9, 2024-02-22T00:39:39.509 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 5 2024-02-22T00:39:39.509 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:39:39.509 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff25406cbc0 msgr2=0x7ff25406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff25406cbc0 0x7ff25406f080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff25c004f10 tx=0x7ff25c00b040).stop 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f9200 msgr2=0x7ff26c0f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f9200 0x7ff26c0f6d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff2600041d0 tx=0x7ff260009f60).stop 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 shutdown_connections 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff25406cbc0 0x7ff25406f080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0f88a0 0x7ff26c0f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 --2- 172.21.15.49:0/3377994103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff26c0f9200 0x7ff26c0f6d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.507+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 >> 172.21.15.49:0/3377994103 conn(0x7ff26c070590 msgr2=0x7ff26c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.508+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 shutdown_connections 2024-02-22T00:39:39.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.508+0000 7ff271f6c700 1 -- 172.21.15.49:0/3377994103 wait complete. 2024-02-22T00:39:39.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.610+0000 7f695e2ad700 1 -- 172.21.15.49:0/2425721980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fd150 msgr2=0x7f69580f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.610+0000 7f695e2ad700 1 --2- 172.21.15.49:0/2425721980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fd150 0x7f69580f6930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f694c0047f0 tx=0x7f694c009cb0).stop 2024-02-22T00:39:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.610+0000 7f695e2ad700 1 -- 172.21.15.49:0/2425721980 shutdown_connections 2024-02-22T00:39:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.610+0000 7f695e2ad700 1 --2- 172.21.15.49:0/2425721980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fd150 0x7f69580f6930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.610+0000 7f695e2ad700 1 --2- 172.21.15.49:0/2425721980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69580fc7f0 0x7f69580fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.610+0000 7f695e2ad700 1 -- 172.21.15.49:0/2425721980 >> 172.21.15.49:0/2425721980 conn(0x7f6958070590 msgr2=0x7f69580f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.610+0000 7f695e2ad700 1 -- 172.21.15.49:0/2425721980 shutdown_connections 2024-02-22T00:39:39.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.610+0000 7f695e2ad700 1 -- 172.21.15.49:0/2425721980 wait complete. 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.611+0000 7f695e2ad700 1 Processor -- start 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.611+0000 7f695e2ad700 1 -- start start 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f695e2ad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fc7f0 0x7f695810ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f695e2ad700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69580fd150 0x7f695810d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f695e2ad700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695810d910 con 0x7f69580fc7f0 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f695e2ad700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695810da50 con 0x7f69580fd150 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6957fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fc7f0 0x7f695810ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6957fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fc7f0 0x7f695810ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51748/0 (socket says 172.21.15.49:51748) 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6957fff700 1 -- 172.21.15.49:0/3597033898 learned_addr learned my addr 172.21.15.49:0/3597033898 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6957fff700 1 -- 172.21.15.49:0/3597033898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69580fd150 msgr2=0x7f695810d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6957fff700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69580fd150 0x7f695810d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:39:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6957fff700 1 -- 172.21.15.49:0/3597033898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c005040 con 0x7f69580fc7f0 2024-02-22T00:39:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6957fff700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fc7f0 0x7f695810ce20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f694800c740 tx=0x7f6948007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6955775700 1 -- 172.21.15.49:0/3597033898 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f694800e680 con 0x7f69580fc7f0 2024-02-22T00:39:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.612+0000 7f6955775700 1 -- 172.21.15.49:0/3597033898 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f694800ec90 con 0x7f69580fc7f0 2024-02-22T00:39:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.613+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6958107190 con 0x7f69580fc7f0 2024-02-22T00:39:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.613+0000 7f6955775700 1 -- 172.21.15.49:0/3597033898 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6948013d60 con 0x7f69580fc7f0 2024-02-22T00:39:39.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.613+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6958107750 con 0x7f69580fc7f0 2024-02-22T00:39:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.614+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695805f590 con 0x7f69580fc7f0 2024-02-22T00:39:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.614+0000 7f6955775700 1 -- 172.21.15.49:0/3597033898 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f694800e7e0 con 0x7f69580fc7f0 2024-02-22T00:39:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.614+0000 7f6955775700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f694006cbc0 0x7f694006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.614+0000 7f6955775700 1 -- 172.21.15.49:0/3597033898 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f694808c190 con 0x7f69580fc7f0 2024-02-22T00:39:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.614+0000 7f69577fe700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f694006cbc0 0x7f694006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:39.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.615+0000 7f69577fe700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f694006cbc0 0x7f694006f080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f69581087a0 tx=0x7f694c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:39.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.619+0000 7f6955775700 1 -- 172.21.15.49:0/3597033898 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f69480561f0 con 0x7f69580fc7f0 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.858+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6958047540 con 0x7f69580fc7f0 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.859+0000 7f6955775700 1 -- 172.21.15.49:0/3597033898 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f6948059810 con 0x7f69580fc7f0 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:39:39.861 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:39:39.862 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:39:39.863 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:39:39.864 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:39:39.864 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:39:39.864 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:39:39.864 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:39:39.864 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:39:39.864 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:39:39.864 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f694006cbc0 msgr2=0x7f694006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f694006cbc0 0x7f694006f080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f69581087a0 tx=0x7f694c009cb0).stop 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fc7f0 msgr2=0x7f695810ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fc7f0 0x7f695810ce20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f694800c740 tx=0x7f6948007ef0).stop 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 shutdown_connections 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f694006cbc0 0x7f694006f080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69580fc7f0 0x7f695810ce20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 --2- 172.21.15.49:0/3597033898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69580fd150 0x7f695810d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 >> 172.21.15.49:0/3597033898 conn(0x7f6958070590 msgr2=0x7f69580fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 shutdown_connections 2024-02-22T00:39:39.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.861+0000 7f695e2ad700 1 -- 172.21.15.49:0/3597033898 wait complete. 2024-02-22T00:39:39.866 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:39:39.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 -- 172.21.15.49:0/3089458495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f88e0 msgr2=0x7fb7300f8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 --2- 172.21.15.49:0/3089458495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f88e0 0x7fb7300f8cc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb7200047f0 tx=0x7fb720009cb0).stop 2024-02-22T00:39:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 -- 172.21.15.49:0/3089458495 shutdown_connections 2024-02-22T00:39:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 --2- 172.21.15.49:0/3089458495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7300f9240 0x7fb730101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:39:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 --2- 172.21.15.49:0/3089458495 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f88e0 0x7fb7300f8cc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 -- 172.21.15.49:0/3089458495 >> 172.21.15.49:0/3089458495 conn(0x7fb730070590 msgr2=0x7fb7300f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 -- 172.21.15.49:0/3089458495 shutdown_connections 2024-02-22T00:39:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 -- 172.21.15.49:0/3089458495 wait complete. 2024-02-22T00:39:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 Processor -- start 2024-02-22T00:39:39.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.964+0000 7fb736455700 1 -- start start 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb736455700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7300f88e0 0x7fb73010e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb736455700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f9240 0x7fb73010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb736455700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73010ec60 con 0x7fb7300f9240 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb736455700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730108280 con 0x7fb7300f88e0 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f9240 0x7fb73010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f9240 0x7fb73010e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51774/0 (socket says 172.21.15.49:51774) 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72f7fe700 1 -- 172.21.15.49:0/453116711 learned_addr learned my addr 172.21.15.49:0/453116711 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72f7fe700 1 -- 172.21.15.49:0/453116711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7300f88e0 msgr2=0x7fb73010e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:39.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72f7fe700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7300f88e0 0x7fb73010e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72f7fe700 1 -- 172.21.15.49:0/453116711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720005040 con 0x7fb7300f9240 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72f7fe700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f9240 0x7fb73010e5d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb71800b410 tx=0x7fb718009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72d7fa700 1 -- 172.21.15.49:0/453116711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7180125f0 con 0x7fb7300f9240 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.965+0000 7fb72d7fa700 1 -- 172.21.15.49:0/453116711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb718012c00 con 0x7fb7300f9240 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.966+0000 7fb72d7fa700 1 -- 172.21.15.49:0/453116711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb71800dbd0 con 0x7fb7300f9240 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.966+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb730108530 con 0x7fb7300f9240 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.966+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb730108a70 con 0x7fb7300f9240 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.967+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73005f590 con 0x7fb7300f9240 2024-02-22T00:39:39.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.967+0000 7fb72d7fa700 1 -- 172.21.15.49:0/453116711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7fb718012750 con 0x7fb7300f9240 2024-02-22T00:39:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.967+0000 7fb72d7fa700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb71c06cbc0 0x7fb71c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.967+0000 7fb72d7fa700 1 -- 172.21.15.49:0/453116711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fb71808bce0 con 0x7fb7300f9240 2024-02-22T00:39:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.968+0000 7fb72ffff700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb71c06cbc0 0x7fb71c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:39.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.968+0000 7fb72ffff700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb71c06cbc0 0x7fb71c06f080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb7200047f0 tx=0x7fb720009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:39.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:39.972+0000 7fb72d7fa700 1 -- 172.21.15.49:0/453116711 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb7180597d0 con 0x7fb7300f9240 2024-02-22T00:39:40.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.189+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb730109760 con 0x7fb71c06cbc0 2024-02-22T00:39:40.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.190+0000 7fb72d7fa700 1 -- 172.21.15.49:0/453116711 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb730109760 con 0x7fb71c06cbc0 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "7/21 daemons upgraded", 2024-02-22T00:39:40.193 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-02-22T00:39:40.194 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:39:40.194 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb71c06cbc0 msgr2=0x7fb71c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb71c06cbc0 0x7fb71c06f080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb7200047f0 tx=0x7fb720009cb0).stop 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f9240 msgr2=0x7fb73010e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f9240 0x7fb73010e5d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb71800b410 tx=0x7fb718009060).stop 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 shutdown_connections 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb71c06cbc0 0x7fb71c06f080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7300f88e0 0x7fb73010e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 --2- 172.21.15.49:0/453116711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7300f9240 0x7fb73010e5d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:40.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 >> 172.21.15.49:0/453116711 conn(0x7fb730070590 msgr2=0x7fb7300fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 shutdown_connections 2024-02-22T00:39:40.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.193+0000 7fb736455700 1 -- 172.21.15.49:0/453116711 wait complete. 2024-02-22T00:39:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:39 smithi161 ceph-mon[113442]: pgmap v51: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 256 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 11/321 objects degraded (3.427%) 2024-02-22T00:39:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:39 smithi161 ceph-mon[113442]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:39 smithi161 ceph-mon[113442]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:39 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded (PG_DEGRADED) 2024-02-22T00:39:40.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:39 smithi161 ceph-mon[113442]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:40.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:39 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3377994103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:40.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:39 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3597033898' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:39:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 -- 172.21.15.49:0/2417747404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fc7f0 msgr2=0x7f223c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 --2- 172.21.15.49:0/2417747404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fc7f0 0x7f223c0fcbd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f22380047f0 tx=0x7f2238009cb0).stop 2024-02-22T00:39:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 -- 172.21.15.49:0/2417747404 shutdown_connections 2024-02-22T00:39:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 --2- 172.21.15.49:0/2417747404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f223c0fd150 0x7f223c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 --2- 172.21.15.49:0/2417747404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fc7f0 0x7f223c0fcbd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 -- 172.21.15.49:0/2417747404 >> 172.21.15.49:0/2417747404 conn(0x7f223c070590 msgr2=0x7f223c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 -- 172.21.15.49:0/2417747404 shutdown_connections 2024-02-22T00:39:40.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 -- 172.21.15.49:0/2417747404 wait complete. 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 Processor -- start 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.295+0000 7f22435cc700 1 -- start start 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22435cc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f223c0fc7f0 0x7f223c0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22435cc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fd150 0x7f223c0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22435cc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0f8f20 con 0x7f223c0fd150 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22435cc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0f9060 con 0x7f223c0fc7f0 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f2240b67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fd150 0x7f223c0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f2240b67700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fd150 0x7f223c0f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51788/0 (socket says 172.21.15.49:51788) 2024-02-22T00:39:40.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f2240b67700 1 -- 172.21.15.49:0/3451329764 learned_addr learned my addr 172.21.15.49:0/3451329764 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f2241368700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f223c0fc7f0 0x7f223c0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f2240b67700 1 -- 172.21.15.49:0/3451329764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f223c0fc7f0 msgr2=0x7f223c0f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f2240b67700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f223c0fc7f0 0x7f223c0f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f2240b67700 1 -- 172.21.15.49:0/3451329764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2238005040 con 0x7f223c0fd150 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f2240b67700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fd150 0x7f223c0f8a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f222c002780 tx=0x7f222c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22327fc700 1 -- 172.21.15.49:0/3451329764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222c007b40 con 0x7f223c0fd150 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c0f9310 con 0x7f223c0fd150 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22327fc700 1 -- 172.21.15.49:0/3451329764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f222c00f040 con 0x7f223c0fd150 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22327fc700 1 -- 172.21.15.49:0/3451329764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f222c014780 con 0x7f223c0fd150 2024-02-22T00:39:40.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.296+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c1146a0 con 0x7f223c0fd150 2024-02-22T00:39:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.297+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c05f590 con 0x7f223c0fd150 2024-02-22T00:39:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.298+0000 7f22327fc700 1 -- 172.21.15.49:0/3451329764 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 37) v1 ==== 90952+0+0 (secure 0 0 0) 0x7f222c007ca0 con 0x7f223c0fd150 2024-02-22T00:39:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.298+0000 7f22327fc700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f222806cbc0 0x7f222806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:39:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.298+0000 7f22327fc700 1 -- 172.21.15.49:0/3451329764 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f222c08be60 con 0x7f223c0fd150 2024-02-22T00:39:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.298+0000 7f2241368700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f222806cbc0 0x7f222806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:39:40.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.299+0000 7f2241368700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f222806cbc0 0x7f222806f080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2238004f10 tx=0x7f223800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:39:40.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.303+0000 7f22327fc700 1 -- 172.21.15.49:0/3451329764 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f222c055db0 con 0x7f223c0fd150 2024-02-22T00:39:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:39 smithi049 ceph-mon[132694]: pgmap v51: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 256 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 11/321 objects degraded (3.427%) 2024-02-22T00:39:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:39 smithi049 ceph-mon[132694]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:39 smithi049 ceph-mon[132694]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:39 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded (PG_DEGRADED) 2024-02-22T00:39:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:39 smithi049 ceph-mon[132694]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:39 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3377994103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:39:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:39 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3597033898' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:39:40.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.585+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f223c047540 con 0x7f223c0fd150 2024-02-22T00:39:40.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.586+0000 7f22327fc700 1 -- 172.21.15.49:0/3451329764 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+349 (secure 0 0 0) 0x7f222c0593d0 con 0x7f223c0fd150 2024-02-22T00:39:40.588 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded 2024-02-22T00:39:40.588 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded 2024-02-22T00:39:40.588 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-02-22T00:39:40.589 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-02-22T00:39:40.589 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f222806cbc0 msgr2=0x7f222806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f222806cbc0 0x7f222806f080 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2238004f10 tx=0x7f223800b040).stop 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fd150 msgr2=0x7f223c0f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fd150 0x7f223c0f8a30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f222c002780 tx=0x7f222c009ee0).stop 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 shutdown_connections 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f222806cbc0 0x7f222806f080 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f223c0fc7f0 0x7f223c0f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 --2- 172.21.15.49:0/3451329764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f223c0fd150 0x7f223c0f8a30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 >> 172.21.15.49:0/3451329764 conn(0x7f223c070590 msgr2=0x7f223c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:39:40.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 shutdown_connections 2024-02-22T00:39:40.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:39:40.588+0000 7f22435cc700 1 -- 172.21.15.49:0/3451329764 wait complete. 2024-02-22T00:39:41.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:40 smithi161 ceph-mon[113442]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:41.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:40 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3451329764' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:39:41.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:40 smithi049 ceph-mon[132694]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:39:41.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:40 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3451329764' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:39:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:41 smithi049 ceph-mon[132694]: pgmap v52: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 256 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 11/321 objects degraded (3.427%) 2024-02-22T00:39:42.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:41 smithi161 ceph-mon[113442]: pgmap v52: 65 pgs: 3 active+undersized+degraded, 6 active+undersized, 56 active+clean; 256 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 11/321 objects degraded (3.427%) 2024-02-22T00:39:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:43 smithi049 ceph-mon[132694]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:39:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:43 smithi049 ceph-mon[132694]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded) 2024-02-22T00:39:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:43 smithi049 ceph-mon[132694]: Cluster is now healthy 2024-02-22T00:39:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:43 smithi161 ceph-mon[113442]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:39:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:43 smithi161 ceph-mon[113442]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded) 2024-02-22T00:39:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:43 smithi161 ceph-mon[113442]: Cluster is now healthy 2024-02-22T00:39:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:44 smithi049 ceph-mon[132694]: mgrmap e38: smithi049.rjblpr(active, since 91s), standbys: smithi161.sazlam 2024-02-22T00:39:44.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:44 smithi161 ceph-mon[113442]: mgrmap e38: smithi049.rjblpr(active, since 91s), standbys: smithi161.sazlam 2024-02-22T00:39:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:45 smithi049 ceph-mon[132694]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:39:46.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:45 smithi161 ceph-mon[113442]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-22T00:39:48.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:47 smithi049 ceph-mon[132694]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 436 B/s wr, 0 op/s 2024-02-22T00:39:48.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:47 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:48.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:47 smithi161 ceph-mon[113442]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 436 B/s wr, 0 op/s 2024-02-22T00:39:48.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:47 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:50.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:49 smithi161 ceph-mon[113442]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 394 B/s wr, 0 op/s 2024-02-22T00:39:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:49 smithi049 ceph-mon[132694]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 394 B/s wr, 0 op/s 2024-02-22T00:39:52.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:51 smithi049 ceph-mon[132694]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-22T00:39:52.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:51 smithi161 ceph-mon[113442]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-22T00:39:53.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:52 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T00:39:53.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:52 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T00:39:53.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:52 smithi049 ceph-mon[132694]: Upgrade: osd.1 is safe to restart 2024-02-22T00:39:53.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:52 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T00:39:53.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:52 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T00:39:53.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:52 smithi161 ceph-mon[113442]: Upgrade: osd.1 is safe to restart 2024-02-22T00:39:54.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:53 smithi161 ceph-mon[113442]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-22T00:39:54.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:53 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:54.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:53 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T00:39:54.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:53 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:54.340 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:53 smithi049 ceph-mon[132694]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-22T00:39:54.340 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:53 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:54.340 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:53 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T00:39:54.340 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:53 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:39:55.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:54 smithi049 ceph-mon[132694]: Upgrade: Updating osd.1 2024-02-22T00:39:55.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:54 smithi049 ceph-mon[132694]: Deploying daemon osd.1 on smithi049 2024-02-22T00:39:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:54 smithi161 ceph-mon[113442]: Upgrade: Updating osd.1 2024-02-22T00:39:55.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:54 smithi161 ceph-mon[113442]: Deploying daemon osd.1 on smithi049 2024-02-22T00:39:56.227 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:55 smithi049 ceph-mon[132694]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-22T00:39:56.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:55 smithi161 ceph-mon[113442]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-22T00:39:56.928 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:39:56 smithi049 systemd[1]: Stopping Ceph osd.1 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:39:56.928 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:39:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[86989]: debug 2024-02-22T00:39:56.752+0000 7fdbb851a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T00:39:56.928 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:39:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[86989]: debug 2024-02-22T00:39:56.752+0000 7fdbb851a700 -1 osd.1 53 *** Got signal Terminated *** 2024-02-22T00:39:56.928 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:39:56 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[86989]: debug 2024-02-22T00:39:56.752+0000 7fdbb851a700 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T00:39:57.243 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:56 smithi049 ceph-mon[132694]: osd.1 marked itself down and dead 2024-02-22T00:39:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:56 smithi161 ceph-mon[113442]: osd.1 marked itself down and dead 2024-02-22T00:39:57.678 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:39:57 smithi049 bash[154064]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1 2024-02-22T00:39:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:39:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: osdmap e54: 6 total, 5 up, 6 in 2024-02-22T00:39:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: failed to encode map e54 with expected crc 2024-02-22T00:39:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: failed to encode map e54 with expected crc 2024-02-22T00:39:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: failed to encode map e54 with expected crc 2024-02-22T00:39:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: failed to encode map e54 with expected crc 2024-02-22T00:39:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:39:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:39:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:39:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: osdmap e54: 6 total, 5 up, 6 in 2024-02-22T00:39:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: failed to encode map e54 with expected crc 2024-02-22T00:39:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: failed to encode map e54 with expected crc 2024-02-22T00:39:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: failed to encode map e54 with expected crc 2024-02-22T00:39:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: failed to encode map e54 with expected crc 2024-02-22T00:39:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:39:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:39:59.011 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:58 smithi049 ceph-mon[132694]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.011 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:58 smithi049 ceph-mon[132694]: osdmap e55: 6 total, 5 up, 6 in 2024-02-22T00:39:59.011 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:58 smithi049 ceph-mon[132694]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.011 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:58 smithi049 ceph-mon[132694]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.011 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:58 smithi049 ceph-mon[132694]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.011 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:58 smithi049 ceph-mon[132694]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.011 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:58 smithi049 ceph-mon[132694]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.011 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:58 smithi049 ceph-mon[132694]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:58 smithi161 ceph-mon[113442]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:58 smithi161 ceph-mon[113442]: osdmap e55: 6 total, 5 up, 6 in 2024-02-22T00:39:59.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:58 smithi161 ceph-mon[113442]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:58 smithi161 ceph-mon[113442]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:58 smithi161 ceph-mon[113442]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:58 smithi161 ceph-mon[113442]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:58 smithi161 ceph-mon[113442]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:58 smithi161 ceph-mon[113442]: failed to encode map e55 with expected crc 2024-02-22T00:39:59.428 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:39:59 smithi049 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.1.service: Succeeded. 2024-02-22T00:39:59.428 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:39:59 smithi049 systemd[1]: Stopped Ceph osd.1 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:39:59.428 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:39:59 smithi049 systemd[1]: Starting Ceph osd.1 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:40:00.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:59 smithi049 ceph-mon[132694]: pgmap v63: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 45/321 objects degraded (14.019%) 2024-02-22T00:40:00.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:39:59 smithi049 ceph-mon[132694]: Health check failed: Degraded data redundancy: 45/321 objects degraded (14.019%), 14 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:59 smithi161 ceph-mon[113442]: pgmap v63: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 45/321 objects degraded (14.019%) 2024-02-22T00:40:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:39:59 smithi161 ceph-mon[113442]: Health check failed: Degraded data redundancy: 45/321 objects degraded (14.019%), 14 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:00.633 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:00 smithi049 bash[154336]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-22T00:40:00.633 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:00 smithi049 bash[154336]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-22T00:40:00.633 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:00 smithi049 bash[154336]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-22T00:40:00.633 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:00 smithi049 bash[154336]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-22T00:40:00.633 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:00 smithi049 bash[154336]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-22T00:40:00.633 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:00 smithi049 bash[154336]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-22T00:40:00.633 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:00 smithi049 bash[154336]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-22T00:40:01.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 45/321 objects degraded (14.019%), 14 pgs degraded 2024-02-22T00:40:01.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: [WRN] OSD_DOWN: 1 osds down 2024-02-22T00:40:01.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: osd.1 (root=default,host=smithi049) is down 2024-02-22T00:40:01.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: [WRN] PG_DEGRADED: Degraded data redundancy: 45/321 objects degraded (14.019%), 14 pgs degraded 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.a is active+undersized+degraded, acting [4,3] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.d is active+undersized+degraded, acting [3,2] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:01.236 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:01.237 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:00 smithi049 ceph-mon[132694]: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-02-22T00:40:01.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: Health detail: HEALTH_WARN 1 osds down; Degraded data redundancy: 45/321 objects degraded (14.019%), 14 pgs degraded 2024-02-22T00:40:01.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: [WRN] OSD_DOWN: 1 osds down 2024-02-22T00:40:01.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: osd.1 (root=default,host=smithi049) is down 2024-02-22T00:40:01.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: [WRN] PG_DEGRADED: Degraded data redundancy: 45/321 objects degraded (14.019%), 14 pgs degraded 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.a is active+undersized+degraded, acting [4,3] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.d is active+undersized+degraded, acting [3,2] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:01.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:01.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:00 smithi161 ceph-mon[113442]: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-02-22T00:40:01.678 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:01 smithi049 ceph-osd[154659]: -- 172.21.15.49:0/4007422858 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5644125d84e0 con 0x5644125a8c00 2024-02-22T00:40:01.678 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:01 smithi049 bash[154621]: b382bd123cdcf7a7b1764e427873b581caba143f4c659421623c33cda01c2635 2024-02-22T00:40:01.679 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:01 smithi049 systemd[1]: Started Ceph osd.1 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:40:02.131 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:01 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[154636]: 2024-02-22T00:40:01.871+0000 7f4b50a6e640 -1 Falling back to public interface 2024-02-22T00:40:02.131 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:01 smithi049 ceph-mon[132694]: pgmap v64: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 45/321 objects degraded (14.019%) 2024-02-22T00:40:02.131 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:01 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:02.131 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:01 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:02.131 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:01 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:40:02.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:01 smithi161 ceph-mon[113442]: pgmap v64: 65 pgs: 14 active+undersized+degraded, 3 stale+active+clean, 15 active+undersized, 33 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 45/321 objects degraded (14.019%) 2024-02-22T00:40:02.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:01 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:02.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:01 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:02.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:01 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:40:04.241 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:03 smithi049 ceph-mon[132694]: pgmap v65: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:04.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:03 smithi161 ceph-mon[113442]: pgmap v65: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:05.261 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:04 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 16 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:05.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:04 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 16 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:06.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:05 smithi161 ceph-mon[113442]: pgmap v66: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:06.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:05 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:06.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:05 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:05 smithi049 ceph-mon[132694]: pgmap v66: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:05 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:05 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:07.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:07 smithi049 ceph-mon[132694]: pgmap v67: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:07.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:07 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:07.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:07 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:07 smithi161 ceph-mon[113442]: pgmap v67: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:07 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:07 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:08.928 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:08 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[154636]: 2024-02-22T00:40:08.660+0000 7f4b50a6e640 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-22T00:40:09.642 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[154636]: 2024-02-22T00:40:09.279+0000 7f4b50a6e640 -1 osd.1 53 log_to_monitors true 2024-02-22T00:40:09.642 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 00:40:09 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[154636]: 2024-02-22T00:40:09.406+0000 7f4b3f6c2700 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:40:09.643 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:09 smithi049 ceph-mon[132694]: pgmap v68: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:09.643 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:09 smithi049 ceph-mon[132694]: from='osd.1 [v2:172.21.15.49:6810/3701332011,v1:172.21.15.49:6811/3701332011]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T00:40:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:09 smithi161 ceph-mon[113442]: pgmap v68: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:09.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:09 smithi161 ceph-mon[113442]: from='osd.1 [v2:172.21.15.49:6810/3701332011,v1:172.21.15.49:6811/3701332011]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T00:40:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='osd.1 [v2:172.21.15.49:6810/3701332011,v1:172.21.15.49:6811/3701332011]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T00:40:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: osdmap e56: 6 total, 5 up, 6 in 2024-02-22T00:40:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='osd.1 [v2:172.21.15.49:6810/3701332011,v1:172.21.15.49:6811/3701332011]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:40:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: failed to encode map e56 with expected crc 2024-02-22T00:40:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:40:10.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:40:10.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:10.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:40:10.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:10.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:10.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:10.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-22T00:40:10.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 -- 172.21.15.49:0/3823649778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fc7f0 msgr2=0x7f18340fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:10.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 --2- 172.21.15.49:0/3823649778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fc7f0 0x7f18340fcbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f18300047f0 tx=0x7f1830009cb0).stop 2024-02-22T00:40:10.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 -- 172.21.15.49:0/3823649778 shutdown_connections 2024-02-22T00:40:10.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 --2- 172.21.15.49:0/3823649778 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18340fd150 0x7f18340f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:10.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 --2- 172.21.15.49:0/3823649778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fc7f0 0x7f18340fcbd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:10.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 -- 172.21.15.49:0/3823649778 >> 172.21.15.49:0/3823649778 conn(0x7f1834070590 msgr2=0x7f18340f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:10.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 -- 172.21.15.49:0/3823649778 shutdown_connections 2024-02-22T00:40:10.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 -- 172.21.15.49:0/3823649778 wait complete. 2024-02-22T00:40:10.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.694+0000 7f183bbd0700 1 Processor -- start 2024-02-22T00:40:10.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183bbd0700 1 -- start start 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183bbd0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18340fc7f0 0x7f183410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183bbd0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fd150 0x7f183410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183bbd0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183410eab0 con 0x7f18340fd150 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183bbd0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183410ebf0 con 0x7f18340fc7f0 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183916b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fd150 0x7f183410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183916b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fd150 0x7f183410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48486/0 (socket says 172.21.15.49:48486) 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183916b700 1 -- 172.21.15.49:0/2528490239 learned_addr learned my addr 172.21.15.49:0/2528490239 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183996c700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18340fc7f0 0x7f183410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183916b700 1 -- 172.21.15.49:0/2528490239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18340fc7f0 msgr2=0x7f183410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183916b700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18340fc7f0 0x7f183410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183916b700 1 -- 172.21.15.49:0/2528490239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830005040 con 0x7f18340fd150 2024-02-22T00:40:10.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183996c700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18340fc7f0 0x7f183410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:40:10.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f183916b700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fd150 0x7f183410e4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f18240044e0 tx=0x7f1824002b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:10.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f182affd700 1 -- 172.21.15.49:0/2528490239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1824007b40 con 0x7f18340fd150 2024-02-22T00:40:10.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.695+0000 7f182affd700 1 -- 172.21.15.49:0/2528490239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f182400f040 con 0x7f18340fd150 2024-02-22T00:40:10.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.696+0000 7f182affd700 1 -- 172.21.15.49:0/2528490239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182400d830 con 0x7f18340fd150 2024-02-22T00:40:10.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.696+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1834108280 con 0x7f18340fd150 2024-02-22T00:40:10.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.696+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18341087c0 con 0x7f18340fd150 2024-02-22T00:40:10.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.697+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183405f590 con 0x7f18340fd150 2024-02-22T00:40:10.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.697+0000 7f182affd700 1 -- 172.21.15.49:0/2528490239 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1824007ca0 con 0x7f18340fd150 2024-02-22T00:40:10.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.697+0000 7f182affd700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f182006caa0 0x7f182006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:10.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.697+0000 7f182affd700 1 -- 172.21.15.49:0/2528490239 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f182408b950 con 0x7f18340fd150 2024-02-22T00:40:10.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.698+0000 7f183996c700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f182006caa0 0x7f182006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:10.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.698+0000 7f183996c700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f182006caa0 0x7f182006ef60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f18300043d0 tx=0x7f183000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:10.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.702+0000 7f182affd700 1 -- 172.21.15.49:0/2528490239 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1824059550 con 0x7f18340fd150 2024-02-22T00:40:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='osd.1 [v2:172.21.15.49:6810/3701332011,v1:172.21.15.49:6811/3701332011]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T00:40:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: osdmap e56: 6 total, 5 up, 6 in 2024-02-22T00:40:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='osd.1 [v2:172.21.15.49:6810/3701332011,v1:172.21.15.49:6811/3701332011]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: failed to encode map e56 with expected crc 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:10.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-22T00:40:10.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.917+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1834108e60 con 0x7f182006caa0 2024-02-22T00:40:10.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.918+0000 7f182affd700 1 -- 172.21.15.49:0/2528490239 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1834108e60 con 0x7f182006caa0 2024-02-22T00:40:10.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f182006caa0 msgr2=0x7f182006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:10.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f182006caa0 0x7f182006ef60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f18300043d0 tx=0x7f183000b040).stop 2024-02-22T00:40:10.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fd150 msgr2=0x7f183410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fd150 0x7f183410e4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f18240044e0 tx=0x7f1824002b00).stop 2024-02-22T00:40:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 shutdown_connections 2024-02-22T00:40:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f182006caa0 0x7f182006ef60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18340fc7f0 0x7f183410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 --2- 172.21.15.49:0/2528490239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18340fd150 0x7f183410e4b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 >> 172.21.15.49:0/2528490239 conn(0x7f1834070590 msgr2=0x7f1834060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 shutdown_connections 2024-02-22T00:40:10.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:10.920+0000 7f183bbd0700 1 -- 172.21.15.49:0/2528490239 wait complete. 2024-02-22T00:40:10.933 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.023+0000 7f95f6885700 1 -- 172.21.15.49:0/2293163623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fd150 msgr2=0x7f95f00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.023+0000 7f95f6885700 1 --2- 172.21.15.49:0/2293163623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fd150 0x7f95f00f6930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f95e40047f0 tx=0x7f95e4009cb0).stop 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.023+0000 7f95f6885700 1 -- 172.21.15.49:0/2293163623 shutdown_connections 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.023+0000 7f95f6885700 1 --2- 172.21.15.49:0/2293163623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fd150 0x7f95f00f6930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.023+0000 7f95f6885700 1 --2- 172.21.15.49:0/2293163623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95f00fc7f0 0x7f95f00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.023+0000 7f95f6885700 1 -- 172.21.15.49:0/2293163623 >> 172.21.15.49:0/2293163623 conn(0x7f95f0070590 msgr2=0x7f95f00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.023+0000 7f95f6885700 1 -- 172.21.15.49:0/2293163623 shutdown_connections 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.023+0000 7f95f6885700 1 -- 172.21.15.49:0/2293163623 wait complete. 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.024+0000 7f95f6885700 1 Processor -- start 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.024+0000 7f95f6885700 1 -- start start 2024-02-22T00:40:11.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.024+0000 7f95f6885700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fc7f0 0x7f95f0106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.024+0000 7f95f6885700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95f00fd150 0x7f95f01073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.024+0000 7f95f6885700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00614e0 con 0x7f95f00fc7f0 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.024+0000 7f95f6885700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0107890 con 0x7f95f00fd150 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95effff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fc7f0 0x7f95f0106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95effff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fc7f0 0x7f95f0106eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48518/0 (socket says 172.21.15.49:48518) 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95effff700 1 -- 172.21.15.49:0/4013142012 learned_addr learned my addr 172.21.15.49:0/4013142012 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95ef7fe700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95f00fd150 0x7f95f01073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95effff700 1 -- 172.21.15.49:0/4013142012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95f00fd150 msgr2=0x7f95f01073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95effff700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95f00fd150 0x7f95f01073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95effff700 1 -- 172.21.15.49:0/4013142012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4005040 con 0x7f95f00fc7f0 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95effff700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fc7f0 0x7f95f0106eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f95e000c790 tx=0x7f95e0004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:11.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95ed7fa700 1 -- 172.21.15.49:0/4013142012 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e00106f0 con 0x7f95f00fc7f0 2024-02-22T00:40:11.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95ed7fa700 1 -- 172.21.15.49:0/4013142012 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f95e0010d00 con 0x7f95f00fc7f0 2024-02-22T00:40:11.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f0107b70 con 0x7f95f00fc7f0 2024-02-22T00:40:11.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95ed7fa700 1 -- 172.21.15.49:0/4013142012 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e0012da0 con 0x7f95f00fc7f0 2024-02-22T00:40:11.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.025+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f01146e0 con 0x7f95f00fc7f0 2024-02-22T00:40:11.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.026+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f005f590 con 0x7f95f00fc7f0 2024-02-22T00:40:11.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.027+0000 7f95ed7fa700 1 -- 172.21.15.49:0/4013142012 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f95e0012400 con 0x7f95f00fc7f0 2024-02-22T00:40:11.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.027+0000 7f95ed7fa700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f95d806caa0 0x7f95d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.027+0000 7f95ed7fa700 1 -- 172.21.15.49:0/4013142012 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f95e008b5a0 con 0x7f95f00fc7f0 2024-02-22T00:40:11.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.027+0000 7f95ef7fe700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f95d806caa0 0x7f95d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.028+0000 7f95ef7fe700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f95d806caa0 0x7f95d806ef60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f95f0060ee0 tx=0x7f95e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:11.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.032+0000 7f95ed7fa700 1 -- 172.21.15.49:0/4013142012 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f95e00591a0 con 0x7f95f00fc7f0 2024-02-22T00:40:11.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.248+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95f0059120 con 0x7f95d806caa0 2024-02-22T00:40:11.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.249+0000 7f95ed7fa700 1 -- 172.21.15.49:0/4013142012 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f95f0059120 con 0x7f95d806caa0 2024-02-22T00:40:11.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f95d806caa0 msgr2=0x7f95d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f95d806caa0 0x7f95d806ef60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f95f0060ee0 tx=0x7f95e400b040).stop 2024-02-22T00:40:11.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fc7f0 msgr2=0x7f95f0106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fc7f0 0x7f95f0106eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f95e000c790 tx=0x7f95e0004330).stop 2024-02-22T00:40:11.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 shutdown_connections 2024-02-22T00:40:11.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f95d806caa0 0x7f95d806ef60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95f00fc7f0 0x7f95f0106eb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 --2- 172.21.15.49:0/4013142012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95f00fd150 0x7f95f01073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 >> 172.21.15.49:0/4013142012 conn(0x7f95f0070590 msgr2=0x7f95f00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:11.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 shutdown_connections 2024-02-22T00:40:11.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.252+0000 7f95f6885700 1 -- 172.21.15.49:0/4013142012 wait complete. 2024-02-22T00:40:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.354+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3049883471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fc7f0 msgr2=0x7fe1c80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.354+0000 7fe1d03f3700 1 --2- 172.21.15.49:0/3049883471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fc7f0 0x7fe1c80fcbd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fe1c40047f0 tx=0x7fe1c4009cb0).stop 2024-02-22T00:40:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.354+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3049883471 shutdown_connections 2024-02-22T00:40:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.354+0000 7fe1d03f3700 1 --2- 172.21.15.49:0/3049883471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1c80fd150 0x7fe1c80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:40:11.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.354+0000 7fe1d03f3700 1 --2- 172.21.15.49:0/3049883471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fc7f0 0x7fe1c80fcbd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.354+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3049883471 >> 172.21.15.49:0/3049883471 conn(0x7fe1c8070590 msgr2=0x7fe1c80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.354+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3049883471 shutdown_connections 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.354+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3049883471 wait complete. 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1d03f3700 1 Processor -- start 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1d03f3700 1 -- start start 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1d03f3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1c80fc7f0 0x7fe1c810e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1d03f3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fd150 0x7fe1c810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1d03f3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c810ebe0 con 0x7fe1c80fd150 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1d03f3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8108200 con 0x7fe1c80fc7f0 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1cd98e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fd150 0x7fe1c810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1cd98e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fd150 0x7fe1c810e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48530/0 (socket says 172.21.15.49:48530) 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1cd98e700 1 -- 172.21.15.49:0/3591829886 learned_addr learned my addr 172.21.15.49:0/3591829886 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1ce18f700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1c80fc7f0 0x7fe1c810e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1cd98e700 1 -- 172.21.15.49:0/3591829886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1c80fc7f0 msgr2=0x7fe1c810e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1cd98e700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1c80fc7f0 0x7fe1c810e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.355+0000 7fe1cd98e700 1 -- 172.21.15.49:0/3591829886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4005040 con 0x7fe1c80fd150 2024-02-22T00:40:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.356+0000 7fe1cd98e700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fd150 0x7fe1c810e550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe1bc00b480 tx=0x7fe1bc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.356+0000 7fe1bb7fe700 1 -- 172.21.15.49:0/3591829886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1bc002500 con 0x7fe1c80fd150 2024-02-22T00:40:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.356+0000 7fe1bb7fe700 1 -- 172.21.15.49:0/3591829886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe1bc002b10 con 0x7fe1c80fd150 2024-02-22T00:40:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.356+0000 7fe1bb7fe700 1 -- 172.21.15.49:0/3591829886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1bc012c90 con 0x7fe1c80fd150 2024-02-22T00:40:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.356+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c81084b0 con 0x7fe1c80fd150 2024-02-22T00:40:11.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.356+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c81089f0 con 0x7fe1c80fd150 2024-02-22T00:40:11.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.357+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c805f590 con 0x7fe1c80fd150 2024-02-22T00:40:11.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.357+0000 7fe1bb7fe700 1 -- 172.21.15.49:0/3591829886 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe1bc002660 con 0x7fe1c80fd150 2024-02-22T00:40:11.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.358+0000 7fe1bb7fe700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe1b406caa0 0x7fe1b406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.358+0000 7fe1ce18f700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe1b406caa0 0x7fe1b406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.358+0000 7fe1bb7fe700 1 -- 172.21.15.49:0/3591829886 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fe1bc08bdc0 con 0x7fe1c80fd150 2024-02-22T00:40:11.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.358+0000 7fe1ce18f700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe1b406caa0 0x7fe1b406ef60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe1c4004f10 tx=0x7fe1c400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:11.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.362+0000 7fe1bb7fe700 1 -- 172.21.15.49:0/3591829886 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe1bc08f030 con 0x7fe1c80fd150 2024-02-22T00:40:11.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.596+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1c81096e0 con 0x7fe1b406caa0 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.606+0000 7fe1bb7fe700 1 -- 172.21.15.49:0/3591829886 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe1c81096e0 con 0x7fe1b406caa0 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (3m) 5s ago 14m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (67s) 5s ago 14m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (62s) 58s ago 13m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (3m) 5s ago 14m 91.1M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (9m) 5s ago 9m 16.2M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (9m) 5s ago 9m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:40:11.608 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (9m) 58s ago 9m 15.8M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (9m) 58s ago 9m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (5m) 5s ago 15m 495M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (4m) 58s ago 13m 447M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (2m) 5s ago 16m 45.1M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (104s) 58s ago 13m 35.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (4m) 5s ago 14m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (3m) 58s ago 13m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (43s) 5s ago 13m 90.9M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (10s) 5s ago 12m 13.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (12m) 5s ago 12m 197M 1910M 16.2.14-550-geb66ed92 7403d1862307 a0570e0b99a2 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (11m) 58s ago 11m 259M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (11m) 58s ago 11m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (10m) 58s ago 10m 220M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:40:11.609 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (3m) 58s ago 13m 56.7M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:40:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.607+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe1b406caa0 msgr2=0x7fe1b406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe1b406caa0 0x7fe1b406ef60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe1c4004f10 tx=0x7fe1c400b040).stop 2024-02-22T00:40:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fd150 msgr2=0x7fe1c810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fd150 0x7fe1c810e550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe1bc00b480 tx=0x7fe1bc0090f0).stop 2024-02-22T00:40:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 shutdown_connections 2024-02-22T00:40:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe1b406caa0 0x7fe1b406ef60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1c80fc7f0 0x7fe1c810e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 --2- 172.21.15.49:0/3591829886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1c80fd150 0x7fe1c810e550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 >> 172.21.15.49:0/3591829886 conn(0x7fe1c8070590 msgr2=0x7fe1c8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 shutdown_connections 2024-02-22T00:40:11.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.608+0000 7fe1d03f3700 1 -- 172.21.15.49:0/3591829886 wait complete. 2024-02-22T00:40:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: failed to encode map e56 with expected crc 2024-02-22T00:40:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-22T00:40:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-22T00:40:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:40:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: failed to encode map e57 with expected crc 2024-02-22T00:40:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: osd.1 [v2:172.21.15.49:6810/3701332011,v1:172.21.15.49:6811/3701332011] boot 2024-02-22T00:40:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: osdmap e57: 6 total, 6 up, 6 in 2024-02-22T00:40:11.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:40:11.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:11.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:11 smithi049 ceph-mon[132694]: osdmap e58: 6 total, 6 up, 6 in 2024-02-22T00:40:11.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.709+0000 7fb674cfb700 1 -- 172.21.15.49:0/517130843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 msgr2=0x7fb6700f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.709+0000 7fb674cfb700 1 --2- 172.21.15.49:0/517130843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 0x7fb6700f6930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb6640047f0 tx=0x7fb664009cb0).stop 2024-02-22T00:40:11.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.710+0000 7fb674cfb700 1 -- 172.21.15.49:0/517130843 shutdown_connections 2024-02-22T00:40:11.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.710+0000 7fb674cfb700 1 --2- 172.21.15.49:0/517130843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 0x7fb6700f6930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.710+0000 7fb674cfb700 1 --2- 172.21.15.49:0/517130843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700fc7f0 0x7fb6700fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:40:11.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.710+0000 7fb674cfb700 1 -- 172.21.15.49:0/517130843 >> 172.21.15.49:0/517130843 conn(0x7fb670070590 msgr2=0x7fb6700f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.710+0000 7fb674cfb700 1 -- 172.21.15.49:0/517130843 shutdown_connections 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.710+0000 7fb674cfb700 1 -- 172.21.15.49:0/517130843 wait complete. 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.710+0000 7fb674cfb700 1 Processor -- start 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb674cfb700 1 -- start start 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb674cfb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700fc7f0 0x7fb67010e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb674cfb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 0x7fb67010e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb674cfb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67010ebc0 con 0x7fb6700fd150 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb674cfb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6701081e0 con 0x7fb6700fc7f0 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb66dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 0x7fb67010e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb66dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 0x7fb67010e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60746/0 (socket says 172.21.15.49:60746) 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb66dd9b700 1 -- 172.21.15.49:0/2304183324 learned_addr learned my addr 172.21.15.49:0/2304183324 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb66e59c700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700fc7f0 0x7fb67010e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb66dd9b700 1 -- 172.21.15.49:0/2304183324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700fc7f0 msgr2=0x7fb67010e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:11.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb66dd9b700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700fc7f0 0x7fb67010e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:11.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb66dd9b700 1 -- 172.21.15.49:0/2304183324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664005040 con 0x7fb6700fd150 2024-02-22T00:40:11.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb66dd9b700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 0x7fb67010e530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb6640099f0 tx=0x7fb664009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:11.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb65f7fe700 1 -- 172.21.15.49:0/2304183324 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb66400e030 con 0x7fb6700fd150 2024-02-22T00:40:11.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb65f7fe700 1 -- 172.21.15.49:0/2304183324 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb664007e90 con 0x7fb6700fd150 2024-02-22T00:40:11.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb670108430 con 0x7fb6700fd150 2024-02-22T00:40:11.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.711+0000 7fb65f7fe700 1 -- 172.21.15.49:0/2304183324 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb664018070 con 0x7fb6700fd150 2024-02-22T00:40:11.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.712+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb670108910 con 0x7fb6700fd150 2024-02-22T00:40:11.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.712+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67005f590 con 0x7fb6700fd150 2024-02-22T00:40:11.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.713+0000 7fb65f7fe700 1 -- 172.21.15.49:0/2304183324 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb66401d420 con 0x7fb6700fd150 2024-02-22T00:40:11.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.713+0000 7fb65f7fe700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb65806caa0 0x7fb65806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:11.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.713+0000 7fb65f7fe700 1 -- 172.21.15.49:0/2304183324 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fb66408d1a0 con 0x7fb6700fd150 2024-02-22T00:40:11.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.713+0000 7fb66e59c700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb65806caa0 0x7fb65806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:11.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.714+0000 7fb66e59c700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb65806caa0 0x7fb65806ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb66000b910 tx=0x7fb660008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:11.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:11.718+0000 7fb65f7fe700 1 -- 172.21.15.49:0/2304183324 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb66405ada0 con 0x7fb6700fd150 2024-02-22T00:40:11.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: failed to encode map e56 with expected crc 2024-02-22T00:40:11.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-22T00:40:11.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-22T00:40:11.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:11.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:40:11.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: failed to encode map e57 with expected crc 2024-02-22T00:40:11.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: osd.1 [v2:172.21.15.49:6810/3701332011,v1:172.21.15.49:6811/3701332011] boot 2024-02-22T00:40:11.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: osdmap e57: 6 total, 6 up, 6 in 2024-02-22T00:40:11.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T00:40:11.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:11.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:11 smithi161 ceph-mon[113442]: osdmap e58: 6 total, 6 up, 6 in 2024-02-22T00:40:12.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.002+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb670047540 con 0x7fb6700fd150 2024-02-22T00:40:12.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.003+0000 7fb65f7fe700 1 -- 172.21.15.49:0/2304183324 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fb66405a930 con 0x7fb6700fd150 2024-02-22T00:40:12.005 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:40:12.005 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:40:12.005 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:40:12.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:40:12.005 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:40:12.005 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:40:12.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4, 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 8, 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:40:12.006 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:40:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb65806caa0 msgr2=0x7fb65806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb65806caa0 0x7fb65806ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb66000b910 tx=0x7fb660008040).stop 2024-02-22T00:40:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 msgr2=0x7fb67010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 0x7fb67010e530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb6640099f0 tx=0x7fb664009cb0).stop 2024-02-22T00:40:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 shutdown_connections 2024-02-22T00:40:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb65806caa0 0x7fb65806ef60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6700fc7f0 0x7fb67010e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 --2- 172.21.15.49:0/2304183324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb6700fd150 0x7fb67010e530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 >> 172.21.15.49:0/2304183324 conn(0x7fb670070590 msgr2=0x7fb670060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 shutdown_connections 2024-02-22T00:40:12.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.005+0000 7fb674cfb700 1 -- 172.21.15.49:0/2304183324 wait complete. 2024-02-22T00:40:12.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/943956556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fd150 msgr2=0x7f9e480f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 --2- 172.21.15.49:0/943956556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fd150 0x7f9e480f6930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9e3c0047f0 tx=0x7f9e3c009cb0).stop 2024-02-22T00:40:12.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/943956556 shutdown_connections 2024-02-22T00:40:12.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 --2- 172.21.15.49:0/943956556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fd150 0x7f9e480f6930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 --2- 172.21.15.49:0/943956556 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e480fc7f0 0x7f9e480fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/943956556 >> 172.21.15.49:0/943956556 conn(0x7f9e48070590 msgr2=0x7f9e480f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:12.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/943956556 shutdown_connections 2024-02-22T00:40:12.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/943956556 wait complete. 2024-02-22T00:40:12.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.106+0000 7f9e4dcd6700 1 Processor -- start 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e4dcd6700 1 -- start start 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e4dcd6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fc7f0 0x7f9e481090a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e4dcd6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e480fd150 0x7f9e48109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e4dcd6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48109a80 con 0x7f9e480fc7f0 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e4dcd6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48109bc0 con 0x7f9e480fd150 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fc7f0 0x7f9e481090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fc7f0 0x7f9e481090a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60764/0 (socket says 172.21.15.49:60764) 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e477fe700 1 -- 172.21.15.49:0/645134360 learned_addr learned my addr 172.21.15.49:0/645134360 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e46ffd700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e480fd150 0x7f9e48109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e477fe700 1 -- 172.21.15.49:0/645134360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e480fd150 msgr2=0x7f9e48109590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e477fe700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e480fd150 0x7f9e48109590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e477fe700 1 -- 172.21.15.49:0/645134360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c005040 con 0x7f9e480fc7f0 2024-02-22T00:40:12.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.107+0000 7f9e477fe700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fc7f0 0x7f9e481090a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f9e380041d0 tx=0x7f9e38009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:12.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.108+0000 7f9e44ff9700 1 -- 172.21.15.49:0/645134360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e38007b40 con 0x7f9e480fc7f0 2024-02-22T00:40:12.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.108+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e48109e70 con 0x7f9e480fc7f0 2024-02-22T00:40:12.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.108+0000 7f9e44ff9700 1 -- 172.21.15.49:0/645134360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e3800f040 con 0x7f9e480fc7f0 2024-02-22T00:40:12.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.108+0000 7f9e44ff9700 1 -- 172.21.15.49:0/645134360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e380147b0 con 0x7f9e480fc7f0 2024-02-22T00:40:12.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.108+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e48112490 con 0x7f9e480fc7f0 2024-02-22T00:40:12.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.109+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4805f590 con 0x7f9e480fc7f0 2024-02-22T00:40:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.109+0000 7f9e44ff9700 1 -- 172.21.15.49:0/645134360 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9e38009110 con 0x7f9e480fc7f0 2024-02-22T00:40:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.110+0000 7f9e44ff9700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e3006caa0 0x7f9e3006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.110+0000 7f9e44ff9700 1 -- 172.21.15.49:0/645134360 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f9e3808bd00 con 0x7f9e480fc7f0 2024-02-22T00:40:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.110+0000 7f9e46ffd700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e3006caa0 0x7f9e3006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.110+0000 7f9e46ffd700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e3006caa0 0x7f9e3006ef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9e48060f00 tx=0x7f9e3c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:12.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.114+0000 7f9e44ff9700 1 -- 172.21.15.49:0/645134360 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9e3808f030 con 0x7f9e480fc7f0 2024-02-22T00:40:12.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.356+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e48047540 con 0x7f9e480fc7f0 2024-02-22T00:40:12.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.357+0000 7f9e44ff9700 1 -- 172.21.15.49:0/645134360 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f9e38055e70 con 0x7f9e480fc7f0 2024-02-22T00:40:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:40:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:40:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:40:12.359 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:40:12.360 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:40:12.361 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:40:12.362 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e3006caa0 msgr2=0x7f9e3006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e3006caa0 0x7f9e3006ef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9e48060f00 tx=0x7f9e3c00b040).stop 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fc7f0 msgr2=0x7f9e481090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fc7f0 0x7f9e481090a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f9e380041d0 tx=0x7f9e38009f60).stop 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 shutdown_connections 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e3006caa0 0x7f9e3006ef60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e480fc7f0 0x7f9e481090a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 --2- 172.21.15.49:0/645134360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e480fd150 0x7f9e48109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 >> 172.21.15.49:0/645134360 conn(0x7f9e48070590 msgr2=0x7f9e480fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:12.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 shutdown_connections 2024-02-22T00:40:12.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.359+0000 7f9e4dcd6700 1 -- 172.21.15.49:0/645134360 wait complete. 2024-02-22T00:40:12.364 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:40:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.464+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/4179771865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fc7f0 msgr2=0x7f4a080fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.464+0000 7f4a0f4d7700 1 --2- 172.21.15.49:0/4179771865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fc7f0 0x7f4a080fcbd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f4a040047f0 tx=0x7f4a04009cb0).stop 2024-02-22T00:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.464+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/4179771865 shutdown_connections 2024-02-22T00:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.464+0000 7f4a0f4d7700 1 --2- 172.21.15.49:0/4179771865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a080fd150 0x7f4a080f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.464+0000 7f4a0f4d7700 1 --2- 172.21.15.49:0/4179771865 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fc7f0 0x7f4a080fcbd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.464+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/4179771865 >> 172.21.15.49:0/4179771865 conn(0x7f4a08070590 msgr2=0x7f4a080f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.464+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/4179771865 shutdown_connections 2024-02-22T00:40:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.464+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/4179771865 wait complete. 2024-02-22T00:40:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.465+0000 7f4a0f4d7700 1 Processor -- start 2024-02-22T00:40:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.465+0000 7f4a0f4d7700 1 -- start start 2024-02-22T00:40:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.465+0000 7f4a0f4d7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a080fc7f0 0x7f4a0810cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.465+0000 7f4a0f4d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fd150 0x7f4a0810d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.465+0000 7f4a0f4d7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0810da20 con 0x7f4a080fd150 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.465+0000 7f4a0f4d7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0810db60 con 0x7f4a080fc7f0 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.465+0000 7f4a0ca72700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fd150 0x7f4a0810d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0ca72700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fd150 0x7f4a0810d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60772/0 (socket says 172.21.15.49:60772) 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0ca72700 1 -- 172.21.15.49:0/1477030800 learned_addr learned my addr 172.21.15.49:0/1477030800 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0d273700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a080fc7f0 0x7f4a0810cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0ca72700 1 -- 172.21.15.49:0/1477030800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a080fc7f0 msgr2=0x7f4a0810cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0ca72700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a080fc7f0 0x7f4a0810cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0ca72700 1 -- 172.21.15.49:0/1477030800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a04005040 con 0x7f4a080fd150 2024-02-22T00:40:12.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0ca72700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fd150 0x7f4a0810d420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f49fc002820 tx=0x7f49fc009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f49fa7fc700 1 -- 172.21.15.49:0/1477030800 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc007b40 con 0x7f4a080fd150 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a081071f0 con 0x7f4a080fd150 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f49fa7fc700 1 -- 172.21.15.49:0/1477030800 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49fc00f040 con 0x7f4a080fd150 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f49fa7fc700 1 -- 172.21.15.49:0/1477030800 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49fc0148b0 con 0x7f4a080fd150 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.466+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a081077b0 con 0x7f4a080fd150 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.467+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0805f590 con 0x7f4a080fd150 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.468+0000 7f49fa7fc700 1 -- 172.21.15.49:0/1477030800 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f49fc007ca0 con 0x7f4a080fd150 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.468+0000 7f49fa7fc700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49f406cab0 0x7f49f406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.468+0000 7f49fa7fc700 1 -- 172.21.15.49:0/1477030800 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f49fc08b7a0 con 0x7f4a080fd150 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.468+0000 7f4a0d273700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49f406cab0 0x7f49f406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.469+0000 7f4a0d273700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49f406cab0 0x7f49f406ef70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4a04004f10 tx=0x7f4a04009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:12.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.472+0000 7f49fa7fc700 1 -- 172.21.15.49:0/1477030800 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f49fc0593a0 con 0x7f4a080fd150 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2304183324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/645134360' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:40:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:12 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:40:12.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.687+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a08107e50 con 0x7f49f406cab0 2024-02-22T00:40:12.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.689+0000 7f49fa7fc700 1 -- 172.21.15.49:0/1477030800 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4a08107e50 con 0x7f49f406cab0 2024-02-22T00:40:12.691 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:40:12.691 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:40:12.691 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:40:12.691 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "8/21 daemons upgraded", 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:40:12.692 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:40:12.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49f406cab0 msgr2=0x7f49f406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49f406cab0 0x7f49f406ef70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4a04004f10 tx=0x7f4a04009cb0).stop 2024-02-22T00:40:12.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fd150 msgr2=0x7f4a0810d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fd150 0x7f4a0810d420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f49fc002820 tx=0x7f49fc009f20).stop 2024-02-22T00:40:12.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 shutdown_connections 2024-02-22T00:40:12.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49f406cab0 0x7f49f406ef70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a080fc7f0 0x7f4a0810cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 --2- 172.21.15.49:0/1477030800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a080fd150 0x7f4a0810d420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 >> 172.21.15.49:0/1477030800 conn(0x7f4a08070590 msgr2=0x7f4a080fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:12.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 shutdown_connections 2024-02-22T00:40:12.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.691+0000 7f4a0f4d7700 1 -- 172.21.15.49:0/1477030800 wait complete. 2024-02-22T00:40:12.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:12.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: failed to encode map e58 with expected crc 2024-02-22T00:40:12.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:12.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2304183324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:12.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/645134360' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:40:12.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:12.795 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:12 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:40:12.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.792+0000 7ffb487c1700 1 -- 172.21.15.49:0/23914715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 msgr2=0x7ffb400fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.792+0000 7ffb487c1700 1 --2- 172.21.15.49:0/23914715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 0x7ffb400fcbd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ffb3c0047f0 tx=0x7ffb3c009cb0).stop 2024-02-22T00:40:12.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.792+0000 7ffb487c1700 1 -- 172.21.15.49:0/23914715 shutdown_connections 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.792+0000 7ffb487c1700 1 --2- 172.21.15.49:0/23914715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb400fd150 0x7ffb400f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.792+0000 7ffb487c1700 1 --2- 172.21.15.49:0/23914715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 0x7ffb400fcbd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.792+0000 7ffb487c1700 1 -- 172.21.15.49:0/23914715 >> 172.21.15.49:0/23914715 conn(0x7ffb40070590 msgr2=0x7ffb400f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.792+0000 7ffb487c1700 1 -- 172.21.15.49:0/23914715 shutdown_connections 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.792+0000 7ffb487c1700 1 -- 172.21.15.49:0/23914715 wait complete. 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb487c1700 1 Processor -- start 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb487c1700 1 -- start start 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb487c1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 0x7ffb4010e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb487c1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb400fd150 0x7ffb4010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb487c1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4010eb80 con 0x7ffb400fc7f0 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb487c1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4010ecc0 con 0x7ffb400fd150 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb4655d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 0x7ffb4010e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb4655d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 0x7ffb4010e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60780/0 (socket says 172.21.15.49:60780) 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb4655d700 1 -- 172.21.15.49:0/3004642004 learned_addr learned my addr 172.21.15.49:0/3004642004 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.793+0000 7ffb45d5c700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb400fd150 0x7ffb4010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb4655d700 1 -- 172.21.15.49:0/3004642004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb400fd150 msgr2=0x7ffb4010e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb4655d700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb400fd150 0x7ffb4010e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb4655d700 1 -- 172.21.15.49:0/3004642004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c005040 con 0x7ffb400fc7f0 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb4655d700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 0x7ffb4010e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ffb3c009380 tx=0x7ffb3c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb377fe700 1 -- 172.21.15.49:0/3004642004 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb3c018070 con 0x7ffb400fc7f0 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb377fe700 1 -- 172.21.15.49:0/3004642004 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb3c007e90 con 0x7ffb400fc7f0 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb40108330 con 0x7ffb400fc7f0 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb377fe700 1 -- 172.21.15.49:0/3004642004 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb3c0123c0 con 0x7ffb400fc7f0 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.794+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb40108890 con 0x7ffb400fc7f0 2024-02-22T00:40:12.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.795+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4005f590 con 0x7ffb400fc7f0 2024-02-22T00:40:12.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.795+0000 7ffb377fe700 1 -- 172.21.15.49:0/3004642004 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffb3c01d420 con 0x7ffb400fc7f0 2024-02-22T00:40:12.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.796+0000 7ffb377fe700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:12.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.796+0000 7ffb377fe700 1 -- 172.21.15.49:0/3004642004 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6051+0+0 (secure 0 0 0) 0x7ffb3c08c900 con 0x7ffb400fc7f0 2024-02-22T00:40:12.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.796+0000 7ffb45d5c700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:12.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.796+0000 7ffb45d5c700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ffb40109a10 tx=0x7ffb3000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:12.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:12.800+0000 7ffb377fe700 1 -- 172.21.15.49:0/3004642004 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffb3c056a70 con 0x7ffb400fc7f0 2024-02-22T00:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.079+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ffb40047540 con 0x7ffb400fc7f0 2024-02-22T00:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.080+0000 7ffb377fe700 1 -- 172.21.15.49:0/3004642004 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1071 (secure 0 0 0) 0x7ffb3c05a090 con 0x7ffb400fc7f0 2024-02-22T00:40:13.082 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN Degraded data redundancy: 51/321 objects degraded (15.888%), 16 pgs degraded 2024-02-22T00:40:13.082 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 51/321 objects degraded (15.888%), 16 pgs degraded 2024-02-22T00:40:13.082 INFO:teuthology.orchestra.run.smithi049.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-02-22T00:40:13.083 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-02-22T00:40:13.084 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-02-22T00:40:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 msgr2=0x7ffb2c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:13.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ffb40109a10 tx=0x7ffb3000b040).stop 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 msgr2=0x7ffb4010e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 0x7ffb4010e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ffb3c009380 tx=0x7ffb3c009cb0).stop 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 shutdown_connections 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb400fc7f0 0x7ffb4010e090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 --2- 172.21.15.49:0/3004642004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb400fd150 0x7ffb4010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 >> 172.21.15.49:0/3004642004 conn(0x7ffb40070590 msgr2=0x7ffb40060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 shutdown_connections 2024-02-22T00:40:13.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:13.082+0000 7ffb487c1700 1 -- 172.21.15.49:0/3004642004 wait complete. 2024-02-22T00:40:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:13 smithi049 ceph-mon[132694]: pgmap v73: 65 pgs: 2 peering, 16 active+undersized+degraded, 16 active+undersized, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:13 smithi049 ceph-mon[132694]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:13 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3004642004' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:40:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:13 smithi161 ceph-mon[113442]: pgmap v73: 65 pgs: 2 peering, 16 active+undersized+degraded, 16 active+undersized, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-02-22T00:40:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:13 smithi161 ceph-mon[113442]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:13 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3004642004' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:40:14.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:14 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 22/321 objects degraded (6.854%), 7 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:14.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:14 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 22/321 objects degraded (6.854%), 7 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:16.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:15 smithi161 ceph-mon[113442]: pgmap v74: 65 pgs: 2 peering, 7 active+undersized+degraded, 5 active+undersized, 51 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22/321 objects degraded (6.854%) 2024-02-22T00:40:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:15 smithi049 ceph-mon[132694]: pgmap v74: 65 pgs: 2 peering, 7 active+undersized+degraded, 5 active+undersized, 51 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22/321 objects degraded (6.854%) 2024-02-22T00:40:17.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:16 smithi161 ceph-mon[113442]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/321 objects degraded (6.854%), 7 pgs degraded) 2024-02-22T00:40:17.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:16 smithi161 ceph-mon[113442]: Cluster is now healthy 2024-02-22T00:40:17.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:16 smithi049 ceph-mon[132694]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/321 objects degraded (6.854%), 7 pgs degraded) 2024-02-22T00:40:17.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:16 smithi049 ceph-mon[132694]: Cluster is now healthy 2024-02-22T00:40:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:17 smithi161 ceph-mon[113442]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:17 smithi049 ceph-mon[132694]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:20.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:19 smithi161 ceph-mon[113442]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:19 smithi049 ceph-mon[132694]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:22.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:21 smithi049 ceph-mon[132694]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:21 smithi161 ceph-mon[113442]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:23.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:23 smithi049 ceph-mon[132694]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:23.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:23 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:23 smithi161 ceph-mon[113442]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:23.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:23 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:26.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:25 smithi049 ceph-mon[132694]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:26.064 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-22T00:40:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:25 smithi161 ceph-mon[113442]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-22T00:40:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:26 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-22T00:40:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:26 smithi049 ceph-mon[132694]: Upgrade: osd.2 is safe to restart 2024-02-22T00:40:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T00:40:27.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:40:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:26 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-22T00:40:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:26 smithi161 ceph-mon[113442]: Upgrade: osd.2 is safe to restart 2024-02-22T00:40:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T00:40:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:40:27.955 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:27 smithi049 ceph-mon[132694]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:27.955 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:27 smithi049 ceph-mon[132694]: Upgrade: Updating osd.2 2024-02-22T00:40:27.956 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:27 smithi049 ceph-mon[132694]: Deploying daemon osd.2 on smithi049 2024-02-22T00:40:27.956 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:27 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:27.956 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:27 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:40:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:27 smithi161 ceph-mon[113442]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:27 smithi161 ceph-mon[113442]: Upgrade: Updating osd.2 2024-02-22T00:40:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:27 smithi161 ceph-mon[113442]: Deploying daemon osd.2 on smithi049 2024-02-22T00:40:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:27 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:27 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:40:30.213 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:29 smithi049 ceph-mon[132694]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:30.213 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:29 smithi049 systemd[1]: Stopping Ceph osd.2 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:40:30.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:29 smithi161 ceph-mon[113442]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:30.678 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[93221]: debug 2024-02-22T00:40:30.209+0000 7f6287366700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T00:40:30.678 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[93221]: debug 2024-02-22T00:40:30.209+0000 7f6287366700 -1 osd.2 58 *** Got signal Terminated *** 2024-02-22T00:40:30.678 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:30 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[93221]: debug 2024-02-22T00:40:30.209+0000 7f6287366700 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T00:40:31.235 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:30 smithi049 ceph-mon[132694]: osd.2 marked itself down and dead 2024-02-22T00:40:31.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:30 smithi161 ceph-mon[113442]: osd.2 marked itself down and dead 2024-02-22T00:40:31.678 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:31 smithi049 bash[161238]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2 2024-02-22T00:40:32.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:31 smithi049 ceph-mon[132694]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:32.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:31 smithi049 ceph-mon[132694]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:40:32.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:31 smithi049 ceph-mon[132694]: failed to encode map e59 with expected crc 2024-02-22T00:40:32.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:31 smithi049 ceph-mon[132694]: failed to encode map e59 with expected crc 2024-02-22T00:40:32.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:31 smithi049 ceph-mon[132694]: osdmap e59: 6 total, 5 up, 6 in 2024-02-22T00:40:32.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:31 smithi049 ceph-mon[132694]: failed to encode map e59 with expected crc 2024-02-22T00:40:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:31 smithi161 ceph-mon[113442]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:31 smithi161 ceph-mon[113442]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:40:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:31 smithi161 ceph-mon[113442]: failed to encode map e59 with expected crc 2024-02-22T00:40:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:31 smithi161 ceph-mon[113442]: failed to encode map e59 with expected crc 2024-02-22T00:40:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:31 smithi161 ceph-mon[113442]: osdmap e59: 6 total, 5 up, 6 in 2024-02-22T00:40:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:31 smithi161 ceph-mon[113442]: failed to encode map e59 with expected crc 2024-02-22T00:40:33.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: osdmap e60: 6 total, 5 up, 6 in 2024-02-22T00:40:33.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:32 smithi161 ceph-mon[113442]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.409 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:32 smithi049 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.2.service: Succeeded. 2024-02-22T00:40:33.409 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:32 smithi049 systemd[1]: Stopped Ceph osd.2 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:40:33.409 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:33 smithi049 systemd[1]: Starting Ceph osd.2 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: osdmap e60: 6 total, 5 up, 6 in 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: failed to encode map e60 with expected crc 2024-02-22T00:40:33.410 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:32 smithi049 ceph-mon[132694]: failed to encode map e60 with expected crc 2024-02-22T00:40:34.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:33 smithi161 ceph-mon[113442]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:34.342 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:33 smithi049 ceph-mon[132694]: pgmap v85: 65 pgs: 9 stale+active+clean, 56 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-22T00:40:34.342 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:33 smithi049 bash[161507]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-22T00:40:34.342 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:33 smithi049 bash[161507]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-22T00:40:34.342 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:33 smithi049 bash[161507]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-22T00:40:34.342 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:33 smithi049 bash[161507]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-22T00:40:34.342 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:33 smithi049 bash[161507]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-22T00:40:34.342 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:33 smithi049 bash[161507]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-22T00:40:34.342 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:33 smithi049 bash[161507]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-22T00:40:35.428 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:35 smithi049 ceph-osd[161835]: -- 172.21.15.49:0/1008130584 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b68dd44e0 con 0x564b68da5000 2024-02-22T00:40:35.428 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:35 smithi049 bash[161797]: 9908da7b40647ee4bf6943ad7c309253e4eae4b298875331c35267e0bbadd53b 2024-02-22T00:40:35.428 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:35 smithi049 systemd[1]: Started Ceph osd.2 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:40:35.909 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[161812]: 2024-02-22T00:40:35.548+0000 7f203465f640 -1 Falling back to public interface 2024-02-22T00:40:36.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:35 smithi049 ceph-mon[132694]: pgmap v86: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 14/321 objects degraded (4.361%) 2024-02-22T00:40:36.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:35 smithi049 ceph-mon[132694]: Health check failed: Degraded data redundancy: 14/321 objects degraded (4.361%), 5 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:36.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:35 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:36.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:35 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:36.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:35 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:40:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:35 smithi161 ceph-mon[113442]: pgmap v86: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 14/321 objects degraded (4.361%) 2024-02-22T00:40:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:35 smithi161 ceph-mon[113442]: Health check failed: Degraded data redundancy: 14/321 objects degraded (4.361%), 5 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:35 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:35 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:36.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:35 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:40:38.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:37 smithi161 ceph-mon[113442]: pgmap v87: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:37 smithi049 ceph-mon[132694]: pgmap v87: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:39 smithi161 ceph-mon[113442]: pgmap v88: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:39 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:39 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:39 smithi049 ceph-mon[132694]: pgmap v88: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:39 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:39 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:41.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:41 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:41.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:41 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:41.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:41 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:41.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:41 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:42 smithi049 ceph-mon[132694]: pgmap v89: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:42 smithi161 ceph-mon[113442]: pgmap v89: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.187+0000 7f4e7be87700 1 -- 172.21.15.49:0/3899708292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 msgr2=0x7f4e74101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.187+0000 7f4e7be87700 1 --2- 172.21.15.49:0/3899708292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 0x7f4e74101910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f4e640047f0 tx=0x7f4e64009cb0).stop 2024-02-22T00:40:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.188+0000 7f4e7be87700 1 -- 172.21.15.49:0/3899708292 shutdown_connections 2024-02-22T00:40:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.188+0000 7f4e7be87700 1 --2- 172.21.15.49:0/3899708292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 0x7f4e74101910 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.188+0000 7f4e7be87700 1 --2- 172.21.15.49:0/3899708292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e740f88a0 0x7f4e740f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.188+0000 7f4e7be87700 1 -- 172.21.15.49:0/3899708292 >> 172.21.15.49:0/3899708292 conn(0x7f4e74070590 msgr2=0x7f4e740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:43.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.188+0000 7f4e7be87700 1 -- 172.21.15.49:0/3899708292 shutdown_connections 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.188+0000 7f4e7be87700 1 -- 172.21.15.49:0/3899708292 wait complete. 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.188+0000 7f4e7be87700 1 Processor -- start 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.188+0000 7f4e7be87700 1 -- start start 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e7be87700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e740f88a0 0x7f4e7410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e7be87700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 0x7f4e7410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e7be87700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7410eb70 con 0x7f4e740f9200 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e7be87700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7410ecb0 con 0x7f4e740f88a0 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e79422700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 0x7f4e7410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e79422700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 0x7f4e7410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41288/0 (socket says 172.21.15.49:41288) 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e79422700 1 -- 172.21.15.49:0/1971160499 learned_addr learned my addr 172.21.15.49:0/1971160499 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e79c23700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e740f88a0 0x7f4e7410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e79422700 1 -- 172.21.15.49:0/1971160499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e740f88a0 msgr2=0x7f4e7410e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e79422700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e740f88a0 0x7f4e7410e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e79422700 1 -- 172.21.15.49:0/1971160499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64005040 con 0x7f4e740f9200 2024-02-22T00:40:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e79422700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 0x7f4e7410e570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4e6400b120 tx=0x7f4e64009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e6affd700 1 -- 172.21.15.49:0/1971160499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e6400e030 con 0x7f4e740f9200 2024-02-22T00:40:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e6affd700 1 -- 172.21.15.49:0/1971160499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e64007e90 con 0x7f4e740f9200 2024-02-22T00:40:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e741082e0 con 0x7f4e740f9200 2024-02-22T00:40:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.189+0000 7f4e6affd700 1 -- 172.21.15.49:0/1971160499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e64018070 con 0x7f4e740f9200 2024-02-22T00:40:43.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.190+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e741087c0 con 0x7f4e740f9200 2024-02-22T00:40:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.191+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7405f590 con 0x7f4e740f9200 2024-02-22T00:40:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.191+0000 7f4e6affd700 1 -- 172.21.15.49:0/1971160499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4e6401d420 con 0x7f4e740f9200 2024-02-22T00:40:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.192+0000 7f4e6affd700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4e6006caa0 0x7f4e6006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.192+0000 7f4e6affd700 1 -- 172.21.15.49:0/1971160499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f4e6408d020 con 0x7f4e740f9200 2024-02-22T00:40:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.192+0000 7f4e79c23700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4e6006caa0 0x7f4e6006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.192+0000 7f4e79c23700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4e6006caa0 0x7f4e6006ef60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4e700041d0 tx=0x7f4e70009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:43.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.196+0000 7f4e6affd700 1 -- 172.21.15.49:0/1971160499 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4e6405ac20 con 0x7f4e740f9200 2024-02-22T00:40:43.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.426+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e741097e0 con 0x7f4e6006caa0 2024-02-22T00:40:43.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.427+0000 7f4e6affd700 1 -- 172.21.15.49:0/1971160499 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4e741097e0 con 0x7f4e6006caa0 2024-02-22T00:40:43.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4e6006caa0 msgr2=0x7f4e6006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4e6006caa0 0x7f4e6006ef60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4e700041d0 tx=0x7f4e70009040).stop 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 msgr2=0x7f4e7410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 0x7f4e7410e570 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f4e6400b120 tx=0x7f4e64009cb0).stop 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 shutdown_connections 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4e6006caa0 0x7f4e6006ef60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e740f88a0 0x7f4e7410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 --2- 172.21.15.49:0/1971160499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e740f9200 0x7f4e7410e570 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.429+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 >> 172.21.15.49:0/1971160499 conn(0x7f4e74070590 msgr2=0x7f4e740fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.430+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 shutdown_connections 2024-02-22T00:40:43.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.430+0000 7f4e7be87700 1 -- 172.21.15.49:0/1971160499 wait complete. 2024-02-22T00:40:43.443 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:40:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.541+0000 7f4de147b700 1 -- 172.21.15.49:0/36373518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6fe0 msgr2=0x7f4ddc103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.541+0000 7f4de147b700 1 --2- 172.21.15.49:0/36373518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6fe0 0x7f4ddc103d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f4dd00047f0 tx=0x7f4dd0009cb0).stop 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.541+0000 7f4de147b700 1 -- 172.21.15.49:0/36373518 shutdown_connections 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.541+0000 7f4de147b700 1 --2- 172.21.15.49:0/36373518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6fe0 0x7f4ddc103d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.541+0000 7f4de147b700 1 --2- 172.21.15.49:0/36373518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ddc0f6710 0x7f4ddc0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.541+0000 7f4de147b700 1 -- 172.21.15.49:0/36373518 >> 172.21.15.49:0/36373518 conn(0x7f4ddc070590 msgr2=0x7f4ddc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.541+0000 7f4de147b700 1 -- 172.21.15.49:0/36373518 shutdown_connections 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.541+0000 7f4de147b700 1 -- 172.21.15.49:0/36373518 wait complete. 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.542+0000 7f4de147b700 1 Processor -- start 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.542+0000 7f4de147b700 1 -- start start 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.542+0000 7f4de147b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6710 0x7f4ddc06a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4de147b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ddc0f6fe0 0x7f4ddc065b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4de147b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc066150 con 0x7f4ddc0f6710 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4de147b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc066290 con 0x7f4ddc0f6fe0 2024-02-22T00:40:43.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4ddaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6710 0x7f4ddc06a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4ddaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6710 0x7f4ddc06a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41302/0 (socket says 172.21.15.49:41302) 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4ddaffd700 1 -- 172.21.15.49:0/545729097 learned_addr learned my addr 172.21.15.49:0/545729097 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4dda7fc700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ddc0f6fe0 0x7f4ddc065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4ddaffd700 1 -- 172.21.15.49:0/545729097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ddc0f6fe0 msgr2=0x7f4ddc065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4ddaffd700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ddc0f6fe0 0x7f4ddc065b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4ddaffd700 1 -- 172.21.15.49:0/545729097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0005040 con 0x7f4ddc0f6710 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4ddaffd700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6710 0x7f4ddc06a9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4dcc0041d0 tx=0x7f4dcc009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4dc3fff700 1 -- 172.21.15.49:0/545729097 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dcc007b40 con 0x7f4ddc0f6710 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4dc3fff700 1 -- 172.21.15.49:0/545729097 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4dcc00f040 con 0x7f4ddc0f6710 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc066540 con 0x7f4ddc0f6710 2024-02-22T00:40:43.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4dc3fff700 1 -- 172.21.15.49:0/545729097 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dcc0137d0 con 0x7f4ddc0f6710 2024-02-22T00:40:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.543+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc11d000 con 0x7f4ddc0f6710 2024-02-22T00:40:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.544+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc05f590 con 0x7f4ddc0f6710 2024-02-22T00:40:43.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.545+0000 7f4dc3fff700 1 -- 172.21.15.49:0/545729097 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4dcc007ca0 con 0x7f4ddc0f6710 2024-02-22T00:40:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.545+0000 7f4dc3fff700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4dc406cab0 0x7f4dc406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.546+0000 7f4dc3fff700 1 -- 172.21.15.49:0/545729097 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f4dcc08b710 con 0x7f4ddc0f6710 2024-02-22T00:40:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.546+0000 7f4dda7fc700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4dc406cab0 0x7f4dc406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.546+0000 7f4dda7fc700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4dc406cab0 0x7f4dc406ef70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4dd0004f10 tx=0x7f4dd0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.550+0000 7f4dc3fff700 1 -- 172.21.15.49:0/545729097 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4dcc055880 con 0x7f4ddc0f6710 2024-02-22T00:40:43.635 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:43 smithi049 ceph-mon[132694]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:43.635 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:43.635 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:40:43.636 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[161812]: 2024-02-22T00:40:43.489+0000 7f203465f640 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-22T00:40:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:43 smithi161 ceph-mon[113442]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:40:43.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.824+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ddc067140 con 0x7f4dc406cab0 2024-02-22T00:40:43.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.825+0000 7f4dc3fff700 1 -- 172.21.15.49:0/545729097 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4ddc067140 con 0x7f4dc406cab0 2024-02-22T00:40:43.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.828+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4dc406cab0 msgr2=0x7f4dc406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.828+0000 7f4de147b700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4dc406cab0 0x7f4dc406ef70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4dd0004f10 tx=0x7f4dd0009cb0).stop 2024-02-22T00:40:43.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.828+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6710 msgr2=0x7f4ddc06a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.828+0000 7f4de147b700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6710 0x7f4ddc06a9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4dcc0041d0 tx=0x7f4dcc009f60).stop 2024-02-22T00:40:43.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.834+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 shutdown_connections 2024-02-22T00:40:43.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.834+0000 7f4de147b700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4dc406cab0 0x7f4dc406ef70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.834+0000 7f4de147b700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ddc0f6710 0x7f4ddc06a9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.834+0000 7f4de147b700 1 --2- 172.21.15.49:0/545729097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ddc0f6fe0 0x7f4ddc065b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.834+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 >> 172.21.15.49:0/545729097 conn(0x7f4ddc070590 msgr2=0x7f4ddc06d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:43.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.834+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 shutdown_connections 2024-02-22T00:40:43.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.834+0000 7f4de147b700 1 -- 172.21.15.49:0/545729097 wait complete. 2024-02-22T00:40:43.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 -- 172.21.15.49:0/3049262672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 msgr2=0x7f6640101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 --2- 172.21.15.49:0/3049262672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 0x7f6640101910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f66280047f0 tx=0x7f6628009cb0).stop 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 -- 172.21.15.49:0/3049262672 shutdown_connections 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 --2- 172.21.15.49:0/3049262672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 0x7f6640101910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 --2- 172.21.15.49:0/3049262672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66400f88a0 0x7f66400f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 -- 172.21.15.49:0/3049262672 >> 172.21.15.49:0/3049262672 conn(0x7f6640070590 msgr2=0x7f66400f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 -- 172.21.15.49:0/3049262672 shutdown_connections 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 -- 172.21.15.49:0/3049262672 wait complete. 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.947+0000 7f6645239700 1 Processor -- start 2024-02-22T00:40:43.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f6645239700 1 -- start start 2024-02-22T00:40:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f6645239700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66400f88a0 0x7f664010e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f6645239700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 0x7f664010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f6645239700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664010eb80 con 0x7f66400f9200 2024-02-22T00:40:43.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f6645239700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664010ecc0 con 0x7f66400f88a0 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f663e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 0x7f664010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f663e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 0x7f664010e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41338/0 (socket says 172.21.15.49:41338) 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f663e59c700 1 -- 172.21.15.49:0/3054128446 learned_addr learned my addr 172.21.15.49:0/3054128446 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f663ed9d700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66400f88a0 0x7f664010e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f663e59c700 1 -- 172.21.15.49:0/3054128446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66400f88a0 msgr2=0x7f664010e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f663e59c700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66400f88a0 0x7f664010e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f663e59c700 1 -- 172.21.15.49:0/3054128446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628005040 con 0x7f66400f9200 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.948+0000 7f663e59c700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 0x7f664010e580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f662800b120 tx=0x7f6628009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.949+0000 7f6637fff700 1 -- 172.21.15.49:0/3054128446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f662800e030 con 0x7f66400f9200 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.949+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66401082f0 con 0x7f66400f9200 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.949+0000 7f6637fff700 1 -- 172.21.15.49:0/3054128446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6628007e90 con 0x7f66400f9200 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.949+0000 7f6637fff700 1 -- 172.21.15.49:0/3054128446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6628018070 con 0x7f66400f9200 2024-02-22T00:40:43.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.949+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66401087d0 con 0x7f66400f9200 2024-02-22T00:40:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.950+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664005f590 con 0x7f66400f9200 2024-02-22T00:40:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.951+0000 7f6637fff700 1 -- 172.21.15.49:0/3054128446 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f662801d420 con 0x7f66400f9200 2024-02-22T00:40:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.951+0000 7f6637fff700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f662c06caa0 0x7f662c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:43.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.951+0000 7f6637fff700 1 -- 172.21.15.49:0/3054128446 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f662808d140 con 0x7f66400f9200 2024-02-22T00:40:43.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.951+0000 7f663ed9d700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f662c06caa0 0x7f662c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:43.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.952+0000 7f663ed9d700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f662c06caa0 0x7f662c06ef60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f66300041d0 tx=0x7f6630009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:43.956+0000 7f6637fff700 1 -- 172.21.15.49:0/3054128446 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f662805acc0 con 0x7f66400f9200 2024-02-22T00:40:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.161+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66400fedd0 con 0x7f662c06caa0 2024-02-22T00:40:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.171+0000 7f6637fff700 1 -- 172.21.15.49:0/3054128446 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f66400fedd0 con 0x7f662c06caa0 2024-02-22T00:40:44.173 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:40:44.173 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (3m) 4s ago 15m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (100s) 4s ago 15m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (94s) 90s ago 14m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (3m) 4s ago 14m 91.2M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (9m) 4s ago 9m 16.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (10m) 4s ago 10m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (9m) 90s ago 9m 15.8M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (10m) 90s ago 9m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (5m) 4s ago 16m 500M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (4m) 90s ago 14m 447M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (2m) 4s ago 16m 46.7M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (2m) 90s ago 14m 35.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (4m) 4s ago 14m 16.8M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (4m) 90s ago 14m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:40:44.174 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (76s) 4s ago 13m 91.5M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:40:44.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (43s) 4s ago 13m 96.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:40:44.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (9s) 4s ago 12m 13.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:40:44.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (12m) 90s ago 12m 259M 2251M 16.2.14-550-geb66ed92 7403d1862307 edceacbb5f8e 2024-02-22T00:40:44.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (11m) 90s ago 11m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:40:44.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (11m) 90s ago 11m 220M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:40:44.175 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (4m) 90s ago 14m 56.7M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:40:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f662c06caa0 msgr2=0x7f662c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f662c06caa0 0x7f662c06ef60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f66300041d0 tx=0x7f6630009040).stop 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 msgr2=0x7f664010e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 0x7f664010e580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f662800b120 tx=0x7f6628009cb0).stop 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 shutdown_connections 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f662c06caa0 0x7f662c06ef60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66400f88a0 0x7f664010e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 --2- 172.21.15.49:0/3054128446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66400f9200 0x7f664010e580 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 >> 172.21.15.49:0/3054128446 conn(0x7f6640070590 msgr2=0x7f66400fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 shutdown_connections 2024-02-22T00:40:44.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.173+0000 7f6645239700 1 -- 172.21.15.49:0/3054128446 wait complete. 2024-02-22T00:40:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.274+0000 7fe133cc5700 1 -- 172.21.15.49:0/3139005589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 msgr2=0x7fe12c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.274+0000 7fe133cc5700 1 --2- 172.21.15.49:0/3139005589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 0x7fe12c0f7a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe11c0047f0 tx=0x7fe11c009cb0).stop 2024-02-22T00:40:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.274+0000 7fe133cc5700 1 -- 172.21.15.49:0/3139005589 shutdown_connections 2024-02-22T00:40:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.274+0000 7fe133cc5700 1 --2- 172.21.15.49:0/3139005589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 0x7fe12c0f7a30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.274+0000 7fe133cc5700 1 --2- 172.21.15.49:0/3139005589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe12c0fd8f0 0x7fe12c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.274+0000 7fe133cc5700 1 -- 172.21.15.49:0/3139005589 >> 172.21.15.49:0/3139005589 conn(0x7fe12c0f34b0 msgr2=0x7fe12c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.274+0000 7fe133cc5700 1 -- 172.21.15.49:0/3139005589 shutdown_connections 2024-02-22T00:40:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.274+0000 7fe133cc5700 1 -- 172.21.15.49:0/3139005589 wait complete. 2024-02-22T00:40:44.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe133cc5700 1 Processor -- start 2024-02-22T00:40:44.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe133cc5700 1 -- start start 2024-02-22T00:40:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe133cc5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe12c0fd8f0 0x7fe12c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe133cc5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 0x7fe12c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe133cc5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c06bab0 con 0x7fe12c0fe250 2024-02-22T00:40:44.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe133cc5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c06bbf0 con 0x7fe12c0fd8f0 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe131260700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 0x7fe12c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe131260700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 0x7fe12c06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41360/0 (socket says 172.21.15.49:41360) 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.275+0000 7fe131260700 1 -- 172.21.15.49:0/293553512 learned_addr learned my addr 172.21.15.49:0/293553512 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe131a61700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe12c0fd8f0 0x7fe12c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe131260700 1 -- 172.21.15.49:0/293553512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe12c0fd8f0 msgr2=0x7fe12c06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe131260700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe12c0fd8f0 0x7fe12c06b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe131260700 1 -- 172.21.15.49:0/293553512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c005040 con 0x7fe12c0fe250 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe131a61700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe12c0fd8f0 0x7fe12c06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe131260700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 0x7fe12c06b5c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe11c0099f0 tx=0x7fe11c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe122ffd700 1 -- 172.21.15.49:0/293553512 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe11c00e030 con 0x7fe12c0fe250 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe122ffd700 1 -- 172.21.15.49:0/293553512 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe11c007e90 con 0x7fe12c0fe250 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c06be40 con 0x7fe12c0fe250 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe122ffd700 1 -- 172.21.15.49:0/293553512 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe11c018070 con 0x7fe12c0fe250 2024-02-22T00:40:44.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.276+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c114690 con 0x7fe12c0fe250 2024-02-22T00:40:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.277+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c05f590 con 0x7fe12c0fe250 2024-02-22T00:40:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.277+0000 7fe122ffd700 1 -- 172.21.15.49:0/293553512 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe11c01d420 con 0x7fe12c0fe250 2024-02-22T00:40:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.278+0000 7fe122ffd700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe11806caa0 0x7fe11806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.278+0000 7fe122ffd700 1 -- 172.21.15.49:0/293553512 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fe11c08d120 con 0x7fe12c0fe250 2024-02-22T00:40:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.278+0000 7fe131a61700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe11806caa0 0x7fe11806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:44.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.278+0000 7fe131a61700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe11806caa0 0x7fe11806ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe1280041d0 tx=0x7fe128009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:44.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.282+0000 7fe122ffd700 1 -- 172.21.15.49:0/293553512 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe11c057290 con 0x7fe12c0fe250 2024-02-22T00:40:44.428 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:43 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[161812]: 2024-02-22T00:40:43.934+0000 7f203465f640 -1 osd.2 58 log_to_monitors true 2024-02-22T00:40:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.561+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe12c0ffc80 con 0x7fe12c0fe250 2024-02-22T00:40:44.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.561+0000 7fe122ffd700 1 -- 172.21.15.49:0/293553512 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fe11c05a8b0 con 0x7fe12c0fe250 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 3, 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:40:44.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:40:44.565 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:40:44.565 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:40:44.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:40:44.565 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:40:44.565 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 7, 2024-02-22T00:40:44.565 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:40:44.565 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:40:44.565 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.563+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe11806caa0 msgr2=0x7fe11806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.563+0000 7fe133cc5700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe11806caa0 0x7fe11806ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe1280041d0 tx=0x7fe128009040).stop 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.563+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 msgr2=0x7fe12c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.563+0000 7fe133cc5700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 0x7fe12c06b5c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe11c0099f0 tx=0x7fe11c009cb0).stop 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.563+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 shutdown_connections 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.563+0000 7fe133cc5700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe11806caa0 0x7fe11806ef60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.564+0000 7fe133cc5700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe12c0fd8f0 0x7fe12c06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.564+0000 7fe133cc5700 1 --2- 172.21.15.49:0/293553512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe12c0fe250 0x7fe12c06b5c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.564+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 >> 172.21.15.49:0/293553512 conn(0x7fe12c0f34b0 msgr2=0x7fe12c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.564+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 shutdown_connections 2024-02-22T00:40:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.564+0000 7fe133cc5700 1 -- 172.21.15.49:0/293553512 wait complete. 2024-02-22T00:40:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.673+0000 7fd54a6c3700 1 -- 172.21.15.49:0/388398238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fc7f0 msgr2=0x7fd5440fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.673+0000 7fd54a6c3700 1 --2- 172.21.15.49:0/388398238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fc7f0 0x7fd5440fcbd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd5340047f0 tx=0x7fd534009cb0).stop 2024-02-22T00:40:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.673+0000 7fd54a6c3700 1 -- 172.21.15.49:0/388398238 shutdown_connections 2024-02-22T00:40:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.673+0000 7fd54a6c3700 1 --2- 172.21.15.49:0/388398238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5440fd150 0x7fd5440f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.673+0000 7fd54a6c3700 1 --2- 172.21.15.49:0/388398238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fc7f0 0x7fd5440fcbd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.673+0000 7fd54a6c3700 1 -- 172.21.15.49:0/388398238 >> 172.21.15.49:0/388398238 conn(0x7fd544070590 msgr2=0x7fd5440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.673+0000 7fd54a6c3700 1 -- 172.21.15.49:0/388398238 shutdown_connections 2024-02-22T00:40:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.673+0000 7fd54a6c3700 1 -- 172.21.15.49:0/388398238 wait complete. 2024-02-22T00:40:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.674+0000 7fd54a6c3700 1 Processor -- start 2024-02-22T00:40:44.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.674+0000 7fd54a6c3700 1 -- start start 2024-02-22T00:40:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd54a6c3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5440fc7f0 0x7fd54410cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:44.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd54a6c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fd150 0x7fd54410d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd54a6c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54410d9f0 con 0x7fd5440fd150 2024-02-22T00:40:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd54a6c3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd54410db30 con 0x7fd5440fc7f0 2024-02-22T00:40:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fd150 0x7fd54410d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fd150 0x7fd54410d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41368/0 (socket says 172.21.15.49:41368) 2024-02-22T00:40:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5437fe700 1 -- 172.21.15.49:0/398355407 learned_addr learned my addr 172.21.15.49:0/398355407 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd543fff700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5440fc7f0 0x7fd54410cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:44.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5437fe700 1 -- 172.21.15.49:0/398355407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5440fc7f0 msgr2=0x7fd54410cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5437fe700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5440fc7f0 0x7fd54410cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5437fe700 1 -- 172.21.15.49:0/398355407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534005040 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5437fe700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fd150 0x7fd54410d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd5380044e0 tx=0x7fd538002a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5417fa700 1 -- 172.21.15.49:0/398355407 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd538007b40 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd5417fa700 1 -- 172.21.15.49:0/398355407 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd53800f040 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.675+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5441071c0 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.676+0000 7fd5417fa700 1 -- 172.21.15.49:0/398355407 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd538014850 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.676+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544107700 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.677+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54405f590 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.677+0000 7fd5417fa700 1 -- 172.21.15.49:0/398355407 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd538009110 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.677+0000 7fd5417fa700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd52c06caa0 0x7fd52c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.678+0000 7fd5417fa700 1 -- 172.21.15.49:0/398355407 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fd53808b820 con 0x7fd5440fd150 2024-02-22T00:40:44.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.678+0000 7fd543fff700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd52c06caa0 0x7fd52c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:44.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.678+0000 7fd543fff700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd52c06caa0 0x7fd52c06ef60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd534004f10 tx=0x7fd53400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:44.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.682+0000 7fd5417fa700 1 -- 172.21.15.49:0/398355407 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd538059420 con 0x7fd5440fd150 2024-02-22T00:40:44.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.931+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd544047540 con 0x7fd5440fd150 2024-02-22T00:40:44.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.932+0000 7fd5417fa700 1 -- 172.21.15.49:0/398355407 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7fd538058fb0 con 0x7fd5440fd150 2024-02-22T00:40:44.934 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:40:44.934 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:40:44.934 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:40:44.934 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:40:44.935 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:40:44.936 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:40:44.937 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:40:44.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd52c06caa0 msgr2=0x7fd52c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd52c06caa0 0x7fd52c06ef60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fd534004f10 tx=0x7fd53400b040).stop 2024-02-22T00:40:44.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fd150 msgr2=0x7fd54410d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:44.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fd150 0x7fd54410d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd5380044e0 tx=0x7fd538002a50).stop 2024-02-22T00:40:44.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 shutdown_connections 2024-02-22T00:40:44.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd52c06caa0 0x7fd52c06ef60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5440fc7f0 0x7fd54410cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 --2- 172.21.15.49:0/398355407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5440fd150 0x7fd54410d3f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:44.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 >> 172.21.15.49:0/398355407 conn(0x7fd544070590 msgr2=0x7fd5440fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:44.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 shutdown_connections 2024-02-22T00:40:44.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:44.934+0000 7fd54a6c3700 1 -- 172.21.15.49:0/398355407 wait complete. 2024-02-22T00:40:44.939 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:40:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.037+0000 7f68ea605700 1 -- 172.21.15.49:0/2757129201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fd150 msgr2=0x7f68e40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.037+0000 7f68ea605700 1 --2- 172.21.15.49:0/2757129201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fd150 0x7f68e40f6930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f68d80047f0 tx=0x7f68d8009cb0).stop 2024-02-22T00:40:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.037+0000 7f68ea605700 1 -- 172.21.15.49:0/2757129201 shutdown_connections 2024-02-22T00:40:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.037+0000 7f68ea605700 1 --2- 172.21.15.49:0/2757129201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fd150 0x7f68e40f6930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.037+0000 7f68ea605700 1 --2- 172.21.15.49:0/2757129201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68e40fc7f0 0x7f68e40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.037+0000 7f68ea605700 1 -- 172.21.15.49:0/2757129201 >> 172.21.15.49:0/2757129201 conn(0x7f68e4070590 msgr2=0x7f68e40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.038+0000 7f68ea605700 1 -- 172.21.15.49:0/2757129201 shutdown_connections 2024-02-22T00:40:45.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.038+0000 7f68ea605700 1 -- 172.21.15.49:0/2757129201 wait complete. 2024-02-22T00:40:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.038+0000 7f68ea605700 1 Processor -- start 2024-02-22T00:40:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.038+0000 7f68ea605700 1 -- start start 2024-02-22T00:40:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68ea605700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fc7f0 0x7f68e41090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:45.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68ea605700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68e40fd150 0x7f68e41095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68ea605700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4109aa0 con 0x7f68e40fc7f0 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68ea605700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e4109be0 con 0x7f68e40fd150 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fc7f0 0x7f68e41090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fc7f0 0x7f68e41090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41390/0 (socket says 172.21.15.49:41390) 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e3fff700 1 -- 172.21.15.49:0/1977531147 learned_addr learned my addr 172.21.15.49:0/1977531147 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e37fe700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68e40fd150 0x7f68e41095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e3fff700 1 -- 172.21.15.49:0/1977531147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68e40fd150 msgr2=0x7f68e41095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e3fff700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68e40fd150 0x7f68e41095b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e3fff700 1 -- 172.21.15.49:0/1977531147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d8005040 con 0x7f68e40fc7f0 2024-02-22T00:40:45.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e37fe700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68e40fd150 0x7f68e41095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:40:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.039+0000 7f68e3fff700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fc7f0 0x7f68e41090c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f68d40041d0 tx=0x7f68d4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.040+0000 7f68e17fa700 1 -- 172.21.15.49:0/1977531147 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68d4007b40 con 0x7f68e40fc7f0 2024-02-22T00:40:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.040+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e4109e90 con 0x7f68e40fc7f0 2024-02-22T00:40:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.040+0000 7f68e17fa700 1 -- 172.21.15.49:0/1977531147 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68d400f040 con 0x7f68e40fc7f0 2024-02-22T00:40:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.040+0000 7f68e17fa700 1 -- 172.21.15.49:0/1977531147 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68d400d800 con 0x7f68e40fc7f0 2024-02-22T00:40:45.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.040+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e41124b0 con 0x7f68e40fc7f0 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-22T00:40:45.045 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-22T00:40:45.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='osd.2 [v2:172.21.15.49:6818/4257132266,v1:172.21.15.49:6819/4257132266]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T00:40:45.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:45.046 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:44 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/293553512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.041+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e405f590 con 0x7f68e40fc7f0 2024-02-22T00:40:45.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.041+0000 7f68e17fa700 1 -- 172.21.15.49:0/1977531147 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f68d4007ca0 con 0x7f68e40fc7f0 2024-02-22T00:40:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.041+0000 7f68e17fa700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68cc06caa0 0x7f68cc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.042+0000 7f68e17fa700 1 -- 172.21.15.49:0/1977531147 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f68d408b830 con 0x7f68e40fc7f0 2024-02-22T00:40:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.042+0000 7f68e37fe700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68cc06caa0 0x7f68cc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:45.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.042+0000 7f68e37fe700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68cc06caa0 0x7f68cc06ef60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f68d80043d0 tx=0x7f68d800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:45.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.046+0000 7f68e17fa700 1 -- 172.21.15.49:0/1977531147 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f68d40559a0 con 0x7f68e40fc7f0 2024-02-22T00:40:45.178 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[161812]: 2024-02-22T00:40:44.710+0000 7f2023ab4700 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:40:45.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-22T00:40:45.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-22T00:40:45.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-22T00:40:45.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='osd.2 [v2:172.21.15.49:6818/4257132266,v1:172.21.15.49:6819/4257132266]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T00:40:45.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:45.180 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:44 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/293553512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:40:45.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.263+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68e4059120 con 0x7f68cc06caa0 2024-02-22T00:40:45.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.264+0000 7f68e17fa700 1 -- 172.21.15.49:0/1977531147 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f68e4059120 con 0x7f68cc06caa0 2024-02-22T00:40:45.266 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:40:45.266 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:40:45.266 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:40:45.266 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:40:45.266 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:40:45.266 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:40:45.266 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:40:45.267 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-02-22T00:40:45.267 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:40:45.267 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "9/21 daemons upgraded", 2024-02-22T00:40:45.267 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-02-22T00:40:45.267 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:40:45.267 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:40:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68cc06caa0 msgr2=0x7f68cc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68cc06caa0 0x7f68cc06ef60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f68d80043d0 tx=0x7f68d800b040).stop 2024-02-22T00:40:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fc7f0 msgr2=0x7f68e41090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fc7f0 0x7f68e41090c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f68d40041d0 tx=0x7f68d4009f60).stop 2024-02-22T00:40:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 shutdown_connections 2024-02-22T00:40:45.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68cc06caa0 0x7f68cc06ef60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68e40fc7f0 0x7f68e41090c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 --2- 172.21.15.49:0/1977531147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68e40fd150 0x7f68e41095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 >> 172.21.15.49:0/1977531147 conn(0x7f68e4070590 msgr2=0x7f68e40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 shutdown_connections 2024-02-22T00:40:45.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.266+0000 7f68ea605700 1 -- 172.21.15.49:0/1977531147 wait complete. 2024-02-22T00:40:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.368+0000 7f54f4207700 1 -- 172.21.15.49:0/1186724342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fd910 msgr2=0x7f54ec0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.368+0000 7f54f4207700 1 --2- 172.21.15.49:0/1186724342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fd910 0x7f54ec0fdcf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f54dc0047f0 tx=0x7f54dc009cb0).stop 2024-02-22T00:40:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.368+0000 7f54f4207700 1 -- 172.21.15.49:0/1186724342 shutdown_connections 2024-02-22T00:40:45.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.368+0000 7f54f4207700 1 --2- 172.21.15.49:0/1186724342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54ec0fe270 0x7f54ec0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.368+0000 7f54f4207700 1 --2- 172.21.15.49:0/1186724342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fd910 0x7f54ec0fdcf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.368+0000 7f54f4207700 1 -- 172.21.15.49:0/1186724342 >> 172.21.15.49:0/1186724342 conn(0x7f54ec0f3530 msgr2=0x7f54ec0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.368+0000 7f54f4207700 1 -- 172.21.15.49:0/1186724342 shutdown_connections 2024-02-22T00:40:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.368+0000 7f54f4207700 1 -- 172.21.15.49:0/1186724342 wait complete. 2024-02-22T00:40:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f4207700 1 Processor -- start 2024-02-22T00:40:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f4207700 1 -- start start 2024-02-22T00:40:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f4207700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54ec0fd910 0x7f54ec10e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f4207700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fe270 0x7f54ec10e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f4207700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec10eba0 con 0x7f54ec0fe270 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f4207700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec10ece0 con 0x7f54ec0fd910 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f17a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fe270 0x7f54ec10e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f17a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fe270 0x7f54ec10e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41400/0 (socket says 172.21.15.49:41400) 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f17a2700 1 -- 172.21.15.49:0/4232109622 learned_addr learned my addr 172.21.15.49:0/4232109622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.369+0000 7f54f1fa3700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54ec0fd910 0x7f54ec10e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54f17a2700 1 -- 172.21.15.49:0/4232109622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54ec0fd910 msgr2=0x7f54ec10e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54f17a2700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54ec0fd910 0x7f54ec10e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54f17a2700 1 -- 172.21.15.49:0/4232109622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc005040 con 0x7f54ec0fe270 2024-02-22T00:40:45.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54f17a2700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fe270 0x7f54ec10e5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f54e800c790 tx=0x7f54e8007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54e2ffd700 1 -- 172.21.15.49:0/4232109622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54e80106f0 con 0x7f54ec0fe270 2024-02-22T00:40:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54e2ffd700 1 -- 172.21.15.49:0/4232109622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54e8010d00 con 0x7f54ec0fe270 2024-02-22T00:40:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec108370 con 0x7f54ec0fe270 2024-02-22T00:40:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54e2ffd700 1 -- 172.21.15.49:0/4232109622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54e8012d50 con 0x7f54ec0fe270 2024-02-22T00:40:45.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.370+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec1088b0 con 0x7f54ec0fe270 2024-02-22T00:40:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.371+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec05f570 con 0x7f54ec0fe270 2024-02-22T00:40:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.371+0000 7f54e2ffd700 1 -- 172.21.15.49:0/4232109622 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f54e8012570 con 0x7f54ec0fe270 2024-02-22T00:40:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.372+0000 7f54e2ffd700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54d806cab0 0x7f54d806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:40:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.372+0000 7f54e2ffd700 1 -- 172.21.15.49:0/4232109622 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f54e808b610 con 0x7f54ec0fe270 2024-02-22T00:40:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.372+0000 7f54f1fa3700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54d806cab0 0x7f54d806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:40:45.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.372+0000 7f54f1fa3700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54d806cab0 0x7f54d806ef70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f54dc004f10 tx=0x7f54dc009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:40:45.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.376+0000 7f54e2ffd700 1 -- 172.21.15.49:0/4232109622 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f54e8059210 con 0x7f54ec0fe270 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.661+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f54ec047540 con 0x7f54ec0fe270 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.662+0000 7f54e2ffd700 1 -- 172.21.15.49:0/4232109622 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+941 (secure 0 0 0) 0x7f54e8058da0 con 0x7f54ec0fe270 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: osd.2 (root=default,host=smithi049) is down 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-02-22T00:40:45.664 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-02-22T00:40:45.665 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54d806cab0 msgr2=0x7f54d806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54d806cab0 0x7f54d806ef70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f54dc004f10 tx=0x7f54dc009cb0).stop 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fe270 msgr2=0x7f54ec10e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fe270 0x7f54ec10e5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f54e800c790 tx=0x7f54e8007f50).stop 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 shutdown_connections 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54d806cab0 0x7f54d806ef70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54ec0fd910 0x7f54ec10e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 --2- 172.21.15.49:0/4232109622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ec0fe270 0x7f54ec10e5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 >> 172.21.15.49:0/4232109622 conn(0x7f54ec0f3530 msgr2=0x7f54ec0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 shutdown_connections 2024-02-22T00:40:45.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:40:45.664+0000 7f54f4207700 1 -- 172.21.15.49:0/4232109622 wait complete. 2024-02-22T00:40:46.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:45 smithi161 ceph-mon[113442]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:46.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:45 smithi161 ceph-mon[113442]: from='osd.2 [v2:172.21.15.49:6818/4257132266,v1:172.21.15.49:6819/4257132266]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T00:40:46.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:45 smithi161 ceph-mon[113442]: osdmap e61: 6 total, 5 up, 6 in 2024-02-22T00:40:46.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:45 smithi161 ceph-mon[113442]: from='osd.2 [v2:172.21.15.49:6818/4257132266,v1:172.21.15.49:6819/4257132266]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:40:46.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:45 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/398355407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:40:46.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:45 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:46.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:45 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4232109622' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:40:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:45 smithi049 ceph-mon[132694]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-02-22T00:40:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:45 smithi049 ceph-mon[132694]: from='osd.2 [v2:172.21.15.49:6818/4257132266,v1:172.21.15.49:6819/4257132266]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T00:40:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:45 smithi049 ceph-mon[132694]: osdmap e61: 6 total, 5 up, 6 in 2024-02-22T00:40:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:45 smithi049 ceph-mon[132694]: from='osd.2 [v2:172.21.15.49:6818/4257132266,v1:172.21.15.49:6819/4257132266]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]: dispatch 2024-02-22T00:40:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:45 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/398355407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:40:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:45 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:46.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:45 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4232109622' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:40:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: failed to encode map e61 with expected crc 2024-02-22T00:40:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:40:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: osd.2 [v2:172.21.15.49:6818/4257132266,v1:172.21.15.49:6819/4257132266] boot 2024-02-22T00:40:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: osdmap e62: 6 total, 6 up, 6 in 2024-02-22T00:40:47.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: failed to encode map e61 with expected crc 2024-02-22T00:40:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:40:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: failed to encode map e61 with expected crc 2024-02-22T00:40:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: failed to encode map e62 with expected crc 2024-02-22T00:40:47.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:46 smithi161 ceph-mon[113442]: osdmap e63: 6 total, 6 up, 6 in 2024-02-22T00:40:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:40:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: failed to encode map e61 with expected crc 2024-02-22T00:40:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:40:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: osd.2 [v2:172.21.15.49:6818/4257132266,v1:172.21.15.49:6819/4257132266] boot 2024-02-22T00:40:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: osdmap e62: 6 total, 6 up, 6 in 2024-02-22T00:40:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: failed to encode map e61 with expected crc 2024-02-22T00:40:47.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T00:40:47.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: failed to encode map e61 with expected crc 2024-02-22T00:40:47.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: failed to encode map e62 with expected crc 2024-02-22T00:40:47.179 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:46 smithi049 ceph-mon[132694]: osdmap e63: 6 total, 6 up, 6 in 2024-02-22T00:40:48.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:47 smithi161 ceph-mon[113442]: pgmap v94: 65 pgs: 5 peering, 10 active+undersized+degraded, 12 active+undersized, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 30/321 objects degraded (9.346%) 2024-02-22T00:40:48.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:47 smithi161 ceph-mon[113442]: failed to encode map e63 with expected crc 2024-02-22T00:40:48.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:47 smithi161 ceph-mon[113442]: failed to encode map e63 with expected crc 2024-02-22T00:40:48.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:47 smithi161 ceph-mon[113442]: failed to encode map e63 with expected crc 2024-02-22T00:40:48.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:47 smithi161 ceph-mon[113442]: failed to encode map e63 with expected crc 2024-02-22T00:40:48.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:47 smithi049 ceph-mon[132694]: pgmap v94: 65 pgs: 5 peering, 10 active+undersized+degraded, 12 active+undersized, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 30/321 objects degraded (9.346%) 2024-02-22T00:40:48.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:47 smithi049 ceph-mon[132694]: failed to encode map e63 with expected crc 2024-02-22T00:40:48.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:47 smithi049 ceph-mon[132694]: failed to encode map e63 with expected crc 2024-02-22T00:40:48.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:47 smithi049 ceph-mon[132694]: failed to encode map e63 with expected crc 2024-02-22T00:40:48.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:47 smithi049 ceph-mon[132694]: failed to encode map e63 with expected crc 2024-02-22T00:40:50.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:49 smithi161 ceph-mon[113442]: pgmap v96: 65 pgs: 5 peering, 5 active+undersized+degraded, 7 active+undersized, 48 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 16/321 objects degraded (4.984%) 2024-02-22T00:40:50.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:49 smithi049 ceph-mon[132694]: pgmap v96: 65 pgs: 5 peering, 5 active+undersized+degraded, 7 active+undersized, 48 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 16/321 objects degraded (4.984%) 2024-02-22T00:40:51.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:50 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 16/321 objects degraded (4.984%), 5 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:51.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:50 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 16/321 objects degraded (4.984%), 5 pgs degraded (PG_DEGRADED) 2024-02-22T00:40:52.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:51 smithi161 ceph-mon[113442]: pgmap v97: 65 pgs: 5 peering, 60 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:40:52.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:51 smithi161 ceph-mon[113442]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/321 objects degraded (4.984%), 5 pgs degraded) 2024-02-22T00:40:52.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:51 smithi161 ceph-mon[113442]: Cluster is now healthy 2024-02-22T00:40:52.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:51 smithi049 ceph-mon[132694]: pgmap v97: 65 pgs: 5 peering, 60 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:40:52.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:51 smithi049 ceph-mon[132694]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/321 objects degraded (4.984%), 5 pgs degraded) 2024-02-22T00:40:52.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:51 smithi049 ceph-mon[132694]: Cluster is now healthy 2024-02-22T00:40:54.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:53 smithi161 ceph-mon[113442]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:40:54.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:53 smithi049 ceph-mon[132694]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:40:56.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:55 smithi161 ceph-mon[113442]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:40:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:55 smithi049 ceph-mon[132694]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:40:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:57 smithi161 ceph-mon[113442]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:40:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:40:58.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:57 smithi049 ceph-mon[132694]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:40:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:40:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:40:59.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-22T00:40:59.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-22T00:41:00.278 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:59 smithi161 ceph-mon[113442]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:00.278 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:59 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-22T00:41:00.278 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:40:59 smithi161 ceph-mon[113442]: Upgrade: osd.3 is safe to restart 2024-02-22T00:41:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:59 smithi049 ceph-mon[132694]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:59 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-22T00:41:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:40:59 smithi049 ceph-mon[132694]: Upgrade: osd.3 is safe to restart 2024-02-22T00:41:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:01 smithi049 ceph-mon[132694]: Upgrade: Updating osd.3 2024-02-22T00:41:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:01 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:01 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T00:41:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:01 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:41:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:01 smithi049 ceph-mon[132694]: Deploying daemon osd.3 on smithi161 2024-02-22T00:41:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:01 smithi049 ceph-mon[132694]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:01.760 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:01 smithi161 ceph-mon[113442]: Upgrade: Updating osd.3 2024-02-22T00:41:01.760 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:01 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:01.760 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:01 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T00:41:01.760 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:01 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:41:01.760 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:01 smithi161 ceph-mon[113442]: Deploying daemon osd.3 on smithi161 2024-02-22T00:41:01.760 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:01 smithi161 ceph-mon[113442]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:03.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:03 smithi161 ceph-mon[113442]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:03.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:03 smithi049 ceph-mon[132694]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:03.880 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:03 smithi161 systemd[1]: Stopping Ceph osd.3 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:41:04.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[76499]: debug 2024-02-22T00:41:03.877+0000 7fb38a2d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T00:41:04.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[76499]: debug 2024-02-22T00:41:03.877+0000 7fb38a2d8700 -1 osd.3 63 *** Got signal Terminated *** 2024-02-22T00:41:04.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[76499]: debug 2024-02-22T00:41:03.877+0000 7fb38a2d8700 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T00:41:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:04 smithi049 ceph-mon[132694]: osd.3 marked itself down and dead 2024-02-22T00:41:04.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:04 smithi161 ceph-mon[113442]: osd.3 marked itself down and dead 2024-02-22T00:41:05.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:04 smithi161 bash[125665]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3 2024-02-22T00:41:05.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:05 smithi161 ceph-mon[113442]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:05.663 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:05 smithi161 ceph-mon[113442]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:41:05.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:05 smithi161 ceph-mon[113442]: failed to encode map e64 with expected crc 2024-02-22T00:41:05.664 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:05 smithi161 ceph-mon[113442]: osdmap e64: 6 total, 5 up, 6 in 2024-02-22T00:41:05.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:05 smithi049 ceph-mon[132694]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:05.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:05 smithi049 ceph-mon[132694]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:41:05.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:05 smithi049 ceph-mon[132694]: failed to encode map e64 with expected crc 2024-02-22T00:41:05.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:05 smithi049 ceph-mon[132694]: osdmap e64: 6 total, 5 up, 6 in 2024-02-22T00:41:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:06 smithi049 ceph-mon[132694]: osdmap e65: 6 total, 5 up, 6 in 2024-02-22T00:41:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:06 smithi049 ceph-mon[132694]: failed to encode map e65 with expected crc 2024-02-22T00:41:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:06 smithi049 ceph-mon[132694]: failed to encode map e65 with expected crc 2024-02-22T00:41:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:06 smithi049 ceph-mon[132694]: failed to encode map e65 with expected crc 2024-02-22T00:41:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:06 smithi049 ceph-mon[132694]: failed to encode map e65 with expected crc 2024-02-22T00:41:06.751 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:06 smithi161 ceph-mon[113442]: osdmap e65: 6 total, 5 up, 6 in 2024-02-22T00:41:06.751 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:06 smithi161 ceph-mon[113442]: failed to encode map e65 with expected crc 2024-02-22T00:41:06.751 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:06 smithi161 ceph-mon[113442]: failed to encode map e65 with expected crc 2024-02-22T00:41:06.751 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:06 smithi161 ceph-mon[113442]: failed to encode map e65 with expected crc 2024-02-22T00:41:06.751 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:06 smithi161 ceph-mon[113442]: failed to encode map e65 with expected crc 2024-02-22T00:41:07.044 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:06 smithi161 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.3.service: Succeeded. 2024-02-22T00:41:07.044 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:06 smithi161 systemd[1]: Stopped Ceph osd.3 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:41:07.044 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:06 smithi161 systemd[1]: Starting Ceph osd.3 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:41:07.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:07 smithi161 ceph-mon[113442]: pgmap v107: 65 pgs: 3 active+undersized+degraded, 4 peering, 12 stale+active+clean, 4 active+undersized, 42 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7/321 objects degraded (2.181%) 2024-02-22T00:41:07.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:07 smithi161 ceph-mon[113442]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-22T00:41:07.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:07 smithi161 ceph-mon[113442]: Health check failed: Degraded data redundancy: 7/321 objects degraded (2.181%), 3 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:07.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:07 smithi049 ceph-mon[132694]: pgmap v107: 65 pgs: 3 active+undersized+degraded, 4 peering, 12 stale+active+clean, 4 active+undersized, 42 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7/321 objects degraded (2.181%) 2024-02-22T00:41:07.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:07 smithi049 ceph-mon[132694]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-22T00:41:07.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:07 smithi049 ceph-mon[132694]: Health check failed: Degraded data redundancy: 7/321 objects degraded (2.181%), 3 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:08.088 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:07 smithi161 bash[125939]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-22T00:41:08.088 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:07 smithi161 bash[125939]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-22T00:41:08.088 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:07 smithi161 bash[125939]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-22T00:41:08.088 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:07 smithi161 bash[125939]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-22T00:41:08.088 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:07 smithi161 bash[125939]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-22T00:41:08.088 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:07 smithi161 bash[125939]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-22T00:41:08.088 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:07 smithi161 bash[125939]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-22T00:41:09.033 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:08 smithi161 ceph-osd[126235]: -- 172.21.15.161:0/2076022776 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561bfc6744e0 con 0x561bfc645000 2024-02-22T00:41:09.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:09 smithi161 bash[126196]: cdd5902896f31cd20936ade9807fc139e979781cc248bf6ab8391f9d30572049 2024-02-22T00:41:09.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:09 smithi161 systemd[1]: Started Ceph osd.3 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:41:09.793 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[126212]: 2024-02-22T00:41:09.471+0000 7f94cc1bc640 -1 Falling back to public interface 2024-02-22T00:41:10.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:10 smithi161 ceph-mon[113442]: pgmap v108: 65 pgs: 12 active+undersized+degraded, 4 peering, 2 stale+active+clean, 13 active+undersized, 34 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 45/321 objects degraded (14.019%) 2024-02-22T00:41:10.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:10.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:10.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:10 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:41:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:10 smithi049 ceph-mon[132694]: pgmap v108: 65 pgs: 12 active+undersized+degraded, 4 peering, 2 stale+active+clean, 13 active+undersized, 34 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 45/321 objects degraded (14.019%) 2024-02-22T00:41:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:10 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:41:11.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:11 smithi049 ceph-mon[132694]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-22T00:41:11.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:11 smithi161 ceph-mon[113442]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-22T00:41:12.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:12 smithi049 ceph-mon[132694]: pgmap v109: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:12 smithi161 ceph-mon[113442]: pgmap v109: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:13 smithi049 ceph-mon[132694]: pgmap v110: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:41:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:13 smithi161 ceph-mon[113442]: pgmap v110: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:41:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:15.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:15 smithi161 ceph-mon[113442]: pgmap v111: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:15.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:15 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:15.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:15 smithi049 ceph-mon[132694]: pgmap v111: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:15.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:15 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.779+0000 7f38ec573700 1 -- 172.21.15.49:0/2851008691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f8900 msgr2=0x7f38e40f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.779+0000 7f38ec573700 1 --2- 172.21.15.49:0/2851008691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f8900 0x7f38e40f8ce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f38e00047f0 tx=0x7f38e0009cb0).stop 2024-02-22T00:41:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.779+0000 7f38ec573700 1 -- 172.21.15.49:0/2851008691 shutdown_connections 2024-02-22T00:41:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.779+0000 7f38ec573700 1 --2- 172.21.15.49:0/2851008691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38e40f9260 0x7f38e4101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.779+0000 7f38ec573700 1 --2- 172.21.15.49:0/2851008691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f8900 0x7f38e40f8ce0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.779+0000 7f38ec573700 1 -- 172.21.15.49:0/2851008691 >> 172.21.15.49:0/2851008691 conn(0x7f38e4070590 msgr2=0x7f38e40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.779+0000 7f38ec573700 1 -- 172.21.15.49:0/2851008691 shutdown_connections 2024-02-22T00:41:15.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.779+0000 7f38ec573700 1 -- 172.21.15.49:0/2851008691 wait complete. 2024-02-22T00:41:15.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.780+0000 7f38ec573700 1 Processor -- start 2024-02-22T00:41:15.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.780+0000 7f38ec573700 1 -- start start 2024-02-22T00:41:15.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38ec573700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38e40f8900 0x7f38e410e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38ec573700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f9260 0x7f38e410e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38ec573700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e410ebf0 con 0x7f38e40f9260 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38ec573700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e410ed30 con 0x7f38e40f8900 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38e9b0e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f9260 0x7f38e410e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38e9b0e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f9260 0x7f38e410e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43756/0 (socket says 172.21.15.49:43756) 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38e9b0e700 1 -- 172.21.15.49:0/4268857560 learned_addr learned my addr 172.21.15.49:0/4268857560 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38ea30f700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38e40f8900 0x7f38e410e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38e9b0e700 1 -- 172.21.15.49:0/4268857560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38e40f8900 msgr2=0x7f38e410e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38e9b0e700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38e40f8900 0x7f38e410e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38e9b0e700 1 -- 172.21.15.49:0/4268857560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4005040 con 0x7f38e40f9260 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38e9b0e700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f9260 0x7f38e410e5f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f38d4004870 tx=0x7f38d4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38db7fe700 1 -- 172.21.15.49:0/4268857560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38d4010500 con 0x7f38e40f9260 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38db7fe700 1 -- 172.21.15.49:0/4268857560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f38d400f040 con 0x7f38e40f9260 2024-02-22T00:41:15.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e0005040 con 0x7f38e40f9260 2024-02-22T00:41:15.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.781+0000 7f38db7fe700 1 -- 172.21.15.49:0/4268857560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38d4014a10 con 0x7f38e40f9260 2024-02-22T00:41:15.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.782+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e4108770 con 0x7f38e40f9260 2024-02-22T00:41:15.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.782+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e405f590 con 0x7f38e40f9260 2024-02-22T00:41:15.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.783+0000 7f38db7fe700 1 -- 172.21.15.49:0/4268857560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f38d4014cd0 con 0x7f38e40f9260 2024-02-22T00:41:15.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.783+0000 7f38db7fe700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f38d006caa0 0x7f38d006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:15.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.784+0000 7f38db7fe700 1 -- 172.21.15.49:0/4268857560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f38d408b710 con 0x7f38e40f9260 2024-02-22T00:41:15.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.784+0000 7f38ea30f700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f38d006caa0 0x7f38d006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:15.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.784+0000 7f38ea30f700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f38d006caa0 0x7f38d006ef60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f38e00047c0 tx=0x7f38e0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:15.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:15.788+0000 7f38db7fe700 1 -- 172.21.15.49:0/4268857560 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f38d4059310 con 0x7f38e40f9260 2024-02-22T00:41:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.004+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38e4109820 con 0x7f38d006caa0 2024-02-22T00:41:16.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.005+0000 7f38db7fe700 1 -- 172.21.15.49:0/4268857560 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f38e4109820 con 0x7f38d006caa0 2024-02-22T00:41:16.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f38d006caa0 msgr2=0x7f38d006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f38d006caa0 0x7f38d006ef60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f38e00047c0 tx=0x7f38e0009cb0).stop 2024-02-22T00:41:16.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f9260 msgr2=0x7f38e410e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f9260 0x7f38e410e5f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f38d4004870 tx=0x7f38d4009cb0).stop 2024-02-22T00:41:16.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 shutdown_connections 2024-02-22T00:41:16.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f38d006caa0 0x7f38d006ef60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38e40f8900 0x7f38e410e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 --2- 172.21.15.49:0/4268857560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38e40f9260 0x7f38e410e5f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 >> 172.21.15.49:0/4268857560 conn(0x7f38e4070590 msgr2=0x7f38e4101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 shutdown_connections 2024-02-22T00:41:16.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.008+0000 7f38ec573700 1 -- 172.21.15.49:0/4268857560 wait complete. 2024-02-22T00:41:16.020 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:41:16.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.114+0000 7f3a2148b700 1 -- 172.21.15.49:0/1359031698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 msgr2=0x7f3a1c0f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.114+0000 7f3a2148b700 1 --2- 172.21.15.49:0/1359031698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 0x7f3a1c0f7ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3a100047f0 tx=0x7f3a10009cb0).stop 2024-02-22T00:41:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.114+0000 7f3a2148b700 1 -- 172.21.15.49:0/1359031698 shutdown_connections 2024-02-22T00:41:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.114+0000 7f3a2148b700 1 --2- 172.21.15.49:0/1359031698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 0x7f3a1c0f7ab0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.114+0000 7f3a2148b700 1 --2- 172.21.15.49:0/1359031698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a1c0fd970 0x7f3a1c0fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.114+0000 7f3a2148b700 1 -- 172.21.15.49:0/1359031698 >> 172.21.15.49:0/1359031698 conn(0x7f3a1c0f3550 msgr2=0x7f3a1c0f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.114+0000 7f3a2148b700 1 -- 172.21.15.49:0/1359031698 shutdown_connections 2024-02-22T00:41:16.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.114+0000 7f3a2148b700 1 -- 172.21.15.49:0/1359031698 wait complete. 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a2148b700 1 Processor -- start 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a2148b700 1 -- start start 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a2148b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a1c0fd970 0x7f3a1c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a2148b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 0x7f3a1c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a2148b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c10eb50 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a2148b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c10ec90 con 0x7f3a1c0fd970 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a1a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 0x7f3a1c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a1a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 0x7f3a1c10e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43770/0 (socket says 172.21.15.49:43770) 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a1a7fc700 1 -- 172.21.15.49:0/1040455557 learned_addr learned my addr 172.21.15.49:0/1040455557 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.115+0000 7f3a1affd700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a1c0fd970 0x7f3a1c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a1a7fc700 1 -- 172.21.15.49:0/1040455557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a1c0fd970 msgr2=0x7f3a1c10e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a1a7fc700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a1c0fd970 0x7f3a1c10e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a1a7fc700 1 -- 172.21.15.49:0/1040455557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10005040 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a1a7fc700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 0x7f3a1c10e550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3a10000c00 tx=0x7f3a10009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a03fff700 1 -- 172.21.15.49:0/1040455557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a1000e030 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c1082c0 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a03fff700 1 -- 172.21.15.49:0/1040455557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3a10007e90 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a03fff700 1 -- 172.21.15.49:0/1040455557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a10018070 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.116+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c1087a0 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.117+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c060370 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.118+0000 7f3a03fff700 1 -- 172.21.15.49:0/1040455557 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3a1001d420 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.118+0000 7f3a03fff700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a0406cab0 0x7f3a0406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.118+0000 7f3a03fff700 1 -- 172.21.15.49:0/1040455557 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f3a1008ce90 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.118+0000 7f3a1affd700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a0406cab0 0x7f3a0406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.119+0000 7f3a1affd700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a0406cab0 0x7f3a0406ef70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3a0c004dc0 tx=0x7f3a0c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:16.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.123+0000 7f3a03fff700 1 -- 172.21.15.49:0/1040455557 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3a1005aa90 con 0x7f3a1c0fe2d0 2024-02-22T00:41:16.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.338+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a1c0ffcc0 con 0x7f3a0406cab0 2024-02-22T00:41:16.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.339+0000 7f3a03fff700 1 -- 172.21.15.49:0/1040455557 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3a1c0ffcc0 con 0x7f3a0406cab0 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a0406cab0 msgr2=0x7f3a0406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a0406cab0 0x7f3a0406ef70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3a0c004dc0 tx=0x7f3a0c00b040).stop 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 msgr2=0x7f3a1c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 0x7f3a1c10e550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f3a10000c00 tx=0x7f3a10009cb0).stop 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 shutdown_connections 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a0406cab0 0x7f3a0406ef70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a1c0fd970 0x7f3a1c10e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 --2- 172.21.15.49:0/1040455557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a1c0fe2d0 0x7f3a1c10e550 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 >> 172.21.15.49:0/1040455557 conn(0x7f3a1c0f3550 msgr2=0x7f3a1c0fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:16.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 shutdown_connections 2024-02-22T00:41:16.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.341+0000 7f3a2148b700 1 -- 172.21.15.49:0/1040455557 wait complete. 2024-02-22T00:41:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.443+0000 7f7a164c7700 1 -- 172.21.15.49:0/3044123464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fe250 msgr2=0x7f7a100f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.443+0000 7f7a164c7700 1 --2- 172.21.15.49:0/3044123464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fe250 0x7f7a100f7a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7a040047f0 tx=0x7f7a04009cb0).stop 2024-02-22T00:41:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.443+0000 7f7a164c7700 1 -- 172.21.15.49:0/3044123464 shutdown_connections 2024-02-22T00:41:16.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.443+0000 7f7a164c7700 1 --2- 172.21.15.49:0/3044123464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fe250 0x7f7a100f7a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.443+0000 7f7a164c7700 1 --2- 172.21.15.49:0/3044123464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a100fd8f0 0x7f7a100fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.443+0000 7f7a164c7700 1 -- 172.21.15.49:0/3044123464 >> 172.21.15.49:0/3044123464 conn(0x7f7a100f34b0 msgr2=0x7f7a100f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:16.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.443+0000 7f7a164c7700 1 -- 172.21.15.49:0/3044123464 shutdown_connections 2024-02-22T00:41:16.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.443+0000 7f7a164c7700 1 -- 172.21.15.49:0/3044123464 wait complete. 2024-02-22T00:41:16.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a164c7700 1 Processor -- start 2024-02-22T00:41:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a164c7700 1 -- start start 2024-02-22T00:41:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a164c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fd8f0 0x7f7a1010e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a164c7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a100fe250 0x7f7a1010e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a164c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1010ec20 con 0x7f7a100fd8f0 2024-02-22T00:41:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a164c7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1010ed60 con 0x7f7a100fe250 2024-02-22T00:41:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a0ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fd8f0 0x7f7a1010e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a0ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fd8f0 0x7f7a1010e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43786/0 (socket says 172.21.15.49:43786) 2024-02-22T00:41:16.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a0ffff700 1 -- 172.21.15.49:0/3854216345 learned_addr learned my addr 172.21.15.49:0/3854216345 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a0f7fe700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a100fe250 0x7f7a1010e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a0ffff700 1 -- 172.21.15.49:0/3854216345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a100fe250 msgr2=0x7f7a1010e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a0ffff700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a100fe250 0x7f7a1010e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.444+0000 7f7a0ffff700 1 -- 172.21.15.49:0/3854216345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04005040 con 0x7f7a100fd8f0 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.445+0000 7f7a0ffff700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fd8f0 0x7f7a1010e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f7a0000e8f0 tx=0x7f7a0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.445+0000 7f7a0d7fa700 1 -- 172.21.15.49:0/3854216345 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a00007b40 con 0x7f7a100fd8f0 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.445+0000 7f7a0d7fa700 1 -- 172.21.15.49:0/3854216345 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a0000f040 con 0x7f7a100fd8f0 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.445+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a101083f0 con 0x7f7a100fd8f0 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.445+0000 7f7a0d7fa700 1 -- 172.21.15.49:0/3854216345 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a00014880 con 0x7f7a100fd8f0 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.445+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a101089b0 con 0x7f7a100fd8f0 2024-02-22T00:41:16.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.446+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1005f590 con 0x7f7a100fd8f0 2024-02-22T00:41:16.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.447+0000 7f7a0d7fa700 1 -- 172.21.15.49:0/3854216345 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7a000090d0 con 0x7f7a100fd8f0 2024-02-22T00:41:16.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.447+0000 7f7a0d7fa700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f79f806caa0 0x7f79f806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.448+0000 7f7a0d7fa700 1 -- 172.21.15.49:0/3854216345 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f7a0008b4f0 con 0x7f7a100fd8f0 2024-02-22T00:41:16.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.448+0000 7f7a0f7fe700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f79f806caa0 0x7f79f806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.448+0000 7f7a0f7fe700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f79f806caa0 0x7f79f806ef60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7a10109a70 tx=0x7f7a04009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:16.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.451+0000 7f7a0d7fa700 1 -- 172.21.15.49:0/3854216345 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7a00059160 con 0x7f7a100fd8f0 2024-02-22T00:41:16.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.657+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a10108ce0 con 0x7f79f806caa0 2024-02-22T00:41:16.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.667+0000 7f7a0d7fa700 1 -- 172.21.15.49:0/3854216345 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7a10108ce0 con 0x7f79f806caa0 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (4m) 37s ago 15m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (2m) 37s ago 15m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (2m) 3s ago 15m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (4m) 37s ago 15m 91.2M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (10m) 37s ago 10m 16.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (10m) 37s ago 10m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (10m) 3s ago 10m 16.3M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (10m) 3s ago 10m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (6m) 37s ago 17m 500M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (5m) 3s ago 15m 448M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (3m) 37s ago 17m 46.7M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:41:16.670 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (2m) 3s ago 14m 39.7M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (5m) 37s ago 15m 16.8M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (5m) 3s ago 14m 18.0M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (109s) 37s ago 14m 91.5M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (75s) 37s ago 13m 96.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (41s) 37s ago 13m 13.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (8s) 3s ago 12m 11.1M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (12m) 3s ago 12m 230M 2251M 16.2.14-550-geb66ed92 7403d1862307 927f84cf2b07 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (12m) 3s ago 12m 216M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:41:16.671 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (4m) 3s ago 14m 61.1M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f79f806caa0 msgr2=0x7f79f806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f79f806caa0 0x7f79f806ef60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7a10109a70 tx=0x7f7a04009cb0).stop 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fd8f0 msgr2=0x7f7a1010e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fd8f0 0x7f7a1010e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f7a0000e8f0 tx=0x7f7a0000b040).stop 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 shutdown_connections 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f79f806caa0 0x7f79f806ef60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7a100fd8f0 0x7f7a1010e130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 --2- 172.21.15.49:0/3854216345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a100fe250 0x7f7a1010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.669+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 >> 172.21.15.49:0/3854216345 conn(0x7f7a100f34b0 msgr2=0x7f7a100fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.670+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 shutdown_connections 2024-02-22T00:41:16.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.670+0000 7f7a164c7700 1 -- 172.21.15.49:0/3854216345 wait complete. 2024-02-22T00:41:16.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:16 smithi049 ceph-mon[132694]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:16.693 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:16 smithi161 ceph-mon[113442]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:16.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.770+0000 7eff3ef2f700 1 -- 172.21.15.49:0/3915181249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fe270 msgr2=0x7eff380f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.770+0000 7eff3ef2f700 1 --2- 172.21.15.49:0/3915181249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fe270 0x7eff380f7a50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7eff240047f0 tx=0x7eff24009cb0).stop 2024-02-22T00:41:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.770+0000 7eff3ef2f700 1 -- 172.21.15.49:0/3915181249 shutdown_connections 2024-02-22T00:41:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.770+0000 7eff3ef2f700 1 --2- 172.21.15.49:0/3915181249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fe270 0x7eff380f7a50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.770+0000 7eff3ef2f700 1 --2- 172.21.15.49:0/3915181249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff380fd910 0x7eff380fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.770+0000 7eff3ef2f700 1 -- 172.21.15.49:0/3915181249 >> 172.21.15.49:0/3915181249 conn(0x7eff380f3530 msgr2=0x7eff380f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.770+0000 7eff3ef2f700 1 -- 172.21.15.49:0/3915181249 shutdown_connections 2024-02-22T00:41:16.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.770+0000 7eff3ef2f700 1 -- 172.21.15.49:0/3915181249 wait complete. 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.771+0000 7eff3ef2f700 1 Processor -- start 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.771+0000 7eff3ef2f700 1 -- start start 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3ef2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fd910 0x7eff3810e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3ef2f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff380fe270 0x7eff3810e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3ef2f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3810ec20 con 0x7eff380fd910 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3ef2f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3810ed60 con 0x7eff380fe270 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3cccb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fd910 0x7eff3810e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3cccb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fd910 0x7eff3810e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43800/0 (socket says 172.21.15.49:43800) 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3cccb700 1 -- 172.21.15.49:0/1650379376 learned_addr learned my addr 172.21.15.49:0/1650379376 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:16.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff37fff700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff380fe270 0x7eff3810e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3cccb700 1 -- 172.21.15.49:0/1650379376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff380fe270 msgr2=0x7eff3810e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3cccb700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff380fe270 0x7eff3810e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3cccb700 1 -- 172.21.15.49:0/1650379376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24005040 con 0x7eff380fd910 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3cccb700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fd910 0x7eff3810e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7eff2c00e8f0 tx=0x7eff2c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff35ffb700 1 -- 172.21.15.49:0/1650379376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff2c007b40 con 0x7eff380fd910 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff381083f0 con 0x7eff380fd910 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff35ffb700 1 -- 172.21.15.49:0/1650379376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff2c00f040 con 0x7eff380fd910 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.772+0000 7eff35ffb700 1 -- 172.21.15.49:0/1650379376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff2c014880 con 0x7eff380fd910 2024-02-22T00:41:16.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.773+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff381089b0 con 0x7eff380fd910 2024-02-22T00:41:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.773+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3805f570 con 0x7eff380fd910 2024-02-22T00:41:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.774+0000 7eff35ffb700 1 -- 172.21.15.49:0/1650379376 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7eff2c014b00 con 0x7eff380fd910 2024-02-22T00:41:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.774+0000 7eff35ffb700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff2806cab0 0x7eff2806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.774+0000 7eff35ffb700 1 -- 172.21.15.49:0/1650379376 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6051+0+0 (secure 0 0 0) 0x7eff2c08b900 con 0x7eff380fd910 2024-02-22T00:41:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.774+0000 7eff37fff700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff2806cab0 0x7eff2806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:16.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.775+0000 7eff37fff700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff2806cab0 0x7eff2806ef70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7eff38109a70 tx=0x7eff24009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:16.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:16.779+0000 7eff35ffb700 1 -- 172.21.15.49:0/1650379376 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7eff2c059500 con 0x7eff380fd910 2024-02-22T00:41:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.067+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7eff381098b0 con 0x7eff380fd910 2024-02-22T00:41:17.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.068+0000 7eff35ffb700 1 -- 172.21.15.49:0/1650379376 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7eff2c059090 con 0x7eff380fd910 2024-02-22T00:41:17.070 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:41:17.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:41:17.070 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:41:17.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:41:17.070 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:41:17.070 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2, 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 3 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6, 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 7 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:41:17.071 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:41:17.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff2806cab0 msgr2=0x7eff2806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff2806cab0 0x7eff2806ef70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7eff38109a70 tx=0x7eff24009cb0).stop 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fd910 msgr2=0x7eff3810e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fd910 0x7eff3810e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7eff2c00e8f0 tx=0x7eff2c00b040).stop 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 shutdown_connections 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff2806cab0 0x7eff2806ef70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff380fd910 0x7eff3810e130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 --2- 172.21.15.49:0/1650379376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff380fe270 0x7eff3810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 >> 172.21.15.49:0/1650379376 conn(0x7eff380f3530 msgr2=0x7eff380fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 shutdown_connections 2024-02-22T00:41:17.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.070+0000 7eff3ef2f700 1 -- 172.21.15.49:0/1650379376 wait complete. 2024-02-22T00:41:17.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.174+0000 7f9220796700 1 -- 172.21.15.49:0/1546616799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f9200 msgr2=0x7f9218101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.174+0000 7f9220796700 1 --2- 172.21.15.49:0/1546616799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f9200 0x7f9218101910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f92140047f0 tx=0x7f9214009cb0).stop 2024-02-22T00:41:17.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.174+0000 7f9220796700 1 -- 172.21.15.49:0/1546616799 shutdown_connections 2024-02-22T00:41:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.174+0000 7f9220796700 1 --2- 172.21.15.49:0/1546616799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f9200 0x7f9218101910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.174+0000 7f9220796700 1 --2- 172.21.15.49:0/1546616799 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92180f88a0 0x7f92180f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.174+0000 7f9220796700 1 -- 172.21.15.49:0/1546616799 >> 172.21.15.49:0/1546616799 conn(0x7f9218070590 msgr2=0x7f92180f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.174+0000 7f9220796700 1 -- 172.21.15.49:0/1546616799 shutdown_connections 2024-02-22T00:41:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.174+0000 7f9220796700 1 -- 172.21.15.49:0/1546616799 wait complete. 2024-02-22T00:41:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f9220796700 1 Processor -- start 2024-02-22T00:41:17.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f9220796700 1 -- start start 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f9220796700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f88a0 0x7f921810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f9220796700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92180f9200 0x7f921810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f9220796700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921810eb70 con 0x7f92180f88a0 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f9220796700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921810ecb0 con 0x7f92180f9200 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f921e532700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f88a0 0x7f921810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f921e532700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f88a0 0x7f921810e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43816/0 (socket says 172.21.15.49:43816) 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f921e532700 1 -- 172.21.15.49:0/353460180 learned_addr learned my addr 172.21.15.49:0/353460180 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.175+0000 7f921dd31700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92180f9200 0x7f921810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f921e532700 1 -- 172.21.15.49:0/353460180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92180f9200 msgr2=0x7f921810e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f921e532700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92180f9200 0x7f921810e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f921e532700 1 -- 172.21.15.49:0/353460180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214005040 con 0x7f92180f88a0 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f921e532700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f88a0 0x7f921810e080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f920c002770 tx=0x7f920c002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f920b7fe700 1 -- 172.21.15.49:0/353460180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f920c007b40 con 0x7f92180f88a0 2024-02-22T00:41:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f920b7fe700 1 -- 172.21.15.49:0/353460180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f920c00f040 con 0x7f92180f88a0 2024-02-22T00:41:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9218108340 con 0x7f92180f88a0 2024-02-22T00:41:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f920b7fe700 1 -- 172.21.15.49:0/353460180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f920c014820 con 0x7f92180f88a0 2024-02-22T00:41:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.176+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9218108880 con 0x7f92180f88a0 2024-02-22T00:41:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.177+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921805f590 con 0x7f92180f88a0 2024-02-22T00:41:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.177+0000 7f920b7fe700 1 -- 172.21.15.49:0/353460180 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f920c007ca0 con 0x7f92180f88a0 2024-02-22T00:41:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.178+0000 7f920b7fe700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920406caa0 0x7f920406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.178+0000 7f920b7fe700 1 -- 172.21.15.49:0/353460180 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f920c08b7f0 con 0x7f92180f88a0 2024-02-22T00:41:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.178+0000 7f921dd31700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920406caa0 0x7f920406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.178+0000 7f921dd31700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920406caa0 0x7f920406ef60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f92181099c0 tx=0x7f921400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.183+0000 7f920b7fe700 1 -- 172.21.15.49:0/353460180 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f920c0593f0 con 0x7f92180f88a0 2024-02-22T00:41:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.423+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9218109800 con 0x7f92180f88a0 2024-02-22T00:41:17.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.423+0000 7f920b7fe700 1 -- 172.21.15.49:0/353460180 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f920c058f80 con 0x7f92180f88a0 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:41:17.426 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:41:17.427 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:41:17.428 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:41:17.429 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:41:17.429 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:41:17.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920406caa0 msgr2=0x7f920406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920406caa0 0x7f920406ef60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f92181099c0 tx=0x7f921400b040).stop 2024-02-22T00:41:17.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f88a0 msgr2=0x7f921810e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f88a0 0x7f921810e080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f920c002770 tx=0x7f920c002a80).stop 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 shutdown_connections 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920406caa0 0x7f920406ef60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92180f88a0 0x7f921810e080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 --2- 172.21.15.49:0/353460180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92180f9200 0x7f921810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.425+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 >> 172.21.15.49:0/353460180 conn(0x7f9218070590 msgr2=0x7f92180fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.426+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 shutdown_connections 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.426+0000 7f9220796700 1 -- 172.21.15.49:0/353460180 wait complete. 2024-02-22T00:41:17.430 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:41:17.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 -- 172.21.15.49:0/2747788363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f88a0 msgr2=0x7ff93c0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 --2- 172.21.15.49:0/2747788363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f88a0 0x7ff93c0f8c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff930004730 tx=0x7ff930009cb0).stop 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 -- 172.21.15.49:0/2747788363 shutdown_connections 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 --2- 172.21.15.49:0/2747788363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff93c0f9200 0x7ff93c101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 --2- 172.21.15.49:0/2747788363 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f88a0 0x7ff93c0f8c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 -- 172.21.15.49:0/2747788363 >> 172.21.15.49:0/2747788363 conn(0x7ff93c070590 msgr2=0x7ff93c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 -- 172.21.15.49:0/2747788363 shutdown_connections 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 -- 172.21.15.49:0/2747788363 wait complete. 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 Processor -- start 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.528+0000 7ff942be2700 1 -- start start 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff942be2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff93c0f88a0 0x7ff93c10e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff942be2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f9200 0x7ff93c10e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff942be2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c10ec00 con 0x7ff93c0f88a0 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff942be2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c10ed40 con 0x7ff93c0f9200 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff94097e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff93c0f88a0 0x7ff93c10e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff94097e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff93c0f88a0 0x7ff93c10e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43832/0 (socket says 172.21.15.49:43832) 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff94097e700 1 -- 172.21.15.49:0/3800838631 learned_addr learned my addr 172.21.15.49:0/3800838631 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff93bfff700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f9200 0x7ff93c10e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff94097e700 1 -- 172.21.15.49:0/3800838631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f9200 msgr2=0x7ff93c10e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff94097e700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f9200 0x7ff93c10e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff94097e700 1 -- 172.21.15.49:0/3800838631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930005040 con 0x7ff93c0f88a0 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff93bfff700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f9200 0x7ff93c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff94097e700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff93c0f88a0 0x7ff93c10e110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff930009e30 tx=0x7ff93000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff939ffb700 1 -- 172.21.15.49:0/3800838631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff930019070 con 0x7ff93c0f88a0 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff939ffb700 1 -- 172.21.15.49:0/3800838631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff9300097d0 con 0x7ff93c0f88a0 2024-02-22T00:41:17.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c108370 con 0x7ff93c0f88a0 2024-02-22T00:41:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.529+0000 7ff939ffb700 1 -- 172.21.15.49:0/3800838631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93001ed30 con 0x7ff93c0f88a0 2024-02-22T00:41:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.530+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c108850 con 0x7ff93c0f88a0 2024-02-22T00:41:17.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.530+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c05f590 con 0x7ff93c0f88a0 2024-02-22T00:41:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.531+0000 7ff939ffb700 1 -- 172.21.15.49:0/3800838631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff93001e420 con 0x7ff93c0f88a0 2024-02-22T00:41:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.531+0000 7ff939ffb700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff92c06caa0 0x7ff92c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.531+0000 7ff939ffb700 1 -- 172.21.15.49:0/3800838631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6051+0+0 (secure 0 0 0) 0x7ff93008c9c0 con 0x7ff93c0f88a0 2024-02-22T00:41:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.531+0000 7ff93bfff700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff92c06caa0 0x7ff92c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.532+0000 7ff93bfff700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff92c06caa0 0x7ff92c06ef60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff9280043d0 tx=0x7ff92800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:17.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.536+0000 7ff939ffb700 1 -- 172.21.15.49:0/3800838631 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff93005a680 con 0x7ff93c0f88a0 2024-02-22T00:41:17.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.753+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff93c0fee70 con 0x7ff92c06caa0 2024-02-22T00:41:17.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.754+0000 7ff939ffb700 1 -- 172.21.15.49:0/3800838631 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff93c0fee70 con 0x7ff92c06caa0 2024-02-22T00:41:17.756 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:41:17.756 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:41:17.756 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "10/21 daemons upgraded", 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:41:17.757 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.756+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff92c06caa0 msgr2=0x7ff92c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.756+0000 7ff942be2700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff92c06caa0 0x7ff92c06ef60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff9280043d0 tx=0x7ff92800b040).stop 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.756+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff93c0f88a0 msgr2=0x7ff93c10e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.756+0000 7ff942be2700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff93c0f88a0 0x7ff93c10e110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff930009e30 tx=0x7ff93000b040).stop 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.756+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 shutdown_connections 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.756+0000 7ff942be2700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff92c06caa0 0x7ff92c06ef60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.756+0000 7ff942be2700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff93c0f88a0 0x7ff93c10e110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.756+0000 7ff942be2700 1 --2- 172.21.15.49:0/3800838631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff93c0f9200 0x7ff93c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.757+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 >> 172.21.15.49:0/3800838631 conn(0x7ff93c070590 msgr2=0x7ff93c0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.757+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 shutdown_connections 2024-02-22T00:41:17.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.757+0000 7ff942be2700 1 -- 172.21.15.49:0/3800838631 wait complete. 2024-02-22T00:41:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.858+0000 7f8f436ff700 1 -- 172.21.15.49:0/2301414644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fe250 msgr2=0x7f8f3c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.858+0000 7f8f436ff700 1 --2- 172.21.15.49:0/2301414644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fe250 0x7f8f3c0f7a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8f380047f0 tx=0x7f8f38009cb0).stop 2024-02-22T00:41:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.858+0000 7f8f436ff700 1 -- 172.21.15.49:0/2301414644 shutdown_connections 2024-02-22T00:41:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.858+0000 7f8f436ff700 1 --2- 172.21.15.49:0/2301414644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fe250 0x7f8f3c0f7a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.858+0000 7f8f436ff700 1 --2- 172.21.15.49:0/2301414644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f3c0fd8f0 0x7f8f3c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.858+0000 7f8f436ff700 1 -- 172.21.15.49:0/2301414644 >> 172.21.15.49:0/2301414644 conn(0x7f8f3c0f34b0 msgr2=0x7f8f3c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:17.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.858+0000 7f8f436ff700 1 -- 172.21.15.49:0/2301414644 shutdown_connections 2024-02-22T00:41:17.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.858+0000 7f8f436ff700 1 -- 172.21.15.49:0/2301414644 wait complete. 2024-02-22T00:41:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f436ff700 1 Processor -- start 2024-02-22T00:41:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f436ff700 1 -- start start 2024-02-22T00:41:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f436ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fd8f0 0x7f8f3c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f436ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f3c0fe250 0x7f8f3c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f436ff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c06bab0 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f436ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c06bbf0 con 0x7f8f3c0fe250 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f4149b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fd8f0 0x7f8f3c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f4149b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fd8f0 0x7f8f3c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43836/0 (socket says 172.21.15.49:43836) 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f4149b700 1 -- 172.21.15.49:0/2828604758 learned_addr learned my addr 172.21.15.49:0/2828604758 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f40c9a700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f3c0fe250 0x7f8f3c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f4149b700 1 -- 172.21.15.49:0/2828604758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f3c0fe250 msgr2=0x7f8f3c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f4149b700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f3c0fe250 0x7f8f3c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.859+0000 7f8f4149b700 1 -- 172.21.15.49:0/2828604758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30005040 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.860+0000 7f8f4149b700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fd8f0 0x7f8f3c06b0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8f30004870 tx=0x7f8f30009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.860+0000 7f8f2e7fc700 1 -- 172.21.15.49:0/2828604758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f30010500 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.860+0000 7f8f2e7fc700 1 -- 172.21.15.49:0/2828604758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f3000f040 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.860+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f38005040 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.860+0000 7f8f2e7fc700 1 -- 172.21.15.49:0/2828604758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f30014a10 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.860+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c114740 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.861+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c05f590 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.861+0000 7f8f2e7fc700 1 -- 172.21.15.49:0/2828604758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8f30014cf0 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.862+0000 7f8f2e7fc700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8f2806cab0 0x7f8f2806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:17.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.862+0000 7f8f2e7fc700 1 -- 172.21.15.49:0/2828604758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f8f3008b6c0 con 0x7f8f3c0fd8f0 2024-02-22T00:41:17.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.862+0000 7f8f40c9a700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8f2806cab0 0x7f8f2806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:17.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.862+0000 7f8f40c9a700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8f2806cab0 0x7f8f2806ef70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8f3c06c870 tx=0x7f8f38009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:17.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:17.866+0000 7f8f2e7fc700 1 -- 172.21.15.49:0/2828604758 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8f30055830 con 0x7f8f3c0fd8f0 2024-02-22T00:41:18.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.143+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8f3c06c5e0 con 0x7f8f3c0fd8f0 2024-02-22T00:41:18.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.144+0000 7f8f2e7fc700 1 -- 172.21.15.49:0/2828604758 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1328 (secure 0 0 0) 0x7f8f30058e50 con 0x7f8f3c0fd8f0 2024-02-22T00:41:18.146 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded 2024-02-22T00:41:18.146 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-22T00:41:18.146 INFO:teuthology.orchestra.run.smithi049.stdout: osd.3 (root=default,host=smithi161) is down 2024-02-22T00:41:18.146 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded 2024-02-22T00:41:18.146 INFO:teuthology.orchestra.run.smithi049.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-02-22T00:41:18.146 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-02-22T00:41:18.147 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-02-22T00:41:18.148 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-02-22T00:41:18.148 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-02-22T00:41:18.148 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-02-22T00:41:18.148 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-02-22T00:41:18.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8f2806cab0 msgr2=0x7f8f2806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8f2806cab0 0x7f8f2806ef70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8f3c06c870 tx=0x7f8f38009cb0).stop 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fd8f0 msgr2=0x7f8f3c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fd8f0 0x7f8f3c06b0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8f30004870 tx=0x7f8f30009cb0).stop 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 shutdown_connections 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8f2806cab0 0x7f8f2806ef70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f3c0fd8f0 0x7f8f3c06b0d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 --2- 172.21.15.49:0/2828604758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f3c0fe250 0x7f8f3c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 >> 172.21.15.49:0/2828604758 conn(0x7f8f3c0f34b0 msgr2=0x7f8f3c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 shutdown_connections 2024-02-22T00:41:18.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:18.146+0000 7f8f436ff700 1 -- 172.21.15.49:0/2828604758 wait complete. 2024-02-22T00:41:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: pgmap v112: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:18.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1650379376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-22T00:41:18.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/353460180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:41:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: pgmap v112: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1650379376' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-22T00:41:18.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:18 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/353460180' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:41:18.793 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[126212]: 2024-02-22T00:41:18.326+0000 7f94cc1bc640 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-22T00:41:19.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:18 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[126212]: 2024-02-22T00:41:18.820+0000 7f94cc1bc640 -1 osd.3 63 log_to_monitors true 2024-02-22T00:41:19.293 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 00:41:19 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[126212]: 2024-02-22T00:41:19.053+0000 7f94bb611700 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:41:19.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:19 smithi161 ceph-mon[113442]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:19.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:19 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2828604758' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:41:19.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:19 smithi161 ceph-mon[113442]: from='osd.3 [v2:172.21.15.161:6800/4220305275,v1:172.21.15.161:6801/4220305275]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T00:41:19.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:19 smithi161 ceph-mon[113442]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T00:41:19.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:19 smithi049 ceph-mon[132694]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:19.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:19 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2828604758' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:41:19.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:19 smithi049 ceph-mon[132694]: from='osd.3 [v2:172.21.15.161:6800/4220305275,v1:172.21.15.161:6801/4220305275]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T00:41:19.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:19 smithi049 ceph-mon[132694]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T00:41:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:20 smithi049 ceph-mon[132694]: pgmap v113: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:20 smithi049 ceph-mon[132694]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T00:41:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:20 smithi049 ceph-mon[132694]: osdmap e66: 6 total, 5 up, 6 in 2024-02-22T00:41:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:20 smithi049 ceph-mon[132694]: from='osd.3 [v2:172.21.15.161:6800/4220305275,v1:172.21.15.161:6801/4220305275]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:41:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:20 smithi049 ceph-mon[132694]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:41:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:20 smithi161 ceph-mon[113442]: pgmap v113: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:20 smithi161 ceph-mon[113442]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T00:41:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:20 smithi161 ceph-mon[113442]: osdmap e66: 6 total, 5 up, 6 in 2024-02-22T00:41:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:20 smithi161 ceph-mon[113442]: from='osd.3 [v2:172.21.15.161:6800/4220305275,v1:172.21.15.161:6801/4220305275]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:41:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:20 smithi161 ceph-mon[113442]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:41:21.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:21 smithi049 ceph-mon[132694]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:41:21.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:21 smithi049 ceph-mon[132694]: failed to encode map e66 with expected crc 2024-02-22T00:41:21.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:21 smithi049 ceph-mon[132694]: osd.3 [v2:172.21.15.161:6800/4220305275,v1:172.21.15.161:6801/4220305275] boot 2024-02-22T00:41:21.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:21 smithi049 ceph-mon[132694]: osdmap e67: 6 total, 6 up, 6 in 2024-02-22T00:41:21.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:21 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:41:21.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:21 smithi049 ceph-mon[132694]: failed to encode map e66 with expected crc 2024-02-22T00:41:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:21 smithi161 ceph-mon[113442]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:41:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:21 smithi161 ceph-mon[113442]: failed to encode map e66 with expected crc 2024-02-22T00:41:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:21 smithi161 ceph-mon[113442]: osd.3 [v2:172.21.15.161:6800/4220305275,v1:172.21.15.161:6801/4220305275] boot 2024-02-22T00:41:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:21 smithi161 ceph-mon[113442]: osdmap e67: 6 total, 6 up, 6 in 2024-02-22T00:41:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:21 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T00:41:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:21 smithi161 ceph-mon[113442]: failed to encode map e66 with expected crc 2024-02-22T00:41:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:22 smithi049 ceph-mon[132694]: pgmap v116: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:22 smithi049 ceph-mon[132694]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:22 smithi049 ceph-mon[132694]: osdmap e68: 6 total, 6 up, 6 in 2024-02-22T00:41:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:22 smithi049 ceph-mon[132694]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:22 smithi049 ceph-mon[132694]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:22 smithi049 ceph-mon[132694]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:22 smithi049 ceph-mon[132694]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:22 smithi049 ceph-mon[132694]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:22 smithi161 ceph-mon[113442]: pgmap v116: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-02-22T00:41:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:22 smithi161 ceph-mon[113442]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:22 smithi161 ceph-mon[113442]: osdmap e68: 6 total, 6 up, 6 in 2024-02-22T00:41:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:22 smithi161 ceph-mon[113442]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:22 smithi161 ceph-mon[113442]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:22 smithi161 ceph-mon[113442]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:22 smithi161 ceph-mon[113442]: failed to encode map e68 with expected crc 2024-02-22T00:41:22.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:22 smithi161 ceph-mon[113442]: failed to encode map e68 with expected crc 2024-02-22T00:41:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:23 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 63/321 objects degraded (19.626%), 18 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:23 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 63/321 objects degraded (19.626%), 18 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:24 smithi049 ceph-mon[132694]: pgmap v118: 65 pgs: 4 peering, 18 active+undersized+degraded, 16 active+undersized, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:41:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:24 smithi161 ceph-mon[113442]: pgmap v118: 65 pgs: 4 peering, 18 active+undersized+degraded, 16 active+undersized, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-02-22T00:41:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:26 smithi049 ceph-mon[132694]: pgmap v119: 65 pgs: 4 peering, 5 active+undersized+degraded, 5 active+undersized, 51 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 14/321 objects degraded (4.361%) 2024-02-22T00:41:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:26 smithi161 ceph-mon[113442]: pgmap v119: 65 pgs: 4 peering, 5 active+undersized+degraded, 5 active+undersized, 51 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 14/321 objects degraded (4.361%) 2024-02-22T00:41:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:27 smithi049 ceph-mon[132694]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/321 objects degraded (4.361%), 5 pgs degraded) 2024-02-22T00:41:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:27 smithi049 ceph-mon[132694]: Cluster is now healthy 2024-02-22T00:41:27.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:27 smithi161 ceph-mon[113442]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/321 objects degraded (4.361%), 5 pgs degraded) 2024-02-22T00:41:27.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:27 smithi161 ceph-mon[113442]: Cluster is now healthy 2024-02-22T00:41:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:28 smithi049 ceph-mon[132694]: pgmap v120: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:41:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:28 smithi161 ceph-mon[113442]: pgmap v120: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:41:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:30 smithi049 ceph-mon[132694]: pgmap v121: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:30 smithi161 ceph-mon[113442]: pgmap v121: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:32 smithi049 ceph-mon[132694]: pgmap v122: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:32 smithi161 ceph-mon[113442]: pgmap v122: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:33.390 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-22T00:41:33.390 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:33 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-22T00:41:33.390 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:33 smithi161 ceph-mon[113442]: Upgrade: osd.4 is safe to restart 2024-02-22T00:41:33.390 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:33.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-22T00:41:33.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:33 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-22T00:41:33.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:33 smithi049 ceph-mon[132694]: Upgrade: osd.4 is safe to restart 2024-02-22T00:41:33.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:34 smithi049 ceph-mon[132694]: pgmap v123: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T00:41:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:41:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:34 smithi161 ceph-mon[113442]: pgmap v123: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T00:41:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:41:35.268 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:35 smithi161 ceph-mon[113442]: Upgrade: Updating osd.4 2024-02-22T00:41:35.268 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:35 smithi161 ceph-mon[113442]: Deploying daemon osd.4 on smithi161 2024-02-22T00:41:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:35 smithi049 ceph-mon[132694]: Upgrade: Updating osd.4 2024-02-22T00:41:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:35 smithi049 ceph-mon[132694]: Deploying daemon osd.4 on smithi161 2024-02-22T00:41:36.211 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:36 smithi161 ceph-mon[113442]: pgmap v124: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:36 smithi049 ceph-mon[132694]: pgmap v124: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:37.043 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:36 smithi161 systemd[1]: Stopping Ceph osd.4 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:41:37.043 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[82065]: debug 2024-02-22T00:41:37.011+0000 7f9dee7e4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T00:41:37.044 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[82065]: debug 2024-02-22T00:41:37.011+0000 7f9dee7e4700 -1 osd.4 68 *** Got signal Terminated *** 2024-02-22T00:41:37.044 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:37 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[82065]: debug 2024-02-22T00:41:37.011+0000 7f9dee7e4700 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T00:41:37.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:37 smithi161 ceph-mon[113442]: osd.4 marked itself down and dead 2024-02-22T00:41:37.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:37 smithi049 ceph-mon[132694]: osd.4 marked itself down and dead 2024-02-22T00:41:38.043 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:37 smithi161 bash[132522]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4 2024-02-22T00:41:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:38 smithi161 ceph-mon[113442]: pgmap v125: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:38 smithi161 ceph-mon[113442]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:41:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:38 smithi161 ceph-mon[113442]: failed to encode map e69 with expected crc 2024-02-22T00:41:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:38 smithi161 ceph-mon[113442]: osdmap e69: 6 total, 5 up, 6 in 2024-02-22T00:41:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:38 smithi049 ceph-mon[132694]: pgmap v125: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:38 smithi049 ceph-mon[132694]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:41:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:38 smithi049 ceph-mon[132694]: failed to encode map e69 with expected crc 2024-02-22T00:41:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:38 smithi049 ceph-mon[132694]: osdmap e69: 6 total, 5 up, 6 in 2024-02-22T00:41:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:39 smithi161 ceph-mon[113442]: failed to encode map e70 with expected crc 2024-02-22T00:41:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:39 smithi161 ceph-mon[113442]: osdmap e70: 6 total, 5 up, 6 in 2024-02-22T00:41:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:39 smithi161 ceph-mon[113442]: failed to encode map e70 with expected crc 2024-02-22T00:41:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:39 smithi161 ceph-mon[113442]: failed to encode map e70 with expected crc 2024-02-22T00:41:39.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:39 smithi049 ceph-mon[132694]: failed to encode map e70 with expected crc 2024-02-22T00:41:39.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:39 smithi049 ceph-mon[132694]: osdmap e70: 6 total, 5 up, 6 in 2024-02-22T00:41:39.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:39 smithi049 ceph-mon[132694]: failed to encode map e70 with expected crc 2024-02-22T00:41:39.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:39 smithi049 ceph-mon[132694]: failed to encode map e70 with expected crc 2024-02-22T00:41:39.990 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:39 smithi161 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.4.service: Succeeded. 2024-02-22T00:41:39.990 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:39 smithi161 systemd[1]: Stopped Ceph osd.4 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:41:39.990 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:39 smithi161 systemd[1]: Starting Ceph osd.4 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:41:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:40 smithi161 ceph-mon[113442]: pgmap v128: 65 pgs: 2 active+undersized+degraded, 5 stale+active+clean, 3 active+undersized, 55 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 5/321 objects degraded (1.558%) 2024-02-22T00:41:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:40 smithi161 ceph-mon[113442]: Health check failed: Degraded data redundancy: 5/321 objects degraded (1.558%), 2 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:40.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:40 smithi049 ceph-mon[132694]: pgmap v128: 65 pgs: 2 active+undersized+degraded, 5 stale+active+clean, 3 active+undersized, 55 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 5/321 objects degraded (1.558%) 2024-02-22T00:41:40.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:40 smithi049 ceph-mon[132694]: Health check failed: Degraded data redundancy: 5/321 objects degraded (1.558%), 2 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:40.931 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:40 smithi161 bash[132796]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-22T00:41:40.932 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:40 smithi161 bash[132796]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-22T00:41:40.932 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:40 smithi161 bash[132796]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-22T00:41:40.932 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:40 smithi161 bash[132796]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-22T00:41:40.932 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:40 smithi161 bash[132796]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-22T00:41:40.932 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:40 smithi161 bash[132796]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-22T00:41:40.932 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:40 smithi161 bash[132796]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-22T00:41:42.201 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:41 smithi161 ceph-osd[133121]: -- 172.21.15.161:0/3787762249 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5558414684e0 con 0x555841439000 2024-02-22T00:41:42.202 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:41 smithi161 bash[133083]: 81512caaf4ab5079b0aaea6a9e1479041ca31c00f194fe731c0a64421918164d 2024-02-22T00:41:42.202 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:41 smithi161 systemd[1]: Started Ceph osd.4 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:41:42.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:42 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T00:41:42.343+0000 7f8c7854d640 -1 Falling back to public interface 2024-02-22T00:41:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:42 smithi161 ceph-mon[113442]: pgmap v129: 65 pgs: 12 active+undersized+degraded, 2 stale+active+clean, 14 active+undersized, 37 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41/321 objects degraded (12.773%) 2024-02-22T00:41:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:41:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:42 smithi049 ceph-mon[132694]: pgmap v129: 65 pgs: 12 active+undersized+degraded, 2 stale+active+clean, 14 active+undersized, 37 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 41/321 objects degraded (12.773%) 2024-02-22T00:41:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:41:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:43 smithi049 ceph-mon[132694]: pgmap v130: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:41:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:43 smithi161 ceph-mon[113442]: pgmap v130: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:41:45.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:45 smithi049 ceph-mon[132694]: pgmap v131: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:45.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:45 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 54/321 objects degraded (16.822%), 16 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:45.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:45 smithi161 ceph-mon[113442]: pgmap v131: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:45.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:45 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 54/321 objects degraded (16.822%), 16 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:46.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:46.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:46.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:46.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:46 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:46.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:46 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:48.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.265+0000 7f80f254d700 1 -- 172.21.15.49:0/1575823960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 msgr2=0x7f80ec0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.265+0000 7f80f254d700 1 --2- 172.21.15.49:0/1575823960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 0x7f80ec0fcbd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f80dc0047f0 tx=0x7f80dc009cb0).stop 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.265+0000 7f80f254d700 1 -- 172.21.15.49:0/1575823960 shutdown_connections 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.265+0000 7f80f254d700 1 --2- 172.21.15.49:0/1575823960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80ec0fd150 0x7f80ec0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.265+0000 7f80f254d700 1 --2- 172.21.15.49:0/1575823960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 0x7f80ec0fcbd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.265+0000 7f80f254d700 1 -- 172.21.15.49:0/1575823960 >> 172.21.15.49:0/1575823960 conn(0x7f80ec070590 msgr2=0x7f80ec0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.265+0000 7f80f254d700 1 -- 172.21.15.49:0/1575823960 shutdown_connections 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.265+0000 7f80f254d700 1 -- 172.21.15.49:0/1575823960 wait complete. 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80f254d700 1 Processor -- start 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80f254d700 1 -- start start 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80f254d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 0x7f80ec10d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80f254d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80ec0fd150 0x7f80ec10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80f254d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec10daf0 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80f254d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec10dc30 con 0x7f80ec0fd150 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 0x7f80ec10d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 0x7f80ec10d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42606/0 (socket says 172.21.15.49:42606) 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80ebfff700 1 -- 172.21.15.49:0/944846940 learned_addr learned my addr 172.21.15.49:0/944846940 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.266+0000 7f80eb7fe700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80ec0fd150 0x7f80ec10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80ebfff700 1 -- 172.21.15.49:0/944846940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80ec0fd150 msgr2=0x7f80ec10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80ebfff700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80ec0fd150 0x7f80ec10d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80ebfff700 1 -- 172.21.15.49:0/944846940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc005040 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80ebfff700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 0x7f80ec10d000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f80dc009380 tx=0x7f80dc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80e97fa700 1 -- 172.21.15.49:0/944846940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80dc018070 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec107260 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80e97fa700 1 -- 172.21.15.49:0/944846940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f80dc007e90 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80e97fa700 1 -- 172.21.15.49:0/944846940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80dc01c380 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.267+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec1077c0 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.268+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec05f590 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.269+0000 7f80e97fa700 1 -- 172.21.15.49:0/944846940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f80dc0123c0 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.269+0000 7f80e97fa700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f80d806cab0 0x7f80d806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.269+0000 7f80e97fa700 1 -- 172.21.15.49:0/944846940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f80dc08cb30 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.269+0000 7f80eb7fe700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f80d806cab0 0x7f80d806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.270+0000 7f80eb7fe700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f80d806cab0 0x7f80d806ef70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f80ec108940 tx=0x7f80d400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:48.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.274+0000 7f80e97fa700 1 -- 172.21.15.49:0/944846940 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f80dc05a730 con 0x7f80ec0fc7f0 2024-02-22T00:41:48.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:48 smithi161 ceph-mon[113442]: pgmap v132: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:48 smithi049 ceph-mon[132694]: pgmap v132: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:48.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.493+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80ec108720 con 0x7f80d806cab0 2024-02-22T00:41:48.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.494+0000 7f80e97fa700 1 -- 172.21.15.49:0/944846940 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f80ec108720 con 0x7f80d806cab0 2024-02-22T00:41:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f80d806cab0 msgr2=0x7f80d806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f80d806cab0 0x7f80d806ef70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f80ec108940 tx=0x7f80d400b040).stop 2024-02-22T00:41:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 msgr2=0x7f80ec10d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 0x7f80ec10d000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f80dc009380 tx=0x7f80dc009cb0).stop 2024-02-22T00:41:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 shutdown_connections 2024-02-22T00:41:48.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f80d806cab0 0x7f80d806ef70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f80ec0fc7f0 0x7f80ec10d000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 --2- 172.21.15.49:0/944846940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80ec0fd150 0x7f80ec10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 >> 172.21.15.49:0/944846940 conn(0x7f80ec070590 msgr2=0x7f80ec0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 shutdown_connections 2024-02-22T00:41:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.496+0000 7f80f254d700 1 -- 172.21.15.49:0/944846940 wait complete. 2024-02-22T00:41:48.508 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:41:48.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.599+0000 7f99d5fc0700 1 -- 172.21.15.49:0/118203045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f88a0 msgr2=0x7f99d00f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.599+0000 7f99d5fc0700 1 --2- 172.21.15.49:0/118203045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f88a0 0x7f99d00f8c80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f99c00047f0 tx=0x7f99c0009cb0).stop 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.600+0000 7f99d5fc0700 1 -- 172.21.15.49:0/118203045 shutdown_connections 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.600+0000 7f99d5fc0700 1 --2- 172.21.15.49:0/118203045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d00f9200 0x7f99d0101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.600+0000 7f99d5fc0700 1 --2- 172.21.15.49:0/118203045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f88a0 0x7f99d00f8c80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.600+0000 7f99d5fc0700 1 -- 172.21.15.49:0/118203045 >> 172.21.15.49:0/118203045 conn(0x7f99d0070590 msgr2=0x7f99d00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.600+0000 7f99d5fc0700 1 -- 172.21.15.49:0/118203045 shutdown_connections 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.600+0000 7f99d5fc0700 1 -- 172.21.15.49:0/118203045 wait complete. 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.600+0000 7f99d5fc0700 1 Processor -- start 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.600+0000 7f99d5fc0700 1 -- start start 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99d5fc0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d00f88a0 0x7f99d010e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99d5fc0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f9200 0x7f99d010e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99d5fc0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d010ec40 con 0x7f99d00f9200 2024-02-22T00:41:48.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99d5fc0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d010ed80 con 0x7f99d00f88a0 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ceffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f9200 0x7f99d010e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ceffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f9200 0x7f99d010e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42628/0 (socket says 172.21.15.49:42628) 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ceffd700 1 -- 172.21.15.49:0/600468649 learned_addr learned my addr 172.21.15.49:0/600468649 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99cf7fe700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d00f88a0 0x7f99d010e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ceffd700 1 -- 172.21.15.49:0/600468649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d00f88a0 msgr2=0x7f99d010e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ceffd700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d00f88a0 0x7f99d010e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ceffd700 1 -- 172.21.15.49:0/600468649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c0005040 con 0x7f99d00f9200 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ceffd700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f9200 0x7f99d010e640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f99b800e910 tx=0x7f99b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ccff9700 1 -- 172.21.15.49:0/600468649 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b8007b40 con 0x7f99d00f9200 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ccff9700 1 -- 172.21.15.49:0/600468649 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f99b800f040 con 0x7f99d00f9200 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d01083b0 con 0x7f99d00f9200 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99ccff9700 1 -- 172.21.15.49:0/600468649 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b8014920 con 0x7f99d00f9200 2024-02-22T00:41:48.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.601+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d01088f0 con 0x7f99d00f9200 2024-02-22T00:41:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.602+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d005f590 con 0x7f99d00f9200 2024-02-22T00:41:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.603+0000 7f99ccff9700 1 -- 172.21.15.49:0/600468649 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f99b8007ca0 con 0x7f99d00f9200 2024-02-22T00:41:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.603+0000 7f99ccff9700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f99bc06caa0 0x7f99bc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.603+0000 7f99ccff9700 1 -- 172.21.15.49:0/600468649 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f99b808b730 con 0x7f99d00f9200 2024-02-22T00:41:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.603+0000 7f99cf7fe700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f99bc06caa0 0x7f99bc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.604+0000 7f99cf7fe700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f99bc06caa0 0x7f99bc06ef60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f99c00047c0 tx=0x7f99c0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:48.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.608+0000 7f99ccff9700 1 -- 172.21.15.49:0/600468649 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f99b8059330 con 0x7f99d00f9200 2024-02-22T00:41:48.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.823+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99d01098b0 con 0x7f99bc06caa0 2024-02-22T00:41:48.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.825+0000 7f99ccff9700 1 -- 172.21.15.49:0/600468649 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f99d01098b0 con 0x7f99bc06caa0 2024-02-22T00:41:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f99bc06caa0 msgr2=0x7f99bc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f99bc06caa0 0x7f99bc06ef60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f99c00047c0 tx=0x7f99c0009cb0).stop 2024-02-22T00:41:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f9200 msgr2=0x7f99d010e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f9200 0x7f99d010e640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f99b800e910 tx=0x7f99b800b040).stop 2024-02-22T00:41:48.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 shutdown_connections 2024-02-22T00:41:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f99bc06caa0 0x7f99bc06ef60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d00f88a0 0x7f99d010e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 --2- 172.21.15.49:0/600468649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99d00f9200 0x7f99d010e640 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 >> 172.21.15.49:0/600468649 conn(0x7f99d0070590 msgr2=0x7f99d00fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 shutdown_connections 2024-02-22T00:41:48.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.827+0000 7f99d5fc0700 1 -- 172.21.15.49:0/600468649 wait complete. 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.928+0000 7f7f69d9b700 1 -- 172.21.15.49:0/847375802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f5c013a70 con 0x7f7f6c0fe270 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.928+0000 7f7f71234700 1 -- 172.21.15.49:0/847375802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fe270 msgr2=0x7f7f6c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.928+0000 7f7f71234700 1 --2- 172.21.15.49:0/847375802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fe270 0x7f7f6c0f7a50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7f5c0047f0 tx=0x7f7f5c009cb0).stop 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.929+0000 7f7f71234700 1 -- 172.21.15.49:0/847375802 shutdown_connections 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.929+0000 7f7f71234700 1 --2- 172.21.15.49:0/847375802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fe270 0x7f7f6c0f7a50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.929+0000 7f7f71234700 1 --2- 172.21.15.49:0/847375802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f6c0fd910 0x7f7f6c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.929+0000 7f7f71234700 1 -- 172.21.15.49:0/847375802 >> 172.21.15.49:0/847375802 conn(0x7f7f6c0f3530 msgr2=0x7f7f6c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.929+0000 7f7f71234700 1 -- 172.21.15.49:0/847375802 shutdown_connections 2024-02-22T00:41:48.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.929+0000 7f7f71234700 1 -- 172.21.15.49:0/847375802 wait complete. 2024-02-22T00:41:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.929+0000 7f7f71234700 1 Processor -- start 2024-02-22T00:41:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f71234700 1 -- start start 2024-02-22T00:41:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f71234700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fd910 0x7f7f6c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f71234700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f6c0fe270 0x7f7f6c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f71234700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c06bab0 con 0x7f7f6c0fd910 2024-02-22T00:41:48.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f71234700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c06bbf0 con 0x7f7f6c0fe270 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f6ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fd910 0x7f7f6c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f6ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fd910 0x7f7f6c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42646/0 (socket says 172.21.15.49:42646) 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f6ad9d700 1 -- 172.21.15.49:0/2292686814 learned_addr learned my addr 172.21.15.49:0/2292686814 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f6a59c700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f6c0fe270 0x7f7f6c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f6ad9d700 1 -- 172.21.15.49:0/2292686814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f6c0fe270 msgr2=0x7f7f6c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f6ad9d700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f6c0fe270 0x7f7f6c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f6ad9d700 1 -- 172.21.15.49:0/2292686814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c005040 con 0x7f7f6c0fd910 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f6ad9d700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fd910 0x7f7f6c06b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7f6000b4b0 tx=0x7f7f600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.930+0000 7f7f53fff700 1 -- 172.21.15.49:0/2292686814 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f60002500 con 0x7f7f6c0fd910 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.931+0000 7f7f53fff700 1 -- 172.21.15.49:0/2292686814 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f60002b10 con 0x7f7f6c0fd910 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.931+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c06bea0 con 0x7f7f6c0fd910 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.931+0000 7f7f53fff700 1 -- 172.21.15.49:0/2292686814 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f60012cb0 con 0x7f7f6c0fd910 2024-02-22T00:41:48.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.931+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c114720 con 0x7f7f6c0fd910 2024-02-22T00:41:48.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.932+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c05f570 con 0x7f7f6c0fd910 2024-02-22T00:41:48.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.932+0000 7f7f53fff700 1 -- 172.21.15.49:0/2292686814 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7f60002660 con 0x7f7f6c0fd910 2024-02-22T00:41:48.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.933+0000 7f7f53fff700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7f5406caa0 0x7f7f5406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.933+0000 7f7f53fff700 1 -- 172.21.15.49:0/2292686814 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f7f6008bca0 con 0x7f7f6c0fd910 2024-02-22T00:41:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.933+0000 7f7f6a59c700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7f5406caa0 0x7f7f5406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.933+0000 7f7f6a59c700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7f5406caa0 0x7f7f5406ef60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7f6c06c870 tx=0x7f7f5c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:48.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:48.937+0000 7f7f53fff700 1 -- 172.21.15.49:0/2292686814 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7f60090070 con 0x7f7f6c0fd910 2024-02-22T00:41:49.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.145+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f6c059120 con 0x7f7f5406caa0 2024-02-22T00:41:49.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.156+0000 7f7f53fff700 1 -- 172.21.15.49:0/2292686814 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7f6c059120 con 0x7f7f5406caa0 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (5m) 69s ago 16m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (2m) 69s ago 16m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (2m) 3s ago 15m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (4m) 69s ago 15m 91.2M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (11m) 69s ago 11m 16.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (11m) 69s ago 11m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (10m) 3s ago 10m 16.4M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (11m) 3s ago 11m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (6m) 69s ago 17m 500M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (5m) 3s ago 15m 448M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (3m) 69s ago 17m 46.7M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:41:49.159 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (3m) 3s ago 15m 40.7M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (5m) 69s ago 15m 16.8M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (5m) 3s ago 15m 17.5M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (2m) 69s ago 14m 91.5M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (108s) 69s ago 14m 96.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (74s) 69s ago 13m 13.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (40s) 3s ago 13m 100M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (7s) 3s ago 13m 11.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (12m) 3s ago 12m 217M 2251M 16.2.14-550-geb66ed92 7403d1862307 5b27fb838bdb 2024-02-22T00:41:49.160 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (5m) 3s ago 15m 61.1M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7f5406caa0 msgr2=0x7f7f5406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7f5406caa0 0x7f7f5406ef60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7f6c06c870 tx=0x7f7f5c00b040).stop 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fd910 msgr2=0x7f7f6c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fd910 0x7f7f6c06b0d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7f6000b4b0 tx=0x7f7f600090f0).stop 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 shutdown_connections 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7f5406caa0 0x7f7f5406ef60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f6c0fd910 0x7f7f6c06b0d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 --2- 172.21.15.49:0/2292686814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f6c0fe270 0x7f7f6c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.158+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 >> 172.21.15.49:0/2292686814 conn(0x7f7f6c0f3530 msgr2=0x7f7f6c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:49.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.159+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 shutdown_connections 2024-02-22T00:41:49.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.159+0000 7f7f71234700 1 -- 172.21.15.49:0/2292686814 wait complete. 2024-02-22T00:41:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.259+0000 7f86ffc84700 1 -- 172.21.15.49:0/1549076183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 msgr2=0x7f86f8101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.259+0000 7f86ffc84700 1 --2- 172.21.15.49:0/1549076183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 0x7f86f8101970 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f86e80047f0 tx=0x7f86e8009cb0).stop 2024-02-22T00:41:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.259+0000 7f86ffc84700 1 -- 172.21.15.49:0/1549076183 shutdown_connections 2024-02-22T00:41:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.259+0000 7f86ffc84700 1 --2- 172.21.15.49:0/1549076183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 0x7f86f8101970 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.259+0000 7f86ffc84700 1 --2- 172.21.15.49:0/1549076183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86f80f8900 0x7f86f80f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.259+0000 7f86ffc84700 1 -- 172.21.15.49:0/1549076183 >> 172.21.15.49:0/1549076183 conn(0x7f86f8070590 msgr2=0x7f86f80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.259+0000 7f86ffc84700 1 -- 172.21.15.49:0/1549076183 shutdown_connections 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.259+0000 7f86ffc84700 1 -- 172.21.15.49:0/1549076183 wait complete. 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86ffc84700 1 Processor -- start 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86ffc84700 1 -- start start 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86ffc84700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86f80f8900 0x7f86f80f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86ffc84700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 0x7f86f80f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86ffc84700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80f7290 con 0x7f86f80f9260 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86ffc84700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f80f73d0 con 0x7f86f80f8900 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86fd21f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 0x7f86f80f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86fd21f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 0x7f86f80f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42656/0 (socket says 172.21.15.49:42656) 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86fd21f700 1 -- 172.21.15.49:0/2360420770 learned_addr learned my addr 172.21.15.49:0/2360420770 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.260+0000 7f86fda20700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86f80f8900 0x7f86f80f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:49.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86fd21f700 1 -- 172.21.15.49:0/2360420770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86f80f8900 msgr2=0x7f86f80f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86fd21f700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86f80f8900 0x7f86f80f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86fd21f700 1 -- 172.21.15.49:0/2360420770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e8005040 con 0x7f86f80f9260 2024-02-22T00:41:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86fd21f700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 0x7f86f80f6da0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f86e8009380 tx=0x7f86e8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86eeffd700 1 -- 172.21.15.49:0/2360420770 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86e800e030 con 0x7f86f80f9260 2024-02-22T00:41:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f80f7620 con 0x7f86f80f9260 2024-02-22T00:41:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86eeffd700 1 -- 172.21.15.49:0/2360420770 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f86e8007e90 con 0x7f86f80f9260 2024-02-22T00:41:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86eeffd700 1 -- 172.21.15.49:0/2360420770 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86e8018070 con 0x7f86f80f9260 2024-02-22T00:41:49.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.261+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f8114620 con 0x7f86f80f9260 2024-02-22T00:41:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.262+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f805f590 con 0x7f86f80f9260 2024-02-22T00:41:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.262+0000 7f86eeffd700 1 -- 172.21.15.49:0/2360420770 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f86e801d420 con 0x7f86f80f9260 2024-02-22T00:41:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.263+0000 7f86eeffd700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f86e406cab0 0x7f86e406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.263+0000 7f86eeffd700 1 -- 172.21.15.49:0/2360420770 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f86e808d0c0 con 0x7f86f80f9260 2024-02-22T00:41:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.263+0000 7f86fda20700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f86e406cab0 0x7f86e406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:49.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.263+0000 7f86fda20700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f86e406cab0 0x7f86e406ef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f86f4004dc0 tx=0x7f86f400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:49.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.267+0000 7f86eeffd700 1 -- 172.21.15.49:0/2360420770 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f86e8057230 con 0x7f86f80f9260 2024-02-22T00:41:49.543 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T00:41:49.202+0000 7f8c7854d640 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-22T00:41:49.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.551+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f86f8047540 con 0x7f86f80f9260 2024-02-22T00:41:49.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.552+0000 7f86eeffd700 1 -- 172.21.15.49:0/2360420770 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f86e805a850 con 0x7f86f80f9260 2024-02-22T00:41:49.554 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:41:49.554 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:41:49.554 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:41:49.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:41:49.554 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1, 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 5, 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 8 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:41:49.555 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:41:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f86e406cab0 msgr2=0x7f86e406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f86e406cab0 0x7f86e406ef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f86f4004dc0 tx=0x7f86f400b040).stop 2024-02-22T00:41:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 msgr2=0x7f86f80f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 0x7f86f80f6da0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f86e8009380 tx=0x7f86e8009cb0).stop 2024-02-22T00:41:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 shutdown_connections 2024-02-22T00:41:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f86e406cab0 0x7f86e406ef70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86f80f8900 0x7f86f80f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 --2- 172.21.15.49:0/2360420770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86f80f9260 0x7f86f80f6da0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 >> 172.21.15.49:0/2360420770 conn(0x7f86f8070590 msgr2=0x7f86f80fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 shutdown_connections 2024-02-22T00:41:49.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.554+0000 7f86ffc84700 1 -- 172.21.15.49:0/2360420770 wait complete. 2024-02-22T00:41:49.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.656+0000 7f999b4d9700 1 -- 172.21.15.49:0/1529318120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 msgr2=0x7f99940fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.656+0000 7f999b4d9700 1 --2- 172.21.15.49:0/1529318120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 0x7f99940fcbd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f99900047f0 tx=0x7f9990009cb0).stop 2024-02-22T00:41:49.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.656+0000 7f999b4d9700 1 -- 172.21.15.49:0/1529318120 shutdown_connections 2024-02-22T00:41:49.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.656+0000 7f999b4d9700 1 --2- 172.21.15.49:0/1529318120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99940fd150 0x7f99940f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.656+0000 7f999b4d9700 1 --2- 172.21.15.49:0/1529318120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 0x7f99940fcbd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.656+0000 7f999b4d9700 1 -- 172.21.15.49:0/1529318120 >> 172.21.15.49:0/1529318120 conn(0x7f9994070590 msgr2=0x7f99940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:49.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.657+0000 7f999b4d9700 1 -- 172.21.15.49:0/1529318120 shutdown_connections 2024-02-22T00:41:49.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.657+0000 7f999b4d9700 1 -- 172.21.15.49:0/1529318120 wait complete. 2024-02-22T00:41:49.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.657+0000 7f999b4d9700 1 Processor -- start 2024-02-22T00:41:49.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.657+0000 7f999b4d9700 1 -- start start 2024-02-22T00:41:49.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.657+0000 7f999b4d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 0x7f999410cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:49.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.657+0000 7f999b4d9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99940fd150 0x7f999410d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:49.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.657+0000 7f999b4d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999410d9f0 con 0x7f99940fc7f0 2024-02-22T00:41:49.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.657+0000 7f999b4d9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999410db30 con 0x7f99940fd150 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f9999275700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 0x7f999410cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f9999275700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 0x7f999410cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42676/0 (socket says 172.21.15.49:42676) 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f9999275700 1 -- 172.21.15.49:0/120973524 learned_addr learned my addr 172.21.15.49:0/120973524 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f9998a74700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99940fd150 0x7f999410d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f9999275700 1 -- 172.21.15.49:0/120973524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99940fd150 msgr2=0x7f999410d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f9999275700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99940fd150 0x7f999410d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f9999275700 1 -- 172.21.15.49:0/120973524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990005040 con 0x7f99940fc7f0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f9999275700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 0x7f999410cf00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f9990005010 tx=0x7f9990009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f998a7fc700 1 -- 172.21.15.49:0/120973524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f999000e030 con 0x7f99940fc7f0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f998a7fc700 1 -- 172.21.15.49:0/120973524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9990007e90 con 0x7f99940fc7f0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9994107160 con 0x7f99940fc7f0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f998a7fc700 1 -- 172.21.15.49:0/120973524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9990018070 con 0x7f99940fc7f0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.658+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99941076c0 con 0x7f99940fc7f0 2024-02-22T00:41:49.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.659+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999405f590 con 0x7f99940fc7f0 2024-02-22T00:41:49.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.660+0000 7f998a7fc700 1 -- 172.21.15.49:0/120973524 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f999001d670 con 0x7f99940fc7f0 2024-02-22T00:41:49.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.660+0000 7f998a7fc700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998006caa0 0x7f998006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:49.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.660+0000 7f998a7fc700 1 -- 172.21.15.49:0/120973524 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f999008cf80 con 0x7f99940fc7f0 2024-02-22T00:41:49.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.660+0000 7f9998a74700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998006caa0 0x7f998006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:49.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.661+0000 7f9998a74700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998006caa0 0x7f998006ef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9994108840 tx=0x7f998400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:49.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.665+0000 7f998a7fc700 1 -- 172.21.15.49:0/120973524 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f999005ab80 con 0x7f99940fc7f0 2024-02-22T00:41:49.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.911+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f99940feb40 con 0x7f99940fc7f0 2024-02-22T00:41:49.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.911+0000 7f998a7fc700 1 -- 172.21.15.49:0/120973524 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f999005a710 con 0x7f99940fc7f0 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:41:49.914 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:41:49.915 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:41:49.916 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:41:49.917 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:41:49.917 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:41:49.917 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:41:49.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998006caa0 msgr2=0x7f998006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998006caa0 0x7f998006ef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9994108840 tx=0x7f998400b040).stop 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 msgr2=0x7f999410cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 0x7f999410cf00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f9990005010 tx=0x7f9990009cb0).stop 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 shutdown_connections 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f998006caa0 0x7f998006ef60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99940fc7f0 0x7f999410cf00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 --2- 172.21.15.49:0/120973524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99940fd150 0x7f999410d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 >> 172.21.15.49:0/120973524 conn(0x7f9994070590 msgr2=0x7f99940fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 shutdown_connections 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:49.913+0000 7f999b4d9700 1 -- 172.21.15.49:0/120973524 wait complete. 2024-02-22T00:41:49.918 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:41:50.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.017+0000 7fdfb72e6700 1 -- 172.21.15.49:0/2400806659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 msgr2=0x7fdfb0101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:50.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.017+0000 7fdfb72e6700 1 --2- 172.21.15.49:0/2400806659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 0x7fdfb0101910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fdfac0047f0 tx=0x7fdfac009cb0).stop 2024-02-22T00:41:50.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.017+0000 7fdfb72e6700 1 -- 172.21.15.49:0/2400806659 shutdown_connections 2024-02-22T00:41:50.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.017+0000 7fdfb72e6700 1 --2- 172.21.15.49:0/2400806659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 0x7fdfb0101910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.017+0000 7fdfb72e6700 1 --2- 172.21.15.49:0/2400806659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfb00f88a0 0x7fdfb00f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.017+0000 7fdfb72e6700 1 -- 172.21.15.49:0/2400806659 >> 172.21.15.49:0/2400806659 conn(0x7fdfb0070590 msgr2=0x7fdfb00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:50.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.017+0000 7fdfb72e6700 1 -- 172.21.15.49:0/2400806659 shutdown_connections 2024-02-22T00:41:50.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.017+0000 7fdfb72e6700 1 -- 172.21.15.49:0/2400806659 wait complete. 2024-02-22T00:41:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb72e6700 1 Processor -- start 2024-02-22T00:41:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb72e6700 1 -- start start 2024-02-22T00:41:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb72e6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfb00f88a0 0x7fdfb010e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:50.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb72e6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 0x7fdfb010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb72e6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb010eb80 con 0x7fdfb00f9200 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb72e6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb010ecc0 con 0x7fdfb00f88a0 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb4881700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 0x7fdfb010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb4881700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 0x7fdfb010e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42688/0 (socket says 172.21.15.49:42688) 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb4881700 1 -- 172.21.15.49:0/1171716584 learned_addr learned my addr 172.21.15.49:0/1171716584 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.018+0000 7fdfb5082700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfb00f88a0 0x7fdfb010e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfb4881700 1 -- 172.21.15.49:0/1171716584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfb00f88a0 msgr2=0x7fdfb010e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfb4881700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfb00f88a0 0x7fdfb010e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfb4881700 1 -- 172.21.15.49:0/1171716584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac005040 con 0x7fdfb00f9200 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfb4881700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 0x7fdfb010e580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdfac0043a0 tx=0x7fdfac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfa6777700 1 -- 172.21.15.49:0/1171716584 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfac00e030 con 0x7fdfb00f9200 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb01082f0 con 0x7fdfb00f9200 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfa6777700 1 -- 172.21.15.49:0/1171716584 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdfac007e90 con 0x7fdfb00f9200 2024-02-22T00:41:50.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfa6777700 1 -- 172.21.15.49:0/1171716584 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfac018070 con 0x7fdfb00f9200 2024-02-22T00:41:50.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.019+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb01087d0 con 0x7fdfb00f9200 2024-02-22T00:41:50.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.020+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb005f590 con 0x7fdfb00f9200 2024-02-22T00:41:50.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.020+0000 7fdfa6777700 1 -- 172.21.15.49:0/1171716584 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdfac0094c0 con 0x7fdfb00f9200 2024-02-22T00:41:50.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.021+0000 7fdfa6777700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdf9c06cab0 0x7fdf9c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:50.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.021+0000 7fdfa6777700 1 -- 172.21.15.49:0/1171716584 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fdfac08cf50 con 0x7fdfb00f9200 2024-02-22T00:41:50.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.021+0000 7fdfb5082700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdf9c06cab0 0x7fdf9c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:50.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.021+0000 7fdfb5082700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdf9c06cab0 0x7fdf9c06ef70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fdfa0004de0 tx=0x7fdfa000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:50.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.026+0000 7fdfa6777700 1 -- 172.21.15.49:0/1171716584 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdfac0c0190 con 0x7fdfb00f9200 2024-02-22T00:41:50.043 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:49 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T00:41:49.846+0000 7f8c7854d640 -1 osd.4 68 log_to_monitors true 2024-02-22T00:41:50.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.244+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfb0109820 con 0x7fdf9c06cab0 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.245+0000 7fdfa6777700 1 -- 172.21.15.49:0/1171716584 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdfb0109820 con 0x7fdf9c06cab0 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:41:50.247 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "11/21 daemons upgraded", 2024-02-22T00:41:50.248 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-02-22T00:41:50.248 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:41:50.248 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdf9c06cab0 msgr2=0x7fdf9c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdf9c06cab0 0x7fdf9c06ef70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fdfa0004de0 tx=0x7fdfa000b040).stop 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 msgr2=0x7fdfb010e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 0x7fdfb010e580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdfac0043a0 tx=0x7fdfac009cb0).stop 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 shutdown_connections 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdf9c06cab0 0x7fdf9c06ef70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfb00f88a0 0x7fdfb010e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 --2- 172.21.15.49:0/1171716584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdfb00f9200 0x7fdfb010e580 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 >> 172.21.15.49:0/1171716584 conn(0x7fdfb0070590 msgr2=0x7fdfb00fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 shutdown_connections 2024-02-22T00:41:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.247+0000 7fdfb72e6700 1 -- 172.21.15.49:0/1171716584 wait complete. 2024-02-22T00:41:50.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.349+0000 7f702c919700 1 -- 172.21.15.49:0/3794542937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fe250 msgr2=0x7f70280f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:50.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.349+0000 7f702c919700 1 --2- 172.21.15.49:0/3794542937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fe250 0x7f70280f7a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f70180047f0 tx=0x7f7018009cb0).stop 2024-02-22T00:41:50.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.349+0000 7f702c919700 1 -- 172.21.15.49:0/3794542937 shutdown_connections 2024-02-22T00:41:50.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.349+0000 7f702c919700 1 --2- 172.21.15.49:0/3794542937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fe250 0x7f70280f7a30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.349+0000 7f702c919700 1 --2- 172.21.15.49:0/3794542937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70280fd8f0 0x7f70280fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.349+0000 7f702c919700 1 -- 172.21.15.49:0/3794542937 >> 172.21.15.49:0/3794542937 conn(0x7f70280f34b0 msgr2=0x7f70280f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:50.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.349+0000 7f702c919700 1 -- 172.21.15.49:0/3794542937 shutdown_connections 2024-02-22T00:41:50.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.349+0000 7f702c919700 1 -- 172.21.15.49:0/3794542937 wait complete. 2024-02-22T00:41:50.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702c919700 1 Processor -- start 2024-02-22T00:41:50.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702c919700 1 -- start start 2024-02-22T00:41:50.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702c919700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fd8f0 0x7f7028110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702c919700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70280fe250 0x7f7028110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702c919700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7028110d60 con 0x7f70280fd8f0 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702c919700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7028110ea0 con 0x7f70280fe250 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fd8f0 0x7f7028110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fd8f0 0x7f7028110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42700/0 (socket says 172.21.15.49:42700) 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702659c700 1 -- 172.21.15.49:0/3017402470 learned_addr learned my addr 172.21.15.49:0/3017402470 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702659c700 1 -- 172.21.15.49:0/3017402470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70280fe250 msgr2=0x7f7028110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702659c700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70280fe250 0x7f7028110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702659c700 1 -- 172.21.15.49:0/3017402470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018005040 con 0x7f70280fd8f0 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.350+0000 7f702659c700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fd8f0 0x7f7028110270 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f701c0041d0 tx=0x7f701c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.351+0000 7f70177fe700 1 -- 172.21.15.49:0/3017402470 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701c002d90 con 0x7f70280fd8f0 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.351+0000 7f70177fe700 1 -- 172.21.15.49:0/3017402470 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f701c00f040 con 0x7f70280fd8f0 2024-02-22T00:41:50.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.351+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702810a530 con 0x7f70280fd8f0 2024-02-22T00:41:50.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.351+0000 7f70177fe700 1 -- 172.21.15.49:0/3017402470 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701c00d800 con 0x7f70280fd8f0 2024-02-22T00:41:50.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.351+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702810aa70 con 0x7f70280fd8f0 2024-02-22T00:41:50.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.352+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702805f590 con 0x7f70280fd8f0 2024-02-22T00:41:50.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.352+0000 7f70177fe700 1 -- 172.21.15.49:0/3017402470 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f701c00dae0 con 0x7f70280fd8f0 2024-02-22T00:41:50.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.353+0000 7f70177fe700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f701006caa0 0x7f701006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:41:50.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.353+0000 7f70177fe700 1 -- 172.21.15.49:0/3017402470 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f701c08bd30 con 0x7f70280fd8f0 2024-02-22T00:41:50.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.353+0000 7f7025d9b700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f701006caa0 0x7f701006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:41:50.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.353+0000 7f7025d9b700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f701006caa0 0x7f701006ef60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f702810bbb0 tx=0x7f7018009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:41:50.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.357+0000 7f70177fe700 1 -- 172.21.15.49:0/3017402470 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f701c059930 con 0x7f70280fd8f0 2024-02-22T00:41:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: pgmap v133: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2360420770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='osd.4 [v2:172.21.15.161:6808/520056397,v1:172.21.15.161:6809/520056397]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-22T00:41:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:50 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/120973524' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:41:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: pgmap v133: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2360420770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='osd.4 [v2:172.21.15.161:6808/520056397,v1:172.21.15.161:6809/520056397]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:41:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-22T00:41:50.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/120973524' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:41:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.638+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f70280fca70 con 0x7f70280fd8f0 2024-02-22T00:41:50.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.639+0000 7f70177fe700 1 -- 172.21.15.49:0/3017402470 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1162 (secure 0 0 0) 0x7f701c0594c0 con 0x7f70280fd8f0 2024-02-22T00:41:50.641 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 54/321 objects degraded (16.822%), 16 pgs degraded 2024-02-22T00:41:50.641 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-22T00:41:50.641 INFO:teuthology.orchestra.run.smithi049.stdout: osd.4 (root=default,host=smithi161) is down 2024-02-22T00:41:50.641 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/321 objects degraded (16.822%), 16 pgs degraded 2024-02-22T00:41:50.641 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-02-22T00:41:50.642 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-02-22T00:41:50.643 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-22T00:41:50.643 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-02-22T00:41:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f701006caa0 msgr2=0x7f701006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f701006caa0 0x7f701006ef60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f702810bbb0 tx=0x7f7018009cb0).stop 2024-02-22T00:41:50.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fd8f0 msgr2=0x7f7028110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:41:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fd8f0 0x7f7028110270 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f701c0041d0 tx=0x7f701c009f60).stop 2024-02-22T00:41:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 shutdown_connections 2024-02-22T00:41:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f701006caa0 0x7f701006ef60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70280fd8f0 0x7f7028110270 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:41:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 --2- 172.21.15.49:0/3017402470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70280fe250 0x7f7028110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:41:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 >> 172.21.15.49:0/3017402470 conn(0x7f70280f34b0 msgr2=0x7f702806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:41:50.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 shutdown_connections 2024-02-22T00:41:50.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:41:50.641+0000 7f702c919700 1 -- 172.21.15.49:0/3017402470 wait complete. 2024-02-22T00:41:51.043 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 00:41:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T00:41:50.748+0000 7f8c681a3700 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:41:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:51 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-22T00:41:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:51 smithi049 ceph-mon[132694]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-22T00:41:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:51 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3017402470' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:41:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:51 smithi049 ceph-mon[132694]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T00:41:51.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:51 smithi049 ceph-mon[132694]: osdmap e71: 6 total, 5 up, 6 in 2024-02-22T00:41:51.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:51 smithi049 ceph-mon[132694]: from='osd.4 [v2:172.21.15.161:6808/520056397,v1:172.21.15.161:6809/520056397]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:41:51.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:51 smithi049 ceph-mon[132694]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:41:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:51 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-22T00:41:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:51 smithi161 ceph-mon[113442]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-22T00:41:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:51 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3017402470' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:41:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:51 smithi161 ceph-mon[113442]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T00:41:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:51 smithi161 ceph-mon[113442]: osdmap e71: 6 total, 5 up, 6 in 2024-02-22T00:41:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:51 smithi161 ceph-mon[113442]: from='osd.4 [v2:172.21.15.161:6808/520056397,v1:172.21.15.161:6809/520056397]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:41:51.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:51 smithi161 ceph-mon[113442]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:41:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:52 smithi049 ceph-mon[132694]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:52 smithi049 ceph-mon[132694]: pgmap v134: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:52 smithi049 ceph-mon[132694]: failed to encode map e71 with expected crc 2024-02-22T00:41:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:52 smithi049 ceph-mon[132694]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:41:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:52 smithi049 ceph-mon[132694]: osd.4 [v2:172.21.15.161:6808/520056397,v1:172.21.15.161:6809/520056397] boot 2024-02-22T00:41:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:52 smithi049 ceph-mon[132694]: osdmap e72: 6 total, 6 up, 6 in 2024-02-22T00:41:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:52 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:41:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:52 smithi161 ceph-mon[113442]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:41:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:52 smithi161 ceph-mon[113442]: pgmap v134: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:52 smithi161 ceph-mon[113442]: failed to encode map e71 with expected crc 2024-02-22T00:41:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:52 smithi161 ceph-mon[113442]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:41:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:52 smithi161 ceph-mon[113442]: osd.4 [v2:172.21.15.161:6808/520056397,v1:172.21.15.161:6809/520056397] boot 2024-02-22T00:41:52.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:52 smithi161 ceph-mon[113442]: osdmap e72: 6 total, 6 up, 6 in 2024-02-22T00:41:52.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:52 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T00:41:53.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:53 smithi049 ceph-mon[132694]: failed to encode map e72 with expected crc 2024-02-22T00:41:53.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:53 smithi049 ceph-mon[132694]: failed to encode map e72 with expected crc 2024-02-22T00:41:53.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:53 smithi049 ceph-mon[132694]: osdmap e73: 6 total, 6 up, 6 in 2024-02-22T00:41:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:53 smithi161 ceph-mon[113442]: failed to encode map e72 with expected crc 2024-02-22T00:41:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:53 smithi161 ceph-mon[113442]: failed to encode map e72 with expected crc 2024-02-22T00:41:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:53 smithi161 ceph-mon[113442]: osdmap e73: 6 total, 6 up, 6 in 2024-02-22T00:41:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:54 smithi049 ceph-mon[132694]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:54 smithi049 ceph-mon[132694]: failed to encode map e73 with expected crc 2024-02-22T00:41:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:54 smithi049 ceph-mon[132694]: failed to encode map e73 with expected crc 2024-02-22T00:41:54.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:54 smithi049 ceph-mon[132694]: failed to encode map e73 with expected crc 2024-02-22T00:41:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:54 smithi161 ceph-mon[113442]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-02-22T00:41:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:54 smithi161 ceph-mon[113442]: failed to encode map e73 with expected crc 2024-02-22T00:41:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:54 smithi161 ceph-mon[113442]: failed to encode map e73 with expected crc 2024-02-22T00:41:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:54 smithi161 ceph-mon[113442]: failed to encode map e73 with expected crc 2024-02-22T00:41:56.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:55 smithi161 ceph-mon[113442]: pgmap v139: 65 pgs: 10 active+undersized+degraded, 10 active+undersized, 45 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/321 objects degraded (8.723%) 2024-02-22T00:41:56.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:55 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 28/321 objects degraded (8.723%), 10 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:55 smithi049 ceph-mon[132694]: pgmap v139: 65 pgs: 10 active+undersized+degraded, 10 active+undersized, 45 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/321 objects degraded (8.723%) 2024-02-22T00:41:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:55 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 28/321 objects degraded (8.723%), 10 pgs degraded (PG_DEGRADED) 2024-02-22T00:41:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:57 smithi161 ceph-mon[113442]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/321 objects degraded (8.723%), 10 pgs degraded) 2024-02-22T00:41:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:57 smithi161 ceph-mon[113442]: Cluster is now healthy 2024-02-22T00:41:57.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:57 smithi049 ceph-mon[132694]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/321 objects degraded (8.723%), 10 pgs degraded) 2024-02-22T00:41:57.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:57 smithi049 ceph-mon[132694]: Cluster is now healthy 2024-02-22T00:41:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:58 smithi161 ceph-mon[113442]: pgmap v140: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:58.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:41:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:41:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:58 smithi049 ceph-mon[132694]: pgmap v140: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:41:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:41:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:41:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:00 smithi161 ceph-mon[113442]: pgmap v141: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:00 smithi049 ceph-mon[132694]: pgmap v141: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:02.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:02 smithi049 ceph-mon[132694]: pgmap v142: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:02.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:02 smithi161 ceph-mon[113442]: pgmap v142: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:03.796 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:03 smithi161 ceph-mon[113442]: pgmap v143: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:03.797 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:03 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:03 smithi049 ceph-mon[132694]: pgmap v143: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:03 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:05.708 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:05 smithi161 ceph-mon[113442]: pgmap v144: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:05.708 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:05 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-22T00:42:05.708 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:05 smithi161 ceph-mon[113442]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-22T00:42:05.708 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:05 smithi161 ceph-mon[113442]: Upgrade: osd.5 is safe to restart 2024-02-22T00:42:05.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:05 smithi049 ceph-mon[132694]: pgmap v144: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:05.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:05 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-22T00:42:05.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:05 smithi049 ceph-mon[132694]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-22T00:42:05.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:05 smithi049 ceph-mon[132694]: Upgrade: osd.5 is safe to restart 2024-02-22T00:42:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:07 smithi161 ceph-mon[113442]: pgmap v145: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:07.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:07 smithi161 ceph-mon[113442]: Upgrade: Updating osd.5 2024-02-22T00:42:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:07 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:07 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T00:42:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:07 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:07.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:07 smithi161 ceph-mon[113442]: Deploying daemon osd.5 on smithi161 2024-02-22T00:42:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:07 smithi049 ceph-mon[132694]: pgmap v145: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:07 smithi049 ceph-mon[132694]: Upgrade: Updating osd.5 2024-02-22T00:42:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:07 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:07 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T00:42:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:07 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:07.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:07 smithi049 ceph-mon[132694]: Deploying daemon osd.5 on smithi161 2024-02-22T00:42:09.614 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:09 smithi161 ceph-mon[113442]: pgmap v146: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:09.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:09 smithi049 ceph-mon[132694]: pgmap v146: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:10.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:09 smithi161 systemd[1]: Stopping Ceph osd.5 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:42:10.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[87416]: debug 2024-02-22T00:42:09.848+0000 7fbea8207700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T00:42:10.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[87416]: debug 2024-02-22T00:42:09.848+0000 7fbea8207700 -1 osd.5 73 *** Got signal Terminated *** 2024-02-22T00:42:10.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[87416]: debug 2024-02-22T00:42:09.848+0000 7fbea8207700 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T00:42:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:10 smithi161 ceph-mon[113442]: osd.5 marked itself down and dead 2024-02-22T00:42:10.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:10 smithi049 ceph-mon[132694]: osd.5 marked itself down and dead 2024-02-22T00:42:11.293 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:10 smithi161 bash[138774]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5 2024-02-22T00:42:11.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:11 smithi161 ceph-mon[113442]: pgmap v147: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:11.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:11 smithi161 ceph-mon[113442]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:42:11.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:11 smithi161 ceph-mon[113442]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2024-02-22T00:42:11.732 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:11 smithi161 ceph-mon[113442]: osdmap e74: 6 total, 5 up, 6 in 2024-02-22T00:42:11.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:11 smithi049 ceph-mon[132694]: pgmap v147: 65 pgs: 65 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:11.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:11 smithi049 ceph-mon[132694]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T00:42:11.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:11 smithi049 ceph-mon[132694]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2024-02-22T00:42:11.769 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:11 smithi049 ceph-mon[132694]: osdmap e74: 6 total, 5 up, 6 in 2024-02-22T00:42:12.754 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:12 smithi161 ceph-mon[113442]: osdmap e75: 6 total, 5 up, 6 in 2024-02-22T00:42:12.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:12 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:12.755 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:12 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:12.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:12 smithi049 ceph-mon[132694]: osdmap e75: 6 total, 5 up, 6 in 2024-02-22T00:42:12.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:12 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:12.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:12 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:13.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:12 smithi161 systemd[1]: ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.5.service: Succeeded. 2024-02-22T00:42:13.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:12 smithi161 systemd[1]: Stopped Ceph osd.5 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:42:13.043 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:12 smithi161 systemd[1]: Starting Ceph osd.5 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T00:42:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:13 smithi161 ceph-mon[113442]: pgmap v150: 65 pgs: 10 peering, 7 stale+active+clean, 48 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:13 smithi161 ceph-mon[113442]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-02-22T00:42:13.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:13 smithi049 ceph-mon[132694]: pgmap v150: 65 pgs: 10 peering, 7 stale+active+clean, 48 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:13.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:13 smithi049 ceph-mon[132694]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-02-22T00:42:14.125 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:13 smithi161 bash[139051]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-22T00:42:14.125 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:13 smithi161 bash[139051]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-22T00:42:14.126 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:13 smithi161 bash[139051]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-22T00:42:14.126 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:13 smithi161 bash[139051]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-22T00:42:14.126 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:13 smithi161 bash[139051]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-22T00:42:14.126 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:13 smithi161 bash[139051]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-22T00:42:14.126 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:13 smithi161 bash[139051]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-22T00:42:14.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:14 smithi161 ceph-mon[113442]: Health check failed: Degraded data redundancy: 29/321 objects degraded (9.034%), 6 pgs degraded (PG_DEGRADED) 2024-02-22T00:42:14.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:14 smithi049 ceph-mon[132694]: Health check failed: Degraded data redundancy: 29/321 objects degraded (9.034%), 6 pgs degraded (PG_DEGRADED) 2024-02-22T00:42:15.293 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:14 smithi161 ceph-osd[139348]: -- 172.21.15.161:0/2130662136 <== mon.1 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557de82884e0 con 0x557de8258c00 2024-02-22T00:42:15.293 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:15 smithi161 bash[139311]: 7c718ce3ecdcac930807c8f63be6cec47a1b2b8ac0c4c460a898443b0ea57e77 2024-02-22T00:42:15.293 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:15 smithi161 systemd[1]: Started Ceph osd.5 for 9923b37e-d118-11ee-95bd-87774f69a715. 2024-02-22T00:42:15.793 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:15 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T00:42:15.485+0000 7f003d937640 -1 Falling back to public interface 2024-02-22T00:42:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:16 smithi049 ceph-mon[132694]: pgmap v151: 65 pgs: 6 active+undersized+degraded, 10 peering, 4 stale+active+clean, 4 active+undersized, 41 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29/321 objects degraded (9.034%) 2024-02-22T00:42:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:16 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:16 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:16 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:16 smithi161 ceph-mon[113442]: pgmap v151: 65 pgs: 6 active+undersized+degraded, 10 peering, 4 stale+active+clean, 4 active+undersized, 41 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 29/321 objects degraded (9.034%) 2024-02-22T00:42:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:16 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:16 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:16.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:16 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:17.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:17 smithi049 ceph-mon[132694]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2024-02-22T00:42:17.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:17 smithi161 ceph-mon[113442]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2024-02-22T00:42:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:18 smithi049 ceph-mon[132694]: pgmap v152: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-02-22T00:42:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:18 smithi161 ceph-mon[113442]: pgmap v152: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-02-22T00:42:20.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:19 smithi161 ceph-mon[113442]: pgmap v153: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-02-22T00:42:20.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:20.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:20.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:20.044 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:20.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:19 smithi049 ceph-mon[132694]: pgmap v153: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-02-22T00:42:20.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:20.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:20.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:20.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:20.543 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T00:42:20.352+0000 7f003d937640 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-22T00:42:20.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.757+0000 7f9bda9ce700 1 -- 172.21.15.49:0/2997412304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fd8f0 msgr2=0x7f9bd40fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:20.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.757+0000 7f9bda9ce700 1 --2- 172.21.15.49:0/2997412304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fd8f0 0x7f9bd40fdcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f9bc40047f0 tx=0x7f9bc4009cb0).stop 2024-02-22T00:42:20.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.758+0000 7f9bda9ce700 1 -- 172.21.15.49:0/2997412304 shutdown_connections 2024-02-22T00:42:20.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.758+0000 7f9bda9ce700 1 --2- 172.21.15.49:0/2997412304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40fe250 0x7f9bd40f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:20.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.758+0000 7f9bda9ce700 1 --2- 172.21.15.49:0/2997412304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fd8f0 0x7f9bd40fdcd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:20.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.758+0000 7f9bda9ce700 1 -- 172.21.15.49:0/2997412304 >> 172.21.15.49:0/2997412304 conn(0x7f9bd40f34b0 msgr2=0x7f9bd40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:20.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.758+0000 7f9bda9ce700 1 -- 172.21.15.49:0/2997412304 shutdown_connections 2024-02-22T00:42:20.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.758+0000 7f9bda9ce700 1 -- 172.21.15.49:0/2997412304 wait complete. 2024-02-22T00:42:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.758+0000 7f9bda9ce700 1 Processor -- start 2024-02-22T00:42:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.758+0000 7f9bda9ce700 1 -- start start 2024-02-22T00:42:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bda9ce700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40fd8f0 0x7f9bd406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bda9ce700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fe250 0x7f9bd406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:20.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bda9ce700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd406b610 con 0x7f9bd40fe250 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bda9ce700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd406b750 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fe250 0x7f9bd406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fe250 0x7f9bd406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55424/0 (socket says 172.21.15.49:55424) 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd3fff700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40fd8f0 0x7f9bd406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd37fe700 1 -- 172.21.15.49:0/818614441 learned_addr learned my addr 172.21.15.49:0/818614441 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd3fff700 1 -- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fe250 msgr2=0x7f9bd406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd3fff700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fe250 0x7f9bd406b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd3fff700 1 -- 172.21.15.49:0/818614441 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8005040 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd37fe700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fe250 0x7f9bd406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.759+0000 7f9bd3fff700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40fd8f0 0x7f9bd406cb30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9bc4000c00 tx=0x7f9bc4009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.760+0000 7f9bd17fa700 1 -- 172.21.15.49:0/818614441 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc4018070 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.760+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc4005040 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.760+0000 7f9bd17fa700 1 -- 172.21.15.49:0/818614441 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9bc4007e90 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.760+0000 7f9bd17fa700 1 -- 172.21.15.49:0/818614441 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bc40123c0 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.760+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd406bd20 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.761+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd405f590 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.761+0000 7f9bd17fa700 1 -- 172.21.15.49:0/818614441 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9bc401d420 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.762+0000 7f9bd17fa700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:20.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.762+0000 7f9bd17fa700 1 -- 172.21.15.49:0/818614441 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f9bc408c980 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.762+0000 7f9bd37fe700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:20.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.762+0000 7f9bd37fe700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f9bd406c870 tx=0x7f9bc800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:20.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.771+0000 7f9bd17fa700 1 -- 172.21.15.49:0/818614441 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9bc405a640 con 0x7f9bd40fd8f0 2024-02-22T00:42:20.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.989+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bd406c600 con 0x7f9bbc06caa0 2024-02-22T00:42:20.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.990+0000 7f9bd17fa700 1 -- 172.21.15.49:0/818614441 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9bd406c600 con 0x7f9bbc06caa0 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.992+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9bbc06caa0 msgr2=0x7f9bbc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.992+0000 7f9bda9ce700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f9bd406c870 tx=0x7f9bc800b040).stop 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.992+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40fd8f0 msgr2=0x7f9bd406cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.992+0000 7f9bda9ce700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40fd8f0 0x7f9bd406cb30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9bc4000c00 tx=0x7f9bc4009cb0).stop 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.993+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 shutdown_connections 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.993+0000 7f9bda9ce700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9bbc06caa0 0x7f9bbc06ef60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.993+0000 7f9bda9ce700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40fd8f0 0x7f9bd406cb30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.993+0000 7f9bda9ce700 1 --2- 172.21.15.49:0/818614441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9bd40fe250 0x7f9bd406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.993+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 >> 172.21.15.49:0/818614441 conn(0x7f9bd40f34b0 msgr2=0x7f9bd40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.993+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 shutdown_connections 2024-02-22T00:42:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:20.993+0000 7f9bda9ce700 1 -- 172.21.15.49:0/818614441 wait complete. 2024-02-22T00:42:21.005 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:42:21.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:20 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 49/321 objects degraded (15.265%), 14 pgs degraded (PG_DEGRADED) 2024-02-22T00:42:21.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:20 smithi161 ceph-mon[113442]: from='osd.5 [v2:172.21.15.161:6816/3112518053,v1:172.21.15.161:6817/3112518053]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T00:42:21.044 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T00:42:20.772+0000 7f003d937640 -1 osd.5 73 log_to_monitors true 2024-02-22T00:42:21.044 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 00:42:20 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T00:42:20.978+0000 7f002cd8c700 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T00:42:21.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 -- 172.21.15.49:0/164471578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 msgr2=0x7f54c40f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 --2- 172.21.15.49:0/164471578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 0x7f54c40f8c80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f54b40047f0 tx=0x7f54b4009cb0).stop 2024-02-22T00:42:21.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 -- 172.21.15.49:0/164471578 shutdown_connections 2024-02-22T00:42:21.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 --2- 172.21.15.49:0/164471578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c40f9200 0x7f54c4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 --2- 172.21.15.49:0/164471578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 0x7f54c40f8c80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 -- 172.21.15.49:0/164471578 >> 172.21.15.49:0/164471578 conn(0x7f54c4070590 msgr2=0x7f54c40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:21.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 -- 172.21.15.49:0/164471578 shutdown_connections 2024-02-22T00:42:21.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 -- 172.21.15.49:0/164471578 wait complete. 2024-02-22T00:42:21.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 Processor -- start 2024-02-22T00:42:21.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.095+0000 7f54ca721700 1 -- start start 2024-02-22T00:42:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54ca721700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 0x7f54c410e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54ca721700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c40f9200 0x7f54c410e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54ca721700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c410eb10 con 0x7f54c40f88a0 2024-02-22T00:42:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54ca721700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c410ec50 con 0x7f54c40f9200 2024-02-22T00:42:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 0x7f54c410e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54c3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 0x7f54c410e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55450/0 (socket says 172.21.15.49:55450) 2024-02-22T00:42:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54c3fff700 1 -- 172.21.15.49:0/1903030523 learned_addr learned my addr 172.21.15.49:0/1903030523 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54c37fe700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c40f9200 0x7f54c410e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54c3fff700 1 -- 172.21.15.49:0/1903030523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c40f9200 msgr2=0x7f54c410e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54c3fff700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c40f9200 0x7f54c410e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54c3fff700 1 -- 172.21.15.49:0/1903030523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4005040 con 0x7f54c40f88a0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.096+0000 7f54c3fff700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 0x7f54c410e020 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f54b4005010 tx=0x7f54b4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.097+0000 7f54c17fa700 1 -- 172.21.15.49:0/1903030523 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b400e030 con 0x7f54c40f88a0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.097+0000 7f54c17fa700 1 -- 172.21.15.49:0/1903030523 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54b4007e90 con 0x7f54c40f88a0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.097+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c4108280 con 0x7f54c40f88a0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.097+0000 7f54c17fa700 1 -- 172.21.15.49:0/1903030523 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54b4018070 con 0x7f54c40f88a0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.097+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c4108760 con 0x7f54c40f88a0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.098+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c405f590 con 0x7f54c40f88a0 2024-02-22T00:42:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.098+0000 7f54c17fa700 1 -- 172.21.15.49:0/1903030523 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f54b401d670 con 0x7f54c40f88a0 2024-02-22T00:42:21.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.098+0000 7f54c17fa700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54b006caa0 0x7f54b006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.099+0000 7f54c17fa700 1 -- 172.21.15.49:0/1903030523 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f54b408cf30 con 0x7f54c40f88a0 2024-02-22T00:42:21.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.099+0000 7f54c37fe700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54b006caa0 0x7f54b006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.099+0000 7f54c37fe700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54b006caa0 0x7f54b006ef60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f54c4109960 tx=0x7f54ac00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.104+0000 7f54c17fa700 1 -- 172.21.15.49:0/1903030523 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f54b40c0190 con 0x7f54c40f88a0 2024-02-22T00:42:21.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:20 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 49/321 objects degraded (15.265%), 14 pgs degraded (PG_DEGRADED) 2024-02-22T00:42:21.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:20 smithi049 ceph-mon[132694]: from='osd.5 [v2:172.21.15.161:6816/3112518053,v1:172.21.15.161:6817/3112518053]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T00:42:21.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.320+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54c40fedd0 con 0x7f54b006caa0 2024-02-22T00:42:21.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.321+0000 7f54c17fa700 1 -- 172.21.15.49:0/1903030523 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f54c40fedd0 con 0x7f54b006caa0 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54b006caa0 msgr2=0x7f54b006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54b006caa0 0x7f54b006ef60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f54c4109960 tx=0x7f54ac00b040).stop 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 msgr2=0x7f54c410e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 0x7f54c410e020 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f54b4005010 tx=0x7f54b4009cb0).stop 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 shutdown_connections 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f54b006caa0 0x7f54b006ef60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54c40f88a0 0x7f54c410e020 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 --2- 172.21.15.49:0/1903030523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54c40f9200 0x7f54c410e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 >> 172.21.15.49:0/1903030523 conn(0x7f54c4070590 msgr2=0x7f54c40fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:21.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 shutdown_connections 2024-02-22T00:42:21.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.324+0000 7f54ca721700 1 -- 172.21.15.49:0/1903030523 wait complete. 2024-02-22T00:42:21.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.425+0000 7f339a183700 1 -- 172.21.15.49:0/1520628689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 msgr2=0x7f33940f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.425+0000 7f339a183700 1 --2- 172.21.15.49:0/1520628689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 0x7f33940f8ce0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f337c0047f0 tx=0x7f337c009cb0).stop 2024-02-22T00:42:21.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.425+0000 7f339a183700 1 -- 172.21.15.49:0/1520628689 shutdown_connections 2024-02-22T00:42:21.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.425+0000 7f339a183700 1 --2- 172.21.15.49:0/1520628689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33940f9260 0x7f3394101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:42:21.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.425+0000 7f339a183700 1 --2- 172.21.15.49:0/1520628689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 0x7f33940f8ce0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.425+0000 7f339a183700 1 -- 172.21.15.49:0/1520628689 >> 172.21.15.49:0/1520628689 conn(0x7f3394070590 msgr2=0x7f33940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:21.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.425+0000 7f339a183700 1 -- 172.21.15.49:0/1520628689 shutdown_connections 2024-02-22T00:42:21.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.425+0000 7f339a183700 1 -- 172.21.15.49:0/1520628689 wait complete. 2024-02-22T00:42:21.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f339a183700 1 Processor -- start 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f339a183700 1 -- start start 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f339a183700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 0x7f339410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f339a183700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33940f9260 0x7f339410e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f339a183700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339410ebc0 con 0x7f33940f8900 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f339a183700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33941081e0 con 0x7f33940f9260 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f33937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 0x7f339410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f33937fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 0x7f339410e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55470/0 (socket says 172.21.15.49:55470) 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.426+0000 7f33937fe700 1 -- 172.21.15.49:0/1482640069 learned_addr learned my addr 172.21.15.49:0/1482640069 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f3392ffd700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33940f9260 0x7f339410e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f33937fe700 1 -- 172.21.15.49:0/1482640069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33940f9260 msgr2=0x7f339410e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f33937fe700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33940f9260 0x7f339410e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f33937fe700 1 -- 172.21.15.49:0/1482640069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c005040 con 0x7f33940f8900 2024-02-22T00:42:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f33937fe700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 0x7f339410e040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f337c009310 tx=0x7f337c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:21.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f3390ff9700 1 -- 172.21.15.49:0/1482640069 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f337c00e030 con 0x7f33940f8900 2024-02-22T00:42:21.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f3390ff9700 1 -- 172.21.15.49:0/1482640069 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f337c007e90 con 0x7f33940f8900 2024-02-22T00:42:21.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3394108430 con 0x7f33940f8900 2024-02-22T00:42:21.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f3390ff9700 1 -- 172.21.15.49:0/1482640069 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f337c018070 con 0x7f33940f8900 2024-02-22T00:42:21.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.427+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3394108910 con 0x7f33940f8900 2024-02-22T00:42:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.428+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339405f590 con 0x7f33940f8900 2024-02-22T00:42:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.428+0000 7f3390ff9700 1 -- 172.21.15.49:0/1482640069 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f337c01d420 con 0x7f33940f8900 2024-02-22T00:42:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.429+0000 7f3390ff9700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f338006caa0 0x7f338006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.429+0000 7f3390ff9700 1 -- 172.21.15.49:0/1482640069 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f337c08d240 con 0x7f33940f8900 2024-02-22T00:42:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.429+0000 7f3392ffd700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f338006caa0 0x7f338006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.429+0000 7f3392ffd700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f338006caa0 0x7f338006ef60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3394109980 tx=0x7f3384008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:21.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.433+0000 7f3390ff9700 1 -- 172.21.15.49:0/1482640069 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f337c05ae40 con 0x7f33940f8900 2024-02-22T00:42:21.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.642+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3394109790 con 0x7f338006caa0 2024-02-22T00:42:21.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.652+0000 7f3390ff9700 1 -- 172.21.15.49:0/1482640069 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3394109790 con 0x7f338006caa0 2024-02-22T00:42:21.654 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:42:21.654 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (5m) 102s ago 16m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:42:21.654 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (3m) 102s ago 16m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:42:21.654 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (3m) 2s ago 16m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:42:21.654 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (5m) 102s ago 16m 91.2M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:42:21.654 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (11m) 102s ago 11m 16.3M - 16.2.14-550-geb66ed92 7403d1862307 039b412226f1 2024-02-22T00:42:21.654 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (11m) 102s ago 11m 117M - 16.2.14-550-geb66ed92 7403d1862307 14ec8203e6a1 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (11m) 2s ago 11m 16.6M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (11m) 2s ago 11m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (7m) 102s ago 18m 500M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (6m) 2s ago 16m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (4m) 102s ago 18m 46.7M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (3m) 2s ago 16m 41.5M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (6m) 102s ago 16m 16.8M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 2s ago 15m 17.4M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (2m) 102s ago 15m 91.5M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (2m) 102s ago 14m 96.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (106s) 102s ago 14m 13.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (73s) 2s ago 14m 102M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (40s) 2s ago 13m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (7s) 2s ago 13m 13.1M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:42:21.655 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (5m) 2s ago 15m 61.1M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:42:21.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f338006caa0 msgr2=0x7f338006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f338006caa0 0x7f338006ef60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f3394109980 tx=0x7f3384008040).stop 2024-02-22T00:42:21.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 msgr2=0x7f339410e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 0x7f339410e040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f337c009310 tx=0x7f337c009cb0).stop 2024-02-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 shutdown_connections 2024-02-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f338006caa0 0x7f338006ef60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33940f8900 0x7f339410e040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 --2- 172.21.15.49:0/1482640069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33940f9260 0x7f339410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 >> 172.21.15.49:0/1482640069 conn(0x7f3394070590 msgr2=0x7f33940fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 shutdown_connections 2024-02-22T00:42:21.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.654+0000 7f339a183700 1 -- 172.21.15.49:0/1482640069 wait complete. 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.755+0000 7f53d66e5700 1 -- 172.21.15.49:0/3255348278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 msgr2=0x7f53d00fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.755+0000 7f53d66e5700 1 --2- 172.21.15.49:0/3255348278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 0x7f53d00fcbd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f53c00047f0 tx=0x7f53c0009cb0).stop 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.755+0000 7f53d66e5700 1 -- 172.21.15.49:0/3255348278 shutdown_connections 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.755+0000 7f53d66e5700 1 --2- 172.21.15.49:0/3255348278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00fd150 0x7f53d00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.755+0000 7f53d66e5700 1 --2- 172.21.15.49:0/3255348278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 0x7f53d00fcbd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.755+0000 7f53d66e5700 1 -- 172.21.15.49:0/3255348278 >> 172.21.15.49:0/3255348278 conn(0x7f53d0070590 msgr2=0x7f53d00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.755+0000 7f53d66e5700 1 -- 172.21.15.49:0/3255348278 shutdown_connections 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.755+0000 7f53d66e5700 1 -- 172.21.15.49:0/3255348278 wait complete. 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53d66e5700 1 Processor -- start 2024-02-22T00:42:21.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53d66e5700 1 -- start start 2024-02-22T00:42:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53d66e5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 0x7f53d010e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53d66e5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00fd150 0x7f53d010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53d66e5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d010eb80 con 0x7f53d00fc7f0 2024-02-22T00:42:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53d66e5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d010ecc0 con 0x7f53d00fd150 2024-02-22T00:42:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53cffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 0x7f53d010e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53cffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 0x7f53d010e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48194/0 (socket says 172.21.15.49:48194) 2024-02-22T00:42:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53cffff700 1 -- 172.21.15.49:0/1979130950 learned_addr learned my addr 172.21.15.49:0/1979130950 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:21.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53cf7fe700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00fd150 0x7f53d010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53cffff700 1 -- 172.21.15.49:0/1979130950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00fd150 msgr2=0x7f53d010e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53cffff700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00fd150 0x7f53d010e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.756+0000 7f53cffff700 1 -- 172.21.15.49:0/1979130950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0005040 con 0x7f53d00fc7f0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.757+0000 7f53cffff700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 0x7f53d010e090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f53c0009380 tx=0x7f53c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.757+0000 7f53cd7fa700 1 -- 172.21.15.49:0/1979130950 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53c0018070 con 0x7f53d00fc7f0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.757+0000 7f53cd7fa700 1 -- 172.21.15.49:0/1979130950 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53c0007e90 con 0x7f53d00fc7f0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.757+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d0108330 con 0x7f53d00fc7f0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.757+0000 7f53cd7fa700 1 -- 172.21.15.49:0/1979130950 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53c00123c0 con 0x7f53d00fc7f0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.757+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d0108890 con 0x7f53d00fc7f0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.758+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d005f590 con 0x7f53d00fc7f0 2024-02-22T00:42:21.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.758+0000 7f53cd7fa700 1 -- 172.21.15.49:0/1979130950 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f53c001d420 con 0x7f53d00fc7f0 2024-02-22T00:42:21.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.759+0000 7f53cd7fa700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f53b806caa0 0x7f53b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:21.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.759+0000 7f53cd7fa700 1 -- 172.21.15.49:0/1979130950 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f53c008c980 con 0x7f53d00fc7f0 2024-02-22T00:42:21.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.759+0000 7f53cf7fe700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f53b806caa0 0x7f53b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:21.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.759+0000 7f53cf7fe700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f53b806caa0 0x7f53b806ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f53c4009f20 tx=0x7f53c400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:21.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:21.763+0000 7f53cd7fa700 1 -- 172.21.15.49:0/1979130950 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f53c0056af0 con 0x7f53d00fc7f0 2024-02-22T00:42:22.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.062+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f53d0108ed0 con 0x7f53d00fc7f0 2024-02-22T00:42:22.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.063+0000 7f53cd7fa700 1 -- 172.21.15.49:0/1979130950 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7f53c005a110 con 0x7f53d00fc7f0 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:42:22.065 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:42:22.066 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4 2024-02-22T00:42:22.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:42:22.066 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:42:22.066 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 4, 2024-02-22T00:42:22.066 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 10 2024-02-22T00:42:22.066 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:42:22.066 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f53b806caa0 msgr2=0x7f53b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f53b806caa0 0x7f53b806ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f53c4009f20 tx=0x7f53c400b040).stop 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 msgr2=0x7f53d010e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 0x7f53d010e090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f53c0009380 tx=0x7f53c0009cb0).stop 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 shutdown_connections 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f53b806caa0 0x7f53b806ef60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53d00fc7f0 0x7f53d010e090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 --2- 172.21.15.49:0/1979130950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d00fd150 0x7f53d010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 >> 172.21.15.49:0/1979130950 conn(0x7f53d0070590 msgr2=0x7f53d0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 shutdown_connections 2024-02-22T00:42:22.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.065+0000 7f53d66e5700 1 -- 172.21.15.49:0/1979130950 wait complete. 2024-02-22T00:42:22.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 -- 172.21.15.49:0/239179677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f9200 msgr2=0x7fb968101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 --2- 172.21.15.49:0/239179677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f9200 0x7fb968101910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb9500047f0 tx=0x7fb950009cb0).stop 2024-02-22T00:42:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 -- 172.21.15.49:0/239179677 shutdown_connections 2024-02-22T00:42:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 --2- 172.21.15.49:0/239179677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f9200 0x7fb968101910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 --2- 172.21.15.49:0/239179677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9680f88a0 0x7fb9680f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 -- 172.21.15.49:0/239179677 >> 172.21.15.49:0/239179677 conn(0x7fb968070590 msgr2=0x7fb9680f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 -- 172.21.15.49:0/239179677 shutdown_connections 2024-02-22T00:42:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 -- 172.21.15.49:0/239179677 wait complete. 2024-02-22T00:42:22.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.167+0000 7fb96e066700 1 Processor -- start 2024-02-22T00:42:22.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb96e066700 1 -- start start 2024-02-22T00:42:22.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb96e066700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f88a0 0x7fb96810e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb96e066700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9680f9200 0x7fb96810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb96e066700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96810ecb0 con 0x7fb9680f88a0 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb96e066700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96810edf0 con 0x7fb9680f9200 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f88a0 0x7fb96810e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f88a0 0x7fb96810e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48216/0 (socket says 172.21.15.49:48216) 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb9677fe700 1 -- 172.21.15.49:0/266421906 learned_addr learned my addr 172.21.15.49:0/266421906 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb966ffd700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9680f9200 0x7fb96810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb9677fe700 1 -- 172.21.15.49:0/266421906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9680f9200 msgr2=0x7fb96810e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb9677fe700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9680f9200 0x7fb96810e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb9677fe700 1 -- 172.21.15.49:0/266421906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950005040 con 0x7fb9680f88a0 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.168+0000 7fb9677fe700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f88a0 0x7fb96810e1c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb95800e910 tx=0x7fb95800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:22.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.169+0000 7fb964ff9700 1 -- 172.21.15.49:0/266421906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb958007b40 con 0x7fb9680f88a0 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.169+0000 7fb964ff9700 1 -- 172.21.15.49:0/266421906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb95800f040 con 0x7fb9680f88a0 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.169+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb968108420 con 0x7fb9680f88a0 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.169+0000 7fb964ff9700 1 -- 172.21.15.49:0/266421906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb958014920 con 0x7fb9680f88a0 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.169+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb968108960 con 0x7fb9680f88a0 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.170+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96805f590 con 0x7fb9680f88a0 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.170+0000 7fb964ff9700 1 -- 172.21.15.49:0/266421906 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb958007ca0 con 0x7fb9680f88a0 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.170+0000 7fb964ff9700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb95406caa0 0x7fb95406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.171+0000 7fb964ff9700 1 -- 172.21.15.49:0/266421906 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6051+0+0 (secure 0 0 0) 0x7fb95808b730 con 0x7fb9680f88a0 2024-02-22T00:42:22.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.171+0000 7fb966ffd700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb95406caa0 0x7fb95406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.171+0000 7fb966ffd700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb95406caa0 0x7fb95406ef60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb968109b00 tx=0x7fb950009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:22.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.175+0000 7fb964ff9700 1 -- 172.21.15.49:0/266421906 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb958059330 con 0x7fb9680f88a0 2024-02-22T00:42:22.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:21 smithi049 ceph-mon[132694]: pgmap v154: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-02-22T00:42:22.177 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:21 smithi049 ceph-mon[132694]: from='osd.5 [v2:172.21.15.161:6816/3112518053,v1:172.21.15.161:6817/3112518053]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T00:42:22.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:21 smithi049 ceph-mon[132694]: osdmap e76: 6 total, 5 up, 6 in 2024-02-22T00:42:22.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:21 smithi049 ceph-mon[132694]: from='osd.5 [v2:172.21.15.161:6816/3112518053,v1:172.21.15.161:6817/3112518053]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:42:22.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:21 smithi049 ceph-mon[132694]: from='client.44275 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:21 smithi161 ceph-mon[113442]: pgmap v154: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 256 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-02-22T00:42:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:21 smithi161 ceph-mon[113442]: from='osd.5 [v2:172.21.15.161:6816/3112518053,v1:172.21.15.161:6817/3112518053]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T00:42:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:21 smithi161 ceph-mon[113442]: osdmap e76: 6 total, 5 up, 6 in 2024-02-22T00:42:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:21 smithi161 ceph-mon[113442]: from='osd.5 [v2:172.21.15.161:6816/3112518053,v1:172.21.15.161:6817/3112518053]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-02-22T00:42:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:21 smithi161 ceph-mon[113442]: from='client.44275 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.417+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb9681098e0 con 0x7fb9680f88a0 2024-02-22T00:42:22.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.418+0000 7fb964ff9700 1 -- 172.21.15.49:0/266421906 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7fb958055020 con 0x7fb9680f88a0 2024-02-22T00:42:22.419 INFO:teuthology.orchestra.run.smithi049.stdout:e16 2024-02-22T00:42:22.419 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:42:22.419 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:42:22.419 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:42:22.419 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:42:22.419 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 16 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:37:34.675539+0000 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-02-22T00:42:22.420 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=14438,1=24271} 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:42:22.421 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:42:22.422 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:14438} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.49:6826/502304157,v1:172.21.15.49:6827/502304157] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:42:22.422 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.161:6824/1178849707,v1:172.21.15.161:6825/1178849707] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:42:22.422 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:42:22.422 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:42:22.422 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:42:22.422 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:42:22.422 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:14450} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/657022316,v1:172.21.15.49:6829/657022316] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:42:22.422 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb95406caa0 msgr2=0x7fb95406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb95406caa0 0x7fb95406ef60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb968109b00 tx=0x7fb950009cb0).stop 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f88a0 msgr2=0x7fb96810e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f88a0 0x7fb96810e1c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb95800e910 tx=0x7fb95800b040).stop 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 shutdown_connections 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb95406caa0 0x7fb95406ef60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9680f88a0 0x7fb96810e1c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 --2- 172.21.15.49:0/266421906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9680f9200 0x7fb96810e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 >> 172.21.15.49:0/266421906 conn(0x7fb968070590 msgr2=0x7fb968100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 shutdown_connections 2024-02-22T00:42:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.420+0000 7fb96e066700 1 -- 172.21.15.49:0/266421906 wait complete. 2024-02-22T00:42:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T00:42:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.522+0000 7f45d5a72700 1 -- 172.21.15.49:0/2626376575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fd150 msgr2=0x7f45d00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.522+0000 7f45d5a72700 1 --2- 172.21.15.49:0/2626376575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fd150 0x7f45d00f6930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f45c40047f0 tx=0x7f45c4009cb0).stop 2024-02-22T00:42:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.522+0000 7f45d5a72700 1 -- 172.21.15.49:0/2626376575 shutdown_connections 2024-02-22T00:42:22.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.522+0000 7f45d5a72700 1 --2- 172.21.15.49:0/2626376575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fd150 0x7f45d00f6930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.522+0000 7f45d5a72700 1 --2- 172.21.15.49:0/2626376575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d00fc7f0 0x7f45d00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.522+0000 7f45d5a72700 1 -- 172.21.15.49:0/2626376575 >> 172.21.15.49:0/2626376575 conn(0x7f45d0070590 msgr2=0x7f45d00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.523+0000 7f45d5a72700 1 -- 172.21.15.49:0/2626376575 shutdown_connections 2024-02-22T00:42:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.523+0000 7f45d5a72700 1 -- 172.21.15.49:0/2626376575 wait complete. 2024-02-22T00:42:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.523+0000 7f45d5a72700 1 Processor -- start 2024-02-22T00:42:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.523+0000 7f45d5a72700 1 -- start start 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45d5a72700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fc7f0 0x7f45d010e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45d5a72700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d00fd150 0x7f45d010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45d5a72700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d010eb90 con 0x7f45d00fc7f0 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45d5a72700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d010ecd0 con 0x7f45d00fd150 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45cf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fc7f0 0x7f45d010e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45cf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fc7f0 0x7f45d010e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48230/0 (socket says 172.21.15.49:48230) 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45cf7fe700 1 -- 172.21.15.49:0/147484227 learned_addr learned my addr 172.21.15.49:0/147484227 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45ceffd700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d00fd150 0x7f45d010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45cf7fe700 1 -- 172.21.15.49:0/147484227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d00fd150 msgr2=0x7f45d010e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45cf7fe700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d00fd150 0x7f45d010e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45cf7fe700 1 -- 172.21.15.49:0/147484227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4005040 con 0x7f45d00fc7f0 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45ceffd700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d00fd150 0x7f45d010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45cf7fe700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fc7f0 0x7f45d010e0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f45c000e8f0 tx=0x7f45c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45ccf74700 1 -- 172.21.15.49:0/147484227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c0007b40 con 0x7f45d00fc7f0 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45ccf74700 1 -- 172.21.15.49:0/147484227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f45c000f040 con 0x7f45d00fc7f0 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d01083a0 con 0x7f45d00fc7f0 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45ccf74700 1 -- 172.21.15.49:0/147484227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c0014880 con 0x7f45d00fc7f0 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.524+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d0108960 con 0x7f45d00fc7f0 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.525+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d005f590 con 0x7f45d00fc7f0 2024-02-22T00:42:22.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.526+0000 7f45ccf74700 1 -- 172.21.15.49:0/147484227 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f45c0014b00 con 0x7f45d00fc7f0 2024-02-22T00:42:22.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.526+0000 7f45ccf74700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f45b806caa0 0x7f45b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.526+0000 7f45ceffd700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f45b806caa0 0x7f45b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.526+0000 7f45ccf74700 1 -- 172.21.15.49:0/147484227 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f45c008b900 con 0x7f45d00fc7f0 2024-02-22T00:42:22.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.527+0000 7f45ceffd700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f45b806caa0 0x7f45b806ef60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f45d0109a20 tx=0x7f45c4009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:22.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.531+0000 7f45ccf74700 1 -- 172.21.15.49:0/147484227 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f45c0055a70 con 0x7f45d00fc7f0 2024-02-22T00:42:22.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.751+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45d0108fa0 con 0x7f45b806caa0 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.753+0000 7f45ccf74700 1 -- 172.21.15.49:0/147484227 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f45d0108fa0 con 0x7f45b806caa0 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-02-22T00:42:22.754 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:42:22.755 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "12/21 daemons upgraded", 2024-02-22T00:42:22.755 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading osd daemons", 2024-02-22T00:42:22.755 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:42:22.755 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:42:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f45b806caa0 msgr2=0x7f45b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f45b806caa0 0x7f45b806ef60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f45d0109a20 tx=0x7f45c4009cb0).stop 2024-02-22T00:42:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fc7f0 msgr2=0x7f45d010e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fc7f0 0x7f45d010e0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f45c000e8f0 tx=0x7f45c000b040).stop 2024-02-22T00:42:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 shutdown_connections 2024-02-22T00:42:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f45b806caa0 0x7f45b806ef60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f45d00fc7f0 0x7f45d010e0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 --2- 172.21.15.49:0/147484227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45d00fd150 0x7f45d010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 >> 172.21.15.49:0/147484227 conn(0x7f45d0070590 msgr2=0x7f45d0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:22.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 shutdown_connections 2024-02-22T00:42:22.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.755+0000 7f45d5a72700 1 -- 172.21.15.49:0/147484227 wait complete. 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.856+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/3132743408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fc7f0 msgr2=0x7f6e140fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.856+0000 7f6e1c1a1700 1 --2- 172.21.15.49:0/3132743408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fc7f0 0x7f6e140fcbd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f6e100047f0 tx=0x7f6e10009cb0).stop 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.856+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/3132743408 shutdown_connections 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.856+0000 7f6e1c1a1700 1 --2- 172.21.15.49:0/3132743408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e140fd150 0x7f6e140f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.856+0000 7f6e1c1a1700 1 --2- 172.21.15.49:0/3132743408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fc7f0 0x7f6e140fcbd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.856+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/3132743408 >> 172.21.15.49:0/3132743408 conn(0x7f6e140f23b0 msgr2=0x7f6e140f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.856+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/3132743408 shutdown_connections 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.856+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/3132743408 wait complete. 2024-02-22T00:42:22.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1c1a1700 1 Processor -- start 2024-02-22T00:42:22.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1c1a1700 1 -- start start 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1c1a1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e140fc7f0 0x7f6e1410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1c1a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fd150 0x7f6e1410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1c1a1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1410eb20 con 0x7f6e140fd150 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1c1a1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1410ec60 con 0x7f6e140fc7f0 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1973c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fd150 0x7f6e1410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1973c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fd150 0x7f6e1410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48238/0 (socket says 172.21.15.49:48238) 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e1973c700 1 -- 172.21.15.49:0/239152068 learned_addr learned my addr 172.21.15.49:0/239152068 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.857+0000 7f6e19f3d700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e140fc7f0 0x7f6e1410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e1973c700 1 -- 172.21.15.49:0/239152068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e140fc7f0 msgr2=0x7f6e1410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e1973c700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e140fc7f0 0x7f6e1410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:22.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e1973c700 1 -- 172.21.15.49:0/239152068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e10005040 con 0x7f6e140fd150 2024-02-22T00:42:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e1973c700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fd150 0x7f6e1410e520 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6e08002820 tx=0x7f6e08009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e06ffd700 1 -- 172.21.15.49:0/239152068 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e08007b40 con 0x7f6e140fd150 2024-02-22T00:42:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e06ffd700 1 -- 172.21.15.49:0/239152068 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e0800f040 con 0x7f6e140fd150 2024-02-22T00:42:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e141082f0 con 0x7f6e140fd150 2024-02-22T00:42:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e06ffd700 1 -- 172.21.15.49:0/239152068 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e080148b0 con 0x7f6e140fd150 2024-02-22T00:42:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.858+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e141088b0 con 0x7f6e140fd150 2024-02-22T00:42:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.859+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e14060370 con 0x7f6e140fd150 2024-02-22T00:42:22.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.860+0000 7f6e06ffd700 1 -- 172.21.15.49:0/239152068 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6e08007ca0 con 0x7f6e140fd150 2024-02-22T00:42:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.860+0000 7f6e06ffd700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e0006caa0 0x7f6e0006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.860+0000 7f6e06ffd700 1 -- 172.21.15.49:0/239152068 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6051+0+0 (secure 0 0 0) 0x7f6e0808b6c0 con 0x7f6e140fd150 2024-02-22T00:42:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.860+0000 7f6e19f3d700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e0006caa0 0x7f6e0006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:22.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.861+0000 7f6e19f3d700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e0006caa0 0x7f6e0006ef60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6e10004f10 tx=0x7f6e1000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:22.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:22.865+0000 7f6e06ffd700 1 -- 172.21.15.49:0/239152068 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6e080592c0 con 0x7f6e140fd150 2024-02-22T00:42:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.178+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6e14109780 con 0x7f6e140fd150 2024-02-22T00:42:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.178+0000 7f6e06ffd700 1 -- 172.21.15.49:0/239152068 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1207 (secure 0 0 0) 0x7f6e08058e50 con 0x7f6e140fd150 2024-02-22T00:42:23.179 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_WARN all OSDs are running quincy or later but require_osd_release < quincy; Degraded data redundancy: 49/321 objects degraded (15.265%), 14 pgs degraded 2024-02-22T00:42:23.179 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running quincy or later but require_osd_release < quincy 2024-02-22T00:42:23.179 INFO:teuthology.orchestra.run.smithi049.stdout: all OSDs are running quincy or later but require_osd_release < quincy 2024-02-22T00:42:23.179 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/321 objects degraded (15.265%), 14 pgs degraded 2024-02-22T00:42:23.179 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-02-22T00:42:23.180 INFO:teuthology.orchestra.run.smithi049.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-02-22T00:42:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e0006caa0 msgr2=0x7f6e0006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e0006caa0 0x7f6e0006ef60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f6e10004f10 tx=0x7f6e1000b040).stop 2024-02-22T00:42:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fd150 msgr2=0x7f6e1410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fd150 0x7f6e1410e520 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6e08002820 tx=0x7f6e08009f20).stop 2024-02-22T00:42:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 shutdown_connections 2024-02-22T00:42:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e0006caa0 0x7f6e0006ef60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e140fc7f0 0x7f6e1410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 --2- 172.21.15.49:0/239152068 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e140fd150 0x7f6e1410e520 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 >> 172.21.15.49:0/239152068 conn(0x7f6e140f23b0 msgr2=0x7f6e14061340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 shutdown_connections 2024-02-22T00:42:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:23.180+0000 7f6e1c1a1700 1 -- 172.21.15.49:0/239152068 wait complete. 2024-02-22T00:42:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:42:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: osd.5 [v2:172.21.15.161:6816/3112518053,v1:172.21.15.161:6817/3112518053] boot 2024-02-22T00:42:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: osdmap e77: 6 total, 6 up, 6 in 2024-02-22T00:42:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:42:23.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1979130950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/266421906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:42:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:23.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:22 smithi161 ceph-mon[113442]: osdmap e78: 6 total, 6 up, 6 in 2024-02-22T00:42:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T00:42:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: osd.5 [v2:172.21.15.161:6816/3112518053,v1:172.21.15.161:6817/3112518053] boot 2024-02-22T00:42:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: osdmap e77: 6 total, 6 up, 6 in 2024-02-22T00:42:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T00:42:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1979130950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:23.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/266421906' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:42:23.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:23.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:22 smithi049 ceph-mon[132694]: osdmap e78: 6 total, 6 up, 6 in 2024-02-22T00:42:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: pgmap v157: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all osd 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/239152068' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: Upgrade: Setting require_osd_release to 18 reef 2024-02-22T00:42:24.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-02-22T00:42:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: pgmap v157: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 49/321 objects degraded (15.265%) 2024-02-22T00:42:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:42:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all osd 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/239152068' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-22T00:42:24.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-22T00:42:24.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-22T00:42:24.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-22T00:42:24.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-22T00:42:24.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-22T00:42:24.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-22T00:42:24.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: Upgrade: Setting require_osd_release to 18 reef 2024-02-22T00:42:24.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-02-22T00:42:24.430 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[132671]: 2024-02-22T00:42:24.207+0000 7f8ae8e07700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-22T00:42:25.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2024-02-22T00:42:25.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-02-22T00:42:25.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: osdmap e79: 6 total, 6 up, 6 in 2024-02-22T00:42:25.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-22T00:42:25.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-22T00:42:25.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-22T00:42:25.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-22T00:42:25.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: osdmap e80: 6 total, 6 up, 6 in 2024-02-22T00:42:25.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-22T00:42:25.297 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:25 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: osdmap e79: 6 total, 6 up, 6 in 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: osdmap e80: 6 total, 6 up, 6 in 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-22T00:42:25.302 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:25 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-22T00:42:26.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: pgmap v161: 65 pgs: 9 active+undersized+degraded, 12 active+undersized, 44 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23/321 objects degraded (7.165%) 2024-02-22T00:42:26.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: Health check update: Degraded data redundancy: 23/321 objects degraded (7.165%), 9 pgs degraded (PG_DEGRADED) 2024-02-22T00:42:26.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.161:6824/2117166336,v1:172.21.15.161:6825/2117166336] up:boot 2024-02-22T00:42:26.274 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6826/3996496243,v1:172.21.15.49:6827/3996496243] up:boot 2024-02-22T00:42:26.275 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:42:26.275 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:42:26.275 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:42:26.275 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:26.275 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.vwomak", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:42:26.275 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: pgmap v161: 65 pgs: 9 active+undersized+degraded, 12 active+undersized, 44 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23/321 objects degraded (7.165%) 2024-02-22T00:42:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: Health check update: Degraded data redundancy: 23/321 objects degraded (7.165%), 9 pgs degraded (PG_DEGRADED) 2024-02-22T00:42:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.161:6824/2117166336,v1:172.21.15.161:6825/2117166336] up:boot 2024-02-22T00:42:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6826/3996496243,v1:172.21.15.49:6827/3996496243] up:boot 2024-02-22T00:42:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:42:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:42:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:42:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.vwomak", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:42:26.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:27.174 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:27 smithi049 ceph-mon[132694]: Upgrade: Updating mds.cephfs.smithi049.vwomak 2024-02-22T00:42:27.175 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:27 smithi049 ceph-mon[132694]: Deploying daemon mds.cephfs.smithi049.vwomak on smithi049 2024-02-22T00:42:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:27 smithi161 ceph-mon[113442]: Upgrade: Updating mds.cephfs.smithi049.vwomak 2024-02-22T00:42:27.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:27 smithi161 ceph-mon[113442]: Deploying daemon mds.cephfs.smithi049.vwomak on smithi049 2024-02-22T00:42:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:28 smithi161 ceph-mon[113442]: pgmap v162: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:28 smithi161 ceph-mon[113442]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/321 objects degraded (7.165%), 9 pgs degraded) 2024-02-22T00:42:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:28 smithi161 ceph-mon[113442]: osdmap e81: 6 total, 6 up, 6 in 2024-02-22T00:42:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:28 smithi049 ceph-mon[132694]: pgmap v162: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:28 smithi049 ceph-mon[132694]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23/321 objects degraded (7.165%), 9 pgs degraded) 2024-02-22T00:42:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:28 smithi049 ceph-mon[132694]: osdmap e81: 6 total, 6 up, 6 in 2024-02-22T00:42:29.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:29 smithi049 ceph-mon[132694]: pgmap v164: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:29.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:29 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-22T00:42:29.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:29 smithi161 ceph-mon[113442]: pgmap v164: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:29.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:29 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-22T00:42:31.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:42:31.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:42:32.071 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:31 smithi049 ceph-mon[132694]: pgmap v165: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:31 smithi161 ceph-mon[113442]: pgmap v165: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:33.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:33 smithi049 ceph-mon[132694]: pgmap v166: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:33.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:33.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:33 smithi161 ceph-mon[113442]: pgmap v166: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:33.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:34.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:34.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:34.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:34.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:34 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:boot 2024-02-22T00:42:34.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:34 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:42:34.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:42:34.857 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:34.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:34.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:34.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:34 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:boot 2024-02-22T00:42:34.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:34 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:42:34.858 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:42:36.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:35 smithi049 ceph-mon[132694]: pgmap v167: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:35 smithi161 ceph-mon[113442]: pgmap v167: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:38.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:37 smithi161 ceph-mon[113442]: pgmap v168: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:38.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:38.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:37 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:37 smithi049 ceph-mon[132694]: pgmap v168: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:37 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:39.440 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:39 smithi049 ceph-mon[132694]: pgmap v169: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:39.440 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:39 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:39.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:39 smithi161 ceph-mon[113442]: pgmap v169: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:39.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:39 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:39.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:39 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:39.915 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:39 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:41 smithi049 ceph-mon[132694]: pgmap v170: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:41 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:41 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:41 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:41 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:42:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:41 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:42.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:41 smithi161 ceph-mon[113442]: pgmap v170: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:42.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:41 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:42.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:41 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:42.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:41 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:42.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:41 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:42:42.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:41 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:43.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:43.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:43.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:43.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:43.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:43.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:44.285 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:43 smithi049 ceph-mon[132694]: pgmap v171: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:44.285 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:44.285 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.rrqshp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:42:44.285 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:44.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:43 smithi161 ceph-mon[113442]: pgmap v171: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:44.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:44.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi049.rrqshp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:42:44.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:45.248 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:44 smithi049 ceph-mon[132694]: Upgrade: Updating mds.cephfs.smithi049.rrqshp 2024-02-22T00:42:45.248 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:44 smithi049 ceph-mon[132694]: Deploying daemon mds.cephfs.smithi049.rrqshp on smithi049 2024-02-22T00:42:45.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:44 smithi161 ceph-mon[113442]: Upgrade: Updating mds.cephfs.smithi049.rrqshp 2024-02-22T00:42:45.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:44 smithi161 ceph-mon[113442]: Deploying daemon mds.cephfs.smithi049.rrqshp on smithi049 2024-02-22T00:42:46.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:45 smithi161 ceph-mon[113442]: pgmap v172: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:46.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:45 smithi161 ceph-mon[113442]: osdmap e82: 6 total, 6 up, 6 in 2024-02-22T00:42:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:45 smithi049 ceph-mon[132694]: pgmap v172: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:45 smithi049 ceph-mon[132694]: osdmap e82: 6 total, 6 up, 6 in 2024-02-22T00:42:47.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:46 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-22T00:42:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:46 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-22T00:42:48.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:47 smithi049 ceph-mon[132694]: pgmap v174: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:48.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:47 smithi161 ceph-mon[113442]: pgmap v174: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:50 smithi049 ceph-mon[132694]: pgmap v175: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:50 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:boot 2024-02-22T00:42:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:50 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:42:50.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:50 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:42:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:50 smithi161 ceph-mon[113442]: pgmap v175: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:50 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:boot 2024-02-22T00:42:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:50 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:42:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:50 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:42:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:52 smithi049 ceph-mon[132694]: pgmap v176: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:52 smithi161 ceph-mon[113442]: pgmap v176: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:53.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.286+0000 7fb1697c1700 1 -- 172.21.15.49:0/140797869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 msgr2=0x7fb1640f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.286+0000 7fb1697c1700 1 --2- 172.21.15.49:0/140797869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 0x7fb1640f8c80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb1540047f0 tx=0x7fb154009cb0).stop 2024-02-22T00:42:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.286+0000 7fb1697c1700 1 -- 172.21.15.49:0/140797869 shutdown_connections 2024-02-22T00:42:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.286+0000 7fb1697c1700 1 --2- 172.21.15.49:0/140797869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1640f9200 0x7fb164101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.286+0000 7fb1697c1700 1 --2- 172.21.15.49:0/140797869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 0x7fb1640f8c80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.286+0000 7fb1697c1700 1 -- 172.21.15.49:0/140797869 >> 172.21.15.49:0/140797869 conn(0x7fb164070590 msgr2=0x7fb1640f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.286+0000 7fb1697c1700 1 -- 172.21.15.49:0/140797869 shutdown_connections 2024-02-22T00:42:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.286+0000 7fb1697c1700 1 -- 172.21.15.49:0/140797869 wait complete. 2024-02-22T00:42:53.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb1697c1700 1 Processor -- start 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb1697c1700 1 -- start start 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb1697c1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 0x7fb164110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb1697c1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1640f9200 0x7fb164110770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb1697c1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164110d70 con 0x7fb1640f88a0 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb1697c1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164110eb0 con 0x7fb1640f9200 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb162ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 0x7fb164110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb162ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 0x7fb164110280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59086/0 (socket says 172.21.15.49:59086) 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb162ffd700 1 -- 172.21.15.49:0/1414995093 learned_addr learned my addr 172.21.15.49:0/1414995093 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.287+0000 7fb1627fc700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1640f9200 0x7fb164110770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb162ffd700 1 -- 172.21.15.49:0/1414995093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1640f9200 msgr2=0x7fb164110770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb162ffd700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1640f9200 0x7fb164110770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb162ffd700 1 -- 172.21.15.49:0/1414995093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154005040 con 0x7fb1640f88a0 2024-02-22T00:42:53.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb162ffd700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 0x7fb164110280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb15400b120 tx=0x7fb154009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:53.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb14bfff700 1 -- 172.21.15.49:0/1414995093 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb15400e030 con 0x7fb1640f88a0 2024-02-22T00:42:53.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb14bfff700 1 -- 172.21.15.49:0/1414995093 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb154007e90 con 0x7fb1640f88a0 2024-02-22T00:42:53.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16410a4e0 con 0x7fb1640f88a0 2024-02-22T00:42:53.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb14bfff700 1 -- 172.21.15.49:0/1414995093 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb154018070 con 0x7fb1640f88a0 2024-02-22T00:42:53.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.288+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16410a9c0 con 0x7fb1640f88a0 2024-02-22T00:42:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.289+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16405f590 con 0x7fb1640f88a0 2024-02-22T00:42:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.290+0000 7fb14bfff700 1 -- 172.21.15.49:0/1414995093 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb15401d420 con 0x7fb1640f88a0 2024-02-22T00:42:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.290+0000 7fb14bfff700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb14c06caa0 0x7fb14c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:53.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.291+0000 7fb14bfff700 1 -- 172.21.15.49:0/1414995093 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb15408d270 con 0x7fb1640f88a0 2024-02-22T00:42:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.291+0000 7fb1627fc700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb14c06caa0 0x7fb14c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:53.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.291+0000 7fb1627fc700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb14c06caa0 0x7fb14c06ef60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb16410bbc0 tx=0x7fb158009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:53.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.295+0000 7fb14bfff700 1 -- 172.21.15.49:0/1414995093 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb15405add0 con 0x7fb1640f88a0 2024-02-22T00:42:53.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.526+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb16410b900 con 0x7fb14c06caa0 2024-02-22T00:42:53.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.527+0000 7fb14bfff700 1 -- 172.21.15.49:0/1414995093 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb16410b900 con 0x7fb14c06caa0 2024-02-22T00:42:53.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb14c06caa0 msgr2=0x7fb14c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:53.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb14c06caa0 0x7fb14c06ef60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fb16410bbc0 tx=0x7fb158009040).stop 2024-02-22T00:42:53.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 msgr2=0x7fb164110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:53.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 0x7fb164110280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb15400b120 tx=0x7fb154009cb0).stop 2024-02-22T00:42:53.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 shutdown_connections 2024-02-22T00:42:53.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb14c06caa0 0x7fb14c06ef60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb1640f88a0 0x7fb164110280 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 --2- 172.21.15.49:0/1414995093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1640f9200 0x7fb164110770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 >> 172.21.15.49:0/1414995093 conn(0x7fb164070590 msgr2=0x7fb1640f6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:53.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 shutdown_connections 2024-02-22T00:42:53.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.529+0000 7fb1697c1700 1 -- 172.21.15.49:0/1414995093 wait complete. 2024-02-22T00:42:53.542 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:42:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.638+0000 7f789adc1700 1 -- 172.21.15.49:0/4048139539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 msgr2=0x7f78940fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:53.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.638+0000 7f789adc1700 1 --2- 172.21.15.49:0/4048139539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 0x7f78940fcbd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f78840047f0 tx=0x7f7884009cb0).stop 2024-02-22T00:42:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.638+0000 7f789adc1700 1 -- 172.21.15.49:0/4048139539 shutdown_connections 2024-02-22T00:42:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.638+0000 7f789adc1700 1 --2- 172.21.15.49:0/4048139539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fd150 0x7f78940f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.638+0000 7f789adc1700 1 --2- 172.21.15.49:0/4048139539 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 0x7f78940fcbd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.638+0000 7f789adc1700 1 -- 172.21.15.49:0/4048139539 >> 172.21.15.49:0/4048139539 conn(0x7f7894070590 msgr2=0x7f78940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.638+0000 7f789adc1700 1 -- 172.21.15.49:0/4048139539 shutdown_connections 2024-02-22T00:42:53.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.638+0000 7f789adc1700 1 -- 172.21.15.49:0/4048139539 wait complete. 2024-02-22T00:42:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f789adc1700 1 Processor -- start 2024-02-22T00:42:53.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f789adc1700 1 -- start start 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f789adc1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 0x7f789410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f789adc1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fd150 0x7f789410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f789adc1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789410eae0 con 0x7f78940fc7f0 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f789adc1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789410ec20 con 0x7f78940fd150 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f7898b5d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 0x7f789410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f7898b5d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 0x7f789410dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59110/0 (socket says 172.21.15.49:59110) 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f7898b5d700 1 -- 172.21.15.49:0/1217329289 learned_addr learned my addr 172.21.15.49:0/1217329289 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f7893fff700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fd150 0x7f789410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.639+0000 7f7898b5d700 1 -- 172.21.15.49:0/1217329289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fd150 msgr2=0x7f789410e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.640+0000 7f7898b5d700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fd150 0x7f789410e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.640+0000 7f7898b5d700 1 -- 172.21.15.49:0/1217329289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884005040 con 0x7f78940fc7f0 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.640+0000 7f7898b5d700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 0x7f789410dff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f788400b120 tx=0x7f7884009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.640+0000 7f7891ffb700 1 -- 172.21.15.49:0/1217329289 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f788400e030 con 0x7f78940fc7f0 2024-02-22T00:42:53.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.640+0000 7f7891ffb700 1 -- 172.21.15.49:0/1217329289 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7884007e90 con 0x7f78940fc7f0 2024-02-22T00:42:53.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.640+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894108250 con 0x7f78940fc7f0 2024-02-22T00:42:53.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.640+0000 7f7891ffb700 1 -- 172.21.15.49:0/1217329289 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7884018070 con 0x7f78940fc7f0 2024-02-22T00:42:53.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.640+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78941087b0 con 0x7f78940fc7f0 2024-02-22T00:42:53.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.641+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789405f590 con 0x7f78940fc7f0 2024-02-22T00:42:53.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.642+0000 7f7891ffb700 1 -- 172.21.15.49:0/1217329289 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f788401d420 con 0x7f78940fc7f0 2024-02-22T00:42:53.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.643+0000 7f7891ffb700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:53.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.643+0000 7f7891ffb700 1 -- 172.21.15.49:0/1217329289 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f788408d520 con 0x7f78940fc7f0 2024-02-22T00:42:53.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.643+0000 7f7893fff700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:53.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.643+0000 7f7893fff700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7894109930 tx=0x7f787c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:53.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.648+0000 7f7891ffb700 1 -- 172.21.15.49:0/1217329289 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f788405b100 con 0x7f78940fc7f0 2024-02-22T00:42:53.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.881+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7894108e40 con 0x7f788006caa0 2024-02-22T00:42:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.882+0000 7f7891ffb700 1 -- 172.21.15.49:0/1217329289 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7894108e40 con 0x7f788006caa0 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.884+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 msgr2=0x7f788006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.884+0000 7f789adc1700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7894109930 tx=0x7f787c009040).stop 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.884+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 msgr2=0x7f789410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.884+0000 7f789adc1700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 0x7f789410dff0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f788400b120 tx=0x7f7884009cb0).stop 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.885+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 shutdown_connections 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.885+0000 7f789adc1700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.885+0000 7f789adc1700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fc7f0 0x7f789410dff0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.885+0000 7f789adc1700 1 --2- 172.21.15.49:0/1217329289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fd150 0x7f789410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.885+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 >> 172.21.15.49:0/1217329289 conn(0x7f7894070590 msgr2=0x7f7894060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.885+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 shutdown_connections 2024-02-22T00:42:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.885+0000 7f789adc1700 1 -- 172.21.15.49:0/1217329289 wait complete. 2024-02-22T00:42:53.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:53 smithi049 ceph-mon[132694]: pgmap v177: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:53.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:53 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:53.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:53 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:53.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:53 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:53.963 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:53 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.996+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3568354618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 msgr2=0x7f5c080fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.996+0000 7f5c0e3ed700 1 --2- 172.21.15.49:0/3568354618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 0x7f5c080fcbd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f5bf80047f0 tx=0x7f5bf8009cb0).stop 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.996+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3568354618 shutdown_connections 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.996+0000 7f5c0e3ed700 1 --2- 172.21.15.49:0/3568354618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c080fd150 0x7f5c080f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.996+0000 7f5c0e3ed700 1 --2- 172.21.15.49:0/3568354618 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 0x7f5c080fcbd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.996+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3568354618 >> 172.21.15.49:0/3568354618 conn(0x7f5c08070590 msgr2=0x7f5c080f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.996+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3568354618 shutdown_connections 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.996+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3568354618 wait complete. 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.997+0000 7f5c0e3ed700 1 Processor -- start 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.997+0000 7f5c0e3ed700 1 -- start start 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c0e3ed700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 0x7f5c0810cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c0e3ed700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c080fd150 0x7f5c0810d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c0e3ed700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0810d9f0 con 0x7f5c080fc7f0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c0e3ed700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0810db30 con 0x7f5c080fd150 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c07fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 0x7f5c0810cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c07fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 0x7f5c0810cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59124/0 (socket says 172.21.15.49:59124) 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c07fff700 1 -- 172.21.15.49:0/3806974936 learned_addr learned my addr 172.21.15.49:0/3806974936 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c077fe700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c080fd150 0x7f5c0810d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c07fff700 1 -- 172.21.15.49:0/3806974936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c080fd150 msgr2=0x7f5c0810d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c07fff700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c080fd150 0x7f5c0810d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c07fff700 1 -- 172.21.15.49:0/3806974936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8005040 con 0x7f5c080fc7f0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c07fff700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 0x7f5c0810cf00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5bf8005010 tx=0x7f5bf8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c057fa700 1 -- 172.21.15.49:0/3806974936 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf800e030 con 0x7f5c080fc7f0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c057fa700 1 -- 172.21.15.49:0/3806974936 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5bf8007e90 con 0x7f5c080fc7f0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c057fa700 1 -- 172.21.15.49:0/3806974936 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf8018070 con 0x7f5c080fc7f0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c08107160 con 0x7f5c080fc7f0 2024-02-22T00:42:54.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.998+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c081076c0 con 0x7f5c080fc7f0 2024-02-22T00:42:54.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:53.999+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0805f590 con 0x7f5c080fc7f0 2024-02-22T00:42:54.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.000+0000 7f5c057fa700 1 -- 172.21.15.49:0/3806974936 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5bf801d670 con 0x7f5c080fc7f0 2024-02-22T00:42:54.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.001+0000 7f5c057fa700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5bf006caa0 0x7f5bf006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.001+0000 7f5c057fa700 1 -- 172.21.15.49:0/3806974936 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5bf808d620 con 0x7f5c080fc7f0 2024-02-22T00:42:54.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.001+0000 7f5c077fe700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5bf006caa0 0x7f5bf006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:54.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.001+0000 7f5c077fe700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5bf006caa0 0x7f5bf006ef60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5c08108840 tx=0x7f5bfc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:54.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.004+0000 7f5c057fa700 1 -- 172.21.15.49:0/3806974936 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5bf805b180 con 0x7f5c080fc7f0 2024-02-22T00:42:54.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:53 smithi161 ceph-mon[113442]: pgmap v177: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:54.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:53 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:54.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:53 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:54.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:53 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:54.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:53 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:54.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.213+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c080feb40 con 0x7f5bf006caa0 2024-02-22T00:42:54.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.223+0000 7f5c057fa700 1 -- 172.21.15.49:0/3806974936 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f5c080feb40 con 0x7f5bf006caa0 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (6m) 1s ago 17m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (3m) 1s ago 17m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (3m) 35s ago 16m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (5m) 1s ago 17m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (5s) 1s ago 12m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (21s) 1s ago 12m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (12m) 35s ago 12m 16.6M - 16.2.14-550-geb66ed92 7403d1862307 c1a09dcb7f80 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (12m) 35s ago 12m 110M - 16.2.14-550-geb66ed92 7403d1862307 2de96806f59b 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (7m) 1s ago 18m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (7m) 35s ago 16m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:42:54.226 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (4m) 1s ago 18m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (4m) 35s ago 16m 41.5M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (6m) 1s ago 16m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (6m) 35s ago 16m 17.4M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (3m) 1s ago 16m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (2m) 1s ago 15m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (2m) 1s ago 14m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (105s) 35s ago 14m 102M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (72s) 35s ago 14m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (39s) 35s ago 13m 13.1M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:42:54.227 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (6m) 35s ago 16m 61.1M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:42:54.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.225+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5bf006caa0 msgr2=0x7f5bf006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5bf006caa0 0x7f5bf006ef60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f5c08108840 tx=0x7f5bfc00b040).stop 2024-02-22T00:42:54.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 msgr2=0x7f5c0810cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 0x7f5c0810cf00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f5bf8005010 tx=0x7f5bf8009cb0).stop 2024-02-22T00:42:54.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 shutdown_connections 2024-02-22T00:42:54.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5bf006caa0 0x7f5bf006ef60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5c080fc7f0 0x7f5c0810cf00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 --2- 172.21.15.49:0/3806974936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c080fd150 0x7f5c0810d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 >> 172.21.15.49:0/3806974936 conn(0x7f5c08070590 msgr2=0x7f5c080fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:54.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 shutdown_connections 2024-02-22T00:42:54.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.226+0000 7f5c0e3ed700 1 -- 172.21.15.49:0/3806974936 wait complete. 2024-02-22T00:42:54.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.328+0000 7f5f83263700 1 -- 172.21.15.49:0/1115361508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 msgr2=0x7f5f7c0f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.328+0000 7f5f83263700 1 --2- 172.21.15.49:0/1115361508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 0x7f5f7c0f8d20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f5f700047f0 tx=0x7f5f70009cb0).stop 2024-02-22T00:42:54.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.328+0000 7f5f83263700 1 -- 172.21.15.49:0/1115361508 shutdown_connections 2024-02-22T00:42:54.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.328+0000 7f5f83263700 1 --2- 172.21.15.49:0/1115361508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f7c0f9210 0x7f5f7c1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:42:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.328+0000 7f5f83263700 1 --2- 172.21.15.49:0/1115361508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 0x7f5f7c0f8d20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.328+0000 7f5f83263700 1 -- 172.21.15.49:0/1115361508 >> 172.21.15.49:0/1115361508 conn(0x7f5f7c070590 msgr2=0x7f5f7c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.328+0000 7f5f83263700 1 -- 172.21.15.49:0/1115361508 shutdown_connections 2024-02-22T00:42:54.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.328+0000 7f5f83263700 1 -- 172.21.15.49:0/1115361508 wait complete. 2024-02-22T00:42:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f83263700 1 Processor -- start 2024-02-22T00:42:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f83263700 1 -- start start 2024-02-22T00:42:54.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f83263700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 0x7f5f7c0f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f83263700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f7c0f9210 0x7f5f7c0f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f83263700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0f72d0 con 0x7f5f7c0f8940 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f83263700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0f7410 con 0x7f5f7c0f9210 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f80fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 0x7f5f7c0f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f80fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 0x7f5f7c0f68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59140/0 (socket says 172.21.15.49:59140) 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f80fff700 1 -- 172.21.15.49:0/1848280796 learned_addr learned my addr 172.21.15.49:0/1848280796 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f80fff700 1 -- 172.21.15.49:0/1848280796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f7c0f9210 msgr2=0x7f5f7c0f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f80fff700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f7c0f9210 0x7f5f7c0f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f80fff700 1 -- 172.21.15.49:0/1848280796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f70005040 con 0x7f5f7c0f8940 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.329+0000 7f5f80fff700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 0x7f5f7c0f68f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f5f7000b120 tx=0x7f5f70009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.330+0000 7f5f79ffb700 1 -- 172.21.15.49:0/1848280796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f7000e030 con 0x7f5f7c0f8940 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.330+0000 7f5f79ffb700 1 -- 172.21.15.49:0/1848280796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f70007e90 con 0x7f5f7c0f8940 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.330+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c0f7660 con 0x7f5f7c0f8940 2024-02-22T00:42:54.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.330+0000 7f5f79ffb700 1 -- 172.21.15.49:0/1848280796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f70018070 con 0x7f5f7c0f8940 2024-02-22T00:42:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.330+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c114700 con 0x7f5f7c0f8940 2024-02-22T00:42:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.331+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c05f590 con 0x7f5f7c0f8940 2024-02-22T00:42:54.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.332+0000 7f5f79ffb700 1 -- 172.21.15.49:0/1848280796 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5f7001d420 con 0x7f5f7c0f8940 2024-02-22T00:42:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.332+0000 7f5f79ffb700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5f6c06caa0 0x7f5f6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.332+0000 7f5f79ffb700 1 -- 172.21.15.49:0/1848280796 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5f7008d580 con 0x7f5f7c0f8940 2024-02-22T00:42:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.332+0000 7f5f7bfff700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5f6c06caa0 0x7f5f6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:54.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.333+0000 7f5f7bfff700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5f6c06caa0 0x7f5f6c06ef60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5f7c0f8090 tx=0x7f5f68006c30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:54.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.336+0000 7f5f79ffb700 1 -- 172.21.15.49:0/1848280796 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5f70057630 con 0x7f5f7c0f8940 2024-02-22T00:42:54.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.621+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5f7c047540 con 0x7f5f7c0f8940 2024-02-22T00:42:54.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.622+0000 7f5f79ffb700 1 -- 172.21.15.49:0/1848280796 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f5f7005ac50 con 0x7f5f7c0f8940 2024-02-22T00:42:54.624 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2, 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:42:54.625 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:42:54.626 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2, 2024-02-22T00:42:54.626 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 12 2024-02-22T00:42:54.626 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:42:54.626 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:42:54.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5f6c06caa0 msgr2=0x7f5f6c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5f6c06caa0 0x7f5f6c06ef60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5f7c0f8090 tx=0x7f5f68006c30).stop 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 msgr2=0x7f5f7c0f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 0x7f5f7c0f68f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f5f7000b120 tx=0x7f5f70009cb0).stop 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 shutdown_connections 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5f6c06caa0 0x7f5f6c06ef60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f7c0f8940 0x7f5f7c0f68f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 --2- 172.21.15.49:0/1848280796 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f7c0f9210 0x7f5f7c0f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 >> 172.21.15.49:0/1848280796 conn(0x7f5f7c070590 msgr2=0x7f5f7c0fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 shutdown_connections 2024-02-22T00:42:54.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.624+0000 7f5f83263700 1 -- 172.21.15.49:0/1848280796 wait complete. 2024-02-22T00:42:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.727+0000 7ff031b0e700 1 -- 172.21.15.49:0/2964043670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 msgr2=0x7ff02c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.727+0000 7ff031b0e700 1 --2- 172.21.15.49:0/2964043670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 0x7ff02c0f6930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff0200047f0 tx=0x7ff020009cb0).stop 2024-02-22T00:42:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.728+0000 7ff031b0e700 1 -- 172.21.15.49:0/2964043670 shutdown_connections 2024-02-22T00:42:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.728+0000 7ff031b0e700 1 --2- 172.21.15.49:0/2964043670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 0x7ff02c0f6930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.728+0000 7ff031b0e700 1 --2- 172.21.15.49:0/2964043670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff02c0fc7f0 0x7ff02c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:42:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.728+0000 7ff031b0e700 1 -- 172.21.15.49:0/2964043670 >> 172.21.15.49:0/2964043670 conn(0x7ff02c070590 msgr2=0x7ff02c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:54.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.728+0000 7ff031b0e700 1 -- 172.21.15.49:0/2964043670 shutdown_connections 2024-02-22T00:42:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.728+0000 7ff031b0e700 1 -- 172.21.15.49:0/2964043670 wait complete. 2024-02-22T00:42:54.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.728+0000 7ff031b0e700 1 Processor -- start 2024-02-22T00:42:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.728+0000 7ff031b0e700 1 -- start start 2024-02-22T00:42:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff031b0e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff02c0fc7f0 0x7ff02c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff031b0e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 0x7ff02c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff031b0e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c10ebe0 con 0x7ff02c0fd150 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff031b0e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c108200 con 0x7ff02c0fc7f0 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff02affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 0x7ff02c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff02affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 0x7ff02c10e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59166/0 (socket says 172.21.15.49:59166) 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff02affd700 1 -- 172.21.15.49:0/1381731350 learned_addr learned my addr 172.21.15.49:0/1381731350 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff02b7fe700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff02c0fc7f0 0x7ff02c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff02affd700 1 -- 172.21.15.49:0/1381731350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff02c0fc7f0 msgr2=0x7ff02c10e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff02affd700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff02c0fc7f0 0x7ff02c10e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff02affd700 1 -- 172.21.15.49:0/1381731350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff020005040 con 0x7ff02c0fd150 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff02affd700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 0x7ff02c10e550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff0200099f0 tx=0x7ff020009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff028ff9700 1 -- 172.21.15.49:0/1381731350 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff02000e030 con 0x7ff02c0fd150 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff028ff9700 1 -- 172.21.15.49:0/1381731350 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff020007e90 con 0x7ff02c0fd150 2024-02-22T00:42:54.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c108450 con 0x7ff02c0fd150 2024-02-22T00:42:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff028ff9700 1 -- 172.21.15.49:0/1381731350 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff020018070 con 0x7ff02c0fd150 2024-02-22T00:42:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.729+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c108930 con 0x7ff02c0fd150 2024-02-22T00:42:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.730+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c05f590 con 0x7ff02c0fd150 2024-02-22T00:42:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.731+0000 7ff028ff9700 1 -- 172.21.15.49:0/1381731350 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff02001d420 con 0x7ff02c0fd150 2024-02-22T00:42:54.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.731+0000 7ff028ff9700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff01406caa0 0x7ff01406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.731+0000 7ff028ff9700 1 -- 172.21.15.49:0/1381731350 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff02008d180 con 0x7ff02c0fd150 2024-02-22T00:42:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.731+0000 7ff02b7fe700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff01406caa0 0x7ff01406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:54.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.732+0000 7ff02b7fe700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff01406caa0 0x7ff01406ef60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff01c006fd0 tx=0x7ff01c009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:54.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.736+0000 7ff028ff9700 1 -- 172.21.15.49:0/1381731350 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff02005ace0 con 0x7ff02c0fd150 2024-02-22T00:42:54.916 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:54 smithi049 ceph-mon[132694]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:54.917 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:54 smithi049 ceph-mon[132694]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:54.917 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:54 smithi049 ceph-mon[132694]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:54.917 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:54 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1848280796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.983+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff02c109030 con 0x7ff02c0fd150 2024-02-22T00:42:54.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.983+0000 7ff028ff9700 1 -- 172.21.15.49:0/1381731350 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1839 (secure 0 0 0) 0x7ff02005a870 con 0x7ff02c0fd150 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:e22 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:42:54.986 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:42:54.987 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/338849788,v1:172.21.15.161:6827/338849788] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:42:54.988 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/2117166336,v1:172.21.15.161:6825/2117166336] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff01406caa0 msgr2=0x7ff01406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff01406caa0 0x7ff01406ef60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff01c006fd0 tx=0x7ff01c009060).stop 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 msgr2=0x7ff02c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 0x7ff02c10e550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff0200099f0 tx=0x7ff020009cb0).stop 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 shutdown_connections 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff01406caa0 0x7ff01406ef60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff02c0fc7f0 0x7ff02c10e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 --2- 172.21.15.49:0/1381731350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff02c0fd150 0x7ff02c10e550 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 >> 172.21.15.49:0/1381731350 conn(0x7ff02c070590 msgr2=0x7ff02c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:54.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 shutdown_connections 2024-02-22T00:42:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:54.986+0000 7ff031b0e700 1 -- 172.21.15.49:0/1381731350 wait complete. 2024-02-22T00:42:54.993 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 22 2024-02-22T00:42:55.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:54 smithi161 ceph-mon[113442]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:55.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:54 smithi161 ceph-mon[113442]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:55.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:54 smithi161 ceph-mon[113442]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:55.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:54 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1848280796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.093+0000 7fdce6f2c700 1 -- 172.21.15.49:0/1849334099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 msgr2=0x7fdce00f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.093+0000 7fdce6f2c700 1 --2- 172.21.15.49:0/1849334099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 0x7fdce00f6980 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fdccc0047f0 tx=0x7fdccc009cb0).stop 2024-02-22T00:42:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.093+0000 7fdce6f2c700 1 -- 172.21.15.49:0/1849334099 shutdown_connections 2024-02-22T00:42:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.093+0000 7fdce6f2c700 1 --2- 172.21.15.49:0/1849334099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 0x7fdce00f6980 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.093+0000 7fdce6f2c700 1 --2- 172.21.15.49:0/1849334099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdce00fc830 0x7fdce00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.093+0000 7fdce6f2c700 1 -- 172.21.15.49:0/1849334099 >> 172.21.15.49:0/1849334099 conn(0x7fdce006c760 msgr2=0x7fdce006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.093+0000 7fdce6f2c700 1 -- 172.21.15.49:0/1849334099 shutdown_connections 2024-02-22T00:42:55.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.093+0000 7fdce6f2c700 1 -- 172.21.15.49:0/1849334099 wait complete. 2024-02-22T00:42:55.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdce6f2c700 1 Processor -- start 2024-02-22T00:42:55.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdce6f2c700 1 -- start start 2024-02-22T00:42:55.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdce6f2c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdce00fc830 0x7fdce00f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:55.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdce6f2c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 0x7fdce00f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:55.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdce6f2c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00f8f60 con 0x7fdce00fd190 2024-02-22T00:42:55.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdce6f2c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00f90a0 con 0x7fdce00fc830 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdcdffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 0x7fdce00f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdcdffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 0x7fdce00f8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59186/0 (socket says 172.21.15.49:59186) 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdcdffff700 1 -- 172.21.15.49:0/2598338889 learned_addr learned my addr 172.21.15.49:0/2598338889 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.094+0000 7fdce4cc8700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdce00fc830 0x7fdce00f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdcdffff700 1 -- 172.21.15.49:0/2598338889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdce00fc830 msgr2=0x7fdce00f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdcdffff700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdce00fc830 0x7fdce00f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdcdffff700 1 -- 172.21.15.49:0/2598338889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc005040 con 0x7fdce00fd190 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdcdffff700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 0x7fdce00f8a70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdccc000c00 tx=0x7fdccc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdcddffb700 1 -- 172.21.15.49:0/2598338889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdccc00e030 con 0x7fdce00fd190 2024-02-22T00:42:55.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdcddffb700 1 -- 172.21.15.49:0/2598338889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdccc007e90 con 0x7fdce00fd190 2024-02-22T00:42:55.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdcddffb700 1 -- 172.21.15.49:0/2598338889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdccc018070 con 0x7fdce00fd190 2024-02-22T00:42:55.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce00f92f0 con 0x7fdce00fd190 2024-02-22T00:42:55.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.095+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce0114630 con 0x7fdce00fd190 2024-02-22T00:42:55.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.096+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce005f570 con 0x7fdce00fd190 2024-02-22T00:42:55.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.097+0000 7fdcddffb700 1 -- 172.21.15.49:0/2598338889 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdccc01d420 con 0x7fdce00fd190 2024-02-22T00:42:55.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.097+0000 7fdcddffb700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdcd006cab0 0x7fdcd006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:55.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.097+0000 7fdcddffb700 1 -- 172.21.15.49:0/2598338889 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdccc08cee0 con 0x7fdce00fd190 2024-02-22T00:42:55.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.097+0000 7fdce4cc8700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdcd006cab0 0x7fdcd006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:55.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.098+0000 7fdce4cc8700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdcd006cab0 0x7fdcd006ef70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fdcd4004de0 tx=0x7fdcd400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:55.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.102+0000 7fdcddffb700 1 -- 172.21.15.49:0/2598338889 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdccc057070 con 0x7fdce00fd190 2024-02-22T00:42:55.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.324+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdce00fb5e0 con 0x7fdcd006cab0 2024-02-22T00:42:55.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.325+0000 7fdcddffb700 1 -- 172.21.15.49:0/2598338889 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fdce00fb5e0 con 0x7fdcd006cab0 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "osd", 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "crash" 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "14/21 daemons upgraded", 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:42:55.328 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:42:55.329 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.327+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdcd006cab0 msgr2=0x7fdcd006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.327+0000 7fdce6f2c700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdcd006cab0 0x7fdcd006ef70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fdcd4004de0 tx=0x7fdcd400b040).stop 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 msgr2=0x7fdce00f8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 0x7fdce00f8a70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdccc000c00 tx=0x7fdccc009cb0).stop 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 shutdown_connections 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdcd006cab0 0x7fdcd006ef70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdce00fc830 0x7fdce00f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 --2- 172.21.15.49:0/2598338889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdce00fd190 0x7fdce00f8a70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 >> 172.21.15.49:0/2598338889 conn(0x7fdce006c760 msgr2=0x7fdce0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:55.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 shutdown_connections 2024-02-22T00:42:55.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.328+0000 7fdce6f2c700 1 -- 172.21.15.49:0/2598338889 wait complete. 2024-02-22T00:42:55.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 -- 172.21.15.49:0/775396912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f88a0 msgr2=0x7f392c0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:55.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 --2- 172.21.15.49:0/775396912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f88a0 0x7f392c0f8c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f391c0047f0 tx=0x7f391c009cb0).stop 2024-02-22T00:42:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 -- 172.21.15.49:0/775396912 shutdown_connections 2024-02-22T00:42:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 --2- 172.21.15.49:0/775396912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c0f9200 0x7f392c101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 --2- 172.21.15.49:0/775396912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f88a0 0x7f392c0f8c80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 -- 172.21.15.49:0/775396912 >> 172.21.15.49:0/775396912 conn(0x7f392c070590 msgr2=0x7f392c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 -- 172.21.15.49:0/775396912 shutdown_connections 2024-02-22T00:42:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 -- 172.21.15.49:0/775396912 wait complete. 2024-02-22T00:42:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.431+0000 7f3932463700 1 Processor -- start 2024-02-22T00:42:55.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f3932463700 1 -- start start 2024-02-22T00:42:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f3932463700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c0f88a0 0x7f392c10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f3932463700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f9200 0x7f392c10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f3932463700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c10eb10 con 0x7f392c0f9200 2024-02-22T00:42:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f3932463700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c10ec50 con 0x7f392c0f88a0 2024-02-22T00:42:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f392b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f9200 0x7f392c10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f392b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f9200 0x7f392c10e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59192/0 (socket says 172.21.15.49:59192) 2024-02-22T00:42:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f392b7fe700 1 -- 172.21.15.49:0/2023615331 learned_addr learned my addr 172.21.15.49:0/2023615331 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:42:55.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f392bfff700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c0f88a0 0x7f392c10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f392b7fe700 1 -- 172.21.15.49:0/2023615331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c0f88a0 msgr2=0x7f392c10e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f392b7fe700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c0f88a0 0x7f392c10e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.432+0000 7f392b7fe700 1 -- 172.21.15.49:0/2023615331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c005040 con 0x7f392c0f9200 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.433+0000 7f392b7fe700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f9200 0x7f392c10e510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f39200041d0 tx=0x7f3920009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.433+0000 7f39297fa700 1 -- 172.21.15.49:0/2023615331 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3920007b40 con 0x7f392c0f9200 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.433+0000 7f39297fa700 1 -- 172.21.15.49:0/2023615331 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f392000f040 con 0x7f392c0f9200 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.433+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c1082e0 con 0x7f392c0f9200 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.433+0000 7f39297fa700 1 -- 172.21.15.49:0/2023615331 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39200147b0 con 0x7f392c0f9200 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.433+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c108820 con 0x7f392c0f9200 2024-02-22T00:42:55.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.434+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c05f590 con 0x7f392c0f9200 2024-02-22T00:42:55.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.434+0000 7f39297fa700 1 -- 172.21.15.49:0/2023615331 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3920009110 con 0x7f392c0f9200 2024-02-22T00:42:55.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.435+0000 7f39297fa700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f391406caa0 0x7f391406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:42:55.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.435+0000 7f39297fa700 1 -- 172.21.15.49:0/2023615331 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f392008bda0 con 0x7f392c0f9200 2024-02-22T00:42:55.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.435+0000 7f392bfff700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f391406caa0 0x7f391406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:42:55.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.435+0000 7f392bfff700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f391406caa0 0x7f391406ef60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f391c004f10 tx=0x7f391c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:42:55.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.439+0000 7f39297fa700 1 -- 172.21.15.49:0/2023615331 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3920059900 con 0x7f392c0f9200 2024-02-22T00:42:55.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.719+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f392c047540 con 0x7f392c0f9200 2024-02-22T00:42:55.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.720+0000 7f39297fa700 1 -- 172.21.15.49:0/2023615331 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f3920059490 con 0x7f392c0f9200 2024-02-22T00:42:55.723 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:42:55.723 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:42:55.723 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:42:55.723 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:42:55.723 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:42:55.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f391406caa0 msgr2=0x7f391406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:55.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f391406caa0 0x7f391406ef60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f391c004f10 tx=0x7f391c00b040).stop 2024-02-22T00:42:55.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f9200 msgr2=0x7f392c10e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:42:55.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f9200 0x7f392c10e510 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f39200041d0 tx=0x7f3920009f60).stop 2024-02-22T00:42:55.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 shutdown_connections 2024-02-22T00:42:55.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f391406caa0 0x7f391406ef60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f392c0f88a0 0x7f392c10e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 --2- 172.21.15.49:0/2023615331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f392c0f9200 0x7f392c10e510 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:42:55.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 >> 172.21.15.49:0/2023615331 conn(0x7f392c070590 msgr2=0x7f392c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:42:55.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 shutdown_connections 2024-02-22T00:42:55.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:42:55.722+0000 7f3932463700 1 -- 172.21.15.49:0/2023615331 wait complete. 2024-02-22T00:42:56.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:55 smithi161 ceph-mon[113442]: pgmap v178: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:56.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:55 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1381731350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:42:56.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:55 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2023615331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:42:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:55 smithi049 ceph-mon[132694]: pgmap v178: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:55 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1381731350' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:42:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:55 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2023615331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:42:57.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:56 smithi049 ceph-mon[132694]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:57.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:56 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:57.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:56 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:56 smithi161 ceph-mon[113442]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:42:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:56 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:57.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:56 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:58.268 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: pgmap v179: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:58.268 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:58.268 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:42:58.268 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:58.269 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:58.269 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:58.269 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:58.269 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:58.269 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:58.269 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: pgmap v179: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:42:58.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:42:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:59 smithi049 ceph-mon[132694]: pgmap v180: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:59 smithi049 ceph-mon[132694]: Upgrade: Updating mds.cephfs.smithi161.wycpud 2024-02-22T00:42:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:59 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:59 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.wycpud", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:42:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:59 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:59.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:42:59 smithi049 ceph-mon[132694]: Deploying daemon mds.cephfs.smithi161.wycpud on smithi161 2024-02-22T00:42:59.978 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:59 smithi161 ceph-mon[113442]: pgmap v180: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:42:59.978 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:59 smithi161 ceph-mon[113442]: Upgrade: Updating mds.cephfs.smithi161.wycpud 2024-02-22T00:42:59.978 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:59 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:42:59.978 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:59 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.wycpud", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:42:59.978 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:59 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:42:59.978 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:42:59 smithi161 ceph-mon[113442]: Deploying daemon mds.cephfs.smithi161.wycpud on smithi161 2024-02-22T00:43:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:01 smithi049 ceph-mon[132694]: pgmap v182: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:01 smithi049 ceph-mon[132694]: osdmap e83: 6 total, 6 up, 6 in 2024-02-22T00:43:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:01 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-22T00:43:01.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:01 smithi161 ceph-mon[113442]: pgmap v182: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:01.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:01 smithi161 ceph-mon[113442]: osdmap e83: 6 total, 6 up, 6 in 2024-02-22T00:43:01.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:01 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-22T00:43:03.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:03 smithi049 ceph-mon[132694]: pgmap v183: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:03.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:03 smithi161 ceph-mon[113442]: pgmap v183: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:06.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:05 smithi161 ceph-mon[113442]: pgmap v184: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:06.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:05 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:06.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:05 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:06.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:05 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:43:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:05 smithi049 ceph-mon[132694]: pgmap v184: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:05 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:05 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:05 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:43:07.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:06 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] up:boot 2024-02-22T00:43:07.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:06 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:43:07.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:06 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:43:07.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:06 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] up:boot 2024-02-22T00:43:07.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:06 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:43:07.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:06 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:43:08.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:07 smithi161 ceph-mon[113442]: pgmap v185: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:07 smithi049 ceph-mon[132694]: pgmap v185: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:10.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:09 smithi161 ceph-mon[113442]: pgmap v186: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:10.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:09 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:10.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:09 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:09 smithi049 ceph-mon[132694]: pgmap v186: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:09 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:09 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:11.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:11 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:11.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:11 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:11.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:11 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:11.445 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:11 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:12.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:12 smithi049 ceph-mon[132694]: pgmap v187: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:12 smithi161 ceph-mon[113442]: pgmap v187: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:13.205 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:43:13.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:43:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: pgmap v188: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:43:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:43:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:43:14.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:14.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:14.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:14.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:14 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: pgmap v188: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:14.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:14.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:14 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:16.401 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:16 smithi161 ceph-mon[113442]: pgmap v189: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:16.401 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:16 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:16.401 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:16 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.plrhpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:43:16.401 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:16 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:43:16.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:16 smithi049 ceph-mon[132694]: pgmap v189: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:16 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:16 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi161.plrhpg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-22T00:43:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:16 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:43:17.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:17 smithi049 ceph-mon[132694]: Upgrade: Updating mds.cephfs.smithi161.plrhpg 2024-02-22T00:43:17.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:17 smithi049 ceph-mon[132694]: Deploying daemon mds.cephfs.smithi161.plrhpg on smithi161 2024-02-22T00:43:17.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:17 smithi161 ceph-mon[113442]: Upgrade: Updating mds.cephfs.smithi161.plrhpg 2024-02-22T00:43:17.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:17 smithi161 ceph-mon[113442]: Deploying daemon mds.cephfs.smithi161.plrhpg on smithi161 2024-02-22T00:43:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:18 smithi161 ceph-mon[113442]: pgmap v190: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:18 smithi161 ceph-mon[113442]: osdmap e84: 6 total, 6 up, 6 in 2024-02-22T00:43:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:18 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-22T00:43:18.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:18 smithi049 ceph-mon[132694]: pgmap v190: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:18.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:18 smithi049 ceph-mon[132694]: osdmap e84: 6 total, 6 up, 6 in 2024-02-22T00:43:18.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:18 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-22T00:43:19.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:19 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:43:19.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:19 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:43:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:20 smithi161 ceph-mon[113442]: pgmap v192: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:20 smithi049 ceph-mon[132694]: pgmap v192: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:22 smithi161 ceph-mon[113442]: pgmap v193: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:22 smithi049 ceph-mon[132694]: pgmap v193: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:23 smithi049 ceph-mon[132694]: pgmap v194: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:23 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:23 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:23 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:43:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:23 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] up:boot 2024-02-22T00:43:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:23 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:43:24.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:23 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:43:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:23 smithi161 ceph-mon[113442]: pgmap v194: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:23 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:23 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:23 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:43:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:23 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] up:boot 2024-02-22T00:43:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:23 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:43:24.294 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:23 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:43:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 -- 172.21.15.49:0/183821633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fe250 msgr2=0x7fae040f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:25.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 --2- 172.21.15.49:0/183821633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fe250 0x7fae040f7a30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fadec0047f0 tx=0x7fadec009cb0).stop 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 -- 172.21.15.49:0/183821633 shutdown_connections 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 --2- 172.21.15.49:0/183821633 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fe250 0x7fae040f7a30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 --2- 172.21.15.49:0/183821633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae040fd8f0 0x7fae040fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 -- 172.21.15.49:0/183821633 >> 172.21.15.49:0/183821633 conn(0x7fae040f34b0 msgr2=0x7fae040f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 -- 172.21.15.49:0/183821633 shutdown_connections 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 -- 172.21.15.49:0/183821633 wait complete. 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 Processor -- start 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.842+0000 7fae0a9ca700 1 -- start start 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae0a9ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fd8f0 0x7fae0410e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae0a9ca700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae040fe250 0x7fae0410e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae0a9ca700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0410ec30 con 0x7fae040fd8f0 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae0a9ca700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0410ed70 con 0x7fae040fe250 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae03fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fd8f0 0x7fae0410e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:25.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae03fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fd8f0 0x7fae0410e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33838/0 (socket says 172.21.15.49:33838) 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae03fff700 1 -- 172.21.15.49:0/3593446528 learned_addr learned my addr 172.21.15.49:0/3593446528 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae037fe700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae040fe250 0x7fae0410e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae03fff700 1 -- 172.21.15.49:0/3593446528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae040fe250 msgr2=0x7fae0410e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae03fff700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae040fe250 0x7fae0410e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.843+0000 7fae03fff700 1 -- 172.21.15.49:0/3593446528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec005040 con 0x7fae040fd8f0 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.844+0000 7fae03fff700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fd8f0 0x7fae0410e140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fadf400e910 tx=0x7fadf400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.844+0000 7fae017fa700 1 -- 172.21.15.49:0/3593446528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf4007b40 con 0x7fae040fd8f0 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.844+0000 7fae017fa700 1 -- 172.21.15.49:0/3593446528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fadf400f040 con 0x7fae040fd8f0 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.844+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae041083a0 con 0x7fae040fd8f0 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.844+0000 7fae017fa700 1 -- 172.21.15.49:0/3593446528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadf4014920 con 0x7fae040fd8f0 2024-02-22T00:43:25.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.844+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae04108960 con 0x7fae040fd8f0 2024-02-22T00:43:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.845+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0405f590 con 0x7fae040fd8f0 2024-02-22T00:43:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.845+0000 7fae017fa700 1 -- 172.21.15.49:0/3593446528 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fadf4007ca0 con 0x7fae040fd8f0 2024-02-22T00:43:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.846+0000 7fae017fa700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fadf006caa0 0x7fadf006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.846+0000 7fae017fa700 1 -- 172.21.15.49:0/3593446528 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fadf408b7d0 con 0x7fae040fd8f0 2024-02-22T00:43:25.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.846+0000 7fae037fe700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fadf006caa0 0x7fadf006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:25.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.847+0000 7fae037fe700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fadf006caa0 0x7fadf006ef60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fae04109a80 tx=0x7fadec009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:25.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:25.851+0000 7fae017fa700 1 -- 172.21.15.49:0/3593446528 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fadf4059330 con 0x7fae040fd8f0 2024-02-22T00:43:26.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.068+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae040ffc40 con 0x7fadf006caa0 2024-02-22T00:43:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.077+0000 7fae017fa700 1 -- 172.21.15.49:0/3593446528 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fae040ffc40 con 0x7fadf006caa0 2024-02-22T00:43:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fadf006caa0 msgr2=0x7fadf006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fadf006caa0 0x7fadf006ef60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fae04109a80 tx=0x7fadec009cb0).stop 2024-02-22T00:43:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fd8f0 msgr2=0x7fae0410e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fd8f0 0x7fae0410e140 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fadf400e910 tx=0x7fadf400b040).stop 2024-02-22T00:43:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 shutdown_connections 2024-02-22T00:43:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fadf006caa0 0x7fadf006ef60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae040fd8f0 0x7fae0410e140 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 --2- 172.21.15.49:0/3593446528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae040fe250 0x7fae0410e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 >> 172.21.15.49:0/3593446528 conn(0x7fae040f34b0 msgr2=0x7fae040fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 shutdown_connections 2024-02-22T00:43:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.079+0000 7fae0a9ca700 1 -- 172.21.15.49:0/3593446528 wait complete. 2024-02-22T00:43:26.096 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:43:26.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.186+0000 7fae984f4700 1 -- 172.21.15.49:0/2380023214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 msgr2=0x7fae900f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.186+0000 7fae984f4700 1 --2- 172.21.15.49:0/2380023214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 0x7fae900f8d00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fae8c0047f0 tx=0x7fae8c009cb0).stop 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 -- 172.21.15.49:0/2380023214 shutdown_connections 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 --2- 172.21.15.49:0/2380023214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900f91f0 0x7fae90101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 --2- 172.21.15.49:0/2380023214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 0x7fae900f8d00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 -- 172.21.15.49:0/2380023214 >> 172.21.15.49:0/2380023214 conn(0x7fae90070590 msgr2=0x7fae900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 -- 172.21.15.49:0/2380023214 shutdown_connections 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 -- 172.21.15.49:0/2380023214 wait complete. 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 Processor -- start 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 -- start start 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 0x7fae900f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900f91f0 0x7fae900f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae900f72b0 con 0x7fae900f8920 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.187+0000 7fae984f4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae900f73f0 con 0x7fae900f91f0 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae96290700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 0x7fae900f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae96290700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 0x7fae900f68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33846/0 (socket says 172.21.15.49:33846) 2024-02-22T00:43:26.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae96290700 1 -- 172.21.15.49:0/4107055145 learned_addr learned my addr 172.21.15.49:0/4107055145 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae95a8f700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900f91f0 0x7fae900f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae96290700 1 -- 172.21.15.49:0/4107055145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900f91f0 msgr2=0x7fae900f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae96290700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900f91f0 0x7fae900f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae96290700 1 -- 172.21.15.49:0/4107055145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c005040 con 0x7fae900f8920 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae96290700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 0x7fae900f68d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fae8c005010 tx=0x7fae8c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae877fe700 1 -- 172.21.15.49:0/4107055145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8c00e030 con 0x7fae900f8920 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae877fe700 1 -- 172.21.15.49:0/4107055145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae8c007e90 con 0x7fae900f8920 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae900f7640 con 0x7fae900f8920 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae877fe700 1 -- 172.21.15.49:0/4107055145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8c018070 con 0x7fae900f8920 2024-02-22T00:43:26.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.188+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae90114640 con 0x7fae900f8920 2024-02-22T00:43:26.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.189+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9005f590 con 0x7fae900f8920 2024-02-22T00:43:26.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.190+0000 7fae877fe700 1 -- 172.21.15.49:0/4107055145 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fae8c01d670 con 0x7fae900f8920 2024-02-22T00:43:26.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.190+0000 7fae877fe700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae7c06caa0 0x7fae7c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.190+0000 7fae877fe700 1 -- 172.21.15.49:0/4107055145 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fae8c08cf50 con 0x7fae900f8920 2024-02-22T00:43:26.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.190+0000 7fae95a8f700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae7c06caa0 0x7fae7c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.191+0000 7fae95a8f700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae7c06caa0 0x7fae7c06ef60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fae900f8070 tx=0x7fae8000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:26.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.195+0000 7fae877fe700 1 -- 172.21.15.49:0/4107055145 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fae8c0c0190 con 0x7fae900f8920 2024-02-22T00:43:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:25 smithi161 ceph-mon[113442]: pgmap v195: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:26.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.411+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae90059120 con 0x7fae7c06caa0 2024-02-22T00:43:26.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.412+0000 7fae877fe700 1 -- 172.21.15.49:0/4107055145 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fae90059120 con 0x7fae7c06caa0 2024-02-22T00:43:26.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae7c06caa0 msgr2=0x7fae7c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae7c06caa0 0x7fae7c06ef60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fae900f8070 tx=0x7fae8000b040).stop 2024-02-22T00:43:26.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 msgr2=0x7fae900f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 0x7fae900f68d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fae8c005010 tx=0x7fae8c009cb0).stop 2024-02-22T00:43:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 shutdown_connections 2024-02-22T00:43:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae7c06caa0 0x7fae7c06ef60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae900f8920 0x7fae900f68d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 --2- 172.21.15.49:0/4107055145 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900f91f0 0x7fae900f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 >> 172.21.15.49:0/4107055145 conn(0x7fae90070590 msgr2=0x7fae900fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 shutdown_connections 2024-02-22T00:43:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.414+0000 7fae984f4700 1 -- 172.21.15.49:0/4107055145 wait complete. 2024-02-22T00:43:26.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:25 smithi049 ceph-mon[132694]: pgmap v195: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:26.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.516+0000 7f1466ee5700 1 -- 172.21.15.49:0/967812775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 msgr2=0x7f14600fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.516+0000 7f1466ee5700 1 --2- 172.21.15.49:0/967812775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 0x7f14600fcbd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f14540047f0 tx=0x7f1454009cb0).stop 2024-02-22T00:43:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.516+0000 7f1466ee5700 1 -- 172.21.15.49:0/967812775 shutdown_connections 2024-02-22T00:43:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.516+0000 7f1466ee5700 1 --2- 172.21.15.49:0/967812775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14600fd150 0x7f14600f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.516+0000 7f1466ee5700 1 --2- 172.21.15.49:0/967812775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 0x7f14600fcbd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.516+0000 7f1466ee5700 1 -- 172.21.15.49:0/967812775 >> 172.21.15.49:0/967812775 conn(0x7f1460070590 msgr2=0x7f14600f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.516+0000 7f1466ee5700 1 -- 172.21.15.49:0/967812775 shutdown_connections 2024-02-22T00:43:26.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.516+0000 7f1466ee5700 1 -- 172.21.15.49:0/967812775 wait complete. 2024-02-22T00:43:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.517+0000 7f1466ee5700 1 Processor -- start 2024-02-22T00:43:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.517+0000 7f1466ee5700 1 -- start start 2024-02-22T00:43:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.517+0000 7f1466ee5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 0x7f14600f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.517+0000 7f1466ee5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14600fd150 0x7f14600f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.517+0000 7f1466ee5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600f8f20 con 0x7f14600fc7f0 2024-02-22T00:43:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.517+0000 7f1466ee5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600f9060 con 0x7f14600fd150 2024-02-22T00:43:26.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.517+0000 7f1464c81700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 0x7f14600f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.517+0000 7f1464c81700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 0x7f14600f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33868/0 (socket says 172.21.15.49:33868) 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f145ffff700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14600fd150 0x7f14600f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f1464c81700 1 -- 172.21.15.49:0/2410101526 learned_addr learned my addr 172.21.15.49:0/2410101526 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f1464c81700 1 -- 172.21.15.49:0/2410101526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14600fd150 msgr2=0x7f14600f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f1464c81700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14600fd150 0x7f14600f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f1464c81700 1 -- 172.21.15.49:0/2410101526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1454005040 con 0x7f14600fc7f0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f145ffff700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14600fd150 0x7f14600f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f1464c81700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 0x7f14600f8540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f1454009380 tx=0x7f1454009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f145dffb700 1 -- 172.21.15.49:0/2410101526 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1454018070 con 0x7f14600fc7f0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f145dffb700 1 -- 172.21.15.49:0/2410101526 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1454007e90 con 0x7f14600fc7f0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14600f92e0 con 0x7f14600fc7f0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f145dffb700 1 -- 172.21.15.49:0/2410101526 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f145401c380 con 0x7f14600fc7f0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.518+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1460114770 con 0x7f14600fc7f0 2024-02-22T00:43:26.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.519+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146005f590 con 0x7f14600fc7f0 2024-02-22T00:43:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.520+0000 7f145dffb700 1 -- 172.21.15.49:0/2410101526 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f14540123c0 con 0x7f14600fc7f0 2024-02-22T00:43:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.520+0000 7f145dffb700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f145006cab0 0x7f145006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.520+0000 7f145dffb700 1 -- 172.21.15.49:0/2410101526 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f145408ca90 con 0x7f14600fc7f0 2024-02-22T00:43:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.520+0000 7f145ffff700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f145006cab0 0x7f145006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.521+0000 7f145ffff700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f145006cab0 0x7f145006ef70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f14600f9ce0 tx=0x7f144c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:26.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.525+0000 7f145dffb700 1 -- 172.21.15.49:0/2410101526 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1454056b60 con 0x7f14600fc7f0 2024-02-22T00:43:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.731+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14600fb5a0 con 0x7f145006cab0 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.742+0000 7f145dffb700 1 -- 172.21.15.49:0/2410101526 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f14600fb5a0 con 0x7f145006cab0 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (6m) 34s ago 17m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (4m) 34s ago 17m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (4m) 0s ago 17m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (6m) 34s ago 17m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (38s) 34s ago 12m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (53s) 34s ago 12m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:43:26.744 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (4s) 0s ago 12m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (21s) 0s ago 12m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (8m) 34s ago 19m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (7m) 0s ago 17m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (5m) 34s ago 19m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (4m) 0s ago 17m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (7m) 34s ago 17m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (7m) 0s ago 16m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (3m) 34s ago 16m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (3m) 34s ago 15m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (2m) 34s ago 15m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (2m) 0s ago 15m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (105s) 0s ago 14m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (72s) 0s ago 14m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:43:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (6m) 0s ago 16m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:43:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f145006cab0 msgr2=0x7f145006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f145006cab0 0x7f145006ef70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f14600f9ce0 tx=0x7f144c00b040).stop 2024-02-22T00:43:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 msgr2=0x7f14600f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 0x7f14600f8540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f1454009380 tx=0x7f1454009cb0).stop 2024-02-22T00:43:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 shutdown_connections 2024-02-22T00:43:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f145006cab0 0x7f145006ef70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14600fc7f0 0x7f14600f8540 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 --2- 172.21.15.49:0/2410101526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14600fd150 0x7f14600f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 >> 172.21.15.49:0/2410101526 conn(0x7f1460070590 msgr2=0x7f1460060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 shutdown_connections 2024-02-22T00:43:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.744+0000 7f1466ee5700 1 -- 172.21.15.49:0/2410101526 wait complete. 2024-02-22T00:43:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 -- 172.21.15.49:0/3565685898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fc7f0 msgr2=0x7f82240fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 --2- 172.21.15.49:0/3565685898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fc7f0 0x7f82240fcbd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f82140047f0 tx=0x7f8214009cb0).stop 2024-02-22T00:43:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 -- 172.21.15.49:0/3565685898 shutdown_connections 2024-02-22T00:43:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 --2- 172.21.15.49:0/3565685898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82240fd150 0x7f82240f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 --2- 172.21.15.49:0/3565685898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fc7f0 0x7f82240fcbd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 -- 172.21.15.49:0/3565685898 >> 172.21.15.49:0/3565685898 conn(0x7f8224070590 msgr2=0x7f82240f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 -- 172.21.15.49:0/3565685898 shutdown_connections 2024-02-22T00:43:26.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 -- 172.21.15.49:0/3565685898 wait complete. 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 Processor -- start 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.845+0000 7f822a3f6700 1 -- start start 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f822a3f6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82240fc7f0 0x7f82240f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f822a3f6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fd150 0x7f82240f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f822a3f6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82240fa160 con 0x7f82240fd150 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f822a3f6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82240fa2a0 con 0x7f82240fc7f0 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f82237fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fd150 0x7f82240f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f82237fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fd150 0x7f82240f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33882/0 (socket says 172.21.15.49:33882) 2024-02-22T00:43:26.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f82237fe700 1 -- 172.21.15.49:0/1535217225 learned_addr learned my addr 172.21.15.49:0/1535217225 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f8223fff700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82240fc7f0 0x7f82240f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f82237fe700 1 -- 172.21.15.49:0/1535217225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82240fc7f0 msgr2=0x7f82240f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f82237fe700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82240fc7f0 0x7f82240f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f82237fe700 1 -- 172.21.15.49:0/1535217225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214005040 con 0x7f82240fd150 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.846+0000 7f82237fe700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fd150 0x7f82240f8a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f821800e940 tx=0x7f821800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.847+0000 7f82217fa700 1 -- 172.21.15.49:0/1535217225 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8218007b40 con 0x7f82240fd150 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.847+0000 7f82217fa700 1 -- 172.21.15.49:0/1535217225 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f821800f040 con 0x7f82240fd150 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.847+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82240f8f20 con 0x7f82240fd150 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.847+0000 7f82217fa700 1 -- 172.21.15.49:0/1535217225 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82180148e0 con 0x7f82240fd150 2024-02-22T00:43:26.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.847+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8224118d80 con 0x7f82240fd150 2024-02-22T00:43:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.847+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822405f590 con 0x7f82240fd150 2024-02-22T00:43:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.848+0000 7f82217fa700 1 -- 172.21.15.49:0/1535217225 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8218007ca0 con 0x7f82240fd150 2024-02-22T00:43:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.849+0000 7f82217fa700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f820c06caa0 0x7f820c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.849+0000 7f82217fa700 1 -- 172.21.15.49:0/1535217225 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f821808b710 con 0x7f82240fd150 2024-02-22T00:43:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.849+0000 7f8223fff700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f820c06caa0 0x7f820c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:26.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.849+0000 7f8223fff700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f820c06caa0 0x7f820c06ef60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f82140047c0 tx=0x7f8214009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:26.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:26.853+0000 7f82217fa700 1 -- 172.21.15.49:0/1535217225 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f82180557e0 con 0x7f82240fd150 2024-02-22T00:43:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.135+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f82240f9a20 con 0x7f82240fd150 2024-02-22T00:43:27.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.136+0000 7f82217fa700 1 -- 172.21.15.49:0/1535217225 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f8218058e00 con 0x7f82240fd150 2024-02-22T00:43:27.138 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:43:27.138 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:43:27.138 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:43:27.139 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:43:27.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f820c06caa0 msgr2=0x7f820c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f820c06caa0 0x7f820c06ef60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f82140047c0 tx=0x7f8214009cb0).stop 2024-02-22T00:43:27.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fd150 msgr2=0x7f82240f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fd150 0x7f82240f8a30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f821800e940 tx=0x7f821800b040).stop 2024-02-22T00:43:27.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 shutdown_connections 2024-02-22T00:43:27.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f820c06caa0 0x7f820c06ef60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82240fc7f0 0x7f82240f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 --2- 172.21.15.49:0/1535217225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82240fd150 0x7f82240f8a30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 >> 172.21.15.49:0/1535217225 conn(0x7f8224070590 msgr2=0x7f8224060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:27.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 shutdown_connections 2024-02-22T00:43:27.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.138+0000 7f822a3f6700 1 -- 172.21.15.49:0/1535217225 wait complete. 2024-02-22T00:43:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:26 smithi161 ceph-mon[113442]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:43:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:27.170 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:26 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.240+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2827730366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fd150 msgr2=0x7f17f40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.240+0000 7f17fa1fd700 1 --2- 172.21.15.49:0/2827730366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fd150 0x7f17f40f6930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f17e80047f0 tx=0x7f17e8009cb0).stop 2024-02-22T00:43:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.240+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2827730366 shutdown_connections 2024-02-22T00:43:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.240+0000 7f17fa1fd700 1 --2- 172.21.15.49:0/2827730366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fd150 0x7f17f40f6930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.240+0000 7f17fa1fd700 1 --2- 172.21.15.49:0/2827730366 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17f40fc7f0 0x7f17f40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.240+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2827730366 >> 172.21.15.49:0/2827730366 conn(0x7f17f4070590 msgr2=0x7f17f40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.240+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2827730366 shutdown_connections 2024-02-22T00:43:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.240+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2827730366 wait complete. 2024-02-22T00:43:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17fa1fd700 1 Processor -- start 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17fa1fd700 1 -- start start 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17fa1fd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fc7f0 0x7f17f410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17fa1fd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17f40fd150 0x7f17f410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17fa1fd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f410eab0 con 0x7f17f40fc7f0 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17fa1fd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f410ebf0 con 0x7f17f40fd150 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17f37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fc7f0 0x7f17f410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17f37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fc7f0 0x7f17f410dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33898/0 (socket says 172.21.15.49:33898) 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17f37fe700 1 -- 172.21.15.49:0/2084026990 learned_addr learned my addr 172.21.15.49:0/2084026990 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17f2ffd700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17f40fd150 0x7f17f410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17f37fe700 1 -- 172.21.15.49:0/2084026990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17f40fd150 msgr2=0x7f17f410e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17f37fe700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17f40fd150 0x7f17f410e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.241+0000 7f17f37fe700 1 -- 172.21.15.49:0/2084026990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8005040 con 0x7f17f40fc7f0 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.242+0000 7f17f37fe700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fc7f0 0x7f17f410dfc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f17e400c740 tx=0x7f17e4007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.242+0000 7f17f0ff9700 1 -- 172.21.15.49:0/2084026990 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17e400e680 con 0x7f17f40fc7f0 2024-02-22T00:43:27.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.242+0000 7f17f0ff9700 1 -- 172.21.15.49:0/2084026990 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f17e400ec90 con 0x7f17f40fc7f0 2024-02-22T00:43:27.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.242+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f4108280 con 0x7f17f40fc7f0 2024-02-22T00:43:27.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.242+0000 7f17f0ff9700 1 -- 172.21.15.49:0/2084026990 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17e4013d60 con 0x7f17f40fc7f0 2024-02-22T00:43:27.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.242+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f4108840 con 0x7f17f40fc7f0 2024-02-22T00:43:27.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.243+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f405f590 con 0x7f17f40fc7f0 2024-02-22T00:43:27.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.243+0000 7f17f0ff9700 1 -- 172.21.15.49:0/2084026990 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f17e400e7e0 con 0x7f17f40fc7f0 2024-02-22T00:43:27.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.244+0000 7f17f0ff9700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17dc06caa0 0x7f17dc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.244+0000 7f17f0ff9700 1 -- 172.21.15.49:0/2084026990 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f17e408c0a0 con 0x7f17f40fc7f0 2024-02-22T00:43:27.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.244+0000 7f17f2ffd700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17dc06caa0 0x7f17dc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.244+0000 7f17f2ffd700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17dc06caa0 0x7f17dc06ef60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f17e8004f10 tx=0x7f17e800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:27.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.248+0000 7f17f0ff9700 1 -- 172.21.15.49:0/2084026990 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f17e4059c00 con 0x7f17f40fc7f0 2024-02-22T00:43:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:26 smithi049 ceph-mon[132694]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:43:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:27.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:26 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:43:27.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.491+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f17f4109740 con 0x7f17f40fc7f0 2024-02-22T00:43:27.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.491+0000 7f17f0ff9700 1 -- 172.21.15.49:0/2084026990 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f17e4059790 con 0x7f17f40fc7f0 2024-02-22T00:43:27.493 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:43:27.494 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:43:27.495 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:43:27.496 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:43:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17dc06caa0 msgr2=0x7f17dc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17dc06caa0 0x7f17dc06ef60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f17e8004f10 tx=0x7f17e800b040).stop 2024-02-22T00:43:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fc7f0 msgr2=0x7f17f410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fc7f0 0x7f17f410dfc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f17e400c740 tx=0x7f17e4007ef0).stop 2024-02-22T00:43:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 shutdown_connections 2024-02-22T00:43:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17dc06caa0 0x7f17dc06ef60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17f40fc7f0 0x7f17f410dfc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 --2- 172.21.15.49:0/2084026990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17f40fd150 0x7f17f410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.493+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 >> 172.21.15.49:0/2084026990 conn(0x7f17f4070590 msgr2=0x7f17f4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.494+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 shutdown_connections 2024-02-22T00:43:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.494+0000 7f17fa1fd700 1 -- 172.21.15.49:0/2084026990 wait complete. 2024-02-22T00:43:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:43:27.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.596+0000 7f65abb74700 1 -- 172.21.15.49:0/3641586129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fc7f0 msgr2=0x7f65a40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.596+0000 7f65abb74700 1 --2- 172.21.15.49:0/3641586129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fc7f0 0x7f65a40fcbd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f65a00047f0 tx=0x7f65a0009cb0).stop 2024-02-22T00:43:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.596+0000 7f65abb74700 1 -- 172.21.15.49:0/3641586129 shutdown_connections 2024-02-22T00:43:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.596+0000 7f65abb74700 1 --2- 172.21.15.49:0/3641586129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a40fd150 0x7f65a40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.596+0000 7f65abb74700 1 --2- 172.21.15.49:0/3641586129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fc7f0 0x7f65a40fcbd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.596+0000 7f65abb74700 1 -- 172.21.15.49:0/3641586129 >> 172.21.15.49:0/3641586129 conn(0x7f65a4070590 msgr2=0x7f65a40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.596+0000 7f65abb74700 1 -- 172.21.15.49:0/3641586129 shutdown_connections 2024-02-22T00:43:27.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.596+0000 7f65abb74700 1 -- 172.21.15.49:0/3641586129 wait complete. 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65abb74700 1 Processor -- start 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65abb74700 1 -- start start 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65abb74700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a40fc7f0 0x7f65a41090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65abb74700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fd150 0x7f65a41095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65abb74700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4109ab0 con 0x7f65a40fd150 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65abb74700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a4109bf0 con 0x7f65a40fc7f0 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65a910f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fd150 0x7f65a41095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65a910f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fd150 0x7f65a41095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33910/0 (socket says 172.21.15.49:33910) 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.597+0000 7f65a910f700 1 -- 172.21.15.49:0/2752188303 learned_addr learned my addr 172.21.15.49:0/2752188303 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:27.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f65a9910700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a40fc7f0 0x7f65a41090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f65a910f700 1 -- 172.21.15.49:0/2752188303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a40fc7f0 msgr2=0x7f65a41090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f65a910f700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a40fc7f0 0x7f65a41090d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f65a910f700 1 -- 172.21.15.49:0/2752188303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0005040 con 0x7f65a40fd150 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f65a910f700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fd150 0x7f65a41095c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f65940044e0 tx=0x7f6594002a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f659affd700 1 -- 172.21.15.49:0/2752188303 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6594007b40 con 0x7f65a40fd150 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f659affd700 1 -- 172.21.15.49:0/2752188303 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f659400f040 con 0x7f65a40fd150 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a4109ea0 con 0x7f65a40fd150 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f659affd700 1 -- 172.21.15.49:0/2752188303 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6594014850 con 0x7f65a40fd150 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.598+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a4112440 con 0x7f65a40fd150 2024-02-22T00:43:27.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.599+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a405f590 con 0x7f65a40fd150 2024-02-22T00:43:27.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.600+0000 7f659affd700 1 -- 172.21.15.49:0/2752188303 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6594009110 con 0x7f65a40fd150 2024-02-22T00:43:27.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.600+0000 7f659affd700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f659006caa0 0x7f659006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.600+0000 7f659affd700 1 -- 172.21.15.49:0/2752188303 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f659408b810 con 0x7f65a40fd150 2024-02-22T00:43:27.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.600+0000 7f65a9910700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f659006caa0 0x7f659006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.600+0000 7f65a9910700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f659006caa0 0x7f659006ef60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f65a0004f10 tx=0x7f65a000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:27.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.604+0000 7f659affd700 1 -- 172.21.15.49:0/2752188303 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f65940558e0 con 0x7f65a40fd150 2024-02-22T00:43:27.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.821+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65a4060d50 con 0x7f659006caa0 2024-02-22T00:43:27.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.822+0000 7f659affd700 1 -- 172.21.15.49:0/2752188303 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f65a4060d50 con 0x7f659006caa0 2024-02-22T00:43:27.824 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:43:27.824 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:43:27.824 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:43:27.824 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:43:27.824 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:43:27.824 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:43:27.825 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:43:27.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f659006caa0 msgr2=0x7f659006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f659006caa0 0x7f659006ef60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f65a0004f10 tx=0x7f65a000b040).stop 2024-02-22T00:43:27.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fd150 msgr2=0x7f65a41095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fd150 0x7f65a41095c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f65940044e0 tx=0x7f6594002a50).stop 2024-02-22T00:43:27.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 shutdown_connections 2024-02-22T00:43:27.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f659006caa0 0x7f659006ef60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65a40fc7f0 0x7f65a41090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 --2- 172.21.15.49:0/2752188303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f65a40fd150 0x7f65a41095c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 >> 172.21.15.49:0/2752188303 conn(0x7f65a4070590 msgr2=0x7f65a40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:27.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 shutdown_connections 2024-02-22T00:43:27.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.824+0000 7f65abb74700 1 -- 172.21.15.49:0/2752188303 wait complete. 2024-02-22T00:43:27.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 -- 172.21.15.49:0/3649274613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fd150 msgr2=0x7fc3640f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 --2- 172.21.15.49:0/3649274613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fd150 0x7fc3640f6930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fc3500047f0 tx=0x7fc350009cb0).stop 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 -- 172.21.15.49:0/3649274613 shutdown_connections 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 --2- 172.21.15.49:0/3649274613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fd150 0x7fc3640f6930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 --2- 172.21.15.49:0/3649274613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3640fc7f0 0x7fc3640fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 -- 172.21.15.49:0/3649274613 >> 172.21.15.49:0/3649274613 conn(0x7fc364070590 msgr2=0x7fc3640f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 -- 172.21.15.49:0/3649274613 shutdown_connections 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 -- 172.21.15.49:0/3649274613 wait complete. 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 Processor -- start 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.926+0000 7fc36ac30700 1 -- start start 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc36ac30700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fc7f0 0x7fc36410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc36ac30700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3640fd150 0x7fc36410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc36ac30700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36410eab0 con 0x7fc3640fc7f0 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc36ac30700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36410ebf0 con 0x7fc3640fd150 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc3689cc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fc7f0 0x7fc36410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc3689cc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fc7f0 0x7fc36410dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33934/0 (socket says 172.21.15.49:33934) 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc3689cc700 1 -- 172.21.15.49:0/3531182614 learned_addr learned my addr 172.21.15.49:0/3531182614 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc363fff700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3640fd150 0x7fc36410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc3689cc700 1 -- 172.21.15.49:0/3531182614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3640fd150 msgr2=0x7fc36410e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc3689cc700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3640fd150 0x7fc36410e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc3689cc700 1 -- 172.21.15.49:0/3531182614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350005040 con 0x7fc3640fc7f0 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc3689cc700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fc7f0 0x7fc36410dfc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fc3580041d0 tx=0x7fc358009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc361ffb700 1 -- 172.21.15.49:0/3531182614 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc358007b40 con 0x7fc3640fc7f0 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc361ffb700 1 -- 172.21.15.49:0/3531182614 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc35800f040 con 0x7fc3640fc7f0 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc364108280 con 0x7fc3640fc7f0 2024-02-22T00:43:27.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.927+0000 7fc361ffb700 1 -- 172.21.15.49:0/3531182614 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3580147b0 con 0x7fc3640fc7f0 2024-02-22T00:43:27.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.928+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc364108840 con 0x7fc3640fc7f0 2024-02-22T00:43:27.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.929+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36405f590 con 0x7fc3640fc7f0 2024-02-22T00:43:27.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.929+0000 7fc361ffb700 1 -- 172.21.15.49:0/3531182614 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc358009110 con 0x7fc3640fc7f0 2024-02-22T00:43:27.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.929+0000 7fc361ffb700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc35406caa0 0x7fc35406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:27.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.929+0000 7fc361ffb700 1 -- 172.21.15.49:0/3531182614 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc35808bcd0 con 0x7fc3640fc7f0 2024-02-22T00:43:27.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.930+0000 7fc363fff700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc35406caa0 0x7fc35406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:27.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.930+0000 7fc363fff700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc35406caa0 0x7fc35406ef60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc364109900 tx=0x7fc35000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:27.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:27.934+0000 7fc361ffb700 1 -- 172.21.15.49:0/3531182614 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc358059830 con 0x7fc3640fc7f0 2024-02-22T00:43:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.214+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc364047540 con 0x7fc3640fc7f0 2024-02-22T00:43:28.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.215+0000 7fc361ffb700 1 -- 172.21.15.49:0/3531182614 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fc3580593c0 con 0x7fc3640fc7f0 2024-02-22T00:43:28.217 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:43:28.217 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:43:28.217 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:43:28.217 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:43:28.218 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:43:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc35406caa0 msgr2=0x7fc35406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc35406caa0 0x7fc35406ef60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc364109900 tx=0x7fc35000b040).stop 2024-02-22T00:43:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fc7f0 msgr2=0x7fc36410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fc7f0 0x7fc36410dfc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fc3580041d0 tx=0x7fc358009f60).stop 2024-02-22T00:43:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 shutdown_connections 2024-02-22T00:43:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc35406caa0 0x7fc35406ef60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc3640fc7f0 0x7fc36410dfc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:28.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 --2- 172.21.15.49:0/3531182614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3640fd150 0x7fc36410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 >> 172.21.15.49:0/3531182614 conn(0x7fc364070590 msgr2=0x7fc364060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 shutdown_connections 2024-02-22T00:43:28.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:28.217+0000 7fc36ac30700 1 -- 172.21.15.49:0/3531182614 wait complete. 2024-02-22T00:43:28.263 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:27 smithi161 ceph-mon[113442]: pgmap v196: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:28.264 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:27 smithi161 ceph-mon[113442]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:43:28.264 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:27 smithi161 ceph-mon[113442]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:43:28.264 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:27 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1535217225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:28.264 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:27 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:43:28.264 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:27 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2084026990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:43:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:27 smithi049 ceph-mon[132694]: pgmap v196: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:27 smithi049 ceph-mon[132694]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:43:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:27 smithi049 ceph-mon[132694]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:43:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:27 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1535217225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:43:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:27 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:43:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:27 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2084026990' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:43:29.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:28 smithi161 ceph-mon[113442]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:43:29.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:28 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3531182614' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:43:29.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:28 smithi049 ceph-mon[132694]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:43:29.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:28 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3531182614' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:43:30.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:29 smithi161 ceph-mon[113442]: pgmap v197: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:29 smithi049 ceph-mon[132694]: pgmap v197: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:32.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:31 smithi049 ceph-mon[132694]: pgmap v198: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:31 smithi161 ceph-mon[113442]: pgmap v198: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:34.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:33 smithi161 ceph-mon[113442]: pgmap v199: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:33 smithi049 ceph-mon[132694]: pgmap v199: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:36 smithi161 ceph-mon[113442]: pgmap v200: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:36.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:36 smithi049 ceph-mon[132694]: pgmap v200: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:38.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:38 smithi161 ceph-mon[113442]: pgmap v201: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:38 smithi049 ceph-mon[132694]: pgmap v201: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:40.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:40 smithi161 ceph-mon[113442]: pgmap v202: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:40 smithi049 ceph-mon[132694]: pgmap v202: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:42.178 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:42 smithi049 ceph-mon[132694]: pgmap v203: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:42.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:42 smithi161 ceph-mon[113442]: pgmap v203: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:43.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:43:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:43:44.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:44 smithi161 ceph-mon[113442]: pgmap v204: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:44.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:44 smithi049 ceph-mon[132694]: pgmap v204: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:46.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:46 smithi161 ceph-mon[113442]: pgmap v205: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:46 smithi049 ceph-mon[132694]: pgmap v205: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:48.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:48 smithi161 ceph-mon[113442]: pgmap v206: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:48 smithi049 ceph-mon[132694]: pgmap v206: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:50.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:50 smithi161 ceph-mon[113442]: pgmap v207: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:50 smithi049 ceph-mon[132694]: pgmap v207: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:52.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:52 smithi161 ceph-mon[113442]: pgmap v208: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:52 smithi049 ceph-mon[132694]: pgmap v208: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:54.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:54 smithi161 ceph-mon[113442]: pgmap v209: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:54 smithi049 ceph-mon[132694]: pgmap v209: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:56.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:56 smithi161 ceph-mon[113442]: pgmap v210: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:56 smithi049 ceph-mon[132694]: pgmap v210: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:58.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:58 smithi161 ceph-mon[113442]: pgmap v211: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:58.295 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:43:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 -- 172.21.15.49:0/3521062015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 msgr2=0x7f6a7c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 --2- 172.21.15.49:0/3521062015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 0x7f6a7c0f7a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f6a680047f0 tx=0x7f6a68009cb0).stop 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 -- 172.21.15.49:0/3521062015 shutdown_connections 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 --2- 172.21.15.49:0/3521062015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 0x7f6a7c0f7a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 --2- 172.21.15.49:0/3521062015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c0fd8f0 0x7f6a7c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 -- 172.21.15.49:0/3521062015 >> 172.21.15.49:0/3521062015 conn(0x7f6a7c0f34b0 msgr2=0x7f6a7c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 -- 172.21.15.49:0/3521062015 shutdown_connections 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 -- 172.21.15.49:0/3521062015 wait complete. 2024-02-22T00:43:58.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.333+0000 7f6a82d35700 1 Processor -- start 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a82d35700 1 -- start start 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a82d35700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c0fd8f0 0x7f6a7c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a82d35700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 0x7f6a7c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a82d35700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c10eae0 con 0x7f6a7c0fe250 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a82d35700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c10ec20 con 0x7f6a7c0fd8f0 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a7bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 0x7f6a7c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a7bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 0x7f6a7c10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56358/0 (socket says 172.21.15.49:56358) 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a7bfff700 1 -- 172.21.15.49:0/4249200321 learned_addr learned my addr 172.21.15.49:0/4249200321 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a80ad1700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c0fd8f0 0x7f6a7c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a7bfff700 1 -- 172.21.15.49:0/4249200321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c0fd8f0 msgr2=0x7f6a7c10dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a7bfff700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c0fd8f0 0x7f6a7c10dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a7bfff700 1 -- 172.21.15.49:0/4249200321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68005040 con 0x7f6a7c0fe250 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a80ad1700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c0fd8f0 0x7f6a7c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:43:58.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.334+0000 7f6a7bfff700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 0x7f6a7c10e4e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f6a680099f0 tx=0x7f6a68009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.335+0000 7f6a79ffb700 1 -- 172.21.15.49:0/4249200321 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a6800e030 con 0x7f6a7c0fe250 2024-02-22T00:43:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.335+0000 7f6a79ffb700 1 -- 172.21.15.49:0/4249200321 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a68007e90 con 0x7f6a7c0fe250 2024-02-22T00:43:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.335+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c108250 con 0x7f6a7c0fe250 2024-02-22T00:43:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.335+0000 7f6a79ffb700 1 -- 172.21.15.49:0/4249200321 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a68018070 con 0x7f6a7c0fe250 2024-02-22T00:43:58.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.335+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c1087b0 con 0x7f6a7c0fe250 2024-02-22T00:43:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.336+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c05f590 con 0x7f6a7c0fe250 2024-02-22T00:43:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.336+0000 7f6a79ffb700 1 -- 172.21.15.49:0/4249200321 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6a68009590 con 0x7f6a7c0fe250 2024-02-22T00:43:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.337+0000 7f6a79ffb700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6a6c06ca30 0x7f6a6c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.337+0000 7f6a79ffb700 1 -- 172.21.15.49:0/4249200321 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6a6808d040 con 0x7f6a7c0fe250 2024-02-22T00:43:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.337+0000 7f6a80ad1700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6a6c06ca30 0x7f6a6c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:58.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.337+0000 7f6a80ad1700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6a6c06ca30 0x7f6a6c06eef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6a70009250 tx=0x7f6a70009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:58.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.341+0000 7f6a79ffb700 1 -- 172.21.15.49:0/4249200321 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6a6805aba0 con 0x7f6a7c0fe250 2024-02-22T00:43:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:58 smithi049 ceph-mon[132694]: pgmap v211: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:43:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:43:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:43:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.556+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a7c0ffc40 con 0x7f6a6c06ca30 2024-02-22T00:43:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.557+0000 7f6a79ffb700 1 -- 172.21.15.49:0/4249200321 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f6a7c0ffc40 con 0x7f6a6c06ca30 2024-02-22T00:43:58.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6a6c06ca30 msgr2=0x7f6a6c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6a6c06ca30 0x7f6a6c06eef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6a70009250 tx=0x7f6a70009da0).stop 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 msgr2=0x7f6a7c10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 0x7f6a7c10e4e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f6a680099f0 tx=0x7f6a68009cb0).stop 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 shutdown_connections 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6a6c06ca30 0x7f6a6c06eef0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a7c0fd8f0 0x7f6a7c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 --2- 172.21.15.49:0/4249200321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6a7c0fe250 0x7f6a7c10e4e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.559+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 >> 172.21.15.49:0/4249200321 conn(0x7f6a7c0f34b0 msgr2=0x7f6a7c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.560+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 shutdown_connections 2024-02-22T00:43:58.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.560+0000 7f6a82d35700 1 -- 172.21.15.49:0/4249200321 wait complete. 2024-02-22T00:43:58.572 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.662+0000 7f622e146700 1 -- 172.21.15.49:0/1743453426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 msgr2=0x7f62280f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.662+0000 7f622e146700 1 --2- 172.21.15.49:0/1743453426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 0x7f62280f6930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f62100047f0 tx=0x7f6210009cb0).stop 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.662+0000 7f622e146700 1 -- 172.21.15.49:0/1743453426 shutdown_connections 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.662+0000 7f622e146700 1 --2- 172.21.15.49:0/1743453426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 0x7f62280f6930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.662+0000 7f622e146700 1 --2- 172.21.15.49:0/1743453426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62280fc7f0 0x7f62280fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.662+0000 7f622e146700 1 -- 172.21.15.49:0/1743453426 >> 172.21.15.49:0/1743453426 conn(0x7f6228070590 msgr2=0x7f62280f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.662+0000 7f622e146700 1 -- 172.21.15.49:0/1743453426 shutdown_connections 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.662+0000 7f622e146700 1 -- 172.21.15.49:0/1743453426 wait complete. 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f622e146700 1 Processor -- start 2024-02-22T00:43:58.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f622e146700 1 -- start start 2024-02-22T00:43:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f622e146700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62280fc7f0 0x7f622810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f622e146700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 0x7f622810e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f622e146700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622810eab0 con 0x7f62280fd150 2024-02-22T00:43:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f622e146700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622810ebf0 con 0x7f62280fc7f0 2024-02-22T00:43:58.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f6226ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 0x7f622810e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f6226ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 0x7f622810e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56370/0 (socket says 172.21.15.49:56370) 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.663+0000 7f6226ffd700 1 -- 172.21.15.49:0/1995354198 learned_addr learned my addr 172.21.15.49:0/1995354198 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f62277fe700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62280fc7f0 0x7f622810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f6226ffd700 1 -- 172.21.15.49:0/1995354198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62280fc7f0 msgr2=0x7f622810dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f6226ffd700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62280fc7f0 0x7f622810dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f6226ffd700 1 -- 172.21.15.49:0/1995354198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210005040 con 0x7f62280fd150 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f62277fe700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62280fc7f0 0x7f622810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f6226ffd700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 0x7f622810e4b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f6210000c00 tx=0x7f6210009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f6224ff9700 1 -- 172.21.15.49:0/1995354198 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f621000e030 con 0x7f62280fd150 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f6224ff9700 1 -- 172.21.15.49:0/1995354198 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6210007e90 con 0x7f62280fd150 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6228108220 con 0x7f62280fd150 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f6224ff9700 1 -- 172.21.15.49:0/1995354198 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6210018070 con 0x7f62280fd150 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.664+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6228108700 con 0x7f62280fd150 2024-02-22T00:43:58.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.665+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622805f590 con 0x7f62280fd150 2024-02-22T00:43:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.665+0000 7f6224ff9700 1 -- 172.21.15.49:0/1995354198 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f621001d420 con 0x7f62280fd150 2024-02-22T00:43:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.666+0000 7f6224ff9700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621406ca40 0x7f621406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.666+0000 7f6224ff9700 1 -- 172.21.15.49:0/1995354198 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f621008d020 con 0x7f62280fd150 2024-02-22T00:43:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.666+0000 7f62277fe700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621406ca40 0x7f621406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:58.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.666+0000 7f62277fe700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621406ca40 0x7f621406ef00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6218009250 tx=0x7f6218009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:58.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.670+0000 7f6224ff9700 1 -- 172.21.15.49:0/1995354198 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f621005ab80 con 0x7f62280fd150 2024-02-22T00:43:58.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.887+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6228108d90 con 0x7f621406ca40 2024-02-22T00:43:58.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.889+0000 7f6224ff9700 1 -- 172.21.15.49:0/1995354198 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f6228108d90 con 0x7f621406ca40 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.890+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621406ca40 msgr2=0x7f621406ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.890+0000 7f622e146700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621406ca40 0x7f621406ef00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6218009250 tx=0x7f6218009de0).stop 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.890+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 msgr2=0x7f622810e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.890+0000 7f622e146700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 0x7f622810e4b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f6210000c00 tx=0x7f6210009cb0).stop 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.891+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 shutdown_connections 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.891+0000 7f622e146700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621406ca40 0x7f621406ef00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.891+0000 7f622e146700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62280fc7f0 0x7f622810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.891+0000 7f622e146700 1 --2- 172.21.15.49:0/1995354198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62280fd150 0x7f622810e4b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.891+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 >> 172.21.15.49:0/1995354198 conn(0x7f6228070590 msgr2=0x7f6228060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:58.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.891+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 shutdown_connections 2024-02-22T00:43:58.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.891+0000 7f622e146700 1 -- 172.21.15.49:0/1995354198 wait complete. 2024-02-22T00:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.994+0000 7f666e737700 1 -- 172.21.15.49:0/245794908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fc810 msgr2=0x7f66680fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.994+0000 7f666e737700 1 --2- 172.21.15.49:0/245794908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fc810 0x7f66680fcbf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f66580047f0 tx=0x7f6658009cb0).stop 2024-02-22T00:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.994+0000 7f666e737700 1 -- 172.21.15.49:0/245794908 shutdown_connections 2024-02-22T00:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.994+0000 7f666e737700 1 --2- 172.21.15.49:0/245794908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66680fd170 0x7f66680f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.994+0000 7f666e737700 1 --2- 172.21.15.49:0/245794908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fc810 0x7f66680fcbf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.994+0000 7f666e737700 1 -- 172.21.15.49:0/245794908 >> 172.21.15.49:0/245794908 conn(0x7f66680f2410 msgr2=0x7f66680f4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.994+0000 7f666e737700 1 -- 172.21.15.49:0/245794908 shutdown_connections 2024-02-22T00:43:58.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.994+0000 7f666e737700 1 -- 172.21.15.49:0/245794908 wait complete. 2024-02-22T00:43:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.995+0000 7f666e737700 1 Processor -- start 2024-02-22T00:43:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.995+0000 7f666e737700 1 -- start start 2024-02-22T00:43:58.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.995+0000 7f666e737700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66680fc810 0x7f666810cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.995+0000 7f666e737700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fd170 0x7f666810d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.995+0000 7f666e737700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666810daa0 con 0x7f66680fd170 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.995+0000 7f666e737700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666810dbe0 con 0x7f66680fc810 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fd170 0x7f666810d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fd170 0x7f666810d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56396/0 (socket says 172.21.15.49:56396) 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66677fe700 1 -- 172.21.15.49:0/2308038210 learned_addr learned my addr 172.21.15.49:0/2308038210 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f6667fff700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66680fc810 0x7f666810cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66677fe700 1 -- 172.21.15.49:0/2308038210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66680fc810 msgr2=0x7f666810cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66677fe700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66680fc810 0x7f666810cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66677fe700 1 -- 172.21.15.49:0/2308038210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6658005040 con 0x7f66680fd170 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66677fe700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fd170 0x7f666810d4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f665c002820 tx=0x7f665c009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66657fa700 1 -- 172.21.15.49:0/2308038210 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f665c007b40 con 0x7f66680fd170 2024-02-22T00:43:58.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6668107270 con 0x7f66680fd170 2024-02-22T00:43:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66657fa700 1 -- 172.21.15.49:0/2308038210 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f665c00f040 con 0x7f66680fd170 2024-02-22T00:43:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f66657fa700 1 -- 172.21.15.49:0/2308038210 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f665c0148b0 con 0x7f66680fd170 2024-02-22T00:43:59.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.996+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66681077b0 con 0x7f66680fd170 2024-02-22T00:43:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.997+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666805f4f0 con 0x7f66680fd170 2024-02-22T00:43:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.998+0000 7f66657fa700 1 -- 172.21.15.49:0/2308038210 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f665c007ca0 con 0x7f66680fd170 2024-02-22T00:43:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.998+0000 7f66657fa700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f665006caa0 0x7f665006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.998+0000 7f66657fa700 1 -- 172.21.15.49:0/2308038210 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f665c08b840 con 0x7f66680fd170 2024-02-22T00:43:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.998+0000 7f6667fff700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f665006caa0 0x7f665006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:59.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:58.999+0000 7f6667fff700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f665006caa0 0x7f665006ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6658004f10 tx=0x7f665800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:59.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.003+0000 7f66657fa700 1 -- 172.21.15.49:0/2308038210 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f665c0593a0 con 0x7f66680fd170 2024-02-22T00:43:59.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.210+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6668107a30 con 0x7f665006caa0 2024-02-22T00:43:59.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.220+0000 7f66657fa700 1 -- 172.21.15.49:0/2308038210 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6668107a30 con 0x7f665006caa0 2024-02-22T00:43:59.222 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:43:59.222 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (7m) 66s ago 18m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:43:59.222 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (4m) 66s ago 18m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:43:59.222 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (4m) 33s ago 17m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:43:59.222 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (6m) 66s ago 18m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:43:59.222 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (70s) 66s ago 13m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (86s) 66s ago 13m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (36s) 33s ago 13m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (53s) 33s ago 13m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (8m) 66s ago 19m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (8m) 33s ago 17m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (5m) 66s ago 19m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (5m) 33s ago 17m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (7m) 66s ago 18m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (7m) 33s ago 17m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (4m) 66s ago 17m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (3m) 66s ago 16m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (3m) 66s ago 16m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (2m) 33s ago 15m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:43:59.223 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (2m) 33s ago 15m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:43:59.224 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (104s) 33s ago 14m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:43:59.224 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (7m) 33s ago 17m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:43:59.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.221+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f665006caa0 msgr2=0x7f665006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f665006caa0 0x7f665006ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6658004f10 tx=0x7f665800b040).stop 2024-02-22T00:43:59.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fd170 msgr2=0x7f666810d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fd170 0x7f666810d4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f665c002820 tx=0x7f665c009f20).stop 2024-02-22T00:43:59.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 shutdown_connections 2024-02-22T00:43:59.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f665006caa0 0x7f665006ef60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66680fc810 0x7f666810cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 --2- 172.21.15.49:0/2308038210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66680fd170 0x7f666810d4a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 >> 172.21.15.49:0/2308038210 conn(0x7f66680f2410 msgr2=0x7f66680fabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:59.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 shutdown_connections 2024-02-22T00:43:59.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.222+0000 7f666e737700 1 -- 172.21.15.49:0/2308038210 wait complete. 2024-02-22T00:43:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 -- 172.21.15.49:0/1300180956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fc7f0 msgr2=0x7fb46c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 --2- 172.21.15.49:0/1300180956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fc7f0 0x7fb46c0fcbd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fb45c0047f0 tx=0x7fb45c009cb0).stop 2024-02-22T00:43:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 -- 172.21.15.49:0/1300180956 shutdown_connections 2024-02-22T00:43:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 --2- 172.21.15.49:0/1300180956 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb46c0fd150 0x7fb46c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:43:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 --2- 172.21.15.49:0/1300180956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fc7f0 0x7fb46c0fcbd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 -- 172.21.15.49:0/1300180956 >> 172.21.15.49:0/1300180956 conn(0x7fb46c070590 msgr2=0x7fb46c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 -- 172.21.15.49:0/1300180956 shutdown_connections 2024-02-22T00:43:59.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 -- 172.21.15.49:0/1300180956 wait complete. 2024-02-22T00:43:59.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.323+0000 7fb472044700 1 Processor -- start 2024-02-22T00:43:59.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb472044700 1 -- start start 2024-02-22T00:43:59.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb472044700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb46c0fc7f0 0x7fb46c109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:59.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb472044700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fd150 0x7fb46c109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:59.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb472044700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c109bd0 con 0x7fb46c0fd150 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb472044700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c109d10 con 0x7fb46c0fc7f0 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb46affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fd150 0x7fb46c109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb46affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fd150 0x7fb46c109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56424/0 (socket says 172.21.15.49:56424) 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb46affd700 1 -- 172.21.15.49:0/1270777343 learned_addr learned my addr 172.21.15.49:0/1270777343 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb46b7fe700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb46c0fc7f0 0x7fb46c109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb46affd700 1 -- 172.21.15.49:0/1270777343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb46c0fc7f0 msgr2=0x7fb46c109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb46affd700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb46c0fc7f0 0x7fb46c109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb46affd700 1 -- 172.21.15.49:0/1270777343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c005040 con 0x7fb46c0fd150 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb46affd700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fd150 0x7fb46c109650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fb46000b480 tx=0x7fb4600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.324+0000 7fb468ff9700 1 -- 172.21.15.49:0/1270777343 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb460002500 con 0x7fb46c0fd150 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.325+0000 7fb468ff9700 1 -- 172.21.15.49:0/1270777343 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb460002b10 con 0x7fb46c0fd150 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.325+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c109fc0 con 0x7fb46c0fd150 2024-02-22T00:43:59.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.325+0000 7fb468ff9700 1 -- 172.21.15.49:0/1270777343 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb460012c90 con 0x7fb46c0fd150 2024-02-22T00:43:59.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.325+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c112550 con 0x7fb46c0fd150 2024-02-22T00:43:59.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.326+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c05f590 con 0x7fb46c0fd150 2024-02-22T00:43:59.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.326+0000 7fb468ff9700 1 -- 172.21.15.49:0/1270777343 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb460002660 con 0x7fb46c0fd150 2024-02-22T00:43:59.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.326+0000 7fb468ff9700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb45406caa0 0x7fb45406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:59.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.327+0000 7fb468ff9700 1 -- 172.21.15.49:0/1270777343 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb46008be20 con 0x7fb46c0fd150 2024-02-22T00:43:59.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.327+0000 7fb46b7fe700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb45406caa0 0x7fb45406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:59.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.327+0000 7fb46b7fe700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb45406caa0 0x7fb45406ef60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb45c004f10 tx=0x7fb45c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:59.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.331+0000 7fb468ff9700 1 -- 172.21.15.49:0/1270777343 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb460055ef0 con 0x7fb46c0fd150 2024-02-22T00:43:59.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.616+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb46c047540 con 0x7fb46c0fd150 2024-02-22T00:43:59.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.617+0000 7fb468ff9700 1 -- 172.21.15.49:0/1270777343 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fb460059510 con 0x7fb46c0fd150 2024-02-22T00:43:59.619 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:43:59.619 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:43:59.619 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:43:59.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:43:59.620 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:43:59.621 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:43:59.621 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:43:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb45406caa0 msgr2=0x7fb45406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb45406caa0 0x7fb45406ef60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb45c004f10 tx=0x7fb45c00b040).stop 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fd150 msgr2=0x7fb46c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fd150 0x7fb46c109650 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fb46000b480 tx=0x7fb4600090f0).stop 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 shutdown_connections 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb45406caa0 0x7fb45406ef60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb46c0fc7f0 0x7fb46c109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 --2- 172.21.15.49:0/1270777343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb46c0fd150 0x7fb46c109650 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 >> 172.21.15.49:0/1270777343 conn(0x7fb46c070590 msgr2=0x7fb46c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 shutdown_connections 2024-02-22T00:43:59.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.619+0000 7fb472044700 1 -- 172.21.15.49:0/1270777343 wait complete. 2024-02-22T00:43:59.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.720+0000 7f394015b700 1 -- 172.21.15.49:0/2724005784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fe250 msgr2=0x7f39380f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.720+0000 7f394015b700 1 --2- 172.21.15.49:0/2724005784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fe250 0x7f39380f7a30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f392c0047f0 tx=0x7f392c009cb0).stop 2024-02-22T00:43:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.720+0000 7f394015b700 1 -- 172.21.15.49:0/2724005784 shutdown_connections 2024-02-22T00:43:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.720+0000 7f394015b700 1 --2- 172.21.15.49:0/2724005784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fe250 0x7f39380f7a30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.720+0000 7f394015b700 1 --2- 172.21.15.49:0/2724005784 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39380fd8f0 0x7f39380fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.720+0000 7f394015b700 1 -- 172.21.15.49:0/2724005784 >> 172.21.15.49:0/2724005784 conn(0x7f39380f34b0 msgr2=0x7f39380f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.720+0000 7f394015b700 1 -- 172.21.15.49:0/2724005784 shutdown_connections 2024-02-22T00:43:59.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.720+0000 7f394015b700 1 -- 172.21.15.49:0/2724005784 wait complete. 2024-02-22T00:43:59.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f394015b700 1 Processor -- start 2024-02-22T00:43:59.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f394015b700 1 -- start start 2024-02-22T00:43:59.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f394015b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fd8f0 0x7f393810dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:59.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f394015b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39380fe250 0x7f393810e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:59.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f394015b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393810eae0 con 0x7f39380fd8f0 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f394015b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393810ec20 con 0x7f39380fe250 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f393def7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fd8f0 0x7f393810dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f393def7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fd8f0 0x7f393810dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56446/0 (socket says 172.21.15.49:56446) 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.721+0000 7f393def7700 1 -- 172.21.15.49:0/1699125217 learned_addr learned my addr 172.21.15.49:0/1699125217 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f393d6f6700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39380fe250 0x7f393810e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f393def7700 1 -- 172.21.15.49:0/1699125217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39380fe250 msgr2=0x7f393810e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f393def7700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39380fe250 0x7f393810e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f393def7700 1 -- 172.21.15.49:0/1699125217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c005040 con 0x7f39380fd8f0 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f393d6f6700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39380fe250 0x7f393810e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f393def7700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fd8f0 0x7f393810dff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f393400c790 tx=0x7f393400cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f392affd700 1 -- 172.21.15.49:0/1699125217 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39340106f0 con 0x7f39380fd8f0 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39381082b0 con 0x7f39380fd8f0 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f392affd700 1 -- 172.21.15.49:0/1699125217 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3934010d00 con 0x7f39380fd8f0 2024-02-22T00:43:59.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f392affd700 1 -- 172.21.15.49:0/1699125217 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3934012e50 con 0x7f39380fd8f0 2024-02-22T00:43:59.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.722+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3938108870 con 0x7f39380fd8f0 2024-02-22T00:43:59.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.723+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393805f590 con 0x7f39380fd8f0 2024-02-22T00:43:59.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.724+0000 7f392affd700 1 -- 172.21.15.49:0/1699125217 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3934010850 con 0x7f39380fd8f0 2024-02-22T00:43:59.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.724+0000 7f392affd700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f392406caa0 0x7f392406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:43:59.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.724+0000 7f392affd700 1 -- 172.21.15.49:0/1699125217 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f393408b630 con 0x7f39380fd8f0 2024-02-22T00:43:59.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.724+0000 7f393d6f6700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f392406caa0 0x7f392406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:43:59.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.725+0000 7f393d6f6700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f392406caa0 0x7f392406ef60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f392c0043d0 tx=0x7f392c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:43:59.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.729+0000 7f392affd700 1 -- 172.21.15.49:0/1699125217 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3934059190 con 0x7f39380fd8f0 2024-02-22T00:43:59.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.970+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3938047540 con 0x7f39380fd8f0 2024-02-22T00:43:59.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.971+0000 7f392affd700 1 -- 172.21.15.49:0/1699125217 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f3934058d20 con 0x7f39380fd8f0 2024-02-22T00:43:59.973 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:43:59.973 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:43:59.973 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:43:59.973 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:43:59.973 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:43:59.974 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:43:59.975 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:43:59.976 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:43:59.976 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:43:59.976 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:43:59.976 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:43:59.976 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:43:59.976 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f392406caa0 msgr2=0x7f392406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f392406caa0 0x7f392406ef60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f392c0043d0 tx=0x7f392c00b040).stop 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fd8f0 msgr2=0x7f393810dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fd8f0 0x7f393810dff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f393400c790 tx=0x7f393400cb50).stop 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 shutdown_connections 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f392406caa0 0x7f392406ef60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39380fd8f0 0x7f393810dff0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 --2- 172.21.15.49:0/1699125217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39380fe250 0x7f393810e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 >> 172.21.15.49:0/1699125217 conn(0x7f39380f34b0 msgr2=0x7f39380fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 shutdown_connections 2024-02-22T00:43:59.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:43:59.973+0000 7f394015b700 1 -- 172.21.15.49:0/1699125217 wait complete. 2024-02-22T00:43:59.978 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:44:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.077+0000 7fbac7417700 1 -- 172.21.15.49:0/3736222742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fd830 msgr2=0x7fbac00fdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.077+0000 7fbac7417700 1 --2- 172.21.15.49:0/3736222742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fd830 0x7fbac00fdc10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fbabc0047f0 tx=0x7fbabc009cb0).stop 2024-02-22T00:44:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.077+0000 7fbac7417700 1 -- 172.21.15.49:0/3736222742 shutdown_connections 2024-02-22T00:44:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.077+0000 7fbac7417700 1 --2- 172.21.15.49:0/3736222742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbac00fe190 0x7fbac00f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.077+0000 7fbac7417700 1 --2- 172.21.15.49:0/3736222742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fd830 0x7fbac00fdc10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.077+0000 7fbac7417700 1 -- 172.21.15.49:0/3736222742 >> 172.21.15.49:0/3736222742 conn(0x7fbac00f3450 msgr2=0x7fbac00f5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.077+0000 7fbac7417700 1 -- 172.21.15.49:0/3736222742 shutdown_connections 2024-02-22T00:44:00.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.077+0000 7fbac7417700 1 -- 172.21.15.49:0/3736222742 wait complete. 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac7417700 1 Processor -- start 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac7417700 1 -- start start 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac7417700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbac00fd830 0x7fbac006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac7417700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fe190 0x7fbac006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac7417700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac006bb70 con 0x7fbac00fe190 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac7417700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac006bcb0 con 0x7fbac00fd830 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac49b2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fe190 0x7fbac006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac49b2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fe190 0x7fbac006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56460/0 (socket says 172.21.15.49:56460) 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac49b2700 1 -- 172.21.15.49:0/917492354 learned_addr learned my addr 172.21.15.49:0/917492354 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac51b3700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbac00fd830 0x7fbac006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac49b2700 1 -- 172.21.15.49:0/917492354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbac00fd830 msgr2=0x7fbac006b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:00.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac49b2700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbac00fd830 0x7fbac006b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac49b2700 1 -- 172.21.15.49:0/917492354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc005040 con 0x7fbac00fe190 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac51b3700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbac00fd830 0x7fbac006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbac49b2700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fe190 0x7fbac006b5c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fbab4002780 tx=0x7fbab4009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.078+0000 7fbab27fc700 1 -- 172.21.15.49:0/917492354 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab4007b40 con 0x7fbac00fe190 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.079+0000 7fbab27fc700 1 -- 172.21.15.49:0/917492354 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbab400f040 con 0x7fbac00fe190 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.079+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac01142e0 con 0x7fbac00fe190 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.079+0000 7fbab27fc700 1 -- 172.21.15.49:0/917492354 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab4014780 con 0x7fbac00fe190 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.079+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac0114760 con 0x7fbac00fe190 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.079+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac005f470 con 0x7fbac00fe190 2024-02-22T00:44:00.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.080+0000 7fbab27fc700 1 -- 172.21.15.49:0/917492354 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbab4007ca0 con 0x7fbac00fe190 2024-02-22T00:44:00.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.080+0000 7fbab27fc700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbaac06caf0 0x7fbaac06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:00.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.080+0000 7fbab27fc700 1 -- 172.21.15.49:0/917492354 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbab408bd30 con 0x7fbac00fe190 2024-02-22T00:44:00.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.081+0000 7fbac51b3700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbaac06caf0 0x7fbaac06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:00.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.081+0000 7fbac51b3700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbaac06caf0 0x7fbaac06efb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fbabc0043d0 tx=0x7fbabc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:00.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.085+0000 7fbab27fc700 1 -- 172.21.15.49:0/917492354 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbab4055e00 con 0x7fbac00fe190 2024-02-22T00:44:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:00 smithi161 ceph-mon[113442]: pgmap v212: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:00 smithi161 ceph-mon[113442]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:00 smithi161 ceph-mon[113442]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:00 smithi161 ceph-mon[113442]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:00 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1270777343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:44:00.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:00 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1699125217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:44:00.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.301+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbac006c830 con 0x7fbaac06caf0 2024-02-22T00:44:00.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.302+0000 7fbab27fc700 1 -- 172.21.15.49:0/917492354 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fbac006c830 con 0x7fbaac06caf0 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:44:00.305 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:44:00.306 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:44:00.306 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:44:00.306 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:44:00.306 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:44:00.306 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:44:00.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbaac06caf0 msgr2=0x7fbaac06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbaac06caf0 0x7fbaac06efb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fbabc0043d0 tx=0x7fbabc00b040).stop 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fe190 msgr2=0x7fbac006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fe190 0x7fbac006b5c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fbab4002780 tx=0x7fbab4009ee0).stop 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 shutdown_connections 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbaac06caf0 0x7fbaac06efb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbac00fd830 0x7fbac006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 --2- 172.21.15.49:0/917492354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbac00fe190 0x7fbac006b5c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 >> 172.21.15.49:0/917492354 conn(0x7fbac00f3450 msgr2=0x7fbac00fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 shutdown_connections 2024-02-22T00:44:00.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.304+0000 7fbac7417700 1 -- 172.21.15.49:0/917492354 wait complete. 2024-02-22T00:44:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.406+0000 7fea189e2700 1 -- 172.21.15.49:0/3958949062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 msgr2=0x7fea14103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.406+0000 7fea189e2700 1 --2- 172.21.15.49:0/3958949062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 0x7fea14103c40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fea040047f0 tx=0x7fea04009cb0).stop 2024-02-22T00:44:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.406+0000 7fea189e2700 1 -- 172.21.15.49:0/3958949062 shutdown_connections 2024-02-22T00:44:00.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.406+0000 7fea189e2700 1 --2- 172.21.15.49:0/3958949062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 0x7fea14103c40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.406+0000 7fea189e2700 1 --2- 172.21.15.49:0/3958949062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1406b170 0x7fea1406b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.406+0000 7fea189e2700 1 -- 172.21.15.49:0/3958949062 >> 172.21.15.49:0/3958949062 conn(0x7fea140f34b0 msgr2=0x7fea140f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:00.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.406+0000 7fea189e2700 1 -- 172.21.15.49:0/3958949062 shutdown_connections 2024-02-22T00:44:00.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.406+0000 7fea189e2700 1 -- 172.21.15.49:0/3958949062 wait complete. 2024-02-22T00:44:00.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea189e2700 1 Processor -- start 2024-02-22T00:44:00.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea189e2700 1 -- start start 2024-02-22T00:44:00.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea189e2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1406b170 0x7fea141104c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:00.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea189e2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 0x7fea141109b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea189e2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea14110fb0 con 0x7fea1406ba40 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea189e2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea141110f0 con 0x7fea1406b170 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea11d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 0x7fea141109b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea11d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 0x7fea141109b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56478/0 (socket says 172.21.15.49:56478) 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea11d9b700 1 -- 172.21.15.49:0/600046907 learned_addr learned my addr 172.21.15.49:0/600046907 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea1259c700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1406b170 0x7fea141104c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea11d9b700 1 -- 172.21.15.49:0/600046907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1406b170 msgr2=0x7fea141104c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.407+0000 7fea11d9b700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1406b170 0x7fea141104c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.408+0000 7fea11d9b700 1 -- 172.21.15.49:0/600046907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04005040 con 0x7fea1406ba40 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.408+0000 7fea11d9b700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 0x7fea141109b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fea04009380 tx=0x7fea04009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.408+0000 7fea037fe700 1 -- 172.21.15.49:0/600046907 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea04018070 con 0x7fea1406ba40 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.408+0000 7fea037fe700 1 -- 172.21.15.49:0/600046907 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea04007e90 con 0x7fea1406ba40 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.408+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1410a750 con 0x7fea1406ba40 2024-02-22T00:44:00.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.408+0000 7fea037fe700 1 -- 172.21.15.49:0/600046907 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea0401c380 con 0x7fea1406ba40 2024-02-22T00:44:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.408+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1410ac30 con 0x7fea1406ba40 2024-02-22T00:44:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.409+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1405f590 con 0x7fea1406ba40 2024-02-22T00:44:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.410+0000 7fea037fe700 1 -- 172.21.15.49:0/600046907 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fea040123c0 con 0x7fea1406ba40 2024-02-22T00:44:00.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.410+0000 7fea037fe700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe9fc06caa0 0x7fe9fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:00.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.410+0000 7fea1259c700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe9fc06caa0 0x7fe9fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:00.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.410+0000 7fea037fe700 1 -- 172.21.15.49:0/600046907 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fea0408caf0 con 0x7fea1406ba40 2024-02-22T00:44:00.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.411+0000 7fea1259c700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe9fc06caa0 0x7fe9fc06ef60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fea08004ee0 tx=0x7fea0800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:00.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.415+0000 7fea037fe700 1 -- 172.21.15.49:0/600046907 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fea0405a590 con 0x7fea1406ba40 2024-02-22T00:44:00.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:00 smithi049 ceph-mon[132694]: pgmap v212: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:00 smithi049 ceph-mon[132694]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:00 smithi049 ceph-mon[132694]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:00 smithi049 ceph-mon[132694]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:00 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1270777343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:44:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:00 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1699125217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:44:00.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.693+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fea1410bb40 con 0x7fea1406ba40 2024-02-22T00:44:00.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.693+0000 7fea037fe700 1 -- 172.21.15.49:0/600046907 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fea0408c100 con 0x7fea1406ba40 2024-02-22T00:44:00.696 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:44:00.696 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:44:00.696 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:44:00.696 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:44:00.696 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe9fc06caa0 msgr2=0x7fe9fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe9fc06caa0 0x7fe9fc06ef60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fea08004ee0 tx=0x7fea0800b040).stop 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 msgr2=0x7fea141109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 0x7fea141109b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fea04009380 tx=0x7fea04009cb0).stop 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 shutdown_connections 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe9fc06caa0 0x7fe9fc06ef60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea1406b170 0x7fea141104c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 --2- 172.21.15.49:0/600046907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea1406ba40 0x7fea141109b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.695+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 >> 172.21.15.49:0/600046907 conn(0x7fea140f34b0 msgr2=0x7fea140fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.696+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 shutdown_connections 2024-02-22T00:44:00.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:00.696+0000 7fea189e2700 1 -- 172.21.15.49:0/600046907 wait complete. 2024-02-22T00:44:01.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:01 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/600046907' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:44:01.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:01 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/600046907' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:44:02.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:02 smithi049 ceph-mon[132694]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:02.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:02 smithi049 ceph-mon[132694]: pgmap v213: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:02 smithi161 ceph-mon[113442]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:02 smithi161 ceph-mon[113442]: pgmap v213: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:04.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:04 smithi049 ceph-mon[132694]: pgmap v214: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:04 smithi161 ceph-mon[113442]: pgmap v214: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:06 smithi049 ceph-mon[132694]: pgmap v215: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:06 smithi161 ceph-mon[113442]: pgmap v215: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:08 smithi049 ceph-mon[132694]: pgmap v216: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:08 smithi161 ceph-mon[113442]: pgmap v216: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:10 smithi049 ceph-mon[132694]: pgmap v217: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:10 smithi161 ceph-mon[113442]: pgmap v217: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:12.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:12 smithi049 ceph-mon[132694]: pgmap v218: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:12.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:12 smithi161 ceph-mon[113442]: pgmap v218: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:13.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:44:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:44:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:14 smithi049 ceph-mon[132694]: pgmap v219: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:14 smithi161 ceph-mon[113442]: pgmap v219: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:16 smithi049 ceph-mon[132694]: pgmap v220: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:16 smithi161 ceph-mon[113442]: pgmap v220: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:18 smithi049 ceph-mon[132694]: pgmap v221: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:18 smithi161 ceph-mon[113442]: pgmap v221: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:20 smithi049 ceph-mon[132694]: pgmap v222: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:20 smithi161 ceph-mon[113442]: pgmap v222: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:22 smithi049 ceph-mon[132694]: pgmap v223: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:22 smithi161 ceph-mon[113442]: pgmap v223: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:24 smithi049 ceph-mon[132694]: pgmap v224: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:24 smithi161 ceph-mon[113442]: pgmap v224: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:26.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:26 smithi049 ceph-mon[132694]: pgmap v225: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:26 smithi161 ceph-mon[113442]: pgmap v225: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:28 smithi049 ceph-mon[132694]: pgmap v226: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:44:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:28 smithi161 ceph-mon[113442]: pgmap v226: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:44:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:30 smithi049 ceph-mon[132694]: pgmap v227: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:30 smithi161 ceph-mon[113442]: pgmap v227: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:30.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.812+0000 7fd2b165b700 1 -- 172.21.15.49:0/1040059882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fe2d0 msgr2=0x7fd2ac0f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:30.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.812+0000 7fd2b165b700 1 --2- 172.21.15.49:0/1040059882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fe2d0 0x7fd2ac0f7ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fd29c0047f0 tx=0x7fd29c009cb0).stop 2024-02-22T00:44:30.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.812+0000 7fd2b165b700 1 -- 172.21.15.49:0/1040059882 shutdown_connections 2024-02-22T00:44:30.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.812+0000 7fd2b165b700 1 --2- 172.21.15.49:0/1040059882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fe2d0 0x7fd2ac0f7ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:30.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.812+0000 7fd2b165b700 1 --2- 172.21.15.49:0/1040059882 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2ac0fd970 0x7fd2ac0fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:30.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.812+0000 7fd2b165b700 1 -- 172.21.15.49:0/1040059882 >> 172.21.15.49:0/1040059882 conn(0x7fd2ac0f3550 msgr2=0x7fd2ac0f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:30.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.812+0000 7fd2b165b700 1 -- 172.21.15.49:0/1040059882 shutdown_connections 2024-02-22T00:44:30.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.812+0000 7fd2b165b700 1 -- 172.21.15.49:0/1040059882 wait complete. 2024-02-22T00:44:30.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2b165b700 1 Processor -- start 2024-02-22T00:44:30.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2b165b700 1 -- start start 2024-02-22T00:44:30.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2b165b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fd970 0x7fd2ac10dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:30.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2b165b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2ac0fe2d0 0x7fd2ac10e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:30.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2b165b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac10ea90 con 0x7fd2ac0fd970 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2b165b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac10ebd0 con 0x7fd2ac0fe2d0 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2aaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fd970 0x7fd2ac10dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2aaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fd970 0x7fd2ac10dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44500/0 (socket says 172.21.15.49:44500) 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2aaffd700 1 -- 172.21.15.49:0/2329715126 learned_addr learned my addr 172.21.15.49:0/2329715126 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.813+0000 7fd2aa7fc700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2ac0fe2d0 0x7fd2ac10e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd2aaffd700 1 -- 172.21.15.49:0/2329715126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2ac0fe2d0 msgr2=0x7fd2ac10e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd2aaffd700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2ac0fe2d0 0x7fd2ac10e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd2aaffd700 1 -- 172.21.15.49:0/2329715126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c005040 con 0x7fd2ac0fd970 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd2aaffd700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fd970 0x7fd2ac10dfa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fd2a00041d0 tx=0x7fd2a0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd293fff700 1 -- 172.21.15.49:0/2329715126 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a0007b40 con 0x7fd2ac0fd970 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac108260 con 0x7fd2ac0fd970 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd293fff700 1 -- 172.21.15.49:0/2329715126 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd2a000f040 con 0x7fd2ac0fd970 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd293fff700 1 -- 172.21.15.49:0/2329715126 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2a00147b0 con 0x7fd2ac0fd970 2024-02-22T00:44:30.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.814+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac108820 con 0x7fd2ac0fd970 2024-02-22T00:44:30.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.815+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac060370 con 0x7fd2ac0fd970 2024-02-22T00:44:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.816+0000 7fd293fff700 1 -- 172.21.15.49:0/2329715126 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd2a0009110 con 0x7fd2ac0fd970 2024-02-22T00:44:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.816+0000 7fd293fff700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd29406caa0 0x7fd29406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.816+0000 7fd293fff700 1 -- 172.21.15.49:0/2329715126 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd2a008bda0 con 0x7fd2ac0fd970 2024-02-22T00:44:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.816+0000 7fd2aa7fc700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd29406caa0 0x7fd29406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:30.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.817+0000 7fd2aa7fc700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd29406caa0 0x7fd29406ef60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd2ac1098e0 tx=0x7fd29c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:30.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:30.821+0000 7fd293fff700 1 -- 172.21.15.49:0/2329715126 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd2a0059900 con 0x7fd2ac0fd970 2024-02-22T00:44:31.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.038+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2ac108aa0 con 0x7fd29406caa0 2024-02-22T00:44:31.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.039+0000 7fd293fff700 1 -- 172.21.15.49:0/2329715126 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd2ac108aa0 con 0x7fd29406caa0 2024-02-22T00:44:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd29406caa0 msgr2=0x7fd29406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd29406caa0 0x7fd29406ef60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd2ac1098e0 tx=0x7fd29c00b040).stop 2024-02-22T00:44:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fd970 msgr2=0x7fd2ac10dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fd970 0x7fd2ac10dfa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fd2a00041d0 tx=0x7fd2a0009f60).stop 2024-02-22T00:44:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 shutdown_connections 2024-02-22T00:44:31.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd29406caa0 0x7fd29406ef60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd2ac0fd970 0x7fd2ac10dfa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 --2- 172.21.15.49:0/2329715126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2ac0fe2d0 0x7fd2ac10e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 >> 172.21.15.49:0/2329715126 conn(0x7fd2ac0f3550 msgr2=0x7fd2ac0fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:31.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 shutdown_connections 2024-02-22T00:44:31.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.042+0000 7fd2b165b700 1 -- 172.21.15.49:0/2329715126 wait complete. 2024-02-22T00:44:31.054 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.145+0000 7f1574647700 1 -- 172.21.15.49:0/4086798352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 msgr2=0x7f156c103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.145+0000 7f1574647700 1 --2- 172.21.15.49:0/4086798352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 0x7f156c103ce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f15680047f0 tx=0x7f1568009cb0).stop 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.145+0000 7f1574647700 1 -- 172.21.15.49:0/4086798352 shutdown_connections 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.145+0000 7f1574647700 1 --2- 172.21.15.49:0/4086798352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 0x7f156c103ce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.145+0000 7f1574647700 1 --2- 172.21.15.49:0/4086798352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f156c06b0f0 0x7f156c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.145+0000 7f1574647700 1 -- 172.21.15.49:0/4086798352 >> 172.21.15.49:0/4086798352 conn(0x7f156c0f3530 msgr2=0x7f156c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.145+0000 7f1574647700 1 -- 172.21.15.49:0/4086798352 shutdown_connections 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.145+0000 7f1574647700 1 -- 172.21.15.49:0/4086798352 wait complete. 2024-02-22T00:44:31.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1574647700 1 Processor -- start 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1574647700 1 -- start start 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1574647700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f156c06b0f0 0x7f156c1102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1574647700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 0x7f156c1107b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1574647700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c110e40 con 0x7f156c06b9c0 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1574647700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c10a460 con 0x7f156c06b0f0 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1571be2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 0x7f156c1107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1571be2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 0x7f156c1107b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44506/0 (socket says 172.21.15.49:44506) 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1571be2700 1 -- 172.21.15.49:0/2523316881 learned_addr learned my addr 172.21.15.49:0/2523316881 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f15723e3700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f156c06b0f0 0x7f156c1102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1571be2700 1 -- 172.21.15.49:0/2523316881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f156c06b0f0 msgr2=0x7f156c1102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1571be2700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f156c06b0f0 0x7f156c1102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1571be2700 1 -- 172.21.15.49:0/2523316881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568005040 con 0x7f156c06b9c0 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.146+0000 7f1571be2700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 0x7f156c1107b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f156800b120 tx=0x7f1568009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.147+0000 7f15637fe700 1 -- 172.21.15.49:0/2523316881 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f156800e030 con 0x7f156c06b9c0 2024-02-22T00:44:31.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.147+0000 7f15637fe700 1 -- 172.21.15.49:0/2523316881 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1568007e90 con 0x7f156c06b9c0 2024-02-22T00:44:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.147+0000 7f15637fe700 1 -- 172.21.15.49:0/2523316881 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1568018070 con 0x7f156c06b9c0 2024-02-22T00:44:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.147+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c10a6b0 con 0x7f156c06b9c0 2024-02-22T00:44:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.147+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c10ab40 con 0x7f156c06b9c0 2024-02-22T00:44:31.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.148+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c05f570 con 0x7f156c06b9c0 2024-02-22T00:44:31.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.148+0000 7f15637fe700 1 -- 172.21.15.49:0/2523316881 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f156801d420 con 0x7f156c06b9c0 2024-02-22T00:44:31.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.149+0000 7f15637fe700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f155806caa0 0x7f155806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.149+0000 7f15637fe700 1 -- 172.21.15.49:0/2523316881 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f156808d1b0 con 0x7f156c06b9c0 2024-02-22T00:44:31.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.149+0000 7f15723e3700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f155806caa0 0x7f155806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:31.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.149+0000 7f15723e3700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f155806caa0 0x7f155806ef60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f155c00b910 tx=0x7f155c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:31.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.153+0000 7f15637fe700 1 -- 172.21.15.49:0/2523316881 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f156805ad10 con 0x7f156c06b9c0 2024-02-22T00:44:31.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.368+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f156c10b9b0 con 0x7f155806caa0 2024-02-22T00:44:31.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.369+0000 7f15637fe700 1 -- 172.21.15.49:0/2523316881 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f156c10b9b0 con 0x7f155806caa0 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f155806caa0 msgr2=0x7f155806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f155806caa0 0x7f155806ef60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f155c00b910 tx=0x7f155c008040).stop 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 msgr2=0x7f156c1107b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 0x7f156c1107b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f156800b120 tx=0x7f1568009cb0).stop 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 shutdown_connections 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f155806caa0 0x7f155806ef60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f156c06b0f0 0x7f156c1102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 --2- 172.21.15.49:0/2523316881 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f156c06b9c0 0x7f156c1107b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 >> 172.21.15.49:0/2523316881 conn(0x7f156c0f3530 msgr2=0x7f156c0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 shutdown_connections 2024-02-22T00:44:31.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.372+0000 7f1574647700 1 -- 172.21.15.49:0/2523316881 wait complete. 2024-02-22T00:44:31.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.473+0000 7f3750475700 1 -- 172.21.15.49:0/1625204937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fc7f0 msgr2=0x7f37480fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.473+0000 7f3750475700 1 --2- 172.21.15.49:0/1625204937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fc7f0 0x7f37480fcbd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f37440047f0 tx=0x7f3744009cb0).stop 2024-02-22T00:44:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.473+0000 7f3750475700 1 -- 172.21.15.49:0/1625204937 shutdown_connections 2024-02-22T00:44:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.473+0000 7f3750475700 1 --2- 172.21.15.49:0/1625204937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37480fd150 0x7f37480f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:44:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.473+0000 7f3750475700 1 --2- 172.21.15.49:0/1625204937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fc7f0 0x7f37480fcbd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.473+0000 7f3750475700 1 -- 172.21.15.49:0/1625204937 >> 172.21.15.49:0/1625204937 conn(0x7f3748070590 msgr2=0x7f37480f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.473+0000 7f3750475700 1 -- 172.21.15.49:0/1625204937 shutdown_connections 2024-02-22T00:44:31.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.473+0000 7f3750475700 1 -- 172.21.15.49:0/1625204937 wait complete. 2024-02-22T00:44:31.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.474+0000 7f3750475700 1 Processor -- start 2024-02-22T00:44:31.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.474+0000 7f3750475700 1 -- start start 2024-02-22T00:44:31.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.474+0000 7f3750475700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37480fc7f0 0x7f3748109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.474+0000 7f3750475700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fd150 0x7f3748109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f3750475700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3748109bb0 con 0x7f37480fd150 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f3750475700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3748109cf0 con 0x7f37480fc7f0 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374da10700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fd150 0x7f3748109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374da10700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fd150 0x7f3748109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42730/0 (socket says 172.21.15.49:42730) 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374da10700 1 -- 172.21.15.49:0/1873525891 learned_addr learned my addr 172.21.15.49:0/1873525891 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374e211700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37480fc7f0 0x7f3748109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374da10700 1 -- 172.21.15.49:0/1873525891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37480fc7f0 msgr2=0x7f3748109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374da10700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37480fc7f0 0x7f3748109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374da10700 1 -- 172.21.15.49:0/1873525891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744005040 con 0x7f37480fd150 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374e211700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37480fc7f0 0x7f3748109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f374da10700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fd150 0x7f3748109630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f373c00b480 tx=0x7f373c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f373b7fe700 1 -- 172.21.15.49:0/1873525891 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373c002500 con 0x7f37480fd150 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3748109fa0 con 0x7f37480fd150 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f373b7fe700 1 -- 172.21.15.49:0/1873525891 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f373c002b10 con 0x7f37480fd150 2024-02-22T00:44:31.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f373b7fe700 1 -- 172.21.15.49:0/1873525891 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f373c012c90 con 0x7f37480fd150 2024-02-22T00:44:31.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.475+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3748112560 con 0x7f37480fd150 2024-02-22T00:44:31.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.476+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374805f590 con 0x7f37480fd150 2024-02-22T00:44:31.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.477+0000 7f373b7fe700 1 -- 172.21.15.49:0/1873525891 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f373c002660 con 0x7f37480fd150 2024-02-22T00:44:31.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.477+0000 7f373b7fe700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f373406caa0 0x7f373406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.477+0000 7f373b7fe700 1 -- 172.21.15.49:0/1873525891 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f373c08be70 con 0x7f37480fd150 2024-02-22T00:44:31.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.477+0000 7f374e211700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f373406caa0 0x7f373406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:31.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.478+0000 7f374e211700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f373406caa0 0x7f373406ef60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f37440043d0 tx=0x7f374400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:31.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.482+0000 7f373b7fe700 1 -- 172.21.15.49:0/1873525891 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f373c055f40 con 0x7f37480fd150 2024-02-22T00:44:31.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.689+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3748059120 con 0x7f373406caa0 2024-02-22T00:44:31.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.699+0000 7f373b7fe700 1 -- 172.21.15.49:0/1873525891 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f3748059120 con 0x7f373406caa0 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (7m) 98s ago 18m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (5m) 98s ago 18m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (5m) 65s ago 18m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (7m) 98s ago 18m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (103s) 98s ago 13m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (118s) 98s ago 13m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (69s) 65s ago 13m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (86s) 65s ago 13m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (9m) 98s ago 20m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (8m) 65s ago 18m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (6m) 98s ago 20m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:44:31.702 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (6m) 65s ago 18m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (8m) 98s ago 18m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (8m) 65s ago 18m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (5m) 98s ago 17m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (4m) 98s ago 17m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (3m) 98s ago 16m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (3m) 65s ago 16m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (2m) 65s ago 15m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (2m) 65s ago 15m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:44:31.703 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (7m) 65s ago 17m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f373406caa0 msgr2=0x7f373406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f373406caa0 0x7f373406ef60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f37440043d0 tx=0x7f374400b040).stop 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fd150 msgr2=0x7f3748109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fd150 0x7f3748109630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f373c00b480 tx=0x7f373c0090f0).stop 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 shutdown_connections 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f373406caa0 0x7f373406ef60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37480fc7f0 0x7f3748109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 --2- 172.21.15.49:0/1873525891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f37480fd150 0x7f3748109630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 >> 172.21.15.49:0/1873525891 conn(0x7f3748070590 msgr2=0x7f37480fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:31.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 shutdown_connections 2024-02-22T00:44:31.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.701+0000 7f3750475700 1 -- 172.21.15.49:0/1873525891 wait complete. 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.802+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1418381863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fd150 msgr2=0x7f9cc40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.802+0000 7f9ccc6e7700 1 --2- 172.21.15.49:0/1418381863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fd150 0x7f9cc40f6930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f9cb80047f0 tx=0x7f9cb8009cb0).stop 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.802+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1418381863 shutdown_connections 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.802+0000 7f9ccc6e7700 1 --2- 172.21.15.49:0/1418381863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fd150 0x7f9cc40f6930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.802+0000 7f9ccc6e7700 1 --2- 172.21.15.49:0/1418381863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc40fc7f0 0x7f9cc40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.802+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1418381863 >> 172.21.15.49:0/1418381863 conn(0x7f9cc4070590 msgr2=0x7f9cc40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.802+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1418381863 shutdown_connections 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.802+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1418381863 wait complete. 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9ccc6e7700 1 Processor -- start 2024-02-22T00:44:31.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9ccc6e7700 1 -- start start 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9ccc6e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fc7f0 0x7f9cc410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9ccc6e7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc40fd150 0x7f9cc410e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9ccc6e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc410ebc0 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9ccc6e7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41081e0 con 0x7f9cc40fd150 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9cca483700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fc7f0 0x7f9cc410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9cca483700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fc7f0 0x7f9cc410e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42746/0 (socket says 172.21.15.49:42746) 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9cca483700 1 -- 172.21.15.49:0/1786923639 learned_addr learned my addr 172.21.15.49:0/1786923639 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9cca483700 1 -- 172.21.15.49:0/1786923639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc40fd150 msgr2=0x7f9cc410e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9cca483700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc40fd150 0x7f9cc410e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.803+0000 7f9cca483700 1 -- 172.21.15.49:0/1786923639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8005040 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.804+0000 7f9cca483700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fc7f0 0x7f9cc410e040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f9cc000b4b0 tx=0x7f9cc00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.804+0000 7f9cb77fe700 1 -- 172.21.15.49:0/1786923639 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc0002500 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.804+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc4108490 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.804+0000 7f9cb77fe700 1 -- 172.21.15.49:0/1786923639 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9cc0002b10 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.804+0000 7f9cb77fe700 1 -- 172.21.15.49:0/1786923639 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc0012cf0 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.804+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc41089d0 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.805+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc405f590 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.805+0000 7f9cb77fe700 1 -- 172.21.15.49:0/1786923639 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9cc0002660 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.806+0000 7f9cb77fe700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb006caa0 0x7f9cb006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.806+0000 7f9cb77fe700 1 -- 172.21.15.49:0/1786923639 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9cc008be80 con 0x7f9cc40fc7f0 2024-02-22T00:44:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.806+0000 7f9cc9c82700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb006caa0 0x7f9cb006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:31.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.806+0000 7f9cc9c82700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb006caa0 0x7f9cb006ef60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9cc4109980 tx=0x7f9cb8009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:31.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:31.810+0000 7f9cb77fe700 1 -- 172.21.15.49:0/1786923639 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9cc00599e0 con 0x7f9cc40fc7f0 2024-02-22T00:44:32.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.089+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9cc41096c0 con 0x7f9cc40fc7f0 2024-02-22T00:44:32.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.091+0000 7f9cb77fe700 1 -- 172.21.15.49:0/1786923639 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f9cc0059570 con 0x7f9cc40fc7f0 2024-02-22T00:44:32.093 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:44:32.093 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:44:32.093 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:44:32.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:44:32.094 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:44:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb006caa0 msgr2=0x7f9cb006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb006caa0 0x7f9cb006ef60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9cc4109980 tx=0x7f9cb8009cb0).stop 2024-02-22T00:44:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fc7f0 msgr2=0x7f9cc410e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fc7f0 0x7f9cc410e040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f9cc000b4b0 tx=0x7f9cc00090f0).stop 2024-02-22T00:44:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 shutdown_connections 2024-02-22T00:44:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb006caa0 0x7f9cb006ef60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc40fc7f0 0x7f9cc410e040 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 --2- 172.21.15.49:0/1786923639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc40fd150 0x7f9cc410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:44:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 >> 172.21.15.49:0/1786923639 conn(0x7f9cc4070590 msgr2=0x7f9cc4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 shutdown_connections 2024-02-22T00:44:32.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.093+0000 7f9ccc6e7700 1 -- 172.21.15.49:0/1786923639 wait complete. 2024-02-22T00:44:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.194+0000 7f70b8c87700 1 -- 172.21.15.49:0/3013279014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 msgr2=0x7f70b40f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.194+0000 7f70b8c87700 1 --2- 172.21.15.49:0/3013279014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 0x7f70b40f7a30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f70a80047f0 tx=0x7f70a8009cb0).stop 2024-02-22T00:44:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.195+0000 7f70b8c87700 1 -- 172.21.15.49:0/3013279014 shutdown_connections 2024-02-22T00:44:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.195+0000 7f70b8c87700 1 --2- 172.21.15.49:0/3013279014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 0x7f70b40f7a30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.195+0000 7f70b8c87700 1 --2- 172.21.15.49:0/3013279014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70b40fd8f0 0x7f70b40fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.195+0000 7f70b8c87700 1 -- 172.21.15.49:0/3013279014 >> 172.21.15.49:0/3013279014 conn(0x7f70b40f34b0 msgr2=0x7f70b40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:32.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.195+0000 7f70b8c87700 1 -- 172.21.15.49:0/3013279014 shutdown_connections 2024-02-22T00:44:32.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.195+0000 7f70b8c87700 1 -- 172.21.15.49:0/3013279014 wait complete. 2024-02-22T00:44:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.195+0000 7f70b8c87700 1 Processor -- start 2024-02-22T00:44:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b8c87700 1 -- start start 2024-02-22T00:44:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b8c87700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70b40fd8f0 0x7f70b410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b8c87700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 0x7f70b410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b8c87700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b410eb70 con 0x7f70b40fe250 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b8c87700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b410ecb0 con 0x7f70b40fd8f0 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 0x7f70b410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 0x7f70b410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42764/0 (socket says 172.21.15.49:42764) 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b1d9b700 1 -- 172.21.15.49:0/4230942374 learned_addr learned my addr 172.21.15.49:0/4230942374 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b259c700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70b40fd8f0 0x7f70b410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b1d9b700 1 -- 172.21.15.49:0/4230942374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70b40fd8f0 msgr2=0x7f70b410e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b1d9b700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70b40fd8f0 0x7f70b410e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b1d9b700 1 -- 172.21.15.49:0/4230942374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8005040 con 0x7f70b40fe250 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b1d9b700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 0x7f70b410e570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f70a8000c00 tx=0x7f70a8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70a37fe700 1 -- 172.21.15.49:0/4230942374 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a800e030 con 0x7f70b40fe250 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b41082e0 con 0x7f70b40fe250 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70a37fe700 1 -- 172.21.15.49:0/4230942374 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70a8007e90 con 0x7f70b40fe250 2024-02-22T00:44:32.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.196+0000 7f70a37fe700 1 -- 172.21.15.49:0/4230942374 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a8018070 con 0x7f70b40fe250 2024-02-22T00:44:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.197+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b41087c0 con 0x7f70b40fe250 2024-02-22T00:44:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.197+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b405f590 con 0x7f70b40fe250 2024-02-22T00:44:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.198+0000 7f70a37fe700 1 -- 172.21.15.49:0/4230942374 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f70a801d420 con 0x7f70b40fe250 2024-02-22T00:44:32.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.198+0000 7f70a37fe700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f709c06cab0 0x7f709c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.198+0000 7f70a37fe700 1 -- 172.21.15.49:0/4230942374 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f70a808d270 con 0x7f70b40fe250 2024-02-22T00:44:32.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.199+0000 7f70b259c700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f709c06cab0 0x7f709c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.199+0000 7f70b259c700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f709c06cab0 0x7f709c06ef70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f70a40041d0 tx=0x7f70a4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:32.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.203+0000 7f70a37fe700 1 -- 172.21.15.49:0/4230942374 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f70a805ae90 con 0x7f70b40fe250 2024-02-22T00:44:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:32 smithi049 ceph-mon[132694]: pgmap v228: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:32 smithi049 ceph-mon[132694]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:32.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.444+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f70b4047540 con 0x7f70b40fe250 2024-02-22T00:44:32.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.444+0000 7f70a37fe700 1 -- 172.21.15.49:0/4230942374 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f70a805aa20 con 0x7f70b40fe250 2024-02-22T00:44:32.446 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:44:32.446 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:44:32.447 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:44:32.448 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:44:32.449 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:44:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f709c06cab0 msgr2=0x7f709c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f709c06cab0 0x7f709c06ef70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f70a40041d0 tx=0x7f70a4009040).stop 2024-02-22T00:44:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 msgr2=0x7f70b410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 0x7f70b410e570 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f70a8000c00 tx=0x7f70a8009cb0).stop 2024-02-22T00:44:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 shutdown_connections 2024-02-22T00:44:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f709c06cab0 0x7f709c06ef70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70b40fd8f0 0x7f70b410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 --2- 172.21.15.49:0/4230942374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70b40fe250 0x7f70b410e570 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 >> 172.21.15.49:0/4230942374 conn(0x7f70b40f34b0 msgr2=0x7f70b40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 shutdown_connections 2024-02-22T00:44:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.446+0000 7f70b8c87700 1 -- 172.21.15.49:0/4230942374 wait complete. 2024-02-22T00:44:32.451 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:44:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:32 smithi161 ceph-mon[113442]: pgmap v228: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:32 smithi161 ceph-mon[113442]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.549+0000 7f7046699700 1 -- 172.21.15.49:0/3600066518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fd150 msgr2=0x7f70400f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.549+0000 7f7046699700 1 --2- 172.21.15.49:0/3600066518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fd150 0x7f70400f6930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f70340047f0 tx=0x7f7034009cb0).stop 2024-02-22T00:44:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.549+0000 7f7046699700 1 -- 172.21.15.49:0/3600066518 shutdown_connections 2024-02-22T00:44:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.549+0000 7f7046699700 1 --2- 172.21.15.49:0/3600066518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fd150 0x7f70400f6930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.549+0000 7f7046699700 1 --2- 172.21.15.49:0/3600066518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70400fc7f0 0x7f70400fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.549+0000 7f7046699700 1 -- 172.21.15.49:0/3600066518 >> 172.21.15.49:0/3600066518 conn(0x7f7040070590 msgr2=0x7f70400f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.549+0000 7f7046699700 1 -- 172.21.15.49:0/3600066518 shutdown_connections 2024-02-22T00:44:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.549+0000 7f7046699700 1 -- 172.21.15.49:0/3600066518 wait complete. 2024-02-22T00:44:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.550+0000 7f7046699700 1 Processor -- start 2024-02-22T00:44:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.550+0000 7f7046699700 1 -- start start 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f7046699700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fc7f0 0x7f704010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f7046699700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70400fd150 0x7f704010d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f7046699700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704010d9c0 con 0x7f70400fc7f0 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f7046699700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704010db00 con 0x7f70400fd150 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fc7f0 0x7f704010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fc7f0 0x7f704010ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42784/0 (socket says 172.21.15.49:42784) 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703ffff700 1 -- 172.21.15.49:0/651543997 learned_addr learned my addr 172.21.15.49:0/651543997 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703f7fe700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70400fd150 0x7f704010d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703ffff700 1 -- 172.21.15.49:0/651543997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70400fd150 msgr2=0x7f704010d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703ffff700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70400fd150 0x7f704010d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703ffff700 1 -- 172.21.15.49:0/651543997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034005040 con 0x7f70400fc7f0 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703ffff700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fc7f0 0x7f704010ced0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f70300041d0 tx=0x7f7030009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703d7fa700 1 -- 172.21.15.49:0/651543997 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7030002d90 con 0x7f70400fc7f0 2024-02-22T00:44:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703d7fa700 1 -- 172.21.15.49:0/651543997 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f703000f040 con 0x7f70400fc7f0 2024-02-22T00:44:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040107190 con 0x7f70400fc7f0 2024-02-22T00:44:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f703d7fa700 1 -- 172.21.15.49:0/651543997 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f703000d800 con 0x7f70400fc7f0 2024-02-22T00:44:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.551+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7040107750 con 0x7f70400fc7f0 2024-02-22T00:44:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.553+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704005f590 con 0x7f70400fc7f0 2024-02-22T00:44:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.553+0000 7f703d7fa700 1 -- 172.21.15.49:0/651543997 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f703000dac0 con 0x7f70400fc7f0 2024-02-22T00:44:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.553+0000 7f703d7fa700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f702806caa0 0x7f702806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.553+0000 7f703d7fa700 1 -- 172.21.15.49:0/651543997 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f703008bdf0 con 0x7f70400fc7f0 2024-02-22T00:44:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.553+0000 7f703f7fe700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f702806caa0 0x7f702806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.554+0000 7f703f7fe700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f702806caa0 0x7f702806ef60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7034004f10 tx=0x7f703400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.558+0000 7f703d7fa700 1 -- 172.21.15.49:0/651543997 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7030059950 con 0x7f70400fc7f0 2024-02-22T00:44:32.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.772+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70401079d0 con 0x7f702806caa0 2024-02-22T00:44:32.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.774+0000 7f703d7fa700 1 -- 172.21.15.49:0/651543997 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f70401079d0 con 0x7f702806caa0 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:44:32.776 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:44:32.777 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:44:32.777 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:44:32.777 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:44:32.777 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f702806caa0 msgr2=0x7f702806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f702806caa0 0x7f702806ef60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f7034004f10 tx=0x7f703400b040).stop 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fc7f0 msgr2=0x7f704010ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fc7f0 0x7f704010ced0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f70300041d0 tx=0x7f7030009f60).stop 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 shutdown_connections 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f702806caa0 0x7f702806ef60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70400fc7f0 0x7f704010ced0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 --2- 172.21.15.49:0/651543997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70400fd150 0x7f704010d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 >> 172.21.15.49:0/651543997 conn(0x7f7040070590 msgr2=0x7f70400fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:32.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 shutdown_connections 2024-02-22T00:44:32.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.776+0000 7f7046699700 1 -- 172.21.15.49:0/651543997 wait complete. 2024-02-22T00:44:32.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.877+0000 7f06571d9700 1 -- 172.21.15.49:0/394254987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fe250 msgr2=0x7f06500f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.877+0000 7f06571d9700 1 --2- 172.21.15.49:0/394254987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fe250 0x7f06500f7a30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f063c0047f0 tx=0x7f063c009cb0).stop 2024-02-22T00:44:32.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.877+0000 7f06571d9700 1 -- 172.21.15.49:0/394254987 shutdown_connections 2024-02-22T00:44:32.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.877+0000 7f06571d9700 1 --2- 172.21.15.49:0/394254987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fe250 0x7f06500f7a30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.877+0000 7f06571d9700 1 --2- 172.21.15.49:0/394254987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06500fd8f0 0x7f06500fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.877+0000 7f06571d9700 1 -- 172.21.15.49:0/394254987 >> 172.21.15.49:0/394254987 conn(0x7f06500f34b0 msgr2=0x7f06500f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.877+0000 7f06571d9700 1 -- 172.21.15.49:0/394254987 shutdown_connections 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.877+0000 7f06571d9700 1 -- 172.21.15.49:0/394254987 wait complete. 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f06571d9700 1 Processor -- start 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f06571d9700 1 -- start start 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f06571d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fd8f0 0x7f065010e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f06571d9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06500fe250 0x7f065010e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f06571d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065010ebb0 con 0x7f06500fd8f0 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f06571d9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06501081d0 con 0x7f06500fe250 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f0654f75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fd8f0 0x7f065010e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f0654f75700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fd8f0 0x7f065010e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42800/0 (socket says 172.21.15.49:42800) 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.878+0000 7f0654f75700 1 -- 172.21.15.49:0/1280167624 learned_addr learned my addr 172.21.15.49:0/1280167624 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:44:32.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f064ffff700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06500fe250 0x7f065010e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f0654f75700 1 -- 172.21.15.49:0/1280167624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06500fe250 msgr2=0x7f065010e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f0654f75700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06500fe250 0x7f065010e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f0654f75700 1 -- 172.21.15.49:0/1280167624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c005040 con 0x7f06500fd8f0 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f0654f75700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fd8f0 0x7f065010e030 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f064400b4b0 tx=0x7f06440090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f064dffb700 1 -- 172.21.15.49:0/1280167624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0644002500 con 0x7f06500fd8f0 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f064dffb700 1 -- 172.21.15.49:0/1280167624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0644002b10 con 0x7f06500fd8f0 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0650108480 con 0x7f06500fd8f0 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f064dffb700 1 -- 172.21.15.49:0/1280167624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0644012cf0 con 0x7f06500fd8f0 2024-02-22T00:44:32.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.879+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06501089c0 con 0x7f06500fd8f0 2024-02-22T00:44:32.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.880+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065005f590 con 0x7f06500fd8f0 2024-02-22T00:44:32.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.881+0000 7f064dffb700 1 -- 172.21.15.49:0/1280167624 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0644002660 con 0x7f06500fd8f0 2024-02-22T00:44:32.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.881+0000 7f064dffb700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f064006cab0 0x7f064006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:44:32.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.881+0000 7f064dffb700 1 -- 172.21.15.49:0/1280167624 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f064408be80 con 0x7f06500fd8f0 2024-02-22T00:44:32.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.881+0000 7f064ffff700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f064006cab0 0x7f064006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:44:32.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.882+0000 7f064ffff700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f064006cab0 0x7f064006ef70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f063c000c00 tx=0x7f063c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:44:32.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:32.886+0000 7f064dffb700 1 -- 172.21.15.49:0/1280167624 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f06440599e0 con 0x7f06500fd8f0 2024-02-22T00:44:33.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.168+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f06501096b0 con 0x7f06500fd8f0 2024-02-22T00:44:33.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.168+0000 7f064dffb700 1 -- 172.21.15.49:0/1280167624 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f0644059570 con 0x7f06500fd8f0 2024-02-22T00:44:33.170 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:44:33.171 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:44:33.171 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:44:33.171 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:44:33.171 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:44:33.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f064006cab0 msgr2=0x7f064006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:33.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f064006cab0 0x7f064006ef70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f063c000c00 tx=0x7f063c009cb0).stop 2024-02-22T00:44:33.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fd8f0 msgr2=0x7f065010e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:44:33.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fd8f0 0x7f065010e030 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f064400b4b0 tx=0x7f06440090f0).stop 2024-02-22T00:44:33.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 shutdown_connections 2024-02-22T00:44:33.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f064006cab0 0x7f064006ef70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:33.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06500fd8f0 0x7f065010e030 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:33.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 --2- 172.21.15.49:0/1280167624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06500fe250 0x7f065010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:44:33.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 >> 172.21.15.49:0/1280167624 conn(0x7f06500f34b0 msgr2=0x7f06500fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:44:33.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 shutdown_connections 2024-02-22T00:44:33.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:44:33.170+0000 7f06571d9700 1 -- 172.21.15.49:0/1280167624 wait complete. 2024-02-22T00:44:33.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:33 smithi049 ceph-mon[132694]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:33.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:33 smithi049 ceph-mon[132694]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:33.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:33 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1786923639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:44:33.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:33 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4230942374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:44:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:33 smithi161 ceph-mon[113442]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:33 smithi161 ceph-mon[113442]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:33 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1786923639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:44:33.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:33 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4230942374' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:44:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:34 smithi049 ceph-mon[132694]: pgmap v229: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:34 smithi049 ceph-mon[132694]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:34 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1280167624' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:44:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:34 smithi161 ceph-mon[113442]: pgmap v229: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:34 smithi161 ceph-mon[113442]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:44:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:34 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1280167624' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:44:36.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:36 smithi049 ceph-mon[132694]: pgmap v230: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:36 smithi161 ceph-mon[113442]: pgmap v230: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:38 smithi049 ceph-mon[132694]: pgmap v231: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:38 smithi161 ceph-mon[113442]: pgmap v231: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:40 smithi049 ceph-mon[132694]: pgmap v232: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:40 smithi161 ceph-mon[113442]: pgmap v232: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:42 smithi049 ceph-mon[132694]: pgmap v233: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:42 smithi161 ceph-mon[113442]: pgmap v233: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:44:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:44:44.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:44 smithi049 ceph-mon[132694]: pgmap v234: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:44 smithi161 ceph-mon[113442]: pgmap v234: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:46 smithi049 ceph-mon[132694]: pgmap v235: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:46 smithi161 ceph-mon[113442]: pgmap v235: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:48 smithi049 ceph-mon[132694]: pgmap v236: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:48 smithi161 ceph-mon[113442]: pgmap v236: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:50 smithi049 ceph-mon[132694]: pgmap v237: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:50 smithi161 ceph-mon[113442]: pgmap v237: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:52 smithi049 ceph-mon[132694]: pgmap v238: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:52 smithi161 ceph-mon[113442]: pgmap v238: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:54 smithi049 ceph-mon[132694]: pgmap v239: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:54 smithi161 ceph-mon[113442]: pgmap v239: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:56 smithi049 ceph-mon[132694]: pgmap v240: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:56 smithi161 ceph-mon[113442]: pgmap v240: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:58 smithi049 ceph-mon[132694]: pgmap v241: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:44:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:44:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:58 smithi161 ceph-mon[113442]: pgmap v241: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:44:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:44:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:45:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:00 smithi049 ceph-mon[132694]: pgmap v242: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:00 smithi161 ceph-mon[113442]: pgmap v242: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:02.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:02 smithi049 ceph-mon[132694]: pgmap v243: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:02 smithi161 ceph-mon[113442]: pgmap v243: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.287+0000 7f29894fe700 1 -- 172.21.15.49:0/3317949839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fd8f0 msgr2=0x7f29840fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.287+0000 7f29894fe700 1 --2- 172.21.15.49:0/3317949839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fd8f0 0x7f29840fdcd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f296c0047f0 tx=0x7f296c009cb0).stop 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.287+0000 7f29894fe700 1 -- 172.21.15.49:0/3317949839 shutdown_connections 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.287+0000 7f29894fe700 1 --2- 172.21.15.49:0/3317949839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29840fe250 0x7f29840f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.287+0000 7f29894fe700 1 --2- 172.21.15.49:0/3317949839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fd8f0 0x7f29840fdcd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.287+0000 7f29894fe700 1 -- 172.21.15.49:0/3317949839 >> 172.21.15.49:0/3317949839 conn(0x7f29840f34b0 msgr2=0x7f29840f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.287+0000 7f29894fe700 1 -- 172.21.15.49:0/3317949839 shutdown_connections 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.287+0000 7f29894fe700 1 -- 172.21.15.49:0/3317949839 wait complete. 2024-02-22T00:45:03.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29894fe700 1 Processor -- start 2024-02-22T00:45:03.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29894fe700 1 -- start start 2024-02-22T00:45:03.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29894fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29840fd8f0 0x7f29841101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29894fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fe250 0x7f29841106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29894fe700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984110cd0 con 0x7f29840fe250 2024-02-22T00:45:03.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29894fe700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984110e10 con 0x7f29840fd8f0 2024-02-22T00:45:03.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29827fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fe250 0x7f29841106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:03.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29827fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fe250 0x7f29841106d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48848/0 (socket says 172.21.15.49:48848) 2024-02-22T00:45:03.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.288+0000 7f29827fc700 1 -- 172.21.15.49:0/2583368698 learned_addr learned my addr 172.21.15.49:0/2583368698 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f2982ffd700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29840fd8f0 0x7f29841101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f29827fc700 1 -- 172.21.15.49:0/2583368698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29840fd8f0 msgr2=0x7f29841101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f29827fc700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29840fd8f0 0x7f29841101e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f29827fc700 1 -- 172.21.15.49:0/2583368698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c005040 con 0x7f29840fe250 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f29827fc700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fe250 0x7f29841106d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f297400c710 tx=0x7f2974007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f297bfff700 1 -- 172.21.15.49:0/2583368698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f297400e680 con 0x7f29840fe250 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f297bfff700 1 -- 172.21.15.49:0/2583368698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f297400ec90 con 0x7f29840fe250 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298410a4a0 con 0x7f29840fe250 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f297bfff700 1 -- 172.21.15.49:0/2583368698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2974013d40 con 0x7f29840fe250 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.289+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298410aa60 con 0x7f29840fe250 2024-02-22T00:45:03.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.290+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298405f590 con 0x7f29840fe250 2024-02-22T00:45:03.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.291+0000 7f297bfff700 1 -- 172.21.15.49:0/2583368698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f297400e7e0 con 0x7f29840fe250 2024-02-22T00:45:03.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.291+0000 7f297bfff700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f297006cab0 0x7f297006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.291+0000 7f297bfff700 1 -- 172.21.15.49:0/2583368698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f297408bbe0 con 0x7f29840fe250 2024-02-22T00:45:03.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.291+0000 7f2982ffd700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f297006cab0 0x7f297006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:03.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.292+0000 7f2982ffd700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f297006cab0 0x7f297006ef70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f296c004f10 tx=0x7f296c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:03.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.296+0000 7f297bfff700 1 -- 172.21.15.49:0/2583368698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2974059740 con 0x7f29840fe250 2024-02-22T00:45:03.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.512+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f298410ac80 con 0x7f297006cab0 2024-02-22T00:45:03.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.514+0000 7f297bfff700 1 -- 172.21.15.49:0/2583368698 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f298410ac80 con 0x7f297006cab0 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f297006cab0 msgr2=0x7f297006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f297006cab0 0x7f297006ef70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f296c004f10 tx=0x7f296c009cb0).stop 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fe250 msgr2=0x7f29841106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fe250 0x7f29841106d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f297400c710 tx=0x7f2974007ec0).stop 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 shutdown_connections 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f297006cab0 0x7f297006ef70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29840fd8f0 0x7f29841101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 --2- 172.21.15.49:0/2583368698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29840fe250 0x7f29841106d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 >> 172.21.15.49:0/2583368698 conn(0x7f29840f34b0 msgr2=0x7f298406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:03.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 shutdown_connections 2024-02-22T00:45:03.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.516+0000 7f29894fe700 1 -- 172.21.15.49:0/2583368698 wait complete. 2024-02-22T00:45:03.528 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:45:03.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 -- 172.21.15.49:0/2471487180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 msgr2=0x7f4ccc101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 --2- 172.21.15.49:0/2471487180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 0x7f4ccc101910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f4cc80047f0 tx=0x7f4cc8009cb0).stop 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 -- 172.21.15.49:0/2471487180 shutdown_connections 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 --2- 172.21.15.49:0/2471487180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 0x7f4ccc101910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 --2- 172.21.15.49:0/2471487180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ccc0f88a0 0x7f4ccc0f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 -- 172.21.15.49:0/2471487180 >> 172.21.15.49:0/2471487180 conn(0x7f4ccc070590 msgr2=0x7f4ccc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 -- 172.21.15.49:0/2471487180 shutdown_connections 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 -- 172.21.15.49:0/2471487180 wait complete. 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 Processor -- start 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.619+0000 7f4cd42d7700 1 -- start start 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd42d7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ccc0f88a0 0x7f4ccc10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd42d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 0x7f4ccc10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd42d7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc10eb70 con 0x7f4ccc0f9200 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd42d7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc10ecb0 con 0x7f4ccc0f88a0 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd1872700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 0x7f4ccc10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd1872700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 0x7f4ccc10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48866/0 (socket says 172.21.15.49:48866) 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd1872700 1 -- 172.21.15.49:0/1407797569 learned_addr learned my addr 172.21.15.49:0/1407797569 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd2073700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ccc0f88a0 0x7f4ccc10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd1872700 1 -- 172.21.15.49:0/1407797569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ccc0f88a0 msgr2=0x7f4ccc10e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd1872700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ccc0f88a0 0x7f4ccc10e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd1872700 1 -- 172.21.15.49:0/1407797569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc8005040 con 0x7f4ccc0f9200 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd1872700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 0x7f4ccc10e570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f4cc800b120 tx=0x7f4cc8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cc3779700 1 -- 172.21.15.49:0/1407797569 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc800e030 con 0x7f4ccc0f9200 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cc3779700 1 -- 172.21.15.49:0/1407797569 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4cc8007e90 con 0x7f4ccc0f9200 2024-02-22T00:45:03.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cc3779700 1 -- 172.21.15.49:0/1407797569 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cc8018070 con 0x7f4ccc0f9200 2024-02-22T00:45:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.620+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc1082e0 con 0x7f4ccc0f9200 2024-02-22T00:45:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.621+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc1087c0 con 0x7f4ccc0f9200 2024-02-22T00:45:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.621+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc05f590 con 0x7f4ccc0f9200 2024-02-22T00:45:03.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.622+0000 7f4cc3779700 1 -- 172.21.15.49:0/1407797569 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4cc801d420 con 0x7f4ccc0f9200 2024-02-22T00:45:03.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.622+0000 7f4cc3779700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4cb806caa0 0x7f4cb806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.622+0000 7f4cc3779700 1 -- 172.21.15.49:0/1407797569 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4cc808d1a0 con 0x7f4ccc0f9200 2024-02-22T00:45:03.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.622+0000 7f4cd2073700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4cb806caa0 0x7f4cb806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:03.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.623+0000 7f4cd2073700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4cb806caa0 0x7f4cb806ef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4cbc004b60 tx=0x7f4cbc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:03.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.627+0000 7f4cc3779700 1 -- 172.21.15.49:0/1407797569 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4cc805ad00 con 0x7f4ccc0f9200 2024-02-22T00:45:03.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.842+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ccc109770 con 0x7f4cb806caa0 2024-02-22T00:45:03.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.843+0000 7f4cc3779700 1 -- 172.21.15.49:0/1407797569 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4ccc109770 con 0x7f4cb806caa0 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4cb806caa0 msgr2=0x7f4cb806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4cb806caa0 0x7f4cb806ef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4cbc004b60 tx=0x7f4cbc009040).stop 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 msgr2=0x7f4ccc10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 0x7f4ccc10e570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f4cc800b120 tx=0x7f4cc8009cb0).stop 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 shutdown_connections 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4cb806caa0 0x7f4cb806ef60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ccc0f88a0 0x7f4ccc10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 --2- 172.21.15.49:0/1407797569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ccc0f9200 0x7f4ccc10e570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 >> 172.21.15.49:0/1407797569 conn(0x7f4ccc070590 msgr2=0x7f4ccc0fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:03.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 shutdown_connections 2024-02-22T00:45:03.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.845+0000 7f4cd42d7700 1 -- 172.21.15.49:0/1407797569 wait complete. 2024-02-22T00:45:03.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.946+0000 7f070a54c700 1 -- 172.21.15.49:0/645769858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 msgr2=0x7f07040fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.946+0000 7f070a54c700 1 --2- 172.21.15.49:0/645769858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 0x7f07040fcbd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f06f40047f0 tx=0x7f06f4009cb0).stop 2024-02-22T00:45:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.946+0000 7f070a54c700 1 -- 172.21.15.49:0/645769858 shutdown_connections 2024-02-22T00:45:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.946+0000 7f070a54c700 1 --2- 172.21.15.49:0/645769858 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07040fd150 0x7f07040f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.946+0000 7f070a54c700 1 --2- 172.21.15.49:0/645769858 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 0x7f07040fcbd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.946+0000 7f070a54c700 1 -- 172.21.15.49:0/645769858 >> 172.21.15.49:0/645769858 conn(0x7f0704070590 msgr2=0x7f07040f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.946+0000 7f070a54c700 1 -- 172.21.15.49:0/645769858 shutdown_connections 2024-02-22T00:45:03.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.946+0000 7f070a54c700 1 -- 172.21.15.49:0/645769858 wait complete. 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.947+0000 7f070a54c700 1 Processor -- start 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.947+0000 7f070a54c700 1 -- start start 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f070a54c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 0x7f070410cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f070a54c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07040fd150 0x7f070410d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f070a54c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070410da20 con 0x7f07040fc7f0 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f070a54c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070410db60 con 0x7f07040fd150 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f0703fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 0x7f070410cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f0703fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 0x7f070410cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48880/0 (socket says 172.21.15.49:48880) 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f0703fff700 1 -- 172.21.15.49:0/2376663566 learned_addr learned my addr 172.21.15.49:0/2376663566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f0703fff700 1 -- 172.21.15.49:0/2376663566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07040fd150 msgr2=0x7f070410d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f0703fff700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07040fd150 0x7f070410d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f0703fff700 1 -- 172.21.15.49:0/2376663566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4005040 con 0x7f07040fc7f0 2024-02-22T00:45:03.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f0703fff700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 0x7f070410cf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f06f4005010 tx=0x7f06f4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f07017fa700 1 -- 172.21.15.49:0/2376663566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f400e030 con 0x7f07040fc7f0 2024-02-22T00:45:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f07017fa700 1 -- 172.21.15.49:0/2376663566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06f4007e90 con 0x7f07040fc7f0 2024-02-22T00:45:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.948+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0704107190 con 0x7f07040fc7f0 2024-02-22T00:45:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.949+0000 7f07017fa700 1 -- 172.21.15.49:0/2376663566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f4018070 con 0x7f07040fc7f0 2024-02-22T00:45:03.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.949+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07041076f0 con 0x7f07040fc7f0 2024-02-22T00:45:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.950+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070405f590 con 0x7f07040fc7f0 2024-02-22T00:45:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.950+0000 7f07017fa700 1 -- 172.21.15.49:0/2376663566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f06f401d6e0 con 0x7f07040fc7f0 2024-02-22T00:45:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.951+0000 7f07017fa700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f06ec06caa0 0x7f06ec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.951+0000 7f07037fe700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f06ec06caa0 0x7f06ec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.951+0000 7f07017fa700 1 -- 172.21.15.49:0/2376663566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f06f408cfb0 con 0x7f07040fc7f0 2024-02-22T00:45:03.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.951+0000 7f07037fe700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f06ec06caa0 0x7f06ec06ef60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0704108870 tx=0x7f06f8009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:03.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:03.955+0000 7f07017fa700 1 -- 172.21.15.49:0/2376663566 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f06f405abd0 con 0x7f07040fc7f0 2024-02-22T00:45:04.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.162+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f07040feb40 con 0x7f06ec06caa0 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.172+0000 7f07017fa700 1 -- 172.21.15.49:0/2376663566 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f07040feb40 con 0x7f06ec06caa0 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (8m) 2m ago 19m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (6m) 2m ago 19m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (5m) 98s ago 18m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (8m) 2m ago 19m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (2m) 2m ago 14m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (2m) 2m ago 14m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (101s) 98s ago 14m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (118s) 98s ago 14m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (9m) 2m ago 20m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:45:04.174 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (9m) 98s ago 18m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (6m) 2m ago 20m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (6m) 98s ago 18m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (8m) 2m ago 19m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (8m) 98s ago 18m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (5m) 2m ago 18m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 2m ago 17m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (4m) 2m ago 17m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (3m) 98s ago 16m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (3m) 98s ago 16m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (2m) 98s ago 15m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:45:04.175 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (8m) 98s ago 18m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:45:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f06ec06caa0 msgr2=0x7f06ec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f06ec06caa0 0x7f06ec06ef60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0704108870 tx=0x7f06f8009b60).stop 2024-02-22T00:45:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 msgr2=0x7f070410cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 0x7f070410cf30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f06f4005010 tx=0x7f06f4009cb0).stop 2024-02-22T00:45:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 shutdown_connections 2024-02-22T00:45:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f06ec06caa0 0x7f06ec06ef60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f07040fc7f0 0x7f070410cf30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 --2- 172.21.15.49:0/2376663566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07040fd150 0x7f070410d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:45:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 >> 172.21.15.49:0/2376663566 conn(0x7f0704070590 msgr2=0x7f07040fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 shutdown_connections 2024-02-22T00:45:04.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.174+0000 7f070a54c700 1 -- 172.21.15.49:0/2376663566 wait complete. 2024-02-22T00:45:04.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.274+0000 7fa97d4f7700 1 -- 172.21.15.49:0/489189354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 msgr2=0x7fa9780f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.274+0000 7fa97d4f7700 1 --2- 172.21.15.49:0/489189354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 0x7fa9780f6920 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fa9680047f0 tx=0x7fa968009cb0).stop 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.275+0000 7fa97d4f7700 1 -- 172.21.15.49:0/489189354 shutdown_connections 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.275+0000 7fa97d4f7700 1 --2- 172.21.15.49:0/489189354 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 0x7fa9780f6920 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.275+0000 7fa97d4f7700 1 --2- 172.21.15.49:0/489189354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9780fc7e0 0x7fa9780fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.275+0000 7fa97d4f7700 1 -- 172.21.15.49:0/489189354 >> 172.21.15.49:0/489189354 conn(0x7fa9780f23c0 msgr2=0x7fa9780f47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.275+0000 7fa97d4f7700 1 -- 172.21.15.49:0/489189354 shutdown_connections 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.275+0000 7fa97d4f7700 1 -- 172.21.15.49:0/489189354 wait complete. 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.275+0000 7fa97d4f7700 1 Processor -- start 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.275+0000 7fa97d4f7700 1 -- start start 2024-02-22T00:45:04.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa97d4f7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9780fc7e0 0x7fa97810e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa97d4f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 0x7fa97810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa97d4f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97810ebe0 con 0x7fa9780fd140 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa97d4f7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978108200 con 0x7fa9780fc7e0 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa9767fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 0x7fa97810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa9767fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 0x7fa97810e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48890/0 (socket says 172.21.15.49:48890) 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa9767fc700 1 -- 172.21.15.49:0/1905885180 learned_addr learned my addr 172.21.15.49:0/1905885180 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa976ffd700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9780fc7e0 0x7fa97810e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa9767fc700 1 -- 172.21.15.49:0/1905885180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9780fc7e0 msgr2=0x7fa97810e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa9767fc700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9780fc7e0 0x7fa97810e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa9767fc700 1 -- 172.21.15.49:0/1905885180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968005040 con 0x7fa9780fd140 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa9767fc700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 0x7fa97810e550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa9680099f0 tx=0x7fa968009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa95ffff700 1 -- 172.21.15.49:0/1905885180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa96800e030 con 0x7fa9780fd140 2024-02-22T00:45:04.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa95ffff700 1 -- 172.21.15.49:0/1905885180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa968007e90 con 0x7fa9780fd140 2024-02-22T00:45:04.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa95ffff700 1 -- 172.21.15.49:0/1905885180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa968018070 con 0x7fa9780fd140 2024-02-22T00:45:04.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.276+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa978108450 con 0x7fa9780fd140 2024-02-22T00:45:04.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.277+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa978108930 con 0x7fa9780fd140 2024-02-22T00:45:04.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.278+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978060370 con 0x7fa9780fd140 2024-02-22T00:45:04.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.278+0000 7fa95ffff700 1 -- 172.21.15.49:0/1905885180 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa96801d420 con 0x7fa9780fd140 2024-02-22T00:45:04.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.278+0000 7fa95ffff700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa96006caa0 0x7fa96006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:04.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.278+0000 7fa95ffff700 1 -- 172.21.15.49:0/1905885180 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa96808d230 con 0x7fa9780fd140 2024-02-22T00:45:04.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.278+0000 7fa976ffd700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa96006caa0 0x7fa96006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:04.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.279+0000 7fa976ffd700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa96006caa0 0x7fa96006ef60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fa96c00b910 tx=0x7fa96c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:04.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.283+0000 7fa95ffff700 1 -- 172.21.15.49:0/1905885180 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa96805ad90 con 0x7fa9780fd140 2024-02-22T00:45:04.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:04 smithi049 ceph-mon[132694]: pgmap v244: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:04 smithi161 ceph-mon[113442]: pgmap v244: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:04.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.563+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa978047540 con 0x7fa9780fd140 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.564+0000 7fa95ffff700 1 -- 172.21.15.49:0/1905885180 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fa96805a920 con 0x7fa9780fd140 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:45:04.566 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:45:04.567 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:45:04.567 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:45:04.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:45:04.567 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:45:04.567 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:45:04.567 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:45:04.567 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa96006caa0 msgr2=0x7fa96006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa96006caa0 0x7fa96006ef60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fa96c00b910 tx=0x7fa96c008040).stop 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 msgr2=0x7fa97810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 0x7fa97810e550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fa9680099f0 tx=0x7fa968009cb0).stop 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 shutdown_connections 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa96006caa0 0x7fa96006ef60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9780fc7e0 0x7fa97810e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 --2- 172.21.15.49:0/1905885180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9780fd140 0x7fa97810e550 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 >> 172.21.15.49:0/1905885180 conn(0x7fa9780f23c0 msgr2=0x7fa978061320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 shutdown_connections 2024-02-22T00:45:04.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.566+0000 7fa97d4f7700 1 -- 172.21.15.49:0/1905885180 wait complete. 2024-02-22T00:45:04.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.668+0000 7fcaacaa0700 1 -- 172.21.15.49:0/1848165537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 msgr2=0x7fcaa80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.668+0000 7fcaacaa0700 1 --2- 172.21.15.49:0/1848165537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 0x7fcaa80f6930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fca900047f0 tx=0x7fca90009cb0).stop 2024-02-22T00:45:04.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.668+0000 7fcaacaa0700 1 -- 172.21.15.49:0/1848165537 shutdown_connections 2024-02-22T00:45:04.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.668+0000 7fcaacaa0700 1 --2- 172.21.15.49:0/1848165537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 0x7fcaa80f6930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.668+0000 7fcaacaa0700 1 --2- 172.21.15.49:0/1848165537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaa80fc7f0 0x7fcaa80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.668+0000 7fcaacaa0700 1 -- 172.21.15.49:0/1848165537 >> 172.21.15.49:0/1848165537 conn(0x7fcaa8070590 msgr2=0x7fcaa80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:04.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.668+0000 7fcaacaa0700 1 -- 172.21.15.49:0/1848165537 shutdown_connections 2024-02-22T00:45:04.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.669+0000 7fcaacaa0700 1 -- 172.21.15.49:0/1848165537 wait complete. 2024-02-22T00:45:04.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.669+0000 7fcaacaa0700 1 Processor -- start 2024-02-22T00:45:04.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.669+0000 7fcaacaa0700 1 -- start start 2024-02-22T00:45:04.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.669+0000 7fcaacaa0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaa80fc7f0 0x7fcaa80f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:04.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.669+0000 7fcaacaa0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 0x7fcaa80f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:04.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaacaa0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80f8f20 con 0x7fcaa80fd150 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaacaa0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80f9060 con 0x7fcaa80fc7f0 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 0x7fcaa80f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 0x7fcaa80f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48900/0 (socket says 172.21.15.49:48900) 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa5d9b700 1 -- 172.21.15.49:0/2693360474 learned_addr learned my addr 172.21.15.49:0/2693360474 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa659c700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaa80fc7f0 0x7fcaa80f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa5d9b700 1 -- 172.21.15.49:0/2693360474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaa80fc7f0 msgr2=0x7fcaa80f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa5d9b700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaa80fc7f0 0x7fcaa80f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa5d9b700 1 -- 172.21.15.49:0/2693360474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90005040 con 0x7fcaa80fd150 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa659c700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaa80fc7f0 0x7fcaa80f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaa5d9b700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 0x7fcaa80f8a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fca900099f0 tx=0x7fca90009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fca9f7fe700 1 -- 172.21.15.49:0/2693360474 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9000e030 con 0x7fcaa80fd150 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa80f92b0 con 0x7fcaa80fd150 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fca9f7fe700 1 -- 172.21.15.49:0/2693360474 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca90007e90 con 0x7fcaa80fd150 2024-02-22T00:45:04.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fca9f7fe700 1 -- 172.21.15.49:0/2693360474 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca90018070 con 0x7fcaa80fd150 2024-02-22T00:45:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.670+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa81145f0 con 0x7fcaa80fd150 2024-02-22T00:45:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.671+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa805f590 con 0x7fcaa80fd150 2024-02-22T00:45:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.672+0000 7fca9f7fe700 1 -- 172.21.15.49:0/2693360474 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fca9001d420 con 0x7fcaa80fd150 2024-02-22T00:45:04.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.672+0000 7fca9f7fe700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca9406caa0 0x7fca9406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.672+0000 7fca9f7fe700 1 -- 172.21.15.49:0/2693360474 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fca9008d240 con 0x7fcaa80fd150 2024-02-22T00:45:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.672+0000 7fcaa659c700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca9406caa0 0x7fca9406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:04.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.673+0000 7fcaa659c700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca9406caa0 0x7fca9406ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fca98007fd0 tx=0x7fca98009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:04.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.677+0000 7fca9f7fe700 1 -- 172.21.15.49:0/2693360474 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fca90057310 con 0x7fcaa80fd150 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.921+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcaa8047540 con 0x7fcaa80fd150 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.922+0000 7fca9f7fe700 1 -- 172.21.15.49:0/2693360474 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fca9005a930 con 0x7fcaa80fd150 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:45:04.924 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:45:04.925 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:45:04.926 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:45:04.927 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:45:04.927 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:45:04.927 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:45:04.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca9406caa0 msgr2=0x7fca9406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca9406caa0 0x7fca9406ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fca98007fd0 tx=0x7fca98009040).stop 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 msgr2=0x7fcaa80f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 0x7fcaa80f8a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fca900099f0 tx=0x7fca90009cb0).stop 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 shutdown_connections 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca9406caa0 0x7fca9406ef60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaa80fc7f0 0x7fcaa80f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 --2- 172.21.15.49:0/2693360474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa80fd150 0x7fcaa80f8a30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 >> 172.21.15.49:0/2693360474 conn(0x7fcaa8070590 msgr2=0x7fcaa8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 shutdown_connections 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:04.924+0000 7fcaacaa0700 1 -- 172.21.15.49:0/2693360474 wait complete. 2024-02-22T00:45:04.928 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 -- 172.21.15.49:0/928244960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f8940 msgr2=0x7f0a900f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 --2- 172.21.15.49:0/928244960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f8940 0x7f0a900f8d20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f0a840047f0 tx=0x7f0a84009cb0).stop 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 -- 172.21.15.49:0/928244960 shutdown_connections 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 --2- 172.21.15.49:0/928244960 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a900f9210 0x7f0a901019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 --2- 172.21.15.49:0/928244960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f8940 0x7f0a900f8d20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 -- 172.21.15.49:0/928244960 >> 172.21.15.49:0/928244960 conn(0x7f0a90070590 msgr2=0x7f0a900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 -- 172.21.15.49:0/928244960 shutdown_connections 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 -- 172.21.15.49:0/928244960 wait complete. 2024-02-22T00:45:05.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.027+0000 7f0a9717f700 1 Processor -- start 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a9717f700 1 -- start start 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a9717f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a900f8940 0x7f0a9010e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a9717f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f9210 0x7f0a9010e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a9717f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9010eb40 con 0x7f0a900f9210 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a9717f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9010ec80 con 0x7f0a900f8940 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f9210 0x7f0a9010e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f9210 0x7f0a9010e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48910/0 (socket says 172.21.15.49:48910) 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8ffff700 1 -- 172.21.15.49:0/1069964885 learned_addr learned my addr 172.21.15.49:0/1069964885 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a94f1b700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a900f8940 0x7f0a9010e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8ffff700 1 -- 172.21.15.49:0/1069964885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a900f8940 msgr2=0x7f0a9010e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8ffff700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a900f8940 0x7f0a9010e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8ffff700 1 -- 172.21.15.49:0/1069964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a84005040 con 0x7f0a900f9210 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8ffff700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f9210 0x7f0a9010e540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f0a7c00c740 tx=0x7f0a7c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:05.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8dffb700 1 -- 172.21.15.49:0/1069964885 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a7c00e680 con 0x7f0a900f9210 2024-02-22T00:45:05.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.028+0000 7f0a8dffb700 1 -- 172.21.15.49:0/1069964885 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a7c00ec90 con 0x7f0a900f9210 2024-02-22T00:45:05.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.029+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a90108310 con 0x7f0a900f9210 2024-02-22T00:45:05.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.029+0000 7f0a8dffb700 1 -- 172.21.15.49:0/1069964885 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a7c013d30 con 0x7f0a900f9210 2024-02-22T00:45:05.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.029+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a90108850 con 0x7f0a900f9210 2024-02-22T00:45:05.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.030+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9005f590 con 0x7f0a900f9210 2024-02-22T00:45:05.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.030+0000 7f0a8dffb700 1 -- 172.21.15.49:0/1069964885 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0a7c013410 con 0x7f0a900f9210 2024-02-22T00:45:05.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.030+0000 7f0a8dffb700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0a8006caa0 0x7f0a8006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:05.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.030+0000 7f0a8dffb700 1 -- 172.21.15.49:0/1069964885 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0a7c08bfa0 con 0x7f0a900f9210 2024-02-22T00:45:05.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.031+0000 7f0a94f1b700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0a8006caa0 0x7f0a8006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:05.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.031+0000 7f0a94f1b700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0a8006caa0 0x7f0a8006ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0a84007cf0 tx=0x7f0a8400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:05.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.035+0000 7f0a8dffb700 1 -- 172.21.15.49:0/1069964885 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0a7c059b00 con 0x7f0a900f9210 2024-02-22T00:45:05.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.255+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a90108b20 con 0x7f0a8006caa0 2024-02-22T00:45:05.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.256+0000 7f0a8dffb700 1 -- 172.21.15.49:0/1069964885 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0a90108b20 con 0x7f0a8006caa0 2024-02-22T00:45:05.258 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:45:05.258 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:45:05.258 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:45:05.258 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:45:05.259 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:45:05.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0a8006caa0 msgr2=0x7f0a8006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:05.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0a8006caa0 0x7f0a8006ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0a84007cf0 tx=0x7f0a8400b040).stop 2024-02-22T00:45:05.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f9210 msgr2=0x7f0a9010e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f9210 0x7f0a9010e540 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f0a7c00c740 tx=0x7f0a7c007ef0).stop 2024-02-22T00:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 shutdown_connections 2024-02-22T00:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0a8006caa0 0x7f0a8006ef60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0a900f8940 0x7f0a9010e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 --2- 172.21.15.49:0/1069964885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a900f9210 0x7f0a9010e540 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 >> 172.21.15.49:0/1069964885 conn(0x7f0a90070590 msgr2=0x7f0a900fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 shutdown_connections 2024-02-22T00:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.258+0000 7f0a9717f700 1 -- 172.21.15.49:0/1069964885 wait complete. 2024-02-22T00:45:05.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 -- 172.21.15.49:0/735714579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f9200 msgr2=0x7f533c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 --2- 172.21.15.49:0/735714579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f9200 0x7f533c101910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f53300047f0 tx=0x7f5330009cb0).stop 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 -- 172.21.15.49:0/735714579 shutdown_connections 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 --2- 172.21.15.49:0/735714579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f9200 0x7f533c101910 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 --2- 172.21.15.49:0/735714579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f533c0f88a0 0x7f533c0f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 -- 172.21.15.49:0/735714579 >> 172.21.15.49:0/735714579 conn(0x7f533c070590 msgr2=0x7f533c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 -- 172.21.15.49:0/735714579 shutdown_connections 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 -- 172.21.15.49:0/735714579 wait complete. 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.360+0000 7f5341f39700 1 Processor -- start 2024-02-22T00:45:05.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f5341f39700 1 -- start start 2024-02-22T00:45:05.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f5341f39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f88a0 0x7f533c0f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:05.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f5341f39700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f533c0f9200 0x7f533c0f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f5341f39700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0f7230 con 0x7f533c0f88a0 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f5341f39700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0f7370 con 0x7f533c0f9200 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f533b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f88a0 0x7f533c0f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f533b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f88a0 0x7f533c0f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48926/0 (socket says 172.21.15.49:48926) 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f533b7fe700 1 -- 172.21.15.49:0/1521342549 learned_addr learned my addr 172.21.15.49:0/1521342549 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f533affd700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f533c0f9200 0x7f533c0f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f533b7fe700 1 -- 172.21.15.49:0/1521342549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f533c0f9200 msgr2=0x7f533c0f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f533b7fe700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f533c0f9200 0x7f533c0f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.361+0000 7f533b7fe700 1 -- 172.21.15.49:0/1521342549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330005040 con 0x7f533c0f88a0 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.362+0000 7f533b7fe700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f88a0 0x7f533c0f6850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f532c00b4b0 tx=0x7f532c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.362+0000 7f5338ff9700 1 -- 172.21.15.49:0/1521342549 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f532c002500 con 0x7f533c0f88a0 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.362+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c0f7620 con 0x7f533c0f88a0 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.362+0000 7f5338ff9700 1 -- 172.21.15.49:0/1521342549 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f532c002b10 con 0x7f533c0f88a0 2024-02-22T00:45:05.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.362+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c1147b0 con 0x7f533c0f88a0 2024-02-22T00:45:05.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.362+0000 7f5338ff9700 1 -- 172.21.15.49:0/1521342549 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f532c012b80 con 0x7f533c0f88a0 2024-02-22T00:45:05.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.363+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c05f590 con 0x7f533c0f88a0 2024-02-22T00:45:05.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.363+0000 7f5338ff9700 1 -- 172.21.15.49:0/1521342549 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f532c002660 con 0x7f533c0f88a0 2024-02-22T00:45:05.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.364+0000 7f5338ff9700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f532406cab0 0x7f532406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:05.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.364+0000 7f5338ff9700 1 -- 172.21.15.49:0/1521342549 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f532c08bcc0 con 0x7f533c0f88a0 2024-02-22T00:45:05.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.364+0000 7f533affd700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f532406cab0 0x7f532406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:05.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.364+0000 7f533affd700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f532406cab0 0x7f532406ef70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5330004f10 tx=0x7f5330009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:05.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.368+0000 7f5338ff9700 1 -- 172.21.15.49:0/1521342549 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f532c055d90 con 0x7f533c0f88a0 2024-02-22T00:45:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:05 smithi049 ceph-mon[132694]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:05 smithi049 ceph-mon[132694]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:05 smithi049 ceph-mon[132694]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:05 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1905885180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:45:05.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:05 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2693360474' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:45:05.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:05 smithi161 ceph-mon[113442]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:05.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:05 smithi161 ceph-mon[113442]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:05.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:05 smithi161 ceph-mon[113442]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:05.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:05 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1905885180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:45:05.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:05 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2693360474' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:45:05.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.650+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f533c047540 con 0x7f533c0f88a0 2024-02-22T00:45:05.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.650+0000 7f5338ff9700 1 -- 172.21.15.49:0/1521342549 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f532c0593b0 con 0x7f533c0f88a0 2024-02-22T00:45:05.652 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:45:05.652 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:45:05.652 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:45:05.652 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:45:05.652 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:45:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f532406cab0 msgr2=0x7f532406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f532406cab0 0x7f532406ef70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5330004f10 tx=0x7f5330009cb0).stop 2024-02-22T00:45:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f88a0 msgr2=0x7f533c0f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f88a0 0x7f533c0f6850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f532c00b4b0 tx=0x7f532c0090f0).stop 2024-02-22T00:45:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 shutdown_connections 2024-02-22T00:45:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f532406cab0 0x7f532406ef70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f533c0f88a0 0x7f533c0f6850 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 --2- 172.21.15.49:0/1521342549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f533c0f9200 0x7f533c0f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 >> 172.21.15.49:0/1521342549 conn(0x7f533c070590 msgr2=0x7f533c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 shutdown_connections 2024-02-22T00:45:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:05.652+0000 7f5341f39700 1 -- 172.21.15.49:0/1521342549 wait complete. 2024-02-22T00:45:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:06 smithi049 ceph-mon[132694]: pgmap v245: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:06 smithi049 ceph-mon[132694]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:06 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1521342549' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:45:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:06 smithi161 ceph-mon[113442]: pgmap v245: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:06 smithi161 ceph-mon[113442]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:06 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1521342549' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:45:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:08 smithi049 ceph-mon[132694]: pgmap v246: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:08 smithi161 ceph-mon[113442]: pgmap v246: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:10 smithi049 ceph-mon[132694]: pgmap v247: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:10 smithi161 ceph-mon[113442]: pgmap v247: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:12.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:12 smithi049 ceph-mon[132694]: pgmap v248: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:12 smithi161 ceph-mon[113442]: pgmap v248: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:13.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:45:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:45:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:14 smithi049 ceph-mon[132694]: pgmap v249: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:14 smithi161 ceph-mon[113442]: pgmap v249: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:16 smithi049 ceph-mon[132694]: pgmap v250: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:16 smithi161 ceph-mon[113442]: pgmap v250: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:18 smithi049 ceph-mon[132694]: pgmap v251: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:18 smithi161 ceph-mon[113442]: pgmap v251: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:20 smithi049 ceph-mon[132694]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:20 smithi161 ceph-mon[113442]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:22 smithi049 ceph-mon[132694]: pgmap v253: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:22 smithi161 ceph-mon[113442]: pgmap v253: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:24 smithi161 ceph-mon[113442]: pgmap v254: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:24.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:24 smithi049 ceph-mon[132694]: pgmap v254: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:26 smithi161 ceph-mon[113442]: pgmap v255: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:26.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:26 smithi049 ceph-mon[132694]: pgmap v255: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:28 smithi161 ceph-mon[113442]: pgmap v256: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:45:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:28 smithi049 ceph-mon[132694]: pgmap v256: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:45:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:30 smithi161 ceph-mon[113442]: pgmap v257: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:30 smithi049 ceph-mon[132694]: pgmap v257: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:32 smithi161 ceph-mon[113442]: pgmap v258: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:32.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:32 smithi049 ceph-mon[132694]: pgmap v258: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:34 smithi161 ceph-mon[113442]: pgmap v259: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:34 smithi049 ceph-mon[132694]: pgmap v259: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.769+0000 7f7713def700 1 -- 172.21.15.49:0/992923135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fc8a0 msgr2=0x7f770c0f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:35.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.769+0000 7f7713def700 1 --2- 172.21.15.49:0/992923135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fc8a0 0x7f770c0f6120 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f76fc0047f0 tx=0x7f76fc009cb0).stop 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.769+0000 7f7713def700 1 -- 172.21.15.49:0/992923135 shutdown_connections 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.769+0000 7f7713def700 1 --2- 172.21.15.49:0/992923135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fc8a0 0x7f770c0f6120 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.769+0000 7f7713def700 1 --2- 172.21.15.49:0/992923135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f770c0fbf40 0x7f770c0fc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.769+0000 7f7713def700 1 -- 172.21.15.49:0/992923135 >> 172.21.15.49:0/992923135 conn(0x7f770c06bdc0 msgr2=0x7f770c06c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.769+0000 7f7713def700 1 -- 172.21.15.49:0/992923135 shutdown_connections 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.769+0000 7f7713def700 1 -- 172.21.15.49:0/992923135 wait complete. 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7713def700 1 Processor -- start 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7713def700 1 -- start start 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7713def700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fbf40 0x7f770c10e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7713def700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f770c0fc8a0 0x7f770c10e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7713def700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c10eaf0 con 0x7f770c0fbf40 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7713def700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c10ec30 con 0x7f770c0fc8a0 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7711b8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fbf40 0x7f770c10e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7711b8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fbf40 0x7f770c10e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43426/0 (socket says 172.21.15.49:43426) 2024-02-22T00:45:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.770+0000 7f7711b8b700 1 -- 172.21.15.49:0/1628013730 learned_addr learned my addr 172.21.15.49:0/1628013730 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f771138a700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f770c0fc8a0 0x7f770c10e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7711b8b700 1 -- 172.21.15.49:0/1628013730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f770c0fc8a0 msgr2=0x7f770c10e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7711b8b700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f770c0fc8a0 0x7f770c10e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7711b8b700 1 -- 172.21.15.49:0/1628013730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc005040 con 0x7f770c0fbf40 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7711b8b700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fbf40 0x7f770c10e000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f770800a340 tx=0x7f770800c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7702ffd700 1 -- 172.21.15.49:0/1628013730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7708007b40 con 0x7f770c0fbf40 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7702ffd700 1 -- 172.21.15.49:0/1628013730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7708010040 con 0x7f770c0fbf40 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c108260 con 0x7f770c0fbf40 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7702ffd700 1 -- 172.21.15.49:0/1628013730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7708014860 con 0x7f770c0fbf40 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.771+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c108820 con 0x7f770c0fbf40 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.772+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c05f090 con 0x7f770c0fbf40 2024-02-22T00:45:35.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.773+0000 7f7702ffd700 1 -- 172.21.15.49:0/1628013730 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7708014a90 con 0x7f770c0fbf40 2024-02-22T00:45:35.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.773+0000 7f7702ffd700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f76f806cab0 0x7f76f806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:35.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.773+0000 7f7702ffd700 1 -- 172.21.15.49:0/1628013730 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f770808b3e0 con 0x7f770c0fbf40 2024-02-22T00:45:35.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.773+0000 7f771138a700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f76f806cab0 0x7f76f806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:35.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.774+0000 7f771138a700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f76f806cab0 0x7f76f806ef70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f76fc005010 tx=0x7f76fc009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:35.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.778+0000 7f7702ffd700 1 -- 172.21.15.49:0/1628013730 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7708058f40 con 0x7f770c0fbf40 2024-02-22T00:45:35.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.994+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f770c108eb0 con 0x7f76f806cab0 2024-02-22T00:45:35.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.995+0000 7f7702ffd700 1 -- 172.21.15.49:0/1628013730 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f770c108eb0 con 0x7f76f806cab0 2024-02-22T00:45:35.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f76f806cab0 msgr2=0x7f76f806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:35.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f76f806cab0 0x7f76f806ef70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f76fc005010 tx=0x7f76fc009cb0).stop 2024-02-22T00:45:35.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fbf40 msgr2=0x7f770c10e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:35.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fbf40 0x7f770c10e000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f770800a340 tx=0x7f770800c040).stop 2024-02-22T00:45:35.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 shutdown_connections 2024-02-22T00:45:36.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f76f806cab0 0x7f76f806ef70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f770c0fbf40 0x7f770c10e000 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 --2- 172.21.15.49:0/1628013730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f770c0fc8a0 0x7f770c10e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 >> 172.21.15.49:0/1628013730 conn(0x7f770c06bdc0 msgr2=0x7f770c0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:36.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 shutdown_connections 2024-02-22T00:45:36.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:35.997+0000 7f7713def700 1 -- 172.21.15.49:0/1628013730 wait complete. 2024-02-22T00:45:36.010 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:45:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.100+0000 7f5941acd700 1 -- 172.21.15.49:0/3805804957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 msgr2=0x7f593c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.100+0000 7f5941acd700 1 --2- 172.21.15.49:0/3805804957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 0x7f593c0fcbd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f59240047f0 tx=0x7f5924009cb0).stop 2024-02-22T00:45:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.100+0000 7f5941acd700 1 -- 172.21.15.49:0/3805804957 shutdown_connections 2024-02-22T00:45:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.100+0000 7f5941acd700 1 --2- 172.21.15.49:0/3805804957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f593c0fd150 0x7f593c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.100+0000 7f5941acd700 1 --2- 172.21.15.49:0/3805804957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 0x7f593c0fcbd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.100+0000 7f5941acd700 1 -- 172.21.15.49:0/3805804957 >> 172.21.15.49:0/3805804957 conn(0x7f593c070590 msgr2=0x7f593c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.100+0000 7f5941acd700 1 -- 172.21.15.49:0/3805804957 shutdown_connections 2024-02-22T00:45:36.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.100+0000 7f5941acd700 1 -- 172.21.15.49:0/3805804957 wait complete. 2024-02-22T00:45:36.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f5941acd700 1 Processor -- start 2024-02-22T00:45:36.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f5941acd700 1 -- start start 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f5941acd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 0x7f593c1091f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f5941acd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f593c0fd150 0x7f593c1096e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f5941acd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c109bd0 con 0x7f593c0fc7f0 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f5941acd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c109d10 con 0x7f593c0fd150 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f593b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 0x7f593c1091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f593b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 0x7f593c1091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43436/0 (socket says 172.21.15.49:43436) 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.101+0000 7f593b7fe700 1 -- 172.21.15.49:0/2879901879 learned_addr learned my addr 172.21.15.49:0/2879901879 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f593affd700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f593c0fd150 0x7f593c1096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f593b7fe700 1 -- 172.21.15.49:0/2879901879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f593c0fd150 msgr2=0x7f593c1096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f593b7fe700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f593c0fd150 0x7f593c1096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f593b7fe700 1 -- 172.21.15.49:0/2879901879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5924005040 con 0x7f593c0fc7f0 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f593b7fe700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 0x7f593c1091f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5924009380 tx=0x7f5924009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f5938f74700 1 -- 172.21.15.49:0/2879901879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5924018070 con 0x7f593c0fc7f0 2024-02-22T00:45:36.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f5938f74700 1 -- 172.21.15.49:0/2879901879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5924007e90 con 0x7f593c0fc7f0 2024-02-22T00:45:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c109f60 con 0x7f593c0fc7f0 2024-02-22T00:45:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f5938f74700 1 -- 172.21.15.49:0/2879901879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59240123c0 con 0x7f593c0fc7f0 2024-02-22T00:45:36.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.102+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c112550 con 0x7f593c0fc7f0 2024-02-22T00:45:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.103+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c05f590 con 0x7f593c0fc7f0 2024-02-22T00:45:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.103+0000 7f5938f74700 1 -- 172.21.15.49:0/2879901879 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f592401d420 con 0x7f593c0fc7f0 2024-02-22T00:45:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.104+0000 7f5938f74700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f592806caa0 0x7f592806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.104+0000 7f5938f74700 1 -- 172.21.15.49:0/2879901879 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f592408c930 con 0x7f593c0fc7f0 2024-02-22T00:45:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.104+0000 7f593affd700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f592806caa0 0x7f592806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:36.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.104+0000 7f593affd700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f592806caa0 0x7f592806ef60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f593c060ee0 tx=0x7f592c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:36.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.109+0000 7f5938f74700 1 -- 172.21.15.49:0/2879901879 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5924056a00 con 0x7f593c0fc7f0 2024-02-22T00:45:36.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.325+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f593c059120 con 0x7f592806caa0 2024-02-22T00:45:36.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.326+0000 7f5938f74700 1 -- 172.21.15.49:0/2879901879 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f593c059120 con 0x7f592806caa0 2024-02-22T00:45:36.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.328+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f592806caa0 msgr2=0x7f592806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.328+0000 7f5941acd700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f592806caa0 0x7f592806ef60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f593c060ee0 tx=0x7f592c00b040).stop 2024-02-22T00:45:36.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.328+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 msgr2=0x7f593c1091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.328+0000 7f5941acd700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 0x7f593c1091f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5924009380 tx=0x7f5924009cb0).stop 2024-02-22T00:45:36.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.329+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 shutdown_connections 2024-02-22T00:45:36.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.329+0000 7f5941acd700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f592806caa0 0x7f592806ef60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.329+0000 7f5941acd700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f593c0fc7f0 0x7f593c1091f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.329+0000 7f5941acd700 1 --2- 172.21.15.49:0/2879901879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f593c0fd150 0x7f593c1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.329+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 >> 172.21.15.49:0/2879901879 conn(0x7f593c070590 msgr2=0x7f593c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:36.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.329+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 shutdown_connections 2024-02-22T00:45:36.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.329+0000 7f5941acd700 1 -- 172.21.15.49:0/2879901879 wait complete. 2024-02-22T00:45:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.430+0000 7ff4609a2700 1 -- 172.21.15.49:0/1219096750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fd150 msgr2=0x7ff45c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.430+0000 7ff4609a2700 1 --2- 172.21.15.49:0/1219096750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fd150 0x7ff45c0f6930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7ff4500047f0 tx=0x7ff450009cb0).stop 2024-02-22T00:45:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.430+0000 7ff4609a2700 1 -- 172.21.15.49:0/1219096750 shutdown_connections 2024-02-22T00:45:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.430+0000 7ff4609a2700 1 --2- 172.21.15.49:0/1219096750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fd150 0x7ff45c0f6930 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.430+0000 7ff4609a2700 1 --2- 172.21.15.49:0/1219096750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0fc7f0 0x7ff45c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.431+0000 7ff4609a2700 1 -- 172.21.15.49:0/1219096750 >> 172.21.15.49:0/1219096750 conn(0x7ff45c070590 msgr2=0x7ff45c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.431+0000 7ff4609a2700 1 -- 172.21.15.49:0/1219096750 shutdown_connections 2024-02-22T00:45:36.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.431+0000 7ff4609a2700 1 -- 172.21.15.49:0/1219096750 wait complete. 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.431+0000 7ff4609a2700 1 Processor -- start 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.431+0000 7ff4609a2700 1 -- start start 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff4609a2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fc7f0 0x7ff45c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff4609a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0fd150 0x7ff45c1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff4609a2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c110cc0 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff4609a2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c110e00 con 0x7ff45c0fd150 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fc7f0 0x7ff45c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff45a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fc7f0 0x7ff45c1101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43454/0 (socket says 172.21.15.49:43454) 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff45a59c700 1 -- 172.21.15.49:0/3849667804 learned_addr learned my addr 172.21.15.49:0/3849667804 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:36.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff45a59c700 1 -- 172.21.15.49:0/3849667804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0fd150 msgr2=0x7ff45c1106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff45a59c700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0fd150 0x7ff45c1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:45:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff45a59c700 1 -- 172.21.15.49:0/3849667804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450005040 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff45a59c700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fc7f0 0x7ff45c1101d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7ff44c0041d0 tx=0x7ff44c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff44b7fe700 1 -- 172.21.15.49:0/3849667804 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff44c002d90 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c10a490 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff44b7fe700 1 -- 172.21.15.49:0/3849667804 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff44c00f040 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff44b7fe700 1 -- 172.21.15.49:0/3849667804 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff44c00d800 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.432+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c10aa50 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.433+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c05f590 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.434+0000 7ff44b7fe700 1 -- 172.21.15.49:0/3849667804 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff44c00dae0 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.434+0000 7ff44b7fe700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff44406caa0 0x7ff44406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.434+0000 7ff44b7fe700 1 -- 172.21.15.49:0/3849667804 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff44c08bdd0 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.434+0000 7ff459d9b700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff44406caa0 0x7ff44406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:36.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.435+0000 7ff459d9b700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff44406caa0 0x7ff44406ef60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff45c10bb10 tx=0x7ff450009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:36.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.439+0000 7ff44b7fe700 1 -- 172.21.15.49:0/3849667804 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff44c059930 con 0x7ff45c0fc7f0 2024-02-22T00:45:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:36 smithi161 ceph-mon[113442]: pgmap v260: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:36.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.644+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff45c10b0f0 con 0x7ff44406caa0 2024-02-22T00:45:36.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.655+0000 7ff44b7fe700 1 -- 172.21.15.49:0/3849667804 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7ff45c10b0f0 con 0x7ff44406caa0 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (8m) 2m ago 20m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (6m) 2m ago 19m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (6m) 2m ago 19m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (8m) 2m ago 19m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (2m) 2m ago 14m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (3m) 2m ago 14m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (2m) 2m ago 14m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (2m) 2m ago 14m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (10m) 2m ago 21m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:45:36.657 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (9m) 2m ago 19m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (7m) 2m ago 21m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (7m) 2m ago 19m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (9m) 2m ago 19m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (9m) 2m ago 19m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 2m ago 18m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (5m) 2m ago 18m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 2m ago 17m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (4m) 2m ago 17m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (3m) 2m ago 16m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (3m) 2m ago 16m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:45:36.658 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (9m) 2m ago 18m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:45:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff44406caa0 msgr2=0x7ff44406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff44406caa0 0x7ff44406ef60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff45c10bb10 tx=0x7ff450009cb0).stop 2024-02-22T00:45:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fc7f0 msgr2=0x7ff45c1101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fc7f0 0x7ff45c1101d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7ff44c0041d0 tx=0x7ff44c009f60).stop 2024-02-22T00:45:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 shutdown_connections 2024-02-22T00:45:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff44406caa0 0x7ff44406ef60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff45c0fc7f0 0x7ff45c1101d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 --2- 172.21.15.49:0/3849667804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0fd150 0x7ff45c1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:45:36.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 >> 172.21.15.49:0/3849667804 conn(0x7ff45c070590 msgr2=0x7ff45c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:36.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 shutdown_connections 2024-02-22T00:45:36.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.657+0000 7ff4609a2700 1 -- 172.21.15.49:0/3849667804 wait complete. 2024-02-22T00:45:36.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:36 smithi049 ceph-mon[132694]: pgmap v260: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.758+0000 7efd5b342700 1 -- 172.21.15.49:0/3379250062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 msgr2=0x7efd540ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.758+0000 7efd5b342700 1 --2- 172.21.15.49:0/3379250062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 0x7efd540ffeb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7efd500047f0 tx=0x7efd50009cb0).stop 2024-02-22T00:45:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.758+0000 7efd5b342700 1 -- 172.21.15.49:0/3379250062 shutdown_connections 2024-02-22T00:45:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.758+0000 7efd5b342700 1 --2- 172.21.15.49:0/3379250062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd54100430 0x7efd540f9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.758+0000 7efd5b342700 1 --2- 172.21.15.49:0/3379250062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 0x7efd540ffeb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.758+0000 7efd5b342700 1 -- 172.21.15.49:0/3379250062 >> 172.21.15.49:0/3379250062 conn(0x7efd540f5830 msgr2=0x7efd540f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.758+0000 7efd5b342700 1 -- 172.21.15.49:0/3379250062 shutdown_connections 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.758+0000 7efd5b342700 1 -- 172.21.15.49:0/3379250062 wait complete. 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd5b342700 1 Processor -- start 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd5b342700 1 -- start start 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd5b342700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 0x7efd541103f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd5b342700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd54100430 0x7efd541108e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd5b342700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54110ee0 con 0x7efd540ffad0 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd5b342700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54111020 con 0x7efd54100430 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd590de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 0x7efd541103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd590de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 0x7efd541103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43472/0 (socket says 172.21.15.49:43472) 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd590de700 1 -- 172.21.15.49:0/1565449404 learned_addr learned my addr 172.21.15.49:0/1565449404 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.759+0000 7efd588dd700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd54100430 0x7efd541108e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:36.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd590de700 1 -- 172.21.15.49:0/1565449404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd54100430 msgr2=0x7efd541108e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd590de700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd54100430 0x7efd541108e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd590de700 1 -- 172.21.15.49:0/1565449404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50005040 con 0x7efd540ffad0 2024-02-22T00:45:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd590de700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 0x7efd541103f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7efd50005010 tx=0x7efd50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd4a7fc700 1 -- 172.21.15.49:0/1565449404 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd5000e030 con 0x7efd540ffad0 2024-02-22T00:45:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd4a7fc700 1 -- 172.21.15.49:0/1565449404 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd50007e90 con 0x7efd540ffad0 2024-02-22T00:45:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd4a7fc700 1 -- 172.21.15.49:0/1565449404 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd50018070 con 0x7efd540ffad0 2024-02-22T00:45:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5410a650 con 0x7efd540ffad0 2024-02-22T00:45:36.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.760+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5410ab30 con 0x7efd540ffad0 2024-02-22T00:45:36.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.761+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5405f510 con 0x7efd540ffad0 2024-02-22T00:45:36.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.762+0000 7efd4a7fc700 1 -- 172.21.15.49:0/1565449404 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efd5001d670 con 0x7efd540ffad0 2024-02-22T00:45:36.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.762+0000 7efd4a7fc700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4006caa0 0x7efd4006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:36.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.762+0000 7efd4a7fc700 1 -- 172.21.15.49:0/1565449404 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7efd5008ce90 con 0x7efd540ffad0 2024-02-22T00:45:36.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.762+0000 7efd588dd700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4006caa0 0x7efd4006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:36.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.763+0000 7efd588dd700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4006caa0 0x7efd4006ef60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7efd5410bd30 tx=0x7efd4400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:36.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:36.767+0000 7efd4a7fc700 1 -- 172.21.15.49:0/1565449404 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efd5005a760 con 0x7efd540ffad0 2024-02-22T00:45:37.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.050+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd5410ba70 con 0x7efd540ffad0 2024-02-22T00:45:37.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.050+0000 7efd4a7fc700 1 -- 172.21.15.49:0/1565449404 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7efd5005a580 con 0x7efd540ffad0 2024-02-22T00:45:37.052 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:45:37.052 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:45:37.053 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:45:37.054 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:45:37.054 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:45:37.054 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:45:37.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4006caa0 msgr2=0x7efd4006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4006caa0 0x7efd4006ef60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7efd5410bd30 tx=0x7efd4400b040).stop 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 msgr2=0x7efd541103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 0x7efd541103f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7efd50005010 tx=0x7efd50009cb0).stop 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 shutdown_connections 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4006caa0 0x7efd4006ef60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd540ffad0 0x7efd541103f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 --2- 172.21.15.49:0/1565449404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd54100430 0x7efd541108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 >> 172.21.15.49:0/1565449404 conn(0x7efd540f5830 msgr2=0x7efd54103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 shutdown_connections 2024-02-22T00:45:37.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.052+0000 7efd5b342700 1 -- 172.21.15.49:0/1565449404 wait complete. 2024-02-22T00:45:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.154+0000 7fb426c04700 1 -- 172.21.15.49:0/2920188908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 msgr2=0x7fb4200f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.154+0000 7fb426c04700 1 --2- 172.21.15.49:0/2920188908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 0x7fb4200f6930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fb40c0047f0 tx=0x7fb40c009cb0).stop 2024-02-22T00:45:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.154+0000 7fb426c04700 1 -- 172.21.15.49:0/2920188908 shutdown_connections 2024-02-22T00:45:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.154+0000 7fb426c04700 1 --2- 172.21.15.49:0/2920188908 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 0x7fb4200f6930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.154+0000 7fb426c04700 1 --2- 172.21.15.49:0/2920188908 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4200fc7f0 0x7fb4200fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.154+0000 7fb426c04700 1 -- 172.21.15.49:0/2920188908 >> 172.21.15.49:0/2920188908 conn(0x7fb420070590 msgr2=0x7fb4200f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.154+0000 7fb426c04700 1 -- 172.21.15.49:0/2920188908 shutdown_connections 2024-02-22T00:45:37.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.154+0000 7fb426c04700 1 -- 172.21.15.49:0/2920188908 wait complete. 2024-02-22T00:45:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.155+0000 7fb426c04700 1 Processor -- start 2024-02-22T00:45:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.155+0000 7fb426c04700 1 -- start start 2024-02-22T00:45:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb426c04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4200fc7f0 0x7fb420109060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb426c04700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 0x7fb420109550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb426c04700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420109a90 con 0x7fb4200fd150 2024-02-22T00:45:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb426c04700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420109bd0 con 0x7fb4200fc7f0 2024-02-22T00:45:37.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 0x7fb420109550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 0x7fb420109550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43488/0 (socket says 172.21.15.49:43488) 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41ffff700 1 -- 172.21.15.49:0/3601933436 learned_addr learned my addr 172.21.15.49:0/3601933436 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb4249a0700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4200fc7f0 0x7fb420109060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41ffff700 1 -- 172.21.15.49:0/3601933436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4200fc7f0 msgr2=0x7fb420109060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41ffff700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4200fc7f0 0x7fb420109060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41ffff700 1 -- 172.21.15.49:0/3601933436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c005040 con 0x7fb4200fd150 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41ffff700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 0x7fb420109550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb40c000c00 tx=0x7fb40c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41dffb700 1 -- 172.21.15.49:0/3601933436 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb40c00e030 con 0x7fb4200fd150 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb420109e20 con 0x7fb4200fd150 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41dffb700 1 -- 172.21.15.49:0/3601933436 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb40c007e90 con 0x7fb4200fd150 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.156+0000 7fb41dffb700 1 -- 172.21.15.49:0/3601933436 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb40c018070 con 0x7fb4200fd150 2024-02-22T00:45:37.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.157+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4201123c0 con 0x7fb4200fd150 2024-02-22T00:45:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.158+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42005f590 con 0x7fb4200fd150 2024-02-22T00:45:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.158+0000 7fb41dffb700 1 -- 172.21.15.49:0/3601933436 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb40c01d420 con 0x7fb4200fd150 2024-02-22T00:45:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.158+0000 7fb41dffb700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb41006cab0 0x7fb41006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.159+0000 7fb41dffb700 1 -- 172.21.15.49:0/3601933436 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb40c08d010 con 0x7fb4200fd150 2024-02-22T00:45:37.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.159+0000 7fb4249a0700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb41006cab0 0x7fb41006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.159+0000 7fb4249a0700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb41006cab0 0x7fb41006ef70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fb414004dc0 tx=0x7fb41400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:37.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.163+0000 7fb41dffb700 1 -- 172.21.15.49:0/3601933436 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb40c0c0190 con 0x7fb4200fd150 2024-02-22T00:45:37.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.409+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb420047540 con 0x7fb4200fd150 2024-02-22T00:45:37.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.409+0000 7fb41dffb700 1 -- 172.21.15.49:0/3601933436 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fb40c057020 con 0x7fb4200fd150 2024-02-22T00:45:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:45:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:45:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:45:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:45:37.412 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:45:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:45:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:45:37.412 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:45:37.413 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:45:37.414 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:45:37.414 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:45:37.414 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:45:37.414 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:45:37.414 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:45:37.414 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:45:37.415 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:45:37.416 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:45:37.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb41006cab0 msgr2=0x7fb41006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb41006cab0 0x7fb41006ef70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fb414004dc0 tx=0x7fb41400b040).stop 2024-02-22T00:45:37.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 msgr2=0x7fb420109550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 0x7fb420109550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fb40c000c00 tx=0x7fb40c009cb0).stop 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 shutdown_connections 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb41006cab0 0x7fb41006ef70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4200fc7f0 0x7fb420109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 --2- 172.21.15.49:0/3601933436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb4200fd150 0x7fb420109550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 >> 172.21.15.49:0/3601933436 conn(0x7fb420070590 msgr2=0x7fb4200fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 shutdown_connections 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.411+0000 7fb426c04700 1 -- 172.21.15.49:0/3601933436 wait complete. 2024-02-22T00:45:37.418 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:45:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 -- 172.21.15.49:0/2252701975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 msgr2=0x7fdc900fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 --2- 172.21.15.49:0/2252701975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 0x7fdc900fcbd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fdc88009b60 tx=0x7fdc88004d10).stop 2024-02-22T00:45:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 -- 172.21.15.49:0/2252701975 shutdown_connections 2024-02-22T00:45:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 --2- 172.21.15.49:0/2252701975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc900fd150 0x7fdc900f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 --2- 172.21.15.49:0/2252701975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 0x7fdc900fcbd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 -- 172.21.15.49:0/2252701975 >> 172.21.15.49:0/2252701975 conn(0x7fdc90070590 msgr2=0x7fdc900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 -- 172.21.15.49:0/2252701975 shutdown_connections 2024-02-22T00:45:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 -- 172.21.15.49:0/2252701975 wait complete. 2024-02-22T00:45:37.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.514+0000 7fdc95e1e700 1 Processor -- start 2024-02-22T00:45:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc95e1e700 1 -- start start 2024-02-22T00:45:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc95e1e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 0x7fdc90110230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc95e1e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc900fd150 0x7fdc90110720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc95e1e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc90110d20 con 0x7fdc900fc7f0 2024-02-22T00:45:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc95e1e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc90110e60 con 0x7fdc900fd150 2024-02-22T00:45:37.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc8f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 0x7fdc90110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc8f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 0x7fdc90110230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43506/0 (socket says 172.21.15.49:43506) 2024-02-22T00:45:37.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc8f7fe700 1 -- 172.21.15.49:0/109066782 learned_addr learned my addr 172.21.15.49:0/109066782 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:37.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc8effd700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc900fd150 0x7fdc90110720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc8f7fe700 1 -- 172.21.15.49:0/109066782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc900fd150 msgr2=0x7fdc90110720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc8f7fe700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc900fd150 0x7fdc90110720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc8f7fe700 1 -- 172.21.15.49:0/109066782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc880097c0 con 0x7fdc900fc7f0 2024-02-22T00:45:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.515+0000 7fdc8f7fe700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 0x7fdc90110230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fdc88009040 tx=0x7fdc88004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.516+0000 7fdc8cff9700 1 -- 172.21.15.49:0/109066782 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc8800e070 con 0x7fdc900fc7f0 2024-02-22T00:45:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.516+0000 7fdc8cff9700 1 -- 172.21.15.49:0/109066782 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc8800bec0 con 0x7fdc900fc7f0 2024-02-22T00:45:37.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.516+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9010a490 con 0x7fdc900fc7f0 2024-02-22T00:45:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.516+0000 7fdc8cff9700 1 -- 172.21.15.49:0/109066782 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc88019070 con 0x7fdc900fc7f0 2024-02-22T00:45:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.516+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9010a9f0 con 0x7fdc900fc7f0 2024-02-22T00:45:37.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.517+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9005f590 con 0x7fdc900fc7f0 2024-02-22T00:45:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.518+0000 7fdc8cff9700 1 -- 172.21.15.49:0/109066782 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdc880139d0 con 0x7fdc900fc7f0 2024-02-22T00:45:37.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.518+0000 7fdc8cff9700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.518+0000 7fdc8cff9700 1 -- 172.21.15.49:0/109066782 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdc8808d170 con 0x7fdc900fc7f0 2024-02-22T00:45:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.518+0000 7fdc8effd700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.519+0000 7fdc8effd700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdc9010bb70 tx=0x7fdc78009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:37.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.522+0000 7fdc8cff9700 1 -- 172.21.15.49:0/109066782 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdc8805ac10 con 0x7fdc900fc7f0 2024-02-22T00:45:37.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:37 smithi161 ceph-mon[113442]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:37.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:37 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1565449404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:45:37.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:37 smithi049 ceph-mon[132694]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:37.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:37 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1565449404' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:45:37.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.737+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc9010b030 con 0x7fdc7c06caa0 2024-02-22T00:45:37.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.738+0000 7fdc8cff9700 1 -- 172.21.15.49:0/109066782 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fdc9010b030 con 0x7fdc7c06caa0 2024-02-22T00:45:37.741 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:45:37.741 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:45:37.741 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:45:37.741 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:45:37.741 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:45:37.741 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:45:37.741 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:45:37.741 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:45:37.742 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:45:37.742 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:45:37.742 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:45:37.742 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:45:37.742 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:45:37.742 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:45:37.742 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:45:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc7c06caa0 msgr2=0x7fdc7c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdc9010bb70 tx=0x7fdc78009da0).stop 2024-02-22T00:45:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 msgr2=0x7fdc90110230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 0x7fdc90110230 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fdc88009040 tx=0x7fdc88004d10).stop 2024-02-22T00:45:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 shutdown_connections 2024-02-22T00:45:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc7c06caa0 0x7fdc7c06ef60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdc900fc7f0 0x7fdc90110230 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 --2- 172.21.15.49:0/109066782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc900fd150 0x7fdc90110720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 >> 172.21.15.49:0/109066782 conn(0x7fdc90070590 msgr2=0x7fdc90060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:37.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 shutdown_connections 2024-02-22T00:45:37.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.740+0000 7fdc95e1e700 1 -- 172.21.15.49:0/109066782 wait complete. 2024-02-22T00:45:37.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.841+0000 7f7b86dd7700 1 -- 172.21.15.49:0/1374068083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 msgr2=0x7f7b80101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.841+0000 7f7b86dd7700 1 --2- 172.21.15.49:0/1374068083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 0x7f7b80101970 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f7b6c0047f0 tx=0x7f7b6c009cb0).stop 2024-02-22T00:45:37.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.841+0000 7f7b86dd7700 1 -- 172.21.15.49:0/1374068083 shutdown_connections 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.841+0000 7f7b86dd7700 1 --2- 172.21.15.49:0/1374068083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 0x7f7b80101970 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.841+0000 7f7b86dd7700 1 --2- 172.21.15.49:0/1374068083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b800f8900 0x7f7b800f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.841+0000 7f7b86dd7700 1 -- 172.21.15.49:0/1374068083 >> 172.21.15.49:0/1374068083 conn(0x7f7b80070590 msgr2=0x7f7b800f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.841+0000 7f7b86dd7700 1 -- 172.21.15.49:0/1374068083 shutdown_connections 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.841+0000 7f7b86dd7700 1 -- 172.21.15.49:0/1374068083 wait complete. 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b86dd7700 1 Processor -- start 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b86dd7700 1 -- start start 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b86dd7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b800f8900 0x7f7b8010e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b86dd7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 0x7f7b8010e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b86dd7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8010eb00 con 0x7f7b800f9260 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b86dd7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8010ec40 con 0x7f7b800f8900 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b7ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 0x7f7b8010e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b7ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 0x7f7b8010e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43526/0 (socket says 172.21.15.49:43526) 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.842+0000 7f7b7ffff700 1 -- 172.21.15.49:0/4283482884 learned_addr learned my addr 172.21.15.49:0/4283482884 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b84b73700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b800f8900 0x7f7b8010e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b7ffff700 1 -- 172.21.15.49:0/4283482884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b800f8900 msgr2=0x7f7b8010e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b7ffff700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b800f8900 0x7f7b8010e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:37.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b7ffff700 1 -- 172.21.15.49:0/4283482884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c005040 con 0x7f7b800f9260 2024-02-22T00:45:37.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b7ffff700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 0x7f7b8010e500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f7b6c009380 tx=0x7f7b6c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:37.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b7dffb700 1 -- 172.21.15.49:0/4283482884 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b6c00e070 con 0x7f7b800f9260 2024-02-22T00:45:37.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b7dffb700 1 -- 172.21.15.49:0/4283482884 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7b6c007e90 con 0x7f7b800f9260 2024-02-22T00:45:37.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b80108270 con 0x7f7b800f9260 2024-02-22T00:45:37.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b7dffb700 1 -- 172.21.15.49:0/4283482884 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b6c018070 con 0x7f7b800f9260 2024-02-22T00:45:37.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.843+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b80108750 con 0x7f7b800f9260 2024-02-22T00:45:37.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.844+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8005f590 con 0x7f7b800f9260 2024-02-22T00:45:37.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.845+0000 7f7b7dffb700 1 -- 172.21.15.49:0/4283482884 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7b6c01d420 con 0x7f7b800f9260 2024-02-22T00:45:37.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.845+0000 7f7b7dffb700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7b7006caa0 0x7f7b7006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:45:37.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.845+0000 7f7b7dffb700 1 -- 172.21.15.49:0/4283482884 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7b6c08c800 con 0x7f7b800f9260 2024-02-22T00:45:37.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.845+0000 7f7b84b73700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7b7006caa0 0x7f7b7006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:45:37.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.846+0000 7f7b84b73700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7b7006caa0 0x7f7b7006ef60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7b74004dc0 tx=0x7f7b7400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:45:37.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:37.850+0000 7f7b7dffb700 1 -- 172.21.15.49:0/4283482884 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7b6c05a360 con 0x7f7b800f9260 2024-02-22T00:45:38.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.128+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7b80109780 con 0x7f7b800f9260 2024-02-22T00:45:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.128+0000 7f7b7dffb700 1 -- 172.21.15.49:0/4283482884 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f7b6c059ef0 con 0x7f7b800f9260 2024-02-22T00:45:38.131 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:45:38.131 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:45:38.131 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:45:38.131 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:45:38.131 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:45:38.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.130+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7b7006caa0 msgr2=0x7f7b7006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.130+0000 7f7b86dd7700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7b7006caa0 0x7f7b7006ef60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7b74004dc0 tx=0x7f7b7400b040).stop 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.130+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 msgr2=0x7f7b8010e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.130+0000 7f7b86dd7700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 0x7f7b8010e500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f7b6c009380 tx=0x7f7b6c009cb0).stop 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.131+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 shutdown_connections 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.131+0000 7f7b86dd7700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f7b7006caa0 0x7f7b7006ef60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.131+0000 7f7b86dd7700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b800f8900 0x7f7b8010e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.131+0000 7f7b86dd7700 1 --2- 172.21.15.49:0/4283482884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b800f9260 0x7f7b8010e500 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.131+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 >> 172.21.15.49:0/4283482884 conn(0x7f7b80070590 msgr2=0x7f7b800fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.131+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 shutdown_connections 2024-02-22T00:45:38.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:45:38.131+0000 7f7b86dd7700 1 -- 172.21.15.49:0/4283482884 wait complete. 2024-02-22T00:45:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:38 smithi161 ceph-mon[113442]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:38 smithi161 ceph-mon[113442]: pgmap v261: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:38 smithi161 ceph-mon[113442]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:38 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3601933436' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:45:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:38 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4283482884' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:45:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:38 smithi049 ceph-mon[132694]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:38 smithi049 ceph-mon[132694]: pgmap v261: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:38 smithi049 ceph-mon[132694]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:38 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3601933436' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:45:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:38 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4283482884' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:45:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:39 smithi161 ceph-mon[113442]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:39.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:39 smithi049 ceph-mon[132694]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:45:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:40 smithi161 ceph-mon[113442]: pgmap v262: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:40.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:40 smithi049 ceph-mon[132694]: pgmap v262: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:42 smithi161 ceph-mon[113442]: pgmap v263: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:42 smithi049 ceph-mon[132694]: pgmap v263: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:45:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:45:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:44 smithi161 ceph-mon[113442]: pgmap v264: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:44 smithi049 ceph-mon[132694]: pgmap v264: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:46 smithi161 ceph-mon[113442]: pgmap v265: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:46 smithi049 ceph-mon[132694]: pgmap v265: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:48 smithi161 ceph-mon[113442]: pgmap v266: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:48 smithi049 ceph-mon[132694]: pgmap v266: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:50 smithi161 ceph-mon[113442]: pgmap v267: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:50.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:50 smithi049 ceph-mon[132694]: pgmap v267: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:52 smithi161 ceph-mon[113442]: pgmap v268: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:52 smithi049 ceph-mon[132694]: pgmap v268: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:54 smithi161 ceph-mon[113442]: pgmap v269: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:54 smithi049 ceph-mon[132694]: pgmap v269: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:56 smithi161 ceph-mon[113442]: pgmap v270: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:56.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:56 smithi049 ceph-mon[132694]: pgmap v270: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:58 smithi161 ceph-mon[113442]: pgmap v271: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:45:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:45:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:58 smithi049 ceph-mon[132694]: pgmap v271: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:45:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:45:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:46:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:00 smithi161 ceph-mon[113442]: pgmap v272: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:00.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:00 smithi049 ceph-mon[132694]: pgmap v272: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:02 smithi161 ceph-mon[113442]: pgmap v273: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:02 smithi049 ceph-mon[132694]: pgmap v273: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:04 smithi161 ceph-mon[113442]: pgmap v274: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:04 smithi049 ceph-mon[132694]: pgmap v274: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:06 smithi161 ceph-mon[113442]: pgmap v275: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:06 smithi049 ceph-mon[132694]: pgmap v275: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:08.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.247+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/3213290129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fc7f0 msgr2=0x7fc5c40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.247+0000 7fc5cb7a6700 1 --2- 172.21.15.49:0/3213290129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fc7f0 0x7fc5c40fcbd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fc5c00047f0 tx=0x7fc5c0009cb0).stop 2024-02-22T00:46:08.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.247+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/3213290129 shutdown_connections 2024-02-22T00:46:08.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.247+0000 7fc5cb7a6700 1 --2- 172.21.15.49:0/3213290129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5c40fd150 0x7fc5c40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.247+0000 7fc5cb7a6700 1 --2- 172.21.15.49:0/3213290129 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fc7f0 0x7fc5c40fcbd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.247+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/3213290129 >> 172.21.15.49:0/3213290129 conn(0x7fc5c4070590 msgr2=0x7fc5c40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.247+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/3213290129 shutdown_connections 2024-02-22T00:46:08.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.247+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/3213290129 wait complete. 2024-02-22T00:46:08.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5cb7a6700 1 Processor -- start 2024-02-22T00:46:08.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5cb7a6700 1 -- start start 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5cb7a6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5c40fc7f0 0x7fc5c4109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5cb7a6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fd150 0x7fc5c4109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5cb7a6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4109bc0 con 0x7fc5c40fd150 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5cb7a6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4109d00 con 0x7fc5c40fc7f0 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5c8d41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fd150 0x7fc5c4109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5c8d41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fd150 0x7fc5c4109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43504/0 (socket says 172.21.15.49:43504) 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.248+0000 7fc5c8d41700 1 -- 172.21.15.49:0/1922180507 learned_addr learned my addr 172.21.15.49:0/1922180507 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5c9542700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5c40fc7f0 0x7fc5c4109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5c8d41700 1 -- 172.21.15.49:0/1922180507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5c40fc7f0 msgr2=0x7fc5c4109190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5c8d41700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5c40fc7f0 0x7fc5c4109190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5c8d41700 1 -- 172.21.15.49:0/1922180507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c0005040 con 0x7fc5c40fd150 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5c8d41700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fd150 0x7fc5c4109680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fc5b400e8c0 tx=0x7fc5b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:08.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5ba7fc700 1 -- 172.21.15.49:0/1922180507 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b400ee60 con 0x7fc5c40fd150 2024-02-22T00:46:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c4109f50 con 0x7fc5c40fd150 2024-02-22T00:46:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5ba7fc700 1 -- 172.21.15.49:0/1922180507 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5b400f040 con 0x7fc5c40fd150 2024-02-22T00:46:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5ba7fc700 1 -- 172.21.15.49:0/1922180507 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5b400c810 con 0x7fc5c40fd150 2024-02-22T00:46:08.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.249+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c4112550 con 0x7fc5c40fd150 2024-02-22T00:46:08.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.250+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c405f590 con 0x7fc5c40fd150 2024-02-22T00:46:08.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.251+0000 7fc5ba7fc700 1 -- 172.21.15.49:0/1922180507 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc5b4007b40 con 0x7fc5c40fd150 2024-02-22T00:46:08.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.251+0000 7fc5ba7fc700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5b006cab0 0x7fc5b006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.251+0000 7fc5ba7fc700 1 -- 172.21.15.49:0/1922180507 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc5b408b950 con 0x7fc5c40fd150 2024-02-22T00:46:08.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.251+0000 7fc5c9542700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5b006cab0 0x7fc5b006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.252+0000 7fc5c9542700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5b006cab0 0x7fc5b006ef70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fc5c0004e60 tx=0x7fc5c000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:08.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.256+0000 7fc5ba7fc700 1 -- 172.21.15.49:0/1922180507 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc5b4055a20 con 0x7fc5c40fd150 2024-02-22T00:46:08.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.475+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5c4059120 con 0x7fc5b006cab0 2024-02-22T00:46:08.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.476+0000 7fc5ba7fc700 1 -- 172.21.15.49:0/1922180507 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc5c4059120 con 0x7fc5b006cab0 2024-02-22T00:46:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5b006cab0 msgr2=0x7fc5b006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5b006cab0 0x7fc5b006ef70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fc5c0004e60 tx=0x7fc5c000b040).stop 2024-02-22T00:46:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fd150 msgr2=0x7fc5c4109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fd150 0x7fc5c4109680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fc5b400e8c0 tx=0x7fc5b400b040).stop 2024-02-22T00:46:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 shutdown_connections 2024-02-22T00:46:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5b006cab0 0x7fc5b006ef70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5c40fc7f0 0x7fc5c4109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 --2- 172.21.15.49:0/1922180507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5c40fd150 0x7fc5c4109680 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 >> 172.21.15.49:0/1922180507 conn(0x7fc5c4070590 msgr2=0x7fc5c40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 shutdown_connections 2024-02-22T00:46:08.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.478+0000 7fc5cb7a6700 1 -- 172.21.15.49:0/1922180507 wait complete. 2024-02-22T00:46:08.490 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:46:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:08 smithi161 ceph-mon[113442]: pgmap v276: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:08.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 -- 172.21.15.49:0/2168285855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 msgr2=0x7f97ac0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 --2- 172.21.15.49:0/2168285855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 0x7f97ac0fdcd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f97a00047f0 tx=0x7f97a0009cb0).stop 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 -- 172.21.15.49:0/2168285855 shutdown_connections 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 --2- 172.21.15.49:0/2168285855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ac0fe250 0x7f97ac0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 --2- 172.21.15.49:0/2168285855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 0x7f97ac0fdcd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 -- 172.21.15.49:0/2168285855 >> 172.21.15.49:0/2168285855 conn(0x7f97ac0f34b0 msgr2=0x7f97ac0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 -- 172.21.15.49:0/2168285855 shutdown_connections 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 -- 172.21.15.49:0/2168285855 wait complete. 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 Processor -- start 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.581+0000 7f97b389d700 1 -- start start 2024-02-22T00:46:08.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b389d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 0x7f97ac10e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b389d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ac0fe250 0x7f97ac10e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b389d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac10ec80 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b389d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac1082a0 con 0x7f97ac0fe250 2024-02-22T00:46:08.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b1639700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 0x7f97ac10e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b1639700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 0x7f97ac10e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43522/0 (socket says 172.21.15.49:43522) 2024-02-22T00:46:08.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b1639700 1 -- 172.21.15.49:0/3268802714 learned_addr learned my addr 172.21.15.49:0/3268802714 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b0e38700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ac0fe250 0x7f97ac10e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b1639700 1 -- 172.21.15.49:0/3268802714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ac0fe250 msgr2=0x7f97ac10e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b1639700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ac0fe250 0x7f97ac10e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b1639700 1 -- 172.21.15.49:0/3268802714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0005040 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b1639700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 0x7f97ac10e100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f97a000b120 tx=0x7f97a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f979e7fc700 1 -- 172.21.15.49:0/3268802714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a000e030 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac1084f0 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f979e7fc700 1 -- 172.21.15.49:0/3268802714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97a0007e90 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f979e7fc700 1 -- 172.21.15.49:0/3268802714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97a0018070 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.582+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac1089d0 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.584+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac05f590 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.584+0000 7f979e7fc700 1 -- 172.21.15.49:0/3268802714 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f97a001d420 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.584+0000 7f979e7fc700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f979806caa0 0x7f979806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.584+0000 7f97b0e38700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f979806caa0 0x7f979806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.584+0000 7f979e7fc700 1 -- 172.21.15.49:0/3268802714 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f97a008d1b0 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.585+0000 7f97b0e38700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f979806caa0 0x7f979806ef60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f97ac109a40 tx=0x7f97a8008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:08.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.589+0000 7f979e7fc700 1 -- 172.21.15.49:0/3268802714 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f97a005ad10 con 0x7f97ac0fd8f0 2024-02-22T00:46:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:08 smithi049 ceph-mon[132694]: pgmap v276: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:08.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.806+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97ac1097f0 con 0x7f979806caa0 2024-02-22T00:46:08.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.807+0000 7f979e7fc700 1 -- 172.21.15.49:0/3268802714 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f97ac1097f0 con 0x7f979806caa0 2024-02-22T00:46:08.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f979806caa0 msgr2=0x7f979806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f979806caa0 0x7f979806ef60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f97ac109a40 tx=0x7f97a8008040).stop 2024-02-22T00:46:08.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 msgr2=0x7f97ac10e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 0x7f97ac10e100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f97a000b120 tx=0x7f97a0009cb0).stop 2024-02-22T00:46:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 shutdown_connections 2024-02-22T00:46:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f979806caa0 0x7f979806ef60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97ac0fd8f0 0x7f97ac10e100 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 --2- 172.21.15.49:0/3268802714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97ac0fe250 0x7f97ac10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 >> 172.21.15.49:0/3268802714 conn(0x7f97ac0f34b0 msgr2=0x7f97ac0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 shutdown_connections 2024-02-22T00:46:08.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.809+0000 7f97b389d700 1 -- 172.21.15.49:0/3268802714 wait complete. 2024-02-22T00:46:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 -- 172.21.15.49:0/3466608530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fd150 msgr2=0x7f1a480f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 --2- 172.21.15.49:0/3466608530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fd150 0x7f1a480f6930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f1a380047f0 tx=0x7f1a38009cb0).stop 2024-02-22T00:46:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 -- 172.21.15.49:0/3466608530 shutdown_connections 2024-02-22T00:46:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 --2- 172.21.15.49:0/3466608530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fd150 0x7f1a480f6930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 --2- 172.21.15.49:0/3466608530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480fc7f0 0x7f1a480fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 -- 172.21.15.49:0/3466608530 >> 172.21.15.49:0/3466608530 conn(0x7f1a48070590 msgr2=0x7f1a480f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 -- 172.21.15.49:0/3466608530 shutdown_connections 2024-02-22T00:46:08.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 -- 172.21.15.49:0/3466608530 wait complete. 2024-02-22T00:46:08.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 Processor -- start 2024-02-22T00:46:08.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.911+0000 7f1a4fafc700 1 -- start start 2024-02-22T00:46:08.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4fafc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fc7f0 0x7f1a481101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4fafc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480fd150 0x7f1a481106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4fafc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a48110cc0 con 0x7f1a480fc7f0 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4fafc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a48110e00 con 0x7f1a480fd150 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d898700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fc7f0 0x7f1a481101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d898700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fc7f0 0x7f1a481101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43540/0 (socket says 172.21.15.49:43540) 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d898700 1 -- 172.21.15.49:0/2555200460 learned_addr learned my addr 172.21.15.49:0/2555200460 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d097700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480fd150 0x7f1a481106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d898700 1 -- 172.21.15.49:0/2555200460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480fd150 msgr2=0x7f1a481106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d898700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480fd150 0x7f1a481106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d898700 1 -- 172.21.15.49:0/2555200460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a38005040 con 0x7f1a480fc7f0 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d097700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480fd150 0x7f1a481106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4d898700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fc7f0 0x7f1a481101d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f1a4400c790 tx=0x7f1a44004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:08.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a3effd700 1 -- 172.21.15.49:0/2555200460 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a440106f0 con 0x7f1a480fc7f0 2024-02-22T00:46:08.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a3effd700 1 -- 172.21.15.49:0/2555200460 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a44010d00 con 0x7f1a480fc7f0 2024-02-22T00:46:08.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4810a490 con 0x7f1a480fc7f0 2024-02-22T00:46:08.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a3effd700 1 -- 172.21.15.49:0/2555200460 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a44012da0 con 0x7f1a480fc7f0 2024-02-22T00:46:08.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.912+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4810aa50 con 0x7f1a480fc7f0 2024-02-22T00:46:08.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.913+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4805f590 con 0x7f1a480fc7f0 2024-02-22T00:46:08.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.914+0000 7f1a3effd700 1 -- 172.21.15.49:0/2555200460 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1a44012400 con 0x7f1a480fc7f0 2024-02-22T00:46:08.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.914+0000 7f1a3effd700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3406caa0 0x7f1a3406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:08.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.914+0000 7f1a3effd700 1 -- 172.21.15.49:0/2555200460 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1a4408b640 con 0x7f1a480fc7f0 2024-02-22T00:46:08.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.914+0000 7f1a4d097700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3406caa0 0x7f1a3406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:08.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.915+0000 7f1a4d097700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3406caa0 0x7f1a3406ef60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1a380043d0 tx=0x7f1a3800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:08.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:08.919+0000 7f1a3effd700 1 -- 172.21.15.49:0/2555200460 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1a440591a0 con 0x7f1a480fc7f0 2024-02-22T00:46:09.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.127+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a4810b850 con 0x7f1a3406caa0 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.137+0000 7f1a3effd700 1 -- 172.21.15.49:0/2555200460 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f1a4810b850 con 0x7f1a3406caa0 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (9m) 3m ago 20m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 3m ago 20m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (6m) 2m ago 19m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (9m) 3m ago 20m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (3m) 3m ago 15m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (3m) 3m ago 15m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (2m) 2m ago 15m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:46:09.139 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (3m) 2m ago 15m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (10m) 3m ago 21m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (10m) 2m ago 19m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (8m) 3m ago 22m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (7m) 2m ago 19m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (10m) 3m ago 20m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (9m) 2m ago 19m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 3m ago 19m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6m) 3m ago 18m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (5m) 3m ago 18m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (5m) 2m ago 17m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (4m) 2m ago 17m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (3m) 2m ago 16m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:46:09.140 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (9m) 2m ago 19m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:46:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3406caa0 msgr2=0x7f1a3406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3406caa0 0x7f1a3406ef60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1a380043d0 tx=0x7f1a3800b040).stop 2024-02-22T00:46:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fc7f0 msgr2=0x7f1a481101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fc7f0 0x7f1a481101d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f1a4400c790 tx=0x7f1a44004330).stop 2024-02-22T00:46:09.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 shutdown_connections 2024-02-22T00:46:09.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3406caa0 0x7f1a3406ef60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a480fc7f0 0x7f1a481101d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 --2- 172.21.15.49:0/2555200460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a480fd150 0x7f1a481106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 >> 172.21.15.49:0/2555200460 conn(0x7f1a48070590 msgr2=0x7f1a48060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:09.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 shutdown_connections 2024-02-22T00:46:09.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.139+0000 7f1a4fafc700 1 -- 172.21.15.49:0/2555200460 wait complete. 2024-02-22T00:46:09.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.239+0000 7f6eb4241700 1 -- 172.21.15.49:0/3449240563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fd8f0 msgr2=0x7f6eac0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.239+0000 7f6eb4241700 1 --2- 172.21.15.49:0/3449240563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fd8f0 0x7f6eac0fdcd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f6ea80047f0 tx=0x7f6ea8009cb0).stop 2024-02-22T00:46:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.239+0000 7f6eb4241700 1 -- 172.21.15.49:0/3449240563 shutdown_connections 2024-02-22T00:46:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.239+0000 7f6eb4241700 1 --2- 172.21.15.49:0/3449240563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eac0fe250 0x7f6eac0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.239+0000 7f6eb4241700 1 --2- 172.21.15.49:0/3449240563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fd8f0 0x7f6eac0fdcd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.239+0000 7f6eb4241700 1 -- 172.21.15.49:0/3449240563 >> 172.21.15.49:0/3449240563 conn(0x7f6eac0f34b0 msgr2=0x7f6eac0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.239+0000 7f6eb4241700 1 -- 172.21.15.49:0/3449240563 shutdown_connections 2024-02-22T00:46:09.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.239+0000 7f6eb4241700 1 -- 172.21.15.49:0/3449240563 wait complete. 2024-02-22T00:46:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.240+0000 7f6eb4241700 1 Processor -- start 2024-02-22T00:46:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.240+0000 7f6eb4241700 1 -- start start 2024-02-22T00:46:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.240+0000 7f6eb4241700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eac0fd8f0 0x7f6eac10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.240+0000 7f6eb4241700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fe250 0x7f6eac10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.240+0000 7f6eb4241700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac10ead0 con 0x7f6eac0fe250 2024-02-22T00:46:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.240+0000 7f6eb4241700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac10ec10 con 0x7f6eac0fd8f0 2024-02-22T00:46:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.240+0000 7f6eb17dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fe250 0x7f6eac10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb17dc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fe250 0x7f6eac10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43550/0 (socket says 172.21.15.49:43550) 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb17dc700 1 -- 172.21.15.49:0/689779295 learned_addr learned my addr 172.21.15.49:0/689779295 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb1fdd700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eac0fd8f0 0x7f6eac10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb17dc700 1 -- 172.21.15.49:0/689779295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eac0fd8f0 msgr2=0x7f6eac10dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb17dc700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eac0fd8f0 0x7f6eac10dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb17dc700 1 -- 172.21.15.49:0/689779295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8005040 con 0x7f6eac0fe250 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb17dc700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fe250 0x7f6eac10e4d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f6e9c002780 tx=0x7f6e9c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6ea2ffd700 1 -- 172.21.15.49:0/689779295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e9c007b40 con 0x7f6eac0fe250 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6ea2ffd700 1 -- 172.21.15.49:0/689779295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6e9c00f040 con 0x7f6eac0fe250 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac1082a0 con 0x7f6eac0fe250 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6ea2ffd700 1 -- 172.21.15.49:0/689779295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e9c014780 con 0x7f6eac0fe250 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.241+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac108860 con 0x7f6eac0fe250 2024-02-22T00:46:09.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.242+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac05f590 con 0x7f6eac0fe250 2024-02-22T00:46:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.243+0000 7f6ea2ffd700 1 -- 172.21.15.49:0/689779295 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6e9c007ca0 con 0x7f6eac0fe250 2024-02-22T00:46:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.243+0000 7f6ea2ffd700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e9806caa0 0x7f6e9806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.243+0000 7f6ea2ffd700 1 -- 172.21.15.49:0/689779295 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6e9c08bd30 con 0x7f6eac0fe250 2024-02-22T00:46:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.243+0000 7f6eb1fdd700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e9806caa0 0x7f6e9806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.244+0000 7f6eb1fdd700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e9806caa0 0x7f6e9806ef60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f6ea8004f10 tx=0x7f6ea800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:09.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.247+0000 7f6ea2ffd700 1 -- 172.21.15.49:0/689779295 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6e9c059890 con 0x7f6eac0fe250 2024-02-22T00:46:09.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.529+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6eac047540 con 0x7f6eac0fe250 2024-02-22T00:46:09.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.529+0000 7f6ea2ffd700 1 -- 172.21.15.49:0/689779295 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f6e9c059420 con 0x7f6eac0fe250 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:46:09.532 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:46:09.533 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:46:09.533 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:46:09.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:46:09.533 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:46:09.533 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:46:09.533 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:46:09.533 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.531+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e9806caa0 msgr2=0x7f6e9806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.531+0000 7f6eb4241700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e9806caa0 0x7f6e9806ef60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f6ea8004f10 tx=0x7f6ea800b040).stop 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.531+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fe250 msgr2=0x7f6eac10e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.531+0000 7f6eb4241700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fe250 0x7f6eac10e4d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f6e9c002780 tx=0x7f6e9c009ee0).stop 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.532+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 shutdown_connections 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.532+0000 7f6eb4241700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6e9806caa0 0x7f6e9806ef60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.532+0000 7f6eb4241700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eac0fd8f0 0x7f6eac10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.532+0000 7f6eb4241700 1 --2- 172.21.15.49:0/689779295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6eac0fe250 0x7f6eac10e4d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.532+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 >> 172.21.15.49:0/689779295 conn(0x7f6eac0f34b0 msgr2=0x7f6eac0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.532+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 shutdown_connections 2024-02-22T00:46:09.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.532+0000 7f6eb4241700 1 -- 172.21.15.49:0/689779295 wait complete. 2024-02-22T00:46:09.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.633+0000 7f2620ab8700 1 -- 172.21.15.49:0/2400973116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fe270 msgr2=0x7f261c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.633+0000 7f2620ab8700 1 --2- 172.21.15.49:0/2400973116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fe270 0x7f261c0f7a50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f26100047f0 tx=0x7f2610009cb0).stop 2024-02-22T00:46:09.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.634+0000 7f2620ab8700 1 -- 172.21.15.49:0/2400973116 shutdown_connections 2024-02-22T00:46:09.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.634+0000 7f2620ab8700 1 --2- 172.21.15.49:0/2400973116 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fe270 0x7f261c0f7a50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.634+0000 7f2620ab8700 1 --2- 172.21.15.49:0/2400973116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f261c0fd910 0x7f261c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:46:09.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.634+0000 7f2620ab8700 1 -- 172.21.15.49:0/2400973116 >> 172.21.15.49:0/2400973116 conn(0x7f261c0f3530 msgr2=0x7f261c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:09.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.634+0000 7f2620ab8700 1 -- 172.21.15.49:0/2400973116 shutdown_connections 2024-02-22T00:46:09.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.634+0000 7f2620ab8700 1 -- 172.21.15.49:0/2400973116 wait complete. 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.634+0000 7f2620ab8700 1 Processor -- start 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.634+0000 7f2620ab8700 1 -- start start 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f2620ab8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fd910 0x7f261c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f2620ab8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f261c0fe270 0x7f261c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f2620ab8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c10ebe0 con 0x7f261c0fd910 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f2620ab8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c108200 con 0x7f261c0fe270 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f261a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fd910 0x7f261c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f261a59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fd910 0x7f261c10e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43568/0 (socket says 172.21.15.49:43568) 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f261a59c700 1 -- 172.21.15.49:0/1208417088 learned_addr learned my addr 172.21.15.49:0/1208417088 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f2619d9b700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f261c0fe270 0x7f261c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f261a59c700 1 -- 172.21.15.49:0/1208417088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f261c0fe270 msgr2=0x7f261c10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f261a59c700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f261c0fe270 0x7f261c10e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f261a59c700 1 -- 172.21.15.49:0/1208417088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2610005040 con 0x7f261c0fd910 2024-02-22T00:46:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f261a59c700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fd910 0x7f261c10e060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f260c00b4b0 tx=0x7f260c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f260b7fe700 1 -- 172.21.15.49:0/1208417088 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f260c002500 con 0x7f261c0fd910 2024-02-22T00:46:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f260b7fe700 1 -- 172.21.15.49:0/1208417088 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f260c002b10 con 0x7f261c0fd910 2024-02-22T00:46:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c1084b0 con 0x7f261c0fd910 2024-02-22T00:46:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f260b7fe700 1 -- 172.21.15.49:0/1208417088 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f260c012cf0 con 0x7f261c0fd910 2024-02-22T00:46:09.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.635+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c1089f0 con 0x7f261c0fd910 2024-02-22T00:46:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.636+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c05f570 con 0x7f261c0fd910 2024-02-22T00:46:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.637+0000 7f260b7fe700 1 -- 172.21.15.49:0/1208417088 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f260c002660 con 0x7f261c0fd910 2024-02-22T00:46:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.638+0000 7f260b7fe700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f260406caa0 0x7f260406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.638+0000 7f260b7fe700 1 -- 172.21.15.49:0/1208417088 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f260c08c290 con 0x7f261c0fd910 2024-02-22T00:46:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.638+0000 7f2619d9b700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f260406caa0 0x7f260406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.638+0000 7f2619d9b700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f260406caa0 0x7f260406ef60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2610000c00 tx=0x7f261000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:09.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.641+0000 7f260b7fe700 1 -- 172.21.15.49:0/1208417088 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f260c059d30 con 0x7f261c0fd910 2024-02-22T00:46:09.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.883+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f261c047540 con 0x7f261c0fd910 2024-02-22T00:46:09.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.884+0000 7f260b7fe700 1 -- 172.21.15.49:0/1208417088 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f260c0598c0 con 0x7f261c0fd910 2024-02-22T00:46:09.886 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:46:09.886 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:46:09.886 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:46:09.886 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:46:09.886 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:46:09.886 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:46:09.887 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:46:09.888 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:46:09.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:46:09.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:46:09.889 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:46:09.889 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:46:09.889 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:46:09.889 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:46:09.889 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:46:09.889 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:46:09.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f260406caa0 msgr2=0x7f260406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f260406caa0 0x7f260406ef60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2610000c00 tx=0x7f261000b040).stop 2024-02-22T00:46:09.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fd910 msgr2=0x7f261c10e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fd910 0x7f261c10e060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f260c00b4b0 tx=0x7f260c0090f0).stop 2024-02-22T00:46:09.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 shutdown_connections 2024-02-22T00:46:09.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f260406caa0 0x7f260406ef60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f261c0fd910 0x7f261c10e060 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 --2- 172.21.15.49:0/1208417088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f261c0fe270 0x7f261c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 >> 172.21.15.49:0/1208417088 conn(0x7f261c0f3530 msgr2=0x7f261c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:09.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 shutdown_connections 2024-02-22T00:46:09.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.886+0000 7f2620ab8700 1 -- 172.21.15.49:0/1208417088 wait complete. 2024-02-22T00:46:09.891 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:46:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.988+0000 7f4f84dd2700 1 -- 172.21.15.49:0/4283423629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fc7f0 msgr2=0x7f4f800fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.988+0000 7f4f84dd2700 1 --2- 172.21.15.49:0/4283423629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fc7f0 0x7f4f800fcbd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f4f740047f0 tx=0x7f4f74009cb0).stop 2024-02-22T00:46:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.989+0000 7f4f84dd2700 1 -- 172.21.15.49:0/4283423629 shutdown_connections 2024-02-22T00:46:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.989+0000 7f4f84dd2700 1 --2- 172.21.15.49:0/4283423629 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f800fd150 0x7f4f800f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.989+0000 7f4f84dd2700 1 --2- 172.21.15.49:0/4283423629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fc7f0 0x7f4f800fcbd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.989+0000 7f4f84dd2700 1 -- 172.21.15.49:0/4283423629 >> 172.21.15.49:0/4283423629 conn(0x7f4f80070590 msgr2=0x7f4f800f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.989+0000 7f4f84dd2700 1 -- 172.21.15.49:0/4283423629 shutdown_connections 2024-02-22T00:46:09.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.989+0000 7f4f84dd2700 1 -- 172.21.15.49:0/4283423629 wait complete. 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.989+0000 7f4f84dd2700 1 Processor -- start 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.989+0000 7f4f84dd2700 1 -- start start 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f84dd2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f800fc7f0 0x7f4f801101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f84dd2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fd150 0x7f4f801106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f84dd2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80110cc0 con 0x7f4f800fd150 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f84dd2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f80110e00 con 0x7f4f800fc7f0 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f7dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fd150 0x7f4f801106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f7dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fd150 0x7f4f801106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43588/0 (socket says 172.21.15.49:43588) 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f7dd9b700 1 -- 172.21.15.49:0/2097457862 learned_addr learned my addr 172.21.15.49:0/2097457862 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f7e59c700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f800fc7f0 0x7f4f801101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f7dd9b700 1 -- 172.21.15.49:0/2097457862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f800fc7f0 msgr2=0x7f4f801101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f7dd9b700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f800fc7f0 0x7f4f801101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f7dd9b700 1 -- 172.21.15.49:0/2097457862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74005040 con 0x7f4f800fd150 2024-02-22T00:46:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f7dd9b700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fd150 0x7f4f801106c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f4f70002780 tx=0x7f4f70009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f6f7fe700 1 -- 172.21.15.49:0/2097457862 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f70007b40 con 0x7f4f800fd150 2024-02-22T00:46:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f6f7fe700 1 -- 172.21.15.49:0/2097457862 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4f7000f040 con 0x7f4f800fd150 2024-02-22T00:46:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8010a490 con 0x7f4f800fd150 2024-02-22T00:46:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f6f7fe700 1 -- 172.21.15.49:0/2097457862 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f70014780 con 0x7f4f800fd150 2024-02-22T00:46:09.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.990+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8010aa50 con 0x7f4f800fd150 2024-02-22T00:46:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.991+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8005f590 con 0x7f4f800fd150 2024-02-22T00:46:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.992+0000 7f4f6f7fe700 1 -- 172.21.15.49:0/2097457862 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4f70007ca0 con 0x7f4f800fd150 2024-02-22T00:46:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.992+0000 7f4f6f7fe700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4f6806cab0 0x7f4f6806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.992+0000 7f4f6f7fe700 1 -- 172.21.15.49:0/2097457862 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4f7008bca0 con 0x7f4f800fd150 2024-02-22T00:46:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.992+0000 7f4f7e59c700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4f6806cab0 0x7f4f6806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:09.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.993+0000 7f4f7e59c700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4f6806cab0 0x7f4f6806ef70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4f74004f10 tx=0x7f4f74009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:09.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:09.997+0000 7f4f6f7fe700 1 -- 172.21.15.49:0/2097457862 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4f70090070 con 0x7f4f800fd150 2024-02-22T00:46:10.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.214+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f8010b0f0 con 0x7f4f6806cab0 2024-02-22T00:46:10.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.215+0000 7f4f6f7fe700 1 -- 172.21.15.49:0/2097457862 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4f8010b0f0 con 0x7f4f6806cab0 2024-02-22T00:46:10.217 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:46:10.217 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:46:10.218 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.217+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4f6806cab0 msgr2=0x7f4f6806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.217+0000 7f4f84dd2700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4f6806cab0 0x7f4f6806ef70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4f74004f10 tx=0x7f4f74009cb0).stop 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.217+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fd150 msgr2=0x7f4f801106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.217+0000 7f4f84dd2700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fd150 0x7f4f801106c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f4f70002780 tx=0x7f4f70009ee0).stop 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.218+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 shutdown_connections 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.218+0000 7f4f84dd2700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4f6806cab0 0x7f4f6806ef70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.218+0000 7f4f84dd2700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f800fc7f0 0x7f4f801101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.218+0000 7f4f84dd2700 1 --2- 172.21.15.49:0/2097457862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f800fd150 0x7f4f801106c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.218+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 >> 172.21.15.49:0/2097457862 conn(0x7f4f80070590 msgr2=0x7f4f80060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.218+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 shutdown_connections 2024-02-22T00:46:10.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.218+0000 7f4f84dd2700 1 -- 172.21.15.49:0/2097457862 wait complete. 2024-02-22T00:46:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 -- 172.21.15.49:0/961270468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f8890 msgr2=0x7fb8700f8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 --2- 172.21.15.49:0/961270468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f8890 0x7fb8700f8c70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fb8600047f0 tx=0x7fb860009cb0).stop 2024-02-22T00:46:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 -- 172.21.15.49:0/961270468 shutdown_connections 2024-02-22T00:46:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 --2- 172.21.15.49:0/961270468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8700f91f0 0x7fb870101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 --2- 172.21.15.49:0/961270468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f8890 0x7fb8700f8c70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 -- 172.21.15.49:0/961270468 >> 172.21.15.49:0/961270468 conn(0x7fb8700f23c0 msgr2=0x7fb8700f47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 -- 172.21.15.49:0/961270468 shutdown_connections 2024-02-22T00:46:10.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 -- 172.21.15.49:0/961270468 wait complete. 2024-02-22T00:46:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 Processor -- start 2024-02-22T00:46:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.320+0000 7fb875b51700 1 -- start start 2024-02-22T00:46:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb875b51700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8700f8890 0x7fb87010e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb875b51700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f91f0 0x7fb87010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb875b51700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87010eb50 con 0x7fb8700f91f0 2024-02-22T00:46:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb875b51700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87010ec90 con 0x7fb8700f8890 2024-02-22T00:46:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f91f0 0x7fb87010e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:10.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f91f0 0x7fb87010e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43602/0 (socket says 172.21.15.49:43602) 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86effd700 1 -- 172.21.15.49:0/4153458989 learned_addr learned my addr 172.21.15.49:0/4153458989 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86f7fe700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8700f8890 0x7fb87010e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86effd700 1 -- 172.21.15.49:0/4153458989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8700f8890 msgr2=0x7fb87010e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86effd700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8700f8890 0x7fb87010e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86effd700 1 -- 172.21.15.49:0/4153458989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860005040 con 0x7fb8700f91f0 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86f7fe700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8700f8890 0x7fb87010e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86effd700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f91f0 0x7fb87010e550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb858002770 tx=0x7fb858002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86cff9700 1 -- 172.21.15.49:0/4153458989 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb858002d80 con 0x7fb8700f91f0 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86cff9700 1 -- 172.21.15.49:0/4153458989 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb85800f040 con 0x7fb8700f91f0 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb870108320 con 0x7fb8700f91f0 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.321+0000 7fb86cff9700 1 -- 172.21.15.49:0/4153458989 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb85800d800 con 0x7fb8700f91f0 2024-02-22T00:46:10.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.322+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb870108860 con 0x7fb8700f91f0 2024-02-22T00:46:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.322+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb870060370 con 0x7fb8700f91f0 2024-02-22T00:46:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.323+0000 7fb86cff9700 1 -- 172.21.15.49:0/4153458989 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb858009110 con 0x7fb8700f91f0 2024-02-22T00:46:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.324+0000 7fb86cff9700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb85c06caa0 0x7fb85c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.324+0000 7fb86f7fe700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb85c06caa0 0x7fb85c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.324+0000 7fb86cff9700 1 -- 172.21.15.49:0/4153458989 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb85808b900 con 0x7fb8700f91f0 2024-02-22T00:46:10.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.324+0000 7fb86f7fe700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb85c06caa0 0x7fb85c06ef60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fb8600047c0 tx=0x7fb86000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:10.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.328+0000 7fb86cff9700 1 -- 172.21.15.49:0/4153458989 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb858059460 con 0x7fb8700f91f0 2024-02-22T00:46:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:10 smithi161 ceph-mon[113442]: pgmap v277: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:10 smithi161 ceph-mon[113442]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:10 smithi161 ceph-mon[113442]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:10 smithi161 ceph-mon[113442]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:10 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/689779295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:46:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:10 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1208417088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:46:10.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.605+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb8700fee60 con 0x7fb8700f91f0 2024-02-22T00:46:10.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.606+0000 7fb86cff9700 1 -- 172.21.15.49:0/4153458989 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fb858058ff0 con 0x7fb8700f91f0 2024-02-22T00:46:10.608 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:46:10.608 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:46:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:46:10.608 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:46:10.608 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.607+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb85c06caa0 msgr2=0x7fb85c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb85c06caa0 0x7fb85c06ef60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fb8600047c0 tx=0x7fb86000b040).stop 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f91f0 msgr2=0x7fb87010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f91f0 0x7fb87010e550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb858002770 tx=0x7fb858002b30).stop 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 shutdown_connections 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb85c06caa0 0x7fb85c06ef60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8700f8890 0x7fb87010e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 --2- 172.21.15.49:0/4153458989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb8700f91f0 0x7fb87010e550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 >> 172.21.15.49:0/4153458989 conn(0x7fb8700f23c0 msgr2=0x7fb8700fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 shutdown_connections 2024-02-22T00:46:10.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:10.608+0000 7fb875b51700 1 -- 172.21.15.49:0/4153458989 wait complete. 2024-02-22T00:46:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:10 smithi049 ceph-mon[132694]: pgmap v277: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:10 smithi049 ceph-mon[132694]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:10 smithi049 ceph-mon[132694]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:10 smithi049 ceph-mon[132694]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:10 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/689779295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:46:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:10 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1208417088' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:46:11.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:11 smithi161 ceph-mon[113442]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:11.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:11 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4153458989' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:46:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:11 smithi049 ceph-mon[132694]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:11.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:11 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4153458989' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:46:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:12 smithi161 ceph-mon[113442]: pgmap v278: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:12 smithi049 ceph-mon[132694]: pgmap v278: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:46:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:46:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:14 smithi161 ceph-mon[113442]: pgmap v279: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:14 smithi049 ceph-mon[132694]: pgmap v279: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:16 smithi161 ceph-mon[113442]: pgmap v280: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:16.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:16 smithi049 ceph-mon[132694]: pgmap v280: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:17.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:17 smithi049 ceph-mon[132694]: pgmap v281: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:17 smithi161 ceph-mon[113442]: pgmap v281: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:19.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:19 smithi161 ceph-mon[113442]: pgmap v282: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:19.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:19 smithi049 ceph-mon[132694]: pgmap v282: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:22.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:22 smithi161 ceph-mon[113442]: pgmap v283: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:22 smithi049 ceph-mon[132694]: pgmap v283: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:24.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:24 smithi161 ceph-mon[113442]: pgmap v284: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:24.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:24 smithi049 ceph-mon[132694]: pgmap v284: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:26.296 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:26 smithi161 ceph-mon[113442]: pgmap v285: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:26 smithi049 ceph-mon[132694]: pgmap v285: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:28 smithi161 ceph-mon[113442]: pgmap v286: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:28.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:46:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:28 smithi049 ceph-mon[132694]: pgmap v286: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:46:30.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:30 smithi161 ceph-mon[113442]: pgmap v287: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:30 smithi049 ceph-mon[132694]: pgmap v287: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:32.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:32 smithi161 ceph-mon[113442]: pgmap v288: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:32 smithi049 ceph-mon[132694]: pgmap v288: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:34.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:34 smithi161 ceph-mon[113442]: pgmap v289: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:34 smithi049 ceph-mon[132694]: pgmap v289: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:36.293 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:36 smithi161 ceph-mon[113442]: pgmap v290: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:36.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:36 smithi049 ceph-mon[132694]: pgmap v290: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:38 smithi049 ceph-mon[132694]: pgmap v291: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:38 smithi161 ceph-mon[113442]: pgmap v291: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:40 smithi049 ceph-mon[132694]: pgmap v292: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:40 smithi161 ceph-mon[113442]: pgmap v292: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.725+0000 7fa384264700 1 -- 172.21.15.49:0/1700201135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fd150 msgr2=0x7fa37c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.725+0000 7fa384264700 1 --2- 172.21.15.49:0/1700201135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fd150 0x7fa37c0f6930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa36c0047f0 tx=0x7fa36c009cb0).stop 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.725+0000 7fa384264700 1 -- 172.21.15.49:0/1700201135 shutdown_connections 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.725+0000 7fa384264700 1 --2- 172.21.15.49:0/1700201135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fd150 0x7fa37c0f6930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.725+0000 7fa384264700 1 --2- 172.21.15.49:0/1700201135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa37c0fc7f0 0x7fa37c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.725+0000 7fa384264700 1 -- 172.21.15.49:0/1700201135 >> 172.21.15.49:0/1700201135 conn(0x7fa37c070590 msgr2=0x7fa37c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.725+0000 7fa384264700 1 -- 172.21.15.49:0/1700201135 shutdown_connections 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.725+0000 7fa384264700 1 -- 172.21.15.49:0/1700201135 wait complete. 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa384264700 1 Processor -- start 2024-02-22T00:46:40.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa384264700 1 -- start start 2024-02-22T00:46:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa384264700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fc7f0 0x7fa37c10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa384264700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa37c0fd150 0x7fa37c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa384264700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c10ec00 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa384264700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c108220 con 0x7fa37c0fd150 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa382000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fc7f0 0x7fa37c10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa382000700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fc7f0 0x7fa37c10e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42672/0 (socket says 172.21.15.49:42672) 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa382000700 1 -- 172.21.15.49:0/1925918187 learned_addr learned my addr 172.21.15.49:0/1925918187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa3817ff700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa37c0fd150 0x7fa37c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa382000700 1 -- 172.21.15.49:0/1925918187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa37c0fd150 msgr2=0x7fa37c10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa382000700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa37c0fd150 0x7fa37c10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.726+0000 7fa382000700 1 -- 172.21.15.49:0/1925918187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c005040 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.727+0000 7fa382000700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fc7f0 0x7fa37c10e080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fa37800b410 tx=0x7fa378009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.727+0000 7fa372ffd700 1 -- 172.21.15.49:0/1925918187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3780125f0 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.727+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c1084d0 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.727+0000 7fa372ffd700 1 -- 172.21.15.49:0/1925918187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa378012c00 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.727+0000 7fa372ffd700 1 -- 172.21.15.49:0/1925918187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa37800dbd0 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.727+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c108a90 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.728+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c05f590 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.728+0000 7fa372ffd700 1 -- 172.21.15.49:0/1925918187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa378012750 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.729+0000 7fa372ffd700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa36806cab0 0x7fa36806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.729+0000 7fa372ffd700 1 -- 172.21.15.49:0/1925918187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa37808bd00 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.729+0000 7fa3817ff700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa36806cab0 0x7fa36806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:40.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.729+0000 7fa3817ff700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa36806cab0 0x7fa36806ef70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa36c004f10 tx=0x7fa36c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:40.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.734+0000 7fa372ffd700 1 -- 172.21.15.49:0/1925918187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa37808f030 con 0x7fa37c0fc7f0 2024-02-22T00:46:40.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.954+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa37c109700 con 0x7fa36806cab0 2024-02-22T00:46:40.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.955+0000 7fa372ffd700 1 -- 172.21.15.49:0/1925918187 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa37c109700 con 0x7fa36806cab0 2024-02-22T00:46:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa36806cab0 msgr2=0x7fa36806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa36806cab0 0x7fa36806ef70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa36c004f10 tx=0x7fa36c009cb0).stop 2024-02-22T00:46:40.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fc7f0 msgr2=0x7fa37c10e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fc7f0 0x7fa37c10e080 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fa37800b410 tx=0x7fa378009060).stop 2024-02-22T00:46:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 shutdown_connections 2024-02-22T00:46:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa36806cab0 0x7fa36806ef70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa37c0fc7f0 0x7fa37c10e080 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 --2- 172.21.15.49:0/1925918187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa37c0fd150 0x7fa37c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 >> 172.21.15.49:0/1925918187 conn(0x7fa37c070590 msgr2=0x7fa37c060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 shutdown_connections 2024-02-22T00:46:40.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:40.957+0000 7fa384264700 1 -- 172.21.15.49:0/1925918187 wait complete. 2024-02-22T00:46:40.970 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:46:41.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.061+0000 7f868586d700 1 -- 172.21.15.49:0/4098634030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f91d0 msgr2=0x7f8680101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.061+0000 7f868586d700 1 --2- 172.21.15.49:0/4098634030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f91d0 0x7f8680101970 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f86740047f0 tx=0x7f8674009cb0).stop 2024-02-22T00:46:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.061+0000 7f868586d700 1 -- 172.21.15.49:0/4098634030 shutdown_connections 2024-02-22T00:46:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.061+0000 7f868586d700 1 --2- 172.21.15.49:0/4098634030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f91d0 0x7f8680101970 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.061+0000 7f868586d700 1 --2- 172.21.15.49:0/4098634030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86800f8900 0x7f86800f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:46:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.061+0000 7f868586d700 1 -- 172.21.15.49:0/4098634030 >> 172.21.15.49:0/4098634030 conn(0x7f86800f23b0 msgr2=0x7f86800f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.061+0000 7f868586d700 1 -- 172.21.15.49:0/4098634030 shutdown_connections 2024-02-22T00:46:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.061+0000 7f868586d700 1 -- 172.21.15.49:0/4098634030 wait complete. 2024-02-22T00:46:41.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f868586d700 1 Processor -- start 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f868586d700 1 -- start start 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f868586d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f8900 0x7f8680110310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f868586d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86800f91d0 0x7f8680110800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f868586d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8680110e90 con 0x7f86800f8900 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f868586d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8680110fd0 con 0x7f86800f91d0 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f867effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f8900 0x7f8680110310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f867effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f8900 0x7f8680110310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42692/0 (socket says 172.21.15.49:42692) 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.062+0000 7f867effd700 1 -- 172.21.15.49:0/3287500073 learned_addr learned my addr 172.21.15.49:0/3287500073 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f867e7fc700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86800f91d0 0x7f8680110800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f867effd700 1 -- 172.21.15.49:0/3287500073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86800f91d0 msgr2=0x7f8680110800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f867effd700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86800f91d0 0x7f8680110800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f867effd700 1 -- 172.21.15.49:0/3287500073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674005040 con 0x7f86800f8900 2024-02-22T00:46:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f867effd700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f8900 0x7f8680110310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f867000b4b0 tx=0x7f86700090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f8667fff700 1 -- 172.21.15.49:0/3287500073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8670002500 con 0x7f86800f8900 2024-02-22T00:46:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868010a6b0 con 0x7f86800f8900 2024-02-22T00:46:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f8667fff700 1 -- 172.21.15.49:0/3287500073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8670002b10 con 0x7f86800f8900 2024-02-22T00:46:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f8667fff700 1 -- 172.21.15.49:0/3287500073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8670012cb0 con 0x7f86800f8900 2024-02-22T00:46:41.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.063+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868010abf0 con 0x7f86800f8900 2024-02-22T00:46:41.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.064+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8680060370 con 0x7f86800f8900 2024-02-22T00:46:41.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.065+0000 7f8667fff700 1 -- 172.21.15.49:0/3287500073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8670002660 con 0x7f86800f8900 2024-02-22T00:46:41.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.065+0000 7f8667fff700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f866806caa0 0x7f866806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.065+0000 7f8667fff700 1 -- 172.21.15.49:0/3287500073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f867008bde0 con 0x7f86800f8900 2024-02-22T00:46:41.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.065+0000 7f867e7fc700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f866806caa0 0x7f866806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.065+0000 7f867e7fc700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f866806caa0 0x7f866806ef60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f868010bc90 tx=0x7f867400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:41.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.070+0000 7f8667fff700 1 -- 172.21.15.49:0/3287500073 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8670055eb0 con 0x7f86800f8900 2024-02-22T00:46:41.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.285+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f868010bae0 con 0x7f866806caa0 2024-02-22T00:46:41.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.287+0000 7f8667fff700 1 -- 172.21.15.49:0/3287500073 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f868010bae0 con 0x7f866806caa0 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f866806caa0 msgr2=0x7f866806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f866806caa0 0x7f866806ef60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f868010bc90 tx=0x7f867400b040).stop 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f8900 msgr2=0x7f8680110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f8900 0x7f8680110310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f867000b4b0 tx=0x7f86700090f0).stop 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 shutdown_connections 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f866806caa0 0x7f866806ef60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86800f8900 0x7f8680110310 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 --2- 172.21.15.49:0/3287500073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86800f91d0 0x7f8680110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 >> 172.21.15.49:0/3287500073 conn(0x7f86800f23b0 msgr2=0x7f86800f6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 shutdown_connections 2024-02-22T00:46:41.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.289+0000 7f868586d700 1 -- 172.21.15.49:0/3287500073 wait complete. 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.390+0000 7f0f61c86700 1 -- 172.21.15.49:0/3153845225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 msgr2=0x7f0f5c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.390+0000 7f0f61c86700 1 --2- 172.21.15.49:0/3153845225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 0x7f0f5c0fcbd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f0f500047f0 tx=0x7f0f50009cb0).stop 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.390+0000 7f0f61c86700 1 -- 172.21.15.49:0/3153845225 shutdown_connections 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.390+0000 7f0f61c86700 1 --2- 172.21.15.49:0/3153845225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f5c0fd150 0x7f0f5c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.390+0000 7f0f61c86700 1 --2- 172.21.15.49:0/3153845225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 0x7f0f5c0fcbd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.390+0000 7f0f61c86700 1 -- 172.21.15.49:0/3153845225 >> 172.21.15.49:0/3153845225 conn(0x7f0f5c070590 msgr2=0x7f0f5c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.390+0000 7f0f61c86700 1 -- 172.21.15.49:0/3153845225 shutdown_connections 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.391+0000 7f0f61c86700 1 -- 172.21.15.49:0/3153845225 wait complete. 2024-02-22T00:46:41.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.391+0000 7f0f61c86700 1 Processor -- start 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.391+0000 7f0f61c86700 1 -- start start 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f61c86700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 0x7f0f5c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f61c86700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f5c0fd150 0x7f0f5c1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f61c86700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c110cc0 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f61c86700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c110e00 con 0x7f0f5c0fd150 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f5b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 0x7f0f5c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f5b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 0x7f0f5c1101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42708/0 (socket says 172.21.15.49:42708) 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f5b7fe700 1 -- 172.21.15.49:0/2410713819 learned_addr learned my addr 172.21.15.49:0/2410713819 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f5affd700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f5c0fd150 0x7f0f5c1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f5b7fe700 1 -- 172.21.15.49:0/2410713819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f5c0fd150 msgr2=0x7f0f5c1106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f5b7fe700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f5c0fd150 0x7f0f5c1106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f5b7fe700 1 -- 172.21.15.49:0/2410713819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50005040 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f5b7fe700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 0x7f0f5c1101d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f0f50005010 tx=0x7f0f50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:41.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f58ff9700 1 -- 172.21.15.49:0/2410713819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f5000e030 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c10a430 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f58ff9700 1 -- 172.21.15.49:0/2410713819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f50007e90 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c10a990 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.392+0000 7f0f58ff9700 1 -- 172.21.15.49:0/2410713819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f50018070 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.393+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c05f590 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.394+0000 7f0f58ff9700 1 -- 172.21.15.49:0/2410713819 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0f50009590 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.394+0000 7f0f58ff9700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0f4406caa0 0x7f0f4406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.394+0000 7f0f5affd700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0f4406caa0 0x7f0f4406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.394+0000 7f0f58ff9700 1 -- 172.21.15.49:0/2410713819 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0f5008d0b0 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.395+0000 7f0f5affd700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0f4406caa0 0x7f0f4406ef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0f5c10bb10 tx=0x7f0f4c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:41.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.399+0000 7f0f58ff9700 1 -- 172.21.15.49:0/2410713819 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0f5005a980 con 0x7f0f5c0fc7f0 2024-02-22T00:46:41.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.606+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f5c10b960 con 0x7f0f4406caa0 2024-02-22T00:46:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.616+0000 7f0f58ff9700 1 -- 172.21.15.49:0/2410713819 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f0f5c10b960 con 0x7f0f4406caa0 2024-02-22T00:46:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:46:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (9m) 3m ago 21m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:46:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (7m) 3m ago 21m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:46:41.618 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (7m) 3m ago 20m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (9m) 3m ago 20m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (3m) 3m ago 15m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (4m) 3m ago 15m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (3m) 3m ago 15m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (3m) 3m ago 15m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (11m) 3m ago 22m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (10m) 3m ago 20m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (8m) 3m ago 22m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (8m) 3m ago 20m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (10m) 3m ago 20m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (10m) 3m ago 20m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 3m ago 19m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:46:41.619 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (6m) 3m ago 19m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:46:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 3m ago 18m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:46:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (5m) 3m ago 18m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:46:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (5m) 3m ago 17m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:46:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (4m) 3m ago 17m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:46:41.620 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (10m) 3m ago 20m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0f4406caa0 msgr2=0x7f0f4406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0f4406caa0 0x7f0f4406ef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0f5c10bb10 tx=0x7f0f4c00b040).stop 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 msgr2=0x7f0f5c1101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 0x7f0f5c1101d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f0f50005010 tx=0x7f0f50009cb0).stop 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 shutdown_connections 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0f4406caa0 0x7f0f4406ef60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f5c0fc7f0 0x7f0f5c1101d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 --2- 172.21.15.49:0/2410713819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f5c0fd150 0x7f0f5c1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.618+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 >> 172.21.15.49:0/2410713819 conn(0x7f0f5c070590 msgr2=0x7f0f5c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.619+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 shutdown_connections 2024-02-22T00:46:41.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.619+0000 7f0f61c86700 1 -- 172.21.15.49:0/2410713819 wait complete. 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 -- 172.21.15.49:0/4247216032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fc7f0 msgr2=0x7f8fd80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 --2- 172.21.15.49:0/4247216032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fc7f0 0x7f8fd80fcbd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f8fc80047f0 tx=0x7f8fc8009cb0).stop 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 -- 172.21.15.49:0/4247216032 shutdown_connections 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 --2- 172.21.15.49:0/4247216032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fd80fd150 0x7f8fd80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 --2- 172.21.15.49:0/4247216032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fc7f0 0x7f8fd80fcbd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 -- 172.21.15.49:0/4247216032 >> 172.21.15.49:0/4247216032 conn(0x7f8fd8070590 msgr2=0x7f8fd80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 -- 172.21.15.49:0/4247216032 shutdown_connections 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 -- 172.21.15.49:0/4247216032 wait complete. 2024-02-22T00:46:41.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.719+0000 7f8fddeff700 1 Processor -- start 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fddeff700 1 -- start start 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fddeff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fd80fc7f0 0x7f8fd80f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fddeff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fd150 0x7f8fd80f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fddeff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80f8f20 con 0x7f8fd80fd150 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fddeff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80f9060 con 0x7f8fd80fc7f0 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fd6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fd150 0x7f8fd80f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fd6ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fd150 0x7f8fd80f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35702/0 (socket says 172.21.15.49:35702) 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fd6ffd700 1 -- 172.21.15.49:0/529200061 learned_addr learned my addr 172.21.15.49:0/529200061 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fd77fe700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fd80fc7f0 0x7f8fd80f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fd6ffd700 1 -- 172.21.15.49:0/529200061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fd80fc7f0 msgr2=0x7f8fd80f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fd6ffd700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fd80fc7f0 0x7f8fd80f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:41.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fd6ffd700 1 -- 172.21.15.49:0/529200061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8005040 con 0x7f8fd80fd150 2024-02-22T00:46:41.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.720+0000 7f8fd6ffd700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fd150 0x7f8fd80f8a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f8fc000c710 tx=0x7f8fc0007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:41.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.721+0000 7f8fd4ff9700 1 -- 172.21.15.49:0/529200061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fc000e680 con 0x7f8fd80fd150 2024-02-22T00:46:41.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.721+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd80f9310 con 0x7f8fd80fd150 2024-02-22T00:46:41.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.721+0000 7f8fd4ff9700 1 -- 172.21.15.49:0/529200061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fc000ec90 con 0x7f8fd80fd150 2024-02-22T00:46:41.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.721+0000 7f8fd4ff9700 1 -- 172.21.15.49:0/529200061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fc0013d40 con 0x7f8fd80fd150 2024-02-22T00:46:41.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.721+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd81146d0 con 0x7f8fd80fd150 2024-02-22T00:46:41.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.721+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd805f590 con 0x7f8fd80fd150 2024-02-22T00:46:41.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.722+0000 7f8fd4ff9700 1 -- 172.21.15.49:0/529200061 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8fc000e7e0 con 0x7f8fd80fd150 2024-02-22T00:46:41.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.723+0000 7f8fd4ff9700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fc406caa0 0x7f8fc406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:41.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.723+0000 7f8fd4ff9700 1 -- 172.21.15.49:0/529200061 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8fc008bb70 con 0x7f8fd80fd150 2024-02-22T00:46:41.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.723+0000 7f8fd77fe700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fc406caa0 0x7f8fc406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:41.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.723+0000 7f8fd77fe700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fc406caa0 0x7f8fc406ef60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8fc8007cf0 tx=0x7f8fc800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:41.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:41.727+0000 7f8fd4ff9700 1 -- 172.21.15.49:0/529200061 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8fc0055c40 con 0x7f8fd80fd150 2024-02-22T00:46:42.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.008+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8fd8047540 con 0x7f8fd80fd150 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.009+0000 7f8fd4ff9700 1 -- 172.21.15.49:0/529200061 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f8fc0077e60 con 0x7f8fd80fd150 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:46:42.011 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:46:42.012 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fc406caa0 msgr2=0x7f8fc406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fc406caa0 0x7f8fc406ef60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8fc8007cf0 tx=0x7f8fc800b040).stop 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fd150 msgr2=0x7f8fd80f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fd150 0x7f8fd80f8a30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f8fc000c710 tx=0x7f8fc0007ec0).stop 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 shutdown_connections 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fc406caa0 0x7f8fc406ef60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8fd80fc7f0 0x7f8fd80f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 --2- 172.21.15.49:0/529200061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8fd80fd150 0x7f8fd80f8a30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 >> 172.21.15.49:0/529200061 conn(0x7f8fd8070590 msgr2=0x7f8fd8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:42.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 shutdown_connections 2024-02-22T00:46:42.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.011+0000 7f8fddeff700 1 -- 172.21.15.49:0/529200061 wait complete. 2024-02-22T00:46:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.113+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3746216196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 msgr2=0x7fe7b00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.113+0000 7fe7b7ad3700 1 --2- 172.21.15.49:0/3746216196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 0x7fe7b00f6930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fe7a40047f0 tx=0x7fe7a4009cb0).stop 2024-02-22T00:46:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.113+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3746216196 shutdown_connections 2024-02-22T00:46:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.113+0000 7fe7b7ad3700 1 --2- 172.21.15.49:0/3746216196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 0x7fe7b00f6930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.113+0000 7fe7b7ad3700 1 --2- 172.21.15.49:0/3746216196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7b00fc7f0 0x7fe7b00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:46:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.113+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3746216196 >> 172.21.15.49:0/3746216196 conn(0x7fe7b0070590 msgr2=0x7fe7b00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.113+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3746216196 shutdown_connections 2024-02-22T00:46:42.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.113+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3746216196 wait complete. 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.114+0000 7fe7b7ad3700 1 Processor -- start 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.114+0000 7fe7b7ad3700 1 -- start start 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.114+0000 7fe7b7ad3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7b00fc7f0 0x7fe7b0109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.114+0000 7fe7b7ad3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 0x7fe7b0109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.114+0000 7fe7b7ad3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0109be0 con 0x7fe7b00fd150 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.114+0000 7fe7b7ad3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0109d20 con 0x7fe7b00fc7f0 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.114+0000 7fe7b506e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 0x7fe7b0109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.114+0000 7fe7b506e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 0x7fe7b0109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35716/0 (socket says 172.21.15.49:35716) 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7b506e700 1 -- 172.21.15.49:0/3701333851 learned_addr learned my addr 172.21.15.49:0/3701333851 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7b586f700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7b00fc7f0 0x7fe7b0109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7b506e700 1 -- 172.21.15.49:0/3701333851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7b00fc7f0 msgr2=0x7fe7b0109170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7b506e700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7b00fc7f0 0x7fe7b0109170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7b506e700 1 -- 172.21.15.49:0/3701333851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4005040 con 0x7fe7b00fd150 2024-02-22T00:46:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7b506e700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 0x7fe7b0109660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe7a4000c00 tx=0x7fe7a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7a2f78700 1 -- 172.21.15.49:0/3701333851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a400e030 con 0x7fe7b00fd150 2024-02-22T00:46:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7a2f78700 1 -- 172.21.15.49:0/3701333851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7a4007e90 con 0x7fe7b00fd150 2024-02-22T00:46:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b0109f70 con 0x7fe7b00fd150 2024-02-22T00:46:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7a2f78700 1 -- 172.21.15.49:0/3701333851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a4018070 con 0x7fe7b00fd150 2024-02-22T00:46:42.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.115+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b01124b0 con 0x7fe7b00fd150 2024-02-22T00:46:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.116+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b005f590 con 0x7fe7b00fd150 2024-02-22T00:46:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.117+0000 7fe7a2f78700 1 -- 172.21.15.49:0/3701333851 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe7a401d420 con 0x7fe7b00fd150 2024-02-22T00:46:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.117+0000 7fe7a2f78700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe79c06cab0 0x7fe79c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.117+0000 7fe7a2f78700 1 -- 172.21.15.49:0/3701333851 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe7a408d1d0 con 0x7fe7b00fd150 2024-02-22T00:46:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.117+0000 7fe7b586f700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe79c06cab0 0x7fe79c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.118+0000 7fe7b586f700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe79c06cab0 0x7fe79c06ef70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe7ac00b910 tx=0x7fe7ac008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:42.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.122+0000 7fe7a2f78700 1 -- 172.21.15.49:0/3701333851 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe7a40572a0 con 0x7fe7b00fd150 2024-02-22T00:46:42.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.362+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe7b0060d10 con 0x7fe7b00fd150 2024-02-22T00:46:42.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.363+0000 7fe7a2f78700 1 -- 172.21.15.49:0/3701333851 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fe7a405a8c0 con 0x7fe7b00fd150 2024-02-22T00:46:42.365 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:46:42.365 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:46:42.365 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:46:42.365 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:46:42.365 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:46:42.366 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:46:42.367 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:46:42.368 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:46:42.368 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:46:42.368 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:46:42.368 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:46:42.368 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:46:42.368 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe79c06cab0 msgr2=0x7fe79c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe79c06cab0 0x7fe79c06ef70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe7ac00b910 tx=0x7fe7ac008040).stop 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 msgr2=0x7fe7b0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 0x7fe7b0109660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe7a4000c00 tx=0x7fe7a4009cb0).stop 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 shutdown_connections 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe79c06cab0 0x7fe79c06ef70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7b00fc7f0 0x7fe7b0109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 --2- 172.21.15.49:0/3701333851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7b00fd150 0x7fe7b0109660 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 >> 172.21.15.49:0/3701333851 conn(0x7fe7b0070590 msgr2=0x7fe7b00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 shutdown_connections 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.365+0000 7fe7b7ad3700 1 -- 172.21.15.49:0/3701333851 wait complete. 2024-02-22T00:46:42.369 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:46:42.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:42 smithi049 ceph-mon[132694]: pgmap v293: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:42.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:42 smithi049 ceph-mon[132694]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:42.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:42 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/529200061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:46:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 -- 172.21.15.49:0/91424573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 msgr2=0x7fca100fdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 --2- 172.21.15.49:0/91424573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 0x7fca100fdaa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fca04004a10 tx=0x7fca04009c50).stop 2024-02-22T00:46:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 -- 172.21.15.49:0/91424573 shutdown_connections 2024-02-22T00:46:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 --2- 172.21.15.49:0/91424573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca100fe020 0x7fca100f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 --2- 172.21.15.49:0/91424573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 0x7fca100fdaa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 -- 172.21.15.49:0/91424573 >> 172.21.15.49:0/91424573 conn(0x7fca100f3280 msgr2=0x7fca100f56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 -- 172.21.15.49:0/91424573 shutdown_connections 2024-02-22T00:46:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 -- 172.21.15.49:0/91424573 wait complete. 2024-02-22T00:46:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 Processor -- start 2024-02-22T00:46:42.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.469+0000 7fca1531c700 1 -- start start 2024-02-22T00:46:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca1531c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 0x7fca1010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca1531c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca100fe020 0x7fca1010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca1531c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1010eb70 con 0x7fca100fd6c0 2024-02-22T00:46:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca1531c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1010ecb0 con 0x7fca100fe020 2024-02-22T00:46:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 0x7fca1010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 0x7fca1010e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35736/0 (socket says 172.21.15.49:35736) 2024-02-22T00:46:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0ffff700 1 -- 172.21.15.49:0/3064454213 learned_addr learned my addr 172.21.15.49:0/3064454213 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:42.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0f7fe700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca100fe020 0x7fca1010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0ffff700 1 -- 172.21.15.49:0/3064454213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca100fe020 msgr2=0x7fca1010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0ffff700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca100fe020 0x7fca1010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0ffff700 1 -- 172.21.15.49:0/3064454213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040045d0 con 0x7fca100fd6c0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0f7fe700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca100fe020 0x7fca1010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0ffff700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 0x7fca1010e080 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fca04002040 tx=0x7fca04009c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0d7fa700 1 -- 172.21.15.49:0/3064454213 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0401a070 con 0x7fca100fd6c0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.470+0000 7fca0d7fa700 1 -- 172.21.15.49:0/3064454213 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca04007d80 con 0x7fca100fd6c0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.471+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca101080d0 con 0x7fca100fd6c0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.471+0000 7fca0d7fa700 1 -- 172.21.15.49:0/3064454213 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca0400e040 con 0x7fca100fd6c0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.471+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca10108630 con 0x7fca100fd6c0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.471+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1005f2f0 con 0x7fca100fd6c0 2024-02-22T00:46:42.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.472+0000 7fca0d7fa700 1 -- 172.21.15.49:0/3064454213 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fca04014520 con 0x7fca100fd6c0 2024-02-22T00:46:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.472+0000 7fca0d7fa700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc9f806caa0 0x7fc9f806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.473+0000 7fca0d7fa700 1 -- 172.21.15.49:0/3064454213 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fca0408c9a0 con 0x7fca100fd6c0 2024-02-22T00:46:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.473+0000 7fca0f7fe700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc9f806caa0 0x7fc9f806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.473+0000 7fca0f7fe700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc9f806caa0 0x7fc9f806ef60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fca00007fd0 tx=0x7fca0000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:42.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.477+0000 7fca0d7fa700 1 -- 172.21.15.49:0/3064454213 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fca0405a500 con 0x7fca100fd6c0 2024-02-22T00:46:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:42 smithi161 ceph-mon[113442]: pgmap v293: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:42 smithi161 ceph-mon[113442]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:42 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/529200061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:46:42.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.693+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca10109770 con 0x7fc9f806caa0 2024-02-22T00:46:42.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.694+0000 7fca0d7fa700 1 -- 172.21.15.49:0/3064454213 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fca10109770 con 0x7fc9f806caa0 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:46:42.697 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:46:42.698 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:46:42.698 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:46:42.698 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:46:42.698 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:46:42.698 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:46:42.698 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.696+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc9f806caa0 msgr2=0x7fc9f806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.696+0000 7fca1531c700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc9f806caa0 0x7fc9f806ef60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fca00007fd0 tx=0x7fca0000b040).stop 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.696+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 msgr2=0x7fca1010e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.696+0000 7fca1531c700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 0x7fca1010e080 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fca04002040 tx=0x7fca04009c50).stop 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.697+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 shutdown_connections 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.697+0000 7fca1531c700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc9f806caa0 0x7fc9f806ef60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.697+0000 7fca1531c700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca100fd6c0 0x7fca1010e080 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.697+0000 7fca1531c700 1 --2- 172.21.15.49:0/3064454213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca100fe020 0x7fca1010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.697+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 >> 172.21.15.49:0/3064454213 conn(0x7fca100f3280 msgr2=0x7fca100fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.697+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 shutdown_connections 2024-02-22T00:46:42.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.697+0000 7fca1531c700 1 -- 172.21.15.49:0/3064454213 wait complete. 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 -- 172.21.15.49:0/168099376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fc7c0 msgr2=0x7f06080fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 --2- 172.21.15.49:0/168099376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fc7c0 0x7f06080fcba0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f05fc0047f0 tx=0x7f05fc009cb0).stop 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 -- 172.21.15.49:0/168099376 shutdown_connections 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 --2- 172.21.15.49:0/168099376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06080fd120 0x7f06080f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 --2- 172.21.15.49:0/168099376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fc7c0 0x7f06080fcba0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 -- 172.21.15.49:0/168099376 >> 172.21.15.49:0/168099376 conn(0x7f060806cea0 msgr2=0x7f060806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 -- 172.21.15.49:0/168099376 shutdown_connections 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 -- 172.21.15.49:0/168099376 wait complete. 2024-02-22T00:46:42.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.799+0000 7f060dc61700 1 Processor -- start 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f060dc61700 1 -- start start 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f060dc61700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06080fc7c0 0x7f06080fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f060dc61700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fd120 0x7f06080fdc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f060dc61700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080fe180 con 0x7f06080fd120 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f060dc61700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080fe2c0 con 0x7f06080fc7c0 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fd120 0x7f06080fdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0606ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fd120 0x7f06080fdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35760/0 (socket says 172.21.15.49:35760) 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0606ffd700 1 -- 172.21.15.49:0/2073666210 learned_addr learned my addr 172.21.15.49:0/2073666210 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f06077fe700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06080fc7c0 0x7f06080fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0606ffd700 1 -- 172.21.15.49:0/2073666210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06080fc7c0 msgr2=0x7f06080fd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0606ffd700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06080fc7c0 0x7f06080fd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:42.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0606ffd700 1 -- 172.21.15.49:0/2073666210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc005040 con 0x7f06080fd120 2024-02-22T00:46:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0606ffd700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fd120 0x7f06080fdc90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f05f800c740 tx=0x7f05f8007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0604ff9700 1 -- 172.21.15.49:0/2073666210 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05f800e680 con 0x7f06080fd120 2024-02-22T00:46:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.800+0000 7f0604ff9700 1 -- 172.21.15.49:0/2073666210 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05f800ec90 con 0x7f06080fd120 2024-02-22T00:46:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.801+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06080fe570 con 0x7f06080fd120 2024-02-22T00:46:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.801+0000 7f0604ff9700 1 -- 172.21.15.49:0/2073666210 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05f8013d60 con 0x7f06080fd120 2024-02-22T00:46:42.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.801+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06081146b0 con 0x7f06080fd120 2024-02-22T00:46:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.802+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0608047540 con 0x7f06080fd120 2024-02-22T00:46:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.802+0000 7f0604ff9700 1 -- 172.21.15.49:0/2073666210 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f05f800e7e0 con 0x7f06080fd120 2024-02-22T00:46:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.802+0000 7f0604ff9700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05f006cab0 0x7f05f006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:46:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.802+0000 7f0604ff9700 1 -- 172.21.15.49:0/2073666210 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f05f808c020 con 0x7f06080fd120 2024-02-22T00:46:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.803+0000 7f06077fe700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05f006cab0 0x7f05f006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:46:42.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.803+0000 7f06077fe700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05f006cab0 0x7f05f006ef70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f05fc004f10 tx=0x7f05fc009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:46:42.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:42.807+0000 7f0604ff9700 1 -- 172.21.15.49:0/2073666210 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f05f80560f0 con 0x7f06080fd120 2024-02-22T00:46:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.088+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0608103580 con 0x7f06080fd120 2024-02-22T00:46:43.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.088+0000 7f0604ff9700 1 -- 172.21.15.49:0/2073666210 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f05f8059710 con 0x7f06080fd120 2024-02-22T00:46:43.090 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:46:43.090 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:46:43.090 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:46:43.091 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:46:43.091 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:46:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05f006cab0 msgr2=0x7f05f006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:43.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05f006cab0 0x7f05f006ef70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f05fc004f10 tx=0x7f05fc009cb0).stop 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fd120 msgr2=0x7f06080fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fd120 0x7f06080fdc90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f05f800c740 tx=0x7f05f8007ef0).stop 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 shutdown_connections 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05f006cab0 0x7f05f006ef70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06080fc7c0 0x7f06080fd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 --2- 172.21.15.49:0/2073666210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06080fd120 0x7f06080fdc90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 >> 172.21.15.49:0/2073666210 conn(0x7f060806cea0 msgr2=0x7f06080f5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 shutdown_connections 2024-02-22T00:46:43.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:46:43.090+0000 7f060dc61700 1 -- 172.21.15.49:0/2073666210 wait complete. 2024-02-22T00:46:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:43 smithi049 ceph-mon[132694]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:43 smithi049 ceph-mon[132694]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:43 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3701333851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:46:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:46:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:43 smithi161 ceph-mon[113442]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:43 smithi161 ceph-mon[113442]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:43 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3701333851' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:46:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:46:44.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:44 smithi049 ceph-mon[132694]: pgmap v294: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:44.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:44 smithi049 ceph-mon[132694]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:44.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:44 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2073666210' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:46:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:44 smithi161 ceph-mon[113442]: pgmap v294: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:44 smithi161 ceph-mon[113442]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:46:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:44 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2073666210' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:46:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:46 smithi049 ceph-mon[132694]: pgmap v295: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:46 smithi161 ceph-mon[113442]: pgmap v295: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:48 smithi049 ceph-mon[132694]: pgmap v296: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:48 smithi161 ceph-mon[113442]: pgmap v296: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:50 smithi049 ceph-mon[132694]: pgmap v297: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:50 smithi161 ceph-mon[113442]: pgmap v297: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:52 smithi049 ceph-mon[132694]: pgmap v298: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:52 smithi161 ceph-mon[113442]: pgmap v298: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:54 smithi049 ceph-mon[132694]: pgmap v299: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:54 smithi161 ceph-mon[113442]: pgmap v299: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:56 smithi049 ceph-mon[132694]: pgmap v300: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:56 smithi161 ceph-mon[113442]: pgmap v300: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:58 smithi049 ceph-mon[132694]: pgmap v301: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:46:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:46:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:58 smithi161 ceph-mon[113442]: pgmap v301: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:46:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:46:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:47:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:00 smithi049 ceph-mon[132694]: pgmap v302: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:00 smithi161 ceph-mon[113442]: pgmap v302: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:02.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:02 smithi049 ceph-mon[132694]: pgmap v303: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:02 smithi161 ceph-mon[113442]: pgmap v303: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:04.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:04 smithi049 ceph-mon[132694]: pgmap v304: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:04 smithi161 ceph-mon[113442]: pgmap v304: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:06 smithi049 ceph-mon[132694]: pgmap v305: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:06 smithi161 ceph-mon[113442]: pgmap v305: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:08 smithi049 ceph-mon[132694]: pgmap v306: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:08 smithi161 ceph-mon[113442]: pgmap v306: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:10 smithi049 ceph-mon[132694]: pgmap v307: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:10 smithi161 ceph-mon[113442]: pgmap v307: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:12.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:12 smithi049 ceph-mon[132694]: pgmap v308: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:12 smithi161 ceph-mon[113442]: pgmap v308: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 -- 172.21.15.49:0/2891974443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 msgr2=0x7fce840fdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 --2- 172.21.15.49:0/2891974443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 0x7fce840fdd30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fce800047f0 tx=0x7fce80009cb0).stop 2024-02-22T00:47:13.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 -- 172.21.15.49:0/2891974443 shutdown_connections 2024-02-22T00:47:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 --2- 172.21.15.49:0/2891974443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce840fe2b0 0x7fce84060680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 --2- 172.21.15.49:0/2891974443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 0x7fce840fdd30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 -- 172.21.15.49:0/2891974443 >> 172.21.15.49:0/2891974443 conn(0x7fce8406c760 msgr2=0x7fce8406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 -- 172.21.15.49:0/2891974443 shutdown_connections 2024-02-22T00:47:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 -- 172.21.15.49:0/2891974443 wait complete. 2024-02-22T00:47:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 Processor -- start 2024-02-22T00:47:13.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.204+0000 7fce8c3c7700 1 -- start start 2024-02-22T00:47:13.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8c3c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 0x7fce8410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8c3c7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce840fe2b0 0x7fce8410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8c3c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8410eab0 con 0x7fce840fd950 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8c3c7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8410ebf0 con 0x7fce840fe2b0 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8a163700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 0x7fce8410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8a163700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 0x7fce8410dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36594/0 (socket says 172.21.15.49:36594) 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8a163700 1 -- 172.21.15.49:0/963655214 learned_addr learned my addr 172.21.15.49:0/963655214 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce89962700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce840fe2b0 0x7fce8410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8a163700 1 -- 172.21.15.49:0/963655214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce840fe2b0 msgr2=0x7fce8410e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8a163700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce840fe2b0 0x7fce8410e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8a163700 1 -- 172.21.15.49:0/963655214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80005040 con 0x7fce840fd950 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8a163700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 0x7fce8410dfc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fce80005010 tx=0x7fce80009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce7b7fe700 1 -- 172.21.15.49:0/963655214 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce8000e030 con 0x7fce840fd950 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce7b7fe700 1 -- 172.21.15.49:0/963655214 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce80007e90 con 0x7fce840fd950 2024-02-22T00:47:13.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce84108220 con 0x7fce840fd950 2024-02-22T00:47:13.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce7b7fe700 1 -- 172.21.15.49:0/963655214 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce80018070 con 0x7fce840fd950 2024-02-22T00:47:13.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.205+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce84108780 con 0x7fce840fd950 2024-02-22T00:47:13.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.206+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8405f570 con 0x7fce840fd950 2024-02-22T00:47:13.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.207+0000 7fce7b7fe700 1 -- 172.21.15.49:0/963655214 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fce8001d670 con 0x7fce840fd950 2024-02-22T00:47:13.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.207+0000 7fce7b7fe700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce7006caa0 0x7fce7006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.207+0000 7fce7b7fe700 1 -- 172.21.15.49:0/963655214 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fce8008cf50 con 0x7fce840fd950 2024-02-22T00:47:13.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.207+0000 7fce89962700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce7006caa0 0x7fce7006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.208+0000 7fce89962700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce7006caa0 0x7fce7006ef60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fce84109900 tx=0x7fce7400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:13.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.212+0000 7fce7b7fe700 1 -- 172.21.15.49:0/963655214 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fce800c0190 con 0x7fce840fd950 2024-02-22T00:47:13.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:47:13.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.428+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce840ffca0 con 0x7fce7006caa0 2024-02-22T00:47:13.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.429+0000 7fce7b7fe700 1 -- 172.21.15.49:0/963655214 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fce840ffca0 con 0x7fce7006caa0 2024-02-22T00:47:13.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce7006caa0 msgr2=0x7fce7006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce7006caa0 0x7fce7006ef60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fce84109900 tx=0x7fce7400b040).stop 2024-02-22T00:47:13.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 msgr2=0x7fce8410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 0x7fce8410dfc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fce80005010 tx=0x7fce80009cb0).stop 2024-02-22T00:47:13.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 shutdown_connections 2024-02-22T00:47:13.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce7006caa0 0x7fce7006ef60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce840fd950 0x7fce8410dfc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 --2- 172.21.15.49:0/963655214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce840fe2b0 0x7fce8410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 >> 172.21.15.49:0/963655214 conn(0x7fce8406c760 msgr2=0x7fce840fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:13.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.431+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 shutdown_connections 2024-02-22T00:47:13.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.432+0000 7fce8c3c7700 1 -- 172.21.15.49:0/963655214 wait complete. 2024-02-22T00:47:13.443 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:47:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.534+0000 7f242dadb700 1 -- 172.21.15.49:0/3021560727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fd8f0 msgr2=0x7f24280fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.534+0000 7f242dadb700 1 --2- 172.21.15.49:0/3021560727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fd8f0 0x7f24280fdcd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f24180047f0 tx=0x7f2418009cb0).stop 2024-02-22T00:47:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.534+0000 7f242dadb700 1 -- 172.21.15.49:0/3021560727 shutdown_connections 2024-02-22T00:47:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.534+0000 7f242dadb700 1 --2- 172.21.15.49:0/3021560727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24280fe250 0x7f24280f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.534+0000 7f242dadb700 1 --2- 172.21.15.49:0/3021560727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fd8f0 0x7f24280fdcd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.534+0000 7f242dadb700 1 -- 172.21.15.49:0/3021560727 >> 172.21.15.49:0/3021560727 conn(0x7f24280f34b0 msgr2=0x7f24280f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.534+0000 7f242dadb700 1 -- 172.21.15.49:0/3021560727 shutdown_connections 2024-02-22T00:47:13.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.534+0000 7f242dadb700 1 -- 172.21.15.49:0/3021560727 wait complete. 2024-02-22T00:47:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.535+0000 7f242dadb700 1 Processor -- start 2024-02-22T00:47:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.535+0000 7f242dadb700 1 -- start start 2024-02-22T00:47:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.535+0000 7f242dadb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24280fd8f0 0x7f24281101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.535+0000 7f242dadb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fe250 0x7f24281106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.535+0000 7f242dadb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2428110ce0 con 0x7f24280fe250 2024-02-22T00:47:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.535+0000 7f242dadb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2428110e20 con 0x7f24280fd8f0 2024-02-22T00:47:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2426ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fe250 0x7f24281106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2426ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fe250 0x7f24281106e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36610/0 (socket says 172.21.15.49:36610) 2024-02-22T00:47:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2426ffd700 1 -- 172.21.15.49:0/167974727 learned_addr learned my addr 172.21.15.49:0/167974727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f24277fe700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24280fd8f0 0x7f24281101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2426ffd700 1 -- 172.21.15.49:0/167974727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24280fd8f0 msgr2=0x7f24281101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2426ffd700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24280fd8f0 0x7f24281101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2426ffd700 1 -- 172.21.15.49:0/167974727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2418005040 con 0x7f24280fe250 2024-02-22T00:47:13.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2426ffd700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fe250 0x7f24281106e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f241c002780 tx=0x7f241c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2424f74700 1 -- 172.21.15.49:0/167974727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f241c007b40 con 0x7f24280fe250 2024-02-22T00:47:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2424f74700 1 -- 172.21.15.49:0/167974727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f241c00f040 con 0x7f24280fe250 2024-02-22T00:47:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242810a500 con 0x7f24280fe250 2024-02-22T00:47:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f2424f74700 1 -- 172.21.15.49:0/167974727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f241c014780 con 0x7f24280fe250 2024-02-22T00:47:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.536+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242810aac0 con 0x7f24280fe250 2024-02-22T00:47:13.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.537+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242805f590 con 0x7f24280fe250 2024-02-22T00:47:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.538+0000 7f2424f74700 1 -- 172.21.15.49:0/167974727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f241c007ca0 con 0x7f24280fe250 2024-02-22T00:47:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.538+0000 7f2424f74700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f241006cab0 0x7f241006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.538+0000 7f2424f74700 1 -- 172.21.15.49:0/167974727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f241c08bbc0 con 0x7f24280fe250 2024-02-22T00:47:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.538+0000 7f24277fe700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f241006cab0 0x7f241006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.538+0000 7f24277fe700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f241006cab0 0x7f241006ef70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2418004f10 tx=0x7f2418009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:47:13.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.542+0000 7f2424f74700 1 -- 172.21.15.49:0/167974727 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f241c059720 con 0x7f24280fe250 2024-02-22T00:47:13.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.758+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f242810ad90 con 0x7f241006cab0 2024-02-22T00:47:13.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.760+0000 7f2424f74700 1 -- 172.21.15.49:0/167974727 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f242810ad90 con 0x7f241006cab0 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.761+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f241006cab0 msgr2=0x7f241006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.761+0000 7f242dadb700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f241006cab0 0x7f241006ef70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2418004f10 tx=0x7f2418009cb0).stop 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.761+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fe250 msgr2=0x7f24281106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.761+0000 7f242dadb700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fe250 0x7f24281106e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f241c002780 tx=0x7f241c009ee0).stop 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.762+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 shutdown_connections 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.762+0000 7f242dadb700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f241006cab0 0x7f241006ef70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.762+0000 7f242dadb700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24280fd8f0 0x7f24281101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.762+0000 7f242dadb700 1 --2- 172.21.15.49:0/167974727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24280fe250 0x7f24281106e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.762+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 >> 172.21.15.49:0/167974727 conn(0x7f24280f34b0 msgr2=0x7f242806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.762+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 shutdown_connections 2024-02-22T00:47:13.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.762+0000 7f242dadb700 1 -- 172.21.15.49:0/167974727 wait complete. 2024-02-22T00:47:13.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 -- 172.21.15.49:0/233300861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fc7f0 msgr2=0x7efd5c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 --2- 172.21.15.49:0/233300861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fc7f0 0x7efd5c0fcbd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7efd4c0047f0 tx=0x7efd4c009cb0).stop 2024-02-22T00:47:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 -- 172.21.15.49:0/233300861 shutdown_connections 2024-02-22T00:47:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 --2- 172.21.15.49:0/233300861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd5c0fd150 0x7efd5c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 --2- 172.21.15.49:0/233300861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fc7f0 0x7efd5c0fcbd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 -- 172.21.15.49:0/233300861 >> 172.21.15.49:0/233300861 conn(0x7efd5c070590 msgr2=0x7efd5c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 -- 172.21.15.49:0/233300861 shutdown_connections 2024-02-22T00:47:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 -- 172.21.15.49:0/233300861 wait complete. 2024-02-22T00:47:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 Processor -- start 2024-02-22T00:47:13.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.864+0000 7efd629f0700 1 -- start start 2024-02-22T00:47:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd629f0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd5c0fc7f0 0x7efd5c10e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd629f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fd150 0x7efd5c10e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd629f0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c10ebf0 con 0x7efd5c0fd150 2024-02-22T00:47:13.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd629f0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c10ed30 con 0x7efd5c0fc7f0 2024-02-22T00:47:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd5b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fd150 0x7efd5c10e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd5b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fd150 0x7efd5c10e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36636/0 (socket says 172.21.15.49:36636) 2024-02-22T00:47:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd5b7fe700 1 -- 172.21.15.49:0/2050946542 learned_addr learned my addr 172.21.15.49:0/2050946542 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd5bfff700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd5c0fc7f0 0x7efd5c10e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd5b7fe700 1 -- 172.21.15.49:0/2050946542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd5c0fc7f0 msgr2=0x7efd5c10e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd5b7fe700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd5c0fc7f0 0x7efd5c10e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:13.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd5b7fe700 1 -- 172.21.15.49:0/2050946542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c005040 con 0x7efd5c0fd150 2024-02-22T00:47:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd5b7fe700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fd150 0x7efd5c10e5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7efd4400e8c0 tx=0x7efd4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd597fa700 1 -- 172.21.15.49:0/2050946542 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd44007b40 con 0x7efd5c0fd150 2024-02-22T00:47:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd597fa700 1 -- 172.21.15.49:0/2050946542 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd4400f040 con 0x7efd5c0fd150 2024-02-22T00:47:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c108400 con 0x7efd5c0fd150 2024-02-22T00:47:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.865+0000 7efd597fa700 1 -- 172.21.15.49:0/2050946542 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd44014880 con 0x7efd5c0fd150 2024-02-22T00:47:13.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.866+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c1089c0 con 0x7efd5c0fd150 2024-02-22T00:47:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.867+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c05f590 con 0x7efd5c0fd150 2024-02-22T00:47:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.867+0000 7efd597fa700 1 -- 172.21.15.49:0/2050946542 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efd44007ca0 con 0x7efd5c0fd150 2024-02-22T00:47:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.867+0000 7efd597fa700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4806caa0 0x7efd4806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.867+0000 7efd597fa700 1 -- 172.21.15.49:0/2050946542 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7efd4408b6a0 con 0x7efd5c0fd150 2024-02-22T00:47:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.867+0000 7efd5bfff700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4806caa0 0x7efd4806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:13.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.868+0000 7efd5bfff700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4806caa0 0x7efd4806ef60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7efd4c0047c0 tx=0x7efd4c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:13.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:13.872+0000 7efd597fa700 1 -- 172.21.15.49:0/2050946542 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efd44055770 con 0x7efd5c0fd150 2024-02-22T00:47:14.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.079+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd5c109050 con 0x7efd4806caa0 2024-02-22T00:47:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.089+0000 7efd597fa700 1 -- 172.21.15.49:0/2050946542 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7efd5c109050 con 0x7efd4806caa0 2024-02-22T00:47:14.090 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (10m) 4m ago 21m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (8m) 4m ago 21m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (8m) 3m ago 21m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (10m) 4m ago 21m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (4m) 4m ago 16m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (4m) 4m ago 16m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (3m) 3m ago 16m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (4m) 3m ago 16m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (12m) 4m ago 22m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (11m) 3m ago 20m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 4m ago 23m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:47:14.091 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (8m) 3m ago 20m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (11m) 4m ago 21m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (10m) 3m ago 20m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (7m) 4m ago 20m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 4m ago 19m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (6m) 4m ago 19m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (6m) 3m ago 18m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (5m) 3m ago 18m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (4m) 3m ago 18m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:47:14.092 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (10m) 3m ago 20m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:47:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4806caa0 msgr2=0x7efd4806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4806caa0 0x7efd4806ef60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7efd4c0047c0 tx=0x7efd4c009cb0).stop 2024-02-22T00:47:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fd150 msgr2=0x7efd5c10e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fd150 0x7efd5c10e5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7efd4400e8c0 tx=0x7efd4400b040).stop 2024-02-22T00:47:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 shutdown_connections 2024-02-22T00:47:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd4806caa0 0x7efd4806ef60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd5c0fc7f0 0x7efd5c10e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 --2- 172.21.15.49:0/2050946542 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c0fd150 0x7efd5c10e5f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 >> 172.21.15.49:0/2050946542 conn(0x7efd5c070590 msgr2=0x7efd5c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 shutdown_connections 2024-02-22T00:47:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.091+0000 7efd629f0700 1 -- 172.21.15.49:0/2050946542 wait complete. 2024-02-22T00:47:14.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.192+0000 7f64e2d56700 1 -- 172.21.15.49:0/2304588606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 msgr2=0x7f64dc0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.192+0000 7f64e2d56700 1 --2- 172.21.15.49:0/2304588606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 0x7f64dc0fcbd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f64d00047f0 tx=0x7f64d0009cb0).stop 2024-02-22T00:47:14.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.192+0000 7f64e2d56700 1 -- 172.21.15.49:0/2304588606 shutdown_connections 2024-02-22T00:47:14.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.192+0000 7f64e2d56700 1 --2- 172.21.15.49:0/2304588606 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64dc0fd150 0x7f64dc0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:47:14.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.192+0000 7f64e2d56700 1 --2- 172.21.15.49:0/2304588606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 0x7f64dc0fcbd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.192+0000 7f64e2d56700 1 -- 172.21.15.49:0/2304588606 >> 172.21.15.49:0/2304588606 conn(0x7f64dc070590 msgr2=0x7f64dc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:14.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.192+0000 7f64e2d56700 1 -- 172.21.15.49:0/2304588606 shutdown_connections 2024-02-22T00:47:14.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.192+0000 7f64e2d56700 1 -- 172.21.15.49:0/2304588606 wait complete. 2024-02-22T00:47:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.193+0000 7f64e2d56700 1 Processor -- start 2024-02-22T00:47:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.193+0000 7f64e2d56700 1 -- start start 2024-02-22T00:47:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.193+0000 7f64e2d56700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 0x7f64dc109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.193+0000 7f64e2d56700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64dc0fd150 0x7f64dc109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.193+0000 7f64e2d56700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc109bb0 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.193+0000 7f64e2d56700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc109cf0 con 0x7f64dc0fd150 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e0af2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 0x7f64dc109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e0af2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 0x7f64dc109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36666/0 (socket says 172.21.15.49:36666) 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e0af2700 1 -- 172.21.15.49:0/1829600109 learned_addr learned my addr 172.21.15.49:0/1829600109 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64dbfff700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64dc0fd150 0x7f64dc109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e0af2700 1 -- 172.21.15.49:0/1829600109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64dc0fd150 msgr2=0x7f64dc109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e0af2700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64dc0fd150 0x7f64dc109630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e0af2700 1 -- 172.21.15.49:0/1829600109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0005040 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e0af2700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 0x7f64dc109140 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f64d000b120 tx=0x7f64d0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64d9ffb700 1 -- 172.21.15.49:0/1829600109 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64d000e030 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc109f40 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64d9ffb700 1 -- 172.21.15.49:0/1829600109 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f64d0007e90 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64d9ffb700 1 -- 172.21.15.49:0/1829600109 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64d0018070 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.194+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc112480 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.195+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc05f590 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.196+0000 7f64d9ffb700 1 -- 172.21.15.49:0/1829600109 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f64d001d420 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.196+0000 7f64d9ffb700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f64cc06caa0 0x7f64cc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.196+0000 7f64d9ffb700 1 -- 172.21.15.49:0/1829600109 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f64d008d270 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.197+0000 7f64dbfff700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f64cc06caa0 0x7f64cc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.197+0000 7f64dbfff700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f64cc06caa0 0x7f64cc06ef60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f64dc060f00 tx=0x7f64c8008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:14.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.201+0000 7f64d9ffb700 1 -- 172.21.15.49:0/1829600109 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f64d0057340 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:14 smithi049 ceph-mon[132694]: pgmap v309: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:14.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.484+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f64dc047540 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.485+0000 7f64d9ffb700 1 -- 172.21.15.49:0/1829600109 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f64d005a960 con 0x7f64dc0fc7f0 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:47:14.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:47:14.487 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:47:14.487 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:47:14.487 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:47:14.487 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:47:14.487 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:47:14.487 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:47:14.487 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:47:14.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f64cc06caa0 msgr2=0x7f64cc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f64cc06caa0 0x7f64cc06ef60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f64dc060f00 tx=0x7f64c8008040).stop 2024-02-22T00:47:14.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 msgr2=0x7f64dc109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 0x7f64dc109140 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f64d000b120 tx=0x7f64d0009cb0).stop 2024-02-22T00:47:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 shutdown_connections 2024-02-22T00:47:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f64cc06caa0 0x7f64cc06ef60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f64dc0fc7f0 0x7f64dc109140 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 --2- 172.21.15.49:0/1829600109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64dc0fd150 0x7f64dc109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 >> 172.21.15.49:0/1829600109 conn(0x7f64dc070590 msgr2=0x7f64dc0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 shutdown_connections 2024-02-22T00:47:14.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.487+0000 7f64e2d56700 1 -- 172.21.15.49:0/1829600109 wait complete. 2024-02-22T00:47:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:14 smithi161 ceph-mon[113442]: pgmap v309: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.590+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/3505530455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 msgr2=0x7fbcb00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.590+0000 7fbcb4d2f700 1 --2- 172.21.15.49:0/3505530455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 0x7fbcb00f6930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fbc980047f0 tx=0x7fbc98009cb0).stop 2024-02-22T00:47:14.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.590+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/3505530455 shutdown_connections 2024-02-22T00:47:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.590+0000 7fbcb4d2f700 1 --2- 172.21.15.49:0/3505530455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 0x7fbcb00f6930 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.590+0000 7fbcb4d2f700 1 --2- 172.21.15.49:0/3505530455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb00fc7f0 0x7fbcb00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.590+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/3505530455 >> 172.21.15.49:0/3505530455 conn(0x7fbcb0070590 msgr2=0x7fbcb00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.590+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/3505530455 shutdown_connections 2024-02-22T00:47:14.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.590+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/3505530455 wait complete. 2024-02-22T00:47:14.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcb4d2f700 1 Processor -- start 2024-02-22T00:47:14.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcb4d2f700 1 -- start start 2024-02-22T00:47:14.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcb4d2f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb00fc7f0 0x7fbcb00f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcb4d2f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 0x7fbcb00f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcb4d2f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00f8f20 con 0x7fbcb00fd150 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcb4d2f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb00f9060 con 0x7fbcb00fc7f0 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcadd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 0x7fbcb00f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcadd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 0x7fbcb00f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36694/0 (socket says 172.21.15.49:36694) 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcadd9b700 1 -- 172.21.15.49:0/2869686520 learned_addr learned my addr 172.21.15.49:0/2869686520 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcae59c700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb00fc7f0 0x7fbcb00f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcadd9b700 1 -- 172.21.15.49:0/2869686520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb00fc7f0 msgr2=0x7fbcb00f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcadd9b700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb00fc7f0 0x7fbcb00f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcadd9b700 1 -- 172.21.15.49:0/2869686520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc98005040 con 0x7fbcb00fd150 2024-02-22T00:47:14.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.591+0000 7fbcae59c700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb00fc7f0 0x7fbcb00f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.592+0000 7fbcadd9b700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 0x7fbcb00f8a30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fbc98000c00 tx=0x7fbc98009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.592+0000 7fbca77fe700 1 -- 172.21.15.49:0/2869686520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc9800e030 con 0x7fbcb00fd150 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.592+0000 7fbca77fe700 1 -- 172.21.15.49:0/2869686520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc98007e90 con 0x7fbcb00fd150 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.592+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb00f92b0 con 0x7fbcb00fd150 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.592+0000 7fbca77fe700 1 -- 172.21.15.49:0/2869686520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc98018070 con 0x7fbcb00fd150 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.592+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb01145f0 con 0x7fbcb00fd150 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.593+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb005f590 con 0x7fbcb00fd150 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.593+0000 7fbca77fe700 1 -- 172.21.15.49:0/2869686520 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbc9801d420 con 0x7fbcb00fd150 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.594+0000 7fbca77fe700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc9c06ca40 0x7fbc9c06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.594+0000 7fbca77fe700 1 -- 172.21.15.49:0/2869686520 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbc9808d020 con 0x7fbcb00fd150 2024-02-22T00:47:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.594+0000 7fbcae59c700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc9c06ca40 0x7fbc9c06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.594+0000 7fbcae59c700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc9c06ca40 0x7fbc9c06ef00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fbca0004ca0 tx=0x7fbca000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.598+0000 7fbca77fe700 1 -- 172.21.15.49:0/2869686520 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbc980570f0 con 0x7fbcb00fd150 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.843+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbcb0047540 con 0x7fbcb00fd150 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.844+0000 7fbca77fe700 1 -- 172.21.15.49:0/2869686520 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fbc9805a710 con 0x7fbcb00fd150 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:47:14.845 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:47:14.846 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:47:14.847 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:47:14.848 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:47:14.848 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:47:14.848 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:47:14.848 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:47:14.848 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:47:14.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc9c06ca40 msgr2=0x7fbc9c06ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc9c06ca40 0x7fbc9c06ef00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fbca0004ca0 tx=0x7fbca000b040).stop 2024-02-22T00:47:14.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 msgr2=0x7fbcb00f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 0x7fbcb00f8a30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fbc98000c00 tx=0x7fbc98009cb0).stop 2024-02-22T00:47:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 shutdown_connections 2024-02-22T00:47:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc9c06ca40 0x7fbc9c06ef00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb00fc7f0 0x7fbcb00f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 --2- 172.21.15.49:0/2869686520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcb00fd150 0x7fbcb00f8a30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 >> 172.21.15.49:0/2869686520 conn(0x7fbcb0070590 msgr2=0x7fbcb0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 shutdown_connections 2024-02-22T00:47:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.846+0000 7fbcb4d2f700 1 -- 172.21.15.49:0/2869686520 wait complete. 2024-02-22T00:47:14.850 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:47:14.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.949+0000 7f15009fc700 1 -- 172.21.15.49:0/2849456997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 msgr2=0x7f14fc0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.949+0000 7f15009fc700 1 --2- 172.21.15.49:0/2849456997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 0x7f14fc0fcbd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f14f00047f0 tx=0x7f14f0009cb0).stop 2024-02-22T00:47:14.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.949+0000 7f15009fc700 1 -- 172.21.15.49:0/2849456997 shutdown_connections 2024-02-22T00:47:14.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.949+0000 7f15009fc700 1 --2- 172.21.15.49:0/2849456997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14fc0fd150 0x7f14fc0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.949+0000 7f15009fc700 1 --2- 172.21.15.49:0/2849456997 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 0x7f14fc0fcbd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.949+0000 7f15009fc700 1 -- 172.21.15.49:0/2849456997 >> 172.21.15.49:0/2849456997 conn(0x7f14fc070590 msgr2=0x7f14fc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:14.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.949+0000 7f15009fc700 1 -- 172.21.15.49:0/2849456997 shutdown_connections 2024-02-22T00:47:14.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.949+0000 7f15009fc700 1 -- 172.21.15.49:0/2849456997 wait complete. 2024-02-22T00:47:14.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f15009fc700 1 Processor -- start 2024-02-22T00:47:14.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f15009fc700 1 -- start start 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f15009fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 0x7f14fc110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f15009fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14fc0fd150 0x7f14fc110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f15009fc700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc110d30 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f15009fc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc110e70 con 0x7f14fc0fd150 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f14fa59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 0x7f14fc110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f14fa59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 0x7f14fc110240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36714/0 (socket says 172.21.15.49:36714) 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.950+0000 7f14fa59c700 1 -- 172.21.15.49:0/2619634428 learned_addr learned my addr 172.21.15.49:0/2619634428 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14f9d9b700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14fc0fd150 0x7f14fc110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14fa59c700 1 -- 172.21.15.49:0/2619634428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14fc0fd150 msgr2=0x7f14fc110730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14fa59c700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14fc0fd150 0x7f14fc110730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14fa59c700 1 -- 172.21.15.49:0/2619634428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f0005040 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14f9d9b700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14fc0fd150 0x7f14fc110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14fa59c700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 0x7f14fc110240 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f14f0013640 tx=0x7f14f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:14.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14eb7fe700 1 -- 172.21.15.49:0/2619634428 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14f000e030 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc10a4a0 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14eb7fe700 1 -- 172.21.15.49:0/2619634428 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14f0007e90 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f14eb7fe700 1 -- 172.21.15.49:0/2619634428 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14f0018070 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.951+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc10aa00 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.952+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14fc05f590 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.953+0000 7f14eb7fe700 1 -- 172.21.15.49:0/2619634428 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f14f001d420 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.953+0000 7f14eb7fe700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f14e406cab0 0x7f14e406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.953+0000 7f14eb7fe700 1 -- 172.21.15.49:0/2619634428 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f14f008d270 con 0x7f14fc0fc7f0 2024-02-22T00:47:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.953+0000 7f14f9d9b700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f14e406cab0 0x7f14e406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:14.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.954+0000 7f14f9d9b700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f14e406cab0 0x7f14e406ef70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f14fc10bb80 tx=0x7f14ec009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:14.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:14.958+0000 7f14eb7fe700 1 -- 172.21.15.49:0/2619634428 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f14f005add0 con 0x7f14fc0fc7f0 2024-02-22T00:47:15.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.173+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14fc10b040 con 0x7f14e406cab0 2024-02-22T00:47:15.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.174+0000 7f14eb7fe700 1 -- 172.21.15.49:0/2619634428 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f14fc10b040 con 0x7f14e406cab0 2024-02-22T00:47:15.175 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:47:15.175 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:47:15.176 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:47:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f14e406cab0 msgr2=0x7f14e406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f14e406cab0 0x7f14e406ef70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f14fc10bb80 tx=0x7f14ec009040).stop 2024-02-22T00:47:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 msgr2=0x7f14fc110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:15.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 0x7f14fc110240 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f14f0013640 tx=0x7f14f0009cb0).stop 2024-02-22T00:47:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 shutdown_connections 2024-02-22T00:47:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f14e406cab0 0x7f14e406ef70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14fc0fc7f0 0x7f14fc110240 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 --2- 172.21.15.49:0/2619634428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14fc0fd150 0x7f14fc110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 >> 172.21.15.49:0/2619634428 conn(0x7f14fc070590 msgr2=0x7f14fc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 shutdown_connections 2024-02-22T00:47:15.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.176+0000 7f15009fc700 1 -- 172.21.15.49:0/2619634428 wait complete. 2024-02-22T00:47:15.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.278+0000 7f8ffa506700 1 -- 172.21.15.49:0/2543299511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fd150 msgr2=0x7f8ff40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.278+0000 7f8ffa506700 1 --2- 172.21.15.49:0/2543299511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fd150 0x7f8ff40f6930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f8fe80047f0 tx=0x7f8fe8009cb0).stop 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.278+0000 7f8ffa506700 1 -- 172.21.15.49:0/2543299511 shutdown_connections 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.278+0000 7f8ffa506700 1 --2- 172.21.15.49:0/2543299511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fd150 0x7f8ff40f6930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.278+0000 7f8ffa506700 1 --2- 172.21.15.49:0/2543299511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ff40fc7f0 0x7f8ff40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.278+0000 7f8ffa506700 1 -- 172.21.15.49:0/2543299511 >> 172.21.15.49:0/2543299511 conn(0x7f8ff4070590 msgr2=0x7f8ff40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.278+0000 7f8ffa506700 1 -- 172.21.15.49:0/2543299511 shutdown_connections 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.278+0000 7f8ffa506700 1 -- 172.21.15.49:0/2543299511 wait complete. 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ffa506700 1 Processor -- start 2024-02-22T00:47:15.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ffa506700 1 -- start start 2024-02-22T00:47:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ffa506700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fc7f0 0x7f8ff410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ffa506700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ff40fd150 0x7f8ff410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ffa506700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff410ebe0 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ffa506700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff4108200 con 0x7f8ff40fd150 2024-02-22T00:47:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ff3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fc7f0 0x7f8ff410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ff3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fc7f0 0x7f8ff410e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36744/0 (socket says 172.21.15.49:36744) 2024-02-22T00:47:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ff3fff700 1 -- 172.21.15.49:0/1866487443 learned_addr learned my addr 172.21.15.49:0/1866487443 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ff3fff700 1 -- 172.21.15.49:0/1866487443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ff40fd150 msgr2=0x7f8ff410e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.279+0000 7f8ff3fff700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ff40fd150 0x7f8ff410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.280+0000 7f8ff3fff700 1 -- 172.21.15.49:0/1866487443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8005040 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.280+0000 7f8ff3fff700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fc7f0 0x7f8ff410e060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f8fe400b4b0 tx=0x7f8fe40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.280+0000 7f8ff17fa700 1 -- 172.21.15.49:0/1866487443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe4002500 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.280+0000 7f8ff17fa700 1 -- 172.21.15.49:0/1866487443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8fe4002b10 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.280+0000 7f8ff17fa700 1 -- 172.21.15.49:0/1866487443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe4012cf0 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.280+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff41084b0 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.280+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff41089f0 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.281+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff405f590 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.282+0000 7f8ff17fa700 1 -- 172.21.15.49:0/1866487443 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8fe4002660 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.282+0000 7f8ff17fa700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fdc06caa0 0x7f8fdc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.282+0000 7f8ff17fa700 1 -- 172.21.15.49:0/1866487443 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8fe408c1e0 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.283+0000 7f8ff37fe700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fdc06caa0 0x7f8fdc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.283+0000 7f8ff37fe700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fdc06caa0 0x7f8fdc06ef60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f8ff41099a0 tx=0x7f8fe8009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:15.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.286+0000 7f8ff17fa700 1 -- 172.21.15.49:0/1866487443 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8fe4059dc0 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:15 smithi049 ceph-mon[132694]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:15.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:15 smithi049 ceph-mon[132694]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:15.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:15 smithi049 ceph-mon[132694]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:15.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:15 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1829600109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:47:15.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:15 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2869686520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:47:15.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:15 smithi161 ceph-mon[113442]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:15.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:15 smithi161 ceph-mon[113442]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:15.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:15 smithi161 ceph-mon[113442]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:15.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:15 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1829600109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:47:15.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:15 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2869686520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:47:15.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.566+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8ff41090e0 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.566+0000 7f8ff17fa700 1 -- 172.21.15.49:0/1866487443 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f8fe4059950 con 0x7f8ff40fc7f0 2024-02-22T00:47:15.568 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:47:15.568 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:47:15.568 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:47:15.568 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:47:15.568 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:47:15.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fdc06caa0 msgr2=0x7f8fdc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:15.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fdc06caa0 0x7f8fdc06ef60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f8ff41099a0 tx=0x7f8fe8009cb0).stop 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fc7f0 msgr2=0x7f8ff410e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fc7f0 0x7f8ff410e060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f8fe400b4b0 tx=0x7f8fe40090f0).stop 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 shutdown_connections 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8fdc06caa0 0x7f8fdc06ef60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ff40fc7f0 0x7f8ff410e060 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 --2- 172.21.15.49:0/1866487443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ff40fd150 0x7f8ff410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.568+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 >> 172.21.15.49:0/1866487443 conn(0x7f8ff4070590 msgr2=0x7f8ff4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.569+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 shutdown_connections 2024-02-22T00:47:15.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:15.569+0000 7f8ffa506700 1 -- 172.21.15.49:0/1866487443 wait complete. 2024-02-22T00:47:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:16 smithi049 ceph-mon[132694]: pgmap v310: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:16 smithi049 ceph-mon[132694]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:16 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1866487443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:47:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:16 smithi161 ceph-mon[113442]: pgmap v310: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:16 smithi161 ceph-mon[113442]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:16 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1866487443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:47:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:18 smithi049 ceph-mon[132694]: pgmap v311: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:18 smithi161 ceph-mon[113442]: pgmap v311: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:20 smithi049 ceph-mon[132694]: pgmap v312: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:20 smithi161 ceph-mon[113442]: pgmap v312: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:22 smithi049 ceph-mon[132694]: pgmap v313: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:22 smithi161 ceph-mon[113442]: pgmap v313: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:24 smithi049 ceph-mon[132694]: pgmap v314: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:24 smithi161 ceph-mon[113442]: pgmap v314: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:26 smithi049 ceph-mon[132694]: pgmap v315: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:26 smithi161 ceph-mon[113442]: pgmap v315: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:28 smithi049 ceph-mon[132694]: pgmap v316: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:47:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:28 smithi161 ceph-mon[113442]: pgmap v316: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:47:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:30 smithi049 ceph-mon[132694]: pgmap v317: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:30 smithi161 ceph-mon[113442]: pgmap v317: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:32 smithi049 ceph-mon[132694]: pgmap v318: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:32 smithi161 ceph-mon[113442]: pgmap v318: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:34 smithi049 ceph-mon[132694]: pgmap v319: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:34 smithi161 ceph-mon[113442]: pgmap v319: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:36.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:36 smithi049 ceph-mon[132694]: pgmap v320: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:36 smithi161 ceph-mon[113442]: pgmap v320: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:38 smithi049 ceph-mon[132694]: pgmap v321: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:38 smithi161 ceph-mon[113442]: pgmap v321: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:40 smithi049 ceph-mon[132694]: pgmap v322: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:40 smithi161 ceph-mon[113442]: pgmap v322: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:42 smithi049 ceph-mon[132694]: pgmap v323: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:42 smithi161 ceph-mon[113442]: pgmap v323: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:47:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:47:44.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:44 smithi049 ceph-mon[132694]: pgmap v324: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:44 smithi161 ceph-mon[113442]: pgmap v324: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.683+0000 7f95a8df8700 1 -- 172.21.15.49:0/922209253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 msgr2=0x7f95a40fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.683+0000 7f95a8df8700 1 --2- 172.21.15.49:0/922209253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 0x7f95a40fdcd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f95940047f0 tx=0x7f9594009cb0).stop 2024-02-22T00:47:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.683+0000 7f95a8df8700 1 -- 172.21.15.49:0/922209253 shutdown_connections 2024-02-22T00:47:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.683+0000 7f95a8df8700 1 --2- 172.21.15.49:0/922209253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95a40fe250 0x7f95a40f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.683+0000 7f95a8df8700 1 --2- 172.21.15.49:0/922209253 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 0x7f95a40fdcd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.683+0000 7f95a8df8700 1 -- 172.21.15.49:0/922209253 >> 172.21.15.49:0/922209253 conn(0x7f95a40f34b0 msgr2=0x7f95a40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.683+0000 7f95a8df8700 1 -- 172.21.15.49:0/922209253 shutdown_connections 2024-02-22T00:47:45.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.683+0000 7f95a8df8700 1 -- 172.21.15.49:0/922209253 wait complete. 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.684+0000 7f95a8df8700 1 Processor -- start 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.684+0000 7f95a8df8700 1 -- start start 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.684+0000 7f95a8df8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 0x7f95a406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.684+0000 7f95a8df8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95a40fe250 0x7f95a406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.684+0000 7f95a8df8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a406bab0 con 0x7f95a40fd8f0 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.684+0000 7f95a8df8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a406bbf0 con 0x7f95a40fe250 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.684+0000 7f95a259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 0x7f95a406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 0x7f95a406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42174/0 (socket says 172.21.15.49:42174) 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a259c700 1 -- 172.21.15.49:0/356120230 learned_addr learned my addr 172.21.15.49:0/356120230 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:45.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a1d9b700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95a40fe250 0x7f95a406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a259c700 1 -- 172.21.15.49:0/356120230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95a40fe250 msgr2=0x7f95a406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a259c700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95a40fe250 0x7f95a406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a259c700 1 -- 172.21.15.49:0/356120230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9594005040 con 0x7f95a40fd8f0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a259c700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 0x7f95a406b0d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f959400b120 tx=0x7f9594009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f959b7fe700 1 -- 172.21.15.49:0/356120230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959400e030 con 0x7f95a40fd8f0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f959b7fe700 1 -- 172.21.15.49:0/356120230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9594007e90 con 0x7f95a40fd8f0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a406be40 con 0x7f95a40fd8f0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f959b7fe700 1 -- 172.21.15.49:0/356120230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9594018070 con 0x7f95a40fd8f0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.685+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a41145f0 con 0x7f95a40fd8f0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.686+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a405f590 con 0x7f95a40fd8f0 2024-02-22T00:47:45.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.687+0000 7f959b7fe700 1 -- 172.21.15.49:0/356120230 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f959401d420 con 0x7f95a40fd8f0 2024-02-22T00:47:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.687+0000 7f959b7fe700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f959006caa0 0x7f959006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.688+0000 7f95a1d9b700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f959006caa0 0x7f959006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.688+0000 7f959b7fe700 1 -- 172.21.15.49:0/356120230 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f959408d1a0 con 0x7f95a40fd8f0 2024-02-22T00:47:45.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.688+0000 7f95a1d9b700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f959006caa0 0x7f959006ef60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f95a406c870 tx=0x7f958c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:45.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.692+0000 7f959b7fe700 1 -- 172.21.15.49:0/356120230 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9594057270 con 0x7f95a40fd8f0 2024-02-22T00:47:45.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.909+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95a4059120 con 0x7f959006caa0 2024-02-22T00:47:45.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.910+0000 7f959b7fe700 1 -- 172.21.15.49:0/356120230 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f95a4059120 con 0x7f959006caa0 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f959006caa0 msgr2=0x7f959006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f959006caa0 0x7f959006ef60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f95a406c870 tx=0x7f958c009040).stop 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 msgr2=0x7f95a406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 0x7f95a406b0d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f959400b120 tx=0x7f9594009cb0).stop 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 shutdown_connections 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f959006caa0 0x7f959006ef60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95a40fd8f0 0x7f95a406b0d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 --2- 172.21.15.49:0/356120230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95a40fe250 0x7f95a406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:45.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 >> 172.21.15.49:0/356120230 conn(0x7f95a40f34b0 msgr2=0x7f95a40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:45.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 shutdown_connections 2024-02-22T00:47:45.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:45.913+0000 7f95a8df8700 1 -- 172.21.15.49:0/356120230 wait complete. 2024-02-22T00:47:45.925 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:47:46.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 -- 172.21.15.49:0/125906233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fd150 msgr2=0x7fc8980f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 --2- 172.21.15.49:0/125906233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fd150 0x7fc8980f6930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fc8840047f0 tx=0x7fc884009cb0).stop 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 -- 172.21.15.49:0/125906233 shutdown_connections 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 --2- 172.21.15.49:0/125906233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fd150 0x7fc8980f6930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 --2- 172.21.15.49:0/125906233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8980fc7f0 0x7fc8980fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 -- 172.21.15.49:0/125906233 >> 172.21.15.49:0/125906233 conn(0x7fc898070590 msgr2=0x7fc8980f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 -- 172.21.15.49:0/125906233 shutdown_connections 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 -- 172.21.15.49:0/125906233 wait complete. 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.016+0000 7fc89f15c700 1 Processor -- start 2024-02-22T00:47:46.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89f15c700 1 -- start start 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89f15c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fc7f0 0x7fc8980f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89f15c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8980fd150 0x7fc8980f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89f15c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980f8f20 con 0x7fc8980fc7f0 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89f15c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980f9060 con 0x7fc8980fd150 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89cef8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fc7f0 0x7fc8980f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89cef8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fc7f0 0x7fc8980f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42198/0 (socket says 172.21.15.49:42198) 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89cef8700 1 -- 172.21.15.49:0/4287929140 learned_addr learned my addr 172.21.15.49:0/4287929140 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc897fff700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8980fd150 0x7fc8980f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89cef8700 1 -- 172.21.15.49:0/4287929140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8980fd150 msgr2=0x7fc8980f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89cef8700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8980fd150 0x7fc8980f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89cef8700 1 -- 172.21.15.49:0/4287929140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc884005040 con 0x7fc8980fc7f0 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc89cef8700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fc7f0 0x7fc8980f8540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fc88c0041d0 tx=0x7fc88c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.017+0000 7fc895ffb700 1 -- 172.21.15.49:0/4287929140 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc88c007b40 con 0x7fc8980fc7f0 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.018+0000 7fc895ffb700 1 -- 172.21.15.49:0/4287929140 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc88c00f040 con 0x7fc8980fc7f0 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.018+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8980f9310 con 0x7fc8980fc7f0 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.018+0000 7fc895ffb700 1 -- 172.21.15.49:0/4287929140 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc88c0137d0 con 0x7fc8980fc7f0 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.018+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8981146c0 con 0x7fc8980fc7f0 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.019+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89805f590 con 0x7fc8980fc7f0 2024-02-22T00:47:46.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.019+0000 7fc895ffb700 1 -- 172.21.15.49:0/4287929140 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc88c007ca0 con 0x7fc8980fc7f0 2024-02-22T00:47:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.019+0000 7fc895ffb700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc88806caa0 0x7fc88806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.020+0000 7fc895ffb700 1 -- 172.21.15.49:0/4287929140 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc88c08b7b0 con 0x7fc8980fc7f0 2024-02-22T00:47:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.020+0000 7fc897fff700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc88806caa0 0x7fc88806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.020+0000 7fc897fff700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc88806caa0 0x7fc88806ef60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fc8980f9ce0 tx=0x7fc88400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:46.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.024+0000 7fc895ffb700 1 -- 172.21.15.49:0/4287929140 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc88c055880 con 0x7fc8980fc7f0 2024-02-22T00:47:46.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.248+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8980fb5a0 con 0x7fc88806caa0 2024-02-22T00:47:46.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.249+0000 7fc895ffb700 1 -- 172.21.15.49:0/4287929140 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc8980fb5a0 con 0x7fc88806caa0 2024-02-22T00:47:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.251+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc88806caa0 msgr2=0x7fc88806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.251+0000 7fc89f15c700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc88806caa0 0x7fc88806ef60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fc8980f9ce0 tx=0x7fc88400b040).stop 2024-02-22T00:47:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.251+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fc7f0 msgr2=0x7fc8980f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.251+0000 7fc89f15c700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fc7f0 0x7fc8980f8540 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fc88c0041d0 tx=0x7fc88c009f60).stop 2024-02-22T00:47:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.252+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 shutdown_connections 2024-02-22T00:47:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.252+0000 7fc89f15c700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc88806caa0 0x7fc88806ef60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.252+0000 7fc89f15c700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc8980fc7f0 0x7fc8980f8540 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.252+0000 7fc89f15c700 1 --2- 172.21.15.49:0/4287929140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8980fd150 0x7fc8980f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.252+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 >> 172.21.15.49:0/4287929140 conn(0x7fc898070590 msgr2=0x7fc898060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.252+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 shutdown_connections 2024-02-22T00:47:46.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.252+0000 7fc89f15c700 1 -- 172.21.15.49:0/4287929140 wait complete. 2024-02-22T00:47:46.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.353+0000 7efc4c158700 1 -- 172.21.15.49:0/1045092362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 msgr2=0x7efc440f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.353+0000 7efc4c158700 1 --2- 172.21.15.49:0/1045092362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 0x7efc440f6930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7efc380047f0 tx=0x7efc38009cb0).stop 2024-02-22T00:47:46.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.353+0000 7efc4c158700 1 -- 172.21.15.49:0/1045092362 shutdown_connections 2024-02-22T00:47:46.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.353+0000 7efc4c158700 1 --2- 172.21.15.49:0/1045092362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 0x7efc440f6930 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.353+0000 7efc4c158700 1 --2- 172.21.15.49:0/1045092362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc440fc7f0 0x7efc440fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.353+0000 7efc4c158700 1 -- 172.21.15.49:0/1045092362 >> 172.21.15.49:0/1045092362 conn(0x7efc44070590 msgr2=0x7efc440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:46.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.353+0000 7efc4c158700 1 -- 172.21.15.49:0/1045092362 shutdown_connections 2024-02-22T00:47:46.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.353+0000 7efc4c158700 1 -- 172.21.15.49:0/1045092362 wait complete. 2024-02-22T00:47:46.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc4c158700 1 Processor -- start 2024-02-22T00:47:46.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc4c158700 1 -- start start 2024-02-22T00:47:46.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc4c158700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc440fc7f0 0x7efc4410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc4c158700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 0x7efc4410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc4c158700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4410eab0 con 0x7efc440fd150 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc4c158700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4410ebf0 con 0x7efc440fc7f0 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc496f3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 0x7efc4410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc496f3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 0x7efc4410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42212/0 (socket says 172.21.15.49:42212) 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc496f3700 1 -- 172.21.15.49:0/192648851 learned_addr learned my addr 172.21.15.49:0/192648851 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc49ef4700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc440fc7f0 0x7efc4410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc496f3700 1 -- 172.21.15.49:0/192648851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc440fc7f0 msgr2=0x7efc4410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc496f3700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc440fc7f0 0x7efc4410dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc496f3700 1 -- 172.21.15.49:0/192648851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc38005040 con 0x7efc440fd150 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.354+0000 7efc496f3700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 0x7efc4410e4b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7efc38000c00 tx=0x7efc38009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.355+0000 7efc36ffd700 1 -- 172.21.15.49:0/192648851 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc3800e030 con 0x7efc440fd150 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.355+0000 7efc36ffd700 1 -- 172.21.15.49:0/192648851 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc38007e90 con 0x7efc440fd150 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.355+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc44108220 con 0x7efc440fd150 2024-02-22T00:47:46.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.355+0000 7efc36ffd700 1 -- 172.21.15.49:0/192648851 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc38018070 con 0x7efc440fd150 2024-02-22T00:47:46.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.355+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc44108780 con 0x7efc440fd150 2024-02-22T00:47:46.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.356+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4405f590 con 0x7efc440fd150 2024-02-22T00:47:46.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.356+0000 7efc36ffd700 1 -- 172.21.15.49:0/192648851 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efc3801d420 con 0x7efc440fd150 2024-02-22T00:47:46.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.357+0000 7efc36ffd700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc3006cab0 0x7efc3006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.357+0000 7efc36ffd700 1 -- 172.21.15.49:0/192648851 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7efc3808d270 con 0x7efc440fd150 2024-02-22T00:47:46.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.357+0000 7efc49ef4700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc3006cab0 0x7efc3006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.357+0000 7efc49ef4700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc3006cab0 0x7efc3006ef70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7efc400041d0 tx=0x7efc40009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:46.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.361+0000 7efc36ffd700 1 -- 172.21.15.49:0/192648851 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efc3805ae90 con 0x7efc440fd150 2024-02-22T00:47:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:46 smithi049 ceph-mon[132694]: pgmap v325: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:46 smithi161 ceph-mon[113442]: pgmap v325: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:46.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.567+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efc44108dc0 con 0x7efc3006cab0 2024-02-22T00:47:46.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.576+0000 7efc36ffd700 1 -- 172.21.15.49:0/192648851 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7efc44108dc0 con 0x7efc3006cab0 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (10m) 4m ago 22m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (8m) 4m ago 22m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (8m) 4m ago 21m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (10m) 4m ago 21m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (4m) 4m ago 16m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (5m) 4m ago 17m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (4m) 4m ago 16m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (4m) 4m ago 17m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (12m) 4m ago 23m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (11m) 4m ago 21m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:47:46.579 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (9m) 4m ago 23m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (9m) 4m ago 21m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (11m) 4m ago 21m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (11m) 4m ago 21m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (8m) 4m ago 20m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (7m) 4m ago 20m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (7m) 4m ago 19m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (6m) 4m ago 19m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (6m) 4m ago 19m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (5m) 4m ago 18m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:47:46.580 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (11m) 4m ago 21m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:47:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.578+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc3006cab0 msgr2=0x7efc3006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.578+0000 7efc4c158700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc3006cab0 0x7efc3006ef70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7efc400041d0 tx=0x7efc40009040).stop 2024-02-22T00:47:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.578+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 msgr2=0x7efc4410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.578+0000 7efc4c158700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 0x7efc4410e4b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7efc38000c00 tx=0x7efc38009cb0).stop 2024-02-22T00:47:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.579+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 shutdown_connections 2024-02-22T00:47:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.579+0000 7efc4c158700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc3006cab0 0x7efc3006ef70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.579+0000 7efc4c158700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc440fc7f0 0x7efc4410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.579+0000 7efc4c158700 1 --2- 172.21.15.49:0/192648851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc440fd150 0x7efc4410e4b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.579+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 >> 172.21.15.49:0/192648851 conn(0x7efc44070590 msgr2=0x7efc44060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:46.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.579+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 shutdown_connections 2024-02-22T00:47:46.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.579+0000 7efc4c158700 1 -- 172.21.15.49:0/192648851 wait complete. 2024-02-22T00:47:46.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.679+0000 7f89128b6700 1 -- 172.21.15.49:0/320432645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 msgr2=0x7f890c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.679+0000 7f89128b6700 1 --2- 172.21.15.49:0/320432645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 0x7f890c0fcbd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f88fc0047f0 tx=0x7f88fc009cb0).stop 2024-02-22T00:47:46.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.679+0000 7f89128b6700 1 -- 172.21.15.49:0/320432645 shutdown_connections 2024-02-22T00:47:46.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.679+0000 7f89128b6700 1 --2- 172.21.15.49:0/320432645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0fd150 0x7f890c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.679+0000 7f89128b6700 1 --2- 172.21.15.49:0/320432645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 0x7f890c0fcbd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.679+0000 7f89128b6700 1 -- 172.21.15.49:0/320432645 >> 172.21.15.49:0/320432645 conn(0x7f890c070590 msgr2=0x7f890c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:46.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.679+0000 7f89128b6700 1 -- 172.21.15.49:0/320432645 shutdown_connections 2024-02-22T00:47:46.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.679+0000 7f89128b6700 1 -- 172.21.15.49:0/320432645 wait complete. 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.680+0000 7f89128b6700 1 Processor -- start 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.680+0000 7f89128b6700 1 -- start start 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.680+0000 7f89128b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 0x7f890c1090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.680+0000 7f89128b6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0fd150 0x7f890c1095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f89128b6700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c109ab0 con 0x7f890c0fc7f0 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f89128b6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c109bf0 con 0x7f890c0fd150 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f890bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 0x7f890c1090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f890bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 0x7f890c1090d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42230/0 (socket says 172.21.15.49:42230) 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f890bfff700 1 -- 172.21.15.49:0/695685233 learned_addr learned my addr 172.21.15.49:0/695685233 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f890b7fe700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0fd150 0x7f890c1095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f890bfff700 1 -- 172.21.15.49:0/695685233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0fd150 msgr2=0x7f890c1095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f890bfff700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0fd150 0x7f890c1095c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f890bfff700 1 -- 172.21.15.49:0/695685233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc005040 con 0x7f890c0fc7f0 2024-02-22T00:47:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f890bfff700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 0x7f890c1090d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f88fc005010 tx=0x7f88fc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f89097fa700 1 -- 172.21.15.49:0/695685233 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88fc00e030 con 0x7f890c0fc7f0 2024-02-22T00:47:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f89097fa700 1 -- 172.21.15.49:0/695685233 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88fc007e90 con 0x7f890c0fc7f0 2024-02-22T00:47:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890c109e40 con 0x7f890c0fc7f0 2024-02-22T00:47:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f89097fa700 1 -- 172.21.15.49:0/695685233 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88fc018070 con 0x7f890c0fc7f0 2024-02-22T00:47:46.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.681+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c112430 con 0x7f890c0fc7f0 2024-02-22T00:47:46.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.682+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890c05f590 con 0x7f890c0fc7f0 2024-02-22T00:47:46.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.683+0000 7f89097fa700 1 -- 172.21.15.49:0/695685233 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f88fc01d670 con 0x7f890c0fc7f0 2024-02-22T00:47:46.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.683+0000 7f89097fa700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88f406caa0 0x7f88f406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:46.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.683+0000 7f89097fa700 1 -- 172.21.15.49:0/695685233 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f88fc08d0a0 con 0x7f890c0fc7f0 2024-02-22T00:47:46.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.683+0000 7f890b7fe700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88f406caa0 0x7f88f406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:46.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.684+0000 7f890b7fe700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88f406caa0 0x7f88f406ef60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f890c060f00 tx=0x7f890000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:46.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.688+0000 7f89097fa700 1 -- 172.21.15.49:0/695685233 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f88fc057170 con 0x7f890c0fc7f0 2024-02-22T00:47:46.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.969+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f890c047540 con 0x7f890c0fc7f0 2024-02-22T00:47:46.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.969+0000 7f89097fa700 1 -- 172.21.15.49:0/695685233 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f88fc05a790 con 0x7f890c0fc7f0 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:47:46.972 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:47:46.973 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:47:46.973 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:47:46.973 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:47:46.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88f406caa0 msgr2=0x7f88f406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88f406caa0 0x7f88f406ef60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f890c060f00 tx=0x7f890000b040).stop 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 msgr2=0x7f890c1090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 0x7f890c1090d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f88fc005010 tx=0x7f88fc009cb0).stop 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 shutdown_connections 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f88f406caa0 0x7f88f406ef60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f890c0fc7f0 0x7f890c1090d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 --2- 172.21.15.49:0/695685233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0fd150 0x7f890c1095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.971+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 >> 172.21.15.49:0/695685233 conn(0x7f890c070590 msgr2=0x7f890c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.972+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 shutdown_connections 2024-02-22T00:47:46.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:46.972+0000 7f89128b6700 1 -- 172.21.15.49:0/695685233 wait complete. 2024-02-22T00:47:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1363677829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f66f0 msgr2=0x7fdca80f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 --2- 172.21.15.49:0/1363677829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f66f0 0x7fdca80f6ad0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fdca40047f0 tx=0x7fdca4009cb0).stop 2024-02-22T00:47:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1363677829 shutdown_connections 2024-02-22T00:47:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 --2- 172.21.15.49:0/1363677829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdca80f6fc0 0x7fdca8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 --2- 172.21.15.49:0/1363677829 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f66f0 0x7fdca80f6ad0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1363677829 >> 172.21.15.49:0/1363677829 conn(0x7fdca80f23b0 msgr2=0x7fdca80f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1363677829 shutdown_connections 2024-02-22T00:47:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1363677829 wait complete. 2024-02-22T00:47:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 Processor -- start 2024-02-22T00:47:47.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.074+0000 7fdcb06d2700 1 -- start start 2024-02-22T00:47:47.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcb06d2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdca80f66f0 0x7fdca81102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcb06d2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f6fc0 0x7fdca81107a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcb06d2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8110da0 con 0x7fdca80f6fc0 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcb06d2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8110ee0 con 0x7fdca80f66f0 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcadc6d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f6fc0 0x7fdca81107a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcadc6d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f6fc0 0x7fdca81107a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42236/0 (socket says 172.21.15.49:42236) 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcadc6d700 1 -- 172.21.15.49:0/1708785402 learned_addr learned my addr 172.21.15.49:0/1708785402 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcae46e700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdca80f66f0 0x7fdca81102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcadc6d700 1 -- 172.21.15.49:0/1708785402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdca80f66f0 msgr2=0x7fdca81102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcadc6d700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdca80f66f0 0x7fdca81102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcadc6d700 1 -- 172.21.15.49:0/1708785402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4005040 con 0x7fdca80f6fc0 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcadc6d700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f6fc0 0x7fdca81107a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fdc980041d0 tx=0x7fdc98009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdc9f7fe700 1 -- 172.21.15.49:0/1708785402 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc98007b40 con 0x7fdca80f6fc0 2024-02-22T00:47:47.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca810a570 con 0x7fdca80f6fc0 2024-02-22T00:47:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdc9f7fe700 1 -- 172.21.15.49:0/1708785402 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc9800f040 con 0x7fdca80f6fc0 2024-02-22T00:47:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdc9f7fe700 1 -- 172.21.15.49:0/1708785402 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc980137d0 con 0x7fdca80f6fc0 2024-02-22T00:47:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.075+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca810aab0 con 0x7fdca80f6fc0 2024-02-22T00:47:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.076+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca8060390 con 0x7fdca80f6fc0 2024-02-22T00:47:47.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.077+0000 7fdc9f7fe700 1 -- 172.21.15.49:0/1708785402 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdc98007ca0 con 0x7fdca80f6fc0 2024-02-22T00:47:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.077+0000 7fdc9f7fe700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc9406caa0 0x7fdc9406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.077+0000 7fdc9f7fe700 1 -- 172.21.15.49:0/1708785402 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdc9808b7b0 con 0x7fdca80f6fc0 2024-02-22T00:47:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.077+0000 7fdcae46e700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc9406caa0 0x7fdc9406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.078+0000 7fdcae46e700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc9406caa0 0x7fdc9406ef60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdca4004f10 tx=0x7fdca400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:47.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.082+0000 7fdc9f7fe700 1 -- 172.21.15.49:0/1708785402 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdc98059310 con 0x7fdca80f6fc0 2024-02-22T00:47:47.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.322+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdca810ba00 con 0x7fdca80f6fc0 2024-02-22T00:47:47.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.323+0000 7fdc9f7fe700 1 -- 172.21.15.49:0/1708785402 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fdc98058ea0 con 0x7fdca80f6fc0 2024-02-22T00:47:47.325 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:47:47.325 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:47:47.325 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:47:47.325 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:47:47.325 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:47:47.325 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:47:47.326 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:47:47.327 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:47:47.328 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:47:47.328 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:47:47.328 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:47:47.328 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:47:47.328 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc9406caa0 msgr2=0x7fdc9406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc9406caa0 0x7fdc9406ef60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdca4004f10 tx=0x7fdca400b040).stop 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f6fc0 msgr2=0x7fdca81107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f6fc0 0x7fdca81107a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fdc980041d0 tx=0x7fdc98009f60).stop 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 shutdown_connections 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdc9406caa0 0x7fdc9406ef60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdca80f66f0 0x7fdca81102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 --2- 172.21.15.49:0/1708785402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdca80f6fc0 0x7fdca81107a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 >> 172.21.15.49:0/1708785402 conn(0x7fdca80f23b0 msgr2=0x7fdca80f40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 shutdown_connections 2024-02-22T00:47:47.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.325+0000 7fdcb06d2700 1 -- 172.21.15.49:0/1708785402 wait complete. 2024-02-22T00:47:47.330 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:47:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:47 smithi049 ceph-mon[132694]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:47 smithi049 ceph-mon[132694]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:47.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:47 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/695685233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:47:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.427+0000 7f1c55f0d700 1 -- 172.21.15.49:0/368139793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 msgr2=0x7f1c500f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.427+0000 7f1c55f0d700 1 --2- 172.21.15.49:0/368139793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 0x7f1c500f8c80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f1c400047f0 tx=0x7f1c40009cb0).stop 2024-02-22T00:47:47.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.427+0000 7f1c55f0d700 1 -- 172.21.15.49:0/368139793 shutdown_connections 2024-02-22T00:47:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.427+0000 7f1c55f0d700 1 --2- 172.21.15.49:0/368139793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c500f9200 0x7f1c50101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:47:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.427+0000 7f1c55f0d700 1 --2- 172.21.15.49:0/368139793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 0x7f1c500f8c80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.427+0000 7f1c55f0d700 1 -- 172.21.15.49:0/368139793 >> 172.21.15.49:0/368139793 conn(0x7f1c50070590 msgr2=0x7f1c500f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.427+0000 7f1c55f0d700 1 -- 172.21.15.49:0/368139793 shutdown_connections 2024-02-22T00:47:47.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.427+0000 7f1c55f0d700 1 -- 172.21.15.49:0/368139793 wait complete. 2024-02-22T00:47:47.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.428+0000 7f1c55f0d700 1 Processor -- start 2024-02-22T00:47:47.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.428+0000 7f1c55f0d700 1 -- start start 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.428+0000 7f1c55f0d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 0x7f1c500f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.428+0000 7f1c55f0d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c500f9200 0x7f1c500f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.428+0000 7f1c55f0d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500f7230 con 0x7f1c500f88a0 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.428+0000 7f1c55f0d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500f7370 con 0x7f1c500f9200 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 0x7f1c500f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 0x7f1c500f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42256/0 (socket says 172.21.15.49:42256) 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4f7fe700 1 -- 172.21.15.49:0/744155959 learned_addr learned my addr 172.21.15.49:0/744155959 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4effd700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c500f9200 0x7f1c500f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4f7fe700 1 -- 172.21.15.49:0/744155959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c500f9200 msgr2=0x7f1c500f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4f7fe700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c500f9200 0x7f1c500f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4f7fe700 1 -- 172.21.15.49:0/744155959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c40005040 con 0x7f1c500f88a0 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4f7fe700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 0x7f1c500f6850 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f1c4000b120 tx=0x7f1c40009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:47.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4cff9700 1 -- 172.21.15.49:0/744155959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4000e030 con 0x7f1c500f88a0 2024-02-22T00:47:47.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c500f75c0 con 0x7f1c500f88a0 2024-02-22T00:47:47.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4cff9700 1 -- 172.21.15.49:0/744155959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c40007e90 con 0x7f1c500f88a0 2024-02-22T00:47:47.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c4cff9700 1 -- 172.21.15.49:0/744155959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c40018070 con 0x7f1c500f88a0 2024-02-22T00:47:47.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.429+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c50114740 con 0x7f1c500f88a0 2024-02-22T00:47:47.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.430+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5005f590 con 0x7f1c500f88a0 2024-02-22T00:47:47.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.431+0000 7f1c4cff9700 1 -- 172.21.15.49:0/744155959 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1c4001d420 con 0x7f1c500f88a0 2024-02-22T00:47:47.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.431+0000 7f1c4cff9700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1c3806caa0 0x7f1c3806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.431+0000 7f1c4cff9700 1 -- 172.21.15.49:0/744155959 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1c4008d110 con 0x7f1c500f88a0 2024-02-22T00:47:47.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.431+0000 7f1c4effd700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1c3806caa0 0x7f1c3806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.432+0000 7f1c4effd700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1c3806caa0 0x7f1c3806ef60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f1c500f7ff0 tx=0x7f1c44009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:47.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.436+0000 7f1c4cff9700 1 -- 172.21.15.49:0/744155959 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1c400571e0 con 0x7f1c500f88a0 2024-02-22T00:47:47.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:47 smithi161 ceph-mon[113442]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:47.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:47 smithi161 ceph-mon[113442]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:47.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:47 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/695685233' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:47:47.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.655+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c50059120 con 0x7f1c3806caa0 2024-02-22T00:47:47.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.656+0000 7f1c4cff9700 1 -- 172.21.15.49:0/744155959 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1c50059120 con 0x7f1c3806caa0 2024-02-22T00:47:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:47:47.658 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:47:47.658 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:47:47.658 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:47:47.658 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:47:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:47:47.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1c3806caa0 msgr2=0x7f1c3806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1c3806caa0 0x7f1c3806ef60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f1c500f7ff0 tx=0x7f1c44009060).stop 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 msgr2=0x7f1c500f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 0x7f1c500f6850 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f1c4000b120 tx=0x7f1c40009cb0).stop 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 shutdown_connections 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1c3806caa0 0x7f1c3806ef60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c500f88a0 0x7f1c500f6850 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 --2- 172.21.15.49:0/744155959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c500f9200 0x7f1c500f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 >> 172.21.15.49:0/744155959 conn(0x7f1c50070590 msgr2=0x7f1c501001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 shutdown_connections 2024-02-22T00:47:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.658+0000 7f1c55f0d700 1 -- 172.21.15.49:0/744155959 wait complete. 2024-02-22T00:47:47.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 -- 172.21.15.49:0/2635649252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 msgr2=0x7fed140fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 --2- 172.21.15.49:0/2635649252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 0x7fed140fcbd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fed040047f0 tx=0x7fed04009cb0).stop 2024-02-22T00:47:47.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 -- 172.21.15.49:0/2635649252 shutdown_connections 2024-02-22T00:47:47.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 --2- 172.21.15.49:0/2635649252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140fd150 0x7fed140f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 --2- 172.21.15.49:0/2635649252 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 0x7fed140fcbd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 -- 172.21.15.49:0/2635649252 >> 172.21.15.49:0/2635649252 conn(0x7fed14070590 msgr2=0x7fed140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:47.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 -- 172.21.15.49:0/2635649252 shutdown_connections 2024-02-22T00:47:47.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 -- 172.21.15.49:0/2635649252 wait complete. 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.760+0000 7fed1b39e700 1 Processor -- start 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1b39e700 1 -- start start 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1b39e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 0x7fed140f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1b39e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140fd150 0x7fed140f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1b39e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140f9740 con 0x7fed140fc7f0 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1b39e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140f9880 con 0x7fed140fd150 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1913a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 0x7fed140f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1913a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 0x7fed140f8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42278/0 (socket says 172.21.15.49:42278) 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1913a700 1 -- 172.21.15.49:0/2016271936 learned_addr learned my addr 172.21.15.49:0/2016271936 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed18939700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140fd150 0x7fed140f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1913a700 1 -- 172.21.15.49:0/2016271936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140fd150 msgr2=0x7fed140f9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:47.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1913a700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140fd150 0x7fed140f9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:47.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1913a700 1 -- 172.21.15.49:0/2016271936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04005040 con 0x7fed140fc7f0 2024-02-22T00:47:47.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed1913a700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 0x7fed140f8d60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fed04013640 tx=0x7fed04009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:47.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.761+0000 7fed0a7fc700 1 -- 172.21.15.49:0/2016271936 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed0400e030 con 0x7fed140fc7f0 2024-02-22T00:47:47.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.762+0000 7fed0a7fc700 1 -- 172.21.15.49:0/2016271936 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fed04007e90 con 0x7fed140fc7f0 2024-02-22T00:47:47.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.762+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed140f9ad0 con 0x7fed140fc7f0 2024-02-22T00:47:47.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.762+0000 7fed0a7fc700 1 -- 172.21.15.49:0/2016271936 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed04018070 con 0x7fed140fc7f0 2024-02-22T00:47:47.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.762+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed14114600 con 0x7fed140fc7f0 2024-02-22T00:47:47.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.762+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1405f590 con 0x7fed140fc7f0 2024-02-22T00:47:47.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.763+0000 7fed0a7fc700 1 -- 172.21.15.49:0/2016271936 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fed0401d420 con 0x7fed140fc7f0 2024-02-22T00:47:47.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.763+0000 7fed0a7fc700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed0006cab0 0x7fed0006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:47:47.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.763+0000 7fed0a7fc700 1 -- 172.21.15.49:0/2016271936 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fed0408d270 con 0x7fed140fc7f0 2024-02-22T00:47:47.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.764+0000 7fed18939700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed0006cab0 0x7fed0006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:47:47.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.764+0000 7fed18939700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed0006cab0 0x7fed0006ef70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fed140fa500 tx=0x7fed10009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:47:47.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:47.768+0000 7fed0a7fc700 1 -- 172.21.15.49:0/2016271936 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fed04057340 con 0x7fed140fc7f0 2024-02-22T00:47:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.046+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fed14047540 con 0x7fed140fc7f0 2024-02-22T00:47:48.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.046+0000 7fed0a7fc700 1 -- 172.21.15.49:0/2016271936 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fed0405a960 con 0x7fed140fc7f0 2024-02-22T00:47:48.048 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:47:48.048 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:47:48.049 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:47:48.049 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:47:48.049 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:47:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed0006cab0 msgr2=0x7fed0006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed0006cab0 0x7fed0006ef70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fed140fa500 tx=0x7fed10009040).stop 2024-02-22T00:47:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 msgr2=0x7fed140f8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:47:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 0x7fed140f8d60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fed04013640 tx=0x7fed04009cb0).stop 2024-02-22T00:47:48.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 shutdown_connections 2024-02-22T00:47:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed0006cab0 0x7fed0006ef70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed140fc7f0 0x7fed140f8d60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 --2- 172.21.15.49:0/2016271936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed140fd150 0x7fed140f9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:47:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 >> 172.21.15.49:0/2016271936 conn(0x7fed14070590 msgr2=0x7fed14060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:47:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 shutdown_connections 2024-02-22T00:47:48.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:47:48.048+0000 7fed1b39e700 1 -- 172.21.15.49:0/2016271936 wait complete. 2024-02-22T00:47:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:48 smithi049 ceph-mon[132694]: pgmap v326: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:48 smithi049 ceph-mon[132694]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:48 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1708785402' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:47:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:48 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2016271936' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:47:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:48 smithi161 ceph-mon[113442]: pgmap v326: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:48 smithi161 ceph-mon[113442]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:48 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1708785402' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:47:48.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:48 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2016271936' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:47:49.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:49 smithi049 ceph-mon[132694]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:49.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:49 smithi161 ceph-mon[113442]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:47:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:50 smithi049 ceph-mon[132694]: pgmap v327: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:50 smithi161 ceph-mon[113442]: pgmap v327: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:52 smithi049 ceph-mon[132694]: pgmap v328: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:52 smithi161 ceph-mon[113442]: pgmap v328: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:54 smithi049 ceph-mon[132694]: pgmap v329: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:54 smithi161 ceph-mon[113442]: pgmap v329: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:56 smithi049 ceph-mon[132694]: pgmap v330: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:56 smithi161 ceph-mon[113442]: pgmap v330: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:58 smithi049 ceph-mon[132694]: pgmap v331: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:47:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:47:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:58 smithi161 ceph-mon[113442]: pgmap v331: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:47:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:47:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:48:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:00 smithi161 ceph-mon[113442]: pgmap v332: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:00.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:00 smithi049 ceph-mon[132694]: pgmap v332: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:02 smithi161 ceph-mon[113442]: pgmap v333: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:02 smithi049 ceph-mon[132694]: pgmap v333: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:04 smithi161 ceph-mon[113442]: pgmap v334: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:04 smithi049 ceph-mon[132694]: pgmap v334: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:06 smithi161 ceph-mon[113442]: pgmap v335: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:06 smithi049 ceph-mon[132694]: pgmap v335: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:08 smithi161 ceph-mon[113442]: pgmap v336: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:08 smithi049 ceph-mon[132694]: pgmap v336: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:10 smithi161 ceph-mon[113442]: pgmap v337: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:10 smithi049 ceph-mon[132694]: pgmap v337: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:12 smithi161 ceph-mon[113442]: pgmap v338: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:12 smithi049 ceph-mon[132694]: pgmap v338: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:48:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:48:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:14 smithi161 ceph-mon[113442]: pgmap v339: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:14 smithi049 ceph-mon[132694]: pgmap v339: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:16 smithi161 ceph-mon[113442]: pgmap v340: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:16.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:16 smithi049 ceph-mon[132694]: pgmap v340: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.164+0000 7f78c046d700 1 -- 172.21.15.49:0/1392831336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fd8f0 msgr2=0x7f78b80fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.164+0000 7f78c046d700 1 --2- 172.21.15.49:0/1392831336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fd8f0 0x7f78b80fdcd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f78ac0047f0 tx=0x7f78ac009cb0).stop 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.165+0000 7f78c046d700 1 -- 172.21.15.49:0/1392831336 shutdown_connections 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.165+0000 7f78c046d700 1 --2- 172.21.15.49:0/1392831336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78b80fe250 0x7f78b80f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.165+0000 7f78c046d700 1 --2- 172.21.15.49:0/1392831336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fd8f0 0x7f78b80fdcd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.165+0000 7f78c046d700 1 -- 172.21.15.49:0/1392831336 >> 172.21.15.49:0/1392831336 conn(0x7f78b80f34b0 msgr2=0x7f78b80f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.165+0000 7f78c046d700 1 -- 172.21.15.49:0/1392831336 shutdown_connections 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.165+0000 7f78c046d700 1 -- 172.21.15.49:0/1392831336 wait complete. 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.165+0000 7f78c046d700 1 Processor -- start 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.165+0000 7f78c046d700 1 -- start start 2024-02-22T00:48:18.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78c046d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78b80fd8f0 0x7f78b810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78c046d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fe250 0x7f78b810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78c046d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b810ead0 con 0x7f78b80fe250 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78c046d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b810ec10 con 0x7f78b80fd8f0 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78bda08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fe250 0x7f78b810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78bda08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fe250 0x7f78b810e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49854/0 (socket says 172.21.15.49:49854) 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78bda08700 1 -- 172.21.15.49:0/1815837790 learned_addr learned my addr 172.21.15.49:0/1815837790 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78be209700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78b80fd8f0 0x7f78b810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78bda08700 1 -- 172.21.15.49:0/1815837790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78b80fd8f0 msgr2=0x7f78b810dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78bda08700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78b80fd8f0 0x7f78b810dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78bda08700 1 -- 172.21.15.49:0/1815837790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac005040 con 0x7f78b80fe250 2024-02-22T00:48:18.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78be209700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78b80fd8f0 0x7f78b810dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:48:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78bda08700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fe250 0x7f78b810e4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f78b400c710 tx=0x7f78b4007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78ab7fe700 1 -- 172.21.15.49:0/1815837790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b400e680 con 0x7f78b80fe250 2024-02-22T00:48:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78ab7fe700 1 -- 172.21.15.49:0/1815837790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f78b400ec90 con 0x7f78b80fe250 2024-02-22T00:48:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b81082a0 con 0x7f78b80fe250 2024-02-22T00:48:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78ab7fe700 1 -- 172.21.15.49:0/1815837790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78b4013cd0 con 0x7f78b80fe250 2024-02-22T00:48:18.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.166+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b8108860 con 0x7f78b80fe250 2024-02-22T00:48:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.167+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b805f590 con 0x7f78b80fe250 2024-02-22T00:48:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.168+0000 7f78ab7fe700 1 -- 172.21.15.49:0/1815837790 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f78b4013410 con 0x7f78b80fe250 2024-02-22T00:48:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.169+0000 7f78ab7fe700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f78a406caa0 0x7f78a406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.169+0000 7f78ab7fe700 1 -- 172.21.15.49:0/1815837790 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f78b408c7b0 con 0x7f78b80fe250 2024-02-22T00:48:18.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.169+0000 7f78be209700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f78a406caa0 0x7f78a406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:18.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.169+0000 7f78be209700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f78a406caa0 0x7f78a406ef60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f78ac0043d0 tx=0x7f78ac00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:18.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.173+0000 7f78ab7fe700 1 -- 172.21.15.49:0/1815837790 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f78b405a250 con 0x7f78b80fe250 2024-02-22T00:48:18.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.388+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78b8108ae0 con 0x7f78a406caa0 2024-02-22T00:48:18.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.390+0000 7f78ab7fe700 1 -- 172.21.15.49:0/1815837790 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f78b8108ae0 con 0x7f78a406caa0 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f78a406caa0 msgr2=0x7f78a406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f78a406caa0 0x7f78a406ef60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f78ac0043d0 tx=0x7f78ac00b040).stop 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fe250 msgr2=0x7f78b810e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fe250 0x7f78b810e4d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f78b400c710 tx=0x7f78b4007ec0).stop 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 shutdown_connections 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f78a406caa0 0x7f78a406ef60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78b80fd8f0 0x7f78b810dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 --2- 172.21.15.49:0/1815837790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78b80fe250 0x7f78b810e4d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 >> 172.21.15.49:0/1815837790 conn(0x7f78b80f34b0 msgr2=0x7f78b80fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 shutdown_connections 2024-02-22T00:48:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.392+0000 7f78c046d700 1 -- 172.21.15.49:0/1815837790 wait complete. 2024-02-22T00:48:18.404 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:48:18.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 -- 172.21.15.49:0/855047473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 msgr2=0x7fde500f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 --2- 172.21.15.49:0/855047473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 0x7fde500f8c80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fde400047f0 tx=0x7fde40009cb0).stop 2024-02-22T00:48:18.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 -- 172.21.15.49:0/855047473 shutdown_connections 2024-02-22T00:48:18.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 --2- 172.21.15.49:0/855047473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde500f9200 0x7fde50101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 --2- 172.21.15.49:0/855047473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 0x7fde500f8c80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 -- 172.21.15.49:0/855047473 >> 172.21.15.49:0/855047473 conn(0x7fde500f23b0 msgr2=0x7fde500f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:18.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 -- 172.21.15.49:0/855047473 shutdown_connections 2024-02-22T00:48:18.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 -- 172.21.15.49:0/855047473 wait complete. 2024-02-22T00:48:18.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.495+0000 7fde559c8700 1 Processor -- start 2024-02-22T00:48:18.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde559c8700 1 -- start start 2024-02-22T00:48:18.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde559c8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 0x7fde5010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde559c8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde500f9200 0x7fde5010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde559c8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5010eb70 con 0x7fde500f88a0 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde559c8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5010ecb0 con 0x7fde500f9200 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde4effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 0x7fde5010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde4effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 0x7fde5010e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49870/0 (socket says 172.21.15.49:49870) 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde4effd700 1 -- 172.21.15.49:0/3901984952 learned_addr learned my addr 172.21.15.49:0/3901984952 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde4effd700 1 -- 172.21.15.49:0/3901984952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde500f9200 msgr2=0x7fde5010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde4effd700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde500f9200 0x7fde5010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde4effd700 1 -- 172.21.15.49:0/3901984952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40005040 con 0x7fde500f88a0 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde4effd700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 0x7fde5010e080 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fde400043a0 tx=0x7fde40009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde47fff700 1 -- 172.21.15.49:0/3901984952 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde4000e030 con 0x7fde500f88a0 2024-02-22T00:48:18.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde47fff700 1 -- 172.21.15.49:0/3901984952 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fde40007e90 con 0x7fde500f88a0 2024-02-22T00:48:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde50108330 con 0x7fde500f88a0 2024-02-22T00:48:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.496+0000 7fde47fff700 1 -- 172.21.15.49:0/3901984952 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde40018070 con 0x7fde500f88a0 2024-02-22T00:48:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.497+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde50108810 con 0x7fde500f88a0 2024-02-22T00:48:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.498+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde50060370 con 0x7fde500f88a0 2024-02-22T00:48:18.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.498+0000 7fde47fff700 1 -- 172.21.15.49:0/3901984952 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fde40009590 con 0x7fde500f88a0 2024-02-22T00:48:18.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.499+0000 7fde47fff700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fde3c06ca40 0x7fde3c06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.499+0000 7fde4e7fc700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fde3c06ca40 0x7fde3c06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:18.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.499+0000 7fde47fff700 1 -- 172.21.15.49:0/3901984952 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fde4008d140 con 0x7fde500f88a0 2024-02-22T00:48:18.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.499+0000 7fde4e7fc700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fde3c06ca40 0x7fde3c06ef00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fde501099c0 tx=0x7fde38009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:18.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.503+0000 7fde47fff700 1 -- 172.21.15.49:0/3901984952 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fde4005ac20 con 0x7fde500f88a0 2024-02-22T00:48:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:18 smithi161 ceph-mon[113442]: pgmap v341: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:18.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:18 smithi049 ceph-mon[132694]: pgmap v341: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:18.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.718+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde50109810 con 0x7fde3c06ca40 2024-02-22T00:48:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.719+0000 7fde47fff700 1 -- 172.21.15.49:0/3901984952 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fde50109810 con 0x7fde3c06ca40 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.721+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fde3c06ca40 msgr2=0x7fde3c06ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.721+0000 7fde559c8700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fde3c06ca40 0x7fde3c06ef00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fde501099c0 tx=0x7fde38009b60).stop 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.721+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 msgr2=0x7fde5010e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.721+0000 7fde559c8700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 0x7fde5010e080 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fde400043a0 tx=0x7fde40009cb0).stop 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.721+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 shutdown_connections 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.722+0000 7fde559c8700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fde3c06ca40 0x7fde3c06ef00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.722+0000 7fde559c8700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde500f88a0 0x7fde5010e080 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.722+0000 7fde559c8700 1 --2- 172.21.15.49:0/3901984952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde500f9200 0x7fde5010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.722+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 >> 172.21.15.49:0/3901984952 conn(0x7fde500f23b0 msgr2=0x7fde500fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.722+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 shutdown_connections 2024-02-22T00:48:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.722+0000 7fde559c8700 1 -- 172.21.15.49:0/3901984952 wait complete. 2024-02-22T00:48:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.823+0000 7f4ef62e7700 1 -- 172.21.15.49:0/388491808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 msgr2=0x7f4ef00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.823+0000 7f4ef62e7700 1 --2- 172.21.15.49:0/388491808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 0x7f4ef00f6930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f4ee40047f0 tx=0x7f4ee4009cb0).stop 2024-02-22T00:48:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.823+0000 7f4ef62e7700 1 -- 172.21.15.49:0/388491808 shutdown_connections 2024-02-22T00:48:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.823+0000 7f4ef62e7700 1 --2- 172.21.15.49:0/388491808 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 0x7f4ef00f6930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.823+0000 7f4ef62e7700 1 --2- 172.21.15.49:0/388491808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ef00fc7f0 0x7f4ef00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.823+0000 7f4ef62e7700 1 -- 172.21.15.49:0/388491808 >> 172.21.15.49:0/388491808 conn(0x7f4ef0070590 msgr2=0x7f4ef00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:18.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.823+0000 7f4ef62e7700 1 -- 172.21.15.49:0/388491808 shutdown_connections 2024-02-22T00:48:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.823+0000 7f4ef62e7700 1 -- 172.21.15.49:0/388491808 wait complete. 2024-02-22T00:48:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.824+0000 7f4ef62e7700 1 Processor -- start 2024-02-22T00:48:18.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.824+0000 7f4ef62e7700 1 -- start start 2024-02-22T00:48:18.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.824+0000 7f4ef62e7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ef00fc7f0 0x7f4ef010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.824+0000 7f4ef62e7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 0x7f4ef010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.824+0000 7f4ef62e7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef010eab0 con 0x7f4ef00fd150 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.824+0000 7f4ef62e7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef010ebf0 con 0x7f4ef00fc7f0 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 0x7f4ef010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 0x7f4ef010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49894/0 (socket says 172.21.15.49:49894) 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eef7fe700 1 -- 172.21.15.49:0/949858753 learned_addr learned my addr 172.21.15.49:0/949858753 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eeffff700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ef00fc7f0 0x7f4ef010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eef7fe700 1 -- 172.21.15.49:0/949858753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ef00fc7f0 msgr2=0x7f4ef010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eef7fe700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ef00fc7f0 0x7f4ef010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eef7fe700 1 -- 172.21.15.49:0/949858753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4005040 con 0x7f4ef00fd150 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eef7fe700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 0x7f4ef010e4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f4ee40099f0 tx=0x7f4ee4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eed775700 1 -- 172.21.15.49:0/949858753 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ee400e030 con 0x7f4ef00fd150 2024-02-22T00:48:18.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eed775700 1 -- 172.21.15.49:0/949858753 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ee4007e90 con 0x7f4ef00fd150 2024-02-22T00:48:18.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef0108220 con 0x7f4ef00fd150 2024-02-22T00:48:18.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4eed775700 1 -- 172.21.15.49:0/949858753 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ee4018070 con 0x7f4ef00fd150 2024-02-22T00:48:18.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.825+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef0108780 con 0x7f4ef00fd150 2024-02-22T00:48:18.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.826+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef005f590 con 0x7f4ef00fd150 2024-02-22T00:48:18.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.827+0000 7f4eed775700 1 -- 172.21.15.49:0/949858753 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4ee401d420 con 0x7f4ef00fd150 2024-02-22T00:48:18.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.827+0000 7f4eed775700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ed806caa0 0x7f4ed806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:18.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.827+0000 7f4eeffff700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ed806caa0 0x7f4ed806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:18.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.827+0000 7f4eed775700 1 -- 172.21.15.49:0/949858753 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4ee408d190 con 0x7f4ef00fd150 2024-02-22T00:48:18.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.828+0000 7f4eeffff700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ed806caa0 0x7f4ed806ef60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4ee0004d20 tx=0x7f4ee0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:18.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:18.832+0000 7f4eed775700 1 -- 172.21.15.49:0/949858753 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4ee405acf0 con 0x7f4ef00fd150 2024-02-22T00:48:19.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.044+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ef01096e0 con 0x7f4ed806caa0 2024-02-22T00:48:19.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.054+0000 7f4eed775700 1 -- 172.21.15.49:0/949858753 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f4ef01096e0 con 0x7f4ed806caa0 2024-02-22T00:48:19.056 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (11m) 5m ago 22m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (9m) 5m ago 22m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (9m) 4m ago 22m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (11m) 5m ago 22m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (5m) 5m ago 17m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (5m) 5m ago 17m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (4m) 4m ago 17m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (5m) 4m ago 17m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (13m) 5m ago 24m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (12m) 4m ago 22m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (10m) 5m ago 24m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:48:19.057 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (9m) 4m ago 21m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (12m) 5m ago 22m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (12m) 4m ago 21m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (8m) 5m ago 21m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (8m) 5m ago 20m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (7m) 5m ago 20m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (7m) 4m ago 19m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (6m) 4m ago 19m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (6m) 4m ago 19m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:48:19.058 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (11m) 4m ago 21m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ed806caa0 msgr2=0x7f4ed806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ed806caa0 0x7f4ed806ef60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4ee0004d20 tx=0x7f4ee0009040).stop 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 msgr2=0x7f4ef010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 0x7f4ef010e4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f4ee40099f0 tx=0x7f4ee4009cb0).stop 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 shutdown_connections 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ed806caa0 0x7f4ed806ef60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ef00fc7f0 0x7f4ef010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 --2- 172.21.15.49:0/949858753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ef00fd150 0x7f4ef010e4b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 >> 172.21.15.49:0/949858753 conn(0x7f4ef0070590 msgr2=0x7f4ef0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 shutdown_connections 2024-02-22T00:48:19.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.057+0000 7f4ef62e7700 1 -- 172.21.15.49:0/949858753 wait complete. 2024-02-22T00:48:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.157+0000 7fe7f80bd700 1 -- 172.21.15.49:0/2929594460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 msgr2=0x7fe7f00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.157+0000 7fe7f80bd700 1 --2- 172.21.15.49:0/2929594460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 0x7fe7f00f6930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fe7e00047f0 tx=0x7fe7e0009cb0).stop 2024-02-22T00:48:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.158+0000 7fe7f80bd700 1 -- 172.21.15.49:0/2929594460 shutdown_connections 2024-02-22T00:48:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.158+0000 7fe7f80bd700 1 --2- 172.21.15.49:0/2929594460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 0x7fe7f00f6930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.158+0000 7fe7f80bd700 1 --2- 172.21.15.49:0/2929594460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f00fc7f0 0x7fe7f00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.158+0000 7fe7f80bd700 1 -- 172.21.15.49:0/2929594460 >> 172.21.15.49:0/2929594460 conn(0x7fe7f0070590 msgr2=0x7fe7f00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.158+0000 7fe7f80bd700 1 -- 172.21.15.49:0/2929594460 shutdown_connections 2024-02-22T00:48:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.158+0000 7fe7f80bd700 1 -- 172.21.15.49:0/2929594460 wait complete. 2024-02-22T00:48:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.158+0000 7fe7f80bd700 1 Processor -- start 2024-02-22T00:48:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.158+0000 7fe7f80bd700 1 -- start start 2024-02-22T00:48:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f80bd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f00fc7f0 0x7fe7f010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f80bd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 0x7fe7f010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f80bd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f010eab0 con 0x7fe7f00fd150 2024-02-22T00:48:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f80bd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f010ebf0 con 0x7fe7f00fc7f0 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5658700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 0x7fe7f010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5658700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 0x7fe7f010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49908/0 (socket says 172.21.15.49:49908) 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5658700 1 -- 172.21.15.49:0/725578327 learned_addr learned my addr 172.21.15.49:0/725578327 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5e59700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f00fc7f0 0x7fe7f010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5658700 1 -- 172.21.15.49:0/725578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f00fc7f0 msgr2=0x7fe7f010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5658700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f00fc7f0 0x7fe7f010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5658700 1 -- 172.21.15.49:0/725578327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0005040 con 0x7fe7f00fd150 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5e59700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f00fc7f0 0x7fe7f010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f5658700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 0x7fe7f010e4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fe7e00099f0 tx=0x7fe7e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7e6ffd700 1 -- 172.21.15.49:0/725578327 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e000e030 con 0x7fe7f00fd150 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7e6ffd700 1 -- 172.21.15.49:0/725578327 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7e0007e90 con 0x7fe7f00fd150 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7e6ffd700 1 -- 172.21.15.49:0/725578327 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7e0018070 con 0x7fe7f00fd150 2024-02-22T00:48:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f0108220 con 0x7fe7f00fd150 2024-02-22T00:48:19.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.159+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f0108780 con 0x7fe7f00fd150 2024-02-22T00:48:19.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.160+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f005f590 con 0x7fe7f00fd150 2024-02-22T00:48:19.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.161+0000 7fe7e6ffd700 1 -- 172.21.15.49:0/725578327 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe7e0009590 con 0x7fe7f00fd150 2024-02-22T00:48:19.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.161+0000 7fe7e6ffd700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe7dc06caa0 0x7fe7dc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.161+0000 7fe7e6ffd700 1 -- 172.21.15.49:0/725578327 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe7e008cf60 con 0x7fe7f00fd150 2024-02-22T00:48:19.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.161+0000 7fe7f5e59700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe7dc06caa0 0x7fe7dc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.162+0000 7fe7f5e59700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe7dc06caa0 0x7fe7dc06ef60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe7ec009250 tx=0x7fe7ec009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.166+0000 7fe7e6ffd700 1 -- 172.21.15.49:0/725578327 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe7e00c0190 con 0x7fe7f00fd150 2024-02-22T00:48:19.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.448+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe7f0047540 con 0x7fe7f00fd150 2024-02-22T00:48:19.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.448+0000 7fe7e6ffd700 1 -- 172.21.15.49:0/725578327 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fe7e005a830 con 0x7fe7f00fd150 2024-02-22T00:48:19.450 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:48:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:48:19.450 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:48:19.451 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:48:19.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe7dc06caa0 msgr2=0x7fe7dc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe7dc06caa0 0x7fe7dc06ef60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe7ec009250 tx=0x7fe7ec009d60).stop 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 msgr2=0x7fe7f010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 0x7fe7f010e4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fe7e00099f0 tx=0x7fe7e0009cb0).stop 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 shutdown_connections 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe7dc06caa0 0x7fe7dc06ef60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f00fc7f0 0x7fe7f010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 --2- 172.21.15.49:0/725578327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7f00fd150 0x7fe7f010e4b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 >> 172.21.15.49:0/725578327 conn(0x7fe7f0070590 msgr2=0x7fe7f0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 shutdown_connections 2024-02-22T00:48:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.450+0000 7fe7f80bd700 1 -- 172.21.15.49:0/725578327 wait complete. 2024-02-22T00:48:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.552+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1596062706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fd150 msgr2=0x7ffb440f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.552+0000 7ffb4aa28700 1 --2- 172.21.15.49:0/1596062706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fd150 0x7ffb440f6930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7ffb380047f0 tx=0x7ffb38009cb0).stop 2024-02-22T00:48:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.552+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1596062706 shutdown_connections 2024-02-22T00:48:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.552+0000 7ffb4aa28700 1 --2- 172.21.15.49:0/1596062706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fd150 0x7ffb440f6930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.552+0000 7ffb4aa28700 1 --2- 172.21.15.49:0/1596062706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb440fc7f0 0x7ffb440fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.552+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1596062706 >> 172.21.15.49:0/1596062706 conn(0x7ffb44070590 msgr2=0x7ffb440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.552+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1596062706 shutdown_connections 2024-02-22T00:48:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.552+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1596062706 wait complete. 2024-02-22T00:48:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.553+0000 7ffb4aa28700 1 Processor -- start 2024-02-22T00:48:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.553+0000 7ffb4aa28700 1 -- start start 2024-02-22T00:48:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.553+0000 7ffb4aa28700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fc7f0 0x7ffb4410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.553+0000 7ffb4aa28700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb440fd150 0x7ffb4410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.553+0000 7ffb4aa28700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4410eab0 con 0x7ffb440fc7f0 2024-02-22T00:48:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.553+0000 7ffb4aa28700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4410ebf0 con 0x7ffb440fd150 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb43fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fc7f0 0x7ffb4410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb43fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fc7f0 0x7ffb4410dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49918/0 (socket says 172.21.15.49:49918) 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb43fff700 1 -- 172.21.15.49:0/1978625599 learned_addr learned my addr 172.21.15.49:0/1978625599 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb437fe700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb440fd150 0x7ffb4410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb43fff700 1 -- 172.21.15.49:0/1978625599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb440fd150 msgr2=0x7ffb4410e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb43fff700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb440fd150 0x7ffb4410e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb43fff700 1 -- 172.21.15.49:0/1978625599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb38005040 con 0x7ffb440fc7f0 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb437fe700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb440fd150 0x7ffb4410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb43fff700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fc7f0 0x7ffb4410dfc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7ffb340041d0 tx=0x7ffb34009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb417fa700 1 -- 172.21.15.49:0/1978625599 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb34002d90 con 0x7ffb440fc7f0 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb417fa700 1 -- 172.21.15.49:0/1978625599 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffb3400f040 con 0x7ffb440fc7f0 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb44108280 con 0x7ffb440fc7f0 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb417fa700 1 -- 172.21.15.49:0/1978625599 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb3400d800 con 0x7ffb440fc7f0 2024-02-22T00:48:19.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.554+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb44108840 con 0x7ffb440fc7f0 2024-02-22T00:48:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.555+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4405f590 con 0x7ffb440fc7f0 2024-02-22T00:48:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.556+0000 7ffb417fa700 1 -- 172.21.15.49:0/1978625599 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffb3400da70 con 0x7ffb440fc7f0 2024-02-22T00:48:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.556+0000 7ffb417fa700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.556+0000 7ffb417fa700 1 -- 172.21.15.49:0/1978625599 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ffb3408bd20 con 0x7ffb440fc7f0 2024-02-22T00:48:19.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.556+0000 7ffb437fe700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.557+0000 7ffb437fe700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ffb38004f10 tx=0x7ffb3800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:19.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.561+0000 7ffb417fa700 1 -- 172.21.15.49:0/1978625599 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffb34059880 con 0x7ffb440fc7f0 2024-02-22T00:48:19.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.805+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb44109640 con 0x7ffb440fc7f0 2024-02-22T00:48:19.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.805+0000 7ffb417fa700 1 -- 172.21.15.49:0/1978625599 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7ffb34059410 con 0x7ffb440fc7f0 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:48:19.808 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:48:19.809 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:48:19.810 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:48:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 msgr2=0x7ffb2c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ffb38004f10 tx=0x7ffb3800b040).stop 2024-02-22T00:48:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fc7f0 msgr2=0x7ffb4410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fc7f0 0x7ffb4410dfc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7ffb340041d0 tx=0x7ffb34009f60).stop 2024-02-22T00:48:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 shutdown_connections 2024-02-22T00:48:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffb2c06caa0 0x7ffb2c06ef60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb440fc7f0 0x7ffb4410dfc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 --2- 172.21.15.49:0/1978625599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb440fd150 0x7ffb4410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 >> 172.21.15.49:0/1978625599 conn(0x7ffb44070590 msgr2=0x7ffb44060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 shutdown_connections 2024-02-22T00:48:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.807+0000 7ffb4aa28700 1 -- 172.21.15.49:0/1978625599 wait complete. 2024-02-22T00:48:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:48:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.910+0000 7f671a89a700 1 -- 172.21.15.49:0/1312460061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 msgr2=0x7f6714101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.910+0000 7f671a89a700 1 --2- 172.21.15.49:0/1312460061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 0x7f6714101970 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f67080047f0 tx=0x7f6708009cb0).stop 2024-02-22T00:48:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.910+0000 7f671a89a700 1 -- 172.21.15.49:0/1312460061 shutdown_connections 2024-02-22T00:48:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.910+0000 7f671a89a700 1 --2- 172.21.15.49:0/1312460061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 0x7f6714101970 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.910+0000 7f671a89a700 1 --2- 172.21.15.49:0/1312460061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140f8900 0x7f67140f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:48:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.910+0000 7f671a89a700 1 -- 172.21.15.49:0/1312460061 >> 172.21.15.49:0/1312460061 conn(0x7f6714070590 msgr2=0x7f67140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:19.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.910+0000 7f671a89a700 1 -- 172.21.15.49:0/1312460061 shutdown_connections 2024-02-22T00:48:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.910+0000 7f671a89a700 1 -- 172.21.15.49:0/1312460061 wait complete. 2024-02-22T00:48:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.911+0000 7f671a89a700 1 Processor -- start 2024-02-22T00:48:19.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.911+0000 7f671a89a700 1 -- start start 2024-02-22T00:48:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.911+0000 7f671a89a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140f8900 0x7f671410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.911+0000 7f671a89a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 0x7f671410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.911+0000 7f671a89a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671410ebb0 con 0x7f67140f9260 2024-02-22T00:48:19.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.911+0000 7f671a89a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67141081d0 con 0x7f67140f8900 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67137fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 0x7f671410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67137fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 0x7f671410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49930/0 (socket says 172.21.15.49:49930) 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67137fe700 1 -- 172.21.15.49:0/986919202 learned_addr learned my addr 172.21.15.49:0/986919202 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f6713fff700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140f8900 0x7f671410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67137fe700 1 -- 172.21.15.49:0/986919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140f8900 msgr2=0x7f671410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67137fe700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140f8900 0x7f671410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67137fe700 1 -- 172.21.15.49:0/986919202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708005040 con 0x7f67140f9260 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67137fe700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 0x7f671410e520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f6708009310 tx=0x7f6708009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67117fa700 1 -- 172.21.15.49:0/986919202 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f670800e030 con 0x7f67140f9260 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67117fa700 1 -- 172.21.15.49:0/986919202 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6708007e90 con 0x7f67140f9260 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6714108420 con 0x7f67140f9260 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f67117fa700 1 -- 172.21.15.49:0/986919202 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6708018070 con 0x7f67140f9260 2024-02-22T00:48:19.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.912+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6714108900 con 0x7f67140f9260 2024-02-22T00:48:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.913+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671405f590 con 0x7f67140f9260 2024-02-22T00:48:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.914+0000 7f67117fa700 1 -- 172.21.15.49:0/986919202 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f670801d420 con 0x7f67140f9260 2024-02-22T00:48:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.914+0000 7f67117fa700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66fc06caa0 0x7f66fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:19.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.914+0000 7f67117fa700 1 -- 172.21.15.49:0/986919202 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f670808d1c0 con 0x7f67140f9260 2024-02-22T00:48:19.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.914+0000 7f6713fff700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66fc06caa0 0x7f66fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:19.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.915+0000 7f6713fff700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66fc06caa0 0x7f66fc06ef60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f6704006fd0 tx=0x7f6704009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:19.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:19.919+0000 7f67117fa700 1 -- 172.21.15.49:0/986919202 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f670805ad20 con 0x7f67140f9260 2024-02-22T00:48:20.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.135+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6714109720 con 0x7f66fc06caa0 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.136+0000 7f67117fa700 1 -- 172.21.15.49:0/986919202 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f6714109720 con 0x7f66fc06caa0 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:48:20.138 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:48:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:48:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:48:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:48:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:48:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:48:20.139 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:48:20.139 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66fc06caa0 msgr2=0x7f66fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66fc06caa0 0x7f66fc06ef60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f6704006fd0 tx=0x7f6704009060).stop 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 msgr2=0x7f671410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 0x7f671410e520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f6708009310 tx=0x7f6708009cb0).stop 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 shutdown_connections 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66fc06caa0 0x7f66fc06ef60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140f8900 0x7f671410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 --2- 172.21.15.49:0/986919202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67140f9260 0x7f671410e520 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 >> 172.21.15.49:0/986919202 conn(0x7f6714070590 msgr2=0x7f67140fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:20.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 shutdown_connections 2024-02-22T00:48:20.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.138+0000 7f671a89a700 1 -- 172.21.15.49:0/986919202 wait complete. 2024-02-22T00:48:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 -- 172.21.15.49:0/476790379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 msgr2=0x7f75d80f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 --2- 172.21.15.49:0/476790379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 0x7f75d80f7a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f75c80047f0 tx=0x7f75c8009cb0).stop 2024-02-22T00:48:20.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 -- 172.21.15.49:0/476790379 shutdown_connections 2024-02-22T00:48:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 --2- 172.21.15.49:0/476790379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 0x7f75d80f7a50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 --2- 172.21.15.49:0/476790379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80fd910 0x7f75d80fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 -- 172.21.15.49:0/476790379 >> 172.21.15.49:0/476790379 conn(0x7f75d80f3530 msgr2=0x7f75d80f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 -- 172.21.15.49:0/476790379 shutdown_connections 2024-02-22T00:48:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 -- 172.21.15.49:0/476790379 wait complete. 2024-02-22T00:48:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 Processor -- start 2024-02-22T00:48:20.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.241+0000 7f75dd43c700 1 -- start start 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75dd43c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80fd910 0x7f75d810dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75dd43c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 0x7f75d810e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75dd43c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d810eae0 con 0x7f75d80fe270 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75dd43c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d810ec20 con 0x7f75d80fd910 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75d67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 0x7f75d810e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75d67fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 0x7f75d810e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49944/0 (socket says 172.21.15.49:49944) 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75d67fc700 1 -- 172.21.15.49:0/404117088 learned_addr learned my addr 172.21.15.49:0/404117088 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75d6ffd700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80fd910 0x7f75d810dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75d67fc700 1 -- 172.21.15.49:0/404117088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80fd910 msgr2=0x7f75d810dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75d67fc700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80fd910 0x7f75d810dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75d67fc700 1 -- 172.21.15.49:0/404117088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8005040 con 0x7f75d80fe270 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75d67fc700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 0x7f75d810e4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f75c8000c00 tx=0x7f75c8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75bffff700 1 -- 172.21.15.49:0/404117088 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c800e030 con 0x7f75d80fe270 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d8108250 con 0x7f75d80fe270 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.242+0000 7f75bffff700 1 -- 172.21.15.49:0/404117088 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75c8007e90 con 0x7f75d80fe270 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.243+0000 7f75bffff700 1 -- 172.21.15.49:0/404117088 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75c8018070 con 0x7f75d80fe270 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.243+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d81087b0 con 0x7f75d80fe270 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.244+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d805f570 con 0x7f75d80fe270 2024-02-22T00:48:20.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.244+0000 7f75bffff700 1 -- 172.21.15.49:0/404117088 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f75c801d420 con 0x7f75d80fe270 2024-02-22T00:48:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.244+0000 7f75bffff700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75c006cab0 0x7f75c006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.245+0000 7f75bffff700 1 -- 172.21.15.49:0/404117088 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f75c808d150 con 0x7f75d80fe270 2024-02-22T00:48:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.245+0000 7f75d6ffd700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75c006cab0 0x7f75c006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:20.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.245+0000 7f75d6ffd700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75c006cab0 0x7f75c006ef70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f75cc004d20 tx=0x7f75cc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.249+0000 7f75bffff700 1 -- 172.21.15.49:0/404117088 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f75c805acb0 con 0x7f75d80fe270 2024-02-22T00:48:20.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.528+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f75d8047540 con 0x7f75d80fe270 2024-02-22T00:48:20.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.528+0000 7f75bffff700 1 -- 172.21.15.49:0/404117088 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f75c805a840 con 0x7f75d80fe270 2024-02-22T00:48:20.531 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:48:20.531 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:48:20.531 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:48:20.531 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:48:20.531 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:48:20.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75c006cab0 msgr2=0x7f75c006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75c006cab0 0x7f75c006ef70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f75cc004d20 tx=0x7f75cc009040).stop 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 msgr2=0x7f75d810e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 0x7f75d810e4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f75c8000c00 tx=0x7f75c8009cb0).stop 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 shutdown_connections 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75c006cab0 0x7f75c006ef70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80fd910 0x7f75d810dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 --2- 172.21.15.49:0/404117088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75d80fe270 0x7f75d810e4e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.530+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 >> 172.21.15.49:0/404117088 conn(0x7f75d80f3530 msgr2=0x7f75d80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.531+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 shutdown_connections 2024-02-22T00:48:20.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:20.531+0000 7f75dd43c700 1 -- 172.21.15.49:0/404117088 wait complete. 2024-02-22T00:48:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:20 smithi161 ceph-mon[113442]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:20 smithi161 ceph-mon[113442]: pgmap v342: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:20 smithi161 ceph-mon[113442]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:20 smithi161 ceph-mon[113442]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:20 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/725578327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:48:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:20 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1978625599' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:48:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:20 smithi049 ceph-mon[132694]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:20 smithi049 ceph-mon[132694]: pgmap v342: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:20 smithi049 ceph-mon[132694]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:20 smithi049 ceph-mon[132694]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:20 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/725578327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:48:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:20 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1978625599' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:48:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:21 smithi161 ceph-mon[113442]: from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:21.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:21 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/404117088' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:48:21.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:21 smithi049 ceph-mon[132694]: from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:21.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:21 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/404117088' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:48:22.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:22 smithi161 ceph-mon[113442]: pgmap v343: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:22 smithi049 ceph-mon[132694]: pgmap v343: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:24 smithi161 ceph-mon[113442]: pgmap v344: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:24.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:24 smithi049 ceph-mon[132694]: pgmap v344: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:26 smithi161 ceph-mon[113442]: pgmap v345: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:26.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:26 smithi049 ceph-mon[132694]: pgmap v345: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:28 smithi161 ceph-mon[113442]: pgmap v346: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:48:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:28 smithi049 ceph-mon[132694]: pgmap v346: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:48:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:30 smithi161 ceph-mon[113442]: pgmap v347: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:30 smithi049 ceph-mon[132694]: pgmap v347: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:32 smithi161 ceph-mon[113442]: pgmap v348: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:32.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:32 smithi049 ceph-mon[132694]: pgmap v348: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:34 smithi161 ceph-mon[113442]: pgmap v349: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:34 smithi049 ceph-mon[132694]: pgmap v349: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:36 smithi161 ceph-mon[113442]: pgmap v350: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:36 smithi049 ceph-mon[132694]: pgmap v350: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:38 smithi161 ceph-mon[113442]: pgmap v351: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:38 smithi049 ceph-mon[132694]: pgmap v351: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:40 smithi161 ceph-mon[113442]: pgmap v352: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:40.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:40 smithi049 ceph-mon[132694]: pgmap v352: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:42 smithi161 ceph-mon[113442]: pgmap v353: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:42 smithi049 ceph-mon[132694]: pgmap v353: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:48:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:48:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:44 smithi161 ceph-mon[113442]: pgmap v354: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:44 smithi049 ceph-mon[132694]: pgmap v354: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:46 smithi161 ceph-mon[113442]: pgmap v355: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:46 smithi049 ceph-mon[132694]: pgmap v355: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:48 smithi161 ceph-mon[113442]: pgmap v356: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:48 smithi049 ceph-mon[132694]: pgmap v356: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:50 smithi161 ceph-mon[113442]: pgmap v357: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.647+0000 7f6b786df700 1 -- 172.21.15.49:0/3884043603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 msgr2=0x7f6b700f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.647+0000 7f6b786df700 1 --2- 172.21.15.49:0/3884043603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 0x7f6b700f7a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f6b6c0047f0 tx=0x7f6b6c009cb0).stop 2024-02-22T00:48:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.647+0000 7f6b786df700 1 -- 172.21.15.49:0/3884043603 shutdown_connections 2024-02-22T00:48:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.647+0000 7f6b786df700 1 --2- 172.21.15.49:0/3884043603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 0x7f6b700f7a50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.647+0000 7f6b786df700 1 --2- 172.21.15.49:0/3884043603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b700fd910 0x7f6b700fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.647+0000 7f6b786df700 1 -- 172.21.15.49:0/3884043603 >> 172.21.15.49:0/3884043603 conn(0x7f6b700f3530 msgr2=0x7f6b700f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.647+0000 7f6b786df700 1 -- 172.21.15.49:0/3884043603 shutdown_connections 2024-02-22T00:48:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.647+0000 7f6b786df700 1 -- 172.21.15.49:0/3884043603 wait complete. 2024-02-22T00:48:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b786df700 1 Processor -- start 2024-02-22T00:48:50.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b786df700 1 -- start start 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b786df700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b700fd910 0x7f6b7006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b786df700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 0x7f6b7006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b786df700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7006bab0 con 0x7f6b700fe270 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b786df700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7006bbf0 con 0x7f6b700fd910 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b75c7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 0x7f6b7006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b75c7a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 0x7f6b7006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39118/0 (socket says 172.21.15.49:39118) 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.648+0000 7f6b75c7a700 1 -- 172.21.15.49:0/488872905 learned_addr learned my addr 172.21.15.49:0/488872905 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b7647b700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b700fd910 0x7f6b7006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b75c7a700 1 -- 172.21.15.49:0/488872905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b700fd910 msgr2=0x7f6b7006b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b75c7a700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b700fd910 0x7f6b7006b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b75c7a700 1 -- 172.21.15.49:0/488872905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c005040 con 0x7f6b700fe270 2024-02-22T00:48:50.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b75c7a700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 0x7f6b7006b5c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6b6c000c00 tx=0x7f6b6c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b677fe700 1 -- 172.21.15.49:0/488872905 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b6c00e030 con 0x7f6b700fe270 2024-02-22T00:48:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b677fe700 1 -- 172.21.15.49:0/488872905 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b6c007e90 con 0x7f6b700fe270 2024-02-22T00:48:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7006be40 con 0x7f6b700fe270 2024-02-22T00:48:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b677fe700 1 -- 172.21.15.49:0/488872905 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b6c018070 con 0x7f6b700fe270 2024-02-22T00:48:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.649+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b70114600 con 0x7f6b700fe270 2024-02-22T00:48:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.650+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7005f570 con 0x7f6b700fe270 2024-02-22T00:48:50.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.651+0000 7f6b677fe700 1 -- 172.21.15.49:0/488872905 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6b6c01d420 con 0x7f6b700fe270 2024-02-22T00:48:50.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.651+0000 7f6b677fe700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6b5c06cab0 0x7f6b5c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:50.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.651+0000 7f6b677fe700 1 -- 172.21.15.49:0/488872905 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6b6c08d270 con 0x7f6b700fe270 2024-02-22T00:48:50.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.651+0000 7f6b7647b700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6b5c06cab0 0x7f6b5c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:50.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.652+0000 7f6b7647b700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6b5c06cab0 0x7f6b5c06ef70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6b60004b60 tx=0x7f6b60009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:50.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.656+0000 7f6b677fe700 1 -- 172.21.15.49:0/488872905 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6b6c057400 con 0x7f6b700fe270 2024-02-22T00:48:50.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:50 smithi049 ceph-mon[132694]: pgmap v357: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:50.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.874+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b70059120 con 0x7f6b5c06cab0 2024-02-22T00:48:50.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.875+0000 7f6b677fe700 1 -- 172.21.15.49:0/488872905 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f6b70059120 con 0x7f6b5c06cab0 2024-02-22T00:48:50.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6b5c06cab0 msgr2=0x7f6b5c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:50.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6b5c06cab0 0x7f6b5c06ef70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6b60004b60 tx=0x7f6b60009040).stop 2024-02-22T00:48:50.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 msgr2=0x7f6b7006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:50.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 0x7f6b7006b5c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6b6c000c00 tx=0x7f6b6c009cb0).stop 2024-02-22T00:48:50.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 shutdown_connections 2024-02-22T00:48:50.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6b5c06cab0 0x7f6b5c06ef70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b700fd910 0x7f6b7006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 --2- 172.21.15.49:0/488872905 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b700fe270 0x7f6b7006b5c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 >> 172.21.15.49:0/488872905 conn(0x7f6b700f3530 msgr2=0x7f6b700fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:50.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 shutdown_connections 2024-02-22T00:48:50.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.877+0000 7f6b786df700 1 -- 172.21.15.49:0/488872905 wait complete. 2024-02-22T00:48:50.889 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:48:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 -- 172.21.15.49:0/2596847318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 msgr2=0x7ff5900f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 --2- 172.21.15.49:0/2596847318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 0x7ff5900f69a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7ff5800047f0 tx=0x7ff580009cb0).stop 2024-02-22T00:48:50.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 -- 172.21.15.49:0/2596847318 shutdown_connections 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 --2- 172.21.15.49:0/2596847318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 0x7ff5900f69a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 --2- 172.21.15.49:0/2596847318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5900fc860 0x7ff5900fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 -- 172.21.15.49:0/2596847318 >> 172.21.15.49:0/2596847318 conn(0x7ff5900f2440 msgr2=0x7ff5900f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 -- 172.21.15.49:0/2596847318 shutdown_connections 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 -- 172.21.15.49:0/2596847318 wait complete. 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 Processor -- start 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.980+0000 7ff5978b4700 1 -- start start 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5978b4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5900fc860 0x7ff59010e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5978b4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 0x7ff59010e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5978b4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59010eb30 con 0x7ff5900fd1c0 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5978b4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59010ec70 con 0x7ff5900fc860 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff594e4f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 0x7ff59010e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:50.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff594e4f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 0x7ff59010e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39134/0 (socket says 172.21.15.49:39134) 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff594e4f700 1 -- 172.21.15.49:0/1852613187 learned_addr learned my addr 172.21.15.49:0/1852613187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff595650700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5900fc860 0x7ff59010e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff594e4f700 1 -- 172.21.15.49:0/1852613187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5900fc860 msgr2=0x7ff59010e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff594e4f700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5900fc860 0x7ff59010e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff594e4f700 1 -- 172.21.15.49:0/1852613187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580005040 con 0x7ff5900fd1c0 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff594e4f700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 0x7ff59010e530 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7ff5800099f0 tx=0x7ff580009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5867fc700 1 -- 172.21.15.49:0/1852613187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff58000e030 con 0x7ff5900fd1c0 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5867fc700 1 -- 172.21.15.49:0/1852613187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff580007e90 con 0x7ff5900fd1c0 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5901082a0 con 0x7ff5900fd1c0 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5867fc700 1 -- 172.21.15.49:0/1852613187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff580018070 con 0x7ff5900fd1c0 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.981+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff590108780 con 0x7ff5900fd1c0 2024-02-22T00:48:50.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.982+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff590060370 con 0x7ff5900fd1c0 2024-02-22T00:48:50.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.983+0000 7ff5867fc700 1 -- 172.21.15.49:0/1852613187 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff58001d420 con 0x7ff5900fd1c0 2024-02-22T00:48:50.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.983+0000 7ff5867fc700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff57c06caa0 0x7ff57c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:50.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.983+0000 7ff5867fc700 1 -- 172.21.15.49:0/1852613187 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff58008d190 con 0x7ff5900fd1c0 2024-02-22T00:48:50.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.983+0000 7ff595650700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff57c06caa0 0x7ff57c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:50.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.984+0000 7ff595650700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff57c06caa0 0x7ff57c06ef60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff58c004d20 tx=0x7ff58c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:50.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:50.988+0000 7ff5867fc700 1 -- 172.21.15.49:0/1852613187 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff58005acf0 con 0x7ff5900fd1c0 2024-02-22T00:48:51.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.204+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5901097a0 con 0x7ff57c06caa0 2024-02-22T00:48:51.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.205+0000 7ff5867fc700 1 -- 172.21.15.49:0/1852613187 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff5901097a0 con 0x7ff57c06caa0 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff57c06caa0 msgr2=0x7ff57c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff57c06caa0 0x7ff57c06ef60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff58c004d20 tx=0x7ff58c009040).stop 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 msgr2=0x7ff59010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 0x7ff59010e530 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7ff5800099f0 tx=0x7ff580009cb0).stop 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 shutdown_connections 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff57c06caa0 0x7ff57c06ef60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5900fc860 0x7ff59010e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 --2- 172.21.15.49:0/1852613187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5900fd1c0 0x7ff59010e530 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.207+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 >> 172.21.15.49:0/1852613187 conn(0x7ff5900f2440 msgr2=0x7ff5900613a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.208+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 shutdown_connections 2024-02-22T00:48:51.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.208+0000 7ff5978b4700 1 -- 172.21.15.49:0/1852613187 wait complete. 2024-02-22T00:48:51.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.309+0000 7f1df8cd8700 1 -- 172.21.15.49:0/690590322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 msgr2=0x7f1df40f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.309+0000 7f1df8cd8700 1 --2- 172.21.15.49:0/690590322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 0x7f1df40f6980 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f1de40047f0 tx=0x7f1de4009cb0).stop 2024-02-22T00:48:51.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.309+0000 7f1df8cd8700 1 -- 172.21.15.49:0/690590322 shutdown_connections 2024-02-22T00:48:51.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.309+0000 7f1df8cd8700 1 --2- 172.21.15.49:0/690590322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 0x7f1df40f6980 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.309+0000 7f1df8cd8700 1 --2- 172.21.15.49:0/690590322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1df40fc830 0x7f1df40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.309+0000 7f1df8cd8700 1 -- 172.21.15.49:0/690590322 >> 172.21.15.49:0/690590322 conn(0x7f1df406c760 msgr2=0x7f1df406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:51.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.309+0000 7f1df8cd8700 1 -- 172.21.15.49:0/690590322 shutdown_connections 2024-02-22T00:48:51.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.309+0000 7f1df8cd8700 1 -- 172.21.15.49:0/690590322 wait complete. 2024-02-22T00:48:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df8cd8700 1 Processor -- start 2024-02-22T00:48:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df8cd8700 1 -- start start 2024-02-22T00:48:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df8cd8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1df40fc830 0x7f1df410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:51.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df8cd8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 0x7f1df410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df8cd8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df410eb20 con 0x7f1df40fd190 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df8cd8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df410ec60 con 0x7f1df40fc830 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 0x7f1df410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 0x7f1df410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39162/0 (socket says 172.21.15.49:39162) 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df1d9b700 1 -- 172.21.15.49:0/2536408473 learned_addr learned my addr 172.21.15.49:0/2536408473 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df259c700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1df40fc830 0x7f1df410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df1d9b700 1 -- 172.21.15.49:0/2536408473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1df40fc830 msgr2=0x7f1df410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df1d9b700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1df40fc830 0x7f1df410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df1d9b700 1 -- 172.21.15.49:0/2536408473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de4005040 con 0x7f1df40fd190 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.310+0000 7f1df1d9b700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 0x7f1df410e520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f1de40099f0 tx=0x7f1de4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.311+0000 7f1de37fe700 1 -- 172.21.15.49:0/2536408473 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1de400e030 con 0x7f1df40fd190 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.311+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df4108290 con 0x7f1df40fd190 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.311+0000 7f1de37fe700 1 -- 172.21.15.49:0/2536408473 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1de4007e90 con 0x7f1df40fd190 2024-02-22T00:48:51.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.311+0000 7f1de37fe700 1 -- 172.21.15.49:0/2536408473 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1de4018070 con 0x7f1df40fd190 2024-02-22T00:48:51.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.311+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df41087f0 con 0x7f1df40fd190 2024-02-22T00:48:51.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.312+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df405f570 con 0x7f1df40fd190 2024-02-22T00:48:51.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.312+0000 7f1de37fe700 1 -- 172.21.15.49:0/2536408473 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1de40094c0 con 0x7f1df40fd190 2024-02-22T00:48:51.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.313+0000 7f1de37fe700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1ddc06caa0 0x7f1ddc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:51.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.313+0000 7f1de37fe700 1 -- 172.21.15.49:0/2536408473 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1de408d010 con 0x7f1df40fd190 2024-02-22T00:48:51.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.313+0000 7f1df259c700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1ddc06caa0 0x7f1ddc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:51.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.313+0000 7f1df259c700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1ddc06caa0 0x7f1ddc06ef60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f1de8004dc0 tx=0x7f1de800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:51.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.317+0000 7f1de37fe700 1 -- 172.21.15.49:0/2536408473 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1de405ab70 con 0x7f1df40fd190 2024-02-22T00:48:51.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.523+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1df4108e30 con 0x7f1ddc06caa0 2024-02-22T00:48:51.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.533+0000 7f1de37fe700 1 -- 172.21.15.49:0/2536408473 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f1df4108e30 con 0x7f1ddc06caa0 2024-02-22T00:48:51.535 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:48:51.535 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (12m) 5m ago 23m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:48:51.535 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (9m) 5m ago 23m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:48:51.535 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (9m) 5m ago 22m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:48:51.535 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (11m) 5m ago 22m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:48:51.535 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (6m) 5m ago 18m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (6m) 5m ago 18m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (5m) 5m ago 18m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (5m) 5m ago 18m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (13m) 5m ago 24m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (12m) 5m ago 22m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (10m) 5m ago 24m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (10m) 5m ago 22m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (12m) 5m ago 22m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (12m) 5m ago 22m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (9m) 5m ago 21m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (8m) 5m ago 21m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (8m) 5m ago 20m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (7m) 5m ago 20m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:48:51.536 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (7m) 5m ago 20m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:48:51.537 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (6m) 5m ago 19m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:48:51.537 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (12m) 5m ago 22m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:48:51.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1ddc06caa0 msgr2=0x7f1ddc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1ddc06caa0 0x7f1ddc06ef60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f1de8004dc0 tx=0x7f1de800b040).stop 2024-02-22T00:48:51.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 msgr2=0x7f1df410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 0x7f1df410e520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f1de40099f0 tx=0x7f1de4009cb0).stop 2024-02-22T00:48:51.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 shutdown_connections 2024-02-22T00:48:51.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1ddc06caa0 0x7f1ddc06ef60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1df40fc830 0x7f1df410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 --2- 172.21.15.49:0/2536408473 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1df40fd190 0x7f1df410e520 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 >> 172.21.15.49:0/2536408473 conn(0x7f1df406c760 msgr2=0x7f1df4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:51.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 shutdown_connections 2024-02-22T00:48:51.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.535+0000 7f1df8cd8700 1 -- 172.21.15.49:0/2536408473 wait complete. 2024-02-22T00:48:51.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.636+0000 7f97f5fb2700 1 -- 172.21.15.49:0/3129954819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f8900 msgr2=0x7f97f00f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.636+0000 7f97f5fb2700 1 --2- 172.21.15.49:0/3129954819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f8900 0x7f97f00f8ce0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f97e00047f0 tx=0x7f97e0009cb0).stop 2024-02-22T00:48:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.636+0000 7f97f5fb2700 1 -- 172.21.15.49:0/3129954819 shutdown_connections 2024-02-22T00:48:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.636+0000 7f97f5fb2700 1 --2- 172.21.15.49:0/3129954819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f00f9260 0x7f97f0101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.636+0000 7f97f5fb2700 1 --2- 172.21.15.49:0/3129954819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f8900 0x7f97f00f8ce0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.636+0000 7f97f5fb2700 1 -- 172.21.15.49:0/3129954819 >> 172.21.15.49:0/3129954819 conn(0x7f97f0070590 msgr2=0x7f97f00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.636+0000 7f97f5fb2700 1 -- 172.21.15.49:0/3129954819 shutdown_connections 2024-02-22T00:48:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.636+0000 7f97f5fb2700 1 -- 172.21.15.49:0/3129954819 wait complete. 2024-02-22T00:48:51.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97f5fb2700 1 Processor -- start 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97f5fb2700 1 -- start start 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97f5fb2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f00f8900 0x7f97f00f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97f5fb2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f9260 0x7f97f00f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97f5fb2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00f7290 con 0x7f97f00f9260 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97f5fb2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00f73d0 con 0x7f97f00f8900 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97eeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f9260 0x7f97f00f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97eeffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f9260 0x7f97f00f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54826/0 (socket says 172.21.15.49:54826) 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97eeffd700 1 -- 172.21.15.49:0/4198719793 learned_addr learned my addr 172.21.15.49:0/4198719793 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.637+0000 7f97ef7fe700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f00f8900 0x7f97f00f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:51.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97eeffd700 1 -- 172.21.15.49:0/4198719793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f00f8900 msgr2=0x7f97f00f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97eeffd700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f00f8900 0x7f97f00f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97eeffd700 1 -- 172.21.15.49:0/4198719793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e0005040 con 0x7f97f00f9260 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97eeffd700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f9260 0x7f97f00f6da0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f97e400e910 tx=0x7f97e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97ecff9700 1 -- 172.21.15.49:0/4198719793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e4007b40 con 0x7f97f00f9260 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f00f7620 con 0x7f97f00f9260 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97ecff9700 1 -- 172.21.15.49:0/4198719793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f97e400f040 con 0x7f97f00f9260 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97ecff9700 1 -- 172.21.15.49:0/4198719793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97e4014920 con 0x7f97f00f9260 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.638+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f0114730 con 0x7f97f00f9260 2024-02-22T00:48:51.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.639+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f005f590 con 0x7f97f00f9260 2024-02-22T00:48:51.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.640+0000 7f97ecff9700 1 -- 172.21.15.49:0/4198719793 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f97e4007ca0 con 0x7f97f00f9260 2024-02-22T00:48:51.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.640+0000 7f97ecff9700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f97d806caa0 0x7f97d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:51.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.640+0000 7f97ecff9700 1 -- 172.21.15.49:0/4198719793 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f97e408b7d0 con 0x7f97f00f9260 2024-02-22T00:48:51.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.640+0000 7f97ef7fe700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f97d806caa0 0x7f97d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:51.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.640+0000 7f97ef7fe700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f97d806caa0 0x7f97d806ef60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f97e00047c0 tx=0x7f97e0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:51.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.644+0000 7f97ecff9700 1 -- 172.21.15.49:0/4198719793 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f97e40558a0 con 0x7f97f00f9260 2024-02-22T00:48:51.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.923+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97f00f7e30 con 0x7f97f00f9260 2024-02-22T00:48:51.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.923+0000 7f97ecff9700 1 -- 172.21.15.49:0/4198719793 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f97e4055030 con 0x7f97f00f9260 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:48:51.926 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:48:51.927 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:48:51.927 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:48:51.927 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:48:51.927 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:48:51.927 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:48:51.927 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f97d806caa0 msgr2=0x7f97d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f97d806caa0 0x7f97d806ef60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f97e00047c0 tx=0x7f97e0009cb0).stop 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f9260 msgr2=0x7f97f00f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f9260 0x7f97f00f6da0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f97e400e910 tx=0x7f97e400b040).stop 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 shutdown_connections 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f97d806caa0 0x7f97d806ef60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97f00f8900 0x7f97f00f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 --2- 172.21.15.49:0/4198719793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f97f00f9260 0x7f97f00f6da0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.925+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 >> 172.21.15.49:0/4198719793 conn(0x7f97f0070590 msgr2=0x7f97f0101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.926+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 shutdown_connections 2024-02-22T00:48:51.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:51.926+0000 7f97f5fb2700 1 -- 172.21.15.49:0/4198719793 wait complete. 2024-02-22T00:48:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.027+0000 7f0c69356700 1 -- 172.21.15.49:0/1425826106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fc7f0 msgr2=0x7f0c640fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.027+0000 7f0c69356700 1 --2- 172.21.15.49:0/1425826106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fc7f0 0x7f0c640fcbd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f0c540047f0 tx=0x7f0c54009cb0).stop 2024-02-22T00:48:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.027+0000 7f0c69356700 1 -- 172.21.15.49:0/1425826106 shutdown_connections 2024-02-22T00:48:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.027+0000 7f0c69356700 1 --2- 172.21.15.49:0/1425826106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c640fd150 0x7f0c640f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:48:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.027+0000 7f0c69356700 1 --2- 172.21.15.49:0/1425826106 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fc7f0 0x7f0c640fcbd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.027+0000 7f0c69356700 1 -- 172.21.15.49:0/1425826106 >> 172.21.15.49:0/1425826106 conn(0x7f0c64070590 msgr2=0x7f0c640f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.027+0000 7f0c69356700 1 -- 172.21.15.49:0/1425826106 shutdown_connections 2024-02-22T00:48:52.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.027+0000 7f0c69356700 1 -- 172.21.15.49:0/1425826106 wait complete. 2024-02-22T00:48:52.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.028+0000 7f0c69356700 1 Processor -- start 2024-02-22T00:48:52.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.028+0000 7f0c69356700 1 -- start start 2024-02-22T00:48:52.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c69356700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c640fc7f0 0x7f0c6410cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c69356700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fd150 0x7f0c6410d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c69356700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6410daf0 con 0x7f0c640fd150 2024-02-22T00:48:52.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c69356700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64107110 con 0x7f0c640fc7f0 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c5a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fd150 0x7f0c6410d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c5a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fd150 0x7f0c6410d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54856/0 (socket says 172.21.15.49:54856) 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c5a7fc700 1 -- 172.21.15.49:0/1421991467 learned_addr learned my addr 172.21.15.49:0/1421991467 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c62ffd700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c640fc7f0 0x7f0c6410cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c5a7fc700 1 -- 172.21.15.49:0/1421991467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c640fc7f0 msgr2=0x7f0c6410cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c5a7fc700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c640fc7f0 0x7f0c6410cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c5a7fc700 1 -- 172.21.15.49:0/1421991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c54005040 con 0x7f0c640fd150 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c62ffd700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c640fc7f0 0x7f0c6410cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c5a7fc700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fd150 0x7f0c6410d460 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0c4c00b480 tx=0x7f0c4c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.029+0000 7f0c60ff9700 1 -- 172.21.15.49:0/1421991467 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c4c002500 con 0x7f0c640fd150 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.030+0000 7f0c60ff9700 1 -- 172.21.15.49:0/1421991467 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0c4c002b10 con 0x7f0c640fd150 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.030+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c641073c0 con 0x7f0c640fd150 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.030+0000 7f0c60ff9700 1 -- 172.21.15.49:0/1421991467 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c4c012c90 con 0x7f0c640fd150 2024-02-22T00:48:52.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.030+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c64107900 con 0x7f0c640fd150 2024-02-22T00:48:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.031+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6405f590 con 0x7f0c640fd150 2024-02-22T00:48:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.031+0000 7f0c60ff9700 1 -- 172.21.15.49:0/1421991467 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0c4c002660 con 0x7f0c640fd150 2024-02-22T00:48:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.032+0000 7f0c60ff9700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0c5006caa0 0x7f0c5006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.032+0000 7f0c60ff9700 1 -- 172.21.15.49:0/1421991467 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0c4c08be40 con 0x7f0c640fd150 2024-02-22T00:48:52.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.032+0000 7f0c62ffd700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0c5006caa0 0x7f0c5006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.032+0000 7f0c62ffd700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0c5006caa0 0x7f0c5006ef60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0c54007cf0 tx=0x7f0c5400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:52.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.036+0000 7f0c60ff9700 1 -- 172.21.15.49:0/1421991467 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0c4c0599a0 con 0x7f0c640fd150 2024-02-22T00:48:52.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.275+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0c64047540 con 0x7f0c640fd150 2024-02-22T00:48:52.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.275+0000 7f0c60ff9700 1 -- 172.21.15.49:0/1421991467 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f0c4c059530 con 0x7f0c640fd150 2024-02-22T00:48:52.277 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:48:52.277 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:48:52.278 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:48:52.279 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:48:52.280 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0c5006caa0 msgr2=0x7f0c5006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0c5006caa0 0x7f0c5006ef60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0c54007cf0 tx=0x7f0c5400b040).stop 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fd150 msgr2=0x7f0c6410d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fd150 0x7f0c6410d460 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0c4c00b480 tx=0x7f0c4c0090f0).stop 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 shutdown_connections 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0c5006caa0 0x7f0c5006ef60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c640fc7f0 0x7f0c6410cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 --2- 172.21.15.49:0/1421991467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0c640fd150 0x7f0c6410d460 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 >> 172.21.15.49:0/1421991467 conn(0x7f0c64070590 msgr2=0x7f0c640fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:52.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 shutdown_connections 2024-02-22T00:48:52.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.277+0000 7f0c69356700 1 -- 172.21.15.49:0/1421991467 wait complete. 2024-02-22T00:48:52.282 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:48:52.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.380+0000 7fd045e8a700 1 -- 172.21.15.49:0/338996672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f91d0 msgr2=0x7fd040101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.380+0000 7fd045e8a700 1 --2- 172.21.15.49:0/338996672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f91d0 0x7fd040101970 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fd0340047f0 tx=0x7fd034009cb0).stop 2024-02-22T00:48:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.380+0000 7fd045e8a700 1 -- 172.21.15.49:0/338996672 shutdown_connections 2024-02-22T00:48:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.380+0000 7fd045e8a700 1 --2- 172.21.15.49:0/338996672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f91d0 0x7fd040101970 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.380+0000 7fd045e8a700 1 --2- 172.21.15.49:0/338996672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400f8900 0x7fd0400f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.380+0000 7fd045e8a700 1 -- 172.21.15.49:0/338996672 >> 172.21.15.49:0/338996672 conn(0x7fd0400f23b0 msgr2=0x7fd0400f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.380+0000 7fd045e8a700 1 -- 172.21.15.49:0/338996672 shutdown_connections 2024-02-22T00:48:52.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.380+0000 7fd045e8a700 1 -- 172.21.15.49:0/338996672 wait complete. 2024-02-22T00:48:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.381+0000 7fd045e8a700 1 Processor -- start 2024-02-22T00:48:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd045e8a700 1 -- start start 2024-02-22T00:48:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd045e8a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f8900 0x7fd04010e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd045e8a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400f91d0 0x7fd04010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd045e8a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04010eb50 con 0x7fd0400f8900 2024-02-22T00:48:52.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd045e8a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04010ec90 con 0x7fd0400f91d0 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd03f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f8900 0x7fd04010e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd03f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f8900 0x7fd04010e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54878/0 (socket says 172.21.15.49:54878) 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd03f7fe700 1 -- 172.21.15.49:0/2092976085 learned_addr learned my addr 172.21.15.49:0/2092976085 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd03effd700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400f91d0 0x7fd04010e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd03f7fe700 1 -- 172.21.15.49:0/2092976085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400f91d0 msgr2=0x7fd04010e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd03f7fe700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400f91d0 0x7fd04010e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd03f7fe700 1 -- 172.21.15.49:0/2092976085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034005040 con 0x7fd0400f8900 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.382+0000 7fd03f7fe700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f8900 0x7fd04010e060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fd0300041d0 tx=0x7fd030009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.383+0000 7fd03cff9700 1 -- 172.21.15.49:0/2092976085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd030007b40 con 0x7fd0400f8900 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.383+0000 7fd03cff9700 1 -- 172.21.15.49:0/2092976085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd03000f040 con 0x7fd0400f8900 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.383+0000 7fd03cff9700 1 -- 172.21.15.49:0/2092976085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0300147b0 con 0x7fd0400f8900 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.383+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd040108320 con 0x7fd0400f8900 2024-02-22T00:48:52.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.383+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd040108810 con 0x7fd0400f8900 2024-02-22T00:48:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.384+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd040060370 con 0x7fd0400f8900 2024-02-22T00:48:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.384+0000 7fd03cff9700 1 -- 172.21.15.49:0/2092976085 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd030009110 con 0x7fd0400f8900 2024-02-22T00:48:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.384+0000 7fd03cff9700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02806caa0 0x7fd02806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.385+0000 7fd03cff9700 1 -- 172.21.15.49:0/2092976085 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd03008bda0 con 0x7fd0400f8900 2024-02-22T00:48:52.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.385+0000 7fd03effd700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02806caa0 0x7fd02806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.385+0000 7fd03effd700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02806caa0 0x7fd02806ef60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fd0401099a0 tx=0x7fd03400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:52.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.389+0000 7fd03cff9700 1 -- 172.21.15.49:0/2092976085 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd030059900 con 0x7fd0400f8900 2024-02-22T00:48:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:52 smithi161 ceph-mon[113442]: pgmap v358: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:52 smithi161 ceph-mon[113442]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:52 smithi161 ceph-mon[113442]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:52 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4198719793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:48:52.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.606+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd040108ae0 con 0x7fd02806caa0 2024-02-22T00:48:52.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.607+0000 7fd03cff9700 1 -- 172.21.15.49:0/2092976085 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd040108ae0 con 0x7fd02806caa0 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:48:52.610 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:48:52.611 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:48:52.611 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.609+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02806caa0 msgr2=0x7fd02806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.609+0000 7fd045e8a700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02806caa0 0x7fd02806ef60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fd0401099a0 tx=0x7fd03400b040).stop 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f8900 msgr2=0x7fd04010e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f8900 0x7fd04010e060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fd0300041d0 tx=0x7fd030009f60).stop 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 shutdown_connections 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02806caa0 0x7fd02806ef60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400f8900 0x7fd04010e060 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 --2- 172.21.15.49:0/2092976085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400f91d0 0x7fd04010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 >> 172.21.15.49:0/2092976085 conn(0x7fd0400f23b0 msgr2=0x7fd040100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 shutdown_connections 2024-02-22T00:48:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.610+0000 7fd045e8a700 1 -- 172.21.15.49:0/2092976085 wait complete. 2024-02-22T00:48:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:52 smithi049 ceph-mon[132694]: pgmap v358: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:52 smithi049 ceph-mon[132694]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:52 smithi049 ceph-mon[132694]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:52 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4198719793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:48:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.711+0000 7fefae86d700 1 -- 172.21.15.49:0/2250820186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fd8f0 msgr2=0x7fefa80fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.711+0000 7fefae86d700 1 --2- 172.21.15.49:0/2250820186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fd8f0 0x7fefa80fdcd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fef980047f0 tx=0x7fef98009cb0).stop 2024-02-22T00:48:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.711+0000 7fefae86d700 1 -- 172.21.15.49:0/2250820186 shutdown_connections 2024-02-22T00:48:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.711+0000 7fefae86d700 1 --2- 172.21.15.49:0/2250820186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefa80fe250 0x7fefa80f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:48:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.711+0000 7fefae86d700 1 --2- 172.21.15.49:0/2250820186 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fd8f0 0x7fefa80fdcd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.712+0000 7fefae86d700 1 -- 172.21.15.49:0/2250820186 >> 172.21.15.49:0/2250820186 conn(0x7fefa80f34b0 msgr2=0x7fefa80f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.712+0000 7fefae86d700 1 -- 172.21.15.49:0/2250820186 shutdown_connections 2024-02-22T00:48:52.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.712+0000 7fefae86d700 1 -- 172.21.15.49:0/2250820186 wait complete. 2024-02-22T00:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.712+0000 7fefae86d700 1 Processor -- start 2024-02-22T00:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.712+0000 7fefae86d700 1 -- start start 2024-02-22T00:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefae86d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefa80fd8f0 0x7fefa810e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefae86d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fe250 0x7fefa810e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefae86d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa810ec80 con 0x7fefa80fe250 2024-02-22T00:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefae86d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81082a0 con 0x7fefa80fd8f0 2024-02-22T00:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefa77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fe250 0x7fefa810e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefa77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fe250 0x7fefa810e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54890/0 (socket says 172.21.15.49:54890) 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefa77fe700 1 -- 172.21.15.49:0/1146661949 learned_addr learned my addr 172.21.15.49:0/1146661949 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefa7fff700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefa80fd8f0 0x7fefa810e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefa77fe700 1 -- 172.21.15.49:0/1146661949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefa80fd8f0 msgr2=0x7fefa810e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefa77fe700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefa80fd8f0 0x7fefa810e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.713+0000 7fefa77fe700 1 -- 172.21.15.49:0/1146661949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98005040 con 0x7fefa80fe250 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.714+0000 7fefa77fe700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fe250 0x7fefa810e5f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fef9c00b480 tx=0x7fef9c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.714+0000 7fefa57fa700 1 -- 172.21.15.49:0/1146661949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9c002500 con 0x7fefa80fe250 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.714+0000 7fefa57fa700 1 -- 172.21.15.49:0/1146661949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef9c002b10 con 0x7fefa80fe250 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.714+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa8108550 con 0x7fefa80fe250 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.714+0000 7fefa57fa700 1 -- 172.21.15.49:0/1146661949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9c012c90 con 0x7fefa80fe250 2024-02-22T00:48:52.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.714+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa8108a90 con 0x7fefa80fe250 2024-02-22T00:48:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.715+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa805f590 con 0x7fefa80fe250 2024-02-22T00:48:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.715+0000 7fefa57fa700 1 -- 172.21.15.49:0/1146661949 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fef9c002660 con 0x7fefa80fe250 2024-02-22T00:48:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.716+0000 7fefa57fa700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef9006caa0 0x7fef9006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:48:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.716+0000 7fefa57fa700 1 -- 172.21.15.49:0/1146661949 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fef9c08be40 con 0x7fefa80fe250 2024-02-22T00:48:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.716+0000 7fefa7fff700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef9006caa0 0x7fef9006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:48:52.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.716+0000 7fefa7fff700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef9006caa0 0x7fef9006ef60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fef98007cf0 tx=0x7fef9800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:48:52.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:52.720+0000 7fefa57fa700 1 -- 172.21.15.49:0/1146661949 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fef9c0599a0 con 0x7fefa80fe250 2024-02-22T00:48:53.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.001+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fefa8047540 con 0x7fefa80fe250 2024-02-22T00:48:53.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.002+0000 7fefa57fa700 1 -- 172.21.15.49:0/1146661949 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fef9c059530 con 0x7fefa80fe250 2024-02-22T00:48:53.004 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:48:53.004 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:48:53.004 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:48:53.004 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:48:53.004 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef9006caa0 msgr2=0x7fef9006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef9006caa0 0x7fef9006ef60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fef98007cf0 tx=0x7fef9800b040).stop 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fe250 msgr2=0x7fefa810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fe250 0x7fefa810e5f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fef9c00b480 tx=0x7fef9c0090f0).stop 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 shutdown_connections 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef9006caa0 0x7fef9006ef60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fefa80fd8f0 0x7fefa810e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 --2- 172.21.15.49:0/1146661949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fefa80fe250 0x7fefa810e5f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 >> 172.21.15.49:0/1146661949 conn(0x7fefa80f34b0 msgr2=0x7fefa80fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 shutdown_connections 2024-02-22T00:48:53.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:48:53.004+0000 7fefae86d700 1 -- 172.21.15.49:0/1146661949 wait complete. 2024-02-22T00:48:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:53 smithi161 ceph-mon[113442]: from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:53 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1421991467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:48:53.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:53 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1146661949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:48:53.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:53 smithi049 ceph-mon[132694]: from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:53.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:53 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1421991467' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:48:53.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:53 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1146661949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:48:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:54 smithi161 ceph-mon[113442]: pgmap v359: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:54 smithi161 ceph-mon[113442]: from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:54 smithi049 ceph-mon[132694]: pgmap v359: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:54 smithi049 ceph-mon[132694]: from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:48:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:56 smithi161 ceph-mon[113442]: pgmap v360: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:56.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:56 smithi049 ceph-mon[132694]: pgmap v360: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:58 smithi161 ceph-mon[113442]: pgmap v361: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:48:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:48:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:58 smithi049 ceph-mon[132694]: pgmap v361: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:48:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:48:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:00 smithi161 ceph-mon[113442]: pgmap v362: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:00.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:00 smithi049 ceph-mon[132694]: pgmap v362: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:02 smithi161 ceph-mon[113442]: pgmap v363: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:02 smithi049 ceph-mon[132694]: pgmap v363: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:04.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:04 smithi161 ceph-mon[113442]: pgmap v364: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:04 smithi049 ceph-mon[132694]: pgmap v364: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:06 smithi161 ceph-mon[113442]: pgmap v365: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:06 smithi049 ceph-mon[132694]: pgmap v365: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:08 smithi161 ceph-mon[113442]: pgmap v366: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:08 smithi049 ceph-mon[132694]: pgmap v366: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:10 smithi049 ceph-mon[132694]: pgmap v367: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:10 smithi161 ceph-mon[113442]: pgmap v367: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:12 smithi049 ceph-mon[132694]: pgmap v368: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:12.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:12 smithi161 ceph-mon[113442]: pgmap v368: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:14 smithi049 ceph-mon[132694]: pgmap v369: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:14.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:14 smithi161 ceph-mon[113442]: pgmap v369: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:16.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:16 smithi049 ceph-mon[132694]: pgmap v370: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:16 smithi161 ceph-mon[113442]: pgmap v370: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:17.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:17 smithi049 ceph-mon[132694]: pgmap v371: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:17 smithi161 ceph-mon[113442]: pgmap v371: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:19.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:19 smithi161 ceph-mon[113442]: pgmap v372: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:19.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:19 smithi049 ceph-mon[132694]: pgmap v372: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:22 smithi049 ceph-mon[132694]: pgmap v373: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:22 smithi161 ceph-mon[113442]: pgmap v373: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.121+0000 7f9216e03700 1 -- 172.21.15.49:0/957665688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f9260 msgr2=0x7f9210101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.121+0000 7f9216e03700 1 --2- 172.21.15.49:0/957665688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f9260 0x7f9210101970 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f91fc0047f0 tx=0x7f91fc009cb0).stop 2024-02-22T00:49:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.121+0000 7f9216e03700 1 -- 172.21.15.49:0/957665688 shutdown_connections 2024-02-22T00:49:23.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.121+0000 7f9216e03700 1 --2- 172.21.15.49:0/957665688 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f9260 0x7f9210101970 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.121+0000 7f9216e03700 1 --2- 172.21.15.49:0/957665688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92100f8900 0x7f92100f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.121+0000 7f9216e03700 1 -- 172.21.15.49:0/957665688 >> 172.21.15.49:0/957665688 conn(0x7f9210070590 msgr2=0x7f92100f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.121+0000 7f9216e03700 1 -- 172.21.15.49:0/957665688 shutdown_connections 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.121+0000 7f9216e03700 1 -- 172.21.15.49:0/957665688 wait complete. 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9216e03700 1 Processor -- start 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9216e03700 1 -- start start 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9216e03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f8900 0x7f9210110220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9216e03700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92100f9260 0x7f9210110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9216e03700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9210110d10 con 0x7f92100f8900 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9216e03700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9210110e50 con 0x7f92100f9260 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9214b9f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f8900 0x7f9210110220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9214b9f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f8900 0x7f9210110220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37998/0 (socket says 172.21.15.49:37998) 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.122+0000 7f9214b9f700 1 -- 172.21.15.49:0/4205506467 learned_addr learned my addr 172.21.15.49:0/4205506467 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:23.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f920ffff700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92100f9260 0x7f9210110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f9214b9f700 1 -- 172.21.15.49:0/4205506467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92100f9260 msgr2=0x7f9210110710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f9214b9f700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92100f9260 0x7f9210110710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f9214b9f700 1 -- 172.21.15.49:0/4205506467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc005040 con 0x7f92100f8900 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f9214b9f700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f8900 0x7f9210110220 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f92040041d0 tx=0x7f9204009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f920dffb700 1 -- 172.21.15.49:0/4205506467 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9204007b40 con 0x7f92100f8900 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f920dffb700 1 -- 172.21.15.49:0/4205506467 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f920400f040 con 0x7f92100f8900 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f920dffb700 1 -- 172.21.15.49:0/4205506467 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92040147b0 con 0x7f92100f8900 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921010a4e0 con 0x7f92100f8900 2024-02-22T00:49:23.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.123+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921010aa20 con 0x7f92100f8900 2024-02-22T00:49:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.124+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921005f590 con 0x7f92100f8900 2024-02-22T00:49:23.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.125+0000 7f920dffb700 1 -- 172.21.15.49:0/4205506467 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9204009110 con 0x7f92100f8900 2024-02-22T00:49:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.125+0000 7f920dffb700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920006caa0 0x7f920006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.125+0000 7f920dffb700 1 -- 172.21.15.49:0/4205506467 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f920408bda0 con 0x7f92100f8900 2024-02-22T00:49:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.125+0000 7f920ffff700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920006caa0 0x7f920006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:23.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.126+0000 7f920ffff700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920006caa0 0x7f920006ef60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f91fc009ee0 tx=0x7f91fc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:23.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.130+0000 7f920dffb700 1 -- 172.21.15.49:0/4205506467 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9204059900 con 0x7f92100f8900 2024-02-22T00:49:23.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.348+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f921010aca0 con 0x7f920006caa0 2024-02-22T00:49:23.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.349+0000 7f920dffb700 1 -- 172.21.15.49:0/4205506467 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f921010aca0 con 0x7f920006caa0 2024-02-22T00:49:23.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920006caa0 msgr2=0x7f920006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920006caa0 0x7f920006ef60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f91fc009ee0 tx=0x7f91fc00b040).stop 2024-02-22T00:49:23.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f8900 msgr2=0x7f9210110220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f8900 0x7f9210110220 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f92040041d0 tx=0x7f9204009f60).stop 2024-02-22T00:49:23.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 shutdown_connections 2024-02-22T00:49:23.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f920006caa0 0x7f920006ef60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92100f8900 0x7f9210110220 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 --2- 172.21.15.49:0/4205506467 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92100f9260 0x7f9210110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 >> 172.21.15.49:0/4205506467 conn(0x7f9210070590 msgr2=0x7f92100f6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 shutdown_connections 2024-02-22T00:49:23.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.351+0000 7f9216e03700 1 -- 172.21.15.49:0/4205506467 wait complete. 2024-02-22T00:49:23.363 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:49:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.454+0000 7f8455286700 1 -- 172.21.15.49:0/2384786044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fc7f0 msgr2=0x7f84500fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.454+0000 7f8455286700 1 --2- 172.21.15.49:0/2384786044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fc7f0 0x7f84500fcbd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f84400047f0 tx=0x7f8440009cb0).stop 2024-02-22T00:49:23.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.454+0000 7f8455286700 1 -- 172.21.15.49:0/2384786044 shutdown_connections 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.454+0000 7f8455286700 1 --2- 172.21.15.49:0/2384786044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84500fd150 0x7f84500f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.454+0000 7f8455286700 1 --2- 172.21.15.49:0/2384786044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fc7f0 0x7f84500fcbd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.454+0000 7f8455286700 1 -- 172.21.15.49:0/2384786044 >> 172.21.15.49:0/2384786044 conn(0x7f84500f23b0 msgr2=0x7f84500f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.454+0000 7f8455286700 1 -- 172.21.15.49:0/2384786044 shutdown_connections 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.454+0000 7f8455286700 1 -- 172.21.15.49:0/2384786044 wait complete. 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.455+0000 7f8455286700 1 Processor -- start 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.455+0000 7f8455286700 1 -- start start 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.455+0000 7f8455286700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84500fc7f0 0x7f845010cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.455+0000 7f8455286700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fd150 0x7f845010d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.455+0000 7f8455286700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845010da10 con 0x7f84500fd150 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.455+0000 7f8455286700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845010db50 con 0x7f84500fc7f0 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f844e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fd150 0x7f845010d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f844e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fd150 0x7f845010d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38006/0 (socket says 172.21.15.49:38006) 2024-02-22T00:49:23.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f844e7fc700 1 -- 172.21.15.49:0/3761543472 learned_addr learned my addr 172.21.15.49:0/3761543472 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f844effd700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84500fc7f0 0x7f845010cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f844e7fc700 1 -- 172.21.15.49:0/3761543472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84500fc7f0 msgr2=0x7f845010cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f844e7fc700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84500fc7f0 0x7f845010cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f844e7fc700 1 -- 172.21.15.49:0/3761543472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440005040 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f844e7fc700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fd150 0x7f845010d410 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f843800c710 tx=0x7f8438007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f8447fff700 1 -- 172.21.15.49:0/3761543472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f843800e680 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f8447fff700 1 -- 172.21.15.49:0/3761543472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f843800ec90 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84501071e0 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f8447fff700 1 -- 172.21.15.49:0/3761543472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8438013d40 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.456+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84501077a0 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.457+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8450060370 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.458+0000 7f8447fff700 1 -- 172.21.15.49:0/3761543472 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f843800e7e0 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.458+0000 7f8447fff700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f843c06caa0 0x7f843c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.458+0000 7f8447fff700 1 -- 172.21.15.49:0/3761543472 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f843808bbb0 con 0x7f84500fd150 2024-02-22T00:49:23.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.458+0000 7f844effd700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f843c06caa0 0x7f843c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:23.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.459+0000 7f844effd700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f843c06caa0 0x7f843c06ef60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f8440007cf0 tx=0x7f844000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:23.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.462+0000 7f8447fff700 1 -- 172.21.15.49:0/3761543472 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8438092080 con 0x7f84500fd150 2024-02-22T00:49:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.678+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84501086b0 con 0x7f843c06caa0 2024-02-22T00:49:23.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.680+0000 7f8447fff700 1 -- 172.21.15.49:0/3761543472 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f84501086b0 con 0x7f843c06caa0 2024-02-22T00:49:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f843c06caa0 msgr2=0x7f843c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f843c06caa0 0x7f843c06ef60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f8440007cf0 tx=0x7f844000b040).stop 2024-02-22T00:49:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fd150 msgr2=0x7f845010d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fd150 0x7f845010d410 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f843800c710 tx=0x7f8438007ec0).stop 2024-02-22T00:49:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 shutdown_connections 2024-02-22T00:49:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f843c06caa0 0x7f843c06ef60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84500fc7f0 0x7f845010cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 --2- 172.21.15.49:0/3761543472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84500fd150 0x7f845010d410 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 >> 172.21.15.49:0/3761543472 conn(0x7f84500f23b0 msgr2=0x7f84500fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:23.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 shutdown_connections 2024-02-22T00:49:23.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.682+0000 7f8455286700 1 -- 172.21.15.49:0/3761543472 wait complete. 2024-02-22T00:49:23.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.784+0000 7f354aed2700 1 -- 172.21.15.49:0/2413587815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 msgr2=0x7f35440fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.784+0000 7f354aed2700 1 --2- 172.21.15.49:0/2413587815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 0x7f35440fdcd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f35380047f0 tx=0x7f3538009cb0).stop 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.784+0000 7f354aed2700 1 -- 172.21.15.49:0/2413587815 shutdown_connections 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.784+0000 7f354aed2700 1 --2- 172.21.15.49:0/2413587815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35440fe250 0x7f35440f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.784+0000 7f354aed2700 1 --2- 172.21.15.49:0/2413587815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 0x7f35440fdcd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.784+0000 7f354aed2700 1 -- 172.21.15.49:0/2413587815 >> 172.21.15.49:0/2413587815 conn(0x7f35440f34b0 msgr2=0x7f35440f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.784+0000 7f354aed2700 1 -- 172.21.15.49:0/2413587815 shutdown_connections 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.784+0000 7f354aed2700 1 -- 172.21.15.49:0/2413587815 wait complete. 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f354aed2700 1 Processor -- start 2024-02-22T00:49:23.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f354aed2700 1 -- start start 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f354aed2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 0x7f354406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f354aed2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35440fe250 0x7f354406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f354aed2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354406bab0 con 0x7f35440fd8f0 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f354aed2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354406bbf0 con 0x7f35440fe250 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f3548c6e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 0x7f354406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f3548c6e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 0x7f354406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38024/0 (socket says 172.21.15.49:38024) 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f3548c6e700 1 -- 172.21.15.49:0/2191736286 learned_addr learned my addr 172.21.15.49:0/2191736286 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f3548c6e700 1 -- 172.21.15.49:0/2191736286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35440fe250 msgr2=0x7f354406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f3548c6e700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35440fe250 0x7f354406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f3548c6e700 1 -- 172.21.15.49:0/2191736286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538005040 con 0x7f35440fd8f0 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.785+0000 7f3548c6e700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 0x7f354406b0d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f3538005010 tx=0x7f3538009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.786+0000 7f3541ffb700 1 -- 172.21.15.49:0/2191736286 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f353800e030 con 0x7f35440fd8f0 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.786+0000 7f3541ffb700 1 -- 172.21.15.49:0/2191736286 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3538007e90 con 0x7f35440fd8f0 2024-02-22T00:49:23.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.786+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354406be40 con 0x7f35440fd8f0 2024-02-22T00:49:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.786+0000 7f3541ffb700 1 -- 172.21.15.49:0/2191736286 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3538018070 con 0x7f35440fd8f0 2024-02-22T00:49:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.786+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35441145f0 con 0x7f35440fd8f0 2024-02-22T00:49:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.787+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354405f590 con 0x7f35440fd8f0 2024-02-22T00:49:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.787+0000 7f3541ffb700 1 -- 172.21.15.49:0/2191736286 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f353801d6e0 con 0x7f35440fd8f0 2024-02-22T00:49:23.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.788+0000 7f3541ffb700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f353406caa0 0x7f353406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:23.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.788+0000 7f3541ffb700 1 -- 172.21.15.49:0/2191736286 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f353808cfb0 con 0x7f35440fd8f0 2024-02-22T00:49:23.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.788+0000 7f3543fff700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f353406caa0 0x7f353406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:23.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.788+0000 7f3543fff700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f353406caa0 0x7f353406ef60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f354406c870 tx=0x7f3530009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:23.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:23.792+0000 7f3541ffb700 1 -- 172.21.15.49:0/2191736286 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3538057140 con 0x7f35440fd8f0 2024-02-22T00:49:24.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.002+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f35440ffcf0 con 0x7f353406caa0 2024-02-22T00:49:24.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.012+0000 7f3541ffb700 1 -- 172.21.15.49:0/2191736286 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f35440ffcf0 con 0x7f353406caa0 2024-02-22T00:49:24.014 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:49:24.014 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (12m) 6m ago 23m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:49:24.014 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (10m) 6m ago 23m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:49:24.014 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (10m) 5m ago 23m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:49:24.014 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (12m) 6m ago 23m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:49:24.014 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (6m) 6m ago 18m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (6m) 6m ago 18m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (6m) 5m ago 18m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (6m) 5m ago 18m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (14m) 6m ago 25m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (13m) 5m ago 23m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (11m) 6m ago 25m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (10m) 5m ago 23m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (13m) 6m ago 23m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (13m) 5m ago 22m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (9m) 6m ago 22m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (9m) 6m ago 21m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (8m) 6m ago 21m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (8m) 5m ago 21m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:49:24.015 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (7m) 5m ago 20m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:49:24.016 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (7m) 5m ago 20m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:49:24.016 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (12m) 5m ago 22m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:49:24.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f353406caa0 msgr2=0x7f353406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f353406caa0 0x7f353406ef60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f354406c870 tx=0x7f3530009b60).stop 2024-02-22T00:49:24.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 msgr2=0x7f354406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 0x7f354406b0d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f3538005010 tx=0x7f3538009cb0).stop 2024-02-22T00:49:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 shutdown_connections 2024-02-22T00:49:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f353406caa0 0x7f353406ef60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f35440fd8f0 0x7f354406b0d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 --2- 172.21.15.49:0/2191736286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35440fe250 0x7f354406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:49:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 >> 172.21.15.49:0/2191736286 conn(0x7f35440f34b0 msgr2=0x7f35440fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 shutdown_connections 2024-02-22T00:49:24.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.014+0000 7f354aed2700 1 -- 172.21.15.49:0/2191736286 wait complete. 2024-02-22T00:49:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.115+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/3208529205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 msgr2=0x7f9ad00f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.115+0000 7f9ad5f8d700 1 --2- 172.21.15.49:0/3208529205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 0x7f9ad00f8c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f9ac00047f0 tx=0x7f9ac0009cb0).stop 2024-02-22T00:49:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.115+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/3208529205 shutdown_connections 2024-02-22T00:49:24.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.115+0000 7f9ad5f8d700 1 --2- 172.21.15.49:0/3208529205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ad00f9200 0x7f9ad0101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.115+0000 7f9ad5f8d700 1 --2- 172.21.15.49:0/3208529205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 0x7f9ad00f8c80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.115+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/3208529205 >> 172.21.15.49:0/3208529205 conn(0x7f9ad0070590 msgr2=0x7f9ad00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.115+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/3208529205 shutdown_connections 2024-02-22T00:49:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.115+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/3208529205 wait complete. 2024-02-22T00:49:24.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9ad5f8d700 1 Processor -- start 2024-02-22T00:49:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9ad5f8d700 1 -- start start 2024-02-22T00:49:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9ad5f8d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 0x7f9ad010e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9ad5f8d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ad00f9200 0x7f9ad010e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9ad5f8d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad010eb10 con 0x7f9ad00f88a0 2024-02-22T00:49:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9ad5f8d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad010ec50 con 0x7f9ad00f9200 2024-02-22T00:49:24.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9acf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 0x7f9ad010e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9acf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 0x7f9ad010e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38036/0 (socket says 172.21.15.49:38036) 2024-02-22T00:49:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.116+0000 7f9acf7fe700 1 -- 172.21.15.49:0/440208748 learned_addr learned my addr 172.21.15.49:0/440208748 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9aceffd700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ad00f9200 0x7f9ad010e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9acf7fe700 1 -- 172.21.15.49:0/440208748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ad00f9200 msgr2=0x7f9ad010e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9acf7fe700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ad00f9200 0x7f9ad010e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9acf7fe700 1 -- 172.21.15.49:0/440208748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0005040 con 0x7f9ad00f88a0 2024-02-22T00:49:24.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9acf7fe700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 0x7f9ad010e020 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f9ac0005010 tx=0x7f9ac0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9accff9700 1 -- 172.21.15.49:0/440208748 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac000e030 con 0x7f9ad00f88a0 2024-02-22T00:49:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad0108280 con 0x7f9ad00f88a0 2024-02-22T00:49:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9accff9700 1 -- 172.21.15.49:0/440208748 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ac0007e90 con 0x7f9ad00f88a0 2024-02-22T00:49:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9accff9700 1 -- 172.21.15.49:0/440208748 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ac0018070 con 0x7f9ad00f88a0 2024-02-22T00:49:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.117+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad0108760 con 0x7f9ad00f88a0 2024-02-22T00:49:24.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.118+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad005f590 con 0x7f9ad00f88a0 2024-02-22T00:49:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.118+0000 7f9accff9700 1 -- 172.21.15.49:0/440208748 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9ac001d6e0 con 0x7f9ad00f88a0 2024-02-22T00:49:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.119+0000 7f9accff9700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9abc06ca30 0x7f9abc06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.119+0000 7f9accff9700 1 -- 172.21.15.49:0/440208748 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9ac008d050 con 0x7f9ad00f88a0 2024-02-22T00:49:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.119+0000 7f9aceffd700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9abc06ca30 0x7f9abc06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.119+0000 7f9aceffd700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9abc06ca30 0x7f9abc06eef0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9ad0109960 tx=0x7f9ab800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:24.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.123+0000 7f9accff9700 1 -- 172.21.15.49:0/440208748 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9ac005a920 con 0x7f9ad00f88a0 2024-02-22T00:49:24.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.408+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ad01097a0 con 0x7f9ad00f88a0 2024-02-22T00:49:24.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.408+0000 7f9accff9700 1 -- 172.21.15.49:0/440208748 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f9ac005a740 con 0x7f9ad00f88a0 2024-02-22T00:49:24.411 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:49:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:49:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:49:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:49:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:49:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:49:24.412 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:49:24.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9abc06ca30 msgr2=0x7f9abc06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9abc06ca30 0x7f9abc06eef0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f9ad0109960 tx=0x7f9ab800b040).stop 2024-02-22T00:49:24.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 msgr2=0x7f9ad010e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 0x7f9ad010e020 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f9ac0005010 tx=0x7f9ac0009cb0).stop 2024-02-22T00:49:24.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 shutdown_connections 2024-02-22T00:49:24.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9abc06ca30 0x7f9abc06eef0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ad00f88a0 0x7f9ad010e020 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 --2- 172.21.15.49:0/440208748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ad00f9200 0x7f9ad010e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.410+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 >> 172.21.15.49:0/440208748 conn(0x7f9ad0070590 msgr2=0x7f9ad00fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:24.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.411+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 shutdown_connections 2024-02-22T00:49:24.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.411+0000 7f9ad5f8d700 1 -- 172.21.15.49:0/440208748 wait complete. 2024-02-22T00:49:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:24 smithi049 ceph-mon[132694]: pgmap v374: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:24.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 -- 172.21.15.49:0/2212601477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 msgr2=0x7f0b100fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 --2- 172.21.15.49:0/2212601477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 0x7f0b100fcbd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f0b040047f0 tx=0x7f0b04009cb0).stop 2024-02-22T00:49:24.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 -- 172.21.15.49:0/2212601477 shutdown_connections 2024-02-22T00:49:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 --2- 172.21.15.49:0/2212601477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100fd150 0x7f0b100f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:49:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 --2- 172.21.15.49:0/2212601477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 0x7f0b100fcbd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 -- 172.21.15.49:0/2212601477 >> 172.21.15.49:0/2212601477 conn(0x7f0b10070590 msgr2=0x7f0b100f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 -- 172.21.15.49:0/2212601477 shutdown_connections 2024-02-22T00:49:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 -- 172.21.15.49:0/2212601477 wait complete. 2024-02-22T00:49:24.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.513+0000 7f0b14e8b700 1 Processor -- start 2024-02-22T00:49:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b14e8b700 1 -- start start 2024-02-22T00:49:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b14e8b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 0x7f0b10110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b14e8b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100fd150 0x7f0b10110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b14e8b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10110df0 con 0x7f0b100fc7f0 2024-02-22T00:49:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b14e8b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1010a410 con 0x7f0b100fd150 2024-02-22T00:49:24.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b0e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 0x7f0b10110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b0e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 0x7f0b10110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38058/0 (socket says 172.21.15.49:38058) 2024-02-22T00:49:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b0e59c700 1 -- 172.21.15.49:0/728677482 learned_addr learned my addr 172.21.15.49:0/728677482 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b0dd9b700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100fd150 0x7f0b10110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b0e59c700 1 -- 172.21.15.49:0/728677482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100fd150 msgr2=0x7f0b10110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b0e59c700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100fd150 0x7f0b10110760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b0e59c700 1 -- 172.21.15.49:0/728677482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04005040 con 0x7f0b100fc7f0 2024-02-22T00:49:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0b0e59c700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 0x7f0b10110270 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f0b04013640 tx=0x7f0b04009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.514+0000 7f0aff7fe700 1 -- 172.21.15.49:0/728677482 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b0400e030 con 0x7f0b100fc7f0 2024-02-22T00:49:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.515+0000 7f0aff7fe700 1 -- 172.21.15.49:0/728677482 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b04007e90 con 0x7f0b100fc7f0 2024-02-22T00:49:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.515+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1010a660 con 0x7f0b100fc7f0 2024-02-22T00:49:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.515+0000 7f0aff7fe700 1 -- 172.21.15.49:0/728677482 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b04018070 con 0x7f0b100fc7f0 2024-02-22T00:49:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.515+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1010ab40 con 0x7f0b100fc7f0 2024-02-22T00:49:24.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.515+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1005f590 con 0x7f0b100fc7f0 2024-02-22T00:49:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.516+0000 7f0aff7fe700 1 -- 172.21.15.49:0/728677482 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0b0401d420 con 0x7f0b100fc7f0 2024-02-22T00:49:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.517+0000 7f0aff7fe700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0af806cab0 0x7f0af806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.517+0000 7f0aff7fe700 1 -- 172.21.15.49:0/728677482 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0b0401de40 con 0x7f0b100fc7f0 2024-02-22T00:49:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.517+0000 7f0b0dd9b700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0af806cab0 0x7f0af806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.517+0000 7f0b0dd9b700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0af806cab0 0x7f0af806ef70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f0b1010bbb0 tx=0x7f0b00008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:24.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.521+0000 7f0aff7fe700 1 -- 172.21.15.49:0/728677482 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0b0405b2e0 con 0x7f0b100fc7f0 2024-02-22T00:49:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:24 smithi161 ceph-mon[113442]: pgmap v374: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:24.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.763+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0b1010b240 con 0x7f0b100fc7f0 2024-02-22T00:49:24.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.763+0000 7f0aff7fe700 1 -- 172.21.15.49:0/728677482 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f0b0405ae70 con 0x7f0b100fc7f0 2024-02-22T00:49:24.766 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:49:24.766 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:49:24.766 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:49:24.766 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:49:24.767 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:49:24.768 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:49:24.769 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:49:24.770 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:49:24.770 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:49:24.770 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:49:24.770 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:49:24.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0af806cab0 msgr2=0x7f0af806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0af806cab0 0x7f0af806ef70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f0b1010bbb0 tx=0x7f0b00008040).stop 2024-02-22T00:49:24.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 msgr2=0x7f0b10110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 0x7f0b10110270 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f0b04013640 tx=0x7f0b04009cb0).stop 2024-02-22T00:49:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 shutdown_connections 2024-02-22T00:49:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0af806cab0 0x7f0af806ef70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b100fc7f0 0x7f0b10110270 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 --2- 172.21.15.49:0/728677482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b100fd150 0x7f0b10110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 >> 172.21.15.49:0/728677482 conn(0x7f0b10070590 msgr2=0x7f0b10060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 shutdown_connections 2024-02-22T00:49:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.766+0000 7f0b14e8b700 1 -- 172.21.15.49:0/728677482 wait complete. 2024-02-22T00:49:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:49:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.869+0000 7faef43dd700 1 -- 172.21.15.49:0/2368245607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 msgr2=0x7faeec0f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.869+0000 7faef43dd700 1 --2- 172.21.15.49:0/2368245607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 0x7faeec0f7090 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7faedc0047f0 tx=0x7faedc009cb0).stop 2024-02-22T00:49:24.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.869+0000 7faef43dd700 1 -- 172.21.15.49:0/2368245607 shutdown_connections 2024-02-22T00:49:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.869+0000 7faef43dd700 1 --2- 172.21.15.49:0/2368245607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 0x7faeec0f7090 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.869+0000 7faef43dd700 1 --2- 172.21.15.49:0/2368245607 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeec0fc870 0x7faeec0fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.869+0000 7faef43dd700 1 -- 172.21.15.49:0/2368245607 >> 172.21.15.49:0/2368245607 conn(0x7faeec06ce40 msgr2=0x7faeec06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.869+0000 7faef43dd700 1 -- 172.21.15.49:0/2368245607 shutdown_connections 2024-02-22T00:49:24.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.869+0000 7faef43dd700 1 -- 172.21.15.49:0/2368245607 wait complete. 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef43dd700 1 Processor -- start 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef43dd700 1 -- start start 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef43dd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeec0fc870 0x7faeec109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef43dd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 0x7faeec109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef43dd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec109b20 con 0x7faeec0fd140 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef43dd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec109c60 con 0x7faeec0fc870 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef1978700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 0x7faeec109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef1978700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 0x7faeec109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38068/0 (socket says 172.21.15.49:38068) 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef1978700 1 -- 172.21.15.49:0/3441446699 learned_addr learned my addr 172.21.15.49:0/3441446699 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef2179700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeec0fc870 0x7faeec109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef1978700 1 -- 172.21.15.49:0/3441446699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeec0fc870 msgr2=0x7faeec109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef1978700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeec0fc870 0x7faeec109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.870+0000 7faef1978700 1 -- 172.21.15.49:0/3441446699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc005040 con 0x7faeec0fd140 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.871+0000 7faef1978700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 0x7faeec109630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7faedc000c00 tx=0x7faedc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.871+0000 7faee37fe700 1 -- 172.21.15.49:0/3441446699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faedc00e030 con 0x7faeec0fd140 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.871+0000 7faee37fe700 1 -- 172.21.15.49:0/3441446699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faedc007e90 con 0x7faeec0fd140 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.871+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec109eb0 con 0x7faeec0fd140 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.871+0000 7faee37fe700 1 -- 172.21.15.49:0/3441446699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faedc018070 con 0x7faeec0fd140 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.871+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec1124a0 con 0x7faeec0fd140 2024-02-22T00:49:24.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.872+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec060670 con 0x7faeec0fd140 2024-02-22T00:49:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.872+0000 7faee37fe700 1 -- 172.21.15.49:0/3441446699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faedc01d420 con 0x7faeec0fd140 2024-02-22T00:49:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.873+0000 7faee37fe700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faed806cab0 0x7faed806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.873+0000 7faee37fe700 1 -- 172.21.15.49:0/3441446699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7faedc08ceb0 con 0x7faeec0fd140 2024-02-22T00:49:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.873+0000 7faef2179700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faed806cab0 0x7faed806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:24.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.873+0000 7faef2179700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faed806cab0 0x7faed806ef70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7faee8009170 tx=0x7faee8009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:24.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:24.877+0000 7faee37fe700 1 -- 172.21.15.49:0/3441446699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7faedc056f80 con 0x7faeec0fd140 2024-02-22T00:49:25.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.095+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faeec059120 con 0x7faed806cab0 2024-02-22T00:49:25.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.096+0000 7faee37fe700 1 -- 172.21.15.49:0/3441446699 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7faeec059120 con 0x7faed806cab0 2024-02-22T00:49:25.098 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:49:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:49:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:49:25.098 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:49:25.099 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:49:25.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faed806cab0 msgr2=0x7faed806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faed806cab0 0x7faed806ef70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7faee8009170 tx=0x7faee8009d60).stop 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 msgr2=0x7faeec109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 0x7faeec109630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7faedc000c00 tx=0x7faedc009cb0).stop 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 shutdown_connections 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faed806cab0 0x7faed806ef70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faeec0fc870 0x7faeec109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 --2- 172.21.15.49:0/3441446699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faeec0fd140 0x7faeec109630 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 >> 172.21.15.49:0/3441446699 conn(0x7faeec06ce40 msgr2=0x7faeec0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 shutdown_connections 2024-02-22T00:49:25.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.098+0000 7faef43dd700 1 -- 172.21.15.49:0/3441446699 wait complete. 2024-02-22T00:49:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.200+0000 7f9419091700 1 -- 172.21.15.49:0/1185379891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 msgr2=0x7f94140f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.200+0000 7f9419091700 1 --2- 172.21.15.49:0/1185379891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 0x7f94140f6930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f94040047f0 tx=0x7f9404009cb0).stop 2024-02-22T00:49:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.200+0000 7f9419091700 1 -- 172.21.15.49:0/1185379891 shutdown_connections 2024-02-22T00:49:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.200+0000 7f9419091700 1 --2- 172.21.15.49:0/1185379891 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 0x7f94140f6930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.200+0000 7f9419091700 1 --2- 172.21.15.49:0/1185379891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94140fc7f0 0x7f94140fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.200+0000 7f9419091700 1 -- 172.21.15.49:0/1185379891 >> 172.21.15.49:0/1185379891 conn(0x7f9414070590 msgr2=0x7f94140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.200+0000 7f9419091700 1 -- 172.21.15.49:0/1185379891 shutdown_connections 2024-02-22T00:49:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.200+0000 7f9419091700 1 -- 172.21.15.49:0/1185379891 wait complete. 2024-02-22T00:49:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f9419091700 1 Processor -- start 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f9419091700 1 -- start start 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f9419091700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94140fc7f0 0x7f941410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f9419091700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 0x7f941410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f9419091700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941410eab0 con 0x7f94140fd150 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f9419091700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941410ebf0 con 0x7f94140fc7f0 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f941259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 0x7f941410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f941259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 0x7f941410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38084/0 (socket says 172.21.15.49:38084) 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f941259c700 1 -- 172.21.15.49:0/4179808848 learned_addr learned my addr 172.21.15.49:0/4179808848 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.201+0000 7f9412d9d700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94140fc7f0 0x7f941410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f941259c700 1 -- 172.21.15.49:0/4179808848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94140fc7f0 msgr2=0x7f941410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f941259c700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94140fc7f0 0x7f941410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f941259c700 1 -- 172.21.15.49:0/4179808848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9404005040 con 0x7f94140fd150 2024-02-22T00:49:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f941259c700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 0x7f941410e4b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f94040099f0 tx=0x7f9404009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f940bfff700 1 -- 172.21.15.49:0/4179808848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940400e030 con 0x7f94140fd150 2024-02-22T00:49:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9414108220 con 0x7f94140fd150 2024-02-22T00:49:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f940bfff700 1 -- 172.21.15.49:0/4179808848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9404007e90 con 0x7f94140fd150 2024-02-22T00:49:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f940bfff700 1 -- 172.21.15.49:0/4179808848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9404018070 con 0x7f94140fd150 2024-02-22T00:49:25.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.202+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9414108780 con 0x7f94140fd150 2024-02-22T00:49:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.203+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941405f590 con 0x7f94140fd150 2024-02-22T00:49:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.204+0000 7f940bfff700 1 -- 172.21.15.49:0/4179808848 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f940401d420 con 0x7f94140fd150 2024-02-22T00:49:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.204+0000 7f940bfff700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f940006caa0 0x7f940006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.204+0000 7f940bfff700 1 -- 172.21.15.49:0/4179808848 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f940408d190 con 0x7f94140fd150 2024-02-22T00:49:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.204+0000 7f9412d9d700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f940006caa0 0x7f940006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:25.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.204+0000 7f9412d9d700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f940006caa0 0x7f940006ef60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f93fc004d20 tx=0x7f93fc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:25.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.209+0000 7f940bfff700 1 -- 172.21.15.49:0/4179808848 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f940405acf0 con 0x7f94140fd150 2024-02-22T00:49:25.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:25 smithi049 ceph-mon[132694]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:25.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:25 smithi049 ceph-mon[132694]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:25.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:25 smithi049 ceph-mon[132694]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:25.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:25 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/440208748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:49:25.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:25 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/728677482' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:49:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.487+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9414047540 con 0x7f94140fd150 2024-02-22T00:49:25.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.488+0000 7f940bfff700 1 -- 172.21.15.49:0/4179808848 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f940405a880 con 0x7f94140fd150 2024-02-22T00:49:25.491 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:49:25.491 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:49:25.491 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:49:25.491 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:49:25.492 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:49:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f940006caa0 msgr2=0x7f940006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f940006caa0 0x7f940006ef60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f93fc004d20 tx=0x7f93fc009040).stop 2024-02-22T00:49:25.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 msgr2=0x7f941410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 0x7f941410e4b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f94040099f0 tx=0x7f9404009cb0).stop 2024-02-22T00:49:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 shutdown_connections 2024-02-22T00:49:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f940006caa0 0x7f940006ef60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94140fc7f0 0x7f941410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 --2- 172.21.15.49:0/4179808848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f94140fd150 0x7f941410e4b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:25.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 >> 172.21.15.49:0/4179808848 conn(0x7f9414070590 msgr2=0x7f9414060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:25.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 shutdown_connections 2024-02-22T00:49:25.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:25.490+0000 7f9419091700 1 -- 172.21.15.49:0/4179808848 wait complete. 2024-02-22T00:49:25.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:25 smithi161 ceph-mon[113442]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:25.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:25 smithi161 ceph-mon[113442]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:25.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:25 smithi161 ceph-mon[113442]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:25.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:25 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/440208748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:49:25.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:25 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/728677482' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:49:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:26 smithi049 ceph-mon[132694]: pgmap v375: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:26 smithi049 ceph-mon[132694]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:26 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4179808848' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:49:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:26 smithi161 ceph-mon[113442]: pgmap v375: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:26 smithi161 ceph-mon[113442]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:26 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4179808848' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:49:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:28 smithi049 ceph-mon[132694]: pgmap v376: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:28 smithi161 ceph-mon[113442]: pgmap v376: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:30 smithi049 ceph-mon[132694]: pgmap v377: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:30 smithi161 ceph-mon[113442]: pgmap v377: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:32 smithi049 ceph-mon[132694]: pgmap v378: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:32 smithi161 ceph-mon[113442]: pgmap v378: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:34 smithi049 ceph-mon[132694]: pgmap v379: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:34 smithi161 ceph-mon[113442]: pgmap v379: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:36.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:36 smithi049 ceph-mon[132694]: pgmap v380: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:36 smithi161 ceph-mon[113442]: pgmap v380: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:38 smithi049 ceph-mon[132694]: pgmap v381: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:38 smithi161 ceph-mon[113442]: pgmap v381: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:40 smithi049 ceph-mon[132694]: pgmap v382: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:40 smithi161 ceph-mon[113442]: pgmap v382: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:42 smithi049 ceph-mon[132694]: pgmap v383: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:42 smithi161 ceph-mon[113442]: pgmap v383: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:44.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:44 smithi049 ceph-mon[132694]: pgmap v384: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:44 smithi161 ceph-mon[113442]: pgmap v384: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:46 smithi049 ceph-mon[132694]: pgmap v385: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:46 smithi161 ceph-mon[113442]: pgmap v385: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:48 smithi049 ceph-mon[132694]: pgmap v386: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:48 smithi161 ceph-mon[113442]: pgmap v386: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:50 smithi049 ceph-mon[132694]: pgmap v387: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:50 smithi161 ceph-mon[113442]: pgmap v387: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:52.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:52 smithi049 ceph-mon[132694]: pgmap v388: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:52 smithi161 ceph-mon[113442]: pgmap v388: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:54.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:54 smithi049 ceph-mon[132694]: pgmap v389: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:54 smithi161 ceph-mon[113442]: pgmap v389: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.606+0000 7fdac97b5700 1 -- 172.21.15.49:0/178218728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 msgr2=0x7fdac40fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.606+0000 7fdac97b5700 1 --2- 172.21.15.49:0/178218728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 0x7fdac40fdd50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fdaac0047f0 tx=0x7fdaac009cb0).stop 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.606+0000 7fdac97b5700 1 -- 172.21.15.49:0/178218728 shutdown_connections 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.606+0000 7fdac97b5700 1 --2- 172.21.15.49:0/178218728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fe2d0 0x7fdac40f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.606+0000 7fdac97b5700 1 --2- 172.21.15.49:0/178218728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 0x7fdac40fdd50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.606+0000 7fdac97b5700 1 -- 172.21.15.49:0/178218728 >> 172.21.15.49:0/178218728 conn(0x7fdac40f3550 msgr2=0x7fdac40f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.606+0000 7fdac97b5700 1 -- 172.21.15.49:0/178218728 shutdown_connections 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.606+0000 7fdac97b5700 1 -- 172.21.15.49:0/178218728 wait complete. 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.607+0000 7fdac97b5700 1 Processor -- start 2024-02-22T00:49:55.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.607+0000 7fdac97b5700 1 -- start start 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.607+0000 7fdac97b5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 0x7fdac4110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.607+0000 7fdac97b5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fe2d0 0x7fdac4110770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.607+0000 7fdac97b5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac4110e00 con 0x7fdac40fd970 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.607+0000 7fdac97b5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac410a420 con 0x7fdac40fe2d0 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.607+0000 7fdac2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 0x7fdac4110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 0x7fdac4110280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56516/0 (socket says 172.21.15.49:56516) 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac2ffd700 1 -- 172.21.15.49:0/4107984794 learned_addr learned my addr 172.21.15.49:0/4107984794 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac27fc700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fe2d0 0x7fdac4110770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac2ffd700 1 -- 172.21.15.49:0/4107984794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fe2d0 msgr2=0x7fdac4110770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac2ffd700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fe2d0 0x7fdac4110770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac2ffd700 1 -- 172.21.15.49:0/4107984794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac005040 con 0x7fdac40fd970 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac2ffd700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 0x7fdac4110280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fdaac00b120 tx=0x7fdaac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdabbfff700 1 -- 172.21.15.49:0/4107984794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaac00e030 con 0x7fdac40fd970 2024-02-22T00:49:55.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdabbfff700 1 -- 172.21.15.49:0/4107984794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdaac007e90 con 0x7fdac40fd970 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdabbfff700 1 -- 172.21.15.49:0/4107984794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaac018070 con 0x7fdac40fd970 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac410a670 con 0x7fdac40fd970 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.608+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac410ab50 con 0x7fdac40fd970 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.609+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac4060370 con 0x7fdac40fd970 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.610+0000 7fdabbfff700 1 -- 172.21.15.49:0/4107984794 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdaac01d420 con 0x7fdac40fd970 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.610+0000 7fdabbfff700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdab006caa0 0x7fdab006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.610+0000 7fdabbfff700 1 -- 172.21.15.49:0/4107984794 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdaac08d1a0 con 0x7fdac40fd970 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.611+0000 7fdac27fc700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdab006caa0 0x7fdab006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:55.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.611+0000 7fdac27fc700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdab006caa0 0x7fdab006ef60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdac410bbc0 tx=0x7fdab4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:55.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.615+0000 7fdabbfff700 1 -- 172.21.15.49:0/4107984794 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdaac05ad00 con 0x7fdac40fd970 2024-02-22T00:49:55.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.830+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdac410b970 con 0x7fdab006caa0 2024-02-22T00:49:55.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.831+0000 7fdabbfff700 1 -- 172.21.15.49:0/4107984794 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fdac410b970 con 0x7fdab006caa0 2024-02-22T00:49:55.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdab006caa0 msgr2=0x7fdab006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:55.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdab006caa0 0x7fdab006ef60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdac410bbc0 tx=0x7fdab4008040).stop 2024-02-22T00:49:55.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 msgr2=0x7fdac4110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:55.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 0x7fdac4110280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fdaac00b120 tx=0x7fdaac009cb0).stop 2024-02-22T00:49:55.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 shutdown_connections 2024-02-22T00:49:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdab006caa0 0x7fdab006ef60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdac40fd970 0x7fdac4110280 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 --2- 172.21.15.49:0/4107984794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdac40fe2d0 0x7fdac4110770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 >> 172.21.15.49:0/4107984794 conn(0x7fdac40f3550 msgr2=0x7fdac406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 shutdown_connections 2024-02-22T00:49:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.833+0000 7fdac97b5700 1 -- 172.21.15.49:0/4107984794 wait complete. 2024-02-22T00:49:55.846 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:49:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.936+0000 7f4a3c524700 1 -- 172.21.15.49:0/384162846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 msgr2=0x7f4a340f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.936+0000 7f4a3c524700 1 --2- 172.21.15.49:0/384162846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 0x7f4a340f8d20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f4a300047f0 tx=0x7f4a30009cb0).stop 2024-02-22T00:49:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.936+0000 7f4a3c524700 1 -- 172.21.15.49:0/384162846 shutdown_connections 2024-02-22T00:49:55.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.936+0000 7f4a3c524700 1 --2- 172.21.15.49:0/384162846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a340f9210 0x7f4a341019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.936+0000 7f4a3c524700 1 --2- 172.21.15.49:0/384162846 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 0x7f4a340f8d20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.936+0000 7f4a3c524700 1 -- 172.21.15.49:0/384162846 >> 172.21.15.49:0/384162846 conn(0x7f4a34070590 msgr2=0x7f4a340f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.936+0000 7f4a3c524700 1 -- 172.21.15.49:0/384162846 shutdown_connections 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.936+0000 7f4a3c524700 1 -- 172.21.15.49:0/384162846 wait complete. 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3c524700 1 Processor -- start 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3c524700 1 -- start start 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3c524700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 0x7f4a3410e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3c524700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a340f9210 0x7f4a3410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3c524700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3410ec20 con 0x7f4a340f8940 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3c524700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a34108240 con 0x7f4a340f9210 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3a2c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 0x7f4a3410e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3a2c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 0x7f4a3410e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56530/0 (socket says 172.21.15.49:56530) 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.937+0000 7f4a3a2c0700 1 -- 172.21.15.49:0/1011760540 learned_addr learned my addr 172.21.15.49:0/1011760540 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:55.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a3a2c0700 1 -- 172.21.15.49:0/1011760540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a340f9210 msgr2=0x7f4a3410e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a3a2c0700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a340f9210 0x7f4a3410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:49:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a3a2c0700 1 -- 172.21.15.49:0/1011760540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30005040 con 0x7f4a340f8940 2024-02-22T00:49:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a3a2c0700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 0x7f4a3410e0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4a3000b120 tx=0x7f4a30009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a277fe700 1 -- 172.21.15.49:0/1011760540 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a3000e030 con 0x7f4a340f8940 2024-02-22T00:49:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a277fe700 1 -- 172.21.15.49:0/1011760540 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4a30007e90 con 0x7f4a340f8940 2024-02-22T00:49:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a34108490 con 0x7f4a340f8940 2024-02-22T00:49:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a277fe700 1 -- 172.21.15.49:0/1011760540 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a30018070 con 0x7f4a340f8940 2024-02-22T00:49:55.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.938+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a34108970 con 0x7f4a340f8940 2024-02-22T00:49:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.939+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3405f590 con 0x7f4a340f8940 2024-02-22T00:49:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.939+0000 7f4a277fe700 1 -- 172.21.15.49:0/1011760540 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4a3001d420 con 0x7f4a340f8940 2024-02-22T00:49:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.940+0000 7f4a277fe700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a2006caa0 0x7f4a2006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.940+0000 7f4a277fe700 1 -- 172.21.15.49:0/1011760540 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4a3008d120 con 0x7f4a340f8940 2024-02-22T00:49:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.940+0000 7f4a39abf700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a2006caa0 0x7f4a2006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:55.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.940+0000 7f4a39abf700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a2006caa0 0x7f4a2006ef60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f4a341099e0 tx=0x7f4a28006c30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:55.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:55.944+0000 7f4a277fe700 1 -- 172.21.15.49:0/1011760540 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4a3005ac80 con 0x7f4a340f8940 2024-02-22T00:49:56.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.161+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a34109720 con 0x7f4a2006caa0 2024-02-22T00:49:56.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.162+0000 7f4a277fe700 1 -- 172.21.15.49:0/1011760540 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4a34109720 con 0x7f4a2006caa0 2024-02-22T00:49:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a2006caa0 msgr2=0x7f4a2006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a2006caa0 0x7f4a2006ef60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f4a341099e0 tx=0x7f4a28006c30).stop 2024-02-22T00:49:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 msgr2=0x7f4a3410e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 0x7f4a3410e0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4a3000b120 tx=0x7f4a30009cb0).stop 2024-02-22T00:49:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 shutdown_connections 2024-02-22T00:49:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a2006caa0 0x7f4a2006ef60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4a340f8940 0x7f4a3410e0a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 --2- 172.21.15.49:0/1011760540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a340f9210 0x7f4a3410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:49:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 >> 172.21.15.49:0/1011760540 conn(0x7f4a34070590 msgr2=0x7f4a340fc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 shutdown_connections 2024-02-22T00:49:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.164+0000 7f4a3c524700 1 -- 172.21.15.49:0/1011760540 wait complete. 2024-02-22T00:49:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.265+0000 7faa92efd700 1 -- 172.21.15.49:0/2548084744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fe250 msgr2=0x7faa8c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.265+0000 7faa92efd700 1 --2- 172.21.15.49:0/2548084744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fe250 0x7faa8c0f7a30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7faa780047f0 tx=0x7faa78009cb0).stop 2024-02-22T00:49:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.266+0000 7faa92efd700 1 -- 172.21.15.49:0/2548084744 shutdown_connections 2024-02-22T00:49:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.266+0000 7faa92efd700 1 --2- 172.21.15.49:0/2548084744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fe250 0x7faa8c0f7a30 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.266+0000 7faa92efd700 1 --2- 172.21.15.49:0/2548084744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0fd8f0 0x7faa8c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.266+0000 7faa92efd700 1 -- 172.21.15.49:0/2548084744 >> 172.21.15.49:0/2548084744 conn(0x7faa8c0f34b0 msgr2=0x7faa8c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:56.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.266+0000 7faa92efd700 1 -- 172.21.15.49:0/2548084744 shutdown_connections 2024-02-22T00:49:56.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.266+0000 7faa92efd700 1 -- 172.21.15.49:0/2548084744 wait complete. 2024-02-22T00:49:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.266+0000 7faa92efd700 1 Processor -- start 2024-02-22T00:49:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.266+0000 7faa92efd700 1 -- start start 2024-02-22T00:49:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa92efd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fd8f0 0x7faa8c10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa92efd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0fe250 0x7faa8c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa92efd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c10eb70 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa92efd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c10ecb0 con 0x7faa8c0fe250 2024-02-22T00:49:56.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa90c99700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fd8f0 0x7faa8c10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa90c99700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fd8f0 0x7faa8c10e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56548/0 (socket says 172.21.15.49:56548) 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa90c99700 1 -- 172.21.15.49:0/3658351765 learned_addr learned my addr 172.21.15.49:0/3658351765 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa8bfff700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0fe250 0x7faa8c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa90c99700 1 -- 172.21.15.49:0/3658351765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0fe250 msgr2=0x7faa8c10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa90c99700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0fe250 0x7faa8c10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa90c99700 1 -- 172.21.15.49:0/3658351765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78005040 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa90c99700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fd8f0 0x7faa8c10e080 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7faa800041d0 tx=0x7faa80009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa89ffb700 1 -- 172.21.15.49:0/3658351765 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa80007b40 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa89ffb700 1 -- 172.21.15.49:0/3658351765 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa8000f040 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c108340 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.267+0000 7faa89ffb700 1 -- 172.21.15.49:0/3658351765 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa800147b0 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.268+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c108880 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.268+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c05f590 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.269+0000 7faa89ffb700 1 -- 172.21.15.49:0/3658351765 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7faa80009110 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.269+0000 7faa89ffb700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faa7c06caa0 0x7faa7c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.269+0000 7faa89ffb700 1 -- 172.21.15.49:0/3658351765 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7faa8008bda0 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.269+0000 7faa8bfff700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faa7c06caa0 0x7faa7c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.270+0000 7faa8bfff700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faa7c06caa0 0x7faa7c06ef60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7faa8c1099c0 tx=0x7faa7800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:56.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.274+0000 7faa89ffb700 1 -- 172.21.15.49:0/3658351765 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7faa80059900 con 0x7faa8c0fd8f0 2024-02-22T00:49:56.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:56 smithi049 ceph-mon[132694]: pgmap v390: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:56.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.479+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa8c108b00 con 0x7faa7c06caa0 2024-02-22T00:49:56.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.489+0000 7faa89ffb700 1 -- 172.21.15.49:0/3658351765 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7faa8c108b00 con 0x7faa7c06caa0 2024-02-22T00:49:56.491 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:49:56.491 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (13m) 7m ago 24m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (10m) 7m ago 24m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (10m) 6m ago 23m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (12m) 7m ago 24m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (7m) 7m ago 19m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (7m) 7m ago 19m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (6m) 6m ago 19m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (6m) 6m ago 19m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (14m) 7m ago 25m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (14m) 6m ago 23m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (11m) 7m ago 25m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (11m) 6m ago 23m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (13m) 7m ago 24m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (13m) 6m ago 23m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:49:56.492 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (10m) 7m ago 23m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (9m) 7m ago 22m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (9m) 7m ago 21m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (8m) 6m ago 21m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (8m) 6m ago 21m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (7m) 6m ago 20m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (13m) 6m ago 23m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faa7c06caa0 msgr2=0x7faa7c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faa7c06caa0 0x7faa7c06ef60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7faa8c1099c0 tx=0x7faa7800b040).stop 2024-02-22T00:49:56.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fd8f0 msgr2=0x7faa8c10e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fd8f0 0x7faa8c10e080 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7faa800041d0 tx=0x7faa80009f60).stop 2024-02-22T00:49:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 shutdown_connections 2024-02-22T00:49:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7faa7c06caa0 0x7faa7c06ef60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faa8c0fd8f0 0x7faa8c10e080 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 --2- 172.21.15.49:0/3658351765 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0fe250 0x7faa8c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 >> 172.21.15.49:0/3658351765 conn(0x7faa8c0f34b0 msgr2=0x7faa8c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 shutdown_connections 2024-02-22T00:49:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.491+0000 7faa92efd700 1 -- 172.21.15.49:0/3658351765 wait complete. 2024-02-22T00:49:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:56 smithi161 ceph-mon[113442]: pgmap v390: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 -- 172.21.15.49:0/2155799107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fe270 msgr2=0x7f883c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 --2- 172.21.15.49:0/2155799107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fe270 0x7f883c0f7a50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f882c0047f0 tx=0x7f882c009cb0).stop 2024-02-22T00:49:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 -- 172.21.15.49:0/2155799107 shutdown_connections 2024-02-22T00:49:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 --2- 172.21.15.49:0/2155799107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fe270 0x7f883c0f7a50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 --2- 172.21.15.49:0/2155799107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f883c0fd910 0x7f883c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 -- 172.21.15.49:0/2155799107 >> 172.21.15.49:0/2155799107 conn(0x7f883c0f3530 msgr2=0x7f883c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 -- 172.21.15.49:0/2155799107 shutdown_connections 2024-02-22T00:49:56.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 -- 172.21.15.49:0/2155799107 wait complete. 2024-02-22T00:49:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 Processor -- start 2024-02-22T00:49:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.592+0000 7f884368e700 1 -- start start 2024-02-22T00:49:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884368e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fd910 0x7f883c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884368e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f883c0fe270 0x7f883c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884368e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c10eae0 con 0x7f883c0fd910 2024-02-22T00:49:56.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884368e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c10ec20 con 0x7f883c0fe270 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884142a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fd910 0x7f883c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884142a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fd910 0x7f883c10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56568/0 (socket says 172.21.15.49:56568) 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884142a700 1 -- 172.21.15.49:0/641814100 learned_addr learned my addr 172.21.15.49:0/641814100 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f8840c29700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f883c0fe270 0x7f883c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884142a700 1 -- 172.21.15.49:0/641814100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f883c0fe270 msgr2=0x7f883c10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884142a700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f883c0fe270 0x7f883c10e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884142a700 1 -- 172.21.15.49:0/641814100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c005040 con 0x7f883c0fd910 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884142a700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fd910 0x7f883c10dff0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f883800c790 tx=0x7f8838004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f88327fc700 1 -- 172.21.15.49:0/641814100 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f883800e680 con 0x7f883c0fd910 2024-02-22T00:49:56.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f88327fc700 1 -- 172.21.15.49:0/641814100 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f883800ec90 con 0x7f883c0fd910 2024-02-22T00:49:56.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c1082b0 con 0x7f883c0fd910 2024-02-22T00:49:56.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f88327fc700 1 -- 172.21.15.49:0/641814100 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8838012d60 con 0x7f883c0fd910 2024-02-22T00:49:56.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.593+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c108870 con 0x7f883c0fd910 2024-02-22T00:49:56.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.594+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c05f570 con 0x7f883c0fd910 2024-02-22T00:49:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.595+0000 7f88327fc700 1 -- 172.21.15.49:0/641814100 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8838012400 con 0x7f883c0fd910 2024-02-22T00:49:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.595+0000 7f88327fc700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f882806caa0 0x7f882806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.595+0000 7f88327fc700 1 -- 172.21.15.49:0/641814100 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f883808bfa0 con 0x7f883c0fd910 2024-02-22T00:49:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.596+0000 7f8840c29700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f882806caa0 0x7f882806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.596+0000 7f8840c29700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f882806caa0 0x7f882806ef60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f883c109930 tx=0x7f882c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:56.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.599+0000 7f88327fc700 1 -- 172.21.15.49:0/641814100 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8838059a40 con 0x7f883c0fd910 2024-02-22T00:49:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.882+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f883c0ffca0 con 0x7f883c0fd910 2024-02-22T00:49:56.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.882+0000 7f88327fc700 1 -- 172.21.15.49:0/641814100 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f88380595d0 con 0x7f883c0fd910 2024-02-22T00:49:56.885 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:49:56.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:49:56.886 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:49:56.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:49:56.886 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:49:56.886 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:49:56.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:49:56.887 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:49:56.887 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:49:56.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:49:56.887 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:49:56.887 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:49:56.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:49:56.887 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:49:56.888 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:49:56.888 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:49:56.888 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.884+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f882806caa0 msgr2=0x7f882806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.884+0000 7f884368e700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f882806caa0 0x7f882806ef60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f883c109930 tx=0x7f882c00b040).stop 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.884+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fd910 msgr2=0x7f883c10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.884+0000 7f884368e700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fd910 0x7f883c10dff0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f883800c790 tx=0x7f8838004330).stop 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.885+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 shutdown_connections 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.885+0000 7f884368e700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f882806caa0 0x7f882806ef60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.885+0000 7f884368e700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f883c0fd910 0x7f883c10dff0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.885+0000 7f884368e700 1 --2- 172.21.15.49:0/641814100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f883c0fe270 0x7f883c10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.885+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 >> 172.21.15.49:0/641814100 conn(0x7f883c0f3530 msgr2=0x7f883c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.885+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 shutdown_connections 2024-02-22T00:49:56.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.885+0000 7f884368e700 1 -- 172.21.15.49:0/641814100 wait complete. 2024-02-22T00:49:56.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.987+0000 7f1012e52700 1 -- 172.21.15.49:0/2480654500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fd910 msgr2=0x7f100c0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.987+0000 7f1012e52700 1 --2- 172.21.15.49:0/2480654500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fd910 0x7f100c0fdcf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f10000047f0 tx=0x7f1000009cb0).stop 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.987+0000 7f1012e52700 1 -- 172.21.15.49:0/2480654500 shutdown_connections 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.987+0000 7f1012e52700 1 --2- 172.21.15.49:0/2480654500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c0fe270 0x7f100c0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.987+0000 7f1012e52700 1 --2- 172.21.15.49:0/2480654500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fd910 0x7f100c0fdcf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.987+0000 7f1012e52700 1 -- 172.21.15.49:0/2480654500 >> 172.21.15.49:0/2480654500 conn(0x7f100c0f3530 msgr2=0x7f100c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.987+0000 7f1012e52700 1 -- 172.21.15.49:0/2480654500 shutdown_connections 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.987+0000 7f1012e52700 1 -- 172.21.15.49:0/2480654500 wait complete. 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f1012e52700 1 Processor -- start 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f1012e52700 1 -- start start 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f1012e52700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c0fd910 0x7f100c10e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f1012e52700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fe270 0x7f100c10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f1012e52700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c10ec70 con 0x7f100c0fe270 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f1012e52700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c108290 con 0x7f100c0fd910 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f100bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fe270 0x7f100c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f100bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fe270 0x7f100c10e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56578/0 (socket says 172.21.15.49:56578) 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f100bfff700 1 -- 172.21.15.49:0/2514715879 learned_addr learned my addr 172.21.15.49:0/2514715879 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f1010bee700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c0fd910 0x7f100c10e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f100bfff700 1 -- 172.21.15.49:0/2514715879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c0fd910 msgr2=0x7f100c10e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f100bfff700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c0fd910 0x7f100c10e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.988+0000 7f100bfff700 1 -- 172.21.15.49:0/2514715879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1000005040 con 0x7f100c0fe270 2024-02-22T00:49:56.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.989+0000 7f100bfff700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fe270 0x7f100c10e5e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f0ff800b480 tx=0x7f0ff80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.989+0000 7f1009ffb700 1 -- 172.21.15.49:0/2514715879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff8002500 con 0x7f100c0fe270 2024-02-22T00:49:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.989+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c108540 con 0x7f100c0fe270 2024-02-22T00:49:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.989+0000 7f1009ffb700 1 -- 172.21.15.49:0/2514715879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ff8002b10 con 0x7f100c0fe270 2024-02-22T00:49:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.989+0000 7f1009ffb700 1 -- 172.21.15.49:0/2514715879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff8012c60 con 0x7f100c0fe270 2024-02-22T00:49:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.989+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c108a80 con 0x7f100c0fe270 2024-02-22T00:49:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.990+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c05f570 con 0x7f100c0fe270 2024-02-22T00:49:56.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.990+0000 7f1009ffb700 1 -- 172.21.15.49:0/2514715879 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0ff8002660 con 0x7f100c0fe270 2024-02-22T00:49:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.991+0000 7f1009ffb700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0ffc06caa0 0x7f0ffc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.991+0000 7f1009ffb700 1 -- 172.21.15.49:0/2514715879 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0ff808bda0 con 0x7f100c0fe270 2024-02-22T00:49:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.991+0000 7f1010bee700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0ffc06caa0 0x7f0ffc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:56.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.991+0000 7f1010bee700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0ffc06caa0 0x7f0ffc06ef60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f1000004f10 tx=0x7f100000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:56.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:56.995+0000 7f1009ffb700 1 -- 172.21.15.49:0/2514715879 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0ff8059900 con 0x7f100c0fe270 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.239+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f100c047540 con 0x7f100c0fe270 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.240+0000 7f1009ffb700 1 -- 172.21.15.49:0/2514715879 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f0ff8059490 con 0x7f100c0fe270 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:49:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:49:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:49:57.244 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:49:57.245 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0ffc06caa0 msgr2=0x7f0ffc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0ffc06caa0 0x7f0ffc06ef60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f1000004f10 tx=0x7f100000b040).stop 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fe270 msgr2=0x7f100c10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fe270 0x7f100c10e5e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f0ff800b480 tx=0x7f0ff80090f0).stop 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 shutdown_connections 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0ffc06caa0 0x7f0ffc06ef60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c0fd910 0x7f100c10e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 --2- 172.21.15.49:0/2514715879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f100c0fe270 0x7f100c10e5e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 >> 172.21.15.49:0/2514715879 conn(0x7f100c0f3530 msgr2=0x7f100c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:57.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 shutdown_connections 2024-02-22T00:49:57.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.242+0000 7f1012e52700 1 -- 172.21.15.49:0/2514715879 wait complete. 2024-02-22T00:49:57.247 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:49:57.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.344+0000 7f750d9f0700 1 -- 172.21.15.49:0/1806288756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 msgr2=0x7f75080f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.344+0000 7f750d9f0700 1 --2- 172.21.15.49:0/1806288756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 0x7f75080f7a30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f74f00047f0 tx=0x7f74f0009cb0).stop 2024-02-22T00:49:57.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.344+0000 7f750d9f0700 1 -- 172.21.15.49:0/1806288756 shutdown_connections 2024-02-22T00:49:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.344+0000 7f750d9f0700 1 --2- 172.21.15.49:0/1806288756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 0x7f75080f7a30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.344+0000 7f750d9f0700 1 --2- 172.21.15.49:0/1806288756 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75080fd8f0 0x7f75080fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.344+0000 7f750d9f0700 1 -- 172.21.15.49:0/1806288756 >> 172.21.15.49:0/1806288756 conn(0x7f75080f34b0 msgr2=0x7f75080f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.344+0000 7f750d9f0700 1 -- 172.21.15.49:0/1806288756 shutdown_connections 2024-02-22T00:49:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.344+0000 7f750d9f0700 1 -- 172.21.15.49:0/1806288756 wait complete. 2024-02-22T00:49:57.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.345+0000 7f750d9f0700 1 Processor -- start 2024-02-22T00:49:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.345+0000 7f750d9f0700 1 -- start start 2024-02-22T00:49:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.345+0000 7f750d9f0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75080fd8f0 0x7f750810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.345+0000 7f750d9f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 0x7f750810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.345+0000 7f750d9f0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750810eb70 con 0x7f75080fe250 2024-02-22T00:49:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.345+0000 7f750d9f0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750810ecb0 con 0x7f75080fd8f0 2024-02-22T00:49:57.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.345+0000 7f74fe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 0x7f750810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f74fe7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 0x7f750810e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56586/0 (socket says 172.21.15.49:56586) 2024-02-22T00:49:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f74fe7fc700 1 -- 172.21.15.49:0/3648661561 learned_addr learned my addr 172.21.15.49:0/3648661561 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f7506ffd700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75080fd8f0 0x7f750810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f74fe7fc700 1 -- 172.21.15.49:0/3648661561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75080fd8f0 msgr2=0x7f750810e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f74fe7fc700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75080fd8f0 0x7f750810e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f74fe7fc700 1 -- 172.21.15.49:0/3648661561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0005040 con 0x7f75080fe250 2024-02-22T00:49:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f7506ffd700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75080fd8f0 0x7f750810e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:49:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f74fe7fc700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 0x7f750810e570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f74f00099f0 tx=0x7f74f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f7504ff9700 1 -- 172.21.15.49:0/3648661561 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f000e030 con 0x7f75080fe250 2024-02-22T00:49:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f7504ff9700 1 -- 172.21.15.49:0/3648661561 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74f0007e90 con 0x7f75080fe250 2024-02-22T00:49:57.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75081082e0 con 0x7f75080fe250 2024-02-22T00:49:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f7504ff9700 1 -- 172.21.15.49:0/3648661561 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f0018070 con 0x7f75080fe250 2024-02-22T00:49:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.346+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75081087c0 con 0x7f75080fe250 2024-02-22T00:49:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.347+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750805f590 con 0x7f75080fe250 2024-02-22T00:49:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.348+0000 7f7504ff9700 1 -- 172.21.15.49:0/3648661561 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f74f0009590 con 0x7f75080fe250 2024-02-22T00:49:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.348+0000 7f7504ff9700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f406ca30 0x7f74f406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:57.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.348+0000 7f7504ff9700 1 -- 172.21.15.49:0/3648661561 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f74f008d040 con 0x7f75080fe250 2024-02-22T00:49:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.348+0000 7f7506ffd700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f406ca30 0x7f74f406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.349+0000 7f7506ffd700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f406ca30 0x7f74f406eef0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f74f8009250 tx=0x7f74f8009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:57.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.353+0000 7f7504ff9700 1 -- 172.21.15.49:0/3648661561 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f74f005aba0 con 0x7f75080fe250 2024-02-22T00:49:57.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:57 smithi049 ceph-mon[132694]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:57.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:57 smithi049 ceph-mon[132694]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:57.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:57 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/641814100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:49:57.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:57 smithi161 ceph-mon[113442]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:57.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:57 smithi161 ceph-mon[113442]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:57.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:57 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/641814100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:49:57.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.569+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75080ffc40 con 0x7f74f406ca30 2024-02-22T00:49:57.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.570+0000 7f7504ff9700 1 -- 172.21.15.49:0/3648661561 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f75080ffc40 con 0x7f74f406ca30 2024-02-22T00:49:57.572 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:49:57.572 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:49:57.573 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:49:57.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f406ca30 msgr2=0x7f74f406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f406ca30 0x7f74f406eef0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f74f8009250 tx=0x7f74f8009d60).stop 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 msgr2=0x7f750810e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 0x7f750810e570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f74f00099f0 tx=0x7f74f0009cb0).stop 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 shutdown_connections 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f74f406ca30 0x7f74f406eef0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75080fd8f0 0x7f750810e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 --2- 172.21.15.49:0/3648661561 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75080fe250 0x7f750810e570 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.572+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 >> 172.21.15.49:0/3648661561 conn(0x7f75080f34b0 msgr2=0x7f75080fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.573+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 shutdown_connections 2024-02-22T00:49:57.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.573+0000 7f750d9f0700 1 -- 172.21.15.49:0/3648661561 wait complete. 2024-02-22T00:49:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.674+0000 7fbfb05ff700 1 -- 172.21.15.49:0/3823840667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 msgr2=0x7fbfa80fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.674+0000 7fbfb05ff700 1 --2- 172.21.15.49:0/3823840667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 0x7fbfa80fdcf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fbf980047f0 tx=0x7fbf98009cb0).stop 2024-02-22T00:49:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.674+0000 7fbfb05ff700 1 -- 172.21.15.49:0/3823840667 shutdown_connections 2024-02-22T00:49:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.674+0000 7fbfb05ff700 1 --2- 172.21.15.49:0/3823840667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa80fe270 0x7fbfa80f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.674+0000 7fbfb05ff700 1 --2- 172.21.15.49:0/3823840667 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 0x7fbfa80fdcf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.674+0000 7fbfb05ff700 1 -- 172.21.15.49:0/3823840667 >> 172.21.15.49:0/3823840667 conn(0x7fbfa80f3530 msgr2=0x7fbfa80f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.674+0000 7fbfb05ff700 1 -- 172.21.15.49:0/3823840667 shutdown_connections 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.674+0000 7fbfb05ff700 1 -- 172.21.15.49:0/3823840667 wait complete. 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfb05ff700 1 Processor -- start 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfb05ff700 1 -- start start 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfb05ff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 0x7fbfa810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfb05ff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa80fe270 0x7fbfa810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfb05ff700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa810ead0 con 0x7fbfa80fd910 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfb05ff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa810ec10 con 0x7fbfa80fe270 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfae39b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 0x7fbfa810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfae39b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 0x7fbfa810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56616/0 (socket says 172.21.15.49:56616) 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfae39b700 1 -- 172.21.15.49:0/2576462003 learned_addr learned my addr 172.21.15.49:0/2576462003 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.675+0000 7fbfadb9a700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa80fe270 0x7fbfa810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:57.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbfae39b700 1 -- 172.21.15.49:0/2576462003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa80fe270 msgr2=0x7fbfa810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbfae39b700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa80fe270 0x7fbfa810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbfae39b700 1 -- 172.21.15.49:0/2576462003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98005040 con 0x7fbfa80fd910 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbfadb9a700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa80fe270 0x7fbfa810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbfae39b700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 0x7fbfa810dfe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fbf98005010 tx=0x7fbf98009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbf9f7fe700 1 -- 172.21.15.49:0/2576462003 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf9800e030 con 0x7fbfa80fd910 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbf9f7fe700 1 -- 172.21.15.49:0/2576462003 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf98007e90 con 0x7fbfa80fd910 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa8108240 con 0x7fbfa80fd910 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbf9f7fe700 1 -- 172.21.15.49:0/2576462003 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf98018070 con 0x7fbfa80fd910 2024-02-22T00:49:57.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.676+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa81087a0 con 0x7fbfa80fd910 2024-02-22T00:49:57.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.677+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa805f570 con 0x7fbfa80fd910 2024-02-22T00:49:57.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.677+0000 7fbf9f7fe700 1 -- 172.21.15.49:0/2576462003 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbf9801d6e0 con 0x7fbfa80fd910 2024-02-22T00:49:57.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.678+0000 7fbf9f7fe700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbf9406caa0 0x7fbf9406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:49:57.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.678+0000 7fbf9f7fe700 1 -- 172.21.15.49:0/2576462003 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbf9808d020 con 0x7fbfa80fd910 2024-02-22T00:49:57.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.678+0000 7fbfadb9a700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbf9406caa0 0x7fbf9406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:49:57.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.678+0000 7fbfadb9a700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbf9406caa0 0x7fbf9406ef60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fbfa8109920 tx=0x7fbfa4009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:49:57.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.682+0000 7fbf9f7fe700 1 -- 172.21.15.49:0/2576462003 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbf9805a8f0 con 0x7fbfa80fd910 2024-02-22T00:49:57.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.962+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbfa8109690 con 0x7fbfa80fd910 2024-02-22T00:49:57.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.962+0000 7fbf9f7fe700 1 -- 172.21.15.49:0/2576462003 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fbf9805a710 con 0x7fbfa80fd910 2024-02-22T00:49:57.965 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:49:57.965 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:49:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:49:57.965 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:49:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:49:57.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbf9406caa0 msgr2=0x7fbf9406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbf9406caa0 0x7fbf9406ef60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fbfa8109920 tx=0x7fbfa4009d60).stop 2024-02-22T00:49:57.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 msgr2=0x7fbfa810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:49:57.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 0x7fbfa810dfe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fbf98005010 tx=0x7fbf98009cb0).stop 2024-02-22T00:49:57.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 shutdown_connections 2024-02-22T00:49:57.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbf9406caa0 0x7fbf9406ef60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbfa80fd910 0x7fbfa810dfe0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 --2- 172.21.15.49:0/2576462003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbfa80fe270 0x7fbfa810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:49:57.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 >> 172.21.15.49:0/2576462003 conn(0x7fbfa80f3530 msgr2=0x7fbfa80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:49:57.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 shutdown_connections 2024-02-22T00:49:57.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:49:57.964+0000 7fbfb05ff700 1 -- 172.21.15.49:0/2576462003 wait complete. 2024-02-22T00:49:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:58 smithi049 ceph-mon[132694]: pgmap v391: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:58 smithi049 ceph-mon[132694]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:58 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2514715879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:49:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:58.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:58 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2576462003' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:49:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:58 smithi161 ceph-mon[113442]: pgmap v391: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:49:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:58 smithi161 ceph-mon[113442]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:58 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2514715879' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:49:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:49:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:58 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2576462003' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:49:59.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:49:59 smithi049 ceph-mon[132694]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:49:59.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:49:59 smithi161 ceph-mon[113442]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[132671]: 2024-02-22T00:49:59.999+0000 7f8aeb60c700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:50:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[132671]: 2024-02-22T00:49:59.999+0000 7f8aeb60c700 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:50:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[132671]: 2024-02-22T00:49:59.999+0000 7f8aeb60c700 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-02-22T00:50:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[132671]: 2024-02-22T00:49:59.999+0000 7f8aeb60c700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:50:00.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[132671]: 2024-02-22T00:49:59.999+0000 7f8aeb60c700 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-02-22T00:50:00.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-mon[132694]: pgmap v392: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:00.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-mon[132694]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:50:00.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-mon[132694]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:50:00.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-mon[132694]: fs cephfs is degraded 2024-02-22T00:50:00.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-mon[132694]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:50:00.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:00 smithi049 ceph-mon[132694]: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:50:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:00 smithi161 ceph-mon[113442]: pgmap v392: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:00 smithi161 ceph-mon[113442]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:50:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:00 smithi161 ceph-mon[113442]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:50:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:00 smithi161 ceph-mon[113442]: fs cephfs is degraded 2024-02-22T00:50:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:00 smithi161 ceph-mon[113442]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:50:00.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:00 smithi161 ceph-mon[113442]: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:50:02.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:02 smithi049 ceph-mon[132694]: pgmap v393: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:02 smithi161 ceph-mon[113442]: pgmap v393: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:04.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:04 smithi049 ceph-mon[132694]: pgmap v394: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:04 smithi161 ceph-mon[113442]: pgmap v394: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:06.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:06 smithi049 ceph-mon[132694]: pgmap v395: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:06 smithi161 ceph-mon[113442]: pgmap v395: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:08 smithi049 ceph-mon[132694]: pgmap v396: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:08 smithi161 ceph-mon[113442]: pgmap v396: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:10 smithi049 ceph-mon[132694]: pgmap v397: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:10 smithi161 ceph-mon[113442]: pgmap v397: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:12.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:12 smithi049 ceph-mon[132694]: pgmap v398: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:12 smithi161 ceph-mon[113442]: pgmap v398: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:13.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:50:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:50:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:14 smithi049 ceph-mon[132694]: pgmap v399: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:14 smithi161 ceph-mon[113442]: pgmap v399: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:16 smithi049 ceph-mon[132694]: pgmap v400: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:16 smithi161 ceph-mon[113442]: pgmap v400: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:18 smithi049 ceph-mon[132694]: pgmap v401: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:18 smithi161 ceph-mon[113442]: pgmap v401: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:20 smithi049 ceph-mon[132694]: pgmap v402: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:20 smithi161 ceph-mon[113442]: pgmap v402: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:22 smithi049 ceph-mon[132694]: pgmap v403: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:22 smithi161 ceph-mon[113442]: pgmap v403: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:24 smithi049 ceph-mon[132694]: pgmap v404: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:24 smithi161 ceph-mon[113442]: pgmap v404: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:26 smithi049 ceph-mon[132694]: pgmap v405: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:26 smithi161 ceph-mon[113442]: pgmap v405: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.080+0000 7f1d13125700 1 -- 172.21.15.49:0/4130806199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 msgr2=0x7f1d0c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.080+0000 7f1d13125700 1 --2- 172.21.15.49:0/4130806199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 0x7f1d0c0fdcd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f1d000047f0 tx=0x7f1d00009cb0).stop 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.080+0000 7f1d13125700 1 -- 172.21.15.49:0/4130806199 shutdown_connections 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.080+0000 7f1d13125700 1 --2- 172.21.15.49:0/4130806199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d0c0fe250 0x7f1d0c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.080+0000 7f1d13125700 1 --2- 172.21.15.49:0/4130806199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 0x7f1d0c0fdcd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.080+0000 7f1d13125700 1 -- 172.21.15.49:0/4130806199 >> 172.21.15.49:0/4130806199 conn(0x7f1d0c0f34b0 msgr2=0x7f1d0c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.080+0000 7f1d13125700 1 -- 172.21.15.49:0/4130806199 shutdown_connections 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.080+0000 7f1d13125700 1 -- 172.21.15.49:0/4130806199 wait complete. 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d13125700 1 Processor -- start 2024-02-22T00:50:28.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d13125700 1 -- start start 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d13125700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 0x7f1d0c10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d13125700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d0c0fe250 0x7f1d0c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d13125700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c10ead0 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d13125700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c10ec10 con 0x7f1d0c0fe250 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d10ec1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 0x7f1d0c10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d10ec1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 0x7f1d0c10dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60430/0 (socket says 172.21.15.49:60430) 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d10ec1700 1 -- 172.21.15.49:0/863326098 learned_addr learned my addr 172.21.15.49:0/863326098 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.081+0000 7f1d0bfff700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d0c0fe250 0x7f1d0c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d10ec1700 1 -- 172.21.15.49:0/863326098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d0c0fe250 msgr2=0x7f1d0c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d10ec1700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d0c0fe250 0x7f1d0c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d10ec1700 1 -- 172.21.15.49:0/863326098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d00005040 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d10ec1700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 0x7f1d0c10dfe0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f1d000043a0 tx=0x7f1d00009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d09ffb700 1 -- 172.21.15.49:0/863326098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d0000e030 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d09ffb700 1 -- 172.21.15.49:0/863326098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d00007e90 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c108240 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d09ffb700 1 -- 172.21.15.49:0/863326098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d00018070 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.082+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c1087a0 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.083+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c05f590 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.084+0000 7f1d09ffb700 1 -- 172.21.15.49:0/863326098 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1d000094c0 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.084+0000 7f1d09ffb700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1cfc06cab0 0x7f1cfc06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.084+0000 7f1d09ffb700 1 -- 172.21.15.49:0/863326098 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1d0008cff0 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.084+0000 7f1d0bfff700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1cfc06cab0 0x7f1cfc06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.085+0000 7f1d0bfff700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1cfc06cab0 0x7f1cfc06ef70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f1d0c109920 tx=0x7f1cf800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:28.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.089+0000 7f1d09ffb700 1 -- 172.21.15.49:0/863326098 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1d0005ab50 con 0x7f1d0c0fd8f0 2024-02-22T00:50:28.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.306+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d0c0ffc40 con 0x7f1cfc06cab0 2024-02-22T00:50:28.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.307+0000 7f1d09ffb700 1 -- 172.21.15.49:0/863326098 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1d0c0ffc40 con 0x7f1cfc06cab0 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1cfc06cab0 msgr2=0x7f1cfc06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1cfc06cab0 0x7f1cfc06ef70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f1d0c109920 tx=0x7f1cf800b040).stop 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 msgr2=0x7f1d0c10dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 0x7f1d0c10dfe0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f1d000043a0 tx=0x7f1d00009cb0).stop 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 shutdown_connections 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1cfc06cab0 0x7f1cfc06ef70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d0c0fd8f0 0x7f1d0c10dfe0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 --2- 172.21.15.49:0/863326098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d0c0fe250 0x7f1d0c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.309+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 >> 172.21.15.49:0/863326098 conn(0x7f1d0c0f34b0 msgr2=0x7f1d0c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.310+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 shutdown_connections 2024-02-22T00:50:28.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.310+0000 7f1d13125700 1 -- 172.21.15.49:0/863326098 wait complete. 2024-02-22T00:50:28.322 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:50:28.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 -- 172.21.15.49:0/2564478442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 msgr2=0x7f18840fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 --2- 172.21.15.49:0/2564478442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 0x7f18840fdcd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f18740047f0 tx=0x7f1874009cb0).stop 2024-02-22T00:50:28.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 -- 172.21.15.49:0/2564478442 shutdown_connections 2024-02-22T00:50:28.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 --2- 172.21.15.49:0/2564478442 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18840fe250 0x7f18840f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 --2- 172.21.15.49:0/2564478442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 0x7f18840fdcd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 -- 172.21.15.49:0/2564478442 >> 172.21.15.49:0/2564478442 conn(0x7f18840f34b0 msgr2=0x7f18840f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:28.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 -- 172.21.15.49:0/2564478442 shutdown_connections 2024-02-22T00:50:28.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 -- 172.21.15.49:0/2564478442 wait complete. 2024-02-22T00:50:28.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 Processor -- start 2024-02-22T00:50:28.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.413+0000 7f188a836700 1 -- start start 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f188a836700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 0x7f188410dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f188a836700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18840fe250 0x7f188410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f188a836700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188410ead0 con 0x7f18840fd8f0 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f188a836700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188410ec10 con 0x7f18840fe250 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f1883fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 0x7f188410dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f1883fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 0x7f188410dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60458/0 (socket says 172.21.15.49:60458) 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f1883fff700 1 -- 172.21.15.49:0/4023468693 learned_addr learned my addr 172.21.15.49:0/4023468693 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f18837fe700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18840fe250 0x7f188410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f1883fff700 1 -- 172.21.15.49:0/4023468693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18840fe250 msgr2=0x7f188410e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f1883fff700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18840fe250 0x7f188410e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f1883fff700 1 -- 172.21.15.49:0/4023468693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874005040 con 0x7f18840fd8f0 2024-02-22T00:50:28.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.414+0000 7f1883fff700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 0x7f188410dfe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f1874005010 tx=0x7f1874009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.415+0000 7f18817fa700 1 -- 172.21.15.49:0/4023468693 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f187400e030 con 0x7f18840fd8f0 2024-02-22T00:50:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.415+0000 7f18817fa700 1 -- 172.21.15.49:0/4023468693 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1874007e90 con 0x7f18840fd8f0 2024-02-22T00:50:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.415+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1884108240 con 0x7f18840fd8f0 2024-02-22T00:50:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.415+0000 7f18817fa700 1 -- 172.21.15.49:0/4023468693 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1874018070 con 0x7f18840fd8f0 2024-02-22T00:50:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.415+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18841087a0 con 0x7f18840fd8f0 2024-02-22T00:50:28.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.416+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188405f590 con 0x7f18840fd8f0 2024-02-22T00:50:28.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.416+0000 7f18817fa700 1 -- 172.21.15.49:0/4023468693 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f187401d670 con 0x7f18840fd8f0 2024-02-22T00:50:28.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.417+0000 7f18817fa700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f186c06caa0 0x7f186c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.417+0000 7f18817fa700 1 -- 172.21.15.49:0/4023468693 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f187408d0e0 con 0x7f18840fd8f0 2024-02-22T00:50:28.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.417+0000 7f18837fe700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f186c06caa0 0x7f186c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.417+0000 7f18837fe700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f186c06caa0 0x7f186c06ef60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f1884109920 tx=0x7f187800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:28.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.421+0000 7f18817fa700 1 -- 172.21.15.49:0/4023468693 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f187405ab80 con 0x7f18840fd8f0 2024-02-22T00:50:28.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:28 smithi049 ceph-mon[132694]: pgmap v406: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:28.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:50:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:28 smithi161 ceph-mon[113442]: pgmap v406: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:50:28.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.637+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18840ffc40 con 0x7f186c06caa0 2024-02-22T00:50:28.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.638+0000 7f18817fa700 1 -- 172.21.15.49:0/4023468693 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f18840ffc40 con 0x7f186c06caa0 2024-02-22T00:50:28.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f186c06caa0 msgr2=0x7f186c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f186c06caa0 0x7f186c06ef60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f1884109920 tx=0x7f187800b040).stop 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 msgr2=0x7f188410dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 0x7f188410dfe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f1874005010 tx=0x7f1874009cb0).stop 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 shutdown_connections 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f186c06caa0 0x7f186c06ef60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18840fd8f0 0x7f188410dfe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 --2- 172.21.15.49:0/4023468693 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18840fe250 0x7f188410e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.640+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 >> 172.21.15.49:0/4023468693 conn(0x7f18840f34b0 msgr2=0x7f18840fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.641+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 shutdown_connections 2024-02-22T00:50:28.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.641+0000 7f188a836700 1 -- 172.21.15.49:0/4023468693 wait complete. 2024-02-22T00:50:28.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 -- 172.21.15.49:0/3217654551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 msgr2=0x7f2a000f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 --2- 172.21.15.49:0/3217654551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 0x7f2a000f7a50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f29fc0047f0 tx=0x7f29fc009cb0).stop 2024-02-22T00:50:28.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 -- 172.21.15.49:0/3217654551 shutdown_connections 2024-02-22T00:50:28.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 --2- 172.21.15.49:0/3217654551 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 0x7f2a000f7a50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 --2- 172.21.15.49:0/3217654551 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a000fd910 0x7f2a000fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 -- 172.21.15.49:0/3217654551 >> 172.21.15.49:0/3217654551 conn(0x7f2a000f3530 msgr2=0x7f2a000f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:28.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 -- 172.21.15.49:0/3217654551 shutdown_connections 2024-02-22T00:50:28.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 -- 172.21.15.49:0/3217654551 wait complete. 2024-02-22T00:50:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 Processor -- start 2024-02-22T00:50:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.743+0000 7f2a07f13700 1 -- start start 2024-02-22T00:50:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a07f13700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a000fd910 0x7f2a0010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a07f13700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 0x7f2a0010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a07f13700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0010eab0 con 0x7f2a000fe270 2024-02-22T00:50:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a07f13700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0010ebf0 con 0x7f2a000fd910 2024-02-22T00:50:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a054ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 0x7f2a0010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a054ae700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 0x7f2a0010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60484/0 (socket says 172.21.15.49:60484) 2024-02-22T00:50:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a054ae700 1 -- 172.21.15.49:0/3769459552 learned_addr learned my addr 172.21.15.49:0/3769459552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:50:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a05caf700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a000fd910 0x7f2a0010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a054ae700 1 -- 172.21.15.49:0/3769459552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a000fd910 msgr2=0x7f2a0010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a054ae700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a000fd910 0x7f2a0010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a054ae700 1 -- 172.21.15.49:0/3769459552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc005040 con 0x7f2a000fe270 2024-02-22T00:50:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a054ae700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 0x7f2a0010e4b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f29fc0099f0 tx=0x7f29fc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f29f6ffd700 1 -- 172.21.15.49:0/3769459552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29fc00e030 con 0x7f2a000fe270 2024-02-22T00:50:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f29f6ffd700 1 -- 172.21.15.49:0/3769459552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29fc007e90 con 0x7f2a000fe270 2024-02-22T00:50:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.744+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a00108220 con 0x7f2a000fe270 2024-02-22T00:50:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.745+0000 7f29f6ffd700 1 -- 172.21.15.49:0/3769459552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29fc018070 con 0x7f2a000fe270 2024-02-22T00:50:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.745+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a00108780 con 0x7f2a000fe270 2024-02-22T00:50:28.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.745+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0005f570 con 0x7f2a000fe270 2024-02-22T00:50:28.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.746+0000 7f29f6ffd700 1 -- 172.21.15.49:0/3769459552 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f29fc0094c0 con 0x7f2a000fe270 2024-02-22T00:50:28.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.746+0000 7f29f6ffd700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29ec06caa0 0x7f29ec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:28.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.747+0000 7f29f6ffd700 1 -- 172.21.15.49:0/3769459552 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f29fc08d010 con 0x7f2a000fe270 2024-02-22T00:50:28.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.747+0000 7f2a05caf700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29ec06caa0 0x7f29ec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:28.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.747+0000 7f2a05caf700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29ec06caa0 0x7f29ec06ef60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f29f0004de0 tx=0x7f29f000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:28.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.751+0000 7f29f6ffd700 1 -- 172.21.15.49:0/3769459552 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f29fc05ab70 con 0x7f2a000fe270 2024-02-22T00:50:28.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.960+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a000ffc60 con 0x7f29ec06caa0 2024-02-22T00:50:28.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.969+0000 7f29f6ffd700 1 -- 172.21.15.49:0/3769459552 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f2a000ffc60 con 0x7f29ec06caa0 2024-02-22T00:50:28.972 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:50:28.972 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (13m) 7m ago 24m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:50:28.972 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (11m) 7m ago 24m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:50:28.972 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (11m) 7m ago 24m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:50:28.972 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (13m) 7m ago 24m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:50:28.972 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (7m) 7m ago 19m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (7m) 7m ago 19m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (7m) 7m ago 19m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (7m) 7m ago 19m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (15m) 7m ago 26m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (14m) 7m ago 24m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (12m) 7m ago 26m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (12m) 7m ago 24m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (14m) 7m ago 24m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (14m) 7m ago 24m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (11m) 7m ago 23m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (10m) 7m ago 23m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (9m) 7m ago 22m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (9m) 7m ago 22m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:50:28.973 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (8m) 7m ago 21m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:50:28.974 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (8m) 7m ago 21m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:50:28.974 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (13m) 7m ago 23m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:50:28.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29ec06caa0 msgr2=0x7f29ec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29ec06caa0 0x7f29ec06ef60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f29f0004de0 tx=0x7f29f000b040).stop 2024-02-22T00:50:28.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 msgr2=0x7f2a0010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 0x7f2a0010e4b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f29fc0099f0 tx=0x7f29fc009cb0).stop 2024-02-22T00:50:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 shutdown_connections 2024-02-22T00:50:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29ec06caa0 0x7f29ec06ef60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a000fd910 0x7f2a0010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 --2- 172.21.15.49:0/3769459552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a000fe270 0x7f2a0010e4b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 >> 172.21.15.49:0/3769459552 conn(0x7f2a000f3530 msgr2=0x7f2a000fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 shutdown_connections 2024-02-22T00:50:28.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:28.972+0000 7f2a07f13700 1 -- 172.21.15.49:0/3769459552 wait complete. 2024-02-22T00:50:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 -- 172.21.15.49:0/812548519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 msgr2=0x7f96540f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 --2- 172.21.15.49:0/812548519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 0x7f96540f6930 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f96400047f0 tx=0x7f9640009cb0).stop 2024-02-22T00:50:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 -- 172.21.15.49:0/812548519 shutdown_connections 2024-02-22T00:50:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 --2- 172.21.15.49:0/812548519 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 0x7f96540f6930 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 --2- 172.21.15.49:0/812548519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fc7f0 0x7f96540fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:50:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 -- 172.21.15.49:0/812548519 >> 172.21.15.49:0/812548519 conn(0x7f9654070590 msgr2=0x7f96540f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:29.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 -- 172.21.15.49:0/812548519 shutdown_connections 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 -- 172.21.15.49:0/812548519 wait complete. 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 Processor -- start 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.073+0000 7f965ac3b700 1 -- start start 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f965ac3b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 0x7f965410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f965ac3b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fd150 0x7f965410e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f965ac3b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965410ebc0 con 0x7f96540fc7f0 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f965ac3b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96541081e0 con 0x7f96540fd150 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f96589d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 0x7f965410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f96589d7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 0x7f965410e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60502/0 (socket says 172.21.15.49:60502) 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f96589d7700 1 -- 172.21.15.49:0/4122347346 learned_addr learned my addr 172.21.15.49:0/4122347346 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f9653fff700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fd150 0x7f965410e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f96589d7700 1 -- 172.21.15.49:0/4122347346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fd150 msgr2=0x7f965410e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f96589d7700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fd150 0x7f965410e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f96589d7700 1 -- 172.21.15.49:0/4122347346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640005040 con 0x7f96540fc7f0 2024-02-22T00:50:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f9653fff700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fd150 0x7f965410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:50:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f96589d7700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 0x7f965410e040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f964800b4b0 tx=0x7f96480090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f9651ffb700 1 -- 172.21.15.49:0/4122347346 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9648002500 con 0x7f96540fc7f0 2024-02-22T00:50:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9654108490 con 0x7f96540fc7f0 2024-02-22T00:50:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f9651ffb700 1 -- 172.21.15.49:0/4122347346 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9648002b10 con 0x7f96540fc7f0 2024-02-22T00:50:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.074+0000 7f9651ffb700 1 -- 172.21.15.49:0/4122347346 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9648012cf0 con 0x7f96540fc7f0 2024-02-22T00:50:29.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.075+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96541089d0 con 0x7f96540fc7f0 2024-02-22T00:50:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.076+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965405f590 con 0x7f96540fc7f0 2024-02-22T00:50:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.076+0000 7f9651ffb700 1 -- 172.21.15.49:0/4122347346 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9648002660 con 0x7f96540fc7f0 2024-02-22T00:50:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.076+0000 7f9651ffb700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964406caa0 0x7f964406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.077+0000 7f9651ffb700 1 -- 172.21.15.49:0/4122347346 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f964808bf40 con 0x7f96540fc7f0 2024-02-22T00:50:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.077+0000 7f9653fff700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964406caa0 0x7f964406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.077+0000 7f9653fff700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964406caa0 0x7f964406ef60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f96400043d0 tx=0x7f964000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:29.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.081+0000 7f9651ffb700 1 -- 172.21.15.49:0/4122347346 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f96480599e0 con 0x7f96540fc7f0 2024-02-22T00:50:29.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.368+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f96541096c0 con 0x7f96540fc7f0 2024-02-22T00:50:29.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.369+0000 7f9651ffb700 1 -- 172.21.15.49:0/4122347346 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f9648059570 con 0x7f96540fc7f0 2024-02-22T00:50:29.371 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:50:29.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:50:29.372 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:50:29.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:50:29.372 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:50:29.372 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:50:29.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:50:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:50:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:50:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:50:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:50:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:50:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:50:29.374 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:50:29.374 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:50:29.374 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:50:29.374 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:50:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964406caa0 msgr2=0x7f964406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964406caa0 0x7f964406ef60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f96400043d0 tx=0x7f964000b040).stop 2024-02-22T00:50:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 msgr2=0x7f965410e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 0x7f965410e040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f964800b4b0 tx=0x7f96480090f0).stop 2024-02-22T00:50:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 shutdown_connections 2024-02-22T00:50:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964406caa0 0x7f964406ef60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 0x7f965410e040 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 --2- 172.21.15.49:0/4122347346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fd150 0x7f965410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 >> 172.21.15.49:0/4122347346 conn(0x7f9654070590 msgr2=0x7f9654060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:29.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 shutdown_connections 2024-02-22T00:50:29.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.371+0000 7f965ac3b700 1 -- 172.21.15.49:0/4122347346 wait complete. 2024-02-22T00:50:29.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:29 smithi049 ceph-mon[132694]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:29.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 -- 172.21.15.49:0/1294102530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 msgr2=0x7f581c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 --2- 172.21.15.49:0/1294102530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 0x7f581c0fcbd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f58100047f0 tx=0x7f5810009cb0).stop 2024-02-22T00:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 -- 172.21.15.49:0/1294102530 shutdown_connections 2024-02-22T00:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 --2- 172.21.15.49:0/1294102530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f581c0fd150 0x7f581c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 --2- 172.21.15.49:0/1294102530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 0x7f581c0fcbd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 -- 172.21.15.49:0/1294102530 >> 172.21.15.49:0/1294102530 conn(0x7f581c070590 msgr2=0x7f581c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 -- 172.21.15.49:0/1294102530 shutdown_connections 2024-02-22T00:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 -- 172.21.15.49:0/1294102530 wait complete. 2024-02-22T00:50:29.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.473+0000 7f5821719700 1 Processor -- start 2024-02-22T00:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f5821719700 1 -- start start 2024-02-22T00:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f5821719700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 0x7f581c0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f5821719700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f581c0fd150 0x7f581c0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f5821719700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c0f8f20 con 0x7f581c0fc7f0 2024-02-22T00:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f5821719700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581c0f9060 con 0x7f581c0fd150 2024-02-22T00:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 0x7f581c0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 0x7f581c0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60518/0 (socket says 172.21.15.49:60518) 2024-02-22T00:50:29.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581affd700 1 -- 172.21.15.49:0/3388738717 learned_addr learned my addr 172.21.15.49:0/3388738717 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581a7fc700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f581c0fd150 0x7f581c0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581affd700 1 -- 172.21.15.49:0/3388738717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f581c0fd150 msgr2=0x7f581c0f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581affd700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f581c0fd150 0x7f581c0f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581affd700 1 -- 172.21.15.49:0/3388738717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5810005040 con 0x7f581c0fc7f0 2024-02-22T00:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581a7fc700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f581c0fd150 0x7f581c0f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.474+0000 7f581affd700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 0x7f581c0f8540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f5810005010 tx=0x7f5810009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:29.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.475+0000 7f5803fff700 1 -- 172.21.15.49:0/3388738717 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581000e030 con 0x7f581c0fc7f0 2024-02-22T00:50:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.475+0000 7f5803fff700 1 -- 172.21.15.49:0/3388738717 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5810007e90 con 0x7f581c0fc7f0 2024-02-22T00:50:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.475+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c0f92b0 con 0x7f581c0fc7f0 2024-02-22T00:50:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.475+0000 7f5803fff700 1 -- 172.21.15.49:0/3388738717 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5810018070 con 0x7f581c0fc7f0 2024-02-22T00:50:29.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.475+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581c114600 con 0x7f581c0fc7f0 2024-02-22T00:50:29.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.476+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c05f590 con 0x7f581c0fc7f0 2024-02-22T00:50:29.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.476+0000 7f5803fff700 1 -- 172.21.15.49:0/3388738717 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f581001d6e0 con 0x7f581c0fc7f0 2024-02-22T00:50:29.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.477+0000 7f5803fff700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f580406ca30 0x7f580406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.477+0000 7f5803fff700 1 -- 172.21.15.49:0/3388738717 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f581008d050 con 0x7f581c0fc7f0 2024-02-22T00:50:29.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.477+0000 7f581a7fc700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f580406ca30 0x7f580406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.477+0000 7f581a7fc700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f580406ca30 0x7f580406eef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f581c0f9ce0 tx=0x7f580c009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:29.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.481+0000 7f5803fff700 1 -- 172.21.15.49:0/3388738717 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f581005abb0 con 0x7f581c0fc7f0 2024-02-22T00:50:29.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:29 smithi161 ceph-mon[113442]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.722+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f581c114c60 con 0x7f581c0fc7f0 2024-02-22T00:50:29.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.722+0000 7f5803fff700 1 -- 172.21.15.49:0/3388738717 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f581005a740 con 0x7f581c0fc7f0 2024-02-22T00:50:29.725 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:50:29.726 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:50:29.726 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:50:29.726 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:50:29.726 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:50:29.726 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:50:29.727 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:50:29.727 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:50:29.727 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:50:29.727 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:50:29.727 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:50:29.727 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:50:29.728 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:50:29.728 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:50:29.728 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:50:29.728 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:50:29.728 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:50:29.729 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:50:29.729 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:50:29.729 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:50:29.729 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:50:29.729 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:50:29.729 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:50:29.730 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:50:29.730 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:50:29.730 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:50:29.730 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:50:29.730 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:50:29.730 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:50:29.731 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:50:29.731 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:50:29.731 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:50:29.731 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:50:29.731 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:50:29.731 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:50:29.731 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:50:29.732 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:50:29.732 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:50:29.732 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:50:29.732 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:50:29.732 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:50:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f580406ca30 msgr2=0x7f580406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f580406ca30 0x7f580406eef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f581c0f9ce0 tx=0x7f580c009d60).stop 2024-02-22T00:50:29.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 msgr2=0x7f581c0f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 0x7f581c0f8540 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f5810005010 tx=0x7f5810009cb0).stop 2024-02-22T00:50:29.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 shutdown_connections 2024-02-22T00:50:29.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f580406ca30 0x7f580406eef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f581c0fc7f0 0x7f581c0f8540 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 --2- 172.21.15.49:0/3388738717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f581c0fd150 0x7f581c0f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 >> 172.21.15.49:0/3388738717 conn(0x7f581c070590 msgr2=0x7f581c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:29.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.724+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 shutdown_connections 2024-02-22T00:50:29.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.725+0000 7f5821719700 1 -- 172.21.15.49:0/3388738717 wait complete. 2024-02-22T00:50:29.735 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:50:29.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.827+0000 7fe58ee2b700 1 -- 172.21.15.49:0/4117082338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 msgr2=0x7fe5880fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.827+0000 7fe58ee2b700 1 --2- 172.21.15.49:0/4117082338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 0x7fe5880fcbd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fe57c0047f0 tx=0x7fe57c009cb0).stop 2024-02-22T00:50:29.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.827+0000 7fe58ee2b700 1 -- 172.21.15.49:0/4117082338 shutdown_connections 2024-02-22T00:50:29.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.827+0000 7fe58ee2b700 1 --2- 172.21.15.49:0/4117082338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5880fd150 0x7fe5880f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.827+0000 7fe58ee2b700 1 --2- 172.21.15.49:0/4117082338 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 0x7fe5880fcbd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.827+0000 7fe58ee2b700 1 -- 172.21.15.49:0/4117082338 >> 172.21.15.49:0/4117082338 conn(0x7fe588070590 msgr2=0x7fe5880f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.827+0000 7fe58ee2b700 1 -- 172.21.15.49:0/4117082338 shutdown_connections 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.827+0000 7fe58ee2b700 1 -- 172.21.15.49:0/4117082338 wait complete. 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58ee2b700 1 Processor -- start 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58ee2b700 1 -- start start 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58ee2b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 0x7fe5880f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58ee2b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5880fd150 0x7fe5880f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58ee2b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880f8f20 con 0x7fe5880fc7f0 2024-02-22T00:50:29.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58ee2b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880f9060 con 0x7fe5880fd150 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58cbc7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 0x7fe5880f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58cbc7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 0x7fe5880f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60536/0 (socket says 172.21.15.49:60536) 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe58cbc7700 1 -- 172.21.15.49:0/1737271340 learned_addr learned my addr 172.21.15.49:0/1737271340 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.828+0000 7fe587fff700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5880fd150 0x7fe5880f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe58cbc7700 1 -- 172.21.15.49:0/1737271340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5880fd150 msgr2=0x7fe5880f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe58cbc7700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5880fd150 0x7fe5880f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe58cbc7700 1 -- 172.21.15.49:0/1737271340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c005040 con 0x7fe5880fc7f0 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe58cbc7700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 0x7fe5880f8540 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fe57c0043a0 tx=0x7fe57c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe585ffb700 1 -- 172.21.15.49:0/1737271340 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57c00e030 con 0x7fe5880fc7f0 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5880f92b0 con 0x7fe5880fc7f0 2024-02-22T00:50:29.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe585ffb700 1 -- 172.21.15.49:0/1737271340 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe57c007e90 con 0x7fe5880fc7f0 2024-02-22T00:50:29.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe585ffb700 1 -- 172.21.15.49:0/1737271340 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe57c018070 con 0x7fe5880fc7f0 2024-02-22T00:50:29.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.829+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe588114600 con 0x7fe5880fc7f0 2024-02-22T00:50:29.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.830+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58805f590 con 0x7fe5880fc7f0 2024-02-22T00:50:29.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.831+0000 7fe585ffb700 1 -- 172.21.15.49:0/1737271340 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe57c009590 con 0x7fe5880fc7f0 2024-02-22T00:50:29.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.831+0000 7fe585ffb700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe57806ca40 0x7fe57806ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:29.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.831+0000 7fe585ffb700 1 -- 172.21.15.49:0/1737271340 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe57c08d0c0 con 0x7fe5880fc7f0 2024-02-22T00:50:29.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.831+0000 7fe587fff700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe57806ca40 0x7fe57806ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:29.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.831+0000 7fe587fff700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe57806ca40 0x7fe57806ef00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe5880f9ce0 tx=0x7fe574009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:29.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:29.835+0000 7fe585ffb700 1 -- 172.21.15.49:0/1737271340 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe57c057190 con 0x7fe5880fc7f0 2024-02-22T00:50:30.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.053+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5880fb5a0 con 0x7fe57806ca40 2024-02-22T00:50:30.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.054+0000 7fe585ffb700 1 -- 172.21.15.49:0/1737271340 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe5880fb5a0 con 0x7fe57806ca40 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:50:30.057 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:50:30.058 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.056+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe57806ca40 msgr2=0x7fe57806ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.056+0000 7fe58ee2b700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe57806ca40 0x7fe57806ef00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe5880f9ce0 tx=0x7fe574009de0).stop 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.056+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 msgr2=0x7fe5880f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.056+0000 7fe58ee2b700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 0x7fe5880f8540 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fe57c0043a0 tx=0x7fe57c009cb0).stop 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.056+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 shutdown_connections 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.056+0000 7fe58ee2b700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe57806ca40 0x7fe57806ef00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.056+0000 7fe58ee2b700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe5880fc7f0 0x7fe5880f8540 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.056+0000 7fe58ee2b700 1 --2- 172.21.15.49:0/1737271340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5880fd150 0x7fe5880f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.057+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 >> 172.21.15.49:0/1737271340 conn(0x7fe588070590 msgr2=0x7fe588060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.057+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 shutdown_connections 2024-02-22T00:50:30.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.057+0000 7fe58ee2b700 1 -- 172.21.15.49:0/1737271340 wait complete. 2024-02-22T00:50:30.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.158+0000 7f692b6d9700 1 -- 172.21.15.49:0/805175340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fd150 msgr2=0x7f69240f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.158+0000 7f692b6d9700 1 --2- 172.21.15.49:0/805175340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fd150 0x7f69240f6930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f69180047f0 tx=0x7f6918009cb0).stop 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.158+0000 7f692b6d9700 1 -- 172.21.15.49:0/805175340 shutdown_connections 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.158+0000 7f692b6d9700 1 --2- 172.21.15.49:0/805175340 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fd150 0x7f69240f6930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.158+0000 7f692b6d9700 1 --2- 172.21.15.49:0/805175340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69240fc7f0 0x7f69240fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.158+0000 7f692b6d9700 1 -- 172.21.15.49:0/805175340 >> 172.21.15.49:0/805175340 conn(0x7f6924070590 msgr2=0x7f69240f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.158+0000 7f692b6d9700 1 -- 172.21.15.49:0/805175340 shutdown_connections 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.158+0000 7f692b6d9700 1 -- 172.21.15.49:0/805175340 wait complete. 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f692b6d9700 1 Processor -- start 2024-02-22T00:50:30.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f692b6d9700 1 -- start start 2024-02-22T00:50:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f692b6d9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fc7f0 0x7f692410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f692b6d9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69240fd150 0x7f692410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:30.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f692b6d9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692410ec00 con 0x7f69240fc7f0 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f692b6d9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6924108220 con 0x7f69240fd150 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6929475700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fc7f0 0x7f692410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6929475700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fc7f0 0x7f692410e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60564/0 (socket says 172.21.15.49:60564) 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6929475700 1 -- 172.21.15.49:0/140580195 learned_addr learned my addr 172.21.15.49:0/140580195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6928c74700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69240fd150 0x7f692410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6929475700 1 -- 172.21.15.49:0/140580195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69240fd150 msgr2=0x7f692410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6929475700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69240fd150 0x7f692410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6929475700 1 -- 172.21.15.49:0/140580195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918005040 con 0x7f69240fc7f0 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6928c74700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69240fd150 0x7f692410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.159+0000 7f6929475700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fc7f0 0x7f692410e080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f692000b4b0 tx=0x7f69200090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.160+0000 7f69167fc700 1 -- 172.21.15.49:0/140580195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6920002500 con 0x7f69240fc7f0 2024-02-22T00:50:30.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.160+0000 7f69167fc700 1 -- 172.21.15.49:0/140580195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6920002b10 con 0x7f69240fc7f0 2024-02-22T00:50:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.160+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69241084d0 con 0x7f69240fc7f0 2024-02-22T00:50:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.160+0000 7f69167fc700 1 -- 172.21.15.49:0/140580195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6920012cf0 con 0x7f69240fc7f0 2024-02-22T00:50:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.160+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6924108a10 con 0x7f69240fc7f0 2024-02-22T00:50:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.161+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692405f590 con 0x7f69240fc7f0 2024-02-22T00:50:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.161+0000 7f69167fc700 1 -- 172.21.15.49:0/140580195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6920002660 con 0x7f69240fc7f0 2024-02-22T00:50:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.162+0000 7f69167fc700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f691006caa0 0x7f691006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:50:30.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.162+0000 7f69167fc700 1 -- 172.21.15.49:0/140580195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f692008be70 con 0x7f69240fc7f0 2024-02-22T00:50:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.162+0000 7f6928c74700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f691006caa0 0x7f691006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:50:30.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.162+0000 7f6928c74700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f691006caa0 0x7f691006ef60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f6918004f10 tx=0x7f691800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:50:30.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.166+0000 7f69167fc700 1 -- 172.21.15.49:0/140580195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6920059910 con 0x7f69240fc7f0 2024-02-22T00:50:30.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.445+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6924109100 con 0x7f69240fc7f0 2024-02-22T00:50:30.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.445+0000 7f69167fc700 1 -- 172.21.15.49:0/140580195 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f69200594a0 con 0x7f69240fc7f0 2024-02-22T00:50:30.448 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:50:30.448 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:50:30.448 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:50:30.448 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:50:30.448 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:50:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f691006caa0 msgr2=0x7f691006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f691006caa0 0x7f691006ef60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f6918004f10 tx=0x7f691800b040).stop 2024-02-22T00:50:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fc7f0 msgr2=0x7f692410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:50:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fc7f0 0x7f692410e080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f692000b4b0 tx=0x7f69200090f0).stop 2024-02-22T00:50:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 shutdown_connections 2024-02-22T00:50:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f691006caa0 0x7f691006ef60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69240fc7f0 0x7f692410e080 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:30.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 --2- 172.21.15.49:0/140580195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69240fd150 0x7f692410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:50:30.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 >> 172.21.15.49:0/140580195 conn(0x7f6924070590 msgr2=0x7f6924060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:50:30.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 shutdown_connections 2024-02-22T00:50:30.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:50:30.447+0000 7f692b6d9700 1 -- 172.21.15.49:0/140580195 wait complete. 2024-02-22T00:50:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:30 smithi161 ceph-mon[113442]: pgmap v407: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:30 smithi161 ceph-mon[113442]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:30 smithi161 ceph-mon[113442]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:30 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4122347346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:50:30.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:30 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3388738717' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:50:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:30 smithi049 ceph-mon[132694]: pgmap v407: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:30 smithi049 ceph-mon[132694]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:30 smithi049 ceph-mon[132694]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:30 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4122347346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:50:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:30 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3388738717' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:50:31.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:31 smithi161 ceph-mon[113442]: from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:31.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:31 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/140580195' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:50:31.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:31 smithi049 ceph-mon[132694]: from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:50:31.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:31 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/140580195' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:50:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:32 smithi161 ceph-mon[113442]: pgmap v408: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:32.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:32 smithi049 ceph-mon[132694]: pgmap v408: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:34 smithi161 ceph-mon[113442]: pgmap v409: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:34 smithi049 ceph-mon[132694]: pgmap v409: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:36 smithi161 ceph-mon[113442]: pgmap v410: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:36 smithi049 ceph-mon[132694]: pgmap v410: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:38 smithi161 ceph-mon[113442]: pgmap v411: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:38 smithi049 ceph-mon[132694]: pgmap v411: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:40 smithi161 ceph-mon[113442]: pgmap v412: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:40.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:40 smithi049 ceph-mon[132694]: pgmap v412: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:42.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:42 smithi161 ceph-mon[113442]: pgmap v413: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:42 smithi049 ceph-mon[132694]: pgmap v413: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:50:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:50:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:44 smithi161 ceph-mon[113442]: pgmap v414: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:44 smithi049 ceph-mon[132694]: pgmap v414: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:46 smithi161 ceph-mon[113442]: pgmap v415: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:46 smithi049 ceph-mon[132694]: pgmap v415: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:48 smithi161 ceph-mon[113442]: pgmap v416: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:48 smithi049 ceph-mon[132694]: pgmap v416: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:50 smithi161 ceph-mon[113442]: pgmap v417: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:50.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:50 smithi049 ceph-mon[132694]: pgmap v417: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:52 smithi161 ceph-mon[113442]: pgmap v418: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:52 smithi049 ceph-mon[132694]: pgmap v418: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:54 smithi161 ceph-mon[113442]: pgmap v419: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:54 smithi049 ceph-mon[132694]: pgmap v419: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:56 smithi161 ceph-mon[113442]: pgmap v420: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:56.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:56 smithi049 ceph-mon[132694]: pgmap v420: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:58 smithi161 ceph-mon[113442]: pgmap v421: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:50:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:50:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:58 smithi049 ceph-mon[132694]: pgmap v421: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:50:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:50:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:51:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:00 smithi161 ceph-mon[113442]: pgmap v422: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:00.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 -- 172.21.15.49:0/1997616072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fc7f0 msgr2=0x7f15340fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:00.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 --2- 172.21.15.49:0/1997616072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fc7f0 0x7f15340fcbd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f15300047f0 tx=0x7f1530009cb0).stop 2024-02-22T00:51:00.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 -- 172.21.15.49:0/1997616072 shutdown_connections 2024-02-22T00:51:00.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 --2- 172.21.15.49:0/1997616072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15340fd150 0x7f15340f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:51:00.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 --2- 172.21.15.49:0/1997616072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fc7f0 0x7f15340fcbd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 -- 172.21.15.49:0/1997616072 >> 172.21.15.49:0/1997616072 conn(0x7f1534070590 msgr2=0x7f15340f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 -- 172.21.15.49:0/1997616072 shutdown_connections 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 -- 172.21.15.49:0/1997616072 wait complete. 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.564+0000 7f153b63c700 1 Processor -- start 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f153b63c700 1 -- start start 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f153b63c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15340fc7f0 0x7f1534109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f153b63c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fd150 0x7f1534109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f153b63c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1534109bd0 con 0x7f15340fd150 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f153b63c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1534109d10 con 0x7f15340fc7f0 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f1538bd7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fd150 0x7f1534109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f1538bd7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fd150 0x7f1534109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59310/0 (socket says 172.21.15.49:59310) 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f1538bd7700 1 -- 172.21.15.49:0/3041479894 learned_addr learned my addr 172.21.15.49:0/3041479894 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:00.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f15393d8700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15340fc7f0 0x7f1534109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f1538bd7700 1 -- 172.21.15.49:0/3041479894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15340fc7f0 msgr2=0x7f1534109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f1538bd7700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15340fc7f0 0x7f1534109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f1538bd7700 1 -- 172.21.15.49:0/3041479894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530005040 con 0x7f15340fd150 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.565+0000 7f1538bd7700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fd150 0x7f1534109650 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f152400b480 tx=0x7f15240090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.566+0000 7f152a7fc700 1 -- 172.21.15.49:0/3041479894 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1524002500 con 0x7f15340fd150 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.566+0000 7f152a7fc700 1 -- 172.21.15.49:0/3041479894 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1524002b10 con 0x7f15340fd150 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.566+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1534109fc0 con 0x7f15340fd150 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.566+0000 7f152a7fc700 1 -- 172.21.15.49:0/3041479894 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1524012c60 con 0x7f15340fd150 2024-02-22T00:51:00.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.566+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1534112550 con 0x7f15340fd150 2024-02-22T00:51:00.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.567+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153405f590 con 0x7f15340fd150 2024-02-22T00:51:00.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.567+0000 7f152a7fc700 1 -- 172.21.15.49:0/3041479894 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1524002660 con 0x7f15340fd150 2024-02-22T00:51:00.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.568+0000 7f152a7fc700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f152006caa0 0x7f152006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:00.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.568+0000 7f152a7fc700 1 -- 172.21.15.49:0/3041479894 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f152408bda0 con 0x7f15340fd150 2024-02-22T00:51:00.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.568+0000 7f15393d8700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f152006caa0 0x7f152006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:00.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.568+0000 7f15393d8700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f152006caa0 0x7f152006ef60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f1530007cf0 tx=0x7f153000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:00.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.572+0000 7f152a7fc700 1 -- 172.21.15.49:0/3041479894 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1524055e70 con 0x7f15340fd150 2024-02-22T00:51:00.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:00 smithi049 ceph-mon[132694]: pgmap v422: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:00.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.787+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1534060d30 con 0x7f152006caa0 2024-02-22T00:51:00.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.789+0000 7f152a7fc700 1 -- 172.21.15.49:0/3041479894 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1534060d30 con 0x7f152006caa0 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f152006caa0 msgr2=0x7f152006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f152006caa0 0x7f152006ef60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f1530007cf0 tx=0x7f153000b040).stop 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fd150 msgr2=0x7f1534109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fd150 0x7f1534109650 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f152400b480 tx=0x7f15240090f0).stop 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 shutdown_connections 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f152006caa0 0x7f152006ef60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15340fc7f0 0x7f1534109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 --2- 172.21.15.49:0/3041479894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15340fd150 0x7f1534109650 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:00.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 >> 172.21.15.49:0/3041479894 conn(0x7f1534070590 msgr2=0x7f15340fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:00.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 shutdown_connections 2024-02-22T00:51:00.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.791+0000 7f153b63c700 1 -- 172.21.15.49:0/3041479894 wait complete. 2024-02-22T00:51:00.803 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 -- 172.21.15.49:0/62841637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fc7f0 msgr2=0x7f49940fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 --2- 172.21.15.49:0/62841637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fc7f0 0x7f49940fcbd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f49840047f0 tx=0x7f4984009cb0).stop 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 -- 172.21.15.49:0/62841637 shutdown_connections 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 --2- 172.21.15.49:0/62841637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49940fd150 0x7f49940f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 --2- 172.21.15.49:0/62841637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fc7f0 0x7f49940fcbd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 -- 172.21.15.49:0/62841637 >> 172.21.15.49:0/62841637 conn(0x7f4994070590 msgr2=0x7f49940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 -- 172.21.15.49:0/62841637 shutdown_connections 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 -- 172.21.15.49:0/62841637 wait complete. 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.894+0000 7f499c443700 1 Processor -- start 2024-02-22T00:51:00.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f499c443700 1 -- start start 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f499c443700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49940fc7f0 0x7f499410cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f499c443700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fd150 0x7f499410d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f499c443700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499410daf0 con 0x7f49940fd150 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f499c443700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4994107110 con 0x7f49940fc7f0 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f49999de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fd150 0x7f499410d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f49999de700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fd150 0x7f499410d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59334/0 (socket says 172.21.15.49:59334) 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f49999de700 1 -- 172.21.15.49:0/1276940409 learned_addr learned my addr 172.21.15.49:0/1276940409 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f499a1df700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49940fc7f0 0x7f499410cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f49999de700 1 -- 172.21.15.49:0/1276940409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49940fc7f0 msgr2=0x7f499410cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f49999de700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49940fc7f0 0x7f499410cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f49999de700 1 -- 172.21.15.49:0/1276940409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4984005040 con 0x7f49940fd150 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f49999de700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fd150 0x7f499410d460 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f499000b480 tx=0x7f49900090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f498b7fe700 1 -- 172.21.15.49:0/1276940409 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4990002500 con 0x7f49940fd150 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f498b7fe700 1 -- 172.21.15.49:0/1276940409 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4990002b10 con 0x7f49940fd150 2024-02-22T00:51:00.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.895+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4994107360 con 0x7f49940fd150 2024-02-22T00:51:00.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.896+0000 7f498b7fe700 1 -- 172.21.15.49:0/1276940409 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4990012c90 con 0x7f49940fd150 2024-02-22T00:51:00.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.896+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49941078a0 con 0x7f49940fd150 2024-02-22T00:51:00.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.896+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499405f590 con 0x7f49940fd150 2024-02-22T00:51:00.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.897+0000 7f498b7fe700 1 -- 172.21.15.49:0/1276940409 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4990002660 con 0x7f49940fd150 2024-02-22T00:51:00.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.897+0000 7f498b7fe700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f498006caa0 0x7f498006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:00.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.898+0000 7f498b7fe700 1 -- 172.21.15.49:0/1276940409 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f499008bda0 con 0x7f49940fd150 2024-02-22T00:51:00.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.898+0000 7f499a1df700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f498006caa0 0x7f498006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:00.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.898+0000 7f499a1df700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f498006caa0 0x7f498006ef60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f4984004f10 tx=0x7f498400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:00.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:00.902+0000 7f498b7fe700 1 -- 172.21.15.49:0/1276940409 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4990059900 con 0x7f49940fd150 2024-02-22T00:51:01.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.123+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49941085f0 con 0x7f498006caa0 2024-02-22T00:51:01.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.125+0000 7f498b7fe700 1 -- 172.21.15.49:0/1276940409 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f49941085f0 con 0x7f498006caa0 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f498006caa0 msgr2=0x7f498006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f498006caa0 0x7f498006ef60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f4984004f10 tx=0x7f498400b040).stop 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fd150 msgr2=0x7f499410d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fd150 0x7f499410d460 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f499000b480 tx=0x7f49900090f0).stop 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 shutdown_connections 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f498006caa0 0x7f498006ef60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49940fc7f0 0x7f499410cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 --2- 172.21.15.49:0/1276940409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49940fd150 0x7f499410d460 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 >> 172.21.15.49:0/1276940409 conn(0x7f4994070590 msgr2=0x7f49940fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:01.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 shutdown_connections 2024-02-22T00:51:01.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.127+0000 7f499c443700 1 -- 172.21.15.49:0/1276940409 wait complete. 2024-02-22T00:51:01.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.230+0000 7f5a1858a700 1 -- 172.21.15.49:0/448092332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fe270 msgr2=0x7f5a100f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.230+0000 7f5a1858a700 1 --2- 172.21.15.49:0/448092332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fe270 0x7f5a100f7a50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f5a000047f0 tx=0x7f5a00009cb0).stop 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.230+0000 7f5a1858a700 1 -- 172.21.15.49:0/448092332 shutdown_connections 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.230+0000 7f5a1858a700 1 --2- 172.21.15.49:0/448092332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fe270 0x7f5a100f7a50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.230+0000 7f5a1858a700 1 --2- 172.21.15.49:0/448092332 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a100fd910 0x7f5a100fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.230+0000 7f5a1858a700 1 -- 172.21.15.49:0/448092332 >> 172.21.15.49:0/448092332 conn(0x7f5a100f3530 msgr2=0x7f5a100f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.230+0000 7f5a1858a700 1 -- 172.21.15.49:0/448092332 shutdown_connections 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.230+0000 7f5a1858a700 1 -- 172.21.15.49:0/448092332 wait complete. 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a1858a700 1 Processor -- start 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a1858a700 1 -- start start 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a1858a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fd910 0x7f5a1006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a1858a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a100fe270 0x7f5a1006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a1858a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1006bab0 con 0x7f5a100fd910 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a1858a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1006bbf0 con 0x7f5a100fe270 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a16326700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fd910 0x7f5a1006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a16326700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fd910 0x7f5a1006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59366/0 (socket says 172.21.15.49:59366) 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a16326700 1 -- 172.21.15.49:0/725700396 learned_addr learned my addr 172.21.15.49:0/725700396 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a15b25700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a100fe270 0x7f5a1006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a16326700 1 -- 172.21.15.49:0/725700396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a100fe270 msgr2=0x7f5a1006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a16326700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a100fe270 0x7f5a1006b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a16326700 1 -- 172.21.15.49:0/725700396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00005040 con 0x7f5a100fd910 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a15b25700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a100fe270 0x7f5a1006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.231+0000 7f5a16326700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fd910 0x7f5a1006b0d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f5a0c00c740 tx=0x7f5a0c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.232+0000 7f5a077fe700 1 -- 172.21.15.49:0/725700396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c00e680 con 0x7f5a100fd910 2024-02-22T00:51:01.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.232+0000 7f5a077fe700 1 -- 172.21.15.49:0/725700396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5a0c00ec90 con 0x7f5a100fd910 2024-02-22T00:51:01.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.232+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1006bea0 con 0x7f5a100fd910 2024-02-22T00:51:01.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.232+0000 7f5a077fe700 1 -- 172.21.15.49:0/725700396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c013d60 con 0x7f5a100fd910 2024-02-22T00:51:01.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.232+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a101146d0 con 0x7f5a100fd910 2024-02-22T00:51:01.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.233+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a1005f570 con 0x7f5a100fd910 2024-02-22T00:51:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.233+0000 7f5a077fe700 1 -- 172.21.15.49:0/725700396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5a0c00e7e0 con 0x7f5a100fd910 2024-02-22T00:51:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.234+0000 7f5a077fe700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f59fc06caa0 0x7f59fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.234+0000 7f5a077fe700 1 -- 172.21.15.49:0/725700396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5a0c08c020 con 0x7f5a100fd910 2024-02-22T00:51:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.234+0000 7f5a15b25700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f59fc06caa0 0x7f59fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.234+0000 7f5a15b25700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f59fc06caa0 0x7f59fc06ef60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f5a00004f10 tx=0x7f5a0000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:01.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.238+0000 7f5a077fe700 1 -- 172.21.15.49:0/725700396 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5a0c0560f0 con 0x7f5a100fd910 2024-02-22T00:51:01.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.445+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a1006c6c0 con 0x7f59fc06caa0 2024-02-22T00:51:01.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.455+0000 7f5a077fe700 1 -- 172.21.15.49:0/725700396 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f5a1006c6c0 con 0x7f59fc06caa0 2024-02-22T00:51:01.458 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:51:01.458 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (14m) 8m ago 25m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:51:01.458 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (11m) 8m ago 25m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:51:01.458 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (11m) 7m ago 24m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (13m) 8m ago 25m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (8m) 8m ago 20m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (8m) 8m ago 20m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (7m) 7m ago 20m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (7m) 7m ago 20m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (15m) 8m ago 26m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (15m) 7m ago 24m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (12m) 8m ago 26m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (12m) 7m ago 24m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (14m) 8m ago 25m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:51:01.459 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (14m) 7m ago 24m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:51:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (11m) 8m ago 24m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:51:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (11m) 8m ago 23m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:51:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (10m) 8m ago 23m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:51:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (9m) 7m ago 22m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:51:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (9m) 7m ago 22m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:51:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (8m) 7m ago 21m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:51:01.460 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (14m) 7m ago 24m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.457+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f59fc06caa0 msgr2=0x7f59fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f59fc06caa0 0x7f59fc06ef60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f5a00004f10 tx=0x7f5a0000b040).stop 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fd910 msgr2=0x7f5a1006b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fd910 0x7f5a1006b0d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f5a0c00c740 tx=0x7f5a0c007ef0).stop 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 shutdown_connections 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f59fc06caa0 0x7f59fc06ef60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a100fd910 0x7f5a1006b0d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 --2- 172.21.15.49:0/725700396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a100fe270 0x7f5a1006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 >> 172.21.15.49:0/725700396 conn(0x7f5a100f3530 msgr2=0x7f5a100fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 shutdown_connections 2024-02-22T00:51:01.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.458+0000 7f5a1858a700 1 -- 172.21.15.49:0/725700396 wait complete. 2024-02-22T00:51:01.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 -- 172.21.15.49:0/3505420911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 msgr2=0x7fa0380fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 --2- 172.21.15.49:0/3505420911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 0x7fa0380fdcf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa0340047f0 tx=0x7fa034009cb0).stop 2024-02-22T00:51:01.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 -- 172.21.15.49:0/3505420911 shutdown_connections 2024-02-22T00:51:01.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 --2- 172.21.15.49:0/3505420911 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0380fe270 0x7fa0380f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 --2- 172.21.15.49:0/3505420911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 0x7fa0380fdcf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 -- 172.21.15.49:0/3505420911 >> 172.21.15.49:0/3505420911 conn(0x7fa0380f3530 msgr2=0x7fa0380f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 -- 172.21.15.49:0/3505420911 shutdown_connections 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 -- 172.21.15.49:0/3505420911 wait complete. 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.558+0000 7fa0402d0700 1 Processor -- start 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa0402d0700 1 -- start start 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa0402d0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 0x7fa03810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa0402d0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0380fe270 0x7fa03810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa0402d0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03810ead0 con 0x7fa0380fd910 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa0402d0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03810ec10 con 0x7fa0380fe270 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03e06c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 0x7fa03810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03e06c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 0x7fa03810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59220/0 (socket says 172.21.15.49:59220) 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03e06c700 1 -- 172.21.15.49:0/1183869220 learned_addr learned my addr 172.21.15.49:0/1183869220 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03d86b700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0380fe270 0x7fa03810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03e06c700 1 -- 172.21.15.49:0/1183869220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0380fe270 msgr2=0x7fa03810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03e06c700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0380fe270 0x7fa03810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03e06c700 1 -- 172.21.15.49:0/1183869220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034005040 con 0x7fa0380fd910 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03d86b700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0380fe270 0x7fa03810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa03e06c700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 0x7fa03810dfe0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fa034005010 tx=0x7fa034009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.559+0000 7fa02b779700 1 -- 172.21.15.49:0/1183869220 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03400e030 con 0x7fa0380fd910 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.560+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa038108240 con 0x7fa0380fd910 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.560+0000 7fa02b779700 1 -- 172.21.15.49:0/1183869220 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa034007e90 con 0x7fa0380fd910 2024-02-22T00:51:01.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.560+0000 7fa02b779700 1 -- 172.21.15.49:0/1183869220 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa034018070 con 0x7fa0380fd910 2024-02-22T00:51:01.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.560+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0381087a0 con 0x7fa0380fd910 2024-02-22T00:51:01.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.561+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03805f570 con 0x7fa0380fd910 2024-02-22T00:51:01.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.561+0000 7fa02b779700 1 -- 172.21.15.49:0/1183869220 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa03401d6e0 con 0x7fa0380fd910 2024-02-22T00:51:01.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.562+0000 7fa02b779700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa02406caa0 0x7fa02406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.562+0000 7fa02b779700 1 -- 172.21.15.49:0/1183869220 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa03408cfb0 con 0x7fa0380fd910 2024-02-22T00:51:01.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.562+0000 7fa03d86b700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa02406caa0 0x7fa02406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.562+0000 7fa03d86b700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa02406caa0 0x7fa02406ef60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa038109920 tx=0x7fa02c009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:01.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.566+0000 7fa02b779700 1 -- 172.21.15.49:0/1183869220 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa03405abd0 con 0x7fa0380fd910 2024-02-22T00:51:01.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.849+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa038047540 con 0x7fa0380fd910 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.850+0000 7fa02b779700 1 -- 172.21.15.49:0/1183869220 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fa03405a760 con 0x7fa0380fd910 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:51:01.852 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:51:01.853 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa02406caa0 msgr2=0x7fa02406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa02406caa0 0x7fa02406ef60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa038109920 tx=0x7fa02c009d60).stop 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 msgr2=0x7fa03810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 0x7fa03810dfe0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fa034005010 tx=0x7fa034009cb0).stop 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 shutdown_connections 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa02406caa0 0x7fa02406ef60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0380fd910 0x7fa03810dfe0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 --2- 172.21.15.49:0/1183869220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0380fe270 0x7fa03810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 >> 172.21.15.49:0/1183869220 conn(0x7fa0380f3530 msgr2=0x7fa0380fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:01.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 shutdown_connections 2024-02-22T00:51:01.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.852+0000 7fa0402d0700 1 -- 172.21.15.49:0/1183869220 wait complete. 2024-02-22T00:51:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.953+0000 7fa6d3eee700 1 -- 172.21.15.49:0/2553354235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fc7f0 msgr2=0x7fa6cc0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.953+0000 7fa6d3eee700 1 --2- 172.21.15.49:0/2553354235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fc7f0 0x7fa6cc0fcbd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fa6c80047f0 tx=0x7fa6c8009cb0).stop 2024-02-22T00:51:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.953+0000 7fa6d3eee700 1 -- 172.21.15.49:0/2553354235 shutdown_connections 2024-02-22T00:51:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.953+0000 7fa6d3eee700 1 --2- 172.21.15.49:0/2553354235 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0fd150 0x7fa6cc0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:51:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.953+0000 7fa6d3eee700 1 --2- 172.21.15.49:0/2553354235 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fc7f0 0x7fa6cc0fcbd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.953+0000 7fa6d3eee700 1 -- 172.21.15.49:0/2553354235 >> 172.21.15.49:0/2553354235 conn(0x7fa6cc070590 msgr2=0x7fa6cc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.954+0000 7fa6d3eee700 1 -- 172.21.15.49:0/2553354235 shutdown_connections 2024-02-22T00:51:01.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.954+0000 7fa6d3eee700 1 -- 172.21.15.49:0/2553354235 wait complete. 2024-02-22T00:51:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.954+0000 7fa6d3eee700 1 Processor -- start 2024-02-22T00:51:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.954+0000 7fa6d3eee700 1 -- start start 2024-02-22T00:51:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.954+0000 7fa6d3eee700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0fc7f0 0x7fa6cc10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.954+0000 7fa6d3eee700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fd150 0x7fa6cc10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.954+0000 7fa6d3eee700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc10ebe0 con 0x7fa6cc0fd150 2024-02-22T00:51:01.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.954+0000 7fa6d3eee700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc108200 con 0x7fa6cc0fc7f0 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d1489700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fd150 0x7fa6cc10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d1489700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fd150 0x7fa6cc10e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59240/0 (socket says 172.21.15.49:59240) 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d1489700 1 -- 172.21.15.49:0/3944397210 learned_addr learned my addr 172.21.15.49:0/3944397210 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d1c8a700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0fc7f0 0x7fa6cc10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d1489700 1 -- 172.21.15.49:0/3944397210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0fc7f0 msgr2=0x7fa6cc10e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d1489700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0fc7f0 0x7fa6cc10e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d1489700 1 -- 172.21.15.49:0/3944397210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8005040 con 0x7fa6cc0fd150 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d1489700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fd150 0x7fa6cc10e550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fa6bc00b480 tx=0x7fa6bc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6c2ffd700 1 -- 172.21.15.49:0/3944397210 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6bc002500 con 0x7fa6cc0fd150 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6c2ffd700 1 -- 172.21.15.49:0/3944397210 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6bc002b10 con 0x7fa6cc0fd150 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc1084b0 con 0x7fa6cc0fd150 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6c2ffd700 1 -- 172.21.15.49:0/3944397210 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6bc012c60 con 0x7fa6cc0fd150 2024-02-22T00:51:01.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.955+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc1089f0 con 0x7fa6cc0fd150 2024-02-22T00:51:01.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.956+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc05f590 con 0x7fa6cc0fd150 2024-02-22T00:51:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.957+0000 7fa6c2ffd700 1 -- 172.21.15.49:0/3944397210 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa6bc002660 con 0x7fa6cc0fd150 2024-02-22T00:51:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.957+0000 7fa6c2ffd700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6b806caa0 0x7fa6b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.957+0000 7fa6c2ffd700 1 -- 172.21.15.49:0/3944397210 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa6bc08bce0 con 0x7fa6cc0fd150 2024-02-22T00:51:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.957+0000 7fa6d1c8a700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6b806caa0 0x7fa6b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:01.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.958+0000 7fa6d1c8a700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6b806caa0 0x7fa6b806ef60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fa6c8007cf0 tx=0x7fa6c800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:01.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:01.962+0000 7fa6c2ffd700 1 -- 172.21.15.49:0/3944397210 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa6bc059840 con 0x7fa6cc0fd150 2024-02-22T00:51:02.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.202+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa6cc1090e0 con 0x7fa6cc0fd150 2024-02-22T00:51:02.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.203+0000 7fa6c2ffd700 1 -- 172.21.15.49:0/3944397210 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fa6bc0593d0 con 0x7fa6cc0fd150 2024-02-22T00:51:02.205 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:51:02.205 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:51:02.205 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:51:02.205 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:51:02.206 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:51:02.207 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:51:02.208 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:51:02.208 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:51:02.208 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:51:02.208 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:51:02.208 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:51:02.208 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:51:02.208 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6b806caa0 msgr2=0x7fa6b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6b806caa0 0x7fa6b806ef60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fa6c8007cf0 tx=0x7fa6c800b040).stop 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fd150 msgr2=0x7fa6cc10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fd150 0x7fa6cc10e550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fa6bc00b480 tx=0x7fa6bc0090f0).stop 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 shutdown_connections 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6b806caa0 0x7fa6b806ef60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0fc7f0 0x7fa6cc10e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 --2- 172.21.15.49:0/3944397210 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6cc0fd150 0x7fa6cc10e550 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 >> 172.21.15.49:0/3944397210 conn(0x7fa6cc070590 msgr2=0x7fa6cc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 shutdown_connections 2024-02-22T00:51:02.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.205+0000 7fa6d3eee700 1 -- 172.21.15.49:0/3944397210 wait complete. 2024-02-22T00:51:02.210 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:51:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.308+0000 7f6533df7700 1 -- 172.21.15.49:0/365411244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fc6f0 msgr2=0x7f652c0fcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.308+0000 7f6533df7700 1 --2- 172.21.15.49:0/365411244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fc6f0 0x7f652c0fcad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f65280047f0 tx=0x7f6528009cb0).stop 2024-02-22T00:51:02.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.308+0000 7f6533df7700 1 -- 172.21.15.49:0/365411244 shutdown_connections 2024-02-22T00:51:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.308+0000 7f6533df7700 1 --2- 172.21.15.49:0/365411244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c0fd050 0x7f652c0f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.308+0000 7f6533df7700 1 --2- 172.21.15.49:0/365411244 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fc6f0 0x7f652c0fcad0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.308+0000 7f6533df7700 1 -- 172.21.15.49:0/365411244 >> 172.21.15.49:0/365411244 conn(0x7f652c070470 msgr2=0x7f652c0f47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.308+0000 7f6533df7700 1 -- 172.21.15.49:0/365411244 shutdown_connections 2024-02-22T00:51:02.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.308+0000 7f6533df7700 1 -- 172.21.15.49:0/365411244 wait complete. 2024-02-22T00:51:02.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6533df7700 1 Processor -- start 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6533df7700 1 -- start start 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6533df7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c0fc6f0 0x7f652c10cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6533df7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fd050 0x7f652c10d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6533df7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c10da80 con 0x7f652c0fd050 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6533df7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c10dbc0 con 0x7f652c0fc6f0 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6531392700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fd050 0x7f652c10d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6531392700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fd050 0x7f652c10d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59252/0 (socket says 172.21.15.49:59252) 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6531392700 1 -- 172.21.15.49:0/4152028031 learned_addr learned my addr 172.21.15.49:0/4152028031 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6531b93700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c0fc6f0 0x7f652c10cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6531392700 1 -- 172.21.15.49:0/4152028031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c0fc6f0 msgr2=0x7f652c10cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6531392700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c0fc6f0 0x7f652c10cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6531392700 1 -- 172.21.15.49:0/4152028031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528005040 con 0x7f652c0fd050 2024-02-22T00:51:02.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.309+0000 7f6531b93700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c0fc6f0 0x7f652c10cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:51:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.310+0000 7f6531392700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fd050 0x7f652c10d480 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f651c00fae0 tx=0x7f651c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.310+0000 7f6522ffd700 1 -- 172.21.15.49:0/4152028031 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f651c007d20 con 0x7f652c0fd050 2024-02-22T00:51:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.310+0000 7f6522ffd700 1 -- 172.21.15.49:0/4152028031 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f651c007e80 con 0x7f652c0fd050 2024-02-22T00:51:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.310+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c107040 con 0x7f652c0fd050 2024-02-22T00:51:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.310+0000 7f6522ffd700 1 -- 172.21.15.49:0/4152028031 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f651c012460 con 0x7f652c0fd050 2024-02-22T00:51:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.310+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c107600 con 0x7f652c0fd050 2024-02-22T00:51:02.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.311+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c05f510 con 0x7f652c0fd050 2024-02-22T00:51:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.312+0000 7f6522ffd700 1 -- 172.21.15.49:0/4152028031 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f651c00d820 con 0x7f652c0fd050 2024-02-22T00:51:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.312+0000 7f6522ffd700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f651806caf0 0x7f651806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.312+0000 7f6522ffd700 1 -- 172.21.15.49:0/4152028031 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f651c08ea90 con 0x7f652c0fd050 2024-02-22T00:51:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.312+0000 7f6531b93700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f651806caf0 0x7f651806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:02.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.313+0000 7f6531b93700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f651806caf0 0x7f651806efb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f65280043d0 tx=0x7f652800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:02.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.316+0000 7f6522ffd700 1 -- 172.21.15.49:0/4152028031 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f651c05c5f0 con 0x7f652c0fd050 2024-02-22T00:51:02.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.532+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f652c1086b0 con 0x7f651806caf0 2024-02-22T00:51:02.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.533+0000 7f6522ffd700 1 -- 172.21.15.49:0/4152028031 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f652c1086b0 con 0x7f651806caf0 2024-02-22T00:51:02.536 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:51:02.536 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:51:02.536 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:51:02.536 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:51:02.537 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:51:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.535+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f651806caf0 msgr2=0x7f651806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f651806caf0 0x7f651806efb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f65280043d0 tx=0x7f652800b040).stop 2024-02-22T00:51:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fd050 msgr2=0x7f652c10d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fd050 0x7f652c10d480 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f651c00fae0 tx=0x7f651c009ee0).stop 2024-02-22T00:51:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 shutdown_connections 2024-02-22T00:51:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f651806caf0 0x7f651806efb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f652c0fc6f0 0x7f652c10cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 --2- 172.21.15.49:0/4152028031 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f652c0fd050 0x7f652c10d480 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 >> 172.21.15.49:0/4152028031 conn(0x7f652c070470 msgr2=0x7f652c0faab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 shutdown_connections 2024-02-22T00:51:02.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.536+0000 7f6533df7700 1 -- 172.21.15.49:0/4152028031 wait complete. 2024-02-22T00:51:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:02 smithi161 ceph-mon[113442]: pgmap v423: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:02 smithi161 ceph-mon[113442]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:02 smithi161 ceph-mon[113442]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:02 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1183869220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:51:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:02 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3944397210' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:51:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.637+0000 7fb331696700 1 -- 172.21.15.49:0/2331809615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 msgr2=0x7fb32c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.637+0000 7fb331696700 1 --2- 172.21.15.49:0/2331809615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 0x7fb32c0f6930 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb3200047f0 tx=0x7fb320009cb0).stop 2024-02-22T00:51:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.637+0000 7fb331696700 1 -- 172.21.15.49:0/2331809615 shutdown_connections 2024-02-22T00:51:02.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.637+0000 7fb331696700 1 --2- 172.21.15.49:0/2331809615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 0x7fb32c0f6930 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.637+0000 7fb331696700 1 --2- 172.21.15.49:0/2331809615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0fc7f0 0x7fb32c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.637+0000 7fb331696700 1 -- 172.21.15.49:0/2331809615 >> 172.21.15.49:0/2331809615 conn(0x7fb32c070590 msgr2=0x7fb32c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.637+0000 7fb331696700 1 -- 172.21.15.49:0/2331809615 shutdown_connections 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.637+0000 7fb331696700 1 -- 172.21.15.49:0/2331809615 wait complete. 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb331696700 1 Processor -- start 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb331696700 1 -- start start 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb331696700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0fc7f0 0x7fb32c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb331696700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 0x7fb32c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb331696700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c10ebe0 con 0x7fb32c0fd150 2024-02-22T00:51:02.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb331696700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c108200 con 0x7fb32c0fc7f0 2024-02-22T00:51:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb32a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 0x7fb32c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb32a7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 0x7fb32c10e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59260/0 (socket says 172.21.15.49:59260) 2024-02-22T00:51:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb32a7fc700 1 -- 172.21.15.49:0/2373982089 learned_addr learned my addr 172.21.15.49:0/2373982089 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb32affd700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0fc7f0 0x7fb32c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb32a7fc700 1 -- 172.21.15.49:0/2373982089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0fc7f0 msgr2=0x7fb32c10e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb32a7fc700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0fc7f0 0x7fb32c10e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.638+0000 7fb32a7fc700 1 -- 172.21.15.49:0/2373982089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb320005040 con 0x7fb32c0fd150 2024-02-22T00:51:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.639+0000 7fb32a7fc700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 0x7fb32c10e550 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fb3200099f0 tx=0x7fb320009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.639+0000 7fb313fff700 1 -- 172.21.15.49:0/2373982089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb32000e030 con 0x7fb32c0fd150 2024-02-22T00:51:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.639+0000 7fb313fff700 1 -- 172.21.15.49:0/2373982089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb320007e90 con 0x7fb32c0fd150 2024-02-22T00:51:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.639+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c108450 con 0x7fb32c0fd150 2024-02-22T00:51:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.639+0000 7fb313fff700 1 -- 172.21.15.49:0/2373982089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb320018070 con 0x7fb32c0fd150 2024-02-22T00:51:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.639+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c108930 con 0x7fb32c0fd150 2024-02-22T00:51:02.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.640+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c05f590 con 0x7fb32c0fd150 2024-02-22T00:51:02.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.640+0000 7fb313fff700 1 -- 172.21.15.49:0/2373982089 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb32001d420 con 0x7fb32c0fd150 2024-02-22T00:51:02.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.641+0000 7fb313fff700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb31406caa0 0x7fb31406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:02.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.641+0000 7fb313fff700 1 -- 172.21.15.49:0/2373982089 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb32008d1c0 con 0x7fb32c0fd150 2024-02-22T00:51:02.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.641+0000 7fb32affd700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb31406caa0 0x7fb31406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:02.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.641+0000 7fb32affd700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb31406caa0 0x7fb31406ef60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fb31c00b910 tx=0x7fb31c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:02.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.645+0000 7fb313fff700 1 -- 172.21.15.49:0/2373982089 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb32005ad20 con 0x7fb32c0fd150 2024-02-22T00:51:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:02 smithi049 ceph-mon[132694]: pgmap v423: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:02 smithi049 ceph-mon[132694]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:02 smithi049 ceph-mon[132694]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:02 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1183869220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:51:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:02 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3944397210' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:51:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.925+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb32c1096e0 con 0x7fb32c0fd150 2024-02-22T00:51:02.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.926+0000 7fb313fff700 1 -- 172.21.15.49:0/2373982089 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fb32005a8b0 con 0x7fb32c0fd150 2024-02-22T00:51:02.928 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:51:02.928 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:51:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:51:02.928 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:51:02.928 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:51:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.927+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb31406caa0 msgr2=0x7fb31406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.927+0000 7fb331696700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb31406caa0 0x7fb31406ef60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fb31c00b910 tx=0x7fb31c008040).stop 2024-02-22T00:51:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.927+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 msgr2=0x7fb32c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.927+0000 7fb331696700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 0x7fb32c10e550 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fb3200099f0 tx=0x7fb320009cb0).stop 2024-02-22T00:51:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.928+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 shutdown_connections 2024-02-22T00:51:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.928+0000 7fb331696700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb31406caa0 0x7fb31406ef60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.928+0000 7fb331696700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0fc7f0 0x7fb32c10e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.928+0000 7fb331696700 1 --2- 172.21.15.49:0/2373982089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb32c0fd150 0x7fb32c10e550 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.928+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 >> 172.21.15.49:0/2373982089 conn(0x7fb32c070590 msgr2=0x7fb32c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.928+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 shutdown_connections 2024-02-22T00:51:02.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:02.928+0000 7fb331696700 1 -- 172.21.15.49:0/2373982089 wait complete. 2024-02-22T00:51:03.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:03 smithi161 ceph-mon[113442]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:03.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:03 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2373982089' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:51:03.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:03 smithi049 ceph-mon[132694]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:03.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:03 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2373982089' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:51:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:04 smithi161 ceph-mon[113442]: pgmap v424: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:04 smithi161 ceph-mon[113442]: from='client.34830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:04 smithi049 ceph-mon[132694]: pgmap v424: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:04 smithi049 ceph-mon[132694]: from='client.34830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:06 smithi161 ceph-mon[113442]: pgmap v425: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:06 smithi049 ceph-mon[132694]: pgmap v425: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:08 smithi161 ceph-mon[113442]: pgmap v426: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:08 smithi049 ceph-mon[132694]: pgmap v426: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:10 smithi161 ceph-mon[113442]: pgmap v427: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:10 smithi049 ceph-mon[132694]: pgmap v427: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:12 smithi161 ceph-mon[113442]: pgmap v428: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:12 smithi049 ceph-mon[132694]: pgmap v428: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:51:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:51:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:14 smithi161 ceph-mon[113442]: pgmap v429: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:14 smithi049 ceph-mon[132694]: pgmap v429: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:16 smithi161 ceph-mon[113442]: pgmap v430: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:16.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:16 smithi049 ceph-mon[132694]: pgmap v430: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:18 smithi161 ceph-mon[113442]: pgmap v431: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:18.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:18 smithi049 ceph-mon[132694]: pgmap v431: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:20 smithi161 ceph-mon[113442]: pgmap v432: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:20.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:20 smithi049 ceph-mon[132694]: pgmap v432: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:22 smithi161 ceph-mon[113442]: pgmap v433: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:22 smithi049 ceph-mon[132694]: pgmap v433: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:24 smithi161 ceph-mon[113442]: pgmap v434: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:24.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:24 smithi049 ceph-mon[132694]: pgmap v434: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:26 smithi161 ceph-mon[113442]: pgmap v435: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:26.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:26 smithi049 ceph-mon[132694]: pgmap v435: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:28 smithi161 ceph-mon[113442]: pgmap v436: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:51:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:28 smithi049 ceph-mon[132694]: pgmap v436: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:51:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:30 smithi161 ceph-mon[113442]: pgmap v437: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:30 smithi049 ceph-mon[132694]: pgmap v437: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:32 smithi161 ceph-mon[113442]: pgmap v438: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:32.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:32 smithi049 ceph-mon[132694]: pgmap v438: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.043+0000 7f51e16c8700 1 -- 172.21.15.49:0/1675309635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fd150 msgr2=0x7f51dc0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.043+0000 7f51e16c8700 1 --2- 172.21.15.49:0/1675309635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fd150 0x7f51dc0f6930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f51d00047f0 tx=0x7f51d0009cb0).stop 2024-02-22T00:51:33.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.043+0000 7f51e16c8700 1 -- 172.21.15.49:0/1675309635 shutdown_connections 2024-02-22T00:51:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.043+0000 7f51e16c8700 1 --2- 172.21.15.49:0/1675309635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fd150 0x7f51dc0f6930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.043+0000 7f51e16c8700 1 --2- 172.21.15.49:0/1675309635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0fc7f0 0x7f51dc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.043+0000 7f51e16c8700 1 -- 172.21.15.49:0/1675309635 >> 172.21.15.49:0/1675309635 conn(0x7f51dc070590 msgr2=0x7f51dc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.043+0000 7f51e16c8700 1 -- 172.21.15.49:0/1675309635 shutdown_connections 2024-02-22T00:51:33.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.043+0000 7f51e16c8700 1 -- 172.21.15.49:0/1675309635 wait complete. 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51e16c8700 1 Processor -- start 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51e16c8700 1 -- start start 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51e16c8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fc7f0 0x7f51dc0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51e16c8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0fd150 0x7f51dc0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51e16c8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0f8f20 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51e16c8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc0f9060 con 0x7f51dc0fd150 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fc7f0 0x7f51dc0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51daffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fc7f0 0x7f51dc0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59072/0 (socket says 172.21.15.49:59072) 2024-02-22T00:51:33.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51daffd700 1 -- 172.21.15.49:0/2092863032 learned_addr learned my addr 172.21.15.49:0/2092863032 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.044+0000 7f51da7fc700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0fd150 0x7f51dc0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51daffd700 1 -- 172.21.15.49:0/2092863032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0fd150 msgr2=0x7f51dc0f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51daffd700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0fd150 0x7f51dc0f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51daffd700 1 -- 172.21.15.49:0/2092863032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d0005040 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51da7fc700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0fd150 0x7f51dc0f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51daffd700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fc7f0 0x7f51dc0f8540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f51cc0041d0 tx=0x7f51cc009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51c3fff700 1 -- 172.21.15.49:0/2092863032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51cc002d90 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51c3fff700 1 -- 172.21.15.49:0/2092863032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f51cc00f040 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc0f9310 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51c3fff700 1 -- 172.21.15.49:0/2092863032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51cc00d800 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.045+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc1146a0 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.046+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc05f590 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.047+0000 7f51c3fff700 1 -- 172.21.15.49:0/2092863032 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f51cc00dac0 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.047+0000 7f51c3fff700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51c406caa0 0x7f51c406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.047+0000 7f51c3fff700 1 -- 172.21.15.49:0/2092863032 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f51cc08bdf0 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.047+0000 7f51da7fc700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51c406caa0 0x7f51c406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.048+0000 7f51da7fc700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51c406caa0 0x7f51c406ef60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f51d00043d0 tx=0x7f51d000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:33.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.052+0000 7f51c3fff700 1 -- 172.21.15.49:0/2092863032 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f51cc055ec0 con 0x7f51dc0fc7f0 2024-02-22T00:51:33.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.268+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51dc0fb5a0 con 0x7f51c406caa0 2024-02-22T00:51:33.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.269+0000 7f51c3fff700 1 -- 172.21.15.49:0/2092863032 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f51dc0fb5a0 con 0x7f51c406caa0 2024-02-22T00:51:33.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51c406caa0 msgr2=0x7f51c406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51c406caa0 0x7f51c406ef60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f51d00043d0 tx=0x7f51d000b040).stop 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fc7f0 msgr2=0x7f51dc0f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fc7f0 0x7f51dc0f8540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f51cc0041d0 tx=0x7f51cc009f60).stop 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 shutdown_connections 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f51c406caa0 0x7f51c406ef60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f51dc0fc7f0 0x7f51dc0f8540 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 --2- 172.21.15.49:0/2092863032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0fd150 0x7f51dc0f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.271+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 >> 172.21.15.49:0/2092863032 conn(0x7f51dc070590 msgr2=0x7f51dc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.272+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 shutdown_connections 2024-02-22T00:51:33.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.272+0000 7f51e16c8700 1 -- 172.21.15.49:0/2092863032 wait complete. 2024-02-22T00:51:33.284 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:51:33.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.374+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2248094620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f9200 msgr2=0x7fe964101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.374+0000 7fe96b9a4700 1 --2- 172.21.15.49:0/2248094620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f9200 0x7fe964101910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fe9540047f0 tx=0x7fe954009cb0).stop 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.375+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2248094620 shutdown_connections 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.375+0000 7fe96b9a4700 1 --2- 172.21.15.49:0/2248094620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f9200 0x7fe964101910 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.375+0000 7fe96b9a4700 1 --2- 172.21.15.49:0/2248094620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9640f88a0 0x7fe9640f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.375+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2248094620 >> 172.21.15.49:0/2248094620 conn(0x7fe964070590 msgr2=0x7fe9640f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.375+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2248094620 shutdown_connections 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.375+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2248094620 wait complete. 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.375+0000 7fe96b9a4700 1 Processor -- start 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.375+0000 7fe96b9a4700 1 -- start start 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe96b9a4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f88a0 0x7fe96410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe96b9a4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9640f9200 0x7fe96410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe96b9a4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96410eb70 con 0x7fe9640f88a0 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe96b9a4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96410ecb0 con 0x7fe9640f9200 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe969740700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f88a0 0x7fe96410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe969740700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f88a0 0x7fe96410e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59088/0 (socket says 172.21.15.49:59088) 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe969740700 1 -- 172.21.15.49:0/2917060723 learned_addr learned my addr 172.21.15.49:0/2917060723 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe968f3f700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9640f9200 0x7fe96410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe969740700 1 -- 172.21.15.49:0/2917060723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9640f9200 msgr2=0x7fe96410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe969740700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9640f9200 0x7fe96410e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe969740700 1 -- 172.21.15.49:0/2917060723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954005040 con 0x7fe9640f88a0 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe969740700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f88a0 0x7fe96410e080 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fe96000c790 tx=0x7fe960004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe95a7fc700 1 -- 172.21.15.49:0/2917060723 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9600106f0 con 0x7fe9640f88a0 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe964108340 con 0x7fe9640f88a0 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe95a7fc700 1 -- 172.21.15.49:0/2917060723 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe960010d00 con 0x7fe9640f88a0 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe95a7fc700 1 -- 172.21.15.49:0/2917060723 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe960012da0 con 0x7fe9640f88a0 2024-02-22T00:51:33.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.376+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe964108880 con 0x7fe9640f88a0 2024-02-22T00:51:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.377+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96405f590 con 0x7fe9640f88a0 2024-02-22T00:51:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.378+0000 7fe95a7fc700 1 -- 172.21.15.49:0/2917060723 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe960012400 con 0x7fe9640f88a0 2024-02-22T00:51:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.378+0000 7fe95a7fc700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe95006caa0 0x7fe95006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.378+0000 7fe95a7fc700 1 -- 172.21.15.49:0/2917060723 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe96008b6a0 con 0x7fe9640f88a0 2024-02-22T00:51:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.378+0000 7fe968f3f700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe95006caa0 0x7fe95006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.379+0000 7fe968f3f700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe95006caa0 0x7fe95006ef60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fe954004f10 tx=0x7fe95400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:33.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.383+0000 7fe95a7fc700 1 -- 172.21.15.49:0/2917060723 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe960059200 con 0x7fe9640f88a0 2024-02-22T00:51:33.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.598+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe964108b00 con 0x7fe95006caa0 2024-02-22T00:51:33.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.599+0000 7fe95a7fc700 1 -- 172.21.15.49:0/2917060723 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe964108b00 con 0x7fe95006caa0 2024-02-22T00:51:33.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe95006caa0 msgr2=0x7fe95006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe95006caa0 0x7fe95006ef60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fe954004f10 tx=0x7fe95400b040).stop 2024-02-22T00:51:33.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f88a0 msgr2=0x7fe96410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f88a0 0x7fe96410e080 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fe96000c790 tx=0x7fe960004330).stop 2024-02-22T00:51:33.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 shutdown_connections 2024-02-22T00:51:33.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe95006caa0 0x7fe95006ef60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9640f88a0 0x7fe96410e080 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 --2- 172.21.15.49:0/2917060723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9640f9200 0x7fe96410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 >> 172.21.15.49:0/2917060723 conn(0x7fe964070590 msgr2=0x7fe9640fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:33.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 shutdown_connections 2024-02-22T00:51:33.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.601+0000 7fe96b9a4700 1 -- 172.21.15.49:0/2917060723 wait complete. 2024-02-22T00:51:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.703+0000 7f00f624b700 1 -- 172.21.15.49:0/834179553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fd150 msgr2=0x7f00f00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.703+0000 7f00f624b700 1 --2- 172.21.15.49:0/834179553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fd150 0x7f00f00f6930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f00e40047f0 tx=0x7f00e4009cb0).stop 2024-02-22T00:51:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.703+0000 7f00f624b700 1 -- 172.21.15.49:0/834179553 shutdown_connections 2024-02-22T00:51:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.703+0000 7f00f624b700 1 --2- 172.21.15.49:0/834179553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fd150 0x7f00f00f6930 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.703+0000 7f00f624b700 1 --2- 172.21.15.49:0/834179553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f00fc7f0 0x7f00f00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.703+0000 7f00f624b700 1 -- 172.21.15.49:0/834179553 >> 172.21.15.49:0/834179553 conn(0x7f00f0070590 msgr2=0x7f00f00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.703+0000 7f00f624b700 1 -- 172.21.15.49:0/834179553 shutdown_connections 2024-02-22T00:51:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.703+0000 7f00f624b700 1 -- 172.21.15.49:0/834179553 wait complete. 2024-02-22T00:51:33.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.704+0000 7f00f624b700 1 Processor -- start 2024-02-22T00:51:33.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.704+0000 7f00f624b700 1 -- start start 2024-02-22T00:51:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00f624b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fc7f0 0x7f00f010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00f624b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f00fd150 0x7f00f010d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00f624b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f010d9c0 con 0x7f00f00fc7f0 2024-02-22T00:51:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00f624b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f010db00 con 0x7f00f00fd150 2024-02-22T00:51:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fc7f0 0x7f00f010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ef7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fc7f0 0x7f00f010ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59102/0 (socket says 172.21.15.49:59102) 2024-02-22T00:51:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ef7fe700 1 -- 172.21.15.49:0/1339678785 learned_addr learned my addr 172.21.15.49:0/1339678785 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:33.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00eeffd700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f00fd150 0x7f00f010d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ef7fe700 1 -- 172.21.15.49:0/1339678785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f00fd150 msgr2=0x7f00f010d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ef7fe700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f00fd150 0x7f00f010d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ef7fe700 1 -- 172.21.15.49:0/1339678785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e4005040 con 0x7f00f00fc7f0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00eeffd700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f00fd150 0x7f00f010d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ef7fe700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fc7f0 0x7f00f010ced0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f00e00041d0 tx=0x7f00e0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ecff9700 1 -- 172.21.15.49:0/1339678785 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00e0002d90 con 0x7f00f00fc7f0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ecff9700 1 -- 172.21.15.49:0/1339678785 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f00e000f040 con 0x7f00f00fc7f0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f0107190 con 0x7f00f00fc7f0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00ecff9700 1 -- 172.21.15.49:0/1339678785 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00e000d800 con 0x7f00f00fc7f0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.705+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f0107750 con 0x7f00f00fc7f0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.706+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f005f590 con 0x7f00f00fc7f0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.707+0000 7f00ecff9700 1 -- 172.21.15.49:0/1339678785 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f00e000da70 con 0x7f00f00fc7f0 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.707+0000 7f00ecff9700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f00d806caa0 0x7f00d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:33.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.707+0000 7f00ecff9700 1 -- 172.21.15.49:0/1339678785 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f00e008bd20 con 0x7f00f00fc7f0 2024-02-22T00:51:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.707+0000 7f00eeffd700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f00d806caa0 0x7f00d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:33.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.708+0000 7f00eeffd700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f00d806caa0 0x7f00d806ef60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f00e4004f10 tx=0x7f00e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:33.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.712+0000 7f00ecff9700 1 -- 172.21.15.49:0/1339678785 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f00e0059880 con 0x7f00f00fc7f0 2024-02-22T00:51:33.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.920+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f00f0108550 con 0x7f00d806caa0 2024-02-22T00:51:33.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.930+0000 7f00ecff9700 1 -- 172.21.15.49:0/1339678785 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f00f0108550 con 0x7f00d806caa0 2024-02-22T00:51:33.932 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:51:33.932 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (14m) 8m ago 25m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (12m) 8m ago 25m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (12m) 8m ago 25m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (14m) 8m ago 25m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (8m) 8m ago 20m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (9m) 8m ago 20m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (8m) 8m ago 20m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (8m) 8m ago 20m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (16m) 8m ago 27m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (15m) 8m ago 25m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (13m) 8m ago 27m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (13m) 8m ago 25m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:51:33.933 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (15m) 8m ago 25m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:51:33.934 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (15m) 8m ago 25m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:51:33.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (12m) 8m ago 24m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:51:33.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (11m) 8m ago 24m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:51:33.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (10m) 8m ago 23m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:51:33.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (10m) 8m ago 23m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:51:33.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (9m) 8m ago 22m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:51:33.934 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (9m) 8m ago 22m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:51:33.934 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (15m) 8m ago 24m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:51:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f00d806caa0 msgr2=0x7f00d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f00d806caa0 0x7f00d806ef60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f00e4004f10 tx=0x7f00e400b040).stop 2024-02-22T00:51:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fc7f0 msgr2=0x7f00f010ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fc7f0 0x7f00f010ced0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f00e00041d0 tx=0x7f00e0009f60).stop 2024-02-22T00:51:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 shutdown_connections 2024-02-22T00:51:33.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f00d806caa0 0x7f00d806ef60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00f00fc7f0 0x7f00f010ced0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 --2- 172.21.15.49:0/1339678785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f00fd150 0x7f00f010d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:33.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 >> 172.21.15.49:0/1339678785 conn(0x7f00f0070590 msgr2=0x7f00f00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:33.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 shutdown_connections 2024-02-22T00:51:33.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:33.932+0000 7f00f624b700 1 -- 172.21.15.49:0/1339678785 wait complete. 2024-02-22T00:51:34.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.037+0000 7efd54411700 1 -- 172.21.15.49:0/208696209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd4c0f88a0 msgr2=0x7efd4c0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.037+0000 7efd54411700 1 --2- 172.21.15.49:0/208696209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd4c0f88a0 0x7efd4c0f8c80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7efd48004730 tx=0x7efd48009cb0).stop 2024-02-22T00:51:34.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.037+0000 7efd54411700 1 -- 172.21.15.49:0/208696209 shutdown_connections 2024-02-22T00:51:34.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.037+0000 7efd54411700 1 --2- 172.21.15.49:0/208696209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd4c0f9200 0x7efd4c101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.037+0000 7efd54411700 1 --2- 172.21.15.49:0/208696209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd4c0f88a0 0x7efd4c0f8c80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.037+0000 7efd54411700 1 -- 172.21.15.49:0/208696209 >> 172.21.15.49:0/208696209 conn(0x7efd4c070590 msgr2=0x7efd4c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.037+0000 7efd54411700 1 -- 172.21.15.49:0/208696209 shutdown_connections 2024-02-22T00:51:34.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.037+0000 7efd54411700 1 -- 172.21.15.49:0/208696209 wait complete. 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd54411700 1 Processor -- start 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd54411700 1 -- start start 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd54411700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd4c0f88a0 0x7efd4c10e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd54411700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd4c0f9200 0x7efd4c10e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd54411700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c10eb60 con 0x7efd4c0f9200 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd54411700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c10eca0 con 0x7efd4c0f88a0 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd519ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd4c0f9200 0x7efd4c10e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd519ac700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd4c0f9200 0x7efd4c10e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59122/0 (socket says 172.21.15.49:59122) 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd519ac700 1 -- 172.21.15.49:0/997077479 learned_addr learned my addr 172.21.15.49:0/997077479 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd521ad700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd4c0f88a0 0x7efd4c10e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd519ac700 1 -- 172.21.15.49:0/997077479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd4c0f88a0 msgr2=0x7efd4c10e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.038+0000 7efd519ac700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd4c0f88a0 0x7efd4c10e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.039+0000 7efd519ac700 1 -- 172.21.15.49:0/997077479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd48005040 con 0x7efd4c0f9200 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.039+0000 7efd519ac700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd4c0f9200 0x7efd4c10e560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7efd3c002770 tx=0x7efd3c009e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.039+0000 7efd437fe700 1 -- 172.21.15.49:0/997077479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3c007b40 con 0x7efd4c0f9200 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.039+0000 7efd437fe700 1 -- 172.21.15.49:0/997077479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efd3c00f040 con 0x7efd4c0f9200 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.039+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4c108330 con 0x7efd4c0f9200 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.039+0000 7efd437fe700 1 -- 172.21.15.49:0/997077479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd3c0148b0 con 0x7efd4c0f9200 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.039+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c108870 con 0x7efd4c0f9200 2024-02-22T00:51:34.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.040+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4c05f590 con 0x7efd4c0f9200 2024-02-22T00:51:34.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.041+0000 7efd437fe700 1 -- 172.21.15.49:0/997077479 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efd3c009110 con 0x7efd4c0f9200 2024-02-22T00:51:34.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.041+0000 7efd437fe700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd3806caa0 0x7efd3806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.041+0000 7efd437fe700 1 -- 172.21.15.49:0/997077479 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7efd3c08b8c0 con 0x7efd4c0f9200 2024-02-22T00:51:34.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.041+0000 7efd521ad700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd3806caa0 0x7efd3806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.042+0000 7efd521ad700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd3806caa0 0x7efd3806ef60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7efd48004e50 tx=0x7efd48009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:34.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.046+0000 7efd437fe700 1 -- 172.21.15.49:0/997077479 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efd3c059420 con 0x7efd4c0f9200 2024-02-22T00:51:34.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.326+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efd4c047540 con 0x7efd4c0f9200 2024-02-22T00:51:34.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.326+0000 7efd437fe700 1 -- 172.21.15.49:0/997077479 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7efd3c058fb0 con 0x7efd4c0f9200 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:51:34.329 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:51:34.330 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:51:34.330 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:51:34.330 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:51:34.330 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:51:34.330 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:51:34.330 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:51:34.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd3806caa0 msgr2=0x7efd3806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd3806caa0 0x7efd3806ef60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7efd48004e50 tx=0x7efd48009cb0).stop 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd4c0f9200 msgr2=0x7efd4c10e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd4c0f9200 0x7efd4c10e560 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7efd3c002770 tx=0x7efd3c009e60).stop 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 shutdown_connections 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efd3806caa0 0x7efd3806ef60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd4c0f88a0 0x7efd4c10e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 --2- 172.21.15.49:0/997077479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd4c0f9200 0x7efd4c10e560 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.328+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 >> 172.21.15.49:0/997077479 conn(0x7efd4c070590 msgr2=0x7efd4c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.329+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 shutdown_connections 2024-02-22T00:51:34.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.329+0000 7efd54411700 1 -- 172.21.15.49:0/997077479 wait complete. 2024-02-22T00:51:34.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.430+0000 7f387af46700 1 -- 172.21.15.49:0/2726733614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fd8f0 msgr2=0x7f38740fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.430+0000 7f387af46700 1 --2- 172.21.15.49:0/2726733614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fd8f0 0x7f38740fdcd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f38680047f0 tx=0x7f3868009cb0).stop 2024-02-22T00:51:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.430+0000 7f387af46700 1 -- 172.21.15.49:0/2726733614 shutdown_connections 2024-02-22T00:51:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.430+0000 7f387af46700 1 --2- 172.21.15.49:0/2726733614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38740fe250 0x7f38740f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:51:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.430+0000 7f387af46700 1 --2- 172.21.15.49:0/2726733614 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fd8f0 0x7f38740fdcd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.430+0000 7f387af46700 1 -- 172.21.15.49:0/2726733614 >> 172.21.15.49:0/2726733614 conn(0x7f38740f34b0 msgr2=0x7f38740f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.430+0000 7f387af46700 1 -- 172.21.15.49:0/2726733614 shutdown_connections 2024-02-22T00:51:34.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.430+0000 7f387af46700 1 -- 172.21.15.49:0/2726733614 wait complete. 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f387af46700 1 Processor -- start 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f387af46700 1 -- start start 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f387af46700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38740fd8f0 0x7f387410e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f387af46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fe250 0x7f387410e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f387af46700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387410ec80 con 0x7f38740fe250 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f387af46700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38741082a0 con 0x7f38740fd8f0 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f3873fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fe250 0x7f387410e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f3873fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fe250 0x7f387410e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59150/0 (socket says 172.21.15.49:59150) 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f3873fff700 1 -- 172.21.15.49:0/838472425 learned_addr learned my addr 172.21.15.49:0/838472425 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f3878ce2700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38740fd8f0 0x7f387410e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f3873fff700 1 -- 172.21.15.49:0/838472425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38740fd8f0 msgr2=0x7f387410e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f3873fff700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38740fd8f0 0x7f387410e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f3873fff700 1 -- 172.21.15.49:0/838472425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868005040 con 0x7f38740fe250 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.431+0000 7f3878ce2700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38740fd8f0 0x7f387410e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.432+0000 7f3873fff700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fe250 0x7f387410e5f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f386000b480 tx=0x7f38600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.432+0000 7f3871ffb700 1 -- 172.21.15.49:0/838472425 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3860002500 con 0x7f38740fe250 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.432+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3874108550 con 0x7f38740fe250 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.432+0000 7f3871ffb700 1 -- 172.21.15.49:0/838472425 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3860002b10 con 0x7f38740fe250 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.432+0000 7f3871ffb700 1 -- 172.21.15.49:0/838472425 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3860012c90 con 0x7f38740fe250 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.432+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3874108a90 con 0x7f38740fe250 2024-02-22T00:51:34.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.433+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387405f590 con 0x7f38740fe250 2024-02-22T00:51:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.433+0000 7f3871ffb700 1 -- 172.21.15.49:0/838472425 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3860002660 con 0x7f38740fe250 2024-02-22T00:51:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.434+0000 7f3871ffb700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f386406caa0 0x7f386406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.434+0000 7f3871ffb700 1 -- 172.21.15.49:0/838472425 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f386008be70 con 0x7f38740fe250 2024-02-22T00:51:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.434+0000 7f3878ce2700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f386406caa0 0x7f386406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.434+0000 7f3878ce2700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f386406caa0 0x7f386406ef60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f38680047c0 tx=0x7f386800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:34.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.438+0000 7f3871ffb700 1 -- 172.21.15.49:0/838472425 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f38600599d0 con 0x7f38740fe250 2024-02-22T00:51:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:34 smithi161 ceph-mon[113442]: pgmap v439: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:34 smithi161 ceph-mon[113442]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:34 smithi049 ceph-mon[132694]: pgmap v439: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:34 smithi049 ceph-mon[132694]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:34.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.689+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3874109780 con 0x7f38740fe250 2024-02-22T00:51:34.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.690+0000 7f3871ffb700 1 -- 172.21.15.49:0/838472425 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f3860059560 con 0x7f38740fe250 2024-02-22T00:51:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:51:34.692 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:51:34.693 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:51:34.694 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:51:34.695 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:51:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f386406caa0 msgr2=0x7f386406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f386406caa0 0x7f386406ef60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f38680047c0 tx=0x7f386800b040).stop 2024-02-22T00:51:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fe250 msgr2=0x7f387410e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fe250 0x7f387410e5f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f386000b480 tx=0x7f38600090f0).stop 2024-02-22T00:51:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 shutdown_connections 2024-02-22T00:51:34.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f386406caa0 0x7f386406ef60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38740fd8f0 0x7f387410e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 --2- 172.21.15.49:0/838472425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38740fe250 0x7f387410e5f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 >> 172.21.15.49:0/838472425 conn(0x7f38740f34b0 msgr2=0x7f38740fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 shutdown_connections 2024-02-22T00:51:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.692+0000 7f387af46700 1 -- 172.21.15.49:0/838472425 wait complete. 2024-02-22T00:51:34.697 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:51:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.795+0000 7fe3c4a58700 1 -- 172.21.15.49:0/175759154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 msgr2=0x7fe3c00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.795+0000 7fe3c4a58700 1 --2- 172.21.15.49:0/175759154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 0x7fe3c00f6930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fe3b40047f0 tx=0x7fe3b4009cb0).stop 2024-02-22T00:51:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.795+0000 7fe3c4a58700 1 -- 172.21.15.49:0/175759154 shutdown_connections 2024-02-22T00:51:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.795+0000 7fe3c4a58700 1 --2- 172.21.15.49:0/175759154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 0x7fe3c00f6930 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.795+0000 7fe3c4a58700 1 --2- 172.21.15.49:0/175759154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c00fc7f0 0x7fe3c00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.795+0000 7fe3c4a58700 1 -- 172.21.15.49:0/175759154 >> 172.21.15.49:0/175759154 conn(0x7fe3c0070590 msgr2=0x7fe3c00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.796+0000 7fe3c4a58700 1 -- 172.21.15.49:0/175759154 shutdown_connections 2024-02-22T00:51:34.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.796+0000 7fe3c4a58700 1 -- 172.21.15.49:0/175759154 wait complete. 2024-02-22T00:51:34.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.796+0000 7fe3c4a58700 1 Processor -- start 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.796+0000 7fe3c4a58700 1 -- start start 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3c4a58700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c00fc7f0 0x7fe3c01090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3c4a58700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 0x7fe3c01095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3c4a58700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0109ac0 con 0x7fe3c00fd150 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3c4a58700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0109c00 con 0x7fe3c00fc7f0 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3bdd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 0x7fe3c01095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3bdd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 0x7fe3c01095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59166/0 (socket says 172.21.15.49:59166) 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3bdd9b700 1 -- 172.21.15.49:0/3550358558 learned_addr learned my addr 172.21.15.49:0/3550358558 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3be59c700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c00fc7f0 0x7fe3c01090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3bdd9b700 1 -- 172.21.15.49:0/3550358558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c00fc7f0 msgr2=0x7fe3c01090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3bdd9b700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c00fc7f0 0x7fe3c01090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3bdd9b700 1 -- 172.21.15.49:0/3550358558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4005040 con 0x7fe3c00fd150 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3bdd9b700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 0x7fe3c01095d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fe3b4000c00 tx=0x7fe3b4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3af7fe700 1 -- 172.21.15.49:0/3550358558 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b400e030 con 0x7fe3c00fd150 2024-02-22T00:51:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3af7fe700 1 -- 172.21.15.49:0/3550358558 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe3b4007e90 con 0x7fe3c00fd150 2024-02-22T00:51:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c0109e50 con 0x7fe3c00fd150 2024-02-22T00:51:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3af7fe700 1 -- 172.21.15.49:0/3550358558 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b4018070 con 0x7fe3c00fd150 2024-02-22T00:51:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.797+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c0112440 con 0x7fe3c00fd150 2024-02-22T00:51:34.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.798+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c005f590 con 0x7fe3c00fd150 2024-02-22T00:51:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.799+0000 7fe3af7fe700 1 -- 172.21.15.49:0/3550358558 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe3b401d420 con 0x7fe3c00fd150 2024-02-22T00:51:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.799+0000 7fe3af7fe700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe3a806cab0 0x7fe3a806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.799+0000 7fe3af7fe700 1 -- 172.21.15.49:0/3550358558 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe3b408cee0 con 0x7fe3c00fd150 2024-02-22T00:51:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.799+0000 7fe3be59c700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe3a806cab0 0x7fe3a806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:34.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.800+0000 7fe3be59c700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe3a806cab0 0x7fe3a806ef70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe3b0004de0 tx=0x7fe3b000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:34.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:34.804+0000 7fe3af7fe700 1 -- 172.21.15.49:0/3550358558 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe3b4057070 con 0x7fe3c00fd150 2024-02-22T00:51:35.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.023+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3c0059120 con 0x7fe3a806cab0 2024-02-22T00:51:35.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.024+0000 7fe3af7fe700 1 -- 172.21.15.49:0/3550358558 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe3c0059120 con 0x7fe3a806cab0 2024-02-22T00:51:35.026 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:51:35.026 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:51:35.026 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:51:35.026 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:51:35.027 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:51:35.028 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:51:35.028 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe3a806cab0 msgr2=0x7fe3a806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe3a806cab0 0x7fe3a806ef70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe3b0004de0 tx=0x7fe3b000b040).stop 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 msgr2=0x7fe3c01095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 0x7fe3c01095d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fe3b4000c00 tx=0x7fe3b4009cb0).stop 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 shutdown_connections 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe3a806cab0 0x7fe3a806ef70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c00fc7f0 0x7fe3c01090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 --2- 172.21.15.49:0/3550358558 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe3c00fd150 0x7fe3c01095d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 >> 172.21.15.49:0/3550358558 conn(0x7fe3c0070590 msgr2=0x7fe3c00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 shutdown_connections 2024-02-22T00:51:35.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.026+0000 7fe3c4a58700 1 -- 172.21.15.49:0/3550358558 wait complete. 2024-02-22T00:51:35.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.129+0000 7fbc61db2700 1 -- 172.21.15.49:0/496959057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fd8d0 msgr2=0x7fbc5c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:35.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.129+0000 7fbc61db2700 1 --2- 172.21.15.49:0/496959057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fd8d0 0x7fbc5c0fdcb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fbc4c0047f0 tx=0x7fbc4c009cb0).stop 2024-02-22T00:51:35.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.129+0000 7fbc61db2700 1 -- 172.21.15.49:0/496959057 shutdown_connections 2024-02-22T00:51:35.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.129+0000 7fbc61db2700 1 --2- 172.21.15.49:0/496959057 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc5c0fe230 0x7fbc5c0f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.129+0000 7fbc61db2700 1 --2- 172.21.15.49:0/496959057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fd8d0 0x7fbc5c0fdcb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.129+0000 7fbc61db2700 1 -- 172.21.15.49:0/496959057 >> 172.21.15.49:0/496959057 conn(0x7fbc5c06cea0 msgr2=0x7fbc5c06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:35.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.129+0000 7fbc61db2700 1 -- 172.21.15.49:0/496959057 shutdown_connections 2024-02-22T00:51:35.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.129+0000 7fbc61db2700 1 -- 172.21.15.49:0/496959057 wait complete. 2024-02-22T00:51:35.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc61db2700 1 Processor -- start 2024-02-22T00:51:35.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc61db2700 1 -- start start 2024-02-22T00:51:35.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc61db2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc5c0fd8d0 0x7fbc5c10e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:35.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc61db2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fe230 0x7fbc5c10e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc61db2700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c10eb40 con 0x7fbc5c0fe230 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc61db2700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c10ec80 con 0x7fbc5c0fd8d0 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc5affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fe230 0x7fbc5c10e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc5affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fe230 0x7fbc5c10e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59188/0 (socket says 172.21.15.49:59188) 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.130+0000 7fbc5affd700 1 -- 172.21.15.49:0/1043438737 learned_addr learned my addr 172.21.15.49:0/1043438737 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc5b7fe700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc5c0fd8d0 0x7fbc5c10e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc5affd700 1 -- 172.21.15.49:0/1043438737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc5c0fd8d0 msgr2=0x7fbc5c10e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc5affd700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc5c0fd8d0 0x7fbc5c10e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc5affd700 1 -- 172.21.15.49:0/1043438737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c005040 con 0x7fbc5c0fe230 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc5affd700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fe230 0x7fbc5c10e540 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fbc4400c740 tx=0x7fbc44007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc58ff9700 1 -- 172.21.15.49:0/1043438737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc4400e680 con 0x7fbc5c0fe230 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc58ff9700 1 -- 172.21.15.49:0/1043438737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc4400ec90 con 0x7fbc5c0fe230 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c108310 con 0x7fbc5c0fe230 2024-02-22T00:51:35.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc58ff9700 1 -- 172.21.15.49:0/1043438737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc44013d60 con 0x7fbc5c0fe230 2024-02-22T00:51:35.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.131+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c108850 con 0x7fbc5c0fe230 2024-02-22T00:51:35.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.132+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c047540 con 0x7fbc5c0fe230 2024-02-22T00:51:35.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.133+0000 7fbc58ff9700 1 -- 172.21.15.49:0/1043438737 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbc4400e7e0 con 0x7fbc5c0fe230 2024-02-22T00:51:35.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.133+0000 7fbc58ff9700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc4806cab0 0x7fbc4806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:51:35.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.133+0000 7fbc58ff9700 1 -- 172.21.15.49:0/1043438737 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbc4408c050 con 0x7fbc5c0fe230 2024-02-22T00:51:35.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.133+0000 7fbc5b7fe700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc4806cab0 0x7fbc4806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:51:35.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.133+0000 7fbc5b7fe700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc4806cab0 0x7fbc4806ef70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fbc4c004f10 tx=0x7fbc4c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:51:35.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.138+0000 7fbc58ff9700 1 -- 172.21.15.49:0/1043438737 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbc44059bb0 con 0x7fbc5c0fe230 2024-02-22T00:51:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.418+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbc5c1096d0 con 0x7fbc5c0fe230 2024-02-22T00:51:35.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.418+0000 7fbc58ff9700 1 -- 172.21.15.49:0/1043438737 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fbc44059740 con 0x7fbc5c0fe230 2024-02-22T00:51:35.421 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:51:35.421 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:51:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:51:35.421 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:51:35.421 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:51:35.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc4806cab0 msgr2=0x7fbc4806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc4806cab0 0x7fbc4806ef70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fbc4c004f10 tx=0x7fbc4c009cb0).stop 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fe230 msgr2=0x7fbc5c10e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fe230 0x7fbc5c10e540 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fbc4400c740 tx=0x7fbc44007ef0).stop 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 shutdown_connections 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbc4806cab0 0x7fbc4806ef70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc5c0fd8d0 0x7fbc5c10e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 --2- 172.21.15.49:0/1043438737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbc5c0fe230 0x7fbc5c10e540 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 >> 172.21.15.49:0/1043438737 conn(0x7fbc5c06cea0 msgr2=0x7fbc5c100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 shutdown_connections 2024-02-22T00:51:35.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:51:35.420+0000 7fbc61db2700 1 -- 172.21.15.49:0/1043438737 wait complete. 2024-02-22T00:51:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:35 smithi049 ceph-mon[132694]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:35 smithi049 ceph-mon[132694]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:35 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/997077479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:51:35.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:35 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/838472425' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:51:35.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:35 smithi161 ceph-mon[113442]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:35.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:35 smithi161 ceph-mon[113442]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:35.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:35 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/997077479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:51:35.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:35 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/838472425' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:51:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:36 smithi049 ceph-mon[132694]: pgmap v440: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:36 smithi049 ceph-mon[132694]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:36 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1043438737' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:51:36.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:36 smithi161 ceph-mon[113442]: pgmap v440: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:36.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:36 smithi161 ceph-mon[113442]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:51:36.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:36 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1043438737' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:51:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:38 smithi049 ceph-mon[132694]: pgmap v441: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:38.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:38 smithi161 ceph-mon[113442]: pgmap v441: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:40.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:40 smithi049 ceph-mon[132694]: pgmap v442: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:40.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:40 smithi161 ceph-mon[113442]: pgmap v442: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:42 smithi049 ceph-mon[132694]: pgmap v443: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:42.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:42 smithi161 ceph-mon[113442]: pgmap v443: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:51:43.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:51:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:44 smithi049 ceph-mon[132694]: pgmap v444: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:44.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:44 smithi161 ceph-mon[113442]: pgmap v444: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:46 smithi049 ceph-mon[132694]: pgmap v445: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:46.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:46 smithi161 ceph-mon[113442]: pgmap v445: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:48 smithi049 ceph-mon[132694]: pgmap v446: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:48.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:48 smithi161 ceph-mon[113442]: pgmap v446: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:50.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:50 smithi049 ceph-mon[132694]: pgmap v447: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:50.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:50 smithi161 ceph-mon[113442]: pgmap v447: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:52 smithi049 ceph-mon[132694]: pgmap v448: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:52 smithi161 ceph-mon[113442]: pgmap v448: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:54 smithi049 ceph-mon[132694]: pgmap v449: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:54.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:54 smithi161 ceph-mon[113442]: pgmap v449: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:56.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:56 smithi049 ceph-mon[132694]: pgmap v450: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:56.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:56 smithi161 ceph-mon[113442]: pgmap v450: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:58 smithi049 ceph-mon[132694]: pgmap v451: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:51:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:51:58.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:58 smithi161 ceph-mon[113442]: pgmap v451: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:51:58.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:51:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:52:00.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:00 smithi049 ceph-mon[132694]: pgmap v452: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:00.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:00 smithi161 ceph-mon[113442]: pgmap v452: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:01.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:01 smithi049 ceph-mon[132694]: pgmap v453: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:01.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:01 smithi161 ceph-mon[113442]: pgmap v453: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:03.928 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:03 smithi049 ceph-mon[132694]: pgmap v454: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:04.043 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:03 smithi161 ceph-mon[113442]: pgmap v454: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:05.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.537+0000 7f7898ed4700 1 -- 172.21.15.49:0/1132731104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 msgr2=0x7f78940f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.537+0000 7f7898ed4700 1 --2- 172.21.15.49:0/1132731104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 0x7f78940f6930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f787c0047f0 tx=0x7f787c009cb0).stop 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.537+0000 7f7898ed4700 1 -- 172.21.15.49:0/1132731104 shutdown_connections 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.537+0000 7f7898ed4700 1 --2- 172.21.15.49:0/1132731104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 0x7f78940f6930 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.537+0000 7f7898ed4700 1 --2- 172.21.15.49:0/1132731104 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fc7f0 0x7f78940fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.537+0000 7f7898ed4700 1 -- 172.21.15.49:0/1132731104 >> 172.21.15.49:0/1132731104 conn(0x7f7894070590 msgr2=0x7f78940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.538+0000 7f7898ed4700 1 -- 172.21.15.49:0/1132731104 shutdown_connections 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.538+0000 7f7898ed4700 1 -- 172.21.15.49:0/1132731104 wait complete. 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.538+0000 7f7898ed4700 1 Processor -- start 2024-02-22T00:52:05.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.538+0000 7f7898ed4700 1 -- start start 2024-02-22T00:52:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7898ed4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fc7f0 0x7f789410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7898ed4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 0x7f789410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7898ed4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789410ebe0 con 0x7f78940fd150 2024-02-22T00:52:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7898ed4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894108200 con 0x7f78940fc7f0 2024-02-22T00:52:05.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7891d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 0x7f789410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7891d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 0x7f789410e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:32978/0 (socket says 172.21.15.49:32978) 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7891d9b700 1 -- 172.21.15.49:0/3288741772 learned_addr learned my addr 172.21.15.49:0/3288741772 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f789259c700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fc7f0 0x7f789410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7891d9b700 1 -- 172.21.15.49:0/3288741772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fc7f0 msgr2=0x7f789410e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7891d9b700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fc7f0 0x7f789410e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7891d9b700 1 -- 172.21.15.49:0/3288741772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c005040 con 0x7f78940fd150 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f7891d9b700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 0x7f789410e550 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f787c0099f0 tx=0x7f787c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f788b7fe700 1 -- 172.21.15.49:0/3288741772 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787c00e030 con 0x7f78940fd150 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.539+0000 7f788b7fe700 1 -- 172.21.15.49:0/3288741772 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f787c007e90 con 0x7f78940fd150 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.540+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7894108450 con 0x7f78940fd150 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.540+0000 7f788b7fe700 1 -- 172.21.15.49:0/3288741772 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f787c018070 con 0x7f78940fd150 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.540+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7894108930 con 0x7f78940fd150 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.540+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789405f590 con 0x7f78940fd150 2024-02-22T00:52:05.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.541+0000 7f788b7fe700 1 -- 172.21.15.49:0/3288741772 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f787c01d420 con 0x7f78940fd150 2024-02-22T00:52:05.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.542+0000 7f788b7fe700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:05.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.542+0000 7f788b7fe700 1 -- 172.21.15.49:0/3288741772 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f787c08d190 con 0x7f78940fd150 2024-02-22T00:52:05.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.542+0000 7f789259c700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:05.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.542+0000 7f789259c700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7884006fd0 tx=0x7f7884009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:05.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.546+0000 7f788b7fe700 1 -- 172.21.15.49:0/3288741772 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f787c05acf0 con 0x7f78940fd150 2024-02-22T00:52:05.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.765+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78941097a0 con 0x7f788006caa0 2024-02-22T00:52:05.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.766+0000 7f788b7fe700 1 -- 172.21.15.49:0/3288741772 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f78941097a0 con 0x7f788006caa0 2024-02-22T00:52:05.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 msgr2=0x7f788006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:05.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7884006fd0 tx=0x7f7884009060).stop 2024-02-22T00:52:05.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 msgr2=0x7f789410e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:05.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 0x7f789410e550 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f787c0099f0 tx=0x7f787c009cb0).stop 2024-02-22T00:52:05.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 shutdown_connections 2024-02-22T00:52:05.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f788006caa0 0x7f788006ef60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:05.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78940fc7f0 0x7f789410e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:05.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 --2- 172.21.15.49:0/3288741772 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78940fd150 0x7f789410e550 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:05.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 >> 172.21.15.49:0/3288741772 conn(0x7f7894070590 msgr2=0x7f7894060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:05.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 shutdown_connections 2024-02-22T00:52:05.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.768+0000 7f7898ed4700 1 -- 172.21.15.49:0/3288741772 wait complete. 2024-02-22T00:52:05.779 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:52:05.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.871+0000 7fca52373700 1 -- 172.21.15.49:0/3145681790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fc7f0 msgr2=0x7fca4c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.871+0000 7fca52373700 1 --2- 172.21.15.49:0/3145681790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fc7f0 0x7fca4c0fcbd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fca3c0047f0 tx=0x7fca3c009cb0).stop 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.871+0000 7fca52373700 1 -- 172.21.15.49:0/3145681790 shutdown_connections 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.871+0000 7fca52373700 1 --2- 172.21.15.49:0/3145681790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca4c0fd150 0x7fca4c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.871+0000 7fca52373700 1 --2- 172.21.15.49:0/3145681790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fc7f0 0x7fca4c0fcbd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.871+0000 7fca52373700 1 -- 172.21.15.49:0/3145681790 >> 172.21.15.49:0/3145681790 conn(0x7fca4c070590 msgr2=0x7fca4c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.871+0000 7fca52373700 1 -- 172.21.15.49:0/3145681790 shutdown_connections 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.871+0000 7fca52373700 1 -- 172.21.15.49:0/3145681790 wait complete. 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca52373700 1 Processor -- start 2024-02-22T00:52:05.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca52373700 1 -- start start 2024-02-22T00:52:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca52373700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca4c0fc7f0 0x7fca4c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca52373700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fd150 0x7fca4c1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca52373700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c110cc0 con 0x7fca4c0fd150 2024-02-22T00:52:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca52373700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c110e00 con 0x7fca4c0fc7f0 2024-02-22T00:52:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca4b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fd150 0x7fca4c1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:05.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca4b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fd150 0x7fca4c1106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33002/0 (socket says 172.21.15.49:33002) 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca4b7fe700 1 -- 172.21.15.49:0/1884469178 learned_addr learned my addr 172.21.15.49:0/1884469178 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca4bfff700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca4c0fc7f0 0x7fca4c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca4b7fe700 1 -- 172.21.15.49:0/1884469178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca4c0fc7f0 msgr2=0x7fca4c1101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca4b7fe700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca4c0fc7f0 0x7fca4c1101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.872+0000 7fca4b7fe700 1 -- 172.21.15.49:0/1884469178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c005040 con 0x7fca4c0fd150 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.873+0000 7fca4b7fe700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fd150 0x7fca4c1106c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fca40002780 tx=0x7fca40009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.873+0000 7fca497fa700 1 -- 172.21.15.49:0/1884469178 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca40007b40 con 0x7fca4c0fd150 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.873+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c10a490 con 0x7fca4c0fd150 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.873+0000 7fca497fa700 1 -- 172.21.15.49:0/1884469178 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca4000f040 con 0x7fca4c0fd150 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.873+0000 7fca497fa700 1 -- 172.21.15.49:0/1884469178 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca40014780 con 0x7fca4c0fd150 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.873+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c10aa50 con 0x7fca4c0fd150 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.874+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c05f590 con 0x7fca4c0fd150 2024-02-22T00:52:05.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.874+0000 7fca497fa700 1 -- 172.21.15.49:0/1884469178 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fca40007ca0 con 0x7fca4c0fd150 2024-02-22T00:52:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.875+0000 7fca497fa700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca3406caa0 0x7fca3406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.875+0000 7fca497fa700 1 -- 172.21.15.49:0/1884469178 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fca4008bdf0 con 0x7fca4c0fd150 2024-02-22T00:52:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.875+0000 7fca4bfff700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca3406caa0 0x7fca3406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:05.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.875+0000 7fca4bfff700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca3406caa0 0x7fca3406ef60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fca3c004f10 tx=0x7fca3c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:05.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:05.879+0000 7fca497fa700 1 -- 172.21.15.49:0/1884469178 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fca40059890 con 0x7fca4c0fd150 2024-02-22T00:52:06.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.099+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fca4c10b0f0 con 0x7fca3406caa0 2024-02-22T00:52:06.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.100+0000 7fca497fa700 1 -- 172.21.15.49:0/1884469178 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fca4c10b0f0 con 0x7fca3406caa0 2024-02-22T00:52:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca3406caa0 msgr2=0x7fca3406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca3406caa0 0x7fca3406ef60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fca3c004f10 tx=0x7fca3c00b040).stop 2024-02-22T00:52:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fd150 msgr2=0x7fca4c1106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fd150 0x7fca4c1106c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fca40002780 tx=0x7fca40009ee0).stop 2024-02-22T00:52:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 shutdown_connections 2024-02-22T00:52:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fca3406caa0 0x7fca3406ef60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca4c0fc7f0 0x7fca4c1101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 --2- 172.21.15.49:0/1884469178 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca4c0fd150 0x7fca4c1106c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 >> 172.21.15.49:0/1884469178 conn(0x7fca4c070590 msgr2=0x7fca4c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 shutdown_connections 2024-02-22T00:52:06.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.102+0000 7fca52373700 1 -- 172.21.15.49:0/1884469178 wait complete. 2024-02-22T00:52:06.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.204+0000 7f9e58f39700 1 -- 172.21.15.49:0/3408744813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 msgr2=0x7f9e540fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.204+0000 7f9e58f39700 1 --2- 172.21.15.49:0/3408744813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 0x7f9e540fdcd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f9e440047f0 tx=0x7f9e44009cb0).stop 2024-02-22T00:52:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.204+0000 7f9e58f39700 1 -- 172.21.15.49:0/3408744813 shutdown_connections 2024-02-22T00:52:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.204+0000 7f9e58f39700 1 --2- 172.21.15.49:0/3408744813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e540fe250 0x7f9e540f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:52:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.204+0000 7f9e58f39700 1 --2- 172.21.15.49:0/3408744813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 0x7f9e540fdcd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.204+0000 7f9e58f39700 1 -- 172.21.15.49:0/3408744813 >> 172.21.15.49:0/3408744813 conn(0x7f9e540f34b0 msgr2=0x7f9e540f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.204+0000 7f9e58f39700 1 -- 172.21.15.49:0/3408744813 shutdown_connections 2024-02-22T00:52:06.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.204+0000 7f9e58f39700 1 -- 172.21.15.49:0/3408744813 wait complete. 2024-02-22T00:52:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.205+0000 7f9e58f39700 1 Processor -- start 2024-02-22T00:52:06.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.205+0000 7f9e58f39700 1 -- start start 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.205+0000 7f9e58f39700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 0x7f9e5410e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.205+0000 7f9e58f39700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e540fe250 0x7f9e5410e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.205+0000 7f9e58f39700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5410ec80 con 0x7f9e540fd8f0 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.205+0000 7f9e58f39700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e541082a0 con 0x7f9e540fe250 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.205+0000 7f9e5259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 0x7f9e5410e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e5259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 0x7f9e5410e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33020/0 (socket says 172.21.15.49:33020) 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e5259c700 1 -- 172.21.15.49:0/898240948 learned_addr learned my addr 172.21.15.49:0/898240948 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e51d9b700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e540fe250 0x7f9e5410e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e5259c700 1 -- 172.21.15.49:0/898240948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e540fe250 msgr2=0x7f9e5410e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e5259c700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e540fe250 0x7f9e5410e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e5259c700 1 -- 172.21.15.49:0/898240948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44005040 con 0x7f9e540fd8f0 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e5259c700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 0x7f9e5410e100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f9e4400b120 tx=0x7f9e44009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:06.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e4b7fe700 1 -- 172.21.15.49:0/898240948 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4400e030 con 0x7f9e540fd8f0 2024-02-22T00:52:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e4b7fe700 1 -- 172.21.15.49:0/898240948 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e44007e90 con 0x7f9e540fd8f0 2024-02-22T00:52:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e541084f0 con 0x7f9e540fd8f0 2024-02-22T00:52:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e4b7fe700 1 -- 172.21.15.49:0/898240948 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e44018070 con 0x7f9e540fd8f0 2024-02-22T00:52:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.206+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e541089d0 con 0x7f9e540fd8f0 2024-02-22T00:52:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.207+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5405f590 con 0x7f9e540fd8f0 2024-02-22T00:52:06.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.208+0000 7f9e4b7fe700 1 -- 172.21.15.49:0/898240948 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9e4401d420 con 0x7f9e540fd8f0 2024-02-22T00:52:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.208+0000 7f9e4b7fe700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e4006caa0 0x7f9e4006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.208+0000 7f9e4b7fe700 1 -- 172.21.15.49:0/898240948 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9e4408d1b0 con 0x7f9e540fd8f0 2024-02-22T00:52:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.208+0000 7f9e51d9b700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e4006caa0 0x7f9e4006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.208+0000 7f9e51d9b700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e4006caa0 0x7f9e4006ef60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f9e54109a40 tx=0x7f9e3c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:06.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.212+0000 7f9e4b7fe700 1 -- 172.21.15.49:0/898240948 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9e4405ad10 con 0x7f9e540fd8f0 2024-02-22T00:52:06.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.419+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e541097f0 con 0x7f9e4006caa0 2024-02-22T00:52:06.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:06 smithi049 ceph-mon[132694]: pgmap v455: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:06.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.429+0000 7f9e4b7fe700 1 -- 172.21.15.49:0/898240948 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f9e541097f0 con 0x7f9e4006caa0 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (15m) 9m ago 26m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (13m) 9m ago 26m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (12m) 8m ago 25m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (15m) 9m ago 26m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (9m) 9m ago 21m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (9m) 9m ago 21m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (8m) 8m ago 21m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (9m) 8m ago 21m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (16m) 9m ago 27m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:52:06.431 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (16m) 8m ago 25m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (14m) 9m ago 27m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (13m) 8m ago 25m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (15m) 9m ago 26m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (15m) 8m ago 25m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (12m) 9m ago 25m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (12m) 9m ago 24m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (11m) 9m ago 24m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (10m) 8m ago 23m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (10m) 8m ago 23m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (9m) 8m ago 22m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:52:06.432 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (15m) 8m ago 25m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:52:06.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.431+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e4006caa0 msgr2=0x7f9e4006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.431+0000 7f9e58f39700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e4006caa0 0x7f9e4006ef60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f9e54109a40 tx=0x7f9e3c008040).stop 2024-02-22T00:52:06.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.431+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 msgr2=0x7f9e5410e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.431+0000 7f9e58f39700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 0x7f9e5410e100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f9e4400b120 tx=0x7f9e44009cb0).stop 2024-02-22T00:52:06.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.432+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 shutdown_connections 2024-02-22T00:52:06.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.432+0000 7f9e58f39700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e4006caa0 0x7f9e4006ef60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.432+0000 7f9e58f39700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e540fd8f0 0x7f9e5410e100 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.432+0000 7f9e58f39700 1 --2- 172.21.15.49:0/898240948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e540fe250 0x7f9e5410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.432+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 >> 172.21.15.49:0/898240948 conn(0x7f9e540f34b0 msgr2=0x7f9e540fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:06.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.432+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 shutdown_connections 2024-02-22T00:52:06.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.432+0000 7f9e58f39700 1 -- 172.21.15.49:0/898240948 wait complete. 2024-02-22T00:52:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.532+0000 7f6ad26ec700 1 -- 172.21.15.49:0/4175804622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fc7f0 msgr2=0x7f6acc0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.532+0000 7f6ad26ec700 1 --2- 172.21.15.49:0/4175804622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fc7f0 0x7f6acc0fcbd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f6abc0047f0 tx=0x7f6abc009cb0).stop 2024-02-22T00:52:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.532+0000 7f6ad26ec700 1 -- 172.21.15.49:0/4175804622 shutdown_connections 2024-02-22T00:52:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.532+0000 7f6ad26ec700 1 --2- 172.21.15.49:0/4175804622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6acc0fd150 0x7f6acc0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.532+0000 7f6ad26ec700 1 --2- 172.21.15.49:0/4175804622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fc7f0 0x7f6acc0fcbd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.532+0000 7f6ad26ec700 1 -- 172.21.15.49:0/4175804622 >> 172.21.15.49:0/4175804622 conn(0x7f6acc070590 msgr2=0x7f6acc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.532+0000 7f6ad26ec700 1 -- 172.21.15.49:0/4175804622 shutdown_connections 2024-02-22T00:52:06.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.533+0000 7f6ad26ec700 1 -- 172.21.15.49:0/4175804622 wait complete. 2024-02-22T00:52:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.533+0000 7f6ad26ec700 1 Processor -- start 2024-02-22T00:52:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.533+0000 7f6ad26ec700 1 -- start start 2024-02-22T00:52:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.533+0000 7f6ad26ec700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6acc0fc7f0 0x7f6acc1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6ad26ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fd150 0x7f6acc1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6ad26ec700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc110cc0 con 0x7f6acc0fd150 2024-02-22T00:52:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6ad26ec700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc110e00 con 0x7f6acc0fc7f0 2024-02-22T00:52:06.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6acb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fd150 0x7f6acc1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6acb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fd150 0x7f6acc1106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33034/0 (socket says 172.21.15.49:33034) 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6acb7fe700 1 -- 172.21.15.49:0/3308373977 learned_addr learned my addr 172.21.15.49:0/3308373977 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6acbfff700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6acc0fc7f0 0x7f6acc1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6acb7fe700 1 -- 172.21.15.49:0/3308373977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6acc0fc7f0 msgr2=0x7f6acc1101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6acb7fe700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6acc0fc7f0 0x7f6acc1101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6acb7fe700 1 -- 172.21.15.49:0/3308373977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc005040 con 0x7f6acc0fd150 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6acb7fe700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fd150 0x7f6acc1106c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f6ac0002780 tx=0x7f6ac0009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6ac97fa700 1 -- 172.21.15.49:0/3308373977 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ac0007b40 con 0x7f6acc0fd150 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6ac97fa700 1 -- 172.21.15.49:0/3308373977 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ac000f040 con 0x7f6acc0fd150 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc10a490 con 0x7f6acc0fd150 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6ac97fa700 1 -- 172.21.15.49:0/3308373977 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ac0014780 con 0x7f6acc0fd150 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.534+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc10aa50 con 0x7f6acc0fd150 2024-02-22T00:52:06.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.535+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc05f590 con 0x7f6acc0fd150 2024-02-22T00:52:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.536+0000 7f6ac97fa700 1 -- 172.21.15.49:0/3308373977 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6ac0007ca0 con 0x7f6acc0fd150 2024-02-22T00:52:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.536+0000 7f6ac97fa700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6ab406caa0 0x7f6ab406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.536+0000 7f6ac97fa700 1 -- 172.21.15.49:0/3308373977 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6ac008bca0 con 0x7f6acc0fd150 2024-02-22T00:52:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.536+0000 7f6acbfff700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6ab406caa0 0x7f6ab406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.536+0000 7f6acbfff700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6ab406caa0 0x7f6ab406ef60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f6abc004f10 tx=0x7f6abc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:06.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.540+0000 7f6ac97fa700 1 -- 172.21.15.49:0/3308373977 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6ac0090070 con 0x7f6acc0fd150 2024-02-22T00:52:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:06 smithi161 ceph-mon[113442]: pgmap v455: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:06.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.821+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6acc047540 con 0x7f6acc0fd150 2024-02-22T00:52:06.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.822+0000 7f6ac97fa700 1 -- 172.21.15.49:0/3308373977 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f6ac0059800 con 0x7f6acc0fd150 2024-02-22T00:52:06.824 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:52:06.824 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:52:06.824 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:52:06.825 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6ab406caa0 msgr2=0x7f6ab406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6ab406caa0 0x7f6ab406ef60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f6abc004f10 tx=0x7f6abc00b040).stop 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fd150 msgr2=0x7f6acc1106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fd150 0x7f6acc1106c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f6ac0002780 tx=0x7f6ac0009ee0).stop 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 shutdown_connections 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f6ab406caa0 0x7f6ab406ef60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6acc0fc7f0 0x7f6acc1101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 --2- 172.21.15.49:0/3308373977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6acc0fd150 0x7f6acc1106c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 >> 172.21.15.49:0/3308373977 conn(0x7f6acc070590 msgr2=0x7f6acc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:06.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 shutdown_connections 2024-02-22T00:52:06.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.824+0000 7f6ad26ec700 1 -- 172.21.15.49:0/3308373977 wait complete. 2024-02-22T00:52:06.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/1776329996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 msgr2=0x7fb5f40f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 --2- 172.21.15.49:0/1776329996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 0x7fb5f40f5fa0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fb5f00047f0 tx=0x7fb5f0009cb0).stop 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/1776329996 shutdown_connections 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 --2- 172.21.15.49:0/1776329996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 0x7fb5f40f5fa0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 --2- 172.21.15.49:0/1776329996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40fda50 0x7fb5f40fde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/1776329996 >> 172.21.15.49:0/1776329996 conn(0x7fb5f406ce50 msgr2=0x7fb5f406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/1776329996 shutdown_connections 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/1776329996 wait complete. 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 Processor -- start 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.926+0000 7fb5fc2a1700 1 -- start start 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5fc2a1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40fda50 0x7fb5f41102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5fc2a1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 0x7fb5f41107e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5fc2a1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4110e70 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5fc2a1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f410a490 con 0x7fb5f40fda50 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5f983c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 0x7fb5f41107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5f983c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 0x7fb5f41107e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33048/0 (socket says 172.21.15.49:33048) 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5f983c700 1 -- 172.21.15.49:0/3046528011 learned_addr learned my addr 172.21.15.49:0/3046528011 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5fa03d700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40fda50 0x7fb5f41102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5f983c700 1 -- 172.21.15.49:0/3046528011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40fda50 msgr2=0x7fb5f41102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5f983c700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40fda50 0x7fb5f41102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5f983c700 1 -- 172.21.15.49:0/3046528011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f0005040 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5f983c700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 0x7fb5f41107e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fb5f0013640 tx=0x7fb5f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5eb779700 1 -- 172.21.15.49:0/3046528011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f000e030 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5eb779700 1 -- 172.21.15.49:0/3046528011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb5f0007e90 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f410a6e0 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5eb779700 1 -- 172.21.15.49:0/3046528011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f0018070 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.927+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f410abc0 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.928+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f4047540 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.929+0000 7fb5eb779700 1 -- 172.21.15.49:0/3046528011 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb5f001d420 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.929+0000 7fb5eb779700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb5e006cab0 0x7fb5e006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:06.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.929+0000 7fb5eb779700 1 -- 172.21.15.49:0/3046528011 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb5f008d140 con 0x7fb5f40fe3b0 2024-02-22T00:52:06.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.929+0000 7fb5fa03d700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb5e006cab0 0x7fb5e006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:06.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.930+0000 7fb5fa03d700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb5e006cab0 0x7fb5e006ef70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb5e400b910 tx=0x7fb5e4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:06.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:06.934+0000 7fb5eb779700 1 -- 172.21.15.49:0/3046528011 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb5f005aca0 con 0x7fb5f40fe3b0 2024-02-22T00:52:07.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.179+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb5f4101e20 con 0x7fb5f40fe3b0 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.179+0000 7fb5eb779700 1 -- 172.21.15.49:0/3046528011 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fb5f001de60 con 0x7fb5f40fe3b0 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:52:07.182 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:52:07.183 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:52:07.184 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:52:07.185 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:52:07.185 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:52:07.185 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:52:07.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.181+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb5e006cab0 msgr2=0x7fb5e006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.181+0000 7fb5fc2a1700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb5e006cab0 0x7fb5e006ef70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb5e400b910 tx=0x7fb5e4008040).stop 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.181+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 msgr2=0x7fb5f41107e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.181+0000 7fb5fc2a1700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 0x7fb5f41107e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fb5f0013640 tx=0x7fb5f0009cb0).stop 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.182+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 shutdown_connections 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.182+0000 7fb5fc2a1700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb5e006cab0 0x7fb5e006ef70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.182+0000 7fb5fc2a1700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5f40fda50 0x7fb5f41102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.182+0000 7fb5fc2a1700 1 --2- 172.21.15.49:0/3046528011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5f40fe3b0 0x7fb5f41107e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.182+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 >> 172.21.15.49:0/3046528011 conn(0x7fb5f406ce50 msgr2=0x7fb5f40f78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.182+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 shutdown_connections 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.182+0000 7fb5fc2a1700 1 -- 172.21.15.49:0/3046528011 wait complete. 2024-02-22T00:52:07.186 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:52:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.284+0000 7f082be11700 1 -- 172.21.15.49:0/3218504929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 msgr2=0x7f08240fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.284+0000 7f082be11700 1 --2- 172.21.15.49:0/3218504929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 0x7f08240fcbd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f08140047f0 tx=0x7f0814009cb0).stop 2024-02-22T00:52:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.284+0000 7f082be11700 1 -- 172.21.15.49:0/3218504929 shutdown_connections 2024-02-22T00:52:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.284+0000 7f082be11700 1 --2- 172.21.15.49:0/3218504929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08240fd150 0x7f08240f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:52:07.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.284+0000 7f082be11700 1 --2- 172.21.15.49:0/3218504929 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 0x7f08240fcbd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.284+0000 7f082be11700 1 -- 172.21.15.49:0/3218504929 >> 172.21.15.49:0/3218504929 conn(0x7f08240f23b0 msgr2=0x7f08240f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.284+0000 7f082be11700 1 -- 172.21.15.49:0/3218504929 shutdown_connections 2024-02-22T00:52:07.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.284+0000 7f082be11700 1 -- 172.21.15.49:0/3218504929 wait complete. 2024-02-22T00:52:07.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f082be11700 1 Processor -- start 2024-02-22T00:52:07.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f082be11700 1 -- start start 2024-02-22T00:52:07.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f082be11700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 0x7f0824109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:07.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f082be11700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08240fd150 0x7f0824109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:07.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f082be11700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824109be0 con 0x7f08240fc7f0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f082be11700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824109d20 con 0x7f08240fd150 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f0829bad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 0x7f0824109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f0829bad700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 0x7f0824109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33062/0 (socket says 172.21.15.49:33062) 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f0829bad700 1 -- 172.21.15.49:0/3428525451 learned_addr learned my addr 172.21.15.49:0/3428525451 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f08293ac700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08240fd150 0x7f0824109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f0829bad700 1 -- 172.21.15.49:0/3428525451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08240fd150 msgr2=0x7f0824109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f0829bad700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08240fd150 0x7f0824109660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.285+0000 7f0829bad700 1 -- 172.21.15.49:0/3428525451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0814005040 con 0x7f08240fc7f0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.286+0000 7f0829bad700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 0x7f0824109170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f081400b120 tx=0x7f0814009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.286+0000 7f081affd700 1 -- 172.21.15.49:0/3428525451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f081400e030 con 0x7f08240fc7f0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.286+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0824109f70 con 0x7f08240fc7f0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.286+0000 7f081affd700 1 -- 172.21.15.49:0/3428525451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0814007e90 con 0x7f08240fc7f0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.286+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08241124b0 con 0x7f08240fc7f0 2024-02-22T00:52:07.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.286+0000 7f081affd700 1 -- 172.21.15.49:0/3428525451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0814018070 con 0x7f08240fc7f0 2024-02-22T00:52:07.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.287+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0824060390 con 0x7f08240fc7f0 2024-02-22T00:52:07.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.287+0000 7f081affd700 1 -- 172.21.15.49:0/3428525451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f081401d420 con 0x7f08240fc7f0 2024-02-22T00:52:07.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.288+0000 7f081affd700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f081006caa0 0x7f081006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:07.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.288+0000 7f081affd700 1 -- 172.21.15.49:0/3428525451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f081408d360 con 0x7f08240fc7f0 2024-02-22T00:52:07.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.288+0000 7f08293ac700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f081006caa0 0x7f081006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:07.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.288+0000 7f08293ac700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f081006caa0 0x7f081006ef60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f08240614f0 tx=0x7f0820008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:07.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.292+0000 7f081affd700 1 -- 172.21.15.49:0/3428525451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0814057370 con 0x7f08240fc7f0 2024-02-22T00:52:07.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:07 smithi049 ceph-mon[132694]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:07.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:07 smithi049 ceph-mon[132694]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:07.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:07 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3308373977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:52:07.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.510+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f08240612a0 con 0x7f081006caa0 2024-02-22T00:52:07.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.511+0000 7f081affd700 1 -- 172.21.15.49:0/3428525451 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f08240612a0 con 0x7f081006caa0 2024-02-22T00:52:07.513 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:52:07.513 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:52:07.513 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:52:07.513 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:52:07.514 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:52:07.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f081006caa0 msgr2=0x7f081006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f081006caa0 0x7f081006ef60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f08240614f0 tx=0x7f0820008040).stop 2024-02-22T00:52:07.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 msgr2=0x7f0824109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 0x7f0824109170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f081400b120 tx=0x7f0814009cb0).stop 2024-02-22T00:52:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 shutdown_connections 2024-02-22T00:52:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f081006caa0 0x7f081006ef60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f08240fc7f0 0x7f0824109170 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 --2- 172.21.15.49:0/3428525451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08240fd150 0x7f0824109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 >> 172.21.15.49:0/3428525451 conn(0x7f08240f23b0 msgr2=0x7f08240fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 shutdown_connections 2024-02-22T00:52:07.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.513+0000 7f082be11700 1 -- 172.21.15.49:0/3428525451 wait complete. 2024-02-22T00:52:07.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:07 smithi161 ceph-mon[113442]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:07.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:07 smithi161 ceph-mon[113442]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:07.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:07 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3308373977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.615+0000 7f89b85d3700 1 -- 172.21.15.49:0/2353698683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 msgr2=0x7f89b00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.615+0000 7f89b85d3700 1 --2- 172.21.15.49:0/2353698683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 0x7f89b00f6930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f89a40047f0 tx=0x7f89a4009cb0).stop 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.615+0000 7f89b85d3700 1 -- 172.21.15.49:0/2353698683 shutdown_connections 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.615+0000 7f89b85d3700 1 --2- 172.21.15.49:0/2353698683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 0x7f89b00f6930 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.615+0000 7f89b85d3700 1 --2- 172.21.15.49:0/2353698683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89b00fc7f0 0x7f89b00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.615+0000 7f89b85d3700 1 -- 172.21.15.49:0/2353698683 >> 172.21.15.49:0/2353698683 conn(0x7f89b0070590 msgr2=0x7f89b00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.615+0000 7f89b85d3700 1 -- 172.21.15.49:0/2353698683 shutdown_connections 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.615+0000 7f89b85d3700 1 -- 172.21.15.49:0/2353698683 wait complete. 2024-02-22T00:52:07.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b85d3700 1 Processor -- start 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b85d3700 1 -- start start 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b85d3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89b00fc7f0 0x7f89b01101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b85d3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 0x7f89b01106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b85d3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0110cd0 con 0x7f89b00fd150 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b85d3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0110e10 con 0x7f89b00fc7f0 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b5b6e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 0x7f89b01106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b5b6e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 0x7f89b01106d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33086/0 (socket says 172.21.15.49:33086) 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b5b6e700 1 -- 172.21.15.49:0/2592076620 learned_addr learned my addr 172.21.15.49:0/2592076620 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b636f700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89b00fc7f0 0x7f89b01101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b5b6e700 1 -- 172.21.15.49:0/2592076620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89b00fc7f0 msgr2=0x7f89b01101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b5b6e700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89b00fc7f0 0x7f89b01101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.616+0000 7f89b5b6e700 1 -- 172.21.15.49:0/2592076620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4005040 con 0x7f89b00fd150 2024-02-22T00:52:07.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.617+0000 7f89b5b6e700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 0x7f89b01106d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f89a40099f0 tx=0x7f89a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:07.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.617+0000 7f89a37fe700 1 -- 172.21.15.49:0/2592076620 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a400e030 con 0x7f89b00fd150 2024-02-22T00:52:07.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.617+0000 7f89a37fe700 1 -- 172.21.15.49:0/2592076620 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89a4007e90 con 0x7f89b00fd150 2024-02-22T00:52:07.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.617+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b010a440 con 0x7f89b00fd150 2024-02-22T00:52:07.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.617+0000 7f89a37fe700 1 -- 172.21.15.49:0/2592076620 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a4018070 con 0x7f89b00fd150 2024-02-22T00:52:07.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.617+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b010a9a0 con 0x7f89b00fd150 2024-02-22T00:52:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.618+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b005f590 con 0x7f89b00fd150 2024-02-22T00:52:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.618+0000 7f89a37fe700 1 -- 172.21.15.49:0/2592076620 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f89a401d420 con 0x7f89b00fd150 2024-02-22T00:52:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.619+0000 7f89a37fe700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f899c06caa0 0x7f899c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.619+0000 7f89a37fe700 1 -- 172.21.15.49:0/2592076620 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f89a408d240 con 0x7f89b00fd150 2024-02-22T00:52:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.619+0000 7f89b636f700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f899c06caa0 0x7f899c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:07.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.619+0000 7f89b636f700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f899c06caa0 0x7f899c06ef60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f89ac0041d0 tx=0x7f89ac009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:07.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.623+0000 7f89a37fe700 1 -- 172.21.15.49:0/2592076620 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f89a405ada0 con 0x7f89b00fd150 2024-02-22T00:52:07.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.904+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f89b0047540 con 0x7f89b00fd150 2024-02-22T00:52:07.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.904+0000 7f89a37fe700 1 -- 172.21.15.49:0/2592076620 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f89a405a930 con 0x7f89b00fd150 2024-02-22T00:52:07.907 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:52:07.907 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:52:07.907 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:52:07.907 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:52:07.907 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f899c06caa0 msgr2=0x7f899c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f899c06caa0 0x7f899c06ef60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f89ac0041d0 tx=0x7f89ac009040).stop 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 msgr2=0x7f89b01106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 0x7f89b01106d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f89a40099f0 tx=0x7f89a4009cb0).stop 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 shutdown_connections 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f899c06caa0 0x7f899c06ef60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89b00fc7f0 0x7f89b01101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 --2- 172.21.15.49:0/2592076620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89b00fd150 0x7f89b01106d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.906+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 >> 172.21.15.49:0/2592076620 conn(0x7f89b0070590 msgr2=0x7f89b0060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.907+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 shutdown_connections 2024-02-22T00:52:07.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:07.907+0000 7f89b85d3700 1 -- 172.21.15.49:0/2592076620 wait complete. 2024-02-22T00:52:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:08 smithi049 ceph-mon[132694]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:08 smithi049 ceph-mon[132694]: pgmap v456: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:08 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3046528011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:52:08.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:08 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2592076620' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:52:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:08 smithi161 ceph-mon[113442]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:08 smithi161 ceph-mon[113442]: pgmap v456: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:08 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3046528011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:52:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:08 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2592076620' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:52:09.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:09 smithi049 ceph-mon[132694]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:09.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:09 smithi161 ceph-mon[113442]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:10.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:10 smithi049 ceph-mon[132694]: pgmap v457: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:10 smithi161 ceph-mon[113442]: pgmap v457: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:12.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:12 smithi049 ceph-mon[132694]: pgmap v458: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:12 smithi161 ceph-mon[113442]: pgmap v458: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:13.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:52:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:52:14.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:14 smithi049 ceph-mon[132694]: pgmap v459: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:14 smithi161 ceph-mon[113442]: pgmap v459: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:16.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:16 smithi049 ceph-mon[132694]: pgmap v460: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:16 smithi161 ceph-mon[113442]: pgmap v460: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:18.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:18 smithi049 ceph-mon[132694]: pgmap v461: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:18 smithi161 ceph-mon[113442]: pgmap v461: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:20.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:20 smithi049 ceph-mon[132694]: pgmap v462: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:20 smithi161 ceph-mon[113442]: pgmap v462: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:22.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:22 smithi049 ceph-mon[132694]: pgmap v463: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:22 smithi161 ceph-mon[113442]: pgmap v463: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:24.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:24 smithi049 ceph-mon[132694]: pgmap v464: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:24 smithi161 ceph-mon[113442]: pgmap v464: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:26.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:26 smithi049 ceph-mon[132694]: pgmap v465: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:26 smithi161 ceph-mon[113442]: pgmap v465: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:28 smithi049 ceph-mon[132694]: pgmap v466: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:28.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:52:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:28 smithi161 ceph-mon[113442]: pgmap v466: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:52:30.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:30 smithi049 ceph-mon[132694]: pgmap v467: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:30 smithi161 ceph-mon[113442]: pgmap v467: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:32 smithi049 ceph-mon[132694]: pgmap v468: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:32 smithi161 ceph-mon[113442]: pgmap v468: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:34 smithi049 ceph-mon[132694]: pgmap v469: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:34 smithi161 ceph-mon[113442]: pgmap v469: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:36.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:36 smithi049 ceph-mon[132694]: pgmap v470: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:36.545 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:36 smithi161 ceph-mon[113442]: pgmap v470: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:38.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.023+0000 7f68f1f03700 1 -- 172.21.15.49:0/1232903222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fd8f0 msgr2=0x7f68ec0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.023+0000 7f68f1f03700 1 --2- 172.21.15.49:0/1232903222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fd8f0 0x7f68ec0fdcd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f68e00047f0 tx=0x7f68e0009cb0).stop 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.023+0000 7f68f1f03700 1 -- 172.21.15.49:0/1232903222 shutdown_connections 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.023+0000 7f68f1f03700 1 --2- 172.21.15.49:0/1232903222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68ec0fe250 0x7f68ec0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.023+0000 7f68f1f03700 1 --2- 172.21.15.49:0/1232903222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fd8f0 0x7f68ec0fdcd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.023+0000 7f68f1f03700 1 -- 172.21.15.49:0/1232903222 >> 172.21.15.49:0/1232903222 conn(0x7f68ec0f34b0 msgr2=0x7f68ec0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.023+0000 7f68f1f03700 1 -- 172.21.15.49:0/1232903222 shutdown_connections 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.023+0000 7f68f1f03700 1 -- 172.21.15.49:0/1232903222 wait complete. 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68f1f03700 1 Processor -- start 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68f1f03700 1 -- start start 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68f1f03700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68ec0fd8f0 0x7f68ec10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68f1f03700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fe250 0x7f68ec10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68f1f03700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec10ead0 con 0x7f68ec0fe250 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68f1f03700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec10ec10 con 0x7f68ec0fd8f0 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68eaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fe250 0x7f68ec10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68eaffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fe250 0x7f68ec10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38200/0 (socket says 172.21.15.49:38200) 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.024+0000 7f68eaffd700 1 -- 172.21.15.49:0/3829809313 learned_addr learned my addr 172.21.15.49:0/3829809313 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68eaffd700 1 -- 172.21.15.49:0/3829809313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68ec0fd8f0 msgr2=0x7f68ec10dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68eb7fe700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68ec0fd8f0 0x7f68ec10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68eaffd700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68ec0fd8f0 0x7f68ec10dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68eaffd700 1 -- 172.21.15.49:0/3829809313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0005040 con 0x7f68ec0fe250 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68eb7fe700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68ec0fd8f0 0x7f68ec10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68eaffd700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fe250 0x7f68ec10e4d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f68dc00c710 tx=0x7f68dc007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68e8ff9700 1 -- 172.21.15.49:0/3829809313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68dc00e680 con 0x7f68ec0fe250 2024-02-22T00:52:38.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68e8ff9700 1 -- 172.21.15.49:0/3829809313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f68dc00ec90 con 0x7f68ec0fe250 2024-02-22T00:52:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec1082a0 con 0x7f68ec0fe250 2024-02-22T00:52:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68e8ff9700 1 -- 172.21.15.49:0/3829809313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68dc013cd0 con 0x7f68ec0fe250 2024-02-22T00:52:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.025+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec108860 con 0x7f68ec0fe250 2024-02-22T00:52:38.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.026+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec05f590 con 0x7f68ec0fe250 2024-02-22T00:52:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.027+0000 7f68e8ff9700 1 -- 172.21.15.49:0/3829809313 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f68dc013410 con 0x7f68ec0fe250 2024-02-22T00:52:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.027+0000 7f68e8ff9700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68d406caa0 0x7f68d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.027+0000 7f68e8ff9700 1 -- 172.21.15.49:0/3829809313 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f68dc08c6f0 con 0x7f68ec0fe250 2024-02-22T00:52:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.027+0000 7f68eb7fe700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68d406caa0 0x7f68d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.028+0000 7f68eb7fe700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68d406caa0 0x7f68d406ef60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f68e00043d0 tx=0x7f68e000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:38.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.031+0000 7f68e8ff9700 1 -- 172.21.15.49:0/3829809313 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f68dc05a250 con 0x7f68ec0fe250 2024-02-22T00:52:38.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.250+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68ec108ae0 con 0x7f68d406caa0 2024-02-22T00:52:38.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.251+0000 7f68e8ff9700 1 -- 172.21.15.49:0/3829809313 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f68ec108ae0 con 0x7f68d406caa0 2024-02-22T00:52:38.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68d406caa0 msgr2=0x7f68d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68d406caa0 0x7f68d406ef60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f68e00043d0 tx=0x7f68e000b040).stop 2024-02-22T00:52:38.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fe250 msgr2=0x7f68ec10e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fe250 0x7f68ec10e4d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f68dc00c710 tx=0x7f68dc007ec0).stop 2024-02-22T00:52:38.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 shutdown_connections 2024-02-22T00:52:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f68d406caa0 0x7f68d406ef60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68ec0fd8f0 0x7f68ec10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 --2- 172.21.15.49:0/3829809313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f68ec0fe250 0x7f68ec10e4d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 >> 172.21.15.49:0/3829809313 conn(0x7f68ec0f34b0 msgr2=0x7f68ec0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 shutdown_connections 2024-02-22T00:52:38.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.254+0000 7f68f1f03700 1 -- 172.21.15.49:0/3829809313 wait complete. 2024-02-22T00:52:38.267 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:52:38.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.357+0000 7fa68eac4700 1 -- 172.21.15.49:0/1718059369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fe230 msgr2=0x7fa6880f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.357+0000 7fa68eac4700 1 --2- 172.21.15.49:0/1718059369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fe230 0x7fa6880f5fa0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fa6740047f0 tx=0x7fa674009cb0).stop 2024-02-22T00:52:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.357+0000 7fa68eac4700 1 -- 172.21.15.49:0/1718059369 shutdown_connections 2024-02-22T00:52:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.357+0000 7fa68eac4700 1 --2- 172.21.15.49:0/1718059369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fe230 0x7fa6880f5fa0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.357+0000 7fa68eac4700 1 --2- 172.21.15.49:0/1718059369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6880fd8d0 0x7fa6880fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:52:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.357+0000 7fa68eac4700 1 -- 172.21.15.49:0/1718059369 >> 172.21.15.49:0/1718059369 conn(0x7fa68806ce40 msgr2=0x7fa68806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.357+0000 7fa68eac4700 1 -- 172.21.15.49:0/1718059369 shutdown_connections 2024-02-22T00:52:38.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.357+0000 7fa68eac4700 1 -- 172.21.15.49:0/1718059369 wait complete. 2024-02-22T00:52:38.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68eac4700 1 Processor -- start 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68eac4700 1 -- start start 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68eac4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fd8d0 0x7fa68810e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68eac4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6880fe230 0x7fa68810e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68eac4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68810ebf0 con 0x7fa6880fd8d0 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68eac4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa688108210 con 0x7fa6880fe230 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68c860700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fd8d0 0x7fa68810e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68c860700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fd8d0 0x7fa68810e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38218/0 (socket says 172.21.15.49:38218) 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.358+0000 7fa68c860700 1 -- 172.21.15.49:0/1089605856 learned_addr learned my addr 172.21.15.49:0/1089605856 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa68c860700 1 -- 172.21.15.49:0/1089605856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6880fe230 msgr2=0x7fa68810e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa687fff700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6880fe230 0x7fa68810e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa68c860700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6880fe230 0x7fa68810e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa68c860700 1 -- 172.21.15.49:0/1089605856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674005040 con 0x7fa6880fd8d0 2024-02-22T00:52:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa68c860700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fd8d0 0x7fa68810e070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fa67c00b4b0 tx=0x7fa67c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa685f76700 1 -- 172.21.15.49:0/1089605856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c002500 con 0x7fa6880fd8d0 2024-02-22T00:52:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6881084c0 con 0x7fa6880fd8d0 2024-02-22T00:52:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa685f76700 1 -- 172.21.15.49:0/1089605856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa67c002b10 con 0x7fa6880fd8d0 2024-02-22T00:52:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa685f76700 1 -- 172.21.15.49:0/1089605856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67c012cf0 con 0x7fa6880fd8d0 2024-02-22T00:52:38.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.359+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa688108a00 con 0x7fa6880fd8d0 2024-02-22T00:52:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.360+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68805f090 con 0x7fa6880fd8d0 2024-02-22T00:52:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.361+0000 7fa685f76700 1 -- 172.21.15.49:0/1089605856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa67c002660 con 0x7fa6880fd8d0 2024-02-22T00:52:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.361+0000 7fa685f76700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa67806caa0 0x7fa67806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.361+0000 7fa685f76700 1 -- 172.21.15.49:0/1089605856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa67c08be80 con 0x7fa6880fd8d0 2024-02-22T00:52:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.361+0000 7fa687fff700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa67806caa0 0x7fa67806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.361+0000 7fa687fff700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa67806caa0 0x7fa67806ef60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fa6740043d0 tx=0x7fa67400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:38.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.365+0000 7fa685f76700 1 -- 172.21.15.49:0/1089605856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa67c0599e0 con 0x7fa6880fd8d0 2024-02-22T00:52:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:38 smithi049 ceph-mon[132694]: pgmap v471: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:38 smithi161 ceph-mon[113442]: pgmap v471: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:38.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.583+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6881096f0 con 0x7fa67806caa0 2024-02-22T00:52:38.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.584+0000 7fa685f76700 1 -- 172.21.15.49:0/1089605856 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa6881096f0 con 0x7fa67806caa0 2024-02-22T00:52:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.586+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa67806caa0 msgr2=0x7fa67806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa67806caa0 0x7fa67806ef60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fa6740043d0 tx=0x7fa67400b040).stop 2024-02-22T00:52:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fd8d0 msgr2=0x7fa68810e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fd8d0 0x7fa68810e070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fa67c00b4b0 tx=0x7fa67c0090f0).stop 2024-02-22T00:52:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 shutdown_connections 2024-02-22T00:52:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa67806caa0 0x7fa67806ef60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6880fd8d0 0x7fa68810e070 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 --2- 172.21.15.49:0/1089605856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6880fe230 0x7fa68810e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 >> 172.21.15.49:0/1089605856 conn(0x7fa68806ce40 msgr2=0x7fa688100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:38.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 shutdown_connections 2024-02-22T00:52:38.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.587+0000 7fa68eac4700 1 -- 172.21.15.49:0/1089605856 wait complete. 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 -- 172.21.15.49:0/1613722962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fe270 msgr2=0x7ffa900f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 --2- 172.21.15.49:0/1613722962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fe270 0x7ffa900f7a50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7ffa7c0047f0 tx=0x7ffa7c009cb0).stop 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 -- 172.21.15.49:0/1613722962 shutdown_connections 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 --2- 172.21.15.49:0/1613722962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fe270 0x7ffa900f7a50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 --2- 172.21.15.49:0/1613722962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900fd910 0x7ffa900fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 -- 172.21.15.49:0/1613722962 >> 172.21.15.49:0/1613722962 conn(0x7ffa900f3530 msgr2=0x7ffa900f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 -- 172.21.15.49:0/1613722962 shutdown_connections 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 -- 172.21.15.49:0/1613722962 wait complete. 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 Processor -- start 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.689+0000 7ffa96c2a700 1 -- start start 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa96c2a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fd910 0x7ffa901101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa96c2a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900fe270 0x7ffa901106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa96c2a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90110ce0 con 0x7ffa900fd910 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa96c2a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90110e20 con 0x7ffa900fe270 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa949c6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fd910 0x7ffa901101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa949c6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fd910 0x7ffa901101f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38236/0 (socket says 172.21.15.49:38236) 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa949c6700 1 -- 172.21.15.49:0/2414464659 learned_addr learned my addr 172.21.15.49:0/2414464659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa8ffff700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900fe270 0x7ffa901106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa949c6700 1 -- 172.21.15.49:0/2414464659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900fe270 msgr2=0x7ffa901106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa949c6700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900fe270 0x7ffa901106e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa949c6700 1 -- 172.21.15.49:0/2414464659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c005040 con 0x7ffa900fd910 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa949c6700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fd910 0x7ffa901101f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7ffa84002770 tx=0x7ffa84002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa8dffb700 1 -- 172.21.15.49:0/2414464659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa84007b40 con 0x7ffa900fd910 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa8dffb700 1 -- 172.21.15.49:0/2414464659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa8400f040 con 0x7ffa900fd910 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9010a4b0 con 0x7ffa900fd910 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.690+0000 7ffa8dffb700 1 -- 172.21.15.49:0/2414464659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa84014820 con 0x7ffa900fd910 2024-02-22T00:52:38.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.691+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9010a9f0 con 0x7ffa900fd910 2024-02-22T00:52:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.691+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9005f570 con 0x7ffa900fd910 2024-02-22T00:52:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.692+0000 7ffa8dffb700 1 -- 172.21.15.49:0/2414464659 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffa84007ca0 con 0x7ffa900fd910 2024-02-22T00:52:38.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.692+0000 7ffa8dffb700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa8006caa0 0x7ffa8006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.692+0000 7ffa8dffb700 1 -- 172.21.15.49:0/2414464659 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ffa8408b990 con 0x7ffa900fd910 2024-02-22T00:52:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.692+0000 7ffa8ffff700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa8006caa0 0x7ffa8006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:38.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.693+0000 7ffa8ffff700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa8006caa0 0x7ffa8006ef60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ffa9010bb30 tx=0x7ffa7c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:38.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.697+0000 7ffa8dffb700 1 -- 172.21.15.49:0/2414464659 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffa840594f0 con 0x7ffa900fd910 2024-02-22T00:52:38.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.906+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa9010ac70 con 0x7ffa8006caa0 2024-02-22T00:52:38.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.916+0000 7ffa8dffb700 1 -- 172.21.15.49:0/2414464659 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7ffa9010ac70 con 0x7ffa8006caa0 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (15m) 9m ago 27m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (13m) 9m ago 26m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (13m) 9m ago 26m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (15m) 9m ago 26m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (9m) 9m ago 21m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (10m) 9m ago 21m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (9m) 9m ago 21m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (9m) 9m ago 21m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:52:38.919 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (17m) 9m ago 28m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (16m) 9m ago 26m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (14m) 9m ago 28m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (14m) 9m ago 26m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (16m) 9m ago 26m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (16m) 9m ago 26m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (13m) 9m ago 25m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (12m) 9m ago 25m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (12m) 9m ago 24m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (11m) 9m ago 24m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (10m) 9m ago 23m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (10m) 9m ago 23m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:52:38.920 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (16m) 9m ago 25m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:52:38.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.918+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa8006caa0 msgr2=0x7ffa8006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.918+0000 7ffa96c2a700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa8006caa0 0x7ffa8006ef60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ffa9010bb30 tx=0x7ffa7c00b040).stop 2024-02-22T00:52:38.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.918+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fd910 msgr2=0x7ffa901101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:38.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.918+0000 7ffa96c2a700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fd910 0x7ffa901101f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7ffa84002770 tx=0x7ffa84002a80).stop 2024-02-22T00:52:38.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.918+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 shutdown_connections 2024-02-22T00:52:38.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.918+0000 7ffa96c2a700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa8006caa0 0x7ffa8006ef60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.918+0000 7ffa96c2a700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa900fd910 0x7ffa901101f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.918+0000 7ffa96c2a700 1 --2- 172.21.15.49:0/2414464659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa900fe270 0x7ffa901106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.919+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 >> 172.21.15.49:0/2414464659 conn(0x7ffa900f3530 msgr2=0x7ffa9006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.919+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 shutdown_connections 2024-02-22T00:52:38.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:38.919+0000 7ffa96c2a700 1 -- 172.21.15.49:0/2414464659 wait complete. 2024-02-22T00:52:39.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.020+0000 7f3376435700 1 -- 172.21.15.49:0/455995530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 msgr2=0x7f33700f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.020+0000 7f3376435700 1 --2- 172.21.15.49:0/455995530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 0x7f33700f6930 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f33640047f0 tx=0x7f3364009cb0).stop 2024-02-22T00:52:39.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.020+0000 7f3376435700 1 -- 172.21.15.49:0/455995530 shutdown_connections 2024-02-22T00:52:39.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.020+0000 7f3376435700 1 --2- 172.21.15.49:0/455995530 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 0x7f33700f6930 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.020+0000 7f3376435700 1 --2- 172.21.15.49:0/455995530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700fc7f0 0x7f33700fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.020+0000 7f3376435700 1 -- 172.21.15.49:0/455995530 >> 172.21.15.49:0/455995530 conn(0x7f3370070590 msgr2=0x7f33700f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:39.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.020+0000 7f3376435700 1 -- 172.21.15.49:0/455995530 shutdown_connections 2024-02-22T00:52:39.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.020+0000 7f3376435700 1 -- 172.21.15.49:0/455995530 wait complete. 2024-02-22T00:52:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.021+0000 7f3376435700 1 Processor -- start 2024-02-22T00:52:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.021+0000 7f3376435700 1 -- start start 2024-02-22T00:52:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f3376435700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700fc7f0 0x7f337010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f3376435700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 0x7f337010d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f3376435700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337010d9c0 con 0x7f33700fd150 2024-02-22T00:52:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f3376435700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337010db00 con 0x7f33700fc7f0 2024-02-22T00:52:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f336f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 0x7f337010d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f336f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 0x7f337010d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38262/0 (socket says 172.21.15.49:38262) 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f336f7fe700 1 -- 172.21.15.49:0/3408310672 learned_addr learned my addr 172.21.15.49:0/3408310672 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f336ffff700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700fc7f0 0x7f337010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f336f7fe700 1 -- 172.21.15.49:0/3408310672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700fc7f0 msgr2=0x7f337010ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f336f7fe700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700fc7f0 0x7f337010ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f336f7fe700 1 -- 172.21.15.49:0/3408310672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3364005040 con 0x7f33700fd150 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.022+0000 7f336f7fe700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 0x7f337010d3c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f33640099f0 tx=0x7f3364009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.023+0000 7f336d7fa700 1 -- 172.21.15.49:0/3408310672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f336400e030 con 0x7f33700fd150 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.023+0000 7f336d7fa700 1 -- 172.21.15.49:0/3408310672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3364007e90 con 0x7f33700fd150 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.023+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3370107130 con 0x7f33700fd150 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.023+0000 7f336d7fa700 1 -- 172.21.15.49:0/3408310672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3364018070 con 0x7f33700fd150 2024-02-22T00:52:39.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.023+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3370107610 con 0x7f33700fd150 2024-02-22T00:52:39.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.024+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337005f590 con 0x7f33700fd150 2024-02-22T00:52:39.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.024+0000 7f336d7fa700 1 -- 172.21.15.49:0/3408310672 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f33640094c0 con 0x7f33700fd150 2024-02-22T00:52:39.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.025+0000 7f336d7fa700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f335806caa0 0x7f335806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.025+0000 7f336d7fa700 1 -- 172.21.15.49:0/3408310672 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f336408cf60 con 0x7f33700fd150 2024-02-22T00:52:39.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.025+0000 7f336ffff700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f335806caa0 0x7f335806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.025+0000 7f336ffff700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f335806caa0 0x7f335806ef60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f3360004e60 tx=0x7f336000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:39.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.030+0000 7f336d7fa700 1 -- 172.21.15.49:0/3408310672 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f33640c0190 con 0x7f33700fd150 2024-02-22T00:52:39.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.310+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3370047540 con 0x7f33700fd150 2024-02-22T00:52:39.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.311+0000 7f336d7fa700 1 -- 172.21.15.49:0/3408310672 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f336405a830 con 0x7f33700fd150 2024-02-22T00:52:39.312 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:52:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:52:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:52:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:52:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:52:39.312 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:52:39.313 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f335806caa0 msgr2=0x7f335806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f335806caa0 0x7f335806ef60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f3360004e60 tx=0x7f336000b040).stop 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 msgr2=0x7f337010d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 0x7f337010d3c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f33640099f0 tx=0x7f3364009cb0).stop 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 shutdown_connections 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f335806caa0 0x7f335806ef60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33700fc7f0 0x7f337010ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 --2- 172.21.15.49:0/3408310672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33700fd150 0x7f337010d3c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 >> 172.21.15.49:0/3408310672 conn(0x7f3370070590 msgr2=0x7f33700fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 shutdown_connections 2024-02-22T00:52:39.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.313+0000 7f3376435700 1 -- 172.21.15.49:0/3408310672 wait complete. 2024-02-22T00:52:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.414+0000 7f10c1257700 1 -- 172.21.15.49:0/1507270341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 msgr2=0x7f10bc0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.414+0000 7f10c1257700 1 --2- 172.21.15.49:0/1507270341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 0x7f10bc0f7a50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f10ac0047f0 tx=0x7f10ac009cb0).stop 2024-02-22T00:52:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.414+0000 7f10c1257700 1 -- 172.21.15.49:0/1507270341 shutdown_connections 2024-02-22T00:52:39.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.414+0000 7f10c1257700 1 --2- 172.21.15.49:0/1507270341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 0x7f10bc0f7a50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.414+0000 7f10c1257700 1 --2- 172.21.15.49:0/1507270341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10bc0fd910 0x7f10bc0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.414+0000 7f10c1257700 1 -- 172.21.15.49:0/1507270341 >> 172.21.15.49:0/1507270341 conn(0x7f10bc0f3530 msgr2=0x7f10bc0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:39.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.415+0000 7f10c1257700 1 -- 172.21.15.49:0/1507270341 shutdown_connections 2024-02-22T00:52:39.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.415+0000 7f10c1257700 1 -- 172.21.15.49:0/1507270341 wait complete. 2024-02-22T00:52:39.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.415+0000 7f10c1257700 1 Processor -- start 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10c1257700 1 -- start start 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10c1257700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10bc0fd910 0x7f10bc06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10c1257700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 0x7f10bc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10c1257700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc06bab0 con 0x7f10bc0fe270 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10c1257700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc06bbf0 con 0x7f10bc0fd910 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10ba59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 0x7f10bc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10ba59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 0x7f10bc06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38284/0 (socket says 172.21.15.49:38284) 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10ba59c700 1 -- 172.21.15.49:0/766834946 learned_addr learned my addr 172.21.15.49:0/766834946 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10bad9d700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10bc0fd910 0x7f10bc06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10ba59c700 1 -- 172.21.15.49:0/766834946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10bc0fd910 msgr2=0x7f10bc06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10ba59c700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10bc0fd910 0x7f10bc06b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10ba59c700 1 -- 172.21.15.49:0/766834946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac005040 con 0x7f10bc0fe270 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.416+0000 7f10ba59c700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 0x7f10bc06b5c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f10ac0099f0 tx=0x7f10ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:39.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.417+0000 7f10a3fff700 1 -- 172.21.15.49:0/766834946 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ac00e030 con 0x7f10bc0fe270 2024-02-22T00:52:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.417+0000 7f10a3fff700 1 -- 172.21.15.49:0/766834946 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10ac007e90 con 0x7f10bc0fe270 2024-02-22T00:52:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.417+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc06be40 con 0x7f10bc0fe270 2024-02-22T00:52:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.417+0000 7f10a3fff700 1 -- 172.21.15.49:0/766834946 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10ac018070 con 0x7f10bc0fe270 2024-02-22T00:52:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.417+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc114600 con 0x7f10bc0fe270 2024-02-22T00:52:39.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.417+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc05f570 con 0x7f10bc0fe270 2024-02-22T00:52:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.418+0000 7f10a3fff700 1 -- 172.21.15.49:0/766834946 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f10ac009590 con 0x7f10bc0fe270 2024-02-22T00:52:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.419+0000 7f10a3fff700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f10a406ca30 0x7f10a406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.419+0000 7f10bad9d700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f10a406ca30 0x7f10a406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.419+0000 7f10a3fff700 1 -- 172.21.15.49:0/766834946 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f10ac08d6b0 con 0x7f10bc0fe270 2024-02-22T00:52:39.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.419+0000 7f10bad9d700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f10a406ca30 0x7f10a406eef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f10b0009170 tx=0x7f10b0009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:39.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.423+0000 7f10a3fff700 1 -- 172.21.15.49:0/766834946 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f10ac057780 con 0x7f10bc0fe270 2024-02-22T00:52:39.427 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:39 smithi049 ceph-mon[132694]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:39.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:39 smithi161 ceph-mon[113442]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:39.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.667+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f10bc047540 con 0x7f10bc0fe270 2024-02-22T00:52:39.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.667+0000 7f10a3fff700 1 -- 172.21.15.49:0/766834946 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f10ac05ada0 con 0x7f10bc0fe270 2024-02-22T00:52:39.668 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:52:39.668 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:52:39.669 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:52:39.670 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:52:39.671 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:52:39.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f10a406ca30 msgr2=0x7f10a406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f10a406ca30 0x7f10a406eef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f10b0009170 tx=0x7f10b0009d60).stop 2024-02-22T00:52:39.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 msgr2=0x7f10bc06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 0x7f10bc06b5c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f10ac0099f0 tx=0x7f10ac009cb0).stop 2024-02-22T00:52:39.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 shutdown_connections 2024-02-22T00:52:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f10a406ca30 0x7f10a406eef0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10bc0fd910 0x7f10bc06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 --2- 172.21.15.49:0/766834946 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10bc0fe270 0x7f10bc06b5c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 >> 172.21.15.49:0/766834946 conn(0x7f10bc0f3530 msgr2=0x7f10bc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 shutdown_connections 2024-02-22T00:52:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.669+0000 7f10c1257700 1 -- 172.21.15.49:0/766834946 wait complete. 2024-02-22T00:52:39.673 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:52:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.772+0000 7f2071700700 1 -- 172.21.15.49:0/666543912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 msgr2=0x7f206c0fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.772+0000 7f2071700700 1 --2- 172.21.15.49:0/666543912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 0x7f206c0fdd50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f205c0047f0 tx=0x7f205c009cb0).stop 2024-02-22T00:52:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.772+0000 7f2071700700 1 -- 172.21.15.49:0/666543912 shutdown_connections 2024-02-22T00:52:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.772+0000 7f2071700700 1 --2- 172.21.15.49:0/666543912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f206c0fe2d0 0x7f206c0f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:52:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.772+0000 7f2071700700 1 --2- 172.21.15.49:0/666543912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 0x7f206c0fdd50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.772+0000 7f2071700700 1 -- 172.21.15.49:0/666543912 >> 172.21.15.49:0/666543912 conn(0x7f206c0f3550 msgr2=0x7f206c0f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.772+0000 7f2071700700 1 -- 172.21.15.49:0/666543912 shutdown_connections 2024-02-22T00:52:39.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.772+0000 7f2071700700 1 -- 172.21.15.49:0/666543912 wait complete. 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.773+0000 7f2071700700 1 Processor -- start 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.773+0000 7f2071700700 1 -- start start 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.773+0000 7f2071700700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 0x7f206c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.773+0000 7f2071700700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f206c0fe2d0 0x7f206c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.773+0000 7f2071700700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c06bab0 con 0x7f206c0fd970 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.773+0000 7f2071700700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c06bbf0 con 0x7f206c0fe2d0 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 0x7f206c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 0x7f206c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38302/0 (socket says 172.21.15.49:38302) 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206affd700 1 -- 172.21.15.49:0/606594674 learned_addr learned my addr 172.21.15.49:0/606594674 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206a7fc700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f206c0fe2d0 0x7f206c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206affd700 1 -- 172.21.15.49:0/606594674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f206c0fe2d0 msgr2=0x7f206c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206affd700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f206c0fe2d0 0x7f206c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206affd700 1 -- 172.21.15.49:0/606594674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c005040 con 0x7f206c0fd970 2024-02-22T00:52:39.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206a7fc700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f206c0fe2d0 0x7f206c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:52:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f206affd700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 0x7f206c06b0d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f205c00b120 tx=0x7f205c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f2053fff700 1 -- 172.21.15.49:0/606594674 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f205c00e030 con 0x7f206c0fd970 2024-02-22T00:52:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f2053fff700 1 -- 172.21.15.49:0/606594674 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f205c007e90 con 0x7f206c0fd970 2024-02-22T00:52:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c06be40 con 0x7f206c0fd970 2024-02-22T00:52:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f2053fff700 1 -- 172.21.15.49:0/606594674 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f205c018070 con 0x7f206c0fd970 2024-02-22T00:52:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.774+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c1146c0 con 0x7f206c0fd970 2024-02-22T00:52:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.775+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c060370 con 0x7f206c0fd970 2024-02-22T00:52:39.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.776+0000 7f2053fff700 1 -- 172.21.15.49:0/606594674 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f205c01d420 con 0x7f206c0fd970 2024-02-22T00:52:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.776+0000 7f2053fff700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f205406caa0 0x7f205406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.776+0000 7f206a7fc700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f205406caa0 0x7f205406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.776+0000 7f2053fff700 1 -- 172.21.15.49:0/606594674 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f205c08d250 con 0x7f206c0fd970 2024-02-22T00:52:39.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.777+0000 7f206a7fc700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f205406caa0 0x7f205406ef60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f206c06c870 tx=0x7f2060008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:39.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.781+0000 7f2053fff700 1 -- 172.21.15.49:0/606594674 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f205c057320 con 0x7f206c0fd970 2024-02-22T00:52:39.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.997+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f206c06c6f0 con 0x7f205406caa0 2024-02-22T00:52:39.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:39.998+0000 7f2053fff700 1 -- 172.21.15.49:0/606594674 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f206000d630 con 0x7f205406caa0 2024-02-22T00:52:39.999 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:52:39.999 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:52:40.000 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:52:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f205406caa0 msgr2=0x7f205406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:40.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f205406caa0 0x7f205406ef60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f206c06c870 tx=0x7f2060008040).stop 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 msgr2=0x7f206c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 0x7f206c06b0d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f205c00b120 tx=0x7f205c009cb0).stop 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 shutdown_connections 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f205406caa0 0x7f205406ef60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f206c0fd970 0x7f206c06b0d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 --2- 172.21.15.49:0/606594674 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f206c0fe2d0 0x7f206c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.000+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 >> 172.21.15.49:0/606594674 conn(0x7f206c0f3550 msgr2=0x7f206c0fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.001+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 shutdown_connections 2024-02-22T00:52:40.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.001+0000 7f2071700700 1 -- 172.21.15.49:0/606594674 wait complete. 2024-02-22T00:52:40.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.103+0000 7f59a21ca700 1 -- 172.21.15.49:0/2335421885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fd8f0 msgr2=0x7f599c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:40.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.103+0000 7f59a21ca700 1 --2- 172.21.15.49:0/2335421885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fd8f0 0x7f599c0fdcd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f598c0047f0 tx=0x7f598c009cb0).stop 2024-02-22T00:52:40.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.103+0000 7f59a21ca700 1 -- 172.21.15.49:0/2335421885 shutdown_connections 2024-02-22T00:52:40.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.103+0000 7f59a21ca700 1 --2- 172.21.15.49:0/2335421885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f599c0fe250 0x7f599c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.103+0000 7f59a21ca700 1 --2- 172.21.15.49:0/2335421885 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fd8f0 0x7f599c0fdcd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.103+0000 7f59a21ca700 1 -- 172.21.15.49:0/2335421885 >> 172.21.15.49:0/2335421885 conn(0x7f599c0f34b0 msgr2=0x7f599c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:40.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.103+0000 7f59a21ca700 1 -- 172.21.15.49:0/2335421885 shutdown_connections 2024-02-22T00:52:40.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.103+0000 7f59a21ca700 1 -- 172.21.15.49:0/2335421885 wait complete. 2024-02-22T00:52:40.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f59a21ca700 1 Processor -- start 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f59a21ca700 1 -- start start 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f59a21ca700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f599c0fd8f0 0x7f599c10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f59a21ca700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fe250 0x7f599c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f59a21ca700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c10ead0 con 0x7f599c0fe250 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f59a21ca700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c10ec10 con 0x7f599c0fd8f0 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f599affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fe250 0x7f599c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f599affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fe250 0x7f599c10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38320/0 (socket says 172.21.15.49:38320) 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f599affd700 1 -- 172.21.15.49:0/3457321699 learned_addr learned my addr 172.21.15.49:0/3457321699 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f599b7fe700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f599c0fd8f0 0x7f599c10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f599affd700 1 -- 172.21.15.49:0/3457321699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f599c0fd8f0 msgr2=0x7f599c10dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:40.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f599affd700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f599c0fd8f0 0x7f599c10dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.104+0000 7f599affd700 1 -- 172.21.15.49:0/3457321699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c005040 con 0x7f599c0fe250 2024-02-22T00:52:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.105+0000 7f599affd700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fe250 0x7f599c10e4d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f5984002780 tx=0x7f5984009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.105+0000 7f5998ff9700 1 -- 172.21.15.49:0/3457321699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5984007b40 con 0x7f599c0fe250 2024-02-22T00:52:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.105+0000 7f5998ff9700 1 -- 172.21.15.49:0/3457321699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f598400f040 con 0x7f599c0fe250 2024-02-22T00:52:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.105+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c1082a0 con 0x7f599c0fe250 2024-02-22T00:52:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.105+0000 7f5998ff9700 1 -- 172.21.15.49:0/3457321699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5984014780 con 0x7f599c0fe250 2024-02-22T00:52:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.105+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c108860 con 0x7f599c0fe250 2024-02-22T00:52:40.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.106+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c05f590 con 0x7f599c0fe250 2024-02-22T00:52:40.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.106+0000 7f5998ff9700 1 -- 172.21.15.49:0/3457321699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5984007ca0 con 0x7f599c0fe250 2024-02-22T00:52:40.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.107+0000 7f5998ff9700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f598806caa0 0x7f598806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:52:40.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.107+0000 7f5998ff9700 1 -- 172.21.15.49:0/3457321699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f598408bd30 con 0x7f599c0fe250 2024-02-22T00:52:40.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.107+0000 7f599b7fe700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f598806caa0 0x7f598806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:52:40.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.107+0000 7f599b7fe700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f598806caa0 0x7f598806ef60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f598c004f10 tx=0x7f598c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:52:40.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.111+0000 7f5998ff9700 1 -- 172.21.15.49:0/3457321699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5984059890 con 0x7f599c0fe250 2024-02-22T00:52:40.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.395+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f599c047540 con 0x7f599c0fe250 2024-02-22T00:52:40.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.395+0000 7f5998ff9700 1 -- 172.21.15.49:0/3457321699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f5984059420 con 0x7f599c0fe250 2024-02-22T00:52:40.397 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:52:40.397 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:52:40.397 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:52:40.397 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:52:40.397 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:52:40.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f598806caa0 msgr2=0x7f598806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:40.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f598806caa0 0x7f598806ef60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f598c004f10 tx=0x7f598c00b040).stop 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fe250 msgr2=0x7f599c10e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fe250 0x7f599c10e4d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f5984002780 tx=0x7f5984009ee0).stop 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 shutdown_connections 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f598806caa0 0x7f598806ef60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f599c0fd8f0 0x7f599c10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 --2- 172.21.15.49:0/3457321699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f599c0fe250 0x7f599c10e4d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 >> 172.21.15.49:0/3457321699 conn(0x7f599c0f34b0 msgr2=0x7f599c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 shutdown_connections 2024-02-22T00:52:40.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:52:40.397+0000 7f59a21ca700 1 -- 172.21.15.49:0/3457321699 wait complete. 2024-02-22T00:52:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:40 smithi049 ceph-mon[132694]: pgmap v472: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:40 smithi049 ceph-mon[132694]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:40 smithi049 ceph-mon[132694]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:40 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3408310672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:52:40.429 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:40 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/766834946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:52:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:40 smithi161 ceph-mon[113442]: pgmap v472: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:40 smithi161 ceph-mon[113442]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:40 smithi161 ceph-mon[113442]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:40 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3408310672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:52:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:40 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/766834946' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:52:41.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:41 smithi049 ceph-mon[132694]: from='client.34914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:41.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:41 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3457321699' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:52:41.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:41 smithi161 ceph-mon[113442]: from='client.34914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:52:41.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:41 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3457321699' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:52:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:42 smithi049 ceph-mon[132694]: pgmap v473: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:42 smithi161 ceph-mon[113442]: pgmap v473: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:52:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:52:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:44 smithi161 ceph-mon[113442]: pgmap v474: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:44 smithi049 ceph-mon[132694]: pgmap v474: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:46 smithi161 ceph-mon[113442]: pgmap v475: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:46 smithi049 ceph-mon[132694]: pgmap v475: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:48 smithi161 ceph-mon[113442]: pgmap v476: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:48 smithi049 ceph-mon[132694]: pgmap v476: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:50 smithi161 ceph-mon[113442]: pgmap v477: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:50.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:50 smithi049 ceph-mon[132694]: pgmap v477: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:52 smithi161 ceph-mon[113442]: pgmap v478: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:52 smithi049 ceph-mon[132694]: pgmap v478: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:54 smithi161 ceph-mon[113442]: pgmap v479: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:54 smithi049 ceph-mon[132694]: pgmap v479: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:56 smithi161 ceph-mon[113442]: pgmap v480: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:56.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:56 smithi049 ceph-mon[132694]: pgmap v480: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:58 smithi161 ceph-mon[113442]: pgmap v481: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:52:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:52:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:58 smithi049 ceph-mon[132694]: pgmap v481: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:52:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:52:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:53:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:00 smithi161 ceph-mon[113442]: pgmap v482: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:00.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:00 smithi049 ceph-mon[132694]: pgmap v482: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:02 smithi161 ceph-mon[113442]: pgmap v483: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:02 smithi049 ceph-mon[132694]: pgmap v483: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:04 smithi161 ceph-mon[113442]: pgmap v484: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:04 smithi049 ceph-mon[132694]: pgmap v484: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:06 smithi161 ceph-mon[113442]: pgmap v485: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:06 smithi049 ceph-mon[132694]: pgmap v485: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:08 smithi161 ceph-mon[113442]: pgmap v486: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:08 smithi049 ceph-mon[132694]: pgmap v486: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:10.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.512+0000 7f87fc26a700 1 -- 172.21.15.49:0/3651034522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 msgr2=0x7f87f40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:10.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.512+0000 7f87fc26a700 1 --2- 172.21.15.49:0/3651034522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 0x7f87f40f6930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f87e40047f0 tx=0x7f87e4009cb0).stop 2024-02-22T00:53:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.513+0000 7f87fc26a700 1 -- 172.21.15.49:0/3651034522 shutdown_connections 2024-02-22T00:53:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.513+0000 7f87fc26a700 1 --2- 172.21.15.49:0/3651034522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 0x7f87f40f6930 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.513+0000 7f87fc26a700 1 --2- 172.21.15.49:0/3651034522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87f40fc7f0 0x7f87f40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.513+0000 7f87fc26a700 1 -- 172.21.15.49:0/3651034522 >> 172.21.15.49:0/3651034522 conn(0x7f87f4070590 msgr2=0x7f87f40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.513+0000 7f87fc26a700 1 -- 172.21.15.49:0/3651034522 shutdown_connections 2024-02-22T00:53:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.513+0000 7f87fc26a700 1 -- 172.21.15.49:0/3651034522 wait complete. 2024-02-22T00:53:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.513+0000 7f87fc26a700 1 Processor -- start 2024-02-22T00:53:10.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.513+0000 7f87fc26a700 1 -- start start 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87fc26a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87f40fc7f0 0x7f87f410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87fc26a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 0x7f87f410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87fc26a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f410eab0 con 0x7f87f40fd150 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87fc26a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f410ebf0 con 0x7f87f40fc7f0 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87f9805700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 0x7f87f410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87f9805700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 0x7f87f410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59846/0 (socket says 172.21.15.49:59846) 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87f9805700 1 -- 172.21.15.49:0/2258641428 learned_addr learned my addr 172.21.15.49:0/2258641428 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87fa006700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87f40fc7f0 0x7f87f410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87f9805700 1 -- 172.21.15.49:0/2258641428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87f40fc7f0 msgr2=0x7f87f410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87f9805700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87f40fc7f0 0x7f87f410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87f9805700 1 -- 172.21.15.49:0/2258641428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e4005040 con 0x7f87f40fd150 2024-02-22T00:53:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87f9805700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 0x7f87f410e4b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f87e4000c00 tx=0x7f87e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87eb779700 1 -- 172.21.15.49:0/2258641428 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e400e030 con 0x7f87f40fd150 2024-02-22T00:53:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87eb779700 1 -- 172.21.15.49:0/2258641428 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87e4007e90 con 0x7f87f40fd150 2024-02-22T00:53:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f4108220 con 0x7f87f40fd150 2024-02-22T00:53:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.514+0000 7f87eb779700 1 -- 172.21.15.49:0/2258641428 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e4018070 con 0x7f87f40fd150 2024-02-22T00:53:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.515+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4108780 con 0x7f87f40fd150 2024-02-22T00:53:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.515+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f405f590 con 0x7f87f40fd150 2024-02-22T00:53:10.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.516+0000 7f87eb779700 1 -- 172.21.15.49:0/2258641428 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f87e401d420 con 0x7f87f40fd150 2024-02-22T00:53:10.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.517+0000 7f87eb779700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f87e006cab0 0x7f87e006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:10.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.517+0000 7f87fa006700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f87e006cab0 0x7f87e006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:10.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.517+0000 7f87eb779700 1 -- 172.21.15.49:0/2258641428 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f87e408cf30 con 0x7f87f40fd150 2024-02-22T00:53:10.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.517+0000 7f87fa006700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f87e006cab0 0x7f87e006ef70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f87f0004dc0 tx=0x7f87f000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.521+0000 7f87eb779700 1 -- 172.21.15.49:0/2258641428 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f87e40c0190 con 0x7f87f40fd150 2024-02-22T00:53:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:10 smithi161 ceph-mon[113442]: pgmap v487: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:10 smithi049 ceph-mon[132694]: pgmap v487: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.739+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87f4108dc0 con 0x7f87e006cab0 2024-02-22T00:53:10.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.741+0000 7f87eb779700 1 -- 172.21.15.49:0/2258641428 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f87f4108dc0 con 0x7f87e006cab0 2024-02-22T00:53:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f87e006cab0 msgr2=0x7f87e006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f87e006cab0 0x7f87e006ef70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f87f0004dc0 tx=0x7f87f000b040).stop 2024-02-22T00:53:10.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 msgr2=0x7f87f410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 0x7f87f410e4b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f87e4000c00 tx=0x7f87e4009cb0).stop 2024-02-22T00:53:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 shutdown_connections 2024-02-22T00:53:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f87e006cab0 0x7f87e006ef70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87f40fc7f0 0x7f87f410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 --2- 172.21.15.49:0/2258641428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f87f40fd150 0x7f87f410e4b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 >> 172.21.15.49:0/2258641428 conn(0x7f87f4070590 msgr2=0x7f87f4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 shutdown_connections 2024-02-22T00:53:10.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.743+0000 7f87fc26a700 1 -- 172.21.15.49:0/2258641428 wait complete. 2024-02-22T00:53:10.756 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:53:10.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.846+0000 7f2f8b53b700 1 -- 172.21.15.49:0/3439865940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fc7f0 msgr2=0x7f2f840fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:10.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.846+0000 7f2f8b53b700 1 --2- 172.21.15.49:0/3439865940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fc7f0 0x7f2f840fcbd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f2f800047f0 tx=0x7f2f80009cb0).stop 2024-02-22T00:53:10.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.846+0000 7f2f8b53b700 1 -- 172.21.15.49:0/3439865940 shutdown_connections 2024-02-22T00:53:10.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.846+0000 7f2f8b53b700 1 --2- 172.21.15.49:0/3439865940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f840fd150 0x7f2f840f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.846+0000 7f2f8b53b700 1 --2- 172.21.15.49:0/3439865940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fc7f0 0x7f2f840fcbd0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.846+0000 7f2f8b53b700 1 -- 172.21.15.49:0/3439865940 >> 172.21.15.49:0/3439865940 conn(0x7f2f84070590 msgr2=0x7f2f840f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:10.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.846+0000 7f2f8b53b700 1 -- 172.21.15.49:0/3439865940 shutdown_connections 2024-02-22T00:53:10.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.846+0000 7f2f8b53b700 1 -- 172.21.15.49:0/3439865940 wait complete. 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f8b53b700 1 Processor -- start 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f8b53b700 1 -- start start 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f8b53b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f840fc7f0 0x7f2f8410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f8b53b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fd150 0x7f2f8410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f8b53b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8410eb20 con 0x7f2f840fd150 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f8b53b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8410ec60 con 0x7f2f840fc7f0 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f88ad6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fd150 0x7f2f8410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f88ad6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fd150 0x7f2f8410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59866/0 (socket says 172.21.15.49:59866) 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f88ad6700 1 -- 172.21.15.49:0/4035120802 learned_addr learned my addr 172.21.15.49:0/4035120802 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f892d7700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f840fc7f0 0x7f2f8410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f88ad6700 1 -- 172.21.15.49:0/4035120802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f840fc7f0 msgr2=0x7f2f8410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:10.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f88ad6700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f840fc7f0 0x7f2f8410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f88ad6700 1 -- 172.21.15.49:0/4035120802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80005040 con 0x7f2f840fd150 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f892d7700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f840fc7f0 0x7f2f8410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.847+0000 7f2f88ad6700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fd150 0x7f2f8410e520 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f2f7400c790 tx=0x7f2f74007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.848+0000 7f2f7a7fc700 1 -- 172.21.15.49:0/4035120802 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f740106f0 con 0x7f2f840fd150 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.848+0000 7f2f7a7fc700 1 -- 172.21.15.49:0/4035120802 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f74010d00 con 0x7f2f840fd150 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.848+0000 7f2f7a7fc700 1 -- 172.21.15.49:0/4035120802 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f74012d50 con 0x7f2f840fd150 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.848+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f841082f0 con 0x7f2f840fd150 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.848+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f841088b0 con 0x7f2f840fd150 2024-02-22T00:53:10.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.849+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8405f590 con 0x7f2f840fd150 2024-02-22T00:53:10.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.849+0000 7f2f7a7fc700 1 -- 172.21.15.49:0/4035120802 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2f74012570 con 0x7f2f840fd150 2024-02-22T00:53:10.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.850+0000 7f2f7a7fc700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f7006caa0 0x7f2f7006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:10.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.850+0000 7f2f7a7fc700 1 -- 172.21.15.49:0/4035120802 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2f7408bf20 con 0x7f2f840fd150 2024-02-22T00:53:10.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.850+0000 7f2f892d7700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f7006caa0 0x7f2f7006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:10.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.850+0000 7f2f892d7700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f7006caa0 0x7f2f7006ef60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f2f80007cf0 tx=0x7f2f8000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:10.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:10.854+0000 7f2f7a7fc700 1 -- 172.21.15.49:0/4035120802 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2f74059bc0 con 0x7f2f840fd150 2024-02-22T00:53:11.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.069+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f84108fa0 con 0x7f2f7006caa0 2024-02-22T00:53:11.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.070+0000 7f2f7a7fc700 1 -- 172.21.15.49:0/4035120802 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2f84108fa0 con 0x7f2f7006caa0 2024-02-22T00:53:11.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f7006caa0 msgr2=0x7f2f7006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f7006caa0 0x7f2f7006ef60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f2f80007cf0 tx=0x7f2f8000b040).stop 2024-02-22T00:53:11.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fd150 msgr2=0x7f2f8410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fd150 0x7f2f8410e520 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f2f7400c790 tx=0x7f2f74007f50).stop 2024-02-22T00:53:11.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 shutdown_connections 2024-02-22T00:53:11.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f7006caa0 0x7f2f7006ef60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f840fc7f0 0x7f2f8410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 --2- 172.21.15.49:0/4035120802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f840fd150 0x7f2f8410e520 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 >> 172.21.15.49:0/4035120802 conn(0x7f2f84070590 msgr2=0x7f2f84060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:11.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 shutdown_connections 2024-02-22T00:53:11.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.072+0000 7f2f8b53b700 1 -- 172.21.15.49:0/4035120802 wait complete. 2024-02-22T00:53:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.173+0000 7f62d5b62700 1 -- 172.21.15.49:0/4036539661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f9200 msgr2=0x7f62d0101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.173+0000 7f62d5b62700 1 --2- 172.21.15.49:0/4036539661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f9200 0x7f62d0101910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f62c40047f0 tx=0x7f62c4009cb0).stop 2024-02-22T00:53:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.173+0000 7f62d5b62700 1 -- 172.21.15.49:0/4036539661 shutdown_connections 2024-02-22T00:53:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.173+0000 7f62d5b62700 1 --2- 172.21.15.49:0/4036539661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f9200 0x7f62d0101910 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.173+0000 7f62d5b62700 1 --2- 172.21.15.49:0/4036539661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62d00f88a0 0x7f62d00f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.173+0000 7f62d5b62700 1 -- 172.21.15.49:0/4036539661 >> 172.21.15.49:0/4036539661 conn(0x7f62d0070590 msgr2=0x7f62d00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.174+0000 7f62d5b62700 1 -- 172.21.15.49:0/4036539661 shutdown_connections 2024-02-22T00:53:11.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.174+0000 7f62d5b62700 1 -- 172.21.15.49:0/4036539661 wait complete. 2024-02-22T00:53:11.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.174+0000 7f62d5b62700 1 Processor -- start 2024-02-22T00:53:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.174+0000 7f62d5b62700 1 -- start start 2024-02-22T00:53:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62d5b62700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f88a0 0x7f62d010e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62d5b62700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62d00f9200 0x7f62d010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62d5b62700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d010eb80 con 0x7f62d00f88a0 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62d5b62700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d010ecc0 con 0x7f62d00f9200 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f88a0 0x7f62d010e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f88a0 0x7f62d010e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59888/0 (socket says 172.21.15.49:59888) 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62cf7fe700 1 -- 172.21.15.49:0/28454266 learned_addr learned my addr 172.21.15.49:0/28454266 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62ceffd700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62d00f9200 0x7f62d010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62cf7fe700 1 -- 172.21.15.49:0/28454266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62d00f9200 msgr2=0x7f62d010e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62cf7fe700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62d00f9200 0x7f62d010e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62cf7fe700 1 -- 172.21.15.49:0/28454266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4005040 con 0x7f62d00f88a0 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62cf7fe700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f88a0 0x7f62d010e090 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f62c00041d0 tx=0x7f62c0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62ccff9700 1 -- 172.21.15.49:0/28454266 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62c0007b40 con 0x7f62d00f88a0 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62ccff9700 1 -- 172.21.15.49:0/28454266 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62c000f040 con 0x7f62d00f88a0 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d0108350 con 0x7f62d00f88a0 2024-02-22T00:53:11.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62ccff9700 1 -- 172.21.15.49:0/28454266 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62c00137d0 con 0x7f62d00f88a0 2024-02-22T00:53:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.175+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d0108890 con 0x7f62d00f88a0 2024-02-22T00:53:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.176+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d005f590 con 0x7f62d00f88a0 2024-02-22T00:53:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.177+0000 7f62ccff9700 1 -- 172.21.15.49:0/28454266 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f62c0007ca0 con 0x7f62d00f88a0 2024-02-22T00:53:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.177+0000 7f62ccff9700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f62b806caa0 0x7f62b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.177+0000 7f62ccff9700 1 -- 172.21.15.49:0/28454266 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f62c008b730 con 0x7f62d00f88a0 2024-02-22T00:53:11.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.177+0000 7f62ceffd700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f62b806caa0 0x7f62b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.178+0000 7f62ceffd700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f62b806caa0 0x7f62b806ef60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f62d01099d0 tx=0x7f62c400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:11.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.182+0000 7f62ccff9700 1 -- 172.21.15.49:0/28454266 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f62c0059290 con 0x7f62d00f88a0 2024-02-22T00:53:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.386+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f62d0108b60 con 0x7f62b806caa0 2024-02-22T00:53:11.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.396+0000 7f62ccff9700 1 -- 172.21.15.49:0/28454266 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f62d0108b60 con 0x7f62b806caa0 2024-02-22T00:53:11.398 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:53:11.398 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (16m) 10m ago 27m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (14m) 10m ago 27m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (14m) 9m ago 26m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (16m) 10m ago 27m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (10m) 10m ago 22m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (10m) 10m ago 22m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (9m) 9m ago 22m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (10m) 9m ago 22m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (18m) 10m ago 28m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (17m) 9m ago 26m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (15m) 10m ago 29m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (14m) 9m ago 26m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (17m) 10m ago 27m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:53:11.399 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (16m) 9m ago 26m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:53:11.400 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (13m) 10m ago 26m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:53:11.400 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (13m) 10m ago 25m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:53:11.400 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (12m) 10m ago 25m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:53:11.400 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (12m) 9m ago 24m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:53:11.400 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (11m) 9m ago 24m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:53:11.400 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (10m) 9m ago 23m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:53:11.400 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (16m) 9m ago 26m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f62b806caa0 msgr2=0x7f62b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f62b806caa0 0x7f62b806ef60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f62d01099d0 tx=0x7f62c400b040).stop 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f88a0 msgr2=0x7f62d010e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f88a0 0x7f62d010e090 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f62c00041d0 tx=0x7f62c0009f60).stop 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 shutdown_connections 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f62b806caa0 0x7f62b806ef60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62d00f88a0 0x7f62d010e090 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 --2- 172.21.15.49:0/28454266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62d00f9200 0x7f62d010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 >> 172.21.15.49:0/28454266 conn(0x7f62d0070590 msgr2=0x7f62d00fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 shutdown_connections 2024-02-22T00:53:11.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.398+0000 7f62d5b62700 1 -- 172.21.15.49:0/28454266 wait complete. 2024-02-22T00:53:11.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.498+0000 7f26ac084700 1 -- 172.21.15.49:0/3321697292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fd150 msgr2=0x7f26a40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.498+0000 7f26ac084700 1 --2- 172.21.15.49:0/3321697292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fd150 0x7f26a40f6930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f26940047f0 tx=0x7f2694009cb0).stop 2024-02-22T00:53:11.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 -- 172.21.15.49:0/3321697292 shutdown_connections 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 --2- 172.21.15.49:0/3321697292 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fd150 0x7f26a40f6930 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 --2- 172.21.15.49:0/3321697292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26a40fc7f0 0x7f26a40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 -- 172.21.15.49:0/3321697292 >> 172.21.15.49:0/3321697292 conn(0x7f26a4070590 msgr2=0x7f26a40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 -- 172.21.15.49:0/3321697292 shutdown_connections 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 -- 172.21.15.49:0/3321697292 wait complete. 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 Processor -- start 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 -- start start 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.499+0000 7f26ac084700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fc7f0 0x7f26a40f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26ac084700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26a40fd150 0x7f26a40f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26ac084700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40f8f20 con 0x7f26a40fc7f0 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26ac084700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40f9060 con 0x7f26a40fd150 2024-02-22T00:53:11.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26a9e20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fc7f0 0x7f26a40f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26a9e20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fc7f0 0x7f26a40f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39526/0 (socket says 172.21.15.49:39526) 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26a9e20700 1 -- 172.21.15.49:0/524782351 learned_addr learned my addr 172.21.15.49:0/524782351 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26a961f700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26a40fd150 0x7f26a40f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26a9e20700 1 -- 172.21.15.49:0/524782351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26a40fd150 msgr2=0x7f26a40f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26a9e20700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26a40fd150 0x7f26a40f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26a9e20700 1 -- 172.21.15.49:0/524782351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2694005040 con 0x7f26a40fc7f0 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26a9e20700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fc7f0 0x7f26a40f8540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f26a000e8f0 tx=0x7f26a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f269affd700 1 -- 172.21.15.49:0/524782351 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a0007b40 con 0x7f26a40fc7f0 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f269affd700 1 -- 172.21.15.49:0/524782351 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26a000f040 con 0x7f26a40fc7f0 2024-02-22T00:53:11.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a40f9340 con 0x7f26a40fc7f0 2024-02-22T00:53:11.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f269affd700 1 -- 172.21.15.49:0/524782351 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26a0014880 con 0x7f26a40fc7f0 2024-02-22T00:53:11.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.500+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a41147a0 con 0x7f26a40fc7f0 2024-02-22T00:53:11.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.501+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a405f590 con 0x7f26a40fc7f0 2024-02-22T00:53:11.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.502+0000 7f269affd700 1 -- 172.21.15.49:0/524782351 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f26a0014b00 con 0x7f26a40fc7f0 2024-02-22T00:53:11.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.502+0000 7f269affd700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f269006cab0 0x7f269006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.502+0000 7f269affd700 1 -- 172.21.15.49:0/524782351 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f26a008b9a0 con 0x7f26a40fc7f0 2024-02-22T00:53:11.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.503+0000 7f26a961f700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f269006cab0 0x7f269006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.503+0000 7f26a961f700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f269006cab0 0x7f269006ef70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f26a40f9ce0 tx=0x7f2694009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:11.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.507+0000 7f269affd700 1 -- 172.21.15.49:0/524782351 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f26a0055a70 con 0x7f26a40fc7f0 2024-02-22T00:53:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.791+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26a4114de0 con 0x7f26a40fc7f0 2024-02-22T00:53:11.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.791+0000 7f269affd700 1 -- 172.21.15.49:0/524782351 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f26a0059090 con 0x7f26a40fc7f0 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:53:11.794 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:53:11.795 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:53:11.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:53:11.795 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:53:11.795 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:53:11.795 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:53:11.795 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:53:11.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f269006cab0 msgr2=0x7f269006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f269006cab0 0x7f269006ef70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f26a40f9ce0 tx=0x7f2694009cb0).stop 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fc7f0 msgr2=0x7f26a40f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fc7f0 0x7f26a40f8540 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f26a000e8f0 tx=0x7f26a000b040).stop 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 shutdown_connections 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f269006cab0 0x7f269006ef70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26a40fc7f0 0x7f26a40f8540 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 --2- 172.21.15.49:0/524782351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26a40fd150 0x7f26a40f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.793+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 >> 172.21.15.49:0/524782351 conn(0x7f26a4070590 msgr2=0x7f26a4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.794+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 shutdown_connections 2024-02-22T00:53:11.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.794+0000 7f26ac084700 1 -- 172.21.15.49:0/524782351 wait complete. 2024-02-22T00:53:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 -- 172.21.15.49:0/55974502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 msgr2=0x7f9d900fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 --2- 172.21.15.49:0/55974502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 0x7f9d900fdcf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f9d8c0047f0 tx=0x7f9d8c009cb0).stop 2024-02-22T00:53:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 -- 172.21.15.49:0/55974502 shutdown_connections 2024-02-22T00:53:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 --2- 172.21.15.49:0/55974502 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d900fe270 0x7f9d900f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 --2- 172.21.15.49:0/55974502 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 0x7f9d900fdcf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 -- 172.21.15.49:0/55974502 >> 172.21.15.49:0/55974502 conn(0x7f9d900f3530 msgr2=0x7f9d900f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 -- 172.21.15.49:0/55974502 shutdown_connections 2024-02-22T00:53:11.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 -- 172.21.15.49:0/55974502 wait complete. 2024-02-22T00:53:11.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 Processor -- start 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.895+0000 7f9d97e46700 1 -- start start 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d97e46700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 0x7f9d9010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d97e46700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d900fe270 0x7f9d9010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d97e46700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9010ead0 con 0x7f9d900fd910 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d97e46700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9010ec10 con 0x7f9d900fe270 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d95be2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 0x7f9d9010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d95be2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 0x7f9d9010dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39534/0 (socket says 172.21.15.49:39534) 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d95be2700 1 -- 172.21.15.49:0/2281407845 learned_addr learned my addr 172.21.15.49:0/2281407845 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d953e1700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d900fe270 0x7f9d9010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d95be2700 1 -- 172.21.15.49:0/2281407845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d900fe270 msgr2=0x7f9d9010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d95be2700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d900fe270 0x7f9d9010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d95be2700 1 -- 172.21.15.49:0/2281407845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c005040 con 0x7f9d900fd910 2024-02-22T00:53:11.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d95be2700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 0x7f9d9010dfe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f9d8c013640 tx=0x7f9d8c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d86ffd700 1 -- 172.21.15.49:0/2281407845 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d8c00e030 con 0x7f9d900fd910 2024-02-22T00:53:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d86ffd700 1 -- 172.21.15.49:0/2281407845 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d8c007e90 con 0x7f9d900fd910 2024-02-22T00:53:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d90108240 con 0x7f9d900fd910 2024-02-22T00:53:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d86ffd700 1 -- 172.21.15.49:0/2281407845 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d8c018070 con 0x7f9d900fd910 2024-02-22T00:53:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.896+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d901087a0 con 0x7f9d900fd910 2024-02-22T00:53:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.897+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9005f570 con 0x7f9d900fd910 2024-02-22T00:53:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.898+0000 7f9d86ffd700 1 -- 172.21.15.49:0/2281407845 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9d8c01d420 con 0x7f9d900fd910 2024-02-22T00:53:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.898+0000 7f9d86ffd700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d7c06cab0 0x7f9d7c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.898+0000 7f9d86ffd700 1 -- 172.21.15.49:0/2281407845 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9d8c08d270 con 0x7f9d900fd910 2024-02-22T00:53:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.898+0000 7f9d953e1700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d7c06cab0 0x7f9d7c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.899+0000 7f9d953e1700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d7c06cab0 0x7f9d7c06ef70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9d90109920 tx=0x7f9d80009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:11.903+0000 7f9d86ffd700 1 -- 172.21.15.49:0/2281407845 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9d8c05add0 con 0x7f9d900fd910 2024-02-22T00:53:12.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.141+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9d90109760 con 0x7f9d900fd910 2024-02-22T00:53:12.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.141+0000 7f9d86ffd700 1 -- 172.21.15.49:0/2281407845 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f9d8c05a960 con 0x7f9d900fd910 2024-02-22T00:53:12.144 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:53:12.144 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:53:12.144 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:53:12.144 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:53:12.145 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:53:12.146 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:53:12.146 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:53:12.146 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:53:12.146 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:53:12.146 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:53:12.146 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:53:12.146 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:53:12.147 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:53:12.148 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:53:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d7c06cab0 msgr2=0x7f9d7c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d7c06cab0 0x7f9d7c06ef70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9d90109920 tx=0x7f9d80009040).stop 2024-02-22T00:53:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 msgr2=0x7f9d9010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 0x7f9d9010dfe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f9d8c013640 tx=0x7f9d8c009cb0).stop 2024-02-22T00:53:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 shutdown_connections 2024-02-22T00:53:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d7c06cab0 0x7f9d7c06ef70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d900fd910 0x7f9d9010dfe0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 --2- 172.21.15.49:0/2281407845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d900fe270 0x7f9d9010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 >> 172.21.15.49:0/2281407845 conn(0x7f9d900f3530 msgr2=0x7f9d900fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:12.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 shutdown_connections 2024-02-22T00:53:12.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.144+0000 7f9d97e46700 1 -- 172.21.15.49:0/2281407845 wait complete. 2024-02-22T00:53:12.150 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:53:12.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.247+0000 7ffa3ba40700 1 -- 172.21.15.49:0/3957948265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 msgr2=0x7ffa340f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.247+0000 7ffa3ba40700 1 --2- 172.21.15.49:0/3957948265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 0x7ffa340f7a50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7ffa280047f0 tx=0x7ffa28009cb0).stop 2024-02-22T00:53:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.247+0000 7ffa3ba40700 1 -- 172.21.15.49:0/3957948265 shutdown_connections 2024-02-22T00:53:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.247+0000 7ffa3ba40700 1 --2- 172.21.15.49:0/3957948265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 0x7ffa340f7a50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.247+0000 7ffa3ba40700 1 --2- 172.21.15.49:0/3957948265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa340fd910 0x7ffa340fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:53:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.247+0000 7ffa3ba40700 1 -- 172.21.15.49:0/3957948265 >> 172.21.15.49:0/3957948265 conn(0x7ffa340f3530 msgr2=0x7ffa340f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.247+0000 7ffa3ba40700 1 -- 172.21.15.49:0/3957948265 shutdown_connections 2024-02-22T00:53:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.247+0000 7ffa3ba40700 1 -- 172.21.15.49:0/3957948265 wait complete. 2024-02-22T00:53:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.248+0000 7ffa3ba40700 1 Processor -- start 2024-02-22T00:53:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.248+0000 7ffa3ba40700 1 -- start start 2024-02-22T00:53:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.248+0000 7ffa3ba40700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa340fd910 0x7ffa3410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.248+0000 7ffa3ba40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 0x7ffa3410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.248+0000 7ffa3ba40700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3410ebe0 con 0x7ffa340fe270 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.248+0000 7ffa3ba40700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34108200 con 0x7ffa340fd910 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa38fdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 0x7ffa3410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa38fdb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 0x7ffa3410e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39556/0 (socket says 172.21.15.49:39556) 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa38fdb700 1 -- 172.21.15.49:0/1969054820 learned_addr learned my addr 172.21.15.49:0/1969054820 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa397dc700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa340fd910 0x7ffa3410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa38fdb700 1 -- 172.21.15.49:0/1969054820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa340fd910 msgr2=0x7ffa3410e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa38fdb700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa340fd910 0x7ffa3410e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa38fdb700 1 -- 172.21.15.49:0/1969054820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28005040 con 0x7ffa340fe270 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa38fdb700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 0x7ffa3410e550 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ffa280099f0 tx=0x7ffa28009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa267fc700 1 -- 172.21.15.49:0/1969054820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa2800e030 con 0x7ffa340fe270 2024-02-22T00:53:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa267fc700 1 -- 172.21.15.49:0/1969054820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa28007e90 con 0x7ffa340fe270 2024-02-22T00:53:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa267fc700 1 -- 172.21.15.49:0/1969054820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa28018070 con 0x7ffa340fe270 2024-02-22T00:53:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34108450 con 0x7ffa340fe270 2024-02-22T00:53:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.249+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa34108930 con 0x7ffa340fe270 2024-02-22T00:53:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.250+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3405f570 con 0x7ffa340fe270 2024-02-22T00:53:12.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.251+0000 7ffa267fc700 1 -- 172.21.15.49:0/1969054820 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffa2801d420 con 0x7ffa340fe270 2024-02-22T00:53:12.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.251+0000 7ffa267fc700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa2006caa0 0x7ffa2006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:12.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.251+0000 7ffa267fc700 1 -- 172.21.15.49:0/1969054820 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ffa2808d1c0 con 0x7ffa340fe270 2024-02-22T00:53:12.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.251+0000 7ffa397dc700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa2006caa0 0x7ffa2006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:12.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.252+0000 7ffa397dc700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa2006caa0 0x7ffa2006ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ffa3000b910 tx=0x7ffa30008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:12.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.256+0000 7ffa267fc700 1 -- 172.21.15.49:0/1969054820 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffa2805ad20 con 0x7ffa340fe270 2024-02-22T00:53:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.471+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa34109750 con 0x7ffa2006caa0 2024-02-22T00:53:12.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.472+0000 7ffa267fc700 1 -- 172.21.15.49:0/1969054820 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ffa34109750 con 0x7ffa2006caa0 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:53:12.475 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:53:12.476 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:53:12.476 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:53:12.476 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:53:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.474+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa2006caa0 msgr2=0x7ffa2006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.474+0000 7ffa3ba40700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa2006caa0 0x7ffa2006ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ffa3000b910 tx=0x7ffa30008040).stop 2024-02-22T00:53:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.474+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 msgr2=0x7ffa3410e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.474+0000 7ffa3ba40700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 0x7ffa3410e550 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7ffa280099f0 tx=0x7ffa28009cb0).stop 2024-02-22T00:53:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.475+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 shutdown_connections 2024-02-22T00:53:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.475+0000 7ffa3ba40700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffa2006caa0 0x7ffa2006ef60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.475+0000 7ffa3ba40700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa340fd910 0x7ffa3410e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.475+0000 7ffa3ba40700 1 --2- 172.21.15.49:0/1969054820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa340fe270 0x7ffa3410e550 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.475+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 >> 172.21.15.49:0/1969054820 conn(0x7ffa340f3530 msgr2=0x7ffa340fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.475+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 shutdown_connections 2024-02-22T00:53:12.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.475+0000 7ffa3ba40700 1 -- 172.21.15.49:0/1969054820 wait complete. 2024-02-22T00:53:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:12 smithi161 ceph-mon[113442]: pgmap v488: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:12 smithi161 ceph-mon[113442]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:12 smithi161 ceph-mon[113442]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:12 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/524782351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:53:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:12 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2281407845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:53:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.576+0000 7f5b08a18700 1 -- 172.21.15.49:0/682423547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 msgr2=0x7f5b040f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.576+0000 7f5b08a18700 1 --2- 172.21.15.49:0/682423547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 0x7f5b040f6930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f5af80047f0 tx=0x7f5af8009cb0).stop 2024-02-22T00:53:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.577+0000 7f5b08a18700 1 -- 172.21.15.49:0/682423547 shutdown_connections 2024-02-22T00:53:12.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.577+0000 7f5b08a18700 1 --2- 172.21.15.49:0/682423547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 0x7f5b040f6930 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.577+0000 7f5b08a18700 1 --2- 172.21.15.49:0/682423547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b040fc7f0 0x7f5b040fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.577+0000 7f5b08a18700 1 -- 172.21.15.49:0/682423547 >> 172.21.15.49:0/682423547 conn(0x7f5b04070590 msgr2=0x7f5b040f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.577+0000 7f5b08a18700 1 -- 172.21.15.49:0/682423547 shutdown_connections 2024-02-22T00:53:12.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.577+0000 7f5b08a18700 1 -- 172.21.15.49:0/682423547 wait complete. 2024-02-22T00:53:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.577+0000 7f5b08a18700 1 Processor -- start 2024-02-22T00:53:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b08a18700 1 -- start start 2024-02-22T00:53:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b08a18700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b040fc7f0 0x7f5b0410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b08a18700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 0x7f5b0410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b08a18700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0410eab0 con 0x7f5b040fd150 2024-02-22T00:53:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b08a18700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0410ebf0 con 0x7f5b040fc7f0 2024-02-22T00:53:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b01d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 0x7f5b0410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:12.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b01d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 0x7f5b0410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39564/0 (socket says 172.21.15.49:39564) 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b01d9b700 1 -- 172.21.15.49:0/3898058944 learned_addr learned my addr 172.21.15.49:0/3898058944 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b0259c700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b040fc7f0 0x7f5b0410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b01d9b700 1 -- 172.21.15.49:0/3898058944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b040fc7f0 msgr2=0x7f5b0410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b01d9b700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b040fc7f0 0x7f5b0410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b01d9b700 1 -- 172.21.15.49:0/3898058944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8005040 con 0x7f5b040fd150 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b0259c700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b040fc7f0 0x7f5b0410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.578+0000 7f5b01d9b700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 0x7f5b0410e4b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f5af80099f0 tx=0x7f5af8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.579+0000 7f5af37fe700 1 -- 172.21.15.49:0/3898058944 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5af800e030 con 0x7f5b040fd150 2024-02-22T00:53:12.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.579+0000 7f5af37fe700 1 -- 172.21.15.49:0/3898058944 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5af8007e90 con 0x7f5b040fd150 2024-02-22T00:53:12.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.579+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b04108220 con 0x7f5b040fd150 2024-02-22T00:53:12.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.579+0000 7f5af37fe700 1 -- 172.21.15.49:0/3898058944 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5af8018070 con 0x7f5b040fd150 2024-02-22T00:53:12.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.579+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b04108780 con 0x7f5b040fd150 2024-02-22T00:53:12.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.579+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0405f590 con 0x7f5b040fd150 2024-02-22T00:53:12.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.580+0000 7f5af37fe700 1 -- 172.21.15.49:0/3898058944 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5af8009590 con 0x7f5b040fd150 2024-02-22T00:53:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.581+0000 7f5af37fe700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5aec06ca30 0x7f5aec06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.581+0000 7f5af37fe700 1 -- 172.21.15.49:0/3898058944 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5af808d040 con 0x7f5b040fd150 2024-02-22T00:53:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.581+0000 7f5b0259c700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5aec06ca30 0x7f5aec06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:12.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.581+0000 7f5b0259c700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5aec06ca30 0x7f5aec06eef0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f5af4004c80 tx=0x7f5af400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:12.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.585+0000 7f5af37fe700 1 -- 172.21.15.49:0/3898058944 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5af805aba0 con 0x7f5b040fd150 2024-02-22T00:53:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:12 smithi049 ceph-mon[132694]: pgmap v488: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:12 smithi049 ceph-mon[132694]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:12 smithi049 ceph-mon[132694]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:12 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/524782351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:53:12.679 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:12 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2281407845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:53:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.867+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5b04047540 con 0x7f5b040fd150 2024-02-22T00:53:12.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.867+0000 7f5af37fe700 1 -- 172.21.15.49:0/3898058944 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f5af805a730 con 0x7f5b040fd150 2024-02-22T00:53:12.869 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:53:12.869 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:53:12.870 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:53:12.870 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:53:12.870 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:53:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5aec06ca30 msgr2=0x7f5aec06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5aec06ca30 0x7f5aec06eef0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f5af4004c80 tx=0x7f5af400b040).stop 2024-02-22T00:53:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 msgr2=0x7f5b0410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 0x7f5b0410e4b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f5af80099f0 tx=0x7f5af8009cb0).stop 2024-02-22T00:53:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 shutdown_connections 2024-02-22T00:53:12.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5aec06ca30 0x7f5aec06eef0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b040fc7f0 0x7f5b0410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 --2- 172.21.15.49:0/3898058944 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b040fd150 0x7f5b0410e4b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:12.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 >> 172.21.15.49:0/3898058944 conn(0x7f5b04070590 msgr2=0x7f5b04060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:12.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 shutdown_connections 2024-02-22T00:53:12.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:12.869+0000 7f5b08a18700 1 -- 172.21.15.49:0/3898058944 wait complete. 2024-02-22T00:53:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:13 smithi161 ceph-mon[113442]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:13.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:53:13.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:13 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3898058944' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:53:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:13 smithi049 ceph-mon[132694]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:53:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:13 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3898058944' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:53:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:14 smithi161 ceph-mon[113442]: from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:14 smithi161 ceph-mon[113442]: pgmap v489: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:14 smithi049 ceph-mon[132694]: from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:14 smithi049 ceph-mon[132694]: pgmap v489: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:16 smithi161 ceph-mon[113442]: pgmap v490: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:16.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:16 smithi049 ceph-mon[132694]: pgmap v490: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:18 smithi161 ceph-mon[113442]: pgmap v491: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:18.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:18 smithi049 ceph-mon[132694]: pgmap v491: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:20 smithi161 ceph-mon[113442]: pgmap v492: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:20 smithi049 ceph-mon[132694]: pgmap v492: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:22 smithi161 ceph-mon[113442]: pgmap v493: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:22 smithi049 ceph-mon[132694]: pgmap v493: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:24 smithi161 ceph-mon[113442]: pgmap v494: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:24.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:24 smithi049 ceph-mon[132694]: pgmap v494: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:26 smithi161 ceph-mon[113442]: pgmap v495: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:26.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:26 smithi049 ceph-mon[132694]: pgmap v495: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:28 smithi161 ceph-mon[113442]: pgmap v496: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:53:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:28 smithi049 ceph-mon[132694]: pgmap v496: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:53:30.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:30 smithi161 ceph-mon[113442]: pgmap v497: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:30.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:30 smithi049 ceph-mon[132694]: pgmap v497: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:32 smithi161 ceph-mon[113442]: pgmap v498: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:32.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:32 smithi049 ceph-mon[132694]: pgmap v498: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:34 smithi161 ceph-mon[113442]: pgmap v499: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:34.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:34 smithi049 ceph-mon[132694]: pgmap v499: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:36 smithi161 ceph-mon[113442]: pgmap v500: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:36.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:36 smithi049 ceph-mon[132694]: pgmap v500: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:38.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:38 smithi161 ceph-mon[113442]: pgmap v501: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:38.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:38 smithi049 ceph-mon[132694]: pgmap v501: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:40 smithi161 ceph-mon[113442]: pgmap v502: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:40.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:40 smithi049 ceph-mon[132694]: pgmap v502: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:42 smithi161 ceph-mon[113442]: pgmap v503: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:42.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:42 smithi049 ceph-mon[132694]: pgmap v503: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.985+0000 7f02cced5700 1 -- 172.21.15.49:0/1876274563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 msgr2=0x7f02c80f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.985+0000 7f02cced5700 1 --2- 172.21.15.49:0/1876274563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 0x7f02c80f8c80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f02b80047f0 tx=0x7f02b8009cb0).stop 2024-02-22T00:53:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.985+0000 7f02cced5700 1 -- 172.21.15.49:0/1876274563 shutdown_connections 2024-02-22T00:53:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.985+0000 7f02cced5700 1 --2- 172.21.15.49:0/1876274563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c80f9200 0x7f02c8101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.985+0000 7f02cced5700 1 --2- 172.21.15.49:0/1876274563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 0x7f02c80f8c80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.985+0000 7f02cced5700 1 -- 172.21.15.49:0/1876274563 >> 172.21.15.49:0/1876274563 conn(0x7f02c8070590 msgr2=0x7f02c80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:42.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.985+0000 7f02cced5700 1 -- 172.21.15.49:0/1876274563 shutdown_connections 2024-02-22T00:53:42.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.986+0000 7f02cced5700 1 -- 172.21.15.49:0/1876274563 wait complete. 2024-02-22T00:53:42.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02cced5700 1 Processor -- start 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02cced5700 1 -- start start 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02cced5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 0x7f02c810e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02cced5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c80f9200 0x7f02c810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02cced5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c810eb30 con 0x7f02c80f88a0 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02cced5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c810ec70 con 0x7f02c80f9200 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02c659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 0x7f02c810e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02c659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 0x7f02c810e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43502/0 (socket says 172.21.15.49:43502) 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02c659c700 1 -- 172.21.15.49:0/313332797 learned_addr learned my addr 172.21.15.49:0/313332797 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02c5d9b700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c80f9200 0x7f02c810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02c659c700 1 -- 172.21.15.49:0/313332797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c80f9200 msgr2=0x7f02c810e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.987+0000 7f02c659c700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c80f9200 0x7f02c810e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.988+0000 7f02c659c700 1 -- 172.21.15.49:0/313332797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8005040 con 0x7f02c80f88a0 2024-02-22T00:53:42.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.988+0000 7f02c5d9b700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c80f9200 0x7f02c810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:53:42.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.988+0000 7f02c659c700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 0x7f02c810e040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f02b800b120 tx=0x7f02b8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:42.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.988+0000 7f02b77fe700 1 -- 172.21.15.49:0/313332797 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02b800e030 con 0x7f02c80f88a0 2024-02-22T00:53:42.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.988+0000 7f02b77fe700 1 -- 172.21.15.49:0/313332797 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02b8007e90 con 0x7f02c80f88a0 2024-02-22T00:53:42.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.988+0000 7f02b77fe700 1 -- 172.21.15.49:0/313332797 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02b8018070 con 0x7f02c80f88a0 2024-02-22T00:53:42.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.988+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c81082a0 con 0x7f02c80f88a0 2024-02-22T00:53:42.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.988+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c8108780 con 0x7f02c80f88a0 2024-02-22T00:53:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.989+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c805f590 con 0x7f02c80f88a0 2024-02-22T00:53:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.989+0000 7f02b77fe700 1 -- 172.21.15.49:0/313332797 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f02b801d420 con 0x7f02c80f88a0 2024-02-22T00:53:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.990+0000 7f02b77fe700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02b006caa0 0x7f02b006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.990+0000 7f02b77fe700 1 -- 172.21.15.49:0/313332797 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f02b808d270 con 0x7f02c80f88a0 2024-02-22T00:53:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.990+0000 7f02c5d9b700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02b006caa0 0x7f02b006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:42.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.990+0000 7f02c5d9b700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02b006caa0 0x7f02b006ef60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f02c8109980 tx=0x7f02bc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:42.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:42.994+0000 7f02b77fe700 1 -- 172.21.15.49:0/313332797 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f02b805add0 con 0x7f02c80f88a0 2024-02-22T00:53:43.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.214+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02c80fedd0 con 0x7f02b006caa0 2024-02-22T00:53:43.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.215+0000 7f02b77fe700 1 -- 172.21.15.49:0/313332797 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f02c80fedd0 con 0x7f02b006caa0 2024-02-22T00:53:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02b006caa0 msgr2=0x7f02b006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02b006caa0 0x7f02b006ef60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f02c8109980 tx=0x7f02bc009040).stop 2024-02-22T00:53:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 msgr2=0x7f02c810e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 0x7f02c810e040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f02b800b120 tx=0x7f02b8009cb0).stop 2024-02-22T00:53:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 shutdown_connections 2024-02-22T00:53:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02b006caa0 0x7f02b006ef60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02c80f88a0 0x7f02c810e040 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 --2- 172.21.15.49:0/313332797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02c80f9200 0x7f02c810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 >> 172.21.15.49:0/313332797 conn(0x7f02c8070590 msgr2=0x7f02c80fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 shutdown_connections 2024-02-22T00:53:43.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.218+0000 7f02cced5700 1 -- 172.21.15.49:0/313332797 wait complete. 2024-02-22T00:53:43.230 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:53:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.323+0000 7fc715130700 1 -- 172.21.15.49:0/3724855745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 msgr2=0x7fc7100f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.323+0000 7fc715130700 1 --2- 172.21.15.49:0/3724855745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 0x7fc7100f8ce0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fc7000047f0 tx=0x7fc700009cb0).stop 2024-02-22T00:53:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.323+0000 7fc715130700 1 -- 172.21.15.49:0/3724855745 shutdown_connections 2024-02-22T00:53:43.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.323+0000 7fc715130700 1 --2- 172.21.15.49:0/3724855745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7100f9260 0x7fc710101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:53:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.323+0000 7fc715130700 1 --2- 172.21.15.49:0/3724855745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 0x7fc7100f8ce0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.323+0000 7fc715130700 1 -- 172.21.15.49:0/3724855745 >> 172.21.15.49:0/3724855745 conn(0x7fc710070590 msgr2=0x7fc7100f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.323+0000 7fc715130700 1 -- 172.21.15.49:0/3724855745 shutdown_connections 2024-02-22T00:53:43.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.323+0000 7fc715130700 1 -- 172.21.15.49:0/3724855745 wait complete. 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc715130700 1 Processor -- start 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc715130700 1 -- start start 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc715130700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 0x7fc71010e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc715130700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7100f9260 0x7fc71010e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc715130700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71010ebc0 con 0x7fc7100f8900 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc715130700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101081e0 con 0x7fc7100f9260 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc70ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 0x7fc71010e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc70ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 0x7fc71010e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43508/0 (socket says 172.21.15.49:43508) 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.324+0000 7fc70ed9d700 1 -- 172.21.15.49:0/3639609159 learned_addr learned my addr 172.21.15.49:0/3639609159 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc70e59c700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7100f9260 0x7fc71010e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc70ed9d700 1 -- 172.21.15.49:0/3639609159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7100f9260 msgr2=0x7fc71010e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc70ed9d700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7100f9260 0x7fc71010e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc70ed9d700 1 -- 172.21.15.49:0/3639609159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700005040 con 0x7fc7100f8900 2024-02-22T00:53:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc70ed9d700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 0x7fc71010e040 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fc700009310 tx=0x7fc700009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc707fff700 1 -- 172.21.15.49:0/3639609159 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70000e030 con 0x7fc7100f8900 2024-02-22T00:53:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc710108430 con 0x7fc7100f8900 2024-02-22T00:53:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc707fff700 1 -- 172.21.15.49:0/3639609159 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc700007e90 con 0x7fc7100f8900 2024-02-22T00:53:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc707fff700 1 -- 172.21.15.49:0/3639609159 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc700018070 con 0x7fc7100f8900 2024-02-22T00:53:43.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.325+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc710108910 con 0x7fc7100f8900 2024-02-22T00:53:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.326+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71005f590 con 0x7fc7100f8900 2024-02-22T00:53:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.327+0000 7fc707fff700 1 -- 172.21.15.49:0/3639609159 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc70001d420 con 0x7fc7100f8900 2024-02-22T00:53:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.327+0000 7fc707fff700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc6fc06caa0 0x7fc6fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.327+0000 7fc707fff700 1 -- 172.21.15.49:0/3639609159 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc70008d290 con 0x7fc7100f8900 2024-02-22T00:53:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.327+0000 7fc70e59c700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc6fc06caa0 0x7fc6fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.328+0000 7fc70e59c700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc6fc06caa0 0x7fc6fc06ef60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc710109980 tx=0x7fc6f8008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:43.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.332+0000 7fc707fff700 1 -- 172.21.15.49:0/3639609159 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc70005adf0 con 0x7fc7100f8900 2024-02-22T00:53:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:53:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.546+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc710109790 con 0x7fc6fc06caa0 2024-02-22T00:53:43.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.548+0000 7fc707fff700 1 -- 172.21.15.49:0/3639609159 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc710109790 con 0x7fc6fc06caa0 2024-02-22T00:53:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc6fc06caa0 msgr2=0x7fc6fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc6fc06caa0 0x7fc6fc06ef60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc710109980 tx=0x7fc6f8008040).stop 2024-02-22T00:53:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 msgr2=0x7fc71010e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 0x7fc71010e040 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fc700009310 tx=0x7fc700009cb0).stop 2024-02-22T00:53:43.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 shutdown_connections 2024-02-22T00:53:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc6fc06caa0 0x7fc6fc06ef60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7100f8900 0x7fc71010e040 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 --2- 172.21.15.49:0/3639609159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7100f9260 0x7fc71010e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 >> 172.21.15.49:0/3639609159 conn(0x7fc710070590 msgr2=0x7fc7100fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 shutdown_connections 2024-02-22T00:53:43.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.550+0000 7fc715130700 1 -- 172.21.15.49:0/3639609159 wait complete. 2024-02-22T00:53:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 -- 172.21.15.49:0/1712587649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b110 msgr2=0x7ff76006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 --2- 172.21.15.49:0/1712587649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b110 0x7ff76006b4f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7ff7500047f0 tx=0x7ff750009cb0).stop 2024-02-22T00:53:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 -- 172.21.15.49:0/1712587649 shutdown_connections 2024-02-22T00:53:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 --2- 172.21.15.49:0/1712587649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff76006b9e0 0x7ff760103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 --2- 172.21.15.49:0/1712587649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b110 0x7ff76006b4f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 -- 172.21.15.49:0/1712587649 >> 172.21.15.49:0/1712587649 conn(0x7ff7600f3550 msgr2=0x7ff7600f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 -- 172.21.15.49:0/1712587649 shutdown_connections 2024-02-22T00:53:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 -- 172.21.15.49:0/1712587649 wait complete. 2024-02-22T00:53:43.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.652+0000 7ff765785700 1 Processor -- start 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff765785700 1 -- start start 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff765785700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff76006b110 0x7ff760110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff765785700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b9e0 0x7ff760110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff765785700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760110d00 con 0x7ff76006b9e0 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff765785700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760110e40 con 0x7ff76006b110 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b9e0 0x7ff760110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75e7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b9e0 0x7ff760110700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43532/0 (socket says 172.21.15.49:43532) 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75e7fc700 1 -- 172.21.15.49:0/1666978903 learned_addr learned my addr 172.21.15.49:0/1666978903 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75effd700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff76006b110 0x7ff760110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75e7fc700 1 -- 172.21.15.49:0/1666978903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff76006b110 msgr2=0x7ff760110210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75e7fc700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff76006b110 0x7ff760110210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75e7fc700 1 -- 172.21.15.49:0/1666978903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750005040 con 0x7ff76006b9e0 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75effd700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff76006b110 0x7ff760110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:53:43.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff75e7fc700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b9e0 0x7ff760110700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7ff7540041d0 tx=0x7ff754009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:43.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff747fff700 1 -- 172.21.15.49:0/1666978903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff754007b40 con 0x7ff76006b9e0 2024-02-22T00:53:43.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.653+0000 7ff747fff700 1 -- 172.21.15.49:0/1666978903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff75400f040 con 0x7ff76006b9e0 2024-02-22T00:53:43.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.654+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76010a4d0 con 0x7ff76006b9e0 2024-02-22T00:53:43.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.654+0000 7ff747fff700 1 -- 172.21.15.49:0/1666978903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff75400d800 con 0x7ff76006b9e0 2024-02-22T00:53:43.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.654+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76010aa10 con 0x7ff76006b9e0 2024-02-22T00:53:43.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.655+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff760060390 con 0x7ff76006b9e0 2024-02-22T00:53:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.656+0000 7ff747fff700 1 -- 172.21.15.49:0/1666978903 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff754007ca0 con 0x7ff76006b9e0 2024-02-22T00:53:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.656+0000 7ff747fff700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff74806caa0 0x7ff74806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.656+0000 7ff747fff700 1 -- 172.21.15.49:0/1666978903 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff75408b860 con 0x7ff76006b9e0 2024-02-22T00:53:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.657+0000 7ff75effd700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff74806caa0 0x7ff74806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.657+0000 7ff75effd700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff74806caa0 0x7ff74806ef60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff7500043d0 tx=0x7ff75000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:43.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.660+0000 7ff747fff700 1 -- 172.21.15.49:0/1666978903 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff754059380 con 0x7ff76006b9e0 2024-02-22T00:53:43.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:53:43.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.867+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff76010ace0 con 0x7ff74806caa0 2024-02-22T00:53:43.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.877+0000 7ff747fff700 1 -- 172.21.15.49:0/1666978903 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7ff76010ace0 con 0x7ff74806caa0 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (16m) 10m ago 28m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (14m) 10m ago 28m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (14m) 10m ago 27m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (16m) 10m ago 27m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (10m) 10m ago 22m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (11m) 10m ago 23m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (10m) 10m ago 22m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (10m) 10m ago 22m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (18m) 10m ago 29m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (17m) 10m ago 27m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (15m) 10m ago 29m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:53:43.880 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (15m) 10m ago 27m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (17m) 10m ago 27m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (17m) 10m ago 27m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (14m) 10m ago 26m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (13m) 10m ago 26m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (13m) 10m ago 25m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (12m) 10m ago 25m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (12m) 10m ago 24m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (11m) 10m ago 24m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:53:43.881 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (17m) 10m ago 27m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:53:43.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff74806caa0 msgr2=0x7ff74806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff74806caa0 0x7ff74806ef60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7ff7500043d0 tx=0x7ff75000b040).stop 2024-02-22T00:53:43.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b9e0 msgr2=0x7ff760110700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b9e0 0x7ff760110700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7ff7540041d0 tx=0x7ff754009f60).stop 2024-02-22T00:53:43.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 shutdown_connections 2024-02-22T00:53:43.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff74806caa0 0x7ff74806ef60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff76006b110 0x7ff760110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 --2- 172.21.15.49:0/1666978903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff76006b9e0 0x7ff760110700 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 >> 172.21.15.49:0/1666978903 conn(0x7ff7600f3550 msgr2=0x7ff7600fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:43.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 shutdown_connections 2024-02-22T00:53:43.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.879+0000 7ff765785700 1 -- 172.21.15.49:0/1666978903 wait complete. 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.980+0000 7fb92eddd700 1 -- 172.21.15.49:0/2949971547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 msgr2=0x7fb9280f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.980+0000 7fb92eddd700 1 --2- 172.21.15.49:0/2949971547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 0x7fb9280f6930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fb9140047f0 tx=0x7fb914009cb0).stop 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.980+0000 7fb92eddd700 1 -- 172.21.15.49:0/2949971547 shutdown_connections 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.980+0000 7fb92eddd700 1 --2- 172.21.15.49:0/2949971547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 0x7fb9280f6930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.980+0000 7fb92eddd700 1 --2- 172.21.15.49:0/2949971547 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9280fc7f0 0x7fb9280fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.980+0000 7fb92eddd700 1 -- 172.21.15.49:0/2949971547 >> 172.21.15.49:0/2949971547 conn(0x7fb928070590 msgr2=0x7fb9280f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.980+0000 7fb92eddd700 1 -- 172.21.15.49:0/2949971547 shutdown_connections 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.980+0000 7fb92eddd700 1 -- 172.21.15.49:0/2949971547 wait complete. 2024-02-22T00:53:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb92eddd700 1 Processor -- start 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb92eddd700 1 -- start start 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb92eddd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9280fc7f0 0x7fb92810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb92eddd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 0x7fb92810e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb92eddd700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92810eab0 con 0x7fb9280fd150 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb92eddd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92810ebf0 con 0x7fb9280fc7f0 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb927fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 0x7fb92810e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb927fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 0x7fb92810e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43548/0 (socket says 172.21.15.49:43548) 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb927fff700 1 -- 172.21.15.49:0/1558869039 learned_addr learned my addr 172.21.15.49:0/1558869039 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb92cb79700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9280fc7f0 0x7fb92810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb927fff700 1 -- 172.21.15.49:0/1558869039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9280fc7f0 msgr2=0x7fb92810dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb927fff700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9280fc7f0 0x7fb92810dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb927fff700 1 -- 172.21.15.49:0/1558869039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914005040 con 0x7fb9280fd150 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb927fff700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 0x7fb92810e4b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fb9140099f0 tx=0x7fb914009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.981+0000 7fb925ffb700 1 -- 172.21.15.49:0/1558869039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb91400e030 con 0x7fb9280fd150 2024-02-22T00:53:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.982+0000 7fb925ffb700 1 -- 172.21.15.49:0/1558869039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb914007e90 con 0x7fb9280fd150 2024-02-22T00:53:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.982+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb928108220 con 0x7fb9280fd150 2024-02-22T00:53:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.982+0000 7fb925ffb700 1 -- 172.21.15.49:0/1558869039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb914018070 con 0x7fb9280fd150 2024-02-22T00:53:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.982+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb928108780 con 0x7fb9280fd150 2024-02-22T00:53:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.983+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92805f590 con 0x7fb9280fd150 2024-02-22T00:53:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.983+0000 7fb925ffb700 1 -- 172.21.15.49:0/1558869039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb9140094c0 con 0x7fb9280fd150 2024-02-22T00:53:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.984+0000 7fb925ffb700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb91806caa0 0x7fb91806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.984+0000 7fb925ffb700 1 -- 172.21.15.49:0/1558869039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb91408cf60 con 0x7fb9280fd150 2024-02-22T00:53:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.984+0000 7fb92cb79700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb91806caa0 0x7fb91806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.984+0000 7fb92cb79700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb91806caa0 0x7fb91806ef60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb91c004dc0 tx=0x7fb91c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:43.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:43.988+0000 7fb925ffb700 1 -- 172.21.15.49:0/1558869039 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb9140c0190 con 0x7fb9280fd150 2024-02-22T00:53:44.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.271+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb928108e10 con 0x7fb9280fd150 2024-02-22T00:53:44.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.272+0000 7fb925ffb700 1 -- 172.21.15.49:0/1558869039 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fb91405a830 con 0x7fb9280fd150 2024-02-22T00:53:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:53:44.274 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:53:44.274 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:53:44.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:53:44.274 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:53:44.274 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:53:44.275 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:53:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb91806caa0 msgr2=0x7fb91806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb91806caa0 0x7fb91806ef60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fb91c004dc0 tx=0x7fb91c00b040).stop 2024-02-22T00:53:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 msgr2=0x7fb92810e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 0x7fb92810e4b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fb9140099f0 tx=0x7fb914009cb0).stop 2024-02-22T00:53:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 shutdown_connections 2024-02-22T00:53:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb91806caa0 0x7fb91806ef60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9280fc7f0 0x7fb92810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 --2- 172.21.15.49:0/1558869039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9280fd150 0x7fb92810e4b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 >> 172.21.15.49:0/1558869039 conn(0x7fb928070590 msgr2=0x7fb928060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 shutdown_connections 2024-02-22T00:53:44.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.274+0000 7fb92eddd700 1 -- 172.21.15.49:0/1558869039 wait complete. 2024-02-22T00:53:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 -- 172.21.15.49:0/918092247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 msgr2=0x7f4ae4103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 --2- 172.21.15.49:0/918092247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 0x7f4ae4103d60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f4acc004820 tx=0x7f4acc009cb0).stop 2024-02-22T00:53:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 -- 172.21.15.49:0/918092247 shutdown_connections 2024-02-22T00:53:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 --2- 172.21.15.49:0/918092247 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 0x7f4ae4103d60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 --2- 172.21.15.49:0/918092247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae40f66f0 0x7f4ae40f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 -- 172.21.15.49:0/918092247 >> 172.21.15.49:0/918092247 conn(0x7f4ae4070590 msgr2=0x7f4ae40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 -- 172.21.15.49:0/918092247 shutdown_connections 2024-02-22T00:53:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 -- 172.21.15.49:0/918092247 wait complete. 2024-02-22T00:53:44.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.376+0000 7f4aea086700 1 Processor -- start 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4aea086700 1 -- start start 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4aea086700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae40f66f0 0x7f4ae4110350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4aea086700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 0x7f4ae4110840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4aea086700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4110e40 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4aea086700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4110f80 con 0x7f4ae40f66f0 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 0x7f4ae4110840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 0x7f4ae4110840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43574/0 (socket says 172.21.15.49:43574) 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae2ffd700 1 -- 172.21.15.49:0/3265726744 learned_addr learned my addr 172.21.15.49:0/3265726744 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:44.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae2ffd700 1 -- 172.21.15.49:0/3265726744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae40f66f0 msgr2=0x7f4ae4110350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae37fe700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae40f66f0 0x7f4ae4110350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae2ffd700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae40f66f0 0x7f4ae4110350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae2ffd700 1 -- 172.21.15.49:0/3265726744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc005040 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae37fe700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae40f66f0 0x7f4ae4110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.377+0000 7f4ae2ffd700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 0x7f4ae4110840 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f4acc005010 tx=0x7f4acc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.378+0000 7f4ae0ff9700 1 -- 172.21.15.49:0/3265726744 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4acc00e030 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.378+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae410a5b0 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.378+0000 7f4ae0ff9700 1 -- 172.21.15.49:0/3265726744 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4acc007e90 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.378+0000 7f4ae0ff9700 1 -- 172.21.15.49:0/3265726744 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4acc018070 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.378+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae410aa90 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.379+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae405f590 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.379+0000 7f4ae0ff9700 1 -- 172.21.15.49:0/3265726744 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4acc01d420 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.380+0000 7f4ae0ff9700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ad006ca30 0x7f4ad006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.380+0000 7f4ae0ff9700 1 -- 172.21.15.49:0/3265726744 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4acc08d0a0 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.380+0000 7f4ae37fe700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ad006ca30 0x7f4ad006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:44.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.380+0000 7f4ae37fe700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ad006ca30 0x7f4ad006eef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4ad4004ca0 tx=0x7f4ad400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:44.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.384+0000 7f4ae0ff9700 1 -- 172.21.15.49:0/3265726744 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4acc05ac00 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:44 smithi161 ceph-mon[113442]: pgmap v504: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:44 smithi161 ceph-mon[113442]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:44 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1558869039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:53:44.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.631+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ae4047540 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.631+0000 7f4ae0ff9700 1 -- 172.21.15.49:0/3265726744 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f4acc004490 con 0x7f4ae40f6fc0 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:53:44.634 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:53:44.635 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:53:44.636 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:53:44.637 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:53:44.637 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:53:44.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ad006ca30 msgr2=0x7f4ad006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ad006ca30 0x7f4ad006eef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4ad4004ca0 tx=0x7f4ad400b040).stop 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 msgr2=0x7f4ae4110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 0x7f4ae4110840 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f4acc005010 tx=0x7f4acc009cb0).stop 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 shutdown_connections 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ad006ca30 0x7f4ad006eef0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ae40f66f0 0x7f4ae4110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 --2- 172.21.15.49:0/3265726744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ae40f6fc0 0x7f4ae4110840 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.633+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 >> 172.21.15.49:0/3265726744 conn(0x7f4ae4070590 msgr2=0x7f4ae406da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.634+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 shutdown_connections 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.634+0000 7f4aea086700 1 -- 172.21.15.49:0/3265726744 wait complete. 2024-02-22T00:53:44.638 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:53:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:44 smithi049 ceph-mon[132694]: pgmap v504: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:44 smithi049 ceph-mon[132694]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:44.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:44 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1558869039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:53:44.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 -- 172.21.15.49:0/3107754568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fe2d0 msgr2=0x7f24b40f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 --2- 172.21.15.49:0/3107754568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fe2d0 0x7f24b40f7ab0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f24a40047f0 tx=0x7f24a4009cb0).stop 2024-02-22T00:53:44.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 -- 172.21.15.49:0/3107754568 shutdown_connections 2024-02-22T00:53:44.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 --2- 172.21.15.49:0/3107754568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fe2d0 0x7f24b40f7ab0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 --2- 172.21.15.49:0/3107754568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b40fd970 0x7f24b40fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 -- 172.21.15.49:0/3107754568 >> 172.21.15.49:0/3107754568 conn(0x7f24b40f3550 msgr2=0x7f24b40f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:44.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 -- 172.21.15.49:0/3107754568 shutdown_connections 2024-02-22T00:53:44.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 -- 172.21.15.49:0/3107754568 wait complete. 2024-02-22T00:53:44.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.737+0000 7f24b92ce700 1 Processor -- start 2024-02-22T00:53:44.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b92ce700 1 -- start start 2024-02-22T00:53:44.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b92ce700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fd970 0x7f24b406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b92ce700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b40fe2d0 0x7f24b406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b92ce700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b406bab0 con 0x7f24b40fd970 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b92ce700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b406bbf0 con 0x7f24b40fe2d0 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fd970 0x7f24b406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b2ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fd970 0x7f24b406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43588/0 (socket says 172.21.15.49:43588) 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b2ffd700 1 -- 172.21.15.49:0/3772915820 learned_addr learned my addr 172.21.15.49:0/3772915820 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b27fc700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b40fe2d0 0x7f24b406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b2ffd700 1 -- 172.21.15.49:0/3772915820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b40fe2d0 msgr2=0x7f24b406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b2ffd700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b40fe2d0 0x7f24b406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b2ffd700 1 -- 172.21.15.49:0/3772915820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4005040 con 0x7f24b40fd970 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f24b2ffd700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fd970 0x7f24b406b0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f24a80041d0 tx=0x7f24a8009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.738+0000 7f249bfff700 1 -- 172.21.15.49:0/3772915820 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a8007b40 con 0x7f24b40fd970 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.739+0000 7f249bfff700 1 -- 172.21.15.49:0/3772915820 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f24a800f040 con 0x7f24b40fd970 2024-02-22T00:53:44.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.739+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b406bea0 con 0x7f24b40fd970 2024-02-22T00:53:44.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.739+0000 7f249bfff700 1 -- 172.21.15.49:0/3772915820 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24a80137d0 con 0x7f24b40fd970 2024-02-22T00:53:44.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.739+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b41146c0 con 0x7f24b40fd970 2024-02-22T00:53:44.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.739+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b4060370 con 0x7f24b40fd970 2024-02-22T00:53:44.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.740+0000 7f249bfff700 1 -- 172.21.15.49:0/3772915820 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f24a8007ca0 con 0x7f24b40fd970 2024-02-22T00:53:44.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.741+0000 7f249bfff700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f249c06caa0 0x7f249c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:44.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.741+0000 7f249bfff700 1 -- 172.21.15.49:0/3772915820 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f24a808b730 con 0x7f24b40fd970 2024-02-22T00:53:44.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.741+0000 7f24b27fc700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f249c06caa0 0x7f249c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:44.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.741+0000 7f24b27fc700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f249c06caa0 0x7f249c06ef60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f24b406c870 tx=0x7f24a400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:44.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.745+0000 7f249bfff700 1 -- 172.21.15.49:0/3772915820 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f24a8055800 con 0x7f24b40fd970 2024-02-22T00:53:44.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.961+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24b4059120 con 0x7f249c06caa0 2024-02-22T00:53:44.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.962+0000 7f249bfff700 1 -- 172.21.15.49:0/3772915820 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f24b4059120 con 0x7f249c06caa0 2024-02-22T00:53:44.964 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:53:44.964 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:53:44.964 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:53:44.964 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:53:44.964 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:53:44.965 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:53:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f249c06caa0 msgr2=0x7f249c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f249c06caa0 0x7f249c06ef60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f24b406c870 tx=0x7f24a400b040).stop 2024-02-22T00:53:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fd970 msgr2=0x7f24b406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:44.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fd970 0x7f24b406b0d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f24a80041d0 tx=0x7f24a8009f60).stop 2024-02-22T00:53:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 shutdown_connections 2024-02-22T00:53:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f249c06caa0 0x7f249c06ef60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b40fd970 0x7f24b406b0d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 --2- 172.21.15.49:0/3772915820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24b40fe2d0 0x7f24b406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 >> 172.21.15.49:0/3772915820 conn(0x7f24b40f3550 msgr2=0x7f24b40fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 shutdown_connections 2024-02-22T00:53:44.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:44.964+0000 7f24b92ce700 1 -- 172.21.15.49:0/3772915820 wait complete. 2024-02-22T00:53:45.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.066+0000 7f66bb542700 1 -- 172.21.15.49:0/3950515088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 msgr2=0x7f66b40f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:45.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.066+0000 7f66bb542700 1 --2- 172.21.15.49:0/3950515088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 0x7f66b40f7ab0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f66a40047f0 tx=0x7f66a4009cb0).stop 2024-02-22T00:53:45.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.066+0000 7f66bb542700 1 -- 172.21.15.49:0/3950515088 shutdown_connections 2024-02-22T00:53:45.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.066+0000 7f66bb542700 1 --2- 172.21.15.49:0/3950515088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 0x7f66b40f7ab0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:45.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.066+0000 7f66bb542700 1 --2- 172.21.15.49:0/3950515088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66b40fd970 0x7f66b40fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:45.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.066+0000 7f66bb542700 1 -- 172.21.15.49:0/3950515088 >> 172.21.15.49:0/3950515088 conn(0x7f66b40f3550 msgr2=0x7f66b40f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:45.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.067+0000 7f66bb542700 1 -- 172.21.15.49:0/3950515088 shutdown_connections 2024-02-22T00:53:45.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.067+0000 7f66bb542700 1 -- 172.21.15.49:0/3950515088 wait complete. 2024-02-22T00:53:45.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.067+0000 7f66bb542700 1 Processor -- start 2024-02-22T00:53:45.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.067+0000 7f66bb542700 1 -- start start 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.067+0000 7f66bb542700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66b40fd970 0x7f66b410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.067+0000 7f66bb542700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 0x7f66b410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.067+0000 7f66bb542700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b410eb50 con 0x7f66b40fe2d0 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.067+0000 7f66bb542700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b410ec90 con 0x7f66b40fd970 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66b8add700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 0x7f66b410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66b8add700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 0x7f66b410e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43600/0 (socket says 172.21.15.49:43600) 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66b8add700 1 -- 172.21.15.49:0/1846272157 learned_addr learned my addr 172.21.15.49:0/1846272157 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66b92de700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66b40fd970 0x7f66b410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66b8add700 1 -- 172.21.15.49:0/1846272157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66b40fd970 msgr2=0x7f66b410e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66b8add700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66b40fd970 0x7f66b410e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66b8add700 1 -- 172.21.15.49:0/1846272157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4005040 con 0x7f66b40fe2d0 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66b8add700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 0x7f66b410e550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f66a40099f0 tx=0x7f66a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66aa7fc700 1 -- 172.21.15.49:0/1846272157 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66a400e030 con 0x7f66b40fe2d0 2024-02-22T00:53:45.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66aa7fc700 1 -- 172.21.15.49:0/1846272157 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f66a4007e90 con 0x7f66b40fe2d0 2024-02-22T00:53:45.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b41082c0 con 0x7f66b40fe2d0 2024-02-22T00:53:45.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66aa7fc700 1 -- 172.21.15.49:0/1846272157 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66a4018070 con 0x7f66b40fe2d0 2024-02-22T00:53:45.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.068+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b41087a0 con 0x7f66b40fe2d0 2024-02-22T00:53:45.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.069+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b4060370 con 0x7f66b40fe2d0 2024-02-22T00:53:45.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.070+0000 7f66aa7fc700 1 -- 172.21.15.49:0/1846272157 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f66a401d420 con 0x7f66b40fe2d0 2024-02-22T00:53:45.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.070+0000 7f66aa7fc700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66a006caa0 0x7f66a006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:53:45.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.070+0000 7f66aa7fc700 1 -- 172.21.15.49:0/1846272157 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f66a408d0b0 con 0x7f66b40fe2d0 2024-02-22T00:53:45.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.070+0000 7f66b92de700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66a006caa0 0x7f66a006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:53:45.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.071+0000 7f66b92de700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66a006caa0 0x7f66a006ef60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f66b00041d0 tx=0x7f66b0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:53:45.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.075+0000 7f66aa7fc700 1 -- 172.21.15.49:0/1846272157 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f66a405ac10 con 0x7f66b40fe2d0 2024-02-22T00:53:45.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.357+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f66b4047540 con 0x7f66b40fe2d0 2024-02-22T00:53:45.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.358+0000 7f66aa7fc700 1 -- 172.21.15.49:0/1846272157 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f66a405a7a0 con 0x7f66b40fe2d0 2024-02-22T00:53:45.360 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:53:45.360 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:53:45.360 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:53:45.361 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:53:45.361 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66a006caa0 msgr2=0x7f66a006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66a006caa0 0x7f66a006ef60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f66b00041d0 tx=0x7f66b0009040).stop 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 msgr2=0x7f66b410e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 0x7f66b410e550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f66a40099f0 tx=0x7f66a4009cb0).stop 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 shutdown_connections 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f66a006caa0 0x7f66a006ef60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66b40fd970 0x7f66b410e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 --2- 172.21.15.49:0/1846272157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66b40fe2d0 0x7f66b410e550 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:53:45.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 >> 172.21.15.49:0/1846272157 conn(0x7f66b40f3550 msgr2=0x7f66b40fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:53:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 shutdown_connections 2024-02-22T00:53:45.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:53:45.360+0000 7f66bb542700 1 -- 172.21.15.49:0/1846272157 wait complete. 2024-02-22T00:53:45.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:45 smithi161 ceph-mon[113442]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:45.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:45 smithi161 ceph-mon[113442]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:45.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:45 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3265726744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:53:45.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:45 smithi049 ceph-mon[132694]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:45.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:45 smithi049 ceph-mon[132694]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:45.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:45 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3265726744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:53:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:46 smithi161 ceph-mon[113442]: pgmap v505: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:46 smithi161 ceph-mon[113442]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:46 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1846272157' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:53:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:46 smithi049 ceph-mon[132694]: pgmap v505: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:46 smithi049 ceph-mon[132694]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:53:46.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:46 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1846272157' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:53:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:48 smithi161 ceph-mon[113442]: pgmap v506: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:48.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:48 smithi049 ceph-mon[132694]: pgmap v506: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:50.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:50 smithi049 ceph-mon[132694]: pgmap v507: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:50.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:50 smithi161 ceph-mon[113442]: pgmap v507: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:52 smithi049 ceph-mon[132694]: pgmap v508: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:52.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:52 smithi161 ceph-mon[113442]: pgmap v508: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:54 smithi049 ceph-mon[132694]: pgmap v509: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:54.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:54 smithi161 ceph-mon[113442]: pgmap v509: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:56.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:56 smithi049 ceph-mon[132694]: pgmap v510: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:56.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:56 smithi161 ceph-mon[113442]: pgmap v510: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:58 smithi049 ceph-mon[132694]: pgmap v511: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:53:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:53:58.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:58 smithi161 ceph-mon[113442]: pgmap v511: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:53:58.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:53:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:54:00.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:00 smithi049 ceph-mon[132694]: pgmap v512: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:00.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:00 smithi161 ceph-mon[113442]: pgmap v512: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:02 smithi049 ceph-mon[132694]: pgmap v513: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:02.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:02 smithi161 ceph-mon[113442]: pgmap v513: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:04 smithi049 ceph-mon[132694]: pgmap v514: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:04.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:04 smithi161 ceph-mon[113442]: pgmap v514: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:06.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:06 smithi049 ceph-mon[132694]: pgmap v515: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:06.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:06 smithi161 ceph-mon[113442]: pgmap v515: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:08 smithi049 ceph-mon[132694]: pgmap v516: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:08.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:08 smithi161 ceph-mon[113442]: pgmap v516: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:10 smithi049 ceph-mon[132694]: pgmap v517: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:10.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:10 smithi161 ceph-mon[113442]: pgmap v517: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:12 smithi049 ceph-mon[132694]: pgmap v518: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:12.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:12 smithi161 ceph-mon[113442]: pgmap v518: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:54:13.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:54:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:14 smithi049 ceph-mon[132694]: pgmap v519: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:14.794 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:14 smithi161 ceph-mon[113442]: pgmap v519: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:15.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.476+0000 7fbb3e63a700 1 -- 172.21.15.49:0/1707499889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 msgr2=0x7fbb380fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:15.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.476+0000 7fbb3e63a700 1 --2- 172.21.15.49:0/1707499889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 0x7fbb380fdcf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fbb280047f0 tx=0x7fbb28009cb0).stop 2024-02-22T00:54:15.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.476+0000 7fbb3e63a700 1 -- 172.21.15.49:0/1707499889 shutdown_connections 2024-02-22T00:54:15.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.476+0000 7fbb3e63a700 1 --2- 172.21.15.49:0/1707499889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb380fe270 0x7fbb380f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:15.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.476+0000 7fbb3e63a700 1 --2- 172.21.15.49:0/1707499889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 0x7fbb380fdcf0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:15.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.476+0000 7fbb3e63a700 1 -- 172.21.15.49:0/1707499889 >> 172.21.15.49:0/1707499889 conn(0x7fbb380f3530 msgr2=0x7fbb380f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:15.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.476+0000 7fbb3e63a700 1 -- 172.21.15.49:0/1707499889 shutdown_connections 2024-02-22T00:54:15.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.476+0000 7fbb3e63a700 1 -- 172.21.15.49:0/1707499889 wait complete. 2024-02-22T00:54:15.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.477+0000 7fbb3e63a700 1 Processor -- start 2024-02-22T00:54:15.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.477+0000 7fbb3e63a700 1 -- start start 2024-02-22T00:54:15.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb3e63a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 0x7fbb3810e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:15.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb3e63a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb380fe270 0x7fbb3810e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb3e63a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3810ec70 con 0x7fbb380fd910 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb3e63a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38108290 con 0x7fbb380fe270 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb37fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 0x7fbb3810e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb37fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 0x7fbb3810e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52050/0 (socket says 172.21.15.49:52050) 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb37fff700 1 -- 172.21.15.49:0/3192430333 learned_addr learned my addr 172.21.15.49:0/3192430333 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb377fe700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb380fe270 0x7fbb3810e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb37fff700 1 -- 172.21.15.49:0/3192430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb380fe270 msgr2=0x7fbb3810e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb37fff700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb380fe270 0x7fbb3810e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb37fff700 1 -- 172.21.15.49:0/3192430333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28005040 con 0x7fbb380fd910 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb377fe700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb380fe270 0x7fbb3810e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb37fff700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 0x7fbb3810e0f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fbb28013640 tx=0x7fbb28009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb357fa700 1 -- 172.21.15.49:0/3192430333 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb2800e030 con 0x7fbb380fd910 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb357fa700 1 -- 172.21.15.49:0/3192430333 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbb28007e90 con 0x7fbb380fd910 2024-02-22T00:54:15.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb381084e0 con 0x7fbb380fd910 2024-02-22T00:54:15.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb357fa700 1 -- 172.21.15.49:0/3192430333 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb28018070 con 0x7fbb380fd910 2024-02-22T00:54:15.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.478+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb381089c0 con 0x7fbb380fd910 2024-02-22T00:54:15.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.479+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3805f570 con 0x7fbb380fd910 2024-02-22T00:54:15.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.480+0000 7fbb357fa700 1 -- 172.21.15.49:0/3192430333 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbb2801d420 con 0x7fbb380fd910 2024-02-22T00:54:15.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.481+0000 7fbb357fa700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbb2406cab0 0x7fbb2406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:15.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.481+0000 7fbb357fa700 1 -- 172.21.15.49:0/3192430333 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbb2801de40 con 0x7fbb380fd910 2024-02-22T00:54:15.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.481+0000 7fbb377fe700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbb2406cab0 0x7fbb2406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:15.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.481+0000 7fbb377fe700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbb2406cab0 0x7fbb2406ef70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbb38109a30 tx=0x7fbb20008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:15.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.485+0000 7fbb357fa700 1 -- 172.21.15.49:0/3192430333 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbb2805b290 con 0x7fbb380fd910 2024-02-22T00:54:15.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.703+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb38109880 con 0x7fbb2406cab0 2024-02-22T00:54:15.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.704+0000 7fbb357fa700 1 -- 172.21.15.49:0/3192430333 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fbb38109880 con 0x7fbb2406cab0 2024-02-22T00:54:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbb2406cab0 msgr2=0x7fbb2406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbb2406cab0 0x7fbb2406ef70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbb38109a30 tx=0x7fbb20008040).stop 2024-02-22T00:54:15.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 msgr2=0x7fbb3810e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 0x7fbb3810e0f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fbb28013640 tx=0x7fbb28009cb0).stop 2024-02-22T00:54:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 shutdown_connections 2024-02-22T00:54:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbb2406cab0 0x7fbb2406ef70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb380fd910 0x7fbb3810e0f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 --2- 172.21.15.49:0/3192430333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb380fe270 0x7fbb3810e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 >> 172.21.15.49:0/3192430333 conn(0x7fbb380f3530 msgr2=0x7fbb380fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 shutdown_connections 2024-02-22T00:54:15.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.706+0000 7fbb3e63a700 1 -- 172.21.15.49:0/3192430333 wait complete. 2024-02-22T00:54:15.718 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:54:15.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.809+0000 7fb0f3693700 1 -- 172.21.15.49:0/604910331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fd150 msgr2=0x7fb0ec0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.809+0000 7fb0f3693700 1 --2- 172.21.15.49:0/604910331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fd150 0x7fb0ec0f6930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fb0dc0047f0 tx=0x7fb0dc009cb0).stop 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.809+0000 7fb0f3693700 1 -- 172.21.15.49:0/604910331 shutdown_connections 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.809+0000 7fb0f3693700 1 --2- 172.21.15.49:0/604910331 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fd150 0x7fb0ec0f6930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.809+0000 7fb0f3693700 1 --2- 172.21.15.49:0/604910331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0ec0fc7f0 0x7fb0ec0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.809+0000 7fb0f3693700 1 -- 172.21.15.49:0/604910331 >> 172.21.15.49:0/604910331 conn(0x7fb0ec070590 msgr2=0x7fb0ec0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f3693700 1 -- 172.21.15.49:0/604910331 shutdown_connections 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f3693700 1 -- 172.21.15.49:0/604910331 wait complete. 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f3693700 1 Processor -- start 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f3693700 1 -- start start 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f3693700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fc7f0 0x7fb0ec10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f3693700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0ec0fd150 0x7fb0ec10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f3693700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec10ebe0 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f3693700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec108200 con 0x7fb0ec0fd150 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.810+0000 7fb0f142f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fc7f0 0x7fb0ec10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f142f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fc7f0 0x7fb0ec10e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52074/0 (socket says 172.21.15.49:52074) 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f142f700 1 -- 172.21.15.49:0/1619012190 learned_addr learned my addr 172.21.15.49:0/1619012190 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f0c2e700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0ec0fd150 0x7fb0ec10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f142f700 1 -- 172.21.15.49:0/1619012190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0ec0fd150 msgr2=0x7fb0ec10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f142f700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0ec0fd150 0x7fb0ec10e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f142f700 1 -- 172.21.15.49:0/1619012190 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc005040 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f142f700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fc7f0 0x7fb0ec10e060 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fb0e800b4b0 tx=0x7fb0e80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0e27fc700 1 -- 172.21.15.49:0/1619012190 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0e8002500 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0e27fc700 1 -- 172.21.15.49:0/1619012190 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0e8002b10 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec1084b0 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0e27fc700 1 -- 172.21.15.49:0/1619012190 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0e8012cf0 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.811+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec1089f0 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.812+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec05f590 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.813+0000 7fb0e27fc700 1 -- 172.21.15.49:0/1619012190 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb0e8002660 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.813+0000 7fb0e27fc700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb0d806caa0 0x7fb0d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:15.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.813+0000 7fb0e27fc700 1 -- 172.21.15.49:0/1619012190 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb0e808be80 con 0x7fb0ec0fc7f0 2024-02-22T00:54:15.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.813+0000 7fb0f0c2e700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb0d806caa0 0x7fb0d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:15.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.813+0000 7fb0f0c2e700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb0d806caa0 0x7fb0d806ef60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fb0dc004f10 tx=0x7fb0dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:15.817+0000 7fb0e27fc700 1 -- 172.21.15.49:0/1619012190 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb0e80599e0 con 0x7fb0ec0fc7f0 2024-02-22T00:54:16.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.035+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0ec103690 con 0x7fb0d806caa0 2024-02-22T00:54:16.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.037+0000 7fb0e27fc700 1 -- 172.21.15.49:0/1619012190 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fb0dc019040 con 0x7fb0d806caa0 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb0d806caa0 msgr2=0x7fb0d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb0d806caa0 0x7fb0d806ef60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fb0dc004f10 tx=0x7fb0dc00b040).stop 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fc7f0 msgr2=0x7fb0ec10e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fc7f0 0x7fb0ec10e060 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fb0e800b4b0 tx=0x7fb0e80090f0).stop 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 shutdown_connections 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb0d806caa0 0x7fb0d806ef60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb0ec0fc7f0 0x7fb0ec10e060 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 --2- 172.21.15.49:0/1619012190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0ec0fd150 0x7fb0ec10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 >> 172.21.15.49:0/1619012190 conn(0x7fb0ec070590 msgr2=0x7fb0ec060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 shutdown_connections 2024-02-22T00:54:16.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.039+0000 7fb0f3693700 1 -- 172.21.15.49:0/1619012190 wait complete. 2024-02-22T00:54:16.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.140+0000 7efc6dad5700 1 -- 172.21.15.49:0/2252919753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 msgr2=0x7efc680fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.140+0000 7efc6dad5700 1 --2- 172.21.15.49:0/2252919753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 0x7efc680fdcd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7efc580047f0 tx=0x7efc58009cb0).stop 2024-02-22T00:54:16.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.141+0000 7efc6dad5700 1 -- 172.21.15.49:0/2252919753 shutdown_connections 2024-02-22T00:54:16.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.141+0000 7efc6dad5700 1 --2- 172.21.15.49:0/2252919753 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc680fe250 0x7efc680f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.141+0000 7efc6dad5700 1 --2- 172.21.15.49:0/2252919753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 0x7efc680fdcd0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.141+0000 7efc6dad5700 1 -- 172.21.15.49:0/2252919753 >> 172.21.15.49:0/2252919753 conn(0x7efc680f34b0 msgr2=0x7efc680f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.141+0000 7efc6dad5700 1 -- 172.21.15.49:0/2252919753 shutdown_connections 2024-02-22T00:54:16.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.141+0000 7efc6dad5700 1 -- 172.21.15.49:0/2252919753 wait complete. 2024-02-22T00:54:16.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.141+0000 7efc6dad5700 1 Processor -- start 2024-02-22T00:54:16.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc6dad5700 1 -- start start 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc6dad5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 0x7efc6810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc6dad5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc680fe250 0x7efc6810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc6dad5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6810ead0 con 0x7efc680fd8f0 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc6dad5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6810ec10 con 0x7efc680fe250 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 0x7efc6810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc677fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 0x7efc6810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52096/0 (socket says 172.21.15.49:52096) 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc677fe700 1 -- 172.21.15.49:0/1193748410 learned_addr learned my addr 172.21.15.49:0/1193748410 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc66ffd700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc680fe250 0x7efc6810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc677fe700 1 -- 172.21.15.49:0/1193748410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc680fe250 msgr2=0x7efc6810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc677fe700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc680fe250 0x7efc6810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc677fe700 1 -- 172.21.15.49:0/1193748410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58005040 con 0x7efc680fd8f0 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc677fe700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 0x7efc6810dfe0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7efc5800b120 tx=0x7efc58009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.142+0000 7efc64f74700 1 -- 172.21.15.49:0/1193748410 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc5800e030 con 0x7efc680fd8f0 2024-02-22T00:54:16.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.143+0000 7efc64f74700 1 -- 172.21.15.49:0/1193748410 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc58007e90 con 0x7efc680fd8f0 2024-02-22T00:54:16.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.143+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc68108240 con 0x7efc680fd8f0 2024-02-22T00:54:16.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.143+0000 7efc64f74700 1 -- 172.21.15.49:0/1193748410 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc58018070 con 0x7efc680fd8f0 2024-02-22T00:54:16.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.143+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc681087a0 con 0x7efc680fd8f0 2024-02-22T00:54:16.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.144+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6805f590 con 0x7efc680fd8f0 2024-02-22T00:54:16.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.144+0000 7efc64f74700 1 -- 172.21.15.49:0/1193748410 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efc5801d420 con 0x7efc680fd8f0 2024-02-22T00:54:16.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.144+0000 7efc64f74700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc5006caa0 0x7efc5006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.145+0000 7efc64f74700 1 -- 172.21.15.49:0/1193748410 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7efc5808d250 con 0x7efc680fd8f0 2024-02-22T00:54:16.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.145+0000 7efc66ffd700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc5006caa0 0x7efc5006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:16.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.145+0000 7efc66ffd700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc5006caa0 0x7efc5006ef60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efc68109920 tx=0x7efc5c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:16.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.149+0000 7efc64f74700 1 -- 172.21.15.49:0/1193748410 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efc5805adb0 con 0x7efc680fd8f0 2024-02-22T00:54:16.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.358+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efc680ffc40 con 0x7efc5006caa0 2024-02-22T00:54:16.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.368+0000 7efc64f74700 1 -- 172.21.15.49:0/1193748410 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7efc680ffc40 con 0x7efc5006caa0 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (17m) 11m ago 28m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (15m) 11m ago 28m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (15m) 10m ago 28m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (17m) 11m ago 28m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (11m) 11m ago 23m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (11m) 11m ago 23m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (10m) 10m ago 23m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (11m) 10m ago 23m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (19m) 11m ago 30m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:54:16.371 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (18m) 10m ago 28m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (16m) 11m ago 30m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (15m) 10m ago 27m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (18m) 11m ago 28m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (18m) 10m ago 27m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (14m) 11m ago 27m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (14m) 11m ago 26m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (13m) 11m ago 26m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (13m) 10m ago 25m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (12m) 10m ago 25m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (12m) 10m ago 25m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:54:16.372 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (17m) 10m ago 27m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:54:16.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.370+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc5006caa0 msgr2=0x7efc5006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.370+0000 7efc6dad5700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc5006caa0 0x7efc5006ef60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7efc68109920 tx=0x7efc5c009040).stop 2024-02-22T00:54:16.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.370+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 msgr2=0x7efc6810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.370+0000 7efc6dad5700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 0x7efc6810dfe0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7efc5800b120 tx=0x7efc58009cb0).stop 2024-02-22T00:54:16.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.371+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 shutdown_connections 2024-02-22T00:54:16.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.371+0000 7efc6dad5700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efc5006caa0 0x7efc5006ef60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.371+0000 7efc6dad5700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efc680fd8f0 0x7efc6810dfe0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.371+0000 7efc6dad5700 1 --2- 172.21.15.49:0/1193748410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc680fe250 0x7efc6810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.371+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 >> 172.21.15.49:0/1193748410 conn(0x7efc680f34b0 msgr2=0x7efc680fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:16.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.371+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 shutdown_connections 2024-02-22T00:54:16.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.371+0000 7efc6dad5700 1 -- 172.21.15.49:0/1193748410 wait complete. 2024-02-22T00:54:16.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.471+0000 7f39dbc24700 1 -- 172.21.15.49:0/4272106453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 msgr2=0x7f39d40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.471+0000 7f39dbc24700 1 --2- 172.21.15.49:0/4272106453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 0x7f39d40fcbd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f39d00047f0 tx=0x7f39d0009cb0).stop 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.471+0000 7f39dbc24700 1 -- 172.21.15.49:0/4272106453 shutdown_connections 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.471+0000 7f39dbc24700 1 --2- 172.21.15.49:0/4272106453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d40fd150 0x7f39d40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.471+0000 7f39dbc24700 1 --2- 172.21.15.49:0/4272106453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 0x7f39d40fcbd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.471+0000 7f39dbc24700 1 -- 172.21.15.49:0/4272106453 >> 172.21.15.49:0/4272106453 conn(0x7f39d4070590 msgr2=0x7f39d40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.471+0000 7f39dbc24700 1 -- 172.21.15.49:0/4272106453 shutdown_connections 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.471+0000 7f39dbc24700 1 -- 172.21.15.49:0/4272106453 wait complete. 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39dbc24700 1 Processor -- start 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39dbc24700 1 -- start start 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39dbc24700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 0x7f39d410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39dbc24700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d40fd150 0x7f39d410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39dbc24700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d410ebe0 con 0x7f39d40fc7f0 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39dbc24700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4108200 con 0x7f39d40fd150 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39d99c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 0x7f39d410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39d99c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 0x7f39d410e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52116/0 (socket says 172.21.15.49:52116) 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.472+0000 7f39d99c0700 1 -- 172.21.15.49:0/1200200764 learned_addr learned my addr 172.21.15.49:0/1200200764 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39d99c0700 1 -- 172.21.15.49:0/1200200764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d40fd150 msgr2=0x7f39d410e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39d99c0700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d40fd150 0x7f39d410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39d99c0700 1 -- 172.21.15.49:0/1200200764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0005040 con 0x7f39d40fc7f0 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39d99c0700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 0x7f39d410e060 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f39d000b120 tx=0x7f39d0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39caffd700 1 -- 172.21.15.49:0/1200200764 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39d000e030 con 0x7f39d40fc7f0 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39caffd700 1 -- 172.21.15.49:0/1200200764 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39d0007e90 con 0x7f39d40fc7f0 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d4108450 con 0x7f39d40fc7f0 2024-02-22T00:54:16.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39caffd700 1 -- 172.21.15.49:0/1200200764 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39d0018070 con 0x7f39d40fc7f0 2024-02-22T00:54:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.473+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4108930 con 0x7f39d40fc7f0 2024-02-22T00:54:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.474+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d405f590 con 0x7f39d40fc7f0 2024-02-22T00:54:16.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.475+0000 7f39caffd700 1 -- 172.21.15.49:0/1200200764 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f39d001d420 con 0x7f39d40fc7f0 2024-02-22T00:54:16.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.475+0000 7f39caffd700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39c006caa0 0x7f39c006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.475+0000 7f39caffd700 1 -- 172.21.15.49:0/1200200764 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f39d008d250 con 0x7f39d40fc7f0 2024-02-22T00:54:16.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.475+0000 7f39d91bf700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39c006caa0 0x7f39c006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:16.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.476+0000 7f39d91bf700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39c006caa0 0x7f39c006ef60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f39d41099a0 tx=0x7f39c4006c30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:16.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.480+0000 7f39caffd700 1 -- 172.21.15.49:0/1200200764 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f39d005adb0 con 0x7f39d40fc7f0 2024-02-22T00:54:16.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:16 smithi049 ceph-mon[132694]: pgmap v520: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.762+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f39d4109780 con 0x7f39d40fc7f0 2024-02-22T00:54:16.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.763+0000 7f39caffd700 1 -- 172.21.15.49:0/1200200764 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f39d005a940 con 0x7f39d40fc7f0 2024-02-22T00:54:16.765 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:54:16.765 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:54:16.765 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:54:16.766 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:54:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39c006caa0 msgr2=0x7f39c006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39c006caa0 0x7f39c006ef60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f39d41099a0 tx=0x7f39c4006c30).stop 2024-02-22T00:54:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 msgr2=0x7f39d410e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 0x7f39d410e060 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f39d000b120 tx=0x7f39d0009cb0).stop 2024-02-22T00:54:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 shutdown_connections 2024-02-22T00:54:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39c006caa0 0x7f39c006ef60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d40fc7f0 0x7f39d410e060 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 --2- 172.21.15.49:0/1200200764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d40fd150 0x7f39d410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 >> 172.21.15.49:0/1200200764 conn(0x7f39d4070590 msgr2=0x7f39d4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 shutdown_connections 2024-02-22T00:54:16.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.765+0000 7f39dbc24700 1 -- 172.21.15.49:0/1200200764 wait complete. 2024-02-22T00:54:16.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:16 smithi161 ceph-mon[113442]: pgmap v520: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 -- 172.21.15.49:0/69924199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 msgr2=0x7f281c0f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 --2- 172.21.15.49:0/69924199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 0x7f281c0f8ce0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f280c0047f0 tx=0x7f280c009cb0).stop 2024-02-22T00:54:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 -- 172.21.15.49:0/69924199 shutdown_connections 2024-02-22T00:54:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 --2- 172.21.15.49:0/69924199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f281c0f9260 0x7f281c101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 --2- 172.21.15.49:0/69924199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 0x7f281c0f8ce0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 -- 172.21.15.49:0/69924199 >> 172.21.15.49:0/69924199 conn(0x7f281c070590 msgr2=0x7f281c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 -- 172.21.15.49:0/69924199 shutdown_connections 2024-02-22T00:54:16.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 -- 172.21.15.49:0/69924199 wait complete. 2024-02-22T00:54:16.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 Processor -- start 2024-02-22T00:54:16.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.868+0000 7f2822161700 1 -- start start 2024-02-22T00:54:16.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2822161700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 0x7f281c10e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2822161700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f281c0f9260 0x7f281c10e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2822161700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c10eb30 con 0x7f281c0f8900 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2822161700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c10ec70 con 0x7f281c0f9260 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f281b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 0x7f281c10e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f281b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 0x7f281c10e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52130/0 (socket says 172.21.15.49:52130) 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f281b7fe700 1 -- 172.21.15.49:0/2392676294 learned_addr learned my addr 172.21.15.49:0/2392676294 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f281b7fe700 1 -- 172.21.15.49:0/2392676294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f281c0f9260 msgr2=0x7f281c10e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f281affd700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f281c0f9260 0x7f281c10e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f281b7fe700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f281c0f9260 0x7f281c10e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f281b7fe700 1 -- 172.21.15.49:0/2392676294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c005040 con 0x7f281c0f8900 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f281b7fe700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 0x7f281c10e040 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f280c009380 tx=0x7f280c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2818ff9700 1 -- 172.21.15.49:0/2392676294 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280c00e070 con 0x7f281c0f8900 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2818ff9700 1 -- 172.21.15.49:0/2392676294 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f280c007e90 con 0x7f281c0f8900 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c1082a0 con 0x7f281c0f8900 2024-02-22T00:54:16.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2818ff9700 1 -- 172.21.15.49:0/2392676294 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f280c018070 con 0x7f281c0f8900 2024-02-22T00:54:16.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.869+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c108780 con 0x7f281c0f8900 2024-02-22T00:54:16.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.871+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c05f590 con 0x7f281c0f8900 2024-02-22T00:54:16.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.871+0000 7f2818ff9700 1 -- 172.21.15.49:0/2392676294 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f280c01d420 con 0x7f281c0f8900 2024-02-22T00:54:16.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.871+0000 7f2818ff9700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f280406caa0 0x7f280406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:16.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.871+0000 7f2818ff9700 1 -- 172.21.15.49:0/2392676294 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f280c08c900 con 0x7f281c0f8900 2024-02-22T00:54:16.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.871+0000 7f281affd700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f280406caa0 0x7f280406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:16.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.872+0000 7f281affd700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f280406caa0 0x7f280406ef60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f281c109980 tx=0x7f281000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:16.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:16.876+0000 7f2818ff9700 1 -- 172.21.15.49:0/2392676294 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f280c05a460 con 0x7f281c0f8900 2024-02-22T00:54:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.118+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f281c0fee70 con 0x7f281c0f8900 2024-02-22T00:54:17.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.118+0000 7f2818ff9700 1 -- 172.21.15.49:0/2392676294 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f280c059ff0 con 0x7f281c0f8900 2024-02-22T00:54:17.120 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:54:17.121 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:54:17.122 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:54:17.123 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:54:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f280406caa0 msgr2=0x7f280406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f280406caa0 0x7f280406ef60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f281c109980 tx=0x7f281000b040).stop 2024-02-22T00:54:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 msgr2=0x7f281c10e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 0x7f281c10e040 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f280c009380 tx=0x7f280c009cb0).stop 2024-02-22T00:54:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 shutdown_connections 2024-02-22T00:54:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f280406caa0 0x7f280406ef60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f281c0f8900 0x7f281c10e040 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 --2- 172.21.15.49:0/2392676294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f281c0f9260 0x7f281c10e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 >> 172.21.15.49:0/2392676294 conn(0x7f281c070590 msgr2=0x7f281c0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 shutdown_connections 2024-02-22T00:54:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.120+0000 7f2822161700 1 -- 172.21.15.49:0/2392676294 wait complete. 2024-02-22T00:54:17.125 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:54:17.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.222+0000 7f26f2dc9700 1 -- 172.21.15.49:0/2249771936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fc7f0 msgr2=0x7f26ec0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.222+0000 7f26f2dc9700 1 --2- 172.21.15.49:0/2249771936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fc7f0 0x7f26ec0fcbd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f26e00047f0 tx=0x7f26e0009cb0).stop 2024-02-22T00:54:17.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.222+0000 7f26f2dc9700 1 -- 172.21.15.49:0/2249771936 shutdown_connections 2024-02-22T00:54:17.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.222+0000 7f26f2dc9700 1 --2- 172.21.15.49:0/2249771936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26ec0fd150 0x7f26ec0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.222+0000 7f26f2dc9700 1 --2- 172.21.15.49:0/2249771936 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fc7f0 0x7f26ec0fcbd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.222+0000 7f26f2dc9700 1 -- 172.21.15.49:0/2249771936 >> 172.21.15.49:0/2249771936 conn(0x7f26ec070590 msgr2=0x7f26ec0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.222+0000 7f26f2dc9700 1 -- 172.21.15.49:0/2249771936 shutdown_connections 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.222+0000 7f26f2dc9700 1 -- 172.21.15.49:0/2249771936 wait complete. 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26f2dc9700 1 Processor -- start 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26f2dc9700 1 -- start start 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26f2dc9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26ec0fc7f0 0x7f26ec0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26f2dc9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fd150 0x7f26ec0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26f2dc9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0f8f20 con 0x7f26ec0fd150 2024-02-22T00:54:17.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26f2dc9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0f9060 con 0x7f26ec0fc7f0 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fd150 0x7f26ec0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26ebfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fd150 0x7f26ec0f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52144/0 (socket says 172.21.15.49:52144) 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.223+0000 7f26ebfff700 1 -- 172.21.15.49:0/70849236 learned_addr learned my addr 172.21.15.49:0/70849236 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26f0b65700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26ec0fc7f0 0x7f26ec0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26ebfff700 1 -- 172.21.15.49:0/70849236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26ec0fc7f0 msgr2=0x7f26ec0f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26ebfff700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26ec0fc7f0 0x7f26ec0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26ebfff700 1 -- 172.21.15.49:0/70849236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0005040 con 0x7f26ec0fd150 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26ebfff700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fd150 0x7f26ec0f8a30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f26d800c790 tx=0x7f26d8007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26e9ffb700 1 -- 172.21.15.49:0/70849236 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d80106f0 con 0x7f26ec0fd150 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26e9ffb700 1 -- 172.21.15.49:0/70849236 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26d8010d00 con 0x7f26ec0fd150 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec0f9310 con 0x7f26ec0fd150 2024-02-22T00:54:17.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26e9ffb700 1 -- 172.21.15.49:0/70849236 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d8012d50 con 0x7f26ec0fd150 2024-02-22T00:54:17.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.224+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec114710 con 0x7f26ec0fd150 2024-02-22T00:54:17.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.225+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec05f590 con 0x7f26ec0fd150 2024-02-22T00:54:17.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.225+0000 7f26e9ffb700 1 -- 172.21.15.49:0/70849236 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f26d8012570 con 0x7f26ec0fd150 2024-02-22T00:54:17.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.226+0000 7f26e9ffb700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f26dc06cab0 0x7f26dc06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:17.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.226+0000 7f26e9ffb700 1 -- 172.21.15.49:0/70849236 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f26d808b5b0 con 0x7f26ec0fd150 2024-02-22T00:54:17.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.226+0000 7f26f0b65700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f26dc06cab0 0x7f26dc06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:17.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.226+0000 7f26f0b65700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f26dc06cab0 0x7f26dc06ef70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f26e0000c00 tx=0x7f26e0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.231+0000 7f26e9ffb700 1 -- 172.21.15.49:0/70849236 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f26d8055680 con 0x7f26ec0fd150 2024-02-22T00:54:17.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.453+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26ec0fb5a0 con 0x7f26dc06cab0 2024-02-22T00:54:17.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.454+0000 7f26e9ffb700 1 -- 172.21.15.49:0/70849236 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f26ec0fb5a0 con 0x7f26dc06cab0 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:54:17.457 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:54:17.458 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f26dc06cab0 msgr2=0x7f26dc06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f26dc06cab0 0x7f26dc06ef70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f26e0000c00 tx=0x7f26e0009cb0).stop 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fd150 msgr2=0x7f26ec0f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fd150 0x7f26ec0f8a30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f26d800c790 tx=0x7f26d8007f50).stop 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 shutdown_connections 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f26dc06cab0 0x7f26dc06ef70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26ec0fc7f0 0x7f26ec0f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 --2- 172.21.15.49:0/70849236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f26ec0fd150 0x7f26ec0f8a30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.456+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 >> 172.21.15.49:0/70849236 conn(0x7f26ec070590 msgr2=0x7f26ec060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.457+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 shutdown_connections 2024-02-22T00:54:17.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.457+0000 7f26f2dc9700 1 -- 172.21.15.49:0/70849236 wait complete. 2024-02-22T00:54:17.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.558+0000 7fc77d639700 1 -- 172.21.15.49:0/3188034005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fc7f0 msgr2=0x7fc7780fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.558+0000 7fc77d639700 1 --2- 172.21.15.49:0/3188034005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fc7f0 0x7fc7780fcbd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fc7680047f0 tx=0x7fc768009cb0).stop 2024-02-22T00:54:17.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.558+0000 7fc77d639700 1 -- 172.21.15.49:0/3188034005 shutdown_connections 2024-02-22T00:54:17.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.558+0000 7fc77d639700 1 --2- 172.21.15.49:0/3188034005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780fd150 0x7fc7780f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:17.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.558+0000 7fc77d639700 1 --2- 172.21.15.49:0/3188034005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fc7f0 0x7fc7780fcbd0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.558+0000 7fc77d639700 1 -- 172.21.15.49:0/3188034005 >> 172.21.15.49:0/3188034005 conn(0x7fc7780f23b0 msgr2=0x7fc7780f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:17.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.558+0000 7fc77d639700 1 -- 172.21.15.49:0/3188034005 shutdown_connections 2024-02-22T00:54:17.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.558+0000 7fc77d639700 1 -- 172.21.15.49:0/3188034005 wait complete. 2024-02-22T00:54:17.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.559+0000 7fc77d639700 1 Processor -- start 2024-02-22T00:54:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.559+0000 7fc77d639700 1 -- start start 2024-02-22T00:54:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.559+0000 7fc77d639700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780fc7f0 0x7fc778109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.559+0000 7fc77d639700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fd150 0x7fc778109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.559+0000 7fc77d639700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc778109c00 con 0x7fc7780fd150 2024-02-22T00:54:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.559+0000 7fc77d639700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc778109d40 con 0x7fc7780fc7f0 2024-02-22T00:54:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc7767fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fd150 0x7fc778109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc7767fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fd150 0x7fc778109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52160/0 (socket says 172.21.15.49:52160) 2024-02-22T00:54:17.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc7767fc700 1 -- 172.21.15.49:0/392275123 learned_addr learned my addr 172.21.15.49:0/392275123 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc776ffd700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780fc7f0 0x7fc778109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc7767fc700 1 -- 172.21.15.49:0/392275123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780fc7f0 msgr2=0x7fc778109190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc7767fc700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780fc7f0 0x7fc778109190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc7767fc700 1 -- 172.21.15.49:0/392275123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768005040 con 0x7fc7780fd150 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc7767fc700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fd150 0x7fc778109680 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fc76c00b480 tx=0x7fc76c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc75ffff700 1 -- 172.21.15.49:0/392275123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc76c002500 con 0x7fc7780fd150 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc75ffff700 1 -- 172.21.15.49:0/392275123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc76c002b10 con 0x7fc7780fd150 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc778109ff0 con 0x7fc7780fd150 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc75ffff700 1 -- 172.21.15.49:0/392275123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc76c012c60 con 0x7fc7780fd150 2024-02-22T00:54:17.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.560+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc778112580 con 0x7fc7780fd150 2024-02-22T00:54:17.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.561+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc778060370 con 0x7fc7780fd150 2024-02-22T00:54:17.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.562+0000 7fc75ffff700 1 -- 172.21.15.49:0/392275123 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc76c002660 con 0x7fc7780fd150 2024-02-22T00:54:17.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.563+0000 7fc75ffff700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc76006caa0 0x7fc76006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:17.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.563+0000 7fc75ffff700 1 -- 172.21.15.49:0/392275123 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc76c08c2d0 con 0x7fc7780fd150 2024-02-22T00:54:17.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.563+0000 7fc776ffd700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc76006caa0 0x7fc76006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:17.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.563+0000 7fc776ffd700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc76006caa0 0x7fc76006ef60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fc768007cf0 tx=0x7fc76800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:17.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.566+0000 7fc75ffff700 1 -- 172.21.15.49:0/392275123 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc76c0562e0 con 0x7fc7780fd150 2024-02-22T00:54:17.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:17 smithi049 ceph-mon[132694]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:17.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:17 smithi049 ceph-mon[132694]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:17.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:17 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1200200764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:54:17.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:17 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2392676294' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:54:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:17 smithi161 ceph-mon[113442]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:17 smithi161 ceph-mon[113442]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:17 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1200200764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:54:17.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:17 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2392676294' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:54:17.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.845+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc778061250 con 0x7fc7780fd150 2024-02-22T00:54:17.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.845+0000 7fc75ffff700 1 -- 172.21.15.49:0/392275123 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fc76c059900 con 0x7fc7780fd150 2024-02-22T00:54:17.848 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:54:17.848 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:54:17.848 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:54:17.848 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:54:17.848 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:54:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.847+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc76006caa0 msgr2=0x7fc76006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.847+0000 7fc77d639700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc76006caa0 0x7fc76006ef60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fc768007cf0 tx=0x7fc76800b040).stop 2024-02-22T00:54:17.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.847+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fd150 msgr2=0x7fc778109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.847+0000 7fc77d639700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fd150 0x7fc778109680 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fc76c00b480 tx=0x7fc76c0090f0).stop 2024-02-22T00:54:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.848+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 shutdown_connections 2024-02-22T00:54:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.848+0000 7fc77d639700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc76006caa0 0x7fc76006ef60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.848+0000 7fc77d639700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7780fc7f0 0x7fc778109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.848+0000 7fc77d639700 1 --2- 172.21.15.49:0/392275123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7780fd150 0x7fc778109680 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.848+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 >> 172.21.15.49:0/392275123 conn(0x7fc7780f23b0 msgr2=0x7fc7780fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.848+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 shutdown_connections 2024-02-22T00:54:17.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:17.848+0000 7fc77d639700 1 -- 172.21.15.49:0/392275123 wait complete. 2024-02-22T00:54:18.681 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:18 smithi049 ceph-mon[132694]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:18.682 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:18 smithi049 ceph-mon[132694]: pgmap v521: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:18.682 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:18 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/392275123' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:54:18.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:18 smithi161 ceph-mon[113442]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:18.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:18 smithi161 ceph-mon[113442]: pgmap v521: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:18.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:18 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/392275123' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:54:19.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:19 smithi049 ceph-mon[132694]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:19.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:19 smithi161 ceph-mon[113442]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:20.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:20 smithi049 ceph-mon[132694]: pgmap v522: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:20.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:20 smithi161 ceph-mon[113442]: pgmap v522: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:22 smithi049 ceph-mon[132694]: pgmap v523: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:22.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:22 smithi161 ceph-mon[113442]: pgmap v523: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:24.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:24 smithi049 ceph-mon[132694]: pgmap v524: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:24.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:24 smithi161 ceph-mon[113442]: pgmap v524: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:26.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:26 smithi049 ceph-mon[132694]: pgmap v525: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:26.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:26 smithi161 ceph-mon[113442]: pgmap v525: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:28 smithi049 ceph-mon[132694]: pgmap v526: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:28.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:54:28.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:28 smithi161 ceph-mon[113442]: pgmap v526: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:28.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:54:29.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:29 smithi049 ceph-mon[132694]: pgmap v527: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:29.793 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:29 smithi161 ceph-mon[113442]: pgmap v527: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:32.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:32 smithi049 ceph-mon[132694]: pgmap v528: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:32.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:32 smithi161 ceph-mon[113442]: pgmap v528: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:34.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:34 smithi049 ceph-mon[132694]: pgmap v529: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:34.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:34 smithi161 ceph-mon[113442]: pgmap v529: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:36.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:36 smithi049 ceph-mon[132694]: pgmap v530: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:36.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:36 smithi161 ceph-mon[113442]: pgmap v530: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:38.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:38 smithi049 ceph-mon[132694]: pgmap v531: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:38.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:38 smithi161 ceph-mon[113442]: pgmap v531: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:40.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:40 smithi049 ceph-mon[132694]: pgmap v532: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:40.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:40 smithi161 ceph-mon[113442]: pgmap v532: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:42.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:42 smithi049 ceph-mon[132694]: pgmap v533: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:42.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:42 smithi161 ceph-mon[113442]: pgmap v533: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:43.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:54:43.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:54:44.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:44 smithi049 ceph-mon[132694]: pgmap v534: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:44.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:44 smithi161 ceph-mon[113442]: pgmap v534: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:46.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:46 smithi049 ceph-mon[132694]: pgmap v535: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:46.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:46 smithi161 ceph-mon[113442]: pgmap v535: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:47.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.964+0000 7fb880813700 1 -- 172.21.15.49:0/1078605238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fd8f0 msgr2=0x7fb87c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:47.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.964+0000 7fb880813700 1 --2- 172.21.15.49:0/1078605238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fd8f0 0x7fb87c0fdcd0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fb8640047f0 tx=0x7fb864009cb0).stop 2024-02-22T00:54:47.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.964+0000 7fb880813700 1 -- 172.21.15.49:0/1078605238 shutdown_connections 2024-02-22T00:54:47.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.964+0000 7fb880813700 1 --2- 172.21.15.49:0/1078605238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb87c0fe250 0x7fb87c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:47.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.964+0000 7fb880813700 1 --2- 172.21.15.49:0/1078605238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fd8f0 0x7fb87c0fdcd0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.964+0000 7fb880813700 1 -- 172.21.15.49:0/1078605238 >> 172.21.15.49:0/1078605238 conn(0x7fb87c0f34b0 msgr2=0x7fb87c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.964+0000 7fb880813700 1 -- 172.21.15.49:0/1078605238 shutdown_connections 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.964+0000 7fb880813700 1 -- 172.21.15.49:0/1078605238 wait complete. 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb880813700 1 Processor -- start 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb880813700 1 -- start start 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb880813700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb87c0fd8f0 0x7fb87c1101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb880813700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fe250 0x7fb87c1106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb880813700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c110ce0 con 0x7fb87c0fe250 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb880813700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c110e20 con 0x7fb87c0fd8f0 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb879d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fe250 0x7fb87c1106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb879d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fe250 0x7fb87c1106e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35184/0 (socket says 172.21.15.49:35184) 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb879d9b700 1 -- 172.21.15.49:0/243577336 learned_addr learned my addr 172.21.15.49:0/243577336 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.965+0000 7fb87a59c700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb87c0fd8f0 0x7fb87c1101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:47.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb879d9b700 1 -- 172.21.15.49:0/243577336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb87c0fd8f0 msgr2=0x7fb87c1101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb879d9b700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb87c0fd8f0 0x7fb87c1101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb879d9b700 1 -- 172.21.15.49:0/243577336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864005040 con 0x7fb87c0fe250 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb879d9b700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fe250 0x7fb87c1106e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb86c002780 tx=0x7fb86c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb8737fe700 1 -- 172.21.15.49:0/243577336 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb86c007b40 con 0x7fb87c0fe250 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb8737fe700 1 -- 172.21.15.49:0/243577336 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb86c00f040 con 0x7fb87c0fe250 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c10a500 con 0x7fb87c0fe250 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb8737fe700 1 -- 172.21.15.49:0/243577336 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb86c014780 con 0x7fb87c0fe250 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.966+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c10aac0 con 0x7fb87c0fe250 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.967+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c05f590 con 0x7fb87c0fe250 2024-02-22T00:54:47.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.968+0000 7fb8737fe700 1 -- 172.21.15.49:0/243577336 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb86c007ca0 con 0x7fb87c0fe250 2024-02-22T00:54:47.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.968+0000 7fb8737fe700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb86806caa0 0x7fb86806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:47.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.968+0000 7fb87a59c700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb86806caa0 0x7fb86806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:47.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.968+0000 7fb8737fe700 1 -- 172.21.15.49:0/243577336 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb86c08bca0 con 0x7fb87c0fe250 2024-02-22T00:54:47.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.969+0000 7fb87a59c700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb86806caa0 0x7fb86806ef60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb864004f10 tx=0x7fb86400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:47.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:47.973+0000 7fb8737fe700 1 -- 172.21.15.49:0/243577336 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb86c090070 con 0x7fb87c0fe250 2024-02-22T00:54:48.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.192+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb87c10ad40 con 0x7fb86806caa0 2024-02-22T00:54:48.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.193+0000 7fb8737fe700 1 -- 172.21.15.49:0/243577336 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fb87c10ad40 con 0x7fb86806caa0 2024-02-22T00:54:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.195+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb86806caa0 msgr2=0x7fb86806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.195+0000 7fb880813700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb86806caa0 0x7fb86806ef60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb864004f10 tx=0x7fb86400b040).stop 2024-02-22T00:54:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fe250 msgr2=0x7fb87c1106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fe250 0x7fb87c1106e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb86c002780 tx=0x7fb86c009ee0).stop 2024-02-22T00:54:48.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 shutdown_connections 2024-02-22T00:54:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb86806caa0 0x7fb86806ef60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb87c0fd8f0 0x7fb87c1101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 --2- 172.21.15.49:0/243577336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb87c0fe250 0x7fb87c1106e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 >> 172.21.15.49:0/243577336 conn(0x7fb87c0f34b0 msgr2=0x7fb87c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 shutdown_connections 2024-02-22T00:54:48.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.196+0000 7fb880813700 1 -- 172.21.15.49:0/243577336 wait complete. 2024-02-22T00:54:48.208 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.298+0000 7f3520b3c700 1 -- 172.21.15.49:0/1203374222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 msgr2=0x7f351c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.298+0000 7f3520b3c700 1 --2- 172.21.15.49:0/1203374222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 0x7f351c0f6930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f35100047f0 tx=0x7f3510009cb0).stop 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.299+0000 7f3520b3c700 1 -- 172.21.15.49:0/1203374222 shutdown_connections 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.299+0000 7f3520b3c700 1 --2- 172.21.15.49:0/1203374222 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 0x7f351c0f6930 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.299+0000 7f3520b3c700 1 --2- 172.21.15.49:0/1203374222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c0fc7f0 0x7f351c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.299+0000 7f3520b3c700 1 -- 172.21.15.49:0/1203374222 >> 172.21.15.49:0/1203374222 conn(0x7f351c070590 msgr2=0x7f351c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.299+0000 7f3520b3c700 1 -- 172.21.15.49:0/1203374222 shutdown_connections 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.299+0000 7f3520b3c700 1 -- 172.21.15.49:0/1203374222 wait complete. 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.299+0000 7f3520b3c700 1 Processor -- start 2024-02-22T00:54:48.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.299+0000 7f3520b3c700 1 -- start start 2024-02-22T00:54:48.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3520b3c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c0fc7f0 0x7f351c10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3520b3c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 0x7f351c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3520b3c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c10ead0 con 0x7f351c0fd150 2024-02-22T00:54:48.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3520b3c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c10ec10 con 0x7f351c0fc7f0 2024-02-22T00:54:48.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3519d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 0x7f351c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3519d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 0x7f351c10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35208/0 (socket says 172.21.15.49:35208) 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3519d9b700 1 -- 172.21.15.49:0/2640667702 learned_addr learned my addr 172.21.15.49:0/2640667702 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f351a59c700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c0fc7f0 0x7f351c10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3519d9b700 1 -- 172.21.15.49:0/2640667702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c0fc7f0 msgr2=0x7f351c10dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3519d9b700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c0fc7f0 0x7f351c10dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3519d9b700 1 -- 172.21.15.49:0/2640667702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510005040 con 0x7f351c0fd150 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3519d9b700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 0x7f351c10e4d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f35100099f0 tx=0x7f3510009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f350b7fe700 1 -- 172.21.15.49:0/2640667702 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f351000e030 con 0x7f351c0fd150 2024-02-22T00:54:48.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f350b7fe700 1 -- 172.21.15.49:0/2640667702 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3510007e90 con 0x7f351c0fd150 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f350b7fe700 1 -- 172.21.15.49:0/2640667702 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3510018070 con 0x7f351c0fd150 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.300+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c108240 con 0x7f351c0fd150 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.301+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c1087a0 con 0x7f351c0fd150 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.301+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c05f590 con 0x7f351c0fd150 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.302+0000 7f350b7fe700 1 -- 172.21.15.49:0/2640667702 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f351001d420 con 0x7f351c0fd150 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.302+0000 7f350b7fe700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f350406caa0 0x7f350406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.302+0000 7f350b7fe700 1 -- 172.21.15.49:0/2640667702 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f351008d190 con 0x7f351c0fd150 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.302+0000 7f351a59c700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f350406caa0 0x7f350406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.303+0000 7f351a59c700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f350406caa0 0x7f350406ef60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f350c0041d0 tx=0x7f350c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:48.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.307+0000 7f350b7fe700 1 -- 172.21.15.49:0/2640667702 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f351005acf0 con 0x7f351c0fd150 2024-02-22T00:54:48.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:48 smithi049 ceph-mon[132694]: pgmap v536: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.521+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f351c108de0 con 0x7f350406caa0 2024-02-22T00:54:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.523+0000 7f350b7fe700 1 -- 172.21.15.49:0/2640667702 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f351c108de0 con 0x7f350406caa0 2024-02-22T00:54:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.524+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f350406caa0 msgr2=0x7f350406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.524+0000 7f3520b3c700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f350406caa0 0x7f350406ef60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f350c0041d0 tx=0x7f350c009040).stop 2024-02-22T00:54:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 msgr2=0x7f351c10e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 0x7f351c10e4d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f35100099f0 tx=0x7f3510009cb0).stop 2024-02-22T00:54:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 shutdown_connections 2024-02-22T00:54:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f350406caa0 0x7f350406ef60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f351c0fc7f0 0x7f351c10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 --2- 172.21.15.49:0/2640667702 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f351c0fd150 0x7f351c10e4d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 >> 172.21.15.49:0/2640667702 conn(0x7f351c070590 msgr2=0x7f351c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 shutdown_connections 2024-02-22T00:54:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.525+0000 7f3520b3c700 1 -- 172.21.15.49:0/2640667702 wait complete. 2024-02-22T00:54:48.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:48 smithi161 ceph-mon[113442]: pgmap v536: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:48.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.626+0000 7fceae17b700 1 -- 172.21.15.49:0/4035438097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 msgr2=0x7fcea806b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.626+0000 7fceae17b700 1 --2- 172.21.15.49:0/4035438097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 0x7fcea806b550 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fce980047f0 tx=0x7fce98009cb0).stop 2024-02-22T00:54:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.626+0000 7fceae17b700 1 -- 172.21.15.49:0/4035438097 shutdown_connections 2024-02-22T00:54:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.626+0000 7fceae17b700 1 --2- 172.21.15.49:0/4035438097 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea806ba40 0x7fcea8103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.626+0000 7fceae17b700 1 --2- 172.21.15.49:0/4035438097 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 0x7fcea806b550 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.626+0000 7fceae17b700 1 -- 172.21.15.49:0/4035438097 >> 172.21.15.49:0/4035438097 conn(0x7fcea80f3530 msgr2=0x7fcea80f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:48.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.626+0000 7fceae17b700 1 -- 172.21.15.49:0/4035438097 shutdown_connections 2024-02-22T00:54:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.626+0000 7fceae17b700 1 -- 172.21.15.49:0/4035438097 wait complete. 2024-02-22T00:54:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.627+0000 7fceae17b700 1 Processor -- start 2024-02-22T00:54:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.627+0000 7fceae17b700 1 -- start start 2024-02-22T00:54:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fceae17b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 0x7fcea8110460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fceae17b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea806ba40 0x7fcea8110950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fceae17b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8110f50 con 0x7fcea806b170 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fceae17b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8111090 con 0x7fcea806ba40 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 0x7fcea8110460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 0x7fcea8110460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35236/0 (socket says 172.21.15.49:35236) 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea77fe700 1 -- 172.21.15.49:0/842053238 learned_addr learned my addr 172.21.15.49:0/842053238 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea6ffd700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea806ba40 0x7fcea8110950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea77fe700 1 -- 172.21.15.49:0/842053238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea806ba40 msgr2=0x7fcea8110950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea77fe700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea806ba40 0x7fcea8110950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea77fe700 1 -- 172.21.15.49:0/842053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98005040 con 0x7fcea806b170 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea6ffd700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea806ba40 0x7fcea8110950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea77fe700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 0x7fcea8110460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fce98005010 tx=0x7fce98009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:48.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea4ff9700 1 -- 172.21.15.49:0/842053238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9800e030 con 0x7fcea806b170 2024-02-22T00:54:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea4ff9700 1 -- 172.21.15.49:0/842053238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce98007e90 con 0x7fcea806b170 2024-02-22T00:54:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fcea4ff9700 1 -- 172.21.15.49:0/842053238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce98018070 con 0x7fcea806b170 2024-02-22T00:54:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea810a6f0 con 0x7fcea806b170 2024-02-22T00:54:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.628+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea810abd0 con 0x7fcea806b170 2024-02-22T00:54:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.629+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea805f570 con 0x7fcea806b170 2024-02-22T00:54:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.630+0000 7fcea4ff9700 1 -- 172.21.15.49:0/842053238 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fce9801d420 con 0x7fcea806b170 2024-02-22T00:54:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.630+0000 7fcea4ff9700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9006ca30 0x7fce9006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.630+0000 7fcea4ff9700 1 -- 172.21.15.49:0/842053238 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fce9808d120 con 0x7fcea806b170 2024-02-22T00:54:48.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.630+0000 7fcea6ffd700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9006ca30 0x7fce9006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.631+0000 7fcea6ffd700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9006ca30 0x7fce9006eef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fcea810bda0 tx=0x7fce9c009e00).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:48.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.635+0000 7fcea4ff9700 1 -- 172.21.15.49:0/842053238 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fce9805ac80 con 0x7fcea806b170 2024-02-22T00:54:48.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.842+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcea810bb50 con 0x7fce9006ca30 2024-02-22T00:54:48.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.852+0000 7fcea4ff9700 1 -- 172.21.15.49:0/842053238 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fcea810bb50 con 0x7fce9006ca30 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (18m) 11m ago 29m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (15m) 11m ago 29m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (15m) 11m ago 28m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (17m) 11m ago 28m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (12m) 11m ago 24m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (12m) 11m ago 24m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (11m) 11m ago 23m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (11m) 11m ago 24m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (19m) 11m ago 30m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (18m) 11m ago 28m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:54:48.855 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (16m) 11m ago 30m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (16m) 11m ago 28m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (18m) 11m ago 28m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (18m) 11m ago 28m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (15m) 11m ago 27m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (14m) 11m ago 27m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (14m) 11m ago 26m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (13m) 11m ago 26m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (13m) 11m ago 26m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (12m) 11m ago 25m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:54:48.856 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (18m) 11m ago 28m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9006ca30 msgr2=0x7fce9006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9006ca30 0x7fce9006eef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fcea810bda0 tx=0x7fce9c009e00).stop 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 msgr2=0x7fcea8110460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 0x7fcea8110460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fce98005010 tx=0x7fce98009cb0).stop 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 shutdown_connections 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9006ca30 0x7fce9006eef0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea806b170 0x7fcea8110460 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 --2- 172.21.15.49:0/842053238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea806ba40 0x7fcea8110950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 >> 172.21.15.49:0/842053238 conn(0x7fcea80f3530 msgr2=0x7fcea81015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:48.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 shutdown_connections 2024-02-22T00:54:48.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.854+0000 7fceae17b700 1 -- 172.21.15.49:0/842053238 wait complete. 2024-02-22T00:54:48.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 -- 172.21.15.49:0/1342967202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 msgr2=0x7f75c8101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 --2- 172.21.15.49:0/1342967202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 0x7f75c8101910 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f75b00047f0 tx=0x7f75b0009cb0).stop 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 -- 172.21.15.49:0/1342967202 shutdown_connections 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 --2- 172.21.15.49:0/1342967202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 0x7f75c8101910 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 --2- 172.21.15.49:0/1342967202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75c80f88a0 0x7f75c80f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 -- 172.21.15.49:0/1342967202 >> 172.21.15.49:0/1342967202 conn(0x7f75c8070590 msgr2=0x7f75c80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 -- 172.21.15.49:0/1342967202 shutdown_connections 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 -- 172.21.15.49:0/1342967202 wait complete. 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 Processor -- start 2024-02-22T00:54:48.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.955+0000 7f75ce319700 1 -- start start 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75ce319700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75c80f88a0 0x7f75c810e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75ce319700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 0x7f75c810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75ce319700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c810ecb0 con 0x7f75c80f9200 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75ce319700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c810edf0 con 0x7f75c80f88a0 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 0x7f75c810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 0x7f75c810e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35254/0 (socket says 172.21.15.49:35254) 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c77fe700 1 -- 172.21.15.49:0/3902016982 learned_addr learned my addr 172.21.15.49:0/3902016982 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c7fff700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75c80f88a0 0x7f75c810e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c77fe700 1 -- 172.21.15.49:0/3902016982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75c80f88a0 msgr2=0x7f75c810e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c77fe700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75c80f88a0 0x7f75c810e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:48.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c77fe700 1 -- 172.21.15.49:0/3902016982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0005040 con 0x7f75c80f9200 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c7fff700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75c80f88a0 0x7f75c810e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c77fe700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 0x7f75c810e6b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f75b0009380 tx=0x7f75b0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c57fa700 1 -- 172.21.15.49:0/3902016982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b0018070 con 0x7f75c80f9200 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c57fa700 1 -- 172.21.15.49:0/3902016982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75b0007e90 con 0x7f75c80f9200 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75c57fa700 1 -- 172.21.15.49:0/3902016982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b001c380 con 0x7f75c80f9200 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.956+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c8108420 con 0x7f75c80f9200 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.957+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c8108900 con 0x7f75c80f9200 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.957+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c805f590 con 0x7f75c80f9200 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.958+0000 7f75c57fa700 1 -- 172.21.15.49:0/3902016982 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f75b00123c0 con 0x7f75c80f9200 2024-02-22T00:54:48.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.958+0000 7f75c57fa700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75b406cab0 0x7f75b406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:48.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.958+0000 7f75c57fa700 1 -- 172.21.15.49:0/3902016982 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f75b008cae0 con 0x7f75c80f9200 2024-02-22T00:54:48.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.958+0000 7f75c7fff700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75b406cab0 0x7f75b406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:48.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.959+0000 7f75c7fff700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75b406cab0 0x7f75b406ef70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f75b8007fd0 tx=0x7f75b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:48.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:48.963+0000 7f75c57fa700 1 -- 172.21.15.49:0/3902016982 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f75b005a640 con 0x7f75c80f9200 2024-02-22T00:54:49.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.244+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f75c81098e0 con 0x7f75c80f9200 2024-02-22T00:54:49.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.245+0000 7f75c57fa700 1 -- 172.21.15.49:0/3902016982 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f75b005a1d0 con 0x7f75c80f9200 2024-02-22T00:54:49.247 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:54:49.247 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:54:49.247 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:54:49.248 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:54:49.249 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:54:49.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75b406cab0 msgr2=0x7f75b406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75b406cab0 0x7f75b406ef70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f75b8007fd0 tx=0x7f75b800b040).stop 2024-02-22T00:54:49.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 msgr2=0x7f75c810e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 0x7f75c810e6b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f75b0009380 tx=0x7f75b0009cb0).stop 2024-02-22T00:54:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 shutdown_connections 2024-02-22T00:54:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f75b406cab0 0x7f75b406ef70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75c80f88a0 0x7f75c810e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 --2- 172.21.15.49:0/3902016982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c80f9200 0x7f75c810e6b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 >> 172.21.15.49:0/3902016982 conn(0x7f75c8070590 msgr2=0x7f75c8100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 shutdown_connections 2024-02-22T00:54:49.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.247+0000 7f75ce319700 1 -- 172.21.15.49:0/3902016982 wait complete. 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 -- 172.21.15.49:0/2028187293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 msgr2=0x7f6234101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 --2- 172.21.15.49:0/2028187293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 0x7f6234101910 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f62280047f0 tx=0x7f6228009cb0).stop 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 -- 172.21.15.49:0/2028187293 shutdown_connections 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 --2- 172.21.15.49:0/2028187293 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 0x7f6234101910 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 --2- 172.21.15.49:0/2028187293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62340f88a0 0x7f62340f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 -- 172.21.15.49:0/2028187293 >> 172.21.15.49:0/2028187293 conn(0x7f6234070590 msgr2=0x7f62340f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 -- 172.21.15.49:0/2028187293 shutdown_connections 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 -- 172.21.15.49:0/2028187293 wait complete. 2024-02-22T00:54:49.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.348+0000 7f6239a90700 1 Processor -- start 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6239a90700 1 -- start start 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6239a90700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62340f88a0 0x7f623410e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6239a90700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 0x7f623410e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6239a90700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623410ec70 con 0x7f62340f9200 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6239a90700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6234108290 con 0x7f62340f88a0 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6232ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 0x7f623410e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6232ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 0x7f623410e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35272/0 (socket says 172.21.15.49:35272) 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6232ffd700 1 -- 172.21.15.49:0/3050850036 learned_addr learned my addr 172.21.15.49:0/3050850036 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6232ffd700 1 -- 172.21.15.49:0/3050850036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62340f88a0 msgr2=0x7f623410e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6232ffd700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62340f88a0 0x7f623410e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6232ffd700 1 -- 172.21.15.49:0/3050850036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228005040 con 0x7f62340f9200 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.349+0000 7f6232ffd700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 0x7f623410e5e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f622800b120 tx=0x7f6228009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:49.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.350+0000 7f6230f74700 1 -- 172.21.15.49:0/3050850036 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f622800e030 con 0x7f62340f9200 2024-02-22T00:54:49.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.350+0000 7f6230f74700 1 -- 172.21.15.49:0/3050850036 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6228007e90 con 0x7f62340f9200 2024-02-22T00:54:49.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.350+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62341084e0 con 0x7f62340f9200 2024-02-22T00:54:49.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.350+0000 7f6230f74700 1 -- 172.21.15.49:0/3050850036 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6228018070 con 0x7f62340f9200 2024-02-22T00:54:49.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.350+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62341089c0 con 0x7f62340f9200 2024-02-22T00:54:49.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.351+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623405f590 con 0x7f62340f9200 2024-02-22T00:54:49.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.351+0000 7f6230f74700 1 -- 172.21.15.49:0/3050850036 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f622801d420 con 0x7f62340f9200 2024-02-22T00:54:49.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.351+0000 7f6230f74700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621c06caa0 0x7f621c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:49.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.352+0000 7f6230f74700 1 -- 172.21.15.49:0/3050850036 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f622808d1b0 con 0x7f62340f9200 2024-02-22T00:54:49.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.352+0000 7f62337fe700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621c06caa0 0x7f621c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:49.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.352+0000 7f62337fe700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621c06caa0 0x7f621c06ef60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f6224009700 tx=0x7f6224006c30).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:49.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.356+0000 7f6230f74700 1 -- 172.21.15.49:0/3050850036 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f622805ad10 con 0x7f62340f9200 2024-02-22T00:54:49.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:49 smithi049 ceph-mon[132694]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:49.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:49 smithi161 ceph-mon[113442]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.596+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6234109770 con 0x7f62340f9200 2024-02-22T00:54:49.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.596+0000 7f6230f74700 1 -- 172.21.15.49:0/3050850036 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f622805a8a0 con 0x7f62340f9200 2024-02-22T00:54:49.598 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:54:49.599 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:54:49.600 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:54:49.600 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:54:49.600 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:54:49.601 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:54:49.601 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:54:49.601 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:54:49.601 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:54:49.601 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:54:49.601 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:54:49.601 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:54:49.601 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:54:49.603 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:54:49.603 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:54:49.603 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:54:49.603 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:54:49.603 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:54:49.604 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:54:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621c06caa0 msgr2=0x7f621c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621c06caa0 0x7f621c06ef60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f6224009700 tx=0x7f6224006c30).stop 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 msgr2=0x7f623410e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 0x7f623410e5e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f622800b120 tx=0x7f6228009cb0).stop 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 shutdown_connections 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f621c06caa0 0x7f621c06ef60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62340f88a0 0x7f623410e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 --2- 172.21.15.49:0/3050850036 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f62340f9200 0x7f623410e5e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 >> 172.21.15.49:0/3050850036 conn(0x7f6234070590 msgr2=0x7f62340fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 shutdown_connections 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.598+0000 7f6239a90700 1 -- 172.21.15.49:0/3050850036 wait complete. 2024-02-22T00:54:49.606 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:54:49.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.700+0000 7f8cc4766700 1 -- 172.21.15.49:0/2596174797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fd150 msgr2=0x7f8cbc0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.700+0000 7f8cc4766700 1 --2- 172.21.15.49:0/2596174797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fd150 0x7f8cbc0f6930 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f8cac0047f0 tx=0x7f8cac009cb0).stop 2024-02-22T00:54:49.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.700+0000 7f8cc4766700 1 -- 172.21.15.49:0/2596174797 shutdown_connections 2024-02-22T00:54:49.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.700+0000 7f8cc4766700 1 --2- 172.21.15.49:0/2596174797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fd150 0x7f8cbc0f6930 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.700+0000 7f8cc4766700 1 --2- 172.21.15.49:0/2596174797 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cbc0fc7f0 0x7f8cbc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.700+0000 7f8cc4766700 1 -- 172.21.15.49:0/2596174797 >> 172.21.15.49:0/2596174797 conn(0x7f8cbc070590 msgr2=0x7f8cbc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:49.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.700+0000 7f8cc4766700 1 -- 172.21.15.49:0/2596174797 shutdown_connections 2024-02-22T00:54:49.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.701+0000 7f8cc4766700 1 -- 172.21.15.49:0/2596174797 wait complete. 2024-02-22T00:54:49.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.701+0000 7f8cc4766700 1 Processor -- start 2024-02-22T00:54:49.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.701+0000 7f8cc4766700 1 -- start start 2024-02-22T00:54:49.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc4766700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fc7f0 0x7f8cbc10ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:49.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc4766700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cbc0fd150 0x7f8cbc10d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:49.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc4766700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc10d9c0 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc4766700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc10db00 con 0x7f8cbc0fd150 2024-02-22T00:54:49.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc2502700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fc7f0 0x7f8cbc10ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc2502700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fc7f0 0x7f8cbc10ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35296/0 (socket says 172.21.15.49:35296) 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc2502700 1 -- 172.21.15.49:0/3066989018 learned_addr learned my addr 172.21.15.49:0/3066989018 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc1d01700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cbc0fd150 0x7f8cbc10d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc2502700 1 -- 172.21.15.49:0/3066989018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cbc0fd150 msgr2=0x7f8cbc10d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc2502700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cbc0fd150 0x7f8cbc10d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc2502700 1 -- 172.21.15.49:0/3066989018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac005040 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.702+0000 7f8cc2502700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fc7f0 0x7f8cbc10ced0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f8cb80041d0 tx=0x7f8cb8009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.703+0000 7f8cb37fe700 1 -- 172.21.15.49:0/3066989018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb8007b40 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.703+0000 7f8cb37fe700 1 -- 172.21.15.49:0/3066989018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8cb800f040 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.703+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cbc107190 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.703+0000 7f8cb37fe700 1 -- 172.21.15.49:0/3066989018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cb80147b0 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.703+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc107750 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.704+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc05f590 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.704+0000 7f8cb37fe700 1 -- 172.21.15.49:0/3066989018 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8cb8009110 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.705+0000 7f8cb37fe700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ca806caa0 0x7f8ca806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:49.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.705+0000 7f8cb37fe700 1 -- 172.21.15.49:0/3066989018 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8cb808bda0 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.705+0000 7f8cc1d01700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ca806caa0 0x7f8ca806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:49.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.705+0000 7f8cc1d01700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ca806caa0 0x7f8ca806ef60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f8cbc108810 tx=0x7f8cac00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:49.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.709+0000 7f8cb37fe700 1 -- 172.21.15.49:0/3066989018 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8cb8059900 con 0x7f8cbc0fc7f0 2024-02-22T00:54:49.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.927+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cbc107df0 con 0x7f8ca806caa0 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.929+0000 7f8cb37fe700 1 -- 172.21.15.49:0/3066989018 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f8cbc107df0 con 0x7f8ca806caa0 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:54:49.931 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:54:49.932 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:54:49.932 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:54:49.932 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:54:49.932 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:54:49.932 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:54:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ca806caa0 msgr2=0x7f8ca806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ca806caa0 0x7f8ca806ef60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f8cbc108810 tx=0x7f8cac00b040).stop 2024-02-22T00:54:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fc7f0 msgr2=0x7f8cbc10ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fc7f0 0x7f8cbc10ced0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f8cb80041d0 tx=0x7f8cb8009f60).stop 2024-02-22T00:54:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 shutdown_connections 2024-02-22T00:54:49.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ca806caa0 0x7f8ca806ef60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cbc0fc7f0 0x7f8cbc10ced0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 --2- 172.21.15.49:0/3066989018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8cbc0fd150 0x7f8cbc10d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:49.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 >> 172.21.15.49:0/3066989018 conn(0x7f8cbc070590 msgr2=0x7f8cbc0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:49.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 shutdown_connections 2024-02-22T00:54:49.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:49.931+0000 7f8cc4766700 1 -- 172.21.15.49:0/3066989018 wait complete. 2024-02-22T00:54:50.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.032+0000 7fb94c0b1700 1 -- 172.21.15.49:0/1195703737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 msgr2=0x7fb9440fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.032+0000 7fb94c0b1700 1 --2- 172.21.15.49:0/1195703737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 0x7fb9440fcbd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fb9380047f0 tx=0x7fb938009cb0).stop 2024-02-22T00:54:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.032+0000 7fb94c0b1700 1 -- 172.21.15.49:0/1195703737 shutdown_connections 2024-02-22T00:54:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.032+0000 7fb94c0b1700 1 --2- 172.21.15.49:0/1195703737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9440fd150 0x7fb9440f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.032+0000 7fb94c0b1700 1 --2- 172.21.15.49:0/1195703737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 0x7fb9440fcbd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.032+0000 7fb94c0b1700 1 -- 172.21.15.49:0/1195703737 >> 172.21.15.49:0/1195703737 conn(0x7fb944070590 msgr2=0x7fb9440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.032+0000 7fb94c0b1700 1 -- 172.21.15.49:0/1195703737 shutdown_connections 2024-02-22T00:54:50.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.032+0000 7fb94c0b1700 1 -- 172.21.15.49:0/1195703737 wait complete. 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb94c0b1700 1 Processor -- start 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb94c0b1700 1 -- start start 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb94c0b1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 0x7fb94410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb94c0b1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9440fd150 0x7fb94410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb94c0b1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94410eae0 con 0x7fb9440fc7f0 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb94c0b1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94410ec20 con 0x7fb9440fd150 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb949e4d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 0x7fb94410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb949e4d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 0x7fb94410dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35314/0 (socket says 172.21.15.49:35314) 2024-02-22T00:54:50.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb949e4d700 1 -- 172.21.15.49:0/2483463949 learned_addr learned my addr 172.21.15.49:0/2483463949 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb949e4d700 1 -- 172.21.15.49:0/2483463949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9440fd150 msgr2=0x7fb94410e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb94964c700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9440fd150 0x7fb94410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb949e4d700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9440fd150 0x7fb94410e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb949e4d700 1 -- 172.21.15.49:0/2483463949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938005040 con 0x7fb9440fc7f0 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb94964c700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9440fd150 0x7fb94410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.033+0000 7fb949e4d700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 0x7fb94410dff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb93800b120 tx=0x7fb938009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.034+0000 7fb936ffd700 1 -- 172.21.15.49:0/2483463949 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93800e030 con 0x7fb9440fc7f0 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.034+0000 7fb936ffd700 1 -- 172.21.15.49:0/2483463949 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb938007e90 con 0x7fb9440fc7f0 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.034+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb944108250 con 0x7fb9440fc7f0 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.034+0000 7fb936ffd700 1 -- 172.21.15.49:0/2483463949 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb938018070 con 0x7fb9440fc7f0 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.034+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9441087b0 con 0x7fb9440fc7f0 2024-02-22T00:54:50.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.034+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94405f590 con 0x7fb9440fc7f0 2024-02-22T00:54:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.035+0000 7fb936ffd700 1 -- 172.21.15.49:0/2483463949 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb93801d420 con 0x7fb9440fc7f0 2024-02-22T00:54:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.036+0000 7fb936ffd700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb93006caa0 0x7fb93006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:54:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.036+0000 7fb936ffd700 1 -- 172.21.15.49:0/2483463949 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb93808d520 con 0x7fb9440fc7f0 2024-02-22T00:54:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.036+0000 7fb94964c700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb93006caa0 0x7fb93006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:54:50.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.036+0000 7fb94964c700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb93006caa0 0x7fb93006ef60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb944109930 tx=0x7fb940009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:54:50.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.040+0000 7fb936ffd700 1 -- 172.21.15.49:0/2483463949 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb93805b0e0 con 0x7fb9440fc7f0 2024-02-22T00:54:50.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.321+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb944047540 con 0x7fb9440fc7f0 2024-02-22T00:54:50.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.321+0000 7fb936ffd700 1 -- 172.21.15.49:0/2483463949 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fb93805ac70 con 0x7fb9440fc7f0 2024-02-22T00:54:50.324 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:54:50.324 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:54:50.324 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:54:50.324 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:54:50.324 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:54:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb93006caa0 msgr2=0x7fb93006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb93006caa0 0x7fb93006ef60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb944109930 tx=0x7fb940009040).stop 2024-02-22T00:54:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 msgr2=0x7fb94410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:54:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 0x7fb94410dff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fb93800b120 tx=0x7fb938009cb0).stop 2024-02-22T00:54:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 shutdown_connections 2024-02-22T00:54:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb93006caa0 0x7fb93006ef60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9440fc7f0 0x7fb94410dff0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 --2- 172.21.15.49:0/2483463949 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9440fd150 0x7fb94410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:54:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 >> 172.21.15.49:0/2483463949 conn(0x7fb944070590 msgr2=0x7fb944060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:54:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 shutdown_connections 2024-02-22T00:54:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:54:50.323+0000 7fb94c0b1700 1 -- 172.21.15.49:0/2483463949 wait complete. 2024-02-22T00:54:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:50 smithi049 ceph-mon[132694]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:50 smithi049 ceph-mon[132694]: pgmap v537: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:50 smithi049 ceph-mon[132694]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:50 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3902016982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:54:50.428 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:50 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3050850036' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:54:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:50 smithi161 ceph-mon[113442]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:50 smithi161 ceph-mon[113442]: pgmap v537: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:50 smithi161 ceph-mon[113442]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:50.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:50 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3902016982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:54:50.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:50 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3050850036' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:54:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:51 smithi161 ceph-mon[113442]: from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:51.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:51 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2483463949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:54:51.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:51 smithi049 ceph-mon[132694]: from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:54:51.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:51 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2483463949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:54:52.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:52 smithi161 ceph-mon[113442]: pgmap v538: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:52.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:52 smithi049 ceph-mon[132694]: pgmap v538: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:54.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:54 smithi161 ceph-mon[113442]: pgmap v539: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:54 smithi049 ceph-mon[132694]: pgmap v539: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:56.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:56 smithi161 ceph-mon[113442]: pgmap v540: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:56.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:56 smithi049 ceph-mon[132694]: pgmap v540: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:58 smithi161 ceph-mon[113442]: pgmap v541: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:58.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:54:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:54:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:58 smithi049 ceph-mon[132694]: pgmap v541: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:54:58.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:54:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:55:00.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:00 smithi161 ceph-mon[113442]: pgmap v542: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:00.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:00 smithi049 ceph-mon[132694]: pgmap v542: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:02.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:02 smithi161 ceph-mon[113442]: pgmap v543: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:02.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:02 smithi049 ceph-mon[132694]: pgmap v543: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:04.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:04 smithi161 ceph-mon[113442]: pgmap v544: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:04.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:04 smithi049 ceph-mon[132694]: pgmap v544: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:06.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:06 smithi161 ceph-mon[113442]: pgmap v545: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:06.680 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:06 smithi049 ceph-mon[132694]: pgmap v545: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:08.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:08 smithi161 ceph-mon[113442]: pgmap v546: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:08.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:08 smithi049 ceph-mon[132694]: pgmap v546: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:10.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:10 smithi161 ceph-mon[113442]: pgmap v547: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:10.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:10 smithi049 ceph-mon[132694]: pgmap v547: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:12.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:12 smithi161 ceph-mon[113442]: pgmap v548: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:12.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:12 smithi049 ceph-mon[132694]: pgmap v548: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:13.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:55:13.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:55:14.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:14 smithi161 ceph-mon[113442]: pgmap v549: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:14.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:14 smithi049 ceph-mon[132694]: pgmap v549: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:16.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:16 smithi161 ceph-mon[113442]: pgmap v550: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:16.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:16 smithi049 ceph-mon[132694]: pgmap v550: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:18.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:18 smithi161 ceph-mon[113442]: pgmap v551: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:18.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:18 smithi049 ceph-mon[132694]: pgmap v551: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:20.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.438+0000 7fea4a71b700 1 -- 172.21.15.49:0/843155328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 msgr2=0x7fea440fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.438+0000 7fea4a71b700 1 --2- 172.21.15.49:0/843155328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 0x7fea440fdcf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fea340047f0 tx=0x7fea34009cb0).stop 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.438+0000 7fea4a71b700 1 -- 172.21.15.49:0/843155328 shutdown_connections 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.438+0000 7fea4a71b700 1 --2- 172.21.15.49:0/843155328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea440fe270 0x7fea440f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.438+0000 7fea4a71b700 1 --2- 172.21.15.49:0/843155328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 0x7fea440fdcf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.438+0000 7fea4a71b700 1 -- 172.21.15.49:0/843155328 >> 172.21.15.49:0/843155328 conn(0x7fea440f3530 msgr2=0x7fea440f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.438+0000 7fea4a71b700 1 -- 172.21.15.49:0/843155328 shutdown_connections 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.438+0000 7fea4a71b700 1 -- 172.21.15.49:0/843155328 wait complete. 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea4a71b700 1 Processor -- start 2024-02-22T00:55:20.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea4a71b700 1 -- start start 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea4a71b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 0x7fea4410dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea4a71b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea440fe270 0x7fea4410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea4a71b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4410ead0 con 0x7fea440fd910 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea4a71b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4410ec10 con 0x7fea440fe270 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea43fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 0x7fea4410dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea43fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 0x7fea4410dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44416/0 (socket says 172.21.15.49:44416) 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea43fff700 1 -- 172.21.15.49:0/968578976 learned_addr learned my addr 172.21.15.49:0/968578976 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea437fe700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea440fe270 0x7fea4410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea43fff700 1 -- 172.21.15.49:0/968578976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea440fe270 msgr2=0x7fea4410e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:20.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea43fff700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea440fe270 0x7fea4410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.439+0000 7fea43fff700 1 -- 172.21.15.49:0/968578976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea34005040 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.440+0000 7fea43fff700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 0x7fea4410dfe0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fea3400b120 tx=0x7fea34009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.440+0000 7fea417fa700 1 -- 172.21.15.49:0/968578976 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea3400e030 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.440+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea44108240 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.440+0000 7fea417fa700 1 -- 172.21.15.49:0/968578976 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea34007e90 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.440+0000 7fea417fa700 1 -- 172.21.15.49:0/968578976 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea34018070 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.440+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea441087a0 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.441+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4405f570 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.441+0000 7fea417fa700 1 -- 172.21.15.49:0/968578976 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fea3401d420 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.442+0000 7fea417fa700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea2c06caa0 0x7fea2c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.442+0000 7fea417fa700 1 -- 172.21.15.49:0/968578976 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fea3408d250 con 0x7fea440fd910 2024-02-22T00:55:20.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.442+0000 7fea437fe700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea2c06caa0 0x7fea2c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:20.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.442+0000 7fea437fe700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea2c06caa0 0x7fea2c06ef60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fea44109920 tx=0x7fea38009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:20.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.446+0000 7fea417fa700 1 -- 172.21.15.49:0/968578976 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fea3405adb0 con 0x7fea440fd910 2024-02-22T00:55:20.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:20 smithi161 ceph-mon[113442]: pgmap v552: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:20.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.662+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea44109770 con 0x7fea2c06caa0 2024-02-22T00:55:20.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.663+0000 7fea417fa700 1 -- 172.21.15.49:0/968578976 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fea44109770 con 0x7fea2c06caa0 2024-02-22T00:55:20.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea2c06caa0 msgr2=0x7fea2c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:20.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea2c06caa0 0x7fea2c06ef60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fea44109920 tx=0x7fea38009040).stop 2024-02-22T00:55:20.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 msgr2=0x7fea4410dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:20.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 0x7fea4410dfe0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fea3400b120 tx=0x7fea34009cb0).stop 2024-02-22T00:55:20.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 shutdown_connections 2024-02-22T00:55:20.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fea2c06caa0 0x7fea2c06ef60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea440fd910 0x7fea4410dfe0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 --2- 172.21.15.49:0/968578976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea440fe270 0x7fea4410e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 >> 172.21.15.49:0/968578976 conn(0x7fea440f3530 msgr2=0x7fea440fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:20.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 shutdown_connections 2024-02-22T00:55:20.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.666+0000 7fea4a71b700 1 -- 172.21.15.49:0/968578976 wait complete. 2024-02-22T00:55:20.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:20 smithi049 ceph-mon[132694]: pgmap v552: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:20.678 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:55:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.768+0000 7fd1c6a76700 1 -- 172.21.15.49:0/3321312343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 msgr2=0x7fd1c00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.768+0000 7fd1c6a76700 1 --2- 172.21.15.49:0/3321312343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 0x7fd1c00f6930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fd1ac0047f0 tx=0x7fd1ac009cb0).stop 2024-02-22T00:55:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.768+0000 7fd1c6a76700 1 -- 172.21.15.49:0/3321312343 shutdown_connections 2024-02-22T00:55:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.768+0000 7fd1c6a76700 1 --2- 172.21.15.49:0/3321312343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 0x7fd1c00f6930 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.768+0000 7fd1c6a76700 1 --2- 172.21.15.49:0/3321312343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1c00fc7f0 0x7fd1c00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:20.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.768+0000 7fd1c6a76700 1 -- 172.21.15.49:0/3321312343 >> 172.21.15.49:0/3321312343 conn(0x7fd1c0070590 msgr2=0x7fd1c00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:20.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.768+0000 7fd1c6a76700 1 -- 172.21.15.49:0/3321312343 shutdown_connections 2024-02-22T00:55:20.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.768+0000 7fd1c6a76700 1 -- 172.21.15.49:0/3321312343 wait complete. 2024-02-22T00:55:20.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.769+0000 7fd1c6a76700 1 Processor -- start 2024-02-22T00:55:20.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.769+0000 7fd1c6a76700 1 -- start start 2024-02-22T00:55:20.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1c6a76700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1c00fc7f0 0x7fd1c010cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:20.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1c6a76700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 0x7fd1c010d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:20.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1c6a76700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c010db00 con 0x7fd1c00fd150 2024-02-22T00:55:20.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1c6a76700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c0107120 con 0x7fd1c00fc7f0 2024-02-22T00:55:20.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 0x7fd1c010d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 0x7fd1c010d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44426/0 (socket says 172.21.15.49:44426) 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bffff700 1 -- 172.21.15.49:0/1666532661 learned_addr learned my addr 172.21.15.49:0/1666532661 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1c4812700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1c00fc7f0 0x7fd1c010cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bffff700 1 -- 172.21.15.49:0/1666532661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1c00fc7f0 msgr2=0x7fd1c010cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bffff700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1c00fc7f0 0x7fd1c010cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bffff700 1 -- 172.21.15.49:0/1666532661 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac005040 con 0x7fd1c00fd150 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1c4812700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1c00fc7f0 0x7fd1c010cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bffff700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 0x7fd1c010d470 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fd1ac0099f0 tx=0x7fd1ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bdf76700 1 -- 172.21.15.49:0/1666532661 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ac00e030 con 0x7fd1c00fd150 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c0107370 con 0x7fd1c00fd150 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bdf76700 1 -- 172.21.15.49:0/1666532661 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1ac007e90 con 0x7fd1c00fd150 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.770+0000 7fd1bdf76700 1 -- 172.21.15.49:0/1666532661 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1ac018070 con 0x7fd1c00fd150 2024-02-22T00:55:20.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.771+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c0107850 con 0x7fd1c00fd150 2024-02-22T00:55:20.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.771+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c005f590 con 0x7fd1c00fd150 2024-02-22T00:55:20.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.772+0000 7fd1bdf76700 1 -- 172.21.15.49:0/1666532661 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd1ac01d420 con 0x7fd1c00fd150 2024-02-22T00:55:20.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.772+0000 7fd1bdf76700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd1b006caf0 0x7fd1b006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:20.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.773+0000 7fd1c4812700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd1b006caf0 0x7fd1b006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:20.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.773+0000 7fd1bdf76700 1 -- 172.21.15.49:0/1666532661 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd1ac08d2f0 con 0x7fd1c00fd150 2024-02-22T00:55:20.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.773+0000 7fd1c4812700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd1b006caf0 0x7fd1b006efb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd1b400a900 tx=0x7fd1b4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:20.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.777+0000 7fd1bdf76700 1 -- 172.21.15.49:0/1666532661 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd1ac05ad90 con 0x7fd1c00fd150 2024-02-22T00:55:20.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.992+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1c0108670 con 0x7fd1b006caf0 2024-02-22T00:55:20.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.993+0000 7fd1bdf76700 1 -- 172.21.15.49:0/1666532661 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd1c0108670 con 0x7fd1b006caf0 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.995+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd1b006caf0 msgr2=0x7fd1b006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.995+0000 7fd1c6a76700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd1b006caf0 0x7fd1b006efb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd1b400a900 tx=0x7fd1b4008040).stop 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.995+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 msgr2=0x7fd1c010d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.995+0000 7fd1c6a76700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 0x7fd1c010d470 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fd1ac0099f0 tx=0x7fd1ac009cb0).stop 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.996+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 shutdown_connections 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.996+0000 7fd1c6a76700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd1b006caf0 0x7fd1b006efb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.996+0000 7fd1c6a76700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1c00fc7f0 0x7fd1c010cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.996+0000 7fd1c6a76700 1 --2- 172.21.15.49:0/1666532661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd1c00fd150 0x7fd1c010d470 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.996+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 >> 172.21.15.49:0/1666532661 conn(0x7fd1c0070590 msgr2=0x7fd1c00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.996+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 shutdown_connections 2024-02-22T00:55:20.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:20.996+0000 7fd1c6a76700 1 -- 172.21.15.49:0/1666532661 wait complete. 2024-02-22T00:55:21.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.098+0000 7fcb56f77700 1 -- 172.21.15.49:0/519208471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 msgr2=0x7fcb500f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.098+0000 7fcb56f77700 1 --2- 172.21.15.49:0/519208471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 0x7fcb500f8b00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fcb440047f0 tx=0x7fcb44009cb0).stop 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.098+0000 7fcb56f77700 1 -- 172.21.15.49:0/519208471 shutdown_connections 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.098+0000 7fcb56f77700 1 --2- 172.21.15.49:0/519208471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb500f5f80 0x7fcb500f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.098+0000 7fcb56f77700 1 --2- 172.21.15.49:0/519208471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 0x7fcb500f8b00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.098+0000 7fcb56f77700 1 -- 172.21.15.49:0/519208471 >> 172.21.15.49:0/519208471 conn(0x7fcb5006ce40 msgr2=0x7fcb5006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.098+0000 7fcb56f77700 1 -- 172.21.15.49:0/519208471 shutdown_connections 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.098+0000 7fcb56f77700 1 -- 172.21.15.49:0/519208471 wait complete. 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb56f77700 1 Processor -- start 2024-02-22T00:55:21.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb56f77700 1 -- start start 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb56f77700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb500f5f80 0x7fcb501102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb56f77700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 0x7fcb501107b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb56f77700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50110db0 con 0x7fcb500f8720 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb56f77700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50110ef0 con 0x7fcb500f5f80 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb4ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 0x7fcb501107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb4ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 0x7fcb501107b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44430/0 (socket says 172.21.15.49:44430) 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb54d13700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb500f5f80 0x7fcb501102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.099+0000 7fcb4ffff700 1 -- 172.21.15.49:0/463636712 learned_addr learned my addr 172.21.15.49:0/463636712 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb4ffff700 1 -- 172.21.15.49:0/463636712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb500f5f80 msgr2=0x7fcb501102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb4ffff700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb500f5f80 0x7fcb501102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb4ffff700 1 -- 172.21.15.49:0/463636712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb44005040 con 0x7fcb500f8720 2024-02-22T00:55:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb4ffff700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 0x7fcb501107b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fcb3c00e910 tx=0x7fcb3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb4dffb700 1 -- 172.21.15.49:0/463636712 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3c007b40 con 0x7fcb500f8720 2024-02-22T00:55:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb4dffb700 1 -- 172.21.15.49:0/463636712 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb3c00f040 con 0x7fcb500f8720 2024-02-22T00:55:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5010a560 con 0x7fcb500f8720 2024-02-22T00:55:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb4dffb700 1 -- 172.21.15.49:0/463636712 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3c014920 con 0x7fcb500f8720 2024-02-22T00:55:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.100+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5010ab20 con 0x7fcb500f8720 2024-02-22T00:55:21.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.101+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50060670 con 0x7fcb500f8720 2024-02-22T00:55:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.102+0000 7fcb4dffb700 1 -- 172.21.15.49:0/463636712 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fcb3c007ca0 con 0x7fcb500f8720 2024-02-22T00:55:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.102+0000 7fcb4dffb700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcb4006cab0 0x7fcb4006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.102+0000 7fcb4dffb700 1 -- 172.21.15.49:0/463636712 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fcb3c08b6c0 con 0x7fcb500f8720 2024-02-22T00:55:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.102+0000 7fcb54d13700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcb4006cab0 0x7fcb4006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.102+0000 7fcb54d13700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcb4006cab0 0x7fcb4006ef70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcb44004540 tx=0x7fcb44009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:21.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.106+0000 7fcb4dffb700 1 -- 172.21.15.49:0/463636712 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcb3c055790 con 0x7fcb500f8720 2024-02-22T00:55:21.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.315+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb5010ad90 con 0x7fcb4006cab0 2024-02-22T00:55:21.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.325+0000 7fcb4dffb700 1 -- 172.21.15.49:0/463636712 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fcb5010ad90 con 0x7fcb4006cab0 2024-02-22T00:55:21.327 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:55:21.327 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (18m) 12m ago 29m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:55:21.327 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (16m) 12m ago 29m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:55:21.327 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (16m) 11m ago 29m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:55:21.327 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (18m) 12m ago 29m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:55:21.327 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (12m) 12m ago 24m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:55:21.327 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (12m) 12m ago 24m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (11m) 11m ago 24m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (12m) 11m ago 24m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (20m) 12m ago 31m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (19m) 11m ago 29m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (17m) 12m ago 31m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (16m) 11m ago 29m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (19m) 12m ago 29m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (19m) 11m ago 28m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:55:21.328 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (15m) 12m ago 28m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:55:21.329 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (15m) 12m ago 27m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:55:21.329 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (14m) 12m ago 27m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:55:21.329 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (14m) 11m ago 27m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:55:21.329 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (13m) 11m ago 26m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:55:21.329 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (13m) 11m ago 26m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:55:21.329 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (18m) 11m ago 28m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:55:21.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcb4006cab0 msgr2=0x7fcb4006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcb4006cab0 0x7fcb4006ef70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcb44004540 tx=0x7fcb44009cb0).stop 2024-02-22T00:55:21.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 msgr2=0x7fcb501107b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 0x7fcb501107b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fcb3c00e910 tx=0x7fcb3c00b040).stop 2024-02-22T00:55:21.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 shutdown_connections 2024-02-22T00:55:21.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcb4006cab0 0x7fcb4006ef70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb500f5f80 0x7fcb501102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 --2- 172.21.15.49:0/463636712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb500f8720 0x7fcb501107b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 >> 172.21.15.49:0/463636712 conn(0x7fcb5006ce40 msgr2=0x7fcb500f4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:21.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 shutdown_connections 2024-02-22T00:55:21.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.327+0000 7fcb56f77700 1 -- 172.21.15.49:0/463636712 wait complete. 2024-02-22T00:55:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 -- 172.21.15.49:0/2962440907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 msgr2=0x7efe0c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 --2- 172.21.15.49:0/2962440907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 0x7efe0c0fcbd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7efdfc0047f0 tx=0x7efdfc009cb0).stop 2024-02-22T00:55:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 -- 172.21.15.49:0/2962440907 shutdown_connections 2024-02-22T00:55:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 --2- 172.21.15.49:0/2962440907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0fd150 0x7efe0c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 --2- 172.21.15.49:0/2962440907 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 0x7efe0c0fcbd0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 -- 172.21.15.49:0/2962440907 >> 172.21.15.49:0/2962440907 conn(0x7efe0c070590 msgr2=0x7efe0c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:21.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 -- 172.21.15.49:0/2962440907 shutdown_connections 2024-02-22T00:55:21.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 -- 172.21.15.49:0/2962440907 wait complete. 2024-02-22T00:55:21.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 Processor -- start 2024-02-22T00:55:21.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.428+0000 7efe125c3700 1 -- start start 2024-02-22T00:55:21.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe125c3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 0x7efe0c110230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe125c3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0fd150 0x7efe0c110720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe125c3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c110d20 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe125c3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c110e60 con 0x7efe0c0fd150 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe0bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 0x7efe0c110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe0bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 0x7efe0c110230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44452/0 (socket says 172.21.15.49:44452) 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe0bfff700 1 -- 172.21.15.49:0/2088726119 learned_addr learned my addr 172.21.15.49:0/2088726119 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe0b7fe700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0fd150 0x7efe0c110720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe0bfff700 1 -- 172.21.15.49:0/2088726119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0fd150 msgr2=0x7efe0c110720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe0bfff700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0fd150 0x7efe0c110720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe0bfff700 1 -- 172.21.15.49:0/2088726119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc005040 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.429+0000 7efe0bfff700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 0x7efe0c110230 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7efdfc005010 tx=0x7efdfc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.430+0000 7efe097fa700 1 -- 172.21.15.49:0/2088726119 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdfc00e030 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.430+0000 7efe097fa700 1 -- 172.21.15.49:0/2088726119 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efdfc007e90 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.430+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c10a490 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.430+0000 7efe097fa700 1 -- 172.21.15.49:0/2088726119 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdfc018070 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.430+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c10a9f0 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.431+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c05f590 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.431+0000 7efe097fa700 1 -- 172.21.15.49:0/2088726119 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efdfc01d670 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.432+0000 7efe097fa700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efdf806caa0 0x7efdf806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.432+0000 7efe097fa700 1 -- 172.21.15.49:0/2088726119 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7efdfc08cf50 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.432+0000 7efe0b7fe700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efdf806caa0 0x7efdf806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.432+0000 7efe0b7fe700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efdf806caa0 0x7efdf806ef60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7efe0c10bb70 tx=0x7efdf400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:21.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.436+0000 7efe097fa700 1 -- 172.21.15.49:0/2088726119 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efdfc0c0190 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.721+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efe0c047540 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.721+0000 7efe097fa700 1 -- 172.21.15.49:0/2088726119 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7efdfc05a820 con 0x7efe0c0fc7f0 2024-02-22T00:55:21.723 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:55:21.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:55:21.723 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:55:21.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:55:21.723 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:55:21.724 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efdf806caa0 msgr2=0x7efdf806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efdf806caa0 0x7efdf806ef60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7efe0c10bb70 tx=0x7efdf400b040).stop 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 msgr2=0x7efe0c110230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 0x7efe0c110230 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7efdfc005010 tx=0x7efdfc009cb0).stop 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 shutdown_connections 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7efdf806caa0 0x7efdf806ef60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efe0c0fc7f0 0x7efe0c110230 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 --2- 172.21.15.49:0/2088726119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe0c0fd150 0x7efe0c110720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 >> 172.21.15.49:0/2088726119 conn(0x7efe0c070590 msgr2=0x7efe0c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:21.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 shutdown_connections 2024-02-22T00:55:21.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.723+0000 7efe125c3700 1 -- 172.21.15.49:0/2088726119 wait complete. 2024-02-22T00:55:21.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.825+0000 7f58549f7700 1 -- 172.21.15.49:0/1327878436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 msgr2=0x7f58501019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.825+0000 7f58549f7700 1 --2- 172.21.15.49:0/1327878436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 0x7f58501019b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f58380047f0 tx=0x7f5838009cb0).stop 2024-02-22T00:55:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.825+0000 7f58549f7700 1 -- 172.21.15.49:0/1327878436 shutdown_connections 2024-02-22T00:55:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.825+0000 7f58549f7700 1 --2- 172.21.15.49:0/1327878436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 0x7f58501019b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.825+0000 7f58549f7700 1 --2- 172.21.15.49:0/1327878436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58500f8940 0x7f58500f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.825+0000 7f58549f7700 1 -- 172.21.15.49:0/1327878436 >> 172.21.15.49:0/1327878436 conn(0x7f5850070590 msgr2=0x7f58500f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.825+0000 7f58549f7700 1 -- 172.21.15.49:0/1327878436 shutdown_connections 2024-02-22T00:55:21.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.825+0000 7f58549f7700 1 -- 172.21.15.49:0/1327878436 wait complete. 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.826+0000 7f58549f7700 1 Processor -- start 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.826+0000 7f58549f7700 1 -- start start 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58549f7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58500f8940 0x7f585010e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58549f7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 0x7f585010e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58549f7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585010eb20 con 0x7f58500f9210 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58549f7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585010ec60 con 0x7f58500f8940 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f584dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 0x7f585010e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f584dd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 0x7f585010e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50498/0 (socket says 172.21.15.49:50498) 2024-02-22T00:55:21.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f584dd9b700 1 -- 172.21.15.49:0/2058161580 learned_addr learned my addr 172.21.15.49:0/2058161580 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f584e59c700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58500f8940 0x7f585010e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f584dd9b700 1 -- 172.21.15.49:0/2058161580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58500f8940 msgr2=0x7f585010e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f584dd9b700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58500f8940 0x7f585010e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f584dd9b700 1 -- 172.21.15.49:0/2058161580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838005040 con 0x7f58500f9210 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f584dd9b700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 0x7f585010e520 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f5838013640 tx=0x7f5838009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58477fe700 1 -- 172.21.15.49:0/2058161580 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f583800e030 con 0x7f58500f9210 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58477fe700 1 -- 172.21.15.49:0/2058161580 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5838007e90 con 0x7f58500f9210 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5850108290 con 0x7f58500f9210 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58477fe700 1 -- 172.21.15.49:0/2058161580 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5838018070 con 0x7f58500f9210 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.827+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5850108770 con 0x7f58500f9210 2024-02-22T00:55:21.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.828+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585005f590 con 0x7f58500f9210 2024-02-22T00:55:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.829+0000 7f58477fe700 1 -- 172.21.15.49:0/2058161580 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f583801d420 con 0x7f58500f9210 2024-02-22T00:55:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.829+0000 7f58477fe700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f583c06cab0 0x7f583c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.829+0000 7f58477fe700 1 -- 172.21.15.49:0/2058161580 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f583808d270 con 0x7f58500f9210 2024-02-22T00:55:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.829+0000 7f584e59c700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f583c06cab0 0x7f583c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:21.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.830+0000 7f584e59c700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f583c06cab0 0x7f583c06ef70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f5840004b60 tx=0x7f5840009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:21.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:21.834+0000 7f58477fe700 1 -- 172.21.15.49:0/2058161580 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f583805add0 con 0x7f58500f9210 2024-02-22T00:55:22.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.081+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5850047540 con 0x7f58500f9210 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.081+0000 7f58477fe700 1 -- 172.21.15.49:0/2058161580 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f583805a960 con 0x7f58500f9210 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:55:22.084 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:55:22.085 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:55:22.086 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:55:22.087 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:55:22.087 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:55:22.087 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:55:22.087 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:55:22.087 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.083+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f583c06cab0 msgr2=0x7f583c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.083+0000 7f58549f7700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f583c06cab0 0x7f583c06ef70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f5840004b60 tx=0x7f5840009040).stop 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 msgr2=0x7f585010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 0x7f585010e520 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f5838013640 tx=0x7f5838009cb0).stop 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 shutdown_connections 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f583c06cab0 0x7f583c06ef70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58500f8940 0x7f585010e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 --2- 172.21.15.49:0/2058161580 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58500f9210 0x7f585010e520 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 >> 172.21.15.49:0/2058161580 conn(0x7f5850070590 msgr2=0x7f58500fc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 shutdown_connections 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.084+0000 7f58549f7700 1 -- 172.21.15.49:0/2058161580 wait complete. 2024-02-22T00:55:22.088 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:55:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.186+0000 7f602d833700 1 -- 172.21.15.49:0/3893218621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 msgr2=0x7f60280f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.186+0000 7f602d833700 1 --2- 172.21.15.49:0/3893218621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 0x7f60280f8c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f60100047f0 tx=0x7f6010009cb0).stop 2024-02-22T00:55:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.186+0000 7f602d833700 1 -- 172.21.15.49:0/3893218621 shutdown_connections 2024-02-22T00:55:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.186+0000 7f602d833700 1 --2- 172.21.15.49:0/3893218621 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60280f9200 0x7f6028101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.186+0000 7f602d833700 1 --2- 172.21.15.49:0/3893218621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 0x7f60280f8c80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.186+0000 7f602d833700 1 -- 172.21.15.49:0/3893218621 >> 172.21.15.49:0/3893218621 conn(0x7f6028070590 msgr2=0x7f60280f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.186+0000 7f602d833700 1 -- 172.21.15.49:0/3893218621 shutdown_connections 2024-02-22T00:55:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.186+0000 7f602d833700 1 -- 172.21.15.49:0/3893218621 wait complete. 2024-02-22T00:55:22.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f602d833700 1 Processor -- start 2024-02-22T00:55:22.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f602d833700 1 -- start start 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f602d833700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 0x7f602810e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f602d833700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60280f9200 0x7f602810e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f602d833700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602810eb10 con 0x7f60280f88a0 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f602d833700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602810ec50 con 0x7f60280f9200 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f6026ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 0x7f602810e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f6026ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 0x7f602810e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50504/0 (socket says 172.21.15.49:50504) 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f6026ffd700 1 -- 172.21.15.49:0/348596991 learned_addr learned my addr 172.21.15.49:0/348596991 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f60267fc700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60280f9200 0x7f602810e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f6026ffd700 1 -- 172.21.15.49:0/348596991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60280f9200 msgr2=0x7f602810e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f6026ffd700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60280f9200 0x7f602810e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f6026ffd700 1 -- 172.21.15.49:0/348596991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6010005040 con 0x7f60280f88a0 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.187+0000 7f60267fc700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60280f9200 0x7f602810e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.188+0000 7f6026ffd700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 0x7f602810e020 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f6010005010 tx=0x7f6010009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:22.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.188+0000 7f601ffff700 1 -- 172.21.15.49:0/348596991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601000e030 con 0x7f60280f88a0 2024-02-22T00:55:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.188+0000 7f601ffff700 1 -- 172.21.15.49:0/348596991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6010007e90 con 0x7f60280f88a0 2024-02-22T00:55:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.188+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6028108280 con 0x7f60280f88a0 2024-02-22T00:55:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.188+0000 7f601ffff700 1 -- 172.21.15.49:0/348596991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6010018070 con 0x7f60280f88a0 2024-02-22T00:55:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.188+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6028108760 con 0x7f60280f88a0 2024-02-22T00:55:22.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.189+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602805f590 con 0x7f60280f88a0 2024-02-22T00:55:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.189+0000 7f601ffff700 1 -- 172.21.15.49:0/348596991 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f601001d6e0 con 0x7f60280f88a0 2024-02-22T00:55:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.190+0000 7f601ffff700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f601406ca30 0x7f601406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.190+0000 7f601ffff700 1 -- 172.21.15.49:0/348596991 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f601008cfd0 con 0x7f60280f88a0 2024-02-22T00:55:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.190+0000 7f60267fc700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f601406ca30 0x7f601406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:22.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.190+0000 7f60267fc700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f601406ca30 0x7f601406eef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f6028109960 tx=0x7f6018009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:22.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.194+0000 7f601ffff700 1 -- 172.21.15.49:0/348596991 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f601005ab30 con 0x7f60280f88a0 2024-02-22T00:55:22.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.410+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60280fedd0 con 0x7f601406ca30 2024-02-22T00:55:22.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.411+0000 7f601ffff700 1 -- 172.21.15.49:0/348596991 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f60280fedd0 con 0x7f601406ca30 2024-02-22T00:55:22.413 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:55:22.413 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:55:22.414 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:55:22.415 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:55:22.415 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:55:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f601406ca30 msgr2=0x7f601406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f601406ca30 0x7f601406eef0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f6028109960 tx=0x7f6018009de0).stop 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 msgr2=0x7f602810e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 0x7f602810e020 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f6010005010 tx=0x7f6010009cb0).stop 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 shutdown_connections 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f601406ca30 0x7f601406eef0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f60280f88a0 0x7f602810e020 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 --2- 172.21.15.49:0/348596991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60280f9200 0x7f602810e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.413+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 >> 172.21.15.49:0/348596991 conn(0x7f6028070590 msgr2=0x7f60280fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.414+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 shutdown_connections 2024-02-22T00:55:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.414+0000 7f602d833700 1 -- 172.21.15.49:0/348596991 wait complete. 2024-02-22T00:55:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 -- 172.21.15.49:0/2337798740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fd150 msgr2=0x7f0d440f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 --2- 172.21.15.49:0/2337798740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fd150 0x7f0d440f6930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f0d2c0047f0 tx=0x7f0d2c009cb0).stop 2024-02-22T00:55:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 -- 172.21.15.49:0/2337798740 shutdown_connections 2024-02-22T00:55:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 --2- 172.21.15.49:0/2337798740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fd150 0x7f0d440f6930 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 --2- 172.21.15.49:0/2337798740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d440fc7f0 0x7f0d440fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 -- 172.21.15.49:0/2337798740 >> 172.21.15.49:0/2337798740 conn(0x7f0d440f23b0 msgr2=0x7f0d440f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 -- 172.21.15.49:0/2337798740 shutdown_connections 2024-02-22T00:55:22.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 -- 172.21.15.49:0/2337798740 wait complete. 2024-02-22T00:55:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.515+0000 7f0d49f0d700 1 Processor -- start 2024-02-22T00:55:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d49f0d700 1 -- start start 2024-02-22T00:55:22.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d49f0d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fc7f0 0x7f0d4410e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d49f0d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d440fd150 0x7f0d4410e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d49f0d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4410ebf0 con 0x7f0d440fc7f0 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d49f0d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44108210 con 0x7f0d440fd150 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fc7f0 0x7f0d4410e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d437fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fc7f0 0x7f0d4410e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50524/0 (socket says 172.21.15.49:50524) 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d437fe700 1 -- 172.21.15.49:0/1355514842 learned_addr learned my addr 172.21.15.49:0/1355514842 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d437fe700 1 -- 172.21.15.49:0/1355514842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d440fd150 msgr2=0x7f0d4410e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d437fe700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d440fd150 0x7f0d4410e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d437fe700 1 -- 172.21.15.49:0/1355514842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c005040 con 0x7f0d440fc7f0 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.516+0000 7f0d437fe700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fc7f0 0x7f0d4410e070 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f0d3400b4b0 tx=0x7f0d340090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:22.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.517+0000 7f0d40ff9700 1 -- 172.21.15.49:0/1355514842 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d34002500 con 0x7f0d440fc7f0 2024-02-22T00:55:22.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.517+0000 7f0d40ff9700 1 -- 172.21.15.49:0/1355514842 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d34002b10 con 0x7f0d440fc7f0 2024-02-22T00:55:22.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.517+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d441084c0 con 0x7f0d440fc7f0 2024-02-22T00:55:22.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.517+0000 7f0d40ff9700 1 -- 172.21.15.49:0/1355514842 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d34012cf0 con 0x7f0d440fc7f0 2024-02-22T00:55:22.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.517+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d44108a00 con 0x7f0d440fc7f0 2024-02-22T00:55:22.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.517+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d44060370 con 0x7f0d440fc7f0 2024-02-22T00:55:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.518+0000 7f0d40ff9700 1 -- 172.21.15.49:0/1355514842 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0d34002660 con 0x7f0d440fc7f0 2024-02-22T00:55:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.519+0000 7f0d40ff9700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0d3006caa0 0x7f0d3006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.519+0000 7f0d40ff9700 1 -- 172.21.15.49:0/1355514842 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0d3408be80 con 0x7f0d440fc7f0 2024-02-22T00:55:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.519+0000 7f0d42ffd700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0d3006caa0 0x7f0d3006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:22.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.519+0000 7f0d42ffd700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0d3006caa0 0x7f0d3006ef60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0d441099b0 tx=0x7f0d2c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:22.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.523+0000 7f0d40ff9700 1 -- 172.21.15.49:0/1355514842 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0d340599e0 con 0x7f0d440fc7f0 2024-02-22T00:55:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:22 smithi161 ceph-mon[113442]: pgmap v553: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:22 smithi161 ceph-mon[113442]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:22 smithi161 ceph-mon[113442]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:22.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:22 smithi161 ceph-mon[113442]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:22.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:22 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2088726119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:55:22.544 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:22 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2058161580' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:55:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:22 smithi049 ceph-mon[132694]: pgmap v553: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:22 smithi049 ceph-mon[132694]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:22 smithi049 ceph-mon[132694]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:22 smithi049 ceph-mon[132694]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:22 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2088726119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:55:22.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:22 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2058161580' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:55:22.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.806+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0d441090a0 con 0x7f0d440fc7f0 2024-02-22T00:55:22.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.806+0000 7f0d40ff9700 1 -- 172.21.15.49:0/1355514842 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f0d34059570 con 0x7f0d440fc7f0 2024-02-22T00:55:22.809 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:55:22.809 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:55:22.809 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:55:22.809 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:55:22.809 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:55:22.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0d3006caa0 msgr2=0x7f0d3006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0d3006caa0 0x7f0d3006ef60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0d441099b0 tx=0x7f0d2c009cb0).stop 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fc7f0 msgr2=0x7f0d4410e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fc7f0 0x7f0d4410e070 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f0d3400b4b0 tx=0x7f0d340090f0).stop 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 shutdown_connections 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0d3006caa0 0x7f0d3006ef60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d440fc7f0 0x7f0d4410e070 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 --2- 172.21.15.49:0/1355514842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d440fd150 0x7f0d4410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 >> 172.21.15.49:0/1355514842 conn(0x7f0d440f23b0 msgr2=0x7f0d44061340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 shutdown_connections 2024-02-22T00:55:22.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:22.809+0000 7f0d49f0d700 1 -- 172.21.15.49:0/1355514842 wait complete. 2024-02-22T00:55:23.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:23 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1355514842' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:55:23.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:23 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1355514842' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:55:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:24 smithi161 ceph-mon[113442]: from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:24.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:24 smithi161 ceph-mon[113442]: pgmap v554: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:24.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:24 smithi049 ceph-mon[132694]: from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:24.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:24 smithi049 ceph-mon[132694]: pgmap v554: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:26.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:26 smithi161 ceph-mon[113442]: pgmap v555: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:26.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:26 smithi049 ceph-mon[132694]: pgmap v555: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:28 smithi161 ceph-mon[113442]: pgmap v556: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:28.543 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:55:28.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:28 smithi049 ceph-mon[132694]: pgmap v556: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:28.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:55:30.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:30 smithi161 ceph-mon[113442]: pgmap v557: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:30.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:30 smithi049 ceph-mon[132694]: pgmap v557: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:32.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:32 smithi161 ceph-mon[113442]: pgmap v558: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:32.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:32 smithi049 ceph-mon[132694]: pgmap v558: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:34.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:34 smithi161 ceph-mon[113442]: pgmap v559: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:34.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:34 smithi049 ceph-mon[132694]: pgmap v559: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:36.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:36 smithi161 ceph-mon[113442]: pgmap v560: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:36.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:36 smithi049 ceph-mon[132694]: pgmap v560: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:38.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:38 smithi161 ceph-mon[113442]: pgmap v561: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:38.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:38 smithi049 ceph-mon[132694]: pgmap v561: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:40.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:40 smithi161 ceph-mon[113442]: pgmap v562: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:40.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:40 smithi049 ceph-mon[132694]: pgmap v562: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:42.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:42 smithi161 ceph-mon[113442]: pgmap v563: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:42.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:42 smithi049 ceph-mon[132694]: pgmap v563: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:43.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:55:43.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:55:44.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:44 smithi161 ceph-mon[113442]: pgmap v564: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:44.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:44 smithi049 ceph-mon[132694]: pgmap v564: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:46.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:46 smithi161 ceph-mon[113442]: pgmap v565: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:46.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:46 smithi049 ceph-mon[132694]: pgmap v565: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:48.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:48 smithi161 ceph-mon[113442]: pgmap v566: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:48.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:48 smithi049 ceph-mon[132694]: pgmap v566: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:50.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:50 smithi161 ceph-mon[113442]: pgmap v567: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:50.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:50 smithi049 ceph-mon[132694]: pgmap v567: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:52.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:52 smithi161 ceph-mon[113442]: pgmap v568: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:52.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:52 smithi049 ceph-mon[132694]: pgmap v568: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.925+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2606228968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 msgr2=0x7fc6040f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.925+0000 7fc60b8cf700 1 --2- 172.21.15.49:0/2606228968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 0x7fc6040f6930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fc6000047f0 tx=0x7fc600009cb0).stop 2024-02-22T00:55:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.925+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2606228968 shutdown_connections 2024-02-22T00:55:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.925+0000 7fc60b8cf700 1 --2- 172.21.15.49:0/2606228968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 0x7fc6040f6930 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.925+0000 7fc60b8cf700 1 --2- 172.21.15.49:0/2606228968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6040fc7f0 0x7fc6040fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.925+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2606228968 >> 172.21.15.49:0/2606228968 conn(0x7fc604070590 msgr2=0x7fc6040f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:52.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.925+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2606228968 shutdown_connections 2024-02-22T00:55:52.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.925+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2606228968 wait complete. 2024-02-22T00:55:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc60b8cf700 1 Processor -- start 2024-02-22T00:55:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc60b8cf700 1 -- start start 2024-02-22T00:55:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc60b8cf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6040fc7f0 0x7fc60410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc60b8cf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 0x7fc60410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc60b8cf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60410eab0 con 0x7fc6040fd150 2024-02-22T00:55:52.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc60b8cf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60410ebf0 con 0x7fc6040fc7f0 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc608e6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 0x7fc60410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc608e6a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 0x7fc60410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42744/0 (socket says 172.21.15.49:42744) 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.926+0000 7fc608e6a700 1 -- 172.21.15.49:0/2174123360 learned_addr learned my addr 172.21.15.49:0/2174123360 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc60966b700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6040fc7f0 0x7fc60410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc608e6a700 1 -- 172.21.15.49:0/2174123360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6040fc7f0 msgr2=0x7fc60410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc608e6a700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6040fc7f0 0x7fc60410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc608e6a700 1 -- 172.21.15.49:0/2174123360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600005040 con 0x7fc6040fd150 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc608e6a700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 0x7fc60410e4b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fc600000c00 tx=0x7fc600009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc5f67fc700 1 -- 172.21.15.49:0/2174123360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc60000e030 con 0x7fc6040fd150 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc5f67fc700 1 -- 172.21.15.49:0/2174123360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc600007e90 con 0x7fc6040fd150 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc604108220 con 0x7fc6040fd150 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc5f67fc700 1 -- 172.21.15.49:0/2174123360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc600018070 con 0x7fc6040fd150 2024-02-22T00:55:52.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.927+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc604108780 con 0x7fc6040fd150 2024-02-22T00:55:52.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.928+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60405f590 con 0x7fc6040fd150 2024-02-22T00:55:52.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.929+0000 7fc5f67fc700 1 -- 172.21.15.49:0/2174123360 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc60001d420 con 0x7fc6040fd150 2024-02-22T00:55:52.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.929+0000 7fc5f67fc700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5f006cab0 0x7fc5f006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:52.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.929+0000 7fc60966b700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5f006cab0 0x7fc5f006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:52.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.929+0000 7fc5f67fc700 1 -- 172.21.15.49:0/2174123360 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc60008cf30 con 0x7fc6040fd150 2024-02-22T00:55:52.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.930+0000 7fc60966b700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5f006cab0 0x7fc5f006ef70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc5f8009170 tx=0x7fc5f8009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:52.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:52.934+0000 7fc5f67fc700 1 -- 172.21.15.49:0/2174123360 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc6000c0190 con 0x7fc6040fd150 2024-02-22T00:55:53.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.151+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc604108ed0 con 0x7fc5f006cab0 2024-02-22T00:55:53.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.152+0000 7fc5f67fc700 1 -- 172.21.15.49:0/2174123360 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc604108ed0 con 0x7fc5f006cab0 2024-02-22T00:55:53.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5f006cab0 msgr2=0x7fc5f006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5f006cab0 0x7fc5f006ef70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc5f8009170 tx=0x7fc5f8009d60).stop 2024-02-22T00:55:53.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 msgr2=0x7fc60410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 0x7fc60410e4b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fc600000c00 tx=0x7fc600009cb0).stop 2024-02-22T00:55:53.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 shutdown_connections 2024-02-22T00:55:53.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc5f006cab0 0x7fc5f006ef70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6040fc7f0 0x7fc60410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 --2- 172.21.15.49:0/2174123360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc6040fd150 0x7fc60410e4b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 >> 172.21.15.49:0/2174123360 conn(0x7fc604070590 msgr2=0x7fc604060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:53.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 shutdown_connections 2024-02-22T00:55:53.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.154+0000 7fc60b8cf700 1 -- 172.21.15.49:0/2174123360 wait complete. 2024-02-22T00:55:53.165 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:55:53.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.257+0000 7f39d734c700 1 -- 172.21.15.49:0/4097537989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fd150 msgr2=0x7f39d00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.257+0000 7f39d734c700 1 --2- 172.21.15.49:0/4097537989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fd150 0x7f39d00f6930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f39cc0047f0 tx=0x7f39cc009cb0).stop 2024-02-22T00:55:53.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.257+0000 7f39d734c700 1 -- 172.21.15.49:0/4097537989 shutdown_connections 2024-02-22T00:55:53.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.257+0000 7f39d734c700 1 --2- 172.21.15.49:0/4097537989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fd150 0x7f39d00f6930 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.257+0000 7f39d734c700 1 --2- 172.21.15.49:0/4097537989 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d00fc7f0 0x7f39d00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.257+0000 7f39d734c700 1 -- 172.21.15.49:0/4097537989 >> 172.21.15.49:0/4097537989 conn(0x7f39d0070590 msgr2=0x7f39d00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:53.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.257+0000 7f39d734c700 1 -- 172.21.15.49:0/4097537989 shutdown_connections 2024-02-22T00:55:53.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.257+0000 7f39d734c700 1 -- 172.21.15.49:0/4097537989 wait complete. 2024-02-22T00:55:53.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d734c700 1 Processor -- start 2024-02-22T00:55:53.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d734c700 1 -- start start 2024-02-22T00:55:53.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d734c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fc7f0 0x7f39d00f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d734c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d00fd150 0x7f39d00f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d734c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00f8f20 con 0x7f39d00fc7f0 2024-02-22T00:55:53.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d734c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00f9060 con 0x7f39d00fd150 2024-02-22T00:55:53.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d50e8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fc7f0 0x7f39d00f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d50e8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fc7f0 0x7f39d00f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42766/0 (socket says 172.21.15.49:42766) 2024-02-22T00:55:53.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d50e8700 1 -- 172.21.15.49:0/156927311 learned_addr learned my addr 172.21.15.49:0/156927311 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d48e7700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d00fd150 0x7f39d00f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d50e8700 1 -- 172.21.15.49:0/156927311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d00fd150 msgr2=0x7f39d00f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d50e8700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d00fd150 0x7f39d00f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d50e8700 1 -- 172.21.15.49:0/156927311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc005040 con 0x7f39d00fc7f0 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.258+0000 7f39d50e8700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fc7f0 0x7f39d00f8540 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f39c00041d0 tx=0x7f39c0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.259+0000 7f39c67fc700 1 -- 172.21.15.49:0/156927311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c0007b40 con 0x7f39d00fc7f0 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.259+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d00f9310 con 0x7f39d00fc7f0 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.259+0000 7f39c67fc700 1 -- 172.21.15.49:0/156927311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39c000f040 con 0x7f39d00fc7f0 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.259+0000 7f39c67fc700 1 -- 172.21.15.49:0/156927311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39c00147b0 con 0x7f39d00fc7f0 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.259+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d01146a0 con 0x7f39d00fc7f0 2024-02-22T00:55:53.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.260+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d005f590 con 0x7f39d00fc7f0 2024-02-22T00:55:53.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.260+0000 7f39c67fc700 1 -- 172.21.15.49:0/156927311 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f39c0009110 con 0x7f39d00fc7f0 2024-02-22T00:55:53.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.260+0000 7f39c67fc700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39bc06caa0 0x7f39bc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.261+0000 7f39c67fc700 1 -- 172.21.15.49:0/156927311 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f39c008bda0 con 0x7f39d00fc7f0 2024-02-22T00:55:53.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.261+0000 7f39d48e7700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39bc06caa0 0x7f39bc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.261+0000 7f39d48e7700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39bc06caa0 0x7f39bc06ef60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f39d00f9ce0 tx=0x7f39cc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:53.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.265+0000 7f39c67fc700 1 -- 172.21.15.49:0/156927311 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f39c0055e70 con 0x7f39d00fc7f0 2024-02-22T00:55:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.486+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39d00fb5a0 con 0x7f39bc06caa0 2024-02-22T00:55:53.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.487+0000 7f39c67fc700 1 -- 172.21.15.49:0/156927311 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f39d00fb5a0 con 0x7f39bc06caa0 2024-02-22T00:55:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39bc06caa0 msgr2=0x7f39bc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39bc06caa0 0x7f39bc06ef60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f39d00f9ce0 tx=0x7f39cc00b040).stop 2024-02-22T00:55:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fc7f0 msgr2=0x7f39d00f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fc7f0 0x7f39d00f8540 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f39c00041d0 tx=0x7f39c0009f60).stop 2024-02-22T00:55:53.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 shutdown_connections 2024-02-22T00:55:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f39bc06caa0 0x7f39bc06ef60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f39d00fc7f0 0x7f39d00f8540 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 --2- 172.21.15.49:0/156927311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39d00fd150 0x7f39d00f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 >> 172.21.15.49:0/156927311 conn(0x7f39d0070590 msgr2=0x7f39d0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.489+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 shutdown_connections 2024-02-22T00:55:53.491 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.490+0000 7f39d734c700 1 -- 172.21.15.49:0/156927311 wait complete. 2024-02-22T00:55:53.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 -- 172.21.15.49:0/2177535197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fe270 msgr2=0x7f4be80f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 --2- 172.21.15.49:0/2177535197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fe270 0x7f4be80f7a50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f4bd40047f0 tx=0x7f4bd4009cb0).stop 2024-02-22T00:55:53.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 -- 172.21.15.49:0/2177535197 shutdown_connections 2024-02-22T00:55:53.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 --2- 172.21.15.49:0/2177535197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fe270 0x7f4be80f7a50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 --2- 172.21.15.49:0/2177535197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be80fd910 0x7f4be80fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 -- 172.21.15.49:0/2177535197 >> 172.21.15.49:0/2177535197 conn(0x7f4be80f3510 msgr2=0x7f4be80f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 -- 172.21.15.49:0/2177535197 shutdown_connections 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 -- 172.21.15.49:0/2177535197 wait complete. 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 Processor -- start 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.591+0000 7f4bef184700 1 -- start start 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4bef184700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fd910 0x7f4be810dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4bef184700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be80fe270 0x7f4be810e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4bef184700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be810eac0 con 0x7f4be80fd910 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4bef184700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be810ec00 con 0x7f4be80fe270 2024-02-22T00:55:53.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4becf20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fd910 0x7f4be810dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4becf20700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fd910 0x7f4be810dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42792/0 (socket says 172.21.15.49:42792) 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4becf20700 1 -- 172.21.15.49:0/3980133705 learned_addr learned my addr 172.21.15.49:0/3980133705 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4be7fff700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be80fe270 0x7f4be810e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4becf20700 1 -- 172.21.15.49:0/3980133705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be80fe270 msgr2=0x7f4be810e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4becf20700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be80fe270 0x7f4be810e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4becf20700 1 -- 172.21.15.49:0/3980133705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4005040 con 0x7f4be80fd910 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4becf20700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fd910 0x7f4be810dfd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f4bdc002770 tx=0x7f4bdc002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4be5ffb700 1 -- 172.21.15.49:0/3980133705 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bdc007b40 con 0x7f4be80fd910 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be8108290 con 0x7f4be80fd910 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4be5ffb700 1 -- 172.21.15.49:0/3980133705 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4bdc00f040 con 0x7f4be80fd910 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.592+0000 7f4be5ffb700 1 -- 172.21.15.49:0/3980133705 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bdc014820 con 0x7f4be80fd910 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.593+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be81087d0 con 0x7f4be80fd910 2024-02-22T00:55:53.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.594+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be8060650 con 0x7f4be80fd910 2024-02-22T00:55:53.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.594+0000 7f4be5ffb700 1 -- 172.21.15.49:0/3980133705 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4bdc007ca0 con 0x7f4be80fd910 2024-02-22T00:55:53.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.594+0000 7f4be5ffb700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4bd806caa0 0x7f4bd806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.594+0000 7f4be5ffb700 1 -- 172.21.15.49:0/3980133705 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4bdc08b990 con 0x7f4be80fd910 2024-02-22T00:55:53.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.594+0000 7f4be7fff700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4bd806caa0 0x7f4bd806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.595+0000 7f4be7fff700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4bd806caa0 0x7f4bd806ef60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f4be8109910 tx=0x7f4bd400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:53.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.599+0000 7f4be5ffb700 1 -- 172.21.15.49:0/3980133705 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4bdc0594f0 con 0x7f4be80fd910 2024-02-22T00:55:53.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.806+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4be8108a50 con 0x7f4bd806caa0 2024-02-22T00:55:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.815+0000 7f4be5ffb700 1 -- 172.21.15.49:0/3980133705 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f4be8108a50 con 0x7f4bd806caa0 2024-02-22T00:55:53.816 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:55:53.816 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (19m) 13m ago 30m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (16m) 13m ago 30m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (16m) 12m ago 29m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (18m) 13m ago 30m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (13m) 13m ago 25m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (13m) 13m ago 25m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (12m) 12m ago 25m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (12m) 12m ago 25m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (20m) 13m ago 31m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (20m) 12m ago 29m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (17m) 13m ago 31m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:55:53.817 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (17m) 12m ago 29m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (19m) 13m ago 29m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (19m) 12m ago 29m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (16m) 13m ago 29m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (15m) 13m ago 28m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (15m) 13m ago 27m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (14m) 12m ago 27m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (14m) 12m ago 27m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (13m) 12m ago 26m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:55:53.818 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (19m) 12m ago 29m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:55:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4bd806caa0 msgr2=0x7f4bd806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4bd806caa0 0x7f4bd806ef60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f4be8109910 tx=0x7f4bd400b040).stop 2024-02-22T00:55:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fd910 msgr2=0x7f4be810dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fd910 0x7f4be810dfd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f4bdc002770 tx=0x7f4bdc002a80).stop 2024-02-22T00:55:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 shutdown_connections 2024-02-22T00:55:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4bd806caa0 0x7f4bd806ef60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4be80fd910 0x7f4be810dfd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 --2- 172.21.15.49:0/3980133705 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4be80fe270 0x7f4be810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 >> 172.21.15.49:0/3980133705 conn(0x7f4be80f3510 msgr2=0x7f4be80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 shutdown_connections 2024-02-22T00:55:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.818+0000 7f4bef184700 1 -- 172.21.15.49:0/3980133705 wait complete. 2024-02-22T00:55:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.918+0000 7fa39750e700 1 -- 172.21.15.49:0/3709708042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 msgr2=0x7fa3900f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.918+0000 7fa39750e700 1 --2- 172.21.15.49:0/3709708042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 0x7fa3900f8c80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fa38c0047f0 tx=0x7fa38c009cb0).stop 2024-02-22T00:55:53.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.918+0000 7fa39750e700 1 -- 172.21.15.49:0/3709708042 shutdown_connections 2024-02-22T00:55:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.918+0000 7fa39750e700 1 --2- 172.21.15.49:0/3709708042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3900f9200 0x7fa390101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.918+0000 7fa39750e700 1 --2- 172.21.15.49:0/3709708042 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 0x7fa3900f8c80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.918+0000 7fa39750e700 1 -- 172.21.15.49:0/3709708042 >> 172.21.15.49:0/3709708042 conn(0x7fa390070590 msgr2=0x7fa3900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.918+0000 7fa39750e700 1 -- 172.21.15.49:0/3709708042 shutdown_connections 2024-02-22T00:55:53.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.918+0000 7fa39750e700 1 -- 172.21.15.49:0/3709708042 wait complete. 2024-02-22T00:55:53.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.919+0000 7fa39750e700 1 Processor -- start 2024-02-22T00:55:53.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.919+0000 7fa39750e700 1 -- start start 2024-02-22T00:55:53.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa39750e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 0x7fa39010e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa39750e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3900f9200 0x7fa39010e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa39750e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39010eb10 con 0x7fa3900f88a0 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa39750e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39010ec50 con 0x7fa3900f9200 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3952aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 0x7fa39010e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3952aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 0x7fa39010e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42804/0 (socket says 172.21.15.49:42804) 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3952aa700 1 -- 172.21.15.49:0/1258837743 learned_addr learned my addr 172.21.15.49:0/1258837743 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa394aa9700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3900f9200 0x7fa39010e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3952aa700 1 -- 172.21.15.49:0/1258837743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3900f9200 msgr2=0x7fa39010e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3952aa700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3900f9200 0x7fa39010e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3952aa700 1 -- 172.21.15.49:0/1258837743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c005040 con 0x7fa3900f88a0 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3952aa700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 0x7fa39010e020 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fa38c013640 tx=0x7fa38c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3827fc700 1 -- 172.21.15.49:0/1258837743 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38c00e030 con 0x7fa3900f88a0 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3827fc700 1 -- 172.21.15.49:0/1258837743 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa38c007e90 con 0x7fa3900f88a0 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa390108280 con 0x7fa3900f88a0 2024-02-22T00:55:53.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa3827fc700 1 -- 172.21.15.49:0/1258837743 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38c018070 con 0x7fa3900f88a0 2024-02-22T00:55:53.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.920+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa390108760 con 0x7fa3900f88a0 2024-02-22T00:55:53.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.921+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39005f590 con 0x7fa3900f88a0 2024-02-22T00:55:53.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.922+0000 7fa3827fc700 1 -- 172.21.15.49:0/1258837743 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa38c01d420 con 0x7fa3900f88a0 2024-02-22T00:55:53.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.922+0000 7fa3827fc700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa37c06cb80 0x7fa37c06f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:53.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.922+0000 7fa3827fc700 1 -- 172.21.15.49:0/1258837743 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa38c08d1c0 con 0x7fa3900f88a0 2024-02-22T00:55:53.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.922+0000 7fa394aa9700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa37c06cb80 0x7fa37c06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:53.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.923+0000 7fa394aa9700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa37c06cb80 0x7fa37c06f040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fa390109960 tx=0x7fa384009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:53.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:53.927+0000 7fa3827fc700 1 -- 172.21.15.49:0/1258837743 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa38c05ad10 con 0x7fa3900f88a0 2024-02-22T00:55:54.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.204+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa390047540 con 0x7fa3900f88a0 2024-02-22T00:55:54.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.205+0000 7fa3827fc700 1 -- 172.21.15.49:0/1258837743 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fa38c05a8a0 con 0x7fa3900f88a0 2024-02-22T00:55:54.206 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:55:54.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:55:54.206 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:55:54.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:55:54.206 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:55:54.206 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:55:54.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:55:54.207 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:55:54.207 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:55:54.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:55:54.207 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:55:54.208 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:55:54.208 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:55:54.208 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:55:54.208 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:55:54.208 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:55:54.208 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:55:54.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa37c06cb80 msgr2=0x7fa37c06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa37c06cb80 0x7fa37c06f040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fa390109960 tx=0x7fa384009040).stop 2024-02-22T00:55:54.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 msgr2=0x7fa39010e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 0x7fa39010e020 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fa38c013640 tx=0x7fa38c009cb0).stop 2024-02-22T00:55:54.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 shutdown_connections 2024-02-22T00:55:54.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa37c06cb80 0x7fa37c06f040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3900f88a0 0x7fa39010e020 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 --2- 172.21.15.49:0/1258837743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3900f9200 0x7fa39010e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 >> 172.21.15.49:0/1258837743 conn(0x7fa390070590 msgr2=0x7fa3900fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:54.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 shutdown_connections 2024-02-22T00:55:54.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.207+0000 7fa39750e700 1 -- 172.21.15.49:0/1258837743 wait complete. 2024-02-22T00:55:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.309+0000 7f3409021700 1 -- 172.21.15.49:0/2292427443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fd150 msgr2=0x7f34040f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.309+0000 7f3409021700 1 --2- 172.21.15.49:0/2292427443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fd150 0x7f34040f6930 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f33ec0047f0 tx=0x7f33ec009cb0).stop 2024-02-22T00:55:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.309+0000 7f3409021700 1 -- 172.21.15.49:0/2292427443 shutdown_connections 2024-02-22T00:55:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.309+0000 7f3409021700 1 --2- 172.21.15.49:0/2292427443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fd150 0x7f34040f6930 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.309+0000 7f3409021700 1 --2- 172.21.15.49:0/2292427443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34040fc7f0 0x7f34040fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:54.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.309+0000 7f3409021700 1 -- 172.21.15.49:0/2292427443 >> 172.21.15.49:0/2292427443 conn(0x7f34040f23b0 msgr2=0x7f34040f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:54.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.309+0000 7f3409021700 1 -- 172.21.15.49:0/2292427443 shutdown_connections 2024-02-22T00:55:54.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.309+0000 7f3409021700 1 -- 172.21.15.49:0/2292427443 wait complete. 2024-02-22T00:55:54.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.310+0000 7f3409021700 1 Processor -- start 2024-02-22T00:55:54.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.310+0000 7f3409021700 1 -- start start 2024-02-22T00:55:54.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.310+0000 7f3409021700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fc7f0 0x7f340410cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:54.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3409021700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34040fd150 0x7f340410d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:54.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3409021700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340410db10 con 0x7f34040fc7f0 2024-02-22T00:55:54.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3409021700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3404107130 con 0x7f34040fd150 2024-02-22T00:55:54.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3402d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fc7f0 0x7f340410cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:54.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3402d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fc7f0 0x7f340410cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42820/0 (socket says 172.21.15.49:42820) 2024-02-22T00:55:54.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3402d9d700 1 -- 172.21.15.49:0/832179800 learned_addr learned my addr 172.21.15.49:0/832179800 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:54.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f340259c700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34040fd150 0x7f340410d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:54.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3402d9d700 1 -- 172.21.15.49:0/832179800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34040fd150 msgr2=0x7f340410d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3402d9d700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34040fd150 0x7f340410d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3402d9d700 1 -- 172.21.15.49:0/832179800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec005040 con 0x7f34040fc7f0 2024-02-22T00:55:54.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f340259c700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34040fd150 0x7f340410d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:55:54.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3402d9d700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fc7f0 0x7f340410cf90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f33f400b4b0 tx=0x7f33f40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:54.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f33fbfff700 1 -- 172.21.15.49:0/832179800 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f4002500 con 0x7f34040fc7f0 2024-02-22T00:55:54.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34041073e0 con 0x7f34040fc7f0 2024-02-22T00:55:54.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f33fbfff700 1 -- 172.21.15.49:0/832179800 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f33f4002b10 con 0x7f34040fc7f0 2024-02-22T00:55:54.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f33fbfff700 1 -- 172.21.15.49:0/832179800 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f4012cf0 con 0x7f34040fc7f0 2024-02-22T00:55:54.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.311+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3404107920 con 0x7f34040fc7f0 2024-02-22T00:55:54.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.312+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3404060370 con 0x7f34040fc7f0 2024-02-22T00:55:54.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.313+0000 7f33fbfff700 1 -- 172.21.15.49:0/832179800 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f33f4002660 con 0x7f34040fc7f0 2024-02-22T00:55:54.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.313+0000 7f33fbfff700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f33f006cab0 0x7f33f006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:54.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.313+0000 7f33fbfff700 1 -- 172.21.15.49:0/832179800 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f33f408be80 con 0x7f34040fc7f0 2024-02-22T00:55:54.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.313+0000 7f340259c700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f33f006cab0 0x7f33f006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:54.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.314+0000 7f340259c700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f33f006cab0 0x7f33f006ef70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f34041088d0 tx=0x7f33ec009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:54.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.318+0000 7f33fbfff700 1 -- 172.21.15.49:0/832179800 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f33f40599e0 con 0x7f34040fc7f0 2024-02-22T00:55:54.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:54 smithi161 ceph-mon[113442]: pgmap v569: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:54.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:54 smithi161 ceph-mon[113442]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:54.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:54 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1258837743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:55:54.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.560+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3404047540 con 0x7f34040fc7f0 2024-02-22T00:55:54.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.561+0000 7f33fbfff700 1 -- 172.21.15.49:0/832179800 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f33f4059570 con 0x7f34040fc7f0 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:55:54.562 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:55:54.563 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:55:54.564 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:55:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:55:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:55:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:55:54.565 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:55:54.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f33f006cab0 msgr2=0x7f33f006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f33f006cab0 0x7f33f006ef70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f34041088d0 tx=0x7f33ec009cb0).stop 2024-02-22T00:55:54.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fc7f0 msgr2=0x7f340410cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fc7f0 0x7f340410cf90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f33f400b4b0 tx=0x7f33f40090f0).stop 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 shutdown_connections 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f33f006cab0 0x7f33f006ef70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f34040fc7f0 0x7f340410cf90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 --2- 172.21.15.49:0/832179800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34040fd150 0x7f340410d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 >> 172.21.15.49:0/832179800 conn(0x7f34040f23b0 msgr2=0x7f34040fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 shutdown_connections 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.563+0000 7f3409021700 1 -- 172.21.15.49:0/832179800 wait complete. 2024-02-22T00:55:54.567 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:55:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 -- 172.21.15.49:0/3413857513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fe250 msgr2=0x7f05900f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 --2- 172.21.15.49:0/3413857513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fe250 0x7f05900f7a30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f05780047f0 tx=0x7f0578009cb0).stop 2024-02-22T00:55:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 -- 172.21.15.49:0/3413857513 shutdown_connections 2024-02-22T00:55:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 --2- 172.21.15.49:0/3413857513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fe250 0x7f05900f7a30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 --2- 172.21.15.49:0/3413857513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fd8f0 0x7f05900fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 -- 172.21.15.49:0/3413857513 >> 172.21.15.49:0/3413857513 conn(0x7f05900f34b0 msgr2=0x7f05900f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:54.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 -- 172.21.15.49:0/3413857513 shutdown_connections 2024-02-22T00:55:54.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 -- 172.21.15.49:0/3413857513 wait complete. 2024-02-22T00:55:54.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.674+0000 7f0596a0e700 1 Processor -- start 2024-02-22T00:55:54.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f0596a0e700 1 -- start start 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f0596a0e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fd8f0 0x7f059010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f0596a0e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fe250 0x7f059010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f0596a0e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059010eae0 con 0x7f05900fd8f0 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f0596a0e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059010ec20 con 0x7f05900fe250 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f058ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fd8f0 0x7f059010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f058ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fd8f0 0x7f059010dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42846/0 (socket says 172.21.15.49:42846) 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f058ffff700 1 -- 172.21.15.49:0/3134951015 learned_addr learned my addr 172.21.15.49:0/3134951015 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f058ffff700 1 -- 172.21.15.49:0/3134951015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fe250 msgr2=0x7f059010e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f058ffff700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fe250 0x7f059010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:54.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f058ffff700 1 -- 172.21.15.49:0/3134951015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578005040 con 0x7f05900fd8f0 2024-02-22T00:55:54.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.675+0000 7f058ffff700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fd8f0 0x7f059010dff0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f05800041d0 tx=0x7f0580009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:54 smithi049 ceph-mon[132694]: pgmap v569: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:54 smithi049 ceph-mon[132694]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:54.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:54 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1258837743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:55:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.676+0000 7f058d7fa700 1 -- 172.21.15.49:0/3134951015 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0580007b40 con 0x7f05900fd8f0 2024-02-22T00:55:54.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.676+0000 7f058d7fa700 1 -- 172.21.15.49:0/3134951015 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f058000f040 con 0x7f05900fd8f0 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.676+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05901082b0 con 0x7f05900fd8f0 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.676+0000 7f058d7fa700 1 -- 172.21.15.49:0/3134951015 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f058000d800 con 0x7f05900fd8f0 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.676+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0590108870 con 0x7f05900fd8f0 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.677+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059005f590 con 0x7f05900fd8f0 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.677+0000 7f058d7fa700 1 -- 172.21.15.49:0/3134951015 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0580007ca0 con 0x7f05900fd8f0 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.678+0000 7f058d7fa700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f057c06caa0 0x7f057c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.678+0000 7f058d7fa700 1 -- 172.21.15.49:0/3134951015 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f058008b7e0 con 0x7f05900fd8f0 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.678+0000 7f058f7fe700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f057c06caa0 0x7f057c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:54.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.678+0000 7f058f7fe700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f057c06caa0 0x7f057c06ef60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f0590109930 tx=0x7f0578009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:54.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.682+0000 7f058d7fa700 1 -- 172.21.15.49:0/3134951015 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0580059340 con 0x7f05900fd8f0 2024-02-22T00:55:54.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.898+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0590108b40 con 0x7f057c06caa0 2024-02-22T00:55:54.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.899+0000 7f058d7fa700 1 -- 172.21.15.49:0/3134951015 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0590108b40 con 0x7f057c06caa0 2024-02-22T00:55:54.899 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:55:54.900 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:55:54.901 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:55:54.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f057c06caa0 msgr2=0x7f057c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f057c06caa0 0x7f057c06ef60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f0590109930 tx=0x7f0578009cb0).stop 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fd8f0 msgr2=0x7f059010dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fd8f0 0x7f059010dff0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f05800041d0 tx=0x7f0580009f60).stop 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 shutdown_connections 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f057c06caa0 0x7f057c06ef60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05900fd8f0 0x7f059010dff0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 --2- 172.21.15.49:0/3134951015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05900fe250 0x7f059010e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 >> 172.21.15.49:0/3134951015 conn(0x7f05900f34b0 msgr2=0x7f05900fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 shutdown_connections 2024-02-22T00:55:54.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:54.901+0000 7f0596a0e700 1 -- 172.21.15.49:0/3134951015 wait complete. 2024-02-22T00:55:55.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.002+0000 7f9208a59700 1 -- 172.21.15.49:0/3648521066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f9200 msgr2=0x7f9204101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.002+0000 7f9208a59700 1 --2- 172.21.15.49:0/3648521066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f9200 0x7f9204101910 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f91f80047f0 tx=0x7f91f8009cb0).stop 2024-02-22T00:55:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.003+0000 7f9208a59700 1 -- 172.21.15.49:0/3648521066 shutdown_connections 2024-02-22T00:55:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.003+0000 7f9208a59700 1 --2- 172.21.15.49:0/3648521066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f9200 0x7f9204101910 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.003+0000 7f9208a59700 1 --2- 172.21.15.49:0/3648521066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040f88a0 0x7f92040f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.003+0000 7f9208a59700 1 -- 172.21.15.49:0/3648521066 >> 172.21.15.49:0/3648521066 conn(0x7f9204070590 msgr2=0x7f92040f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.003+0000 7f9208a59700 1 -- 172.21.15.49:0/3648521066 shutdown_connections 2024-02-22T00:55:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.003+0000 7f9208a59700 1 -- 172.21.15.49:0/3648521066 wait complete. 2024-02-22T00:55:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.003+0000 7f9208a59700 1 Processor -- start 2024-02-22T00:55:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.003+0000 7f9208a59700 1 -- start start 2024-02-22T00:55:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f9208a59700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f88a0 0x7f920410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f9208a59700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040f9200 0x7f920410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f9208a59700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920410eb70 con 0x7f92040f88a0 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f9208a59700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920410ecb0 con 0x7f92040f9200 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f920259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f88a0 0x7f920410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f920259c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f88a0 0x7f920410e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42862/0 (socket says 172.21.15.49:42862) 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f920259c700 1 -- 172.21.15.49:0/3409935183 learned_addr learned my addr 172.21.15.49:0/3409935183 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f920259c700 1 -- 172.21.15.49:0/3409935183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040f9200 msgr2=0x7f920410e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f920259c700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040f9200 0x7f920410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f920259c700 1 -- 172.21.15.49:0/3409935183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f8005040 con 0x7f92040f88a0 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f920259c700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f88a0 0x7f920410e080 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f91f40041d0 tx=0x7f91f4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f91f37fe700 1 -- 172.21.15.49:0/3409935183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91f4002d90 con 0x7f92040f88a0 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f91f37fe700 1 -- 172.21.15.49:0/3409935183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f91f400f040 con 0x7f92040f88a0 2024-02-22T00:55:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9204108340 con 0x7f92040f88a0 2024-02-22T00:55:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f91f37fe700 1 -- 172.21.15.49:0/3409935183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91f400d800 con 0x7f92040f88a0 2024-02-22T00:55:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.004+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9204108880 con 0x7f92040f88a0 2024-02-22T00:55:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.006+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920405f590 con 0x7f92040f88a0 2024-02-22T00:55:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.006+0000 7f91f37fe700 1 -- 172.21.15.49:0/3409935183 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f91f400dac0 con 0x7f92040f88a0 2024-02-22T00:55:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.006+0000 7f91f37fe700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f91ec06cab0 0x7f91ec06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:55:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.006+0000 7f91f37fe700 1 -- 172.21.15.49:0/3409935183 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f91f408bdf0 con 0x7f92040f88a0 2024-02-22T00:55:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.006+0000 7f9201d9b700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f91ec06cab0 0x7f91ec06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:55:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.007+0000 7f9201d9b700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f91ec06cab0 0x7f91ec06ef70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f91f8004710 tx=0x7f91f8009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:55:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.011+0000 7f91f37fe700 1 -- 172.21.15.49:0/3409935183 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f91f4059950 con 0x7f92040f88a0 2024-02-22T00:55:55.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.297+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9204047540 con 0x7f92040f88a0 2024-02-22T00:55:55.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.297+0000 7f91f37fe700 1 -- 172.21.15.49:0/3409935183 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f91f40594e0 con 0x7f92040f88a0 2024-02-22T00:55:55.298 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:55:55.298 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:55:55.298 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:55:55.298 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:55:55.299 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:55:55.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.299+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f91ec06cab0 msgr2=0x7f91ec06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:55.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.299+0000 7f9208a59700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f91ec06cab0 0x7f91ec06ef70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f91f8004710 tx=0x7f91f8009cb0).stop 2024-02-22T00:55:55.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.299+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f88a0 msgr2=0x7f920410e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:55:55.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.299+0000 7f9208a59700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f88a0 0x7f920410e080 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f91f40041d0 tx=0x7f91f4009f60).stop 2024-02-22T00:55:55.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.300+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 shutdown_connections 2024-02-22T00:55:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.300+0000 7f9208a59700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f91ec06cab0 0x7f91ec06ef70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.300+0000 7f9208a59700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92040f88a0 0x7f920410e080 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:55:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.300+0000 7f9208a59700 1 --2- 172.21.15.49:0/3409935183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92040f9200 0x7f920410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:55:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.300+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 >> 172.21.15.49:0/3409935183 conn(0x7f9204070590 msgr2=0x7f92040fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:55:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.300+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 shutdown_connections 2024-02-22T00:55:55.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:55:55.300+0000 7f9208a59700 1 -- 172.21.15.49:0/3409935183 wait complete. 2024-02-22T00:55:55.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:55 smithi161 ceph-mon[113442]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:55.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:55 smithi161 ceph-mon[113442]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:55.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:55 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/832179800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:55:55.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:55 smithi049 ceph-mon[132694]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:55.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:55 smithi049 ceph-mon[132694]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:55.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:55 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/832179800' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:55:56.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:56 smithi161 ceph-mon[113442]: pgmap v570: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:56 smithi161 ceph-mon[113442]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:56.542 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:56 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3409935183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:55:56.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:56 smithi049 ceph-mon[132694]: pgmap v570: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:56.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:56 smithi049 ceph-mon[132694]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:55:56.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:56 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3409935183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:55:58.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:58 smithi161 ceph-mon[113442]: pgmap v571: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:58.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:55:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:55:58.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:58 smithi049 ceph-mon[132694]: pgmap v571: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:55:58.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:55:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:00.541 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:00 smithi161 ceph-mon[113442]: pgmap v572: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:00.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:00 smithi049 ceph-mon[132694]: pgmap v572: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:02.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:02 smithi049 ceph-mon[132694]: pgmap v573: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:02.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:02 smithi161 ceph-mon[113442]: pgmap v573: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:04.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:04 smithi049 ceph-mon[132694]: pgmap v574: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:04.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:04 smithi161 ceph-mon[113442]: pgmap v574: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:06.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:06 smithi049 ceph-mon[132694]: pgmap v575: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:06.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:06 smithi161 ceph-mon[113442]: pgmap v575: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:08.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:08 smithi049 ceph-mon[132694]: pgmap v576: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:08.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:08 smithi161 ceph-mon[113442]: pgmap v576: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:10.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:10 smithi049 ceph-mon[132694]: pgmap v577: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:10.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:10 smithi161 ceph-mon[113442]: pgmap v577: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:12.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:12 smithi049 ceph-mon[132694]: pgmap v578: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:12.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:12 smithi161 ceph-mon[113442]: pgmap v578: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:13.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:13.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:14.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:14 smithi049 ceph-mon[132694]: pgmap v579: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:14.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:14 smithi161 ceph-mon[113442]: pgmap v579: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:16.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:16 smithi049 ceph-mon[132694]: pgmap v580: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:16.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:16 smithi161 ceph-mon[113442]: pgmap v580: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:18.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:18 smithi049 ceph-mon[132694]: pgmap v581: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:18.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:18 smithi161 ceph-mon[113442]: pgmap v581: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:20.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:20 smithi049 ceph-mon[132694]: pgmap v582: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:20.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:20 smithi161 ceph-mon[113442]: pgmap v582: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:22.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:22 smithi049 ceph-mon[132694]: pgmap v583: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:22.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:22 smithi161 ceph-mon[113442]: pgmap v583: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:24.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:24 smithi049 ceph-mon[132694]: pgmap v584: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:24.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:24 smithi161 ceph-mon[113442]: pgmap v584: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:25.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.417+0000 7fc7b8a26700 1 -- 172.21.15.49:0/337061909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 msgr2=0x7fc7b40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:25.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.417+0000 7fc7b8a26700 1 --2- 172.21.15.49:0/337061909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 0x7fc7b40f6930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fc79c0047f0 tx=0x7fc79c009cb0).stop 2024-02-22T00:56:25.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.417+0000 7fc7b8a26700 1 -- 172.21.15.49:0/337061909 shutdown_connections 2024-02-22T00:56:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.417+0000 7fc7b8a26700 1 --2- 172.21.15.49:0/337061909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 0x7fc7b40f6930 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.417+0000 7fc7b8a26700 1 --2- 172.21.15.49:0/337061909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40fc7f0 0x7fc7b40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.417+0000 7fc7b8a26700 1 -- 172.21.15.49:0/337061909 >> 172.21.15.49:0/337061909 conn(0x7fc7b4070590 msgr2=0x7fc7b40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.418+0000 7fc7b8a26700 1 -- 172.21.15.49:0/337061909 shutdown_connections 2024-02-22T00:56:25.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.418+0000 7fc7b8a26700 1 -- 172.21.15.49:0/337061909 wait complete. 2024-02-22T00:56:25.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.418+0000 7fc7b8a26700 1 Processor -- start 2024-02-22T00:56:25.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.418+0000 7fc7b8a26700 1 -- start start 2024-02-22T00:56:25.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b8a26700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40fc7f0 0x7fc7b410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:25.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b8a26700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 0x7fc7b410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:25.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b8a26700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b410eab0 con 0x7fc7b40fd150 2024-02-22T00:56:25.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b8a26700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b410ebf0 con 0x7fc7b40fc7f0 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 0x7fc7b410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b1d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 0x7fc7b410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39686/0 (socket says 172.21.15.49:39686) 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b1d9b700 1 -- 172.21.15.49:0/1131184399 learned_addr learned my addr 172.21.15.49:0/1131184399 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b1d9b700 1 -- 172.21.15.49:0/1131184399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40fc7f0 msgr2=0x7fc7b410dfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b1d9b700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40fc7f0 0x7fc7b410dfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b1d9b700 1 -- 172.21.15.49:0/1131184399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c005040 con 0x7fc7b40fd150 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7b1d9b700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 0x7fc7b410e4b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fc79c0099f0 tx=0x7fc79c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.419+0000 7fc7ab7fe700 1 -- 172.21.15.49:0/1131184399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79c00e030 con 0x7fc7b40fd150 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.420+0000 7fc7ab7fe700 1 -- 172.21.15.49:0/1131184399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc79c007e90 con 0x7fc7b40fd150 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.420+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b4108220 con 0x7fc7b40fd150 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.420+0000 7fc7ab7fe700 1 -- 172.21.15.49:0/1131184399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79c018070 con 0x7fc7b40fd150 2024-02-22T00:56:25.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.420+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b4108780 con 0x7fc7b40fd150 2024-02-22T00:56:25.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.421+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b405f590 con 0x7fc7b40fd150 2024-02-22T00:56:25.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.421+0000 7fc7ab7fe700 1 -- 172.21.15.49:0/1131184399 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc79c009590 con 0x7fc7b40fd150 2024-02-22T00:56:25.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.422+0000 7fc7ab7fe700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006ca30 0x7fc7a006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:25.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.422+0000 7fc7ab7fe700 1 -- 172.21.15.49:0/1131184399 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc79c08d040 con 0x7fc7b40fd150 2024-02-22T00:56:25.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.422+0000 7fc7b259c700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006ca30 0x7fc7a006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:25.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.422+0000 7fc7b259c700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006ca30 0x7fc7a006eef0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fc7a4004b90 tx=0x7fc7a4009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:25.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.426+0000 7fc7ab7fe700 1 -- 172.21.15.49:0/1131184399 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc79c05aba0 con 0x7fc7b40fd150 2024-02-22T00:56:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.642+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7b4108e10 con 0x7fc7a006ca30 2024-02-22T00:56:25.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.643+0000 7fc7ab7fe700 1 -- 172.21.15.49:0/1131184399 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc7b4108e10 con 0x7fc7a006ca30 2024-02-22T00:56:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006ca30 msgr2=0x7fc7a006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006ca30 0x7fc7a006eef0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fc7a4004b90 tx=0x7fc7a4009b60).stop 2024-02-22T00:56:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 msgr2=0x7fc7b410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 0x7fc7b410e4b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fc79c0099f0 tx=0x7fc79c009cb0).stop 2024-02-22T00:56:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 shutdown_connections 2024-02-22T00:56:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc7a006ca30 0x7fc7a006eef0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7b40fc7f0 0x7fc7b410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:25.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 --2- 172.21.15.49:0/1131184399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc7b40fd150 0x7fc7b410e4b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.645+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 >> 172.21.15.49:0/1131184399 conn(0x7fc7b4070590 msgr2=0x7fc7b4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.646+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 shutdown_connections 2024-02-22T00:56:25.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.646+0000 7fc7b8a26700 1 -- 172.21.15.49:0/1131184399 wait complete. 2024-02-22T00:56:25.655 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:56:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.748+0000 7f20a20c7700 1 -- 172.21.15.49:0/1990326856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 msgr2=0x7f209c0f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.748+0000 7f20a20c7700 1 --2- 172.21.15.49:0/1990326856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 0x7f209c0f5f80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f20900047f0 tx=0x7f2090009cb0).stop 2024-02-22T00:56:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.748+0000 7f20a20c7700 1 -- 172.21.15.49:0/1990326856 shutdown_connections 2024-02-22T00:56:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.748+0000 7f20a20c7700 1 --2- 172.21.15.49:0/1990326856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 0x7f209c0f5f80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.748+0000 7f20a20c7700 1 --2- 172.21.15.49:0/1990326856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f209c0fd8b0 0x7f209c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.748+0000 7f20a20c7700 1 -- 172.21.15.49:0/1990326856 >> 172.21.15.49:0/1990326856 conn(0x7f209c06ce40 msgr2=0x7f209c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.748+0000 7f20a20c7700 1 -- 172.21.15.49:0/1990326856 shutdown_connections 2024-02-22T00:56:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.748+0000 7f20a20c7700 1 -- 172.21.15.49:0/1990326856 wait complete. 2024-02-22T00:56:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f20a20c7700 1 Processor -- start 2024-02-22T00:56:25.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f20a20c7700 1 -- start start 2024-02-22T00:56:25.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f20a20c7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f209c0fd8b0 0x7f209c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f20a20c7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 0x7f209c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f20a20c7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c10eae0 con 0x7f209c0fe210 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f20a20c7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209c10ec20 con 0x7f209c0fd8b0 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f209affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 0x7f209c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f209affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 0x7f209c10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39714/0 (socket says 172.21.15.49:39714) 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.749+0000 7f209affd700 1 -- 172.21.15.49:0/3699755689 learned_addr learned my addr 172.21.15.49:0/3699755689 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f209b7fe700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f209c0fd8b0 0x7f209c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f209affd700 1 -- 172.21.15.49:0/3699755689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f209c0fd8b0 msgr2=0x7f209c10dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f209affd700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f209c0fd8b0 0x7f209c10dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f209affd700 1 -- 172.21.15.49:0/3699755689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2090005040 con 0x7f209c0fe210 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f209affd700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 0x7f209c10e4e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f2090005010 tx=0x7f2090009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f2098ff9700 1 -- 172.21.15.49:0/3699755689 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f209000e030 con 0x7f209c0fe210 2024-02-22T00:56:25.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f2098ff9700 1 -- 172.21.15.49:0/3699755689 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2090007e90 con 0x7f209c0fe210 2024-02-22T00:56:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209c108250 con 0x7f209c0fe210 2024-02-22T00:56:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f2098ff9700 1 -- 172.21.15.49:0/3699755689 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2090018070 con 0x7f209c0fe210 2024-02-22T00:56:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.750+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209c108730 con 0x7f209c0fe210 2024-02-22T00:56:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.751+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209c060670 con 0x7f209c0fe210 2024-02-22T00:56:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.752+0000 7f2098ff9700 1 -- 172.21.15.49:0/3699755689 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f209001d6e0 con 0x7f209c0fe210 2024-02-22T00:56:25.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.752+0000 7f2098ff9700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f208406caa0 0x7f208406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:25.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.752+0000 7f2098ff9700 1 -- 172.21.15.49:0/3699755689 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f209008cf30 con 0x7f209c0fe210 2024-02-22T00:56:25.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.752+0000 7f209b7fe700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f208406caa0 0x7f208406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:25.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.752+0000 7f209b7fe700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f208406caa0 0x7f208406ef60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f208c009250 tx=0x7f208c009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:25.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.757+0000 7f2098ff9700 1 -- 172.21.15.49:0/3699755689 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f20900c0190 con 0x7f209c0fe210 2024-02-22T00:56:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.974+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f209c0faac0 con 0x7f208406caa0 2024-02-22T00:56:25.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.975+0000 7f2098ff9700 1 -- 172.21.15.49:0/3699755689 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f209c0faac0 con 0x7f208406caa0 2024-02-22T00:56:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f208406caa0 msgr2=0x7f208406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f208406caa0 0x7f208406ef60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f208c009250 tx=0x7f208c009de0).stop 2024-02-22T00:56:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 msgr2=0x7f209c10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 0x7f209c10e4e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f2090005010 tx=0x7f2090009cb0).stop 2024-02-22T00:56:25.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 shutdown_connections 2024-02-22T00:56:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f208406caa0 0x7f208406ef60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f209c0fd8b0 0x7f209c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 --2- 172.21.15.49:0/3699755689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f209c0fe210 0x7f209c10e4e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 >> 172.21.15.49:0/3699755689 conn(0x7f209c06ce40 msgr2=0x7f209c100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 shutdown_connections 2024-02-22T00:56:25.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:25.977+0000 7f20a20c7700 1 -- 172.21.15.49:0/3699755689 wait complete. 2024-02-22T00:56:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.079+0000 7fd5d76e3700 1 -- 172.21.15.49:0/4155213676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fd150 msgr2=0x7fd5d00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.079+0000 7fd5d76e3700 1 --2- 172.21.15.49:0/4155213676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fd150 0x7fd5d00f6930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fd5c00047f0 tx=0x7fd5c0009cb0).stop 2024-02-22T00:56:26.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.079+0000 7fd5d76e3700 1 -- 172.21.15.49:0/4155213676 shutdown_connections 2024-02-22T00:56:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.079+0000 7fd5d76e3700 1 --2- 172.21.15.49:0/4155213676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fd150 0x7fd5d00f6930 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.079+0000 7fd5d76e3700 1 --2- 172.21.15.49:0/4155213676 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5d00fc7f0 0x7fd5d00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.079+0000 7fd5d76e3700 1 -- 172.21.15.49:0/4155213676 >> 172.21.15.49:0/4155213676 conn(0x7fd5d0070590 msgr2=0x7fd5d00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.079+0000 7fd5d76e3700 1 -- 172.21.15.49:0/4155213676 shutdown_connections 2024-02-22T00:56:26.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.079+0000 7fd5d76e3700 1 -- 172.21.15.49:0/4155213676 wait complete. 2024-02-22T00:56:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d76e3700 1 Processor -- start 2024-02-22T00:56:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d76e3700 1 -- start start 2024-02-22T00:56:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d76e3700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fc7f0 0x7fd5d00f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d76e3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5d00fd150 0x7fd5d00f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d76e3700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00f8f20 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d76e3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00f9060 con 0x7fd5d00fd150 2024-02-22T00:56:26.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d547f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fc7f0 0x7fd5d00f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d547f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fc7f0 0x7fd5d00f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39730/0 (socket says 172.21.15.49:39730) 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d547f700 1 -- 172.21.15.49:0/341693257 learned_addr learned my addr 172.21.15.49:0/341693257 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d547f700 1 -- 172.21.15.49:0/341693257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5d00fd150 msgr2=0x7fd5d00f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d547f700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5d00fd150 0x7fd5d00f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d547f700 1 -- 172.21.15.49:0/341693257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0005040 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5d547f700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fc7f0 0x7fd5d00f8540 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fd5cc00c740 tx=0x7fd5cc007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5c67fc700 1 -- 172.21.15.49:0/341693257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5cc00e680 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.080+0000 7fd5c67fc700 1 -- 172.21.15.49:0/341693257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5cc00ec90 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.081+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d00f9310 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.081+0000 7fd5c67fc700 1 -- 172.21.15.49:0/341693257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5cc013d60 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.081+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d01146a0 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.081+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d005f590 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.082+0000 7fd5c67fc700 1 -- 172.21.15.49:0/341693257 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd5cc00e7e0 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.083+0000 7fd5c67fc700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd5bc06caa0 0x7fd5bc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.083+0000 7fd5c67fc700 1 -- 172.21.15.49:0/341693257 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd5cc08c680 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.083+0000 7fd5d4c7e700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd5bc06caa0 0x7fd5bc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:26.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.083+0000 7fd5d4c7e700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd5bc06caa0 0x7fd5bc06ef60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fd5d00f9ce0 tx=0x7fd5c0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:26.086 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.087+0000 7fd5c67fc700 1 -- 172.21.15.49:0/341693257 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd5cc056750 con 0x7fd5d00fc7f0 2024-02-22T00:56:26.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.292+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5d00fb5a0 con 0x7fd5bc06caa0 2024-02-22T00:56:26.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.302+0000 7fd5c67fc700 1 -- 172.21.15.49:0/341693257 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fd5d00fb5a0 con 0x7fd5bc06caa0 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (19m) 13m ago 30m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (17m) 13m ago 30m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (17m) 13m ago 30m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (19m) 13m ago 30m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (13m) 13m ago 25m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (13m) 13m ago 25m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (13m) 13m ago 25m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:56:26.302 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (13m) 13m ago 25m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (21m) 13m ago 32m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (20m) 13m ago 30m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (18m) 13m ago 32m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (17m) 13m ago 30m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (20m) 13m ago 30m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (20m) 13m ago 29m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (16m) 13m ago 29m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (16m) 13m ago 28m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (15m) 13m ago 28m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (15m) 13m ago 28m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (14m) 13m ago 27m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (14m) 13m ago 27m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:56:26.303 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (19m) 13m ago 29m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:56:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd5bc06caa0 msgr2=0x7fd5bc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd5bc06caa0 0x7fd5bc06ef60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fd5d00f9ce0 tx=0x7fd5c0009cb0).stop 2024-02-22T00:56:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fc7f0 msgr2=0x7fd5d00f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fc7f0 0x7fd5d00f8540 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fd5cc00c740 tx=0x7fd5cc007ef0).stop 2024-02-22T00:56:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 shutdown_connections 2024-02-22T00:56:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd5bc06caa0 0x7fd5bc06ef60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5d00fc7f0 0x7fd5d00f8540 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 --2- 172.21.15.49:0/341693257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5d00fd150 0x7fd5d00f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 >> 172.21.15.49:0/341693257 conn(0x7fd5d0070590 msgr2=0x7fd5d0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 shutdown_connections 2024-02-22T00:56:26.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.304+0000 7fd5d76e3700 1 -- 172.21.15.49:0/341693257 wait complete. 2024-02-22T00:56:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 -- 172.21.15.49:0/1193192838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 msgr2=0x7f21680fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 --2- 172.21.15.49:0/1193192838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 0x7f21680fdd50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f21580047f0 tx=0x7f2158009cb0).stop 2024-02-22T00:56:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 -- 172.21.15.49:0/1193192838 shutdown_connections 2024-02-22T00:56:26.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 --2- 172.21.15.49:0/1193192838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21680fe2d0 0x7f21680f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 --2- 172.21.15.49:0/1193192838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 0x7f21680fdd50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 -- 172.21.15.49:0/1193192838 >> 172.21.15.49:0/1193192838 conn(0x7f21680f3550 msgr2=0x7f21680f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 -- 172.21.15.49:0/1193192838 shutdown_connections 2024-02-22T00:56:26.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 -- 172.21.15.49:0/1193192838 wait complete. 2024-02-22T00:56:26.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 Processor -- start 2024-02-22T00:56:26.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.406+0000 7f216e503700 1 -- start start 2024-02-22T00:56:26.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f216e503700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 0x7f216810dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f216e503700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21680fe2d0 0x7f216810e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f216e503700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216810eae0 con 0x7f21680fd970 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f216e503700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216810ec20 con 0x7f21680fe2d0 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f2167fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 0x7f216810dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f2167fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 0x7f216810dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39738/0 (socket says 172.21.15.49:39738) 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f2167fff700 1 -- 172.21.15.49:0/2238087628 learned_addr learned my addr 172.21.15.49:0/2238087628 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f2167fff700 1 -- 172.21.15.49:0/2238087628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21680fe2d0 msgr2=0x7f216810e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f21677fe700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21680fe2d0 0x7f216810e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f2167fff700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21680fe2d0 0x7f216810e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f2167fff700 1 -- 172.21.15.49:0/2238087628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158005040 con 0x7f21680fd970 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.407+0000 7f2167fff700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 0x7f216810dff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f215800b120 tx=0x7f2158009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.408+0000 7f21657fa700 1 -- 172.21.15.49:0/2238087628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f215800e030 con 0x7f21680fd970 2024-02-22T00:56:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.408+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2168108250 con 0x7f21680fd970 2024-02-22T00:56:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.408+0000 7f21657fa700 1 -- 172.21.15.49:0/2238087628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2158007e90 con 0x7f21680fd970 2024-02-22T00:56:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.408+0000 7f21657fa700 1 -- 172.21.15.49:0/2238087628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2158018070 con 0x7f21680fd970 2024-02-22T00:56:26.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.408+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21681087b0 con 0x7f21680fd970 2024-02-22T00:56:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.408+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2168060370 con 0x7f21680fd970 2024-02-22T00:56:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.409+0000 7f21657fa700 1 -- 172.21.15.49:0/2238087628 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f215801d420 con 0x7f21680fd970 2024-02-22T00:56:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.409+0000 7f21657fa700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f215406caa0 0x7f215406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.410+0000 7f21657fa700 1 -- 172.21.15.49:0/2238087628 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f215808d1a0 con 0x7f21680fd970 2024-02-22T00:56:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.410+0000 7f21677fe700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f215406caa0 0x7f215406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.410+0000 7f21677fe700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f215406caa0 0x7f215406ef60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f2168109930 tx=0x7f2150009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.414+0000 7f21657fa700 1 -- 172.21.15.49:0/2238087628 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f215805ad00 con 0x7f21680fd970 2024-02-22T00:56:26.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:26 smithi049 ceph-mon[132694]: pgmap v585: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:26.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.693+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f21680ffcc0 con 0x7f21680fd970 2024-02-22T00:56:26.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.694+0000 7f21657fa700 1 -- 172.21.15.49:0/2238087628 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f215805a890 con 0x7f21680fd970 2024-02-22T00:56:26.693 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:56:26.693 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:56:26.693 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:56:26.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:56:26.693 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:56:26.694 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:56:26.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f215406caa0 msgr2=0x7f215406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f215406caa0 0x7f215406ef60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f2168109930 tx=0x7f2150009040).stop 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 msgr2=0x7f216810dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 0x7f216810dff0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f215800b120 tx=0x7f2158009cb0).stop 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 shutdown_connections 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f215406caa0 0x7f215406ef60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21680fd970 0x7f216810dff0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 --2- 172.21.15.49:0/2238087628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21680fe2d0 0x7f216810e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 >> 172.21.15.49:0/2238087628 conn(0x7f21680f3550 msgr2=0x7f21680fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 shutdown_connections 2024-02-22T00:56:26.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.696+0000 7f216e503700 1 -- 172.21.15.49:0/2238087628 wait complete. 2024-02-22T00:56:26.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:26 smithi161 ceph-mon[113442]: pgmap v585: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:26.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.798+0000 7f1807f08700 1 -- 172.21.15.49:0/1808015641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fd150 msgr2=0x7f18000f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.798+0000 7f1807f08700 1 --2- 172.21.15.49:0/1808015641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fd150 0x7f18000f6930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f17f00047f0 tx=0x7f17f0009cb0).stop 2024-02-22T00:56:26.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.798+0000 7f1807f08700 1 -- 172.21.15.49:0/1808015641 shutdown_connections 2024-02-22T00:56:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.798+0000 7f1807f08700 1 --2- 172.21.15.49:0/1808015641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fd150 0x7f18000f6930 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 --2- 172.21.15.49:0/1808015641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18000fc7f0 0x7f18000fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 -- 172.21.15.49:0/1808015641 >> 172.21.15.49:0/1808015641 conn(0x7f1800070590 msgr2=0x7f18000f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 -- 172.21.15.49:0/1808015641 shutdown_connections 2024-02-22T00:56:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 -- 172.21.15.49:0/1808015641 wait complete. 2024-02-22T00:56:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 Processor -- start 2024-02-22T00:56:26.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 -- start start 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fc7f0 0x7f180010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18000fd150 0x7f180010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180010ead0 con 0x7f18000fc7f0 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.799+0000 7f1807f08700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180010ec10 con 0x7f18000fd150 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1805ca4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fc7f0 0x7f180010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1805ca4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fc7f0 0x7f180010dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39756/0 (socket says 172.21.15.49:39756) 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1805ca4700 1 -- 172.21.15.49:0/1373972900 learned_addr learned my addr 172.21.15.49:0/1373972900 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f18054a3700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18000fd150 0x7f180010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1805ca4700 1 -- 172.21.15.49:0/1373972900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18000fd150 msgr2=0x7f180010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1805ca4700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18000fd150 0x7f180010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1805ca4700 1 -- 172.21.15.49:0/1373972900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0005040 con 0x7f18000fc7f0 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f18054a3700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18000fd150 0x7f180010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1805ca4700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fc7f0 0x7f180010dfe0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f17fc0041d0 tx=0x7f17fc009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f17f6ffd700 1 -- 172.21.15.49:0/1373972900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17fc007b40 con 0x7f18000fc7f0 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f17f6ffd700 1 -- 172.21.15.49:0/1373972900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f17fc00f040 con 0x7f18000fc7f0 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18001082a0 con 0x7f18000fc7f0 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f17f6ffd700 1 -- 172.21.15.49:0/1373972900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17fc00d800 con 0x7f18000fc7f0 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.800+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1800108860 con 0x7f18000fc7f0 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.801+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180005f590 con 0x7f18000fc7f0 2024-02-22T00:56:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.802+0000 7f17f6ffd700 1 -- 172.21.15.49:0/1373972900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f17fc007ca0 con 0x7f18000fc7f0 2024-02-22T00:56:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.802+0000 7f17f6ffd700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17ec06cab0 0x7f17ec06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.802+0000 7f17f6ffd700 1 -- 172.21.15.49:0/1373972900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f17fc08b7e0 con 0x7f18000fc7f0 2024-02-22T00:56:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.802+0000 7f18054a3700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17ec06cab0 0x7f17ec06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.803+0000 7f18054a3700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17ec06cab0 0x7f17ec06ef70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f1800109920 tx=0x7f17f0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:26.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:26.807+0000 7f17f6ffd700 1 -- 172.21.15.49:0/1373972900 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f17fc059340 con 0x7f18000fc7f0 2024-02-22T00:56:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.048+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1800109660 con 0x7f18000fc7f0 2024-02-22T00:56:27.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.049+0000 7f17f6ffd700 1 -- 172.21.15.49:0/1373972900 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f17fc058ed0 con 0x7f18000fc7f0 2024-02-22T00:56:27.048 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:56:27.048 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:56:27.048 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:56:27.049 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:56:27.050 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:56:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:56:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:56:27.051 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:56:27.051 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:56:27.051 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:56:27.051 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:56:27.051 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:56:27.051 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17ec06cab0 msgr2=0x7f17ec06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17ec06cab0 0x7f17ec06ef70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f1800109920 tx=0x7f17f0009cb0).stop 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fc7f0 msgr2=0x7f180010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fc7f0 0x7f180010dfe0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f17fc0041d0 tx=0x7f17fc009f60).stop 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 shutdown_connections 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17ec06cab0 0x7f17ec06ef70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18000fc7f0 0x7f180010dfe0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 --2- 172.21.15.49:0/1373972900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18000fd150 0x7f180010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 >> 172.21.15.49:0/1373972900 conn(0x7f1800070590 msgr2=0x7f1800060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 shutdown_connections 2024-02-22T00:56:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.051+0000 7f1807f08700 1 -- 172.21.15.49:0/1373972900 wait complete. 2024-02-22T00:56:27.053 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:56:27.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.153+0000 7fd045c93700 1 -- 172.21.15.49:0/3476787183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 msgr2=0x7fd0400f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.153+0000 7fd045c93700 1 --2- 172.21.15.49:0/3476787183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 0x7fd0400f7a50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fd0280047f0 tx=0x7fd028009cb0).stop 2024-02-22T00:56:27.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.154+0000 7fd045c93700 1 -- 172.21.15.49:0/3476787183 shutdown_connections 2024-02-22T00:56:27.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.154+0000 7fd045c93700 1 --2- 172.21.15.49:0/3476787183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 0x7fd0400f7a50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.154+0000 7fd045c93700 1 --2- 172.21.15.49:0/3476787183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400fd910 0x7fd0400fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:27.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.154+0000 7fd045c93700 1 -- 172.21.15.49:0/3476787183 >> 172.21.15.49:0/3476787183 conn(0x7fd0400f3530 msgr2=0x7fd0400f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:27.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.154+0000 7fd045c93700 1 -- 172.21.15.49:0/3476787183 shutdown_connections 2024-02-22T00:56:27.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.154+0000 7fd045c93700 1 -- 172.21.15.49:0/3476787183 wait complete. 2024-02-22T00:56:27.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.154+0000 7fd045c93700 1 Processor -- start 2024-02-22T00:56:27.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd045c93700 1 -- start start 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd045c93700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400fd910 0x7fd04010e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd045c93700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 0x7fd04010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd045c93700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04010ebe0 con 0x7fd0400fe270 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd045c93700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd040108200 con 0x7fd0400fd910 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd03effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 0x7fd04010e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd03effd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 0x7fd04010e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39762/0 (socket says 172.21.15.49:39762) 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd03effd700 1 -- 172.21.15.49:0/2908481048 learned_addr learned my addr 172.21.15.49:0/2908481048 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd03f7fe700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400fd910 0x7fd04010e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd03effd700 1 -- 172.21.15.49:0/2908481048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400fd910 msgr2=0x7fd04010e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd03effd700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400fd910 0x7fd04010e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd03effd700 1 -- 172.21.15.49:0/2908481048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd028005040 con 0x7fd0400fe270 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.155+0000 7fd03f7fe700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400fd910 0x7fd04010e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:56:27.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.156+0000 7fd03effd700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 0x7fd04010e550 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fd0280099f0 tx=0x7fd028009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:27.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.156+0000 7fd03cff9700 1 -- 172.21.15.49:0/2908481048 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd02800e030 con 0x7fd0400fe270 2024-02-22T00:56:27.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.156+0000 7fd03cff9700 1 -- 172.21.15.49:0/2908481048 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd028007e90 con 0x7fd0400fe270 2024-02-22T00:56:27.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.156+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd040108450 con 0x7fd0400fe270 2024-02-22T00:56:27.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.156+0000 7fd03cff9700 1 -- 172.21.15.49:0/2908481048 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd028018070 con 0x7fd0400fe270 2024-02-22T00:56:27.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.156+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd040108930 con 0x7fd0400fe270 2024-02-22T00:56:27.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.157+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04005f570 con 0x7fd0400fe270 2024-02-22T00:56:27.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.157+0000 7fd03cff9700 1 -- 172.21.15.49:0/2908481048 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd02801d420 con 0x7fd0400fe270 2024-02-22T00:56:27.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.158+0000 7fd03cff9700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02c06caa0 0x7fd02c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:27.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.158+0000 7fd03cff9700 1 -- 172.21.15.49:0/2908481048 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd02808d1c0 con 0x7fd0400fe270 2024-02-22T00:56:27.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.158+0000 7fd03f7fe700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02c06caa0 0x7fd02c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:27.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.158+0000 7fd03f7fe700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02c06caa0 0x7fd02c06ef60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fd03000a900 tx=0x7fd030008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:27.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.162+0000 7fd03cff9700 1 -- 172.21.15.49:0/2908481048 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd02805ad20 con 0x7fd0400fe270 2024-02-22T00:56:27.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.380+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd040109750 con 0x7fd02c06caa0 2024-02-22T00:56:27.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.381+0000 7fd03cff9700 1 -- 172.21.15.49:0/2908481048 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd040109750 con 0x7fd02c06caa0 2024-02-22T00:56:27.380 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:56:27.380 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:56:27.380 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:56:27.380 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:56:27.380 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:56:27.380 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:56:27.380 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:56:27.381 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:56:27.381 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:56:27.381 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:56:27.381 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:56:27.381 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:56:27.381 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:56:27.381 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:56:27.381 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:56:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02c06caa0 msgr2=0x7fd02c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02c06caa0 0x7fd02c06ef60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fd03000a900 tx=0x7fd030008040).stop 2024-02-22T00:56:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 msgr2=0x7fd04010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 0x7fd04010e550 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fd0280099f0 tx=0x7fd028009cb0).stop 2024-02-22T00:56:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 shutdown_connections 2024-02-22T00:56:27.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd02c06caa0 0x7fd02c06ef60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0400fd910 0x7fd04010e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 --2- 172.21.15.49:0/2908481048 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0400fe270 0x7fd04010e550 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 >> 172.21.15.49:0/2908481048 conn(0x7fd0400f3530 msgr2=0x7fd0400fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 shutdown_connections 2024-02-22T00:56:27.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.383+0000 7fd045c93700 1 -- 172.21.15.49:0/2908481048 wait complete. 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.493+0000 7f05c8345700 1 -- 172.21.15.49:0/3818792489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f9200 msgr2=0x7f05c0101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.493+0000 7f05c8345700 1 --2- 172.21.15.49:0/3818792489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f9200 0x7f05c0101910 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f05b00047f0 tx=0x7f05b0009cb0).stop 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.493+0000 7f05c8345700 1 -- 172.21.15.49:0/3818792489 shutdown_connections 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.493+0000 7f05c8345700 1 --2- 172.21.15.49:0/3818792489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f9200 0x7f05c0101910 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.493+0000 7f05c8345700 1 --2- 172.21.15.49:0/3818792489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05c00f88a0 0x7f05c00f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.493+0000 7f05c8345700 1 -- 172.21.15.49:0/3818792489 >> 172.21.15.49:0/3818792489 conn(0x7f05c0070590 msgr2=0x7f05c00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c8345700 1 -- 172.21.15.49:0/3818792489 shutdown_connections 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c8345700 1 -- 172.21.15.49:0/3818792489 wait complete. 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c8345700 1 Processor -- start 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c8345700 1 -- start start 2024-02-22T00:56:27.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c8345700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f88a0 0x7f05c010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c8345700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05c00f9200 0x7f05c010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c8345700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c010eb70 con 0x7f05c00f88a0 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c8345700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c010ecb0 con 0x7f05c00f9200 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c60e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f88a0 0x7f05c010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c60e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f88a0 0x7f05c010e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39772/0 (socket says 172.21.15.49:39772) 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.494+0000 7f05c60e1700 1 -- 172.21.15.49:0/3822525006 learned_addr learned my addr 172.21.15.49:0/3822525006 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05c58e0700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05c00f9200 0x7f05c010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05c60e1700 1 -- 172.21.15.49:0/3822525006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05c00f9200 msgr2=0x7f05c010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05c60e1700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05c00f9200 0x7f05c010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05c60e1700 1 -- 172.21.15.49:0/3822525006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0005040 con 0x7f05c00f88a0 2024-02-22T00:56:27.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05c58e0700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05c00f9200 0x7f05c010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:56:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05c60e1700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f88a0 0x7f05c010e080 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f05bc00c790 tx=0x7f05bc004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05b77fe700 1 -- 172.21.15.49:0/3822525006 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05bc0106f0 con 0x7f05c00f88a0 2024-02-22T00:56:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05b77fe700 1 -- 172.21.15.49:0/3822525006 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f05bc010d00 con 0x7f05c00f88a0 2024-02-22T00:56:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c0108340 con 0x7f05c00f88a0 2024-02-22T00:56:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05b77fe700 1 -- 172.21.15.49:0/3822525006 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05bc012da0 con 0x7f05c00f88a0 2024-02-22T00:56:27.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.495+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c0108880 con 0x7f05c00f88a0 2024-02-22T00:56:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.496+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c005f590 con 0x7f05c00f88a0 2024-02-22T00:56:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.497+0000 7f05b77fe700 1 -- 172.21.15.49:0/3822525006 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f05bc012400 con 0x7f05c00f88a0 2024-02-22T00:56:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.497+0000 7f05b77fe700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05ac06caa0 0x7f05ac06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.497+0000 7f05b77fe700 1 -- 172.21.15.49:0/3822525006 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f05bc08b640 con 0x7f05c00f88a0 2024-02-22T00:56:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.497+0000 7f05c58e0700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05ac06caa0 0x7f05ac06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:27.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.498+0000 7f05c58e0700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05ac06caa0 0x7f05ac06ef60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f05b00043d0 tx=0x7f05b000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:27.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.502+0000 7f05b77fe700 1 -- 172.21.15.49:0/3822525006 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f05bc0591a0 con 0x7f05c00f88a0 2024-02-22T00:56:27.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:27 smithi049 ceph-mon[132694]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:27.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:27 smithi049 ceph-mon[132694]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:27.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:27 smithi049 ceph-mon[132694]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:27.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:27 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2238087628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:56:27.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:27 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1373972900' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:56:27.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.778+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f05c0047540 con 0x7f05c00f88a0 2024-02-22T00:56:27.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.778+0000 7f05b77fe700 1 -- 172.21.15.49:0/3822525006 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f05bc058d30 con 0x7f05c00f88a0 2024-02-22T00:56:27.777 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:56:27.778 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:56:27.778 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:56:27.778 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:56:27.778 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:56:27.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05ac06caa0 msgr2=0x7f05ac06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05ac06caa0 0x7f05ac06ef60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f05b00043d0 tx=0x7f05b000b040).stop 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f88a0 msgr2=0x7f05c010e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f88a0 0x7f05c010e080 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f05bc00c790 tx=0x7f05bc004330).stop 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 shutdown_connections 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f05ac06caa0 0x7f05ac06ef60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05c00f88a0 0x7f05c010e080 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 --2- 172.21.15.49:0/3822525006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05c00f9200 0x7f05c010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 >> 172.21.15.49:0/3822525006 conn(0x7f05c0070590 msgr2=0x7f05c00fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 shutdown_connections 2024-02-22T00:56:27.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:27.780+0000 7f05c8345700 1 -- 172.21.15.49:0/3822525006 wait complete. 2024-02-22T00:56:27.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:27 smithi161 ceph-mon[113442]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:27.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:27 smithi161 ceph-mon[113442]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:27.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:27 smithi161 ceph-mon[113442]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:27.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:27 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2238087628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:56:27.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:27 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1373972900' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:56:28.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:28 smithi049 ceph-mon[132694]: pgmap v586: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:28.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:28.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:28 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3822525006' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:56:28.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:28 smithi161 ceph-mon[113442]: pgmap v586: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:28.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:28.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:28 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3822525006' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:56:29.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:29 smithi049 ceph-mon[132694]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:29.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:29 smithi161 ceph-mon[113442]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:30.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:30 smithi049 ceph-mon[132694]: pgmap v587: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:30.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:30 smithi161 ceph-mon[113442]: pgmap v587: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:32.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:32 smithi049 ceph-mon[132694]: pgmap v588: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:32.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:32 smithi161 ceph-mon[113442]: pgmap v588: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:34.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:34 smithi049 ceph-mon[132694]: pgmap v589: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:34.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:34 smithi161 ceph-mon[113442]: pgmap v589: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:36.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:36 smithi049 ceph-mon[132694]: pgmap v590: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:36.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:36 smithi161 ceph-mon[113442]: pgmap v590: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:38.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:38 smithi049 ceph-mon[132694]: pgmap v591: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:38.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:38 smithi161 ceph-mon[113442]: pgmap v591: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:40.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:40 smithi049 ceph-mon[132694]: pgmap v592: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:40.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:40 smithi161 ceph-mon[113442]: pgmap v592: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:42.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:42 smithi049 ceph-mon[132694]: pgmap v593: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:42.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:42 smithi161 ceph-mon[113442]: pgmap v593: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:43.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:43.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:44.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:44 smithi049 ceph-mon[132694]: pgmap v594: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:44.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:44 smithi161 ceph-mon[113442]: pgmap v594: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:46.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:46 smithi049 ceph-mon[132694]: pgmap v595: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:46.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:46 smithi161 ceph-mon[113442]: pgmap v595: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:48.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:48 smithi049 ceph-mon[132694]: pgmap v596: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:48.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:48 smithi161 ceph-mon[113442]: pgmap v596: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:49.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:49 smithi161 ceph-mon[113442]: pgmap v597: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:49.927 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:49 smithi049 ceph-mon[132694]: pgmap v597: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:52.424 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:52 smithi049 ceph-mon[132694]: pgmap v598: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:52.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:52 smithi161 ceph-mon[113442]: pgmap v598: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:54.424 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:54 smithi049 ceph-mon[132694]: pgmap v599: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:54.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:54 smithi161 ceph-mon[113442]: pgmap v599: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:56.424 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:56 smithi049 ceph-mon[132694]: pgmap v600: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:56.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:56 smithi161 ceph-mon[113442]: pgmap v600: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.895+0000 7ff1ece4c700 1 -- 172.21.15.49:0/1416142119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 msgr2=0x7ff1e80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.895+0000 7ff1ece4c700 1 --2- 172.21.15.49:0/1416142119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 0x7ff1e80fcbd0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7ff1d80047f0 tx=0x7ff1d8009cb0).stop 2024-02-22T00:56:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.895+0000 7ff1ece4c700 1 -- 172.21.15.49:0/1416142119 shutdown_connections 2024-02-22T00:56:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.895+0000 7ff1ece4c700 1 --2- 172.21.15.49:0/1416142119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e80fd150 0x7ff1e80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.895+0000 7ff1ece4c700 1 --2- 172.21.15.49:0/1416142119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 0x7ff1e80fcbd0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:57.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.895+0000 7ff1ece4c700 1 -- 172.21.15.49:0/1416142119 >> 172.21.15.49:0/1416142119 conn(0x7ff1e8070590 msgr2=0x7ff1e80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:57.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.895+0000 7ff1ece4c700 1 -- 172.21.15.49:0/1416142119 shutdown_connections 2024-02-22T00:56:57.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.896+0000 7ff1ece4c700 1 -- 172.21.15.49:0/1416142119 wait complete. 2024-02-22T00:56:57.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.896+0000 7ff1ece4c700 1 Processor -- start 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.896+0000 7ff1ece4c700 1 -- start start 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1ece4c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 0x7ff1e810e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1ece4c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e80fd150 0x7ff1e810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1ece4c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e810eb30 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1ece4c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e810ec70 con 0x7ff1e80fd150 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 0x7ff1e810e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 0x7ff1e810e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52842/0 (socket says 172.21.15.49:52842) 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e659c700 1 -- 172.21.15.49:0/700169817 learned_addr learned my addr 172.21.15.49:0/700169817 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e5d9b700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e80fd150 0x7ff1e810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e659c700 1 -- 172.21.15.49:0/700169817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e80fd150 msgr2=0x7ff1e810e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e659c700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e80fd150 0x7ff1e810e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:57.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e659c700 1 -- 172.21.15.49:0/700169817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d8005040 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e5d9b700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e80fd150 0x7ff1e810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:56:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1e659c700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 0x7ff1e810e040 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7ff1d8005010 tx=0x7ff1d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1d77fe700 1 -- 172.21.15.49:0/700169817 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d800e030 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1d77fe700 1 -- 172.21.15.49:0/700169817 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff1d8007e90 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e81082a0 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.897+0000 7ff1d77fe700 1 -- 172.21.15.49:0/700169817 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d8018070 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.898+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e8108800 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.898+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e805f590 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.899+0000 7ff1d77fe700 1 -- 172.21.15.49:0/700169817 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff1d801d6e0 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.899+0000 7ff1d77fe700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff1d006ca30 0x7ff1d006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.900+0000 7ff1e5d9b700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff1d006ca30 0x7ff1d006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.900+0000 7ff1d77fe700 1 -- 172.21.15.49:0/700169817 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff1d808d050 con 0x7ff1e80fc7f0 2024-02-22T00:56:57.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.900+0000 7ff1e5d9b700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff1d006ca30 0x7ff1d006eef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff1e8109980 tx=0x7ff1dc009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:57.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:57.904+0000 7ff1d77fe700 1 -- 172.21.15.49:0/700169817 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff1d805a920 con 0x7ff1e80fc7f0 2024-02-22T00:56:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.122+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1e8108e90 con 0x7ff1d006ca30 2024-02-22T00:56:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.124+0000 7ff1d77fe700 1 -- 172.21.15.49:0/700169817 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff1e8108e90 con 0x7ff1d006ca30 2024-02-22T00:56:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.125+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff1d006ca30 msgr2=0x7ff1d006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.125+0000 7ff1ece4c700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff1d006ca30 0x7ff1d006eef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7ff1e8109980 tx=0x7ff1dc009da0).stop 2024-02-22T00:56:58.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.125+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 msgr2=0x7ff1e810e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.125+0000 7ff1ece4c700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 0x7ff1e810e040 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7ff1d8005010 tx=0x7ff1d8009cb0).stop 2024-02-22T00:56:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.126+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 shutdown_connections 2024-02-22T00:56:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.126+0000 7ff1ece4c700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff1d006ca30 0x7ff1d006eef0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.126+0000 7ff1ece4c700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1e80fc7f0 0x7ff1e810e040 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.126+0000 7ff1ece4c700 1 --2- 172.21.15.49:0/700169817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1e80fd150 0x7ff1e810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.126+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 >> 172.21.15.49:0/700169817 conn(0x7ff1e8070590 msgr2=0x7ff1e8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.126+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 shutdown_connections 2024-02-22T00:56:58.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.126+0000 7ff1ece4c700 1 -- 172.21.15.49:0/700169817 wait complete. 2024-02-22T00:56:58.134 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.229+0000 7f17c0202700 1 -- 172.21.15.49:0/3467191773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 msgr2=0x7f17b80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.229+0000 7f17c0202700 1 --2- 172.21.15.49:0/3467191773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 0x7f17b80fcbd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f17b40047f0 tx=0x7f17b4009cb0).stop 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.229+0000 7f17c0202700 1 -- 172.21.15.49:0/3467191773 shutdown_connections 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.229+0000 7f17c0202700 1 --2- 172.21.15.49:0/3467191773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80fd150 0x7f17b80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.229+0000 7f17c0202700 1 --2- 172.21.15.49:0/3467191773 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 0x7f17b80fcbd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.229+0000 7f17c0202700 1 -- 172.21.15.49:0/3467191773 >> 172.21.15.49:0/3467191773 conn(0x7f17b8070590 msgr2=0x7f17b80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.229+0000 7f17c0202700 1 -- 172.21.15.49:0/3467191773 shutdown_connections 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.229+0000 7f17c0202700 1 -- 172.21.15.49:0/3467191773 wait complete. 2024-02-22T00:56:58.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.230+0000 7f17c0202700 1 Processor -- start 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.230+0000 7f17c0202700 1 -- start start 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.230+0000 7f17c0202700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 0x7f17b81090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.230+0000 7f17c0202700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80fd150 0x7f17b81095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.230+0000 7f17c0202700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8109ab0 con 0x7f17b80fc7f0 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.230+0000 7f17c0202700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8109bf0 con 0x7f17b80fd150 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17bdf9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 0x7f17b81090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17bdf9e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 0x7f17b81090d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52874/0 (socket says 172.21.15.49:52874) 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17bdf9e700 1 -- 172.21.15.49:0/940544080 learned_addr learned my addr 172.21.15.49:0/940544080 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17bdf9e700 1 -- 172.21.15.49:0/940544080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80fd150 msgr2=0x7f17b81095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17bdf9e700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80fd150 0x7f17b81095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17bdf9e700 1 -- 172.21.15.49:0/940544080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4005040 con 0x7f17b80fc7f0 2024-02-22T00:56:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17bdf9e700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 0x7f17b81090d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f17b4005010 tx=0x7f17b4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17aaffd700 1 -- 172.21.15.49:0/940544080 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b400e030 con 0x7f17b80fc7f0 2024-02-22T00:56:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17aaffd700 1 -- 172.21.15.49:0/940544080 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f17b4007e90 con 0x7f17b80fc7f0 2024-02-22T00:56:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b8109e40 con 0x7f17b80fc7f0 2024-02-22T00:56:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17aaffd700 1 -- 172.21.15.49:0/940544080 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b4018070 con 0x7f17b80fc7f0 2024-02-22T00:56:58.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.231+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b8112430 con 0x7f17b80fc7f0 2024-02-22T00:56:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.232+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b805f590 con 0x7f17b80fc7f0 2024-02-22T00:56:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.233+0000 7f17aaffd700 1 -- 172.21.15.49:0/940544080 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f17b401d6e0 con 0x7f17b80fc7f0 2024-02-22T00:56:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.233+0000 7f17aaffd700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17a406ca30 0x7f17a406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.233+0000 7f17aaffd700 1 -- 172.21.15.49:0/940544080 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f17b408d050 con 0x7f17b80fc7f0 2024-02-22T00:56:58.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.233+0000 7f17bd79d700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17a406ca30 0x7f17a406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:58.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.233+0000 7f17bd79d700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17a406ca30 0x7f17a406eef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f17b8060f00 tx=0x7f17ac009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:58.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.238+0000 7f17aaffd700 1 -- 172.21.15.49:0/940544080 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f17b405abb0 con 0x7f17b80fc7f0 2024-02-22T00:56:58.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.453+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b80febf0 con 0x7f17a406ca30 2024-02-22T00:56:58.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.454+0000 7f17aaffd700 1 -- 172.21.15.49:0/940544080 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f17b80febf0 con 0x7f17a406ca30 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17a406ca30 msgr2=0x7f17a406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17a406ca30 0x7f17a406eef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f17b8060f00 tx=0x7f17ac009b60).stop 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 msgr2=0x7f17b81090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 0x7f17b81090d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f17b4005010 tx=0x7f17b4009cb0).stop 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 shutdown_connections 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f17a406ca30 0x7f17a406eef0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f17b80fc7f0 0x7f17b81090d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 --2- 172.21.15.49:0/940544080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80fd150 0x7f17b81095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.456+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 >> 172.21.15.49:0/940544080 conn(0x7f17b8070590 msgr2=0x7f17b80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.457+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 shutdown_connections 2024-02-22T00:56:58.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.457+0000 7f17c0202700 1 -- 172.21.15.49:0/940544080 wait complete. 2024-02-22T00:56:58.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:58 smithi161 ceph-mon[113442]: pgmap v601: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:58.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:58.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.557+0000 7f6635212700 1 -- 172.21.15.49:0/2337179445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 msgr2=0x7f6630101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.557+0000 7f6635212700 1 --2- 172.21.15.49:0/2337179445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 0x7f6630101970 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f66240047f0 tx=0x7f6624009cb0).stop 2024-02-22T00:56:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.557+0000 7f6635212700 1 -- 172.21.15.49:0/2337179445 shutdown_connections 2024-02-22T00:56:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.557+0000 7f6635212700 1 --2- 172.21.15.49:0/2337179445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 0x7f6630101970 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.557+0000 7f6635212700 1 --2- 172.21.15.49:0/2337179445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66300f8900 0x7f66300f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.557+0000 7f6635212700 1 -- 172.21.15.49:0/2337179445 >> 172.21.15.49:0/2337179445 conn(0x7f6630070590 msgr2=0x7f66300f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.557+0000 7f6635212700 1 -- 172.21.15.49:0/2337179445 shutdown_connections 2024-02-22T00:56:58.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.557+0000 7f6635212700 1 -- 172.21.15.49:0/2337179445 wait complete. 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.558+0000 7f6635212700 1 Processor -- start 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.558+0000 7f6635212700 1 -- start start 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.558+0000 7f6635212700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66300f8900 0x7f66300f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.558+0000 7f6635212700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 0x7f66300f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.558+0000 7f6635212700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66300f7290 con 0x7f66300f9260 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.558+0000 7f6635212700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66300f73d0 con 0x7f66300f8900 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 0x7f66300f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662e59c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 0x7f66300f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52880/0 (socket says 172.21.15.49:52880) 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662e59c700 1 -- 172.21.15.49:0/394326158 learned_addr learned my addr 172.21.15.49:0/394326158 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:58.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662ed9d700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66300f8900 0x7f66300f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662e59c700 1 -- 172.21.15.49:0/394326158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66300f8900 msgr2=0x7f66300f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662e59c700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66300f8900 0x7f66300f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662e59c700 1 -- 172.21.15.49:0/394326158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624005040 con 0x7f66300f9260 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662ed9d700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66300f8900 0x7f66300f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f662e59c700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 0x7f66300f6da0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f6624009310 tx=0x7f6624009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f6617fff700 1 -- 172.21.15.49:0/394326158 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f662400e030 con 0x7f66300f9260 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66300f7620 con 0x7f66300f9260 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f6617fff700 1 -- 172.21.15.49:0/394326158 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6624007e90 con 0x7f66300f9260 2024-02-22T00:56:58.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f6617fff700 1 -- 172.21.15.49:0/394326158 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6624018070 con 0x7f66300f9260 2024-02-22T00:56:58.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.559+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6630114620 con 0x7f66300f9260 2024-02-22T00:56:58.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.560+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663005f590 con 0x7f66300f9260 2024-02-22T00:56:58.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.561+0000 7f6617fff700 1 -- 172.21.15.49:0/394326158 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f662401d420 con 0x7f66300f9260 2024-02-22T00:56:58.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.561+0000 7f6617fff700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f661806caa0 0x7f661806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.561+0000 7f6617fff700 1 -- 172.21.15.49:0/394326158 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f662408d290 con 0x7f66300f9260 2024-02-22T00:56:58.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.561+0000 7f662ed9d700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f661806caa0 0x7f661806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:58.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.562+0000 7f662ed9d700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f661806caa0 0x7f661806ef60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f6620004ba0 tx=0x7f6620009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:58.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.566+0000 7f6617fff700 1 -- 172.21.15.49:0/394326158 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6624057360 con 0x7f66300f9260 2024-02-22T00:56:58.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:58 smithi049 ceph-mon[132694]: pgmap v601: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:56:58.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:56:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.772+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66300f7ea0 con 0x7f661806caa0 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.781+0000 7f6617fff700 1 -- 172.21.15.49:0/394326158 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f66300f7ea0 con 0x7f661806caa0 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (20m) 14m ago 31m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (17m) 14m ago 31m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (17m) 13m ago 30m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (19m) 14m ago 31m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (14m) 14m ago 26m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (14m) 14m ago 26m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (13m) 13m ago 26m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:56:58.780 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (13m) 13m ago 26m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (21m) 14m ago 32m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (21m) 13m ago 30m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (18m) 14m ago 32m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (18m) 13m ago 30m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (20m) 14m ago 31m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (20m) 13m ago 30m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (17m) 14m ago 30m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (16m) 14m ago 29m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (16m) 14m ago 29m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (15m) 13m ago 28m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (15m) 13m ago 28m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (14m) 13m ago 27m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:56:58.781 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (20m) 13m ago 30m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:56:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.783+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f661806caa0 msgr2=0x7f661806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.783+0000 7f6635212700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f661806caa0 0x7f661806ef60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f6620004ba0 tx=0x7f6620009040).stop 2024-02-22T00:56:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.783+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 msgr2=0x7f66300f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.783+0000 7f6635212700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 0x7f66300f6da0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f6624009310 tx=0x7f6624009cb0).stop 2024-02-22T00:56:58.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.784+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 shutdown_connections 2024-02-22T00:56:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.784+0000 7f6635212700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f661806caa0 0x7f661806ef60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.784+0000 7f6635212700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66300f8900 0x7f66300f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.784+0000 7f6635212700 1 --2- 172.21.15.49:0/394326158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66300f9260 0x7f66300f6da0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.784+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 >> 172.21.15.49:0/394326158 conn(0x7f6630070590 msgr2=0x7f66300fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.784+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 shutdown_connections 2024-02-22T00:56:58.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.784+0000 7f6635212700 1 -- 172.21.15.49:0/394326158 wait complete. 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 -- 172.21.15.49:0/1891886870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f8960 msgr2=0x7fae340f8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 --2- 172.21.15.49:0/1891886870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f8960 0x7fae340f8d40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fae24004820 tx=0x7fae24009cb0).stop 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 -- 172.21.15.49:0/1891886870 shutdown_connections 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 --2- 172.21.15.49:0/1891886870 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340f9230 0x7fae341019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 --2- 172.21.15.49:0/1891886870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f8960 0x7fae340f8d40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 -- 172.21.15.49:0/1891886870 >> 172.21.15.49:0/1891886870 conn(0x7fae34070590 msgr2=0x7fae340f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 -- 172.21.15.49:0/1891886870 shutdown_connections 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 -- 172.21.15.49:0/1891886870 wait complete. 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.884+0000 7fae39b7e700 1 Processor -- start 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae39b7e700 1 -- start start 2024-02-22T00:56:58.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae39b7e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340f8960 0x7fae340f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae39b7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f9230 0x7fae340f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae39b7e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae340f72f0 con 0x7fae340f9230 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae39b7e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae340f7430 con 0x7fae340f8960 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae32ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f9230 0x7fae340f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae32ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f9230 0x7fae340f6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52888/0 (socket says 172.21.15.49:52888) 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae32ffd700 1 -- 172.21.15.49:0/3594169700 learned_addr learned my addr 172.21.15.49:0/3594169700 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae337fe700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340f8960 0x7fae340f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae32ffd700 1 -- 172.21.15.49:0/3594169700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340f8960 msgr2=0x7fae340f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae32ffd700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340f8960 0x7fae340f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae32ffd700 1 -- 172.21.15.49:0/3594169700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24005040 con 0x7fae340f9230 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.885+0000 7fae32ffd700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f9230 0x7fae340f6e00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fae280041d0 tx=0x7fae28009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.886+0000 7fae30ff9700 1 -- 172.21.15.49:0/3594169700 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae28002d90 con 0x7fae340f9230 2024-02-22T00:56:58.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.886+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae340f76e0 con 0x7fae340f9230 2024-02-22T00:56:58.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.886+0000 7fae30ff9700 1 -- 172.21.15.49:0/3594169700 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae2800f040 con 0x7fae340f9230 2024-02-22T00:56:58.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.886+0000 7fae30ff9700 1 -- 172.21.15.49:0/3594169700 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae2800d800 con 0x7fae340f9230 2024-02-22T00:56:58.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.886+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae34114690 con 0x7fae340f9230 2024-02-22T00:56:58.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.887+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3405f590 con 0x7fae340f9230 2024-02-22T00:56:58.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.887+0000 7fae30ff9700 1 -- 172.21.15.49:0/3594169700 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fae2800dac0 con 0x7fae340f9230 2024-02-22T00:56:58.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.888+0000 7fae30ff9700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae1c06caa0 0x7fae1c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:58.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.888+0000 7fae30ff9700 1 -- 172.21.15.49:0/3594169700 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fae2808bdf0 con 0x7fae340f9230 2024-02-22T00:56:58.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.888+0000 7fae337fe700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae1c06caa0 0x7fae1c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:58.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.888+0000 7fae337fe700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae1c06caa0 0x7fae1c06ef60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fae24004580 tx=0x7fae2400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:58.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:58.892+0000 7fae30ff9700 1 -- 172.21.15.49:0/3594169700 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fae28055ec0 con 0x7fae340f9230 2024-02-22T00:56:59.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.171+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fae34047540 con 0x7fae340f9230 2024-02-22T00:56:59.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.171+0000 7fae30ff9700 1 -- 172.21.15.49:0/3594169700 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fae280594e0 con 0x7fae340f9230 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:56:59.170 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:56:59.171 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:56:59.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:56:59.171 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:56:59.171 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:56:59.171 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:56:59.171 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:56:59.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae1c06caa0 msgr2=0x7fae1c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae1c06caa0 0x7fae1c06ef60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fae24004580 tx=0x7fae2400b040).stop 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f9230 msgr2=0x7fae340f6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f9230 0x7fae340f6e00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fae280041d0 tx=0x7fae28009f60).stop 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 shutdown_connections 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fae1c06caa0 0x7fae1c06ef60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae340f8960 0x7fae340f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 --2- 172.21.15.49:0/3594169700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae340f9230 0x7fae340f6e00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.173+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 >> 172.21.15.49:0/3594169700 conn(0x7fae34070590 msgr2=0x7fae340fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.174+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 shutdown_connections 2024-02-22T00:56:59.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.174+0000 7fae39b7e700 1 -- 172.21.15.49:0/3594169700 wait complete. 2024-02-22T00:56:59.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.276+0000 7fdd684aa700 1 -- 172.21.15.49:0/2399417296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fd150 msgr2=0x7fdd600f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.276+0000 7fdd684aa700 1 --2- 172.21.15.49:0/2399417296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fd150 0x7fdd600f6930 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fdd540047f0 tx=0x7fdd54009cb0).stop 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.276+0000 7fdd684aa700 1 -- 172.21.15.49:0/2399417296 shutdown_connections 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.276+0000 7fdd684aa700 1 --2- 172.21.15.49:0/2399417296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fd150 0x7fdd600f6930 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.276+0000 7fdd684aa700 1 --2- 172.21.15.49:0/2399417296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd600fc7f0 0x7fdd600fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.276+0000 7fdd684aa700 1 -- 172.21.15.49:0/2399417296 >> 172.21.15.49:0/2399417296 conn(0x7fdd60070590 msgr2=0x7fdd600f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.276+0000 7fdd684aa700 1 -- 172.21.15.49:0/2399417296 shutdown_connections 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.276+0000 7fdd684aa700 1 -- 172.21.15.49:0/2399417296 wait complete. 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd684aa700 1 Processor -- start 2024-02-22T00:56:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd684aa700 1 -- start start 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd684aa700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fc7f0 0x7fdd6010e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd684aa700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd600fd150 0x7fdd6010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd684aa700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6010ebe0 con 0x7fdd600fc7f0 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd684aa700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd60108200 con 0x7fdd600fd150 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd66246700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fc7f0 0x7fdd6010e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd66246700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fc7f0 0x7fdd6010e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52912/0 (socket says 172.21.15.49:52912) 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd66246700 1 -- 172.21.15.49:0/3249582492 learned_addr learned my addr 172.21.15.49:0/3249582492 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd66246700 1 -- 172.21.15.49:0/3249582492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd600fd150 msgr2=0x7fdd6010e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd66246700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd600fd150 0x7fdd6010e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd66246700 1 -- 172.21.15.49:0/3249582492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54005040 con 0x7fdd600fc7f0 2024-02-22T00:56:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd66246700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fc7f0 0x7fdd6010e060 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fdd5c00b4b0 tx=0x7fdd5c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd537fe700 1 -- 172.21.15.49:0/3249582492 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd5c002500 con 0x7fdd600fc7f0 2024-02-22T00:56:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd537fe700 1 -- 172.21.15.49:0/3249582492 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdd5c002b10 con 0x7fdd600fc7f0 2024-02-22T00:56:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.277+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd601084b0 con 0x7fdd600fc7f0 2024-02-22T00:56:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.278+0000 7fdd537fe700 1 -- 172.21.15.49:0/3249582492 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd5c012cf0 con 0x7fdd600fc7f0 2024-02-22T00:56:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.278+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd601089f0 con 0x7fdd600fc7f0 2024-02-22T00:56:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.278+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6005f590 con 0x7fdd600fc7f0 2024-02-22T00:56:59.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.279+0000 7fdd537fe700 1 -- 172.21.15.49:0/3249582492 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdd5c002660 con 0x7fdd600fc7f0 2024-02-22T00:56:59.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.279+0000 7fdd537fe700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4c06caa0 0x7fdd4c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.279+0000 7fdd537fe700 1 -- 172.21.15.49:0/3249582492 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdd5c08be80 con 0x7fdd600fc7f0 2024-02-22T00:56:59.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.279+0000 7fdd65a45700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4c06caa0 0x7fdd4c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:59.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.280+0000 7fdd65a45700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4c06caa0 0x7fdd4c06ef60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fdd601099a0 tx=0x7fdd54009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:59.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.284+0000 7fdd537fe700 1 -- 172.21.15.49:0/3249582492 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdd5c0599e0 con 0x7fdd600fc7f0 2024-02-22T00:56:59.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.528+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd60103620 con 0x7fdd600fc7f0 2024-02-22T00:56:59.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.529+0000 7fdd537fe700 1 -- 172.21.15.49:0/3249582492 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7fdd5c059570 con 0x7fdd600fc7f0 2024-02-22T00:56:59.527 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:56:59.527 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:56:59.527 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:56:59.527 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:56:59.527 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:56:59.527 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:56:59.528 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:56:59.529 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:56:59.530 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:56:59.530 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:56:59.530 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:56:59.530 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:56:59.530 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:56:59.530 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4c06caa0 msgr2=0x7fdd4c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4c06caa0 0x7fdd4c06ef60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fdd601099a0 tx=0x7fdd54009cb0).stop 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fc7f0 msgr2=0x7fdd6010e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fc7f0 0x7fdd6010e060 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fdd5c00b4b0 tx=0x7fdd5c0090f0).stop 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 shutdown_connections 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdd4c06caa0 0x7fdd4c06ef60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdd600fc7f0 0x7fdd6010e060 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 --2- 172.21.15.49:0/3249582492 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd600fd150 0x7fdd6010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 >> 172.21.15.49:0/3249582492 conn(0x7fdd60070590 msgr2=0x7fdd60060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 shutdown_connections 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.531+0000 7fdd684aa700 1 -- 172.21.15.49:0/3249582492 wait complete. 2024-02-22T00:56:59.531 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:56:59.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:59 smithi161 ceph-mon[113442]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:59.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:56:59 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3594169700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:56:59.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.633+0000 7fef662b7700 1 -- 172.21.15.49:0/3303534205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 msgr2=0x7fef600f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.633+0000 7fef662b7700 1 --2- 172.21.15.49:0/3303534205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 0x7fef600f7a30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fef480047f0 tx=0x7fef48009cb0).stop 2024-02-22T00:56:59.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.633+0000 7fef662b7700 1 -- 172.21.15.49:0/3303534205 shutdown_connections 2024-02-22T00:56:59.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.633+0000 7fef662b7700 1 --2- 172.21.15.49:0/3303534205 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 0x7fef600f7a30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.633+0000 7fef662b7700 1 --2- 172.21.15.49:0/3303534205 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef600fd8f0 0x7fef600fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.633+0000 7fef662b7700 1 -- 172.21.15.49:0/3303534205 >> 172.21.15.49:0/3303534205 conn(0x7fef600f34b0 msgr2=0x7fef600f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:59.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.633+0000 7fef662b7700 1 -- 172.21.15.49:0/3303534205 shutdown_connections 2024-02-22T00:56:59.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.633+0000 7fef662b7700 1 -- 172.21.15.49:0/3303534205 wait complete. 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.634+0000 7fef662b7700 1 Processor -- start 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.634+0000 7fef662b7700 1 -- start start 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.634+0000 7fef662b7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef600fd8f0 0x7fef6010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.634+0000 7fef662b7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 0x7fef6010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.634+0000 7fef662b7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6010eae0 con 0x7fef600fe250 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.634+0000 7fef662b7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6010ec20 con 0x7fef600fd8f0 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 0x7fef6010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5f7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 0x7fef6010e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52934/0 (socket says 172.21.15.49:52934) 2024-02-22T00:56:59.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5f7fe700 1 -- 172.21.15.49:0/37061527 learned_addr learned my addr 172.21.15.49:0/37061527 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5ffff700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef600fd8f0 0x7fef6010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5f7fe700 1 -- 172.21.15.49:0/37061527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef600fd8f0 msgr2=0x7fef6010dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5f7fe700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef600fd8f0 0x7fef6010dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5f7fe700 1 -- 172.21.15.49:0/37061527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48005040 con 0x7fef600fe250 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5f7fe700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 0x7fef6010e4e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fef480099f0 tx=0x7fef48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5d775700 1 -- 172.21.15.49:0/37061527 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef4800e030 con 0x7fef600fe250 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef60108250 con 0x7fef600fe250 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5d775700 1 -- 172.21.15.49:0/37061527 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef48007e90 con 0x7fef600fe250 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef5d775700 1 -- 172.21.15.49:0/37061527 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef48018070 con 0x7fef600fe250 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.635+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef601087b0 con 0x7fef600fe250 2024-02-22T00:56:59.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.636+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6005f590 con 0x7fef600fe250 2024-02-22T00:56:59.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.637+0000 7fef5d775700 1 -- 172.21.15.49:0/37061527 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fef480094c0 con 0x7fef600fe250 2024-02-22T00:56:59.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.637+0000 7fef5d775700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef4c06caa0 0x7fef4c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.637+0000 7fef5d775700 1 -- 172.21.15.49:0/37061527 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fef4808cf60 con 0x7fef600fe250 2024-02-22T00:56:59.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.637+0000 7fef5ffff700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef4c06caa0 0x7fef4c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:59.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.638+0000 7fef5ffff700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef4c06caa0 0x7fef4c06ef60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fef50004de0 tx=0x7fef5000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:59.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.642+0000 7fef5d775700 1 -- 172.21.15.49:0/37061527 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fef480c0190 con 0x7fef600fe250 2024-02-22T00:56:59.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:59 smithi049 ceph-mon[132694]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:56:59.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:56:59 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3594169700' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:56:59.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.857+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef60109750 con 0x7fef4c06caa0 2024-02-22T00:56:59.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.858+0000 7fef5d775700 1 -- 172.21.15.49:0/37061527 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fef60109750 con 0x7fef4c06caa0 2024-02-22T00:56:59.856 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:56:59.856 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:56:59.856 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:56:59.856 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:56:59.856 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:56:59.856 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:56:59.857 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:56:59.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef4c06caa0 msgr2=0x7fef4c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef4c06caa0 0x7fef4c06ef60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fef50004de0 tx=0x7fef5000b040).stop 2024-02-22T00:56:59.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 msgr2=0x7fef6010e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 0x7fef6010e4e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fef480099f0 tx=0x7fef48009cb0).stop 2024-02-22T00:56:59.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 shutdown_connections 2024-02-22T00:56:59.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fef4c06caa0 0x7fef4c06ef60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef600fd8f0 0x7fef6010dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 --2- 172.21.15.49:0/37061527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef600fe250 0x7fef6010e4e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 >> 172.21.15.49:0/37061527 conn(0x7fef600f34b0 msgr2=0x7fef600fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:59.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 shutdown_connections 2024-02-22T00:56:59.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.860+0000 7fef662b7700 1 -- 172.21.15.49:0/37061527 wait complete. 2024-02-22T00:56:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 -- 172.21.15.49:0/2590716639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 msgr2=0x7ff43c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 --2- 172.21.15.49:0/2590716639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 0x7ff43c0fcbd0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7ff4300047f0 tx=0x7ff430009cb0).stop 2024-02-22T00:56:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 -- 172.21.15.49:0/2590716639 shutdown_connections 2024-02-22T00:56:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 --2- 172.21.15.49:0/2590716639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff43c0fd150 0x7ff43c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 --2- 172.21.15.49:0/2590716639 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 0x7ff43c0fcbd0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 -- 172.21.15.49:0/2590716639 >> 172.21.15.49:0/2590716639 conn(0x7ff43c070590 msgr2=0x7ff43c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:56:59.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 -- 172.21.15.49:0/2590716639 shutdown_connections 2024-02-22T00:56:59.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 -- 172.21.15.49:0/2590716639 wait complete. 2024-02-22T00:56:59.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.962+0000 7ff4411f8700 1 Processor -- start 2024-02-22T00:56:59.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff4411f8700 1 -- start start 2024-02-22T00:56:59.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff4411f8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 0x7ff43c0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff4411f8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff43c0fd150 0x7ff43c0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff4411f8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0f8f20 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff4411f8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0f9060 con 0x7ff43c0fd150 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff43ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 0x7ff43c0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff43ad9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 0x7ff43c0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52962/0 (socket says 172.21.15.49:52962) 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff43ad9d700 1 -- 172.21.15.49:0/416604642 learned_addr learned my addr 172.21.15.49:0/416604642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff43a59c700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff43c0fd150 0x7ff43c0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff43ad9d700 1 -- 172.21.15.49:0/416604642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff43c0fd150 msgr2=0x7ff43c0f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff43ad9d700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff43c0fd150 0x7ff43c0f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff43ad9d700 1 -- 172.21.15.49:0/416604642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430005040 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.963+0000 7ff43ad9d700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 0x7ff43c0f8540 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7ff430005010 tx=0x7ff430009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.964+0000 7ff423fff700 1 -- 172.21.15.49:0/416604642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff43000e030 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.964+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c0f92b0 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.964+0000 7ff423fff700 1 -- 172.21.15.49:0/416604642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff430007e90 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.964+0000 7ff423fff700 1 -- 172.21.15.49:0/416604642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff430018070 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.964+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c114600 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.965+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c05f590 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.965+0000 7ff423fff700 1 -- 172.21.15.49:0/416604642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff43001d6e0 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.966+0000 7ff423fff700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff42406ca30 0x7ff42406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:56:59.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.966+0000 7ff423fff700 1 -- 172.21.15.49:0/416604642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff43008d050 con 0x7ff43c0fc7f0 2024-02-22T00:56:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.966+0000 7ff43a59c700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff42406ca30 0x7ff42406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:56:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.966+0000 7ff43a59c700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff42406ca30 0x7ff42406eef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7ff43c0f9ce0 tx=0x7ff42c009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:56:59.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:56:59.970+0000 7ff423fff700 1 -- 172.21.15.49:0/416604642 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff43005abb0 con 0x7ff43c0fc7f0 2024-02-22T00:57:00.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.253+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff43c047540 con 0x7ff43c0fc7f0 2024-02-22T00:57:00.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.253+0000 7ff423fff700 1 -- 172.21.15.49:0/416604642 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7ff43005a740 con 0x7ff43c0fc7f0 2024-02-22T00:57:00.252 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:57:00.252 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:57:00.252 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:57:00.252 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:57:00.252 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:57:00.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff42406ca30 msgr2=0x7ff42406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff42406ca30 0x7ff42406eef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7ff43c0f9ce0 tx=0x7ff42c009d60).stop 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 msgr2=0x7ff43c0f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 0x7ff43c0f8540 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7ff430005010 tx=0x7ff430009cb0).stop 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 shutdown_connections 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff42406ca30 0x7ff42406eef0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff43c0fc7f0 0x7ff43c0f8540 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 --2- 172.21.15.49:0/416604642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff43c0fd150 0x7ff43c0f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.255+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 >> 172.21.15.49:0/416604642 conn(0x7ff43c070590 msgr2=0x7ff43c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.256+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 shutdown_connections 2024-02-22T00:57:00.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:00.256+0000 7ff4411f8700 1 -- 172.21.15.49:0/416604642 wait complete. 2024-02-22T00:57:00.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:00 smithi161 ceph-mon[113442]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:00.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:00 smithi161 ceph-mon[113442]: pgmap v602: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:00.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:00 smithi161 ceph-mon[113442]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:00.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:00 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3249582492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:57:00.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:00 smithi049 ceph-mon[132694]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:00.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:00 smithi049 ceph-mon[132694]: pgmap v602: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:00.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:00 smithi049 ceph-mon[132694]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:00.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:00 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3249582492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:57:01.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:01 smithi161 ceph-mon[113442]: from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:01.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:01 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/416604642' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:57:01.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:01 smithi049 ceph-mon[132694]: from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:01.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:01 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/416604642' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:57:02.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:02 smithi161 ceph-mon[113442]: pgmap v603: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:02.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:02 smithi049 ceph-mon[132694]: pgmap v603: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:04.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:04 smithi161 ceph-mon[113442]: pgmap v604: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:04.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:04 smithi049 ceph-mon[132694]: pgmap v604: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:06.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:06 smithi161 ceph-mon[113442]: pgmap v605: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:06.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:06 smithi049 ceph-mon[132694]: pgmap v605: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:08.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:08 smithi161 ceph-mon[113442]: pgmap v606: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:08.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:08 smithi049 ceph-mon[132694]: pgmap v606: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:10.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:10 smithi161 ceph-mon[113442]: pgmap v607: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:10.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:10 smithi049 ceph-mon[132694]: pgmap v607: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:12.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:12 smithi161 ceph-mon[113442]: pgmap v608: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:12.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:12 smithi049 ceph-mon[132694]: pgmap v608: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:13.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:57:13.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:57:14.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:14 smithi161 ceph-mon[113442]: pgmap v609: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:14.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:14 smithi049 ceph-mon[132694]: pgmap v609: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:16.288 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:16 smithi161 ceph-mon[113442]: pgmap v610: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:16.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:16 smithi049 ceph-mon[132694]: pgmap v610: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:18.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:18 smithi161 ceph-mon[113442]: pgmap v611: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:18.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:18 smithi049 ceph-mon[132694]: pgmap v611: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:20.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:20 smithi161 ceph-mon[113442]: pgmap v612: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:20.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:20 smithi049 ceph-mon[132694]: pgmap v612: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:22.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:22 smithi161 ceph-mon[113442]: pgmap v613: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:22.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:22 smithi049 ceph-mon[132694]: pgmap v613: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:24.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:24 smithi161 ceph-mon[113442]: pgmap v614: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:24.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:24 smithi049 ceph-mon[132694]: pgmap v614: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:26.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:26 smithi161 ceph-mon[113442]: pgmap v615: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:26.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:26 smithi049 ceph-mon[132694]: pgmap v615: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:28.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:28 smithi161 ceph-mon[113442]: pgmap v616: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:28.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:57:28.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:28 smithi049 ceph-mon[132694]: pgmap v616: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:28.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:57:30.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.371+0000 7f9cd06bf700 1 -- 172.21.15.49:0/3517862940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 msgr2=0x7f9cc80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:30.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.371+0000 7f9cd06bf700 1 --2- 172.21.15.49:0/3517862940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 0x7f9cc80fcbd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f9cc40047f0 tx=0x7f9cc4009cb0).stop 2024-02-22T00:57:30.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.372+0000 7f9cd06bf700 1 -- 172.21.15.49:0/3517862940 shutdown_connections 2024-02-22T00:57:30.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.372+0000 7f9cd06bf700 1 --2- 172.21.15.49:0/3517862940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc80fd150 0x7f9cc80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.372+0000 7f9cd06bf700 1 --2- 172.21.15.49:0/3517862940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 0x7f9cc80fcbd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.372+0000 7f9cd06bf700 1 -- 172.21.15.49:0/3517862940 >> 172.21.15.49:0/3517862940 conn(0x7f9cc8070590 msgr2=0x7f9cc80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:30.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.372+0000 7f9cd06bf700 1 -- 172.21.15.49:0/3517862940 shutdown_connections 2024-02-22T00:57:30.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.372+0000 7f9cd06bf700 1 -- 172.21.15.49:0/3517862940 wait complete. 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cd06bf700 1 Processor -- start 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cd06bf700 1 -- start start 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cd06bf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 0x7f9cc81090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cd06bf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc80fd150 0x7f9cc81095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cd06bf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8109ad0 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cd06bf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc8109c10 con 0x7f9cc80fd150 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cce45b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 0x7f9cc81090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cce45b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 0x7f9cc81090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37090/0 (socket says 172.21.15.49:37090) 2024-02-22T00:57:30.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cce45b700 1 -- 172.21.15.49:0/4042824819 learned_addr learned my addr 172.21.15.49:0/4042824819 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9ccdc5a700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc80fd150 0x7f9cc81095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cce45b700 1 -- 172.21.15.49:0/4042824819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc80fd150 msgr2=0x7f9cc81095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cce45b700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc80fd150 0x7f9cc81095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.373+0000 7f9cce45b700 1 -- 172.21.15.49:0/4042824819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4005040 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.374+0000 7f9cce45b700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 0x7f9cc81090f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f9cc400b120 tx=0x7f9cc4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.374+0000 7f9cbf7fe700 1 -- 172.21.15.49:0/4042824819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc400e030 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.374+0000 7f9cbf7fe700 1 -- 172.21.15.49:0/4042824819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9cc4007e90 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.374+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc8109e60 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.374+0000 7f9cbf7fe700 1 -- 172.21.15.49:0/4042824819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cc4018070 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.374+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc8112450 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.375+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc805f590 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.375+0000 7f9cbf7fe700 1 -- 172.21.15.49:0/4042824819 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9cc401d420 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.376+0000 7f9cbf7fe700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb406caa0 0x7f9cb406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:30.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.376+0000 7f9cbf7fe700 1 -- 172.21.15.49:0/4042824819 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9cc408d190 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.376+0000 7f9ccdc5a700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb406caa0 0x7f9cb406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:30.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.376+0000 7f9ccdc5a700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb406caa0 0x7f9cb406ef60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9cc8060ee0 tx=0x7f9cb8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:30.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.381+0000 7f9cbf7fe700 1 -- 172.21.15.49:0/4042824819 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9cc4057260 con 0x7f9cc80fc7f0 2024-02-22T00:57:30.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:30 smithi161 ceph-mon[113442]: pgmap v617: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:30.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.600+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cc8059120 con 0x7f9cb406caa0 2024-02-22T00:57:30.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.601+0000 7f9cbf7fe700 1 -- 172.21.15.49:0/4042824819 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9cc8059120 con 0x7f9cb406caa0 2024-02-22T00:57:30.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb406caa0 msgr2=0x7f9cb406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:30.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb406caa0 0x7f9cb406ef60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9cc8060ee0 tx=0x7f9cb8009040).stop 2024-02-22T00:57:30.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 msgr2=0x7f9cc81090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:30.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 0x7f9cc81090f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f9cc400b120 tx=0x7f9cc4009cb0).stop 2024-02-22T00:57:30.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 shutdown_connections 2024-02-22T00:57:30.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9cb406caa0 0x7f9cb406ef60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9cc80fc7f0 0x7f9cc81090f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 --2- 172.21.15.49:0/4042824819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc80fd150 0x7f9cc81095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 >> 172.21.15.49:0/4042824819 conn(0x7f9cc8070590 msgr2=0x7f9cc80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 shutdown_connections 2024-02-22T00:57:30.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.603+0000 7f9cd06bf700 1 -- 172.21.15.49:0/4042824819 wait complete. 2024-02-22T00:57:30.609 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:57:30.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:30 smithi049 ceph-mon[132694]: pgmap v617: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:30.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.706+0000 7fba1fa73700 1 -- 172.21.15.49:0/3817524451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 msgr2=0x7fba18101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:30.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.706+0000 7fba1fa73700 1 --2- 172.21.15.49:0/3817524451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 0x7fba18101910 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fba140047f0 tx=0x7fba14009cb0).stop 2024-02-22T00:57:30.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.706+0000 7fba1fa73700 1 -- 172.21.15.49:0/3817524451 shutdown_connections 2024-02-22T00:57:30.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.706+0000 7fba1fa73700 1 --2- 172.21.15.49:0/3817524451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 0x7fba18101910 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.706+0000 7fba1fa73700 1 --2- 172.21.15.49:0/3817524451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180f88a0 0x7fba180f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.706+0000 7fba1fa73700 1 -- 172.21.15.49:0/3817524451 >> 172.21.15.49:0/3817524451 conn(0x7fba18070590 msgr2=0x7fba180f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:30.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.706+0000 7fba1fa73700 1 -- 172.21.15.49:0/3817524451 shutdown_connections 2024-02-22T00:57:30.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.706+0000 7fba1fa73700 1 -- 172.21.15.49:0/3817524451 wait complete. 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1fa73700 1 Processor -- start 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1fa73700 1 -- start start 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1fa73700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180f88a0 0x7fba1810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1fa73700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 0x7fba1810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1fa73700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1810eb70 con 0x7fba180f9200 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1fa73700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1810ecb0 con 0x7fba180f88a0 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1d00e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 0x7fba1810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1d00e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 0x7fba1810e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37116/0 (socket says 172.21.15.49:37116) 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1d00e700 1 -- 172.21.15.49:0/1541911452 learned_addr learned my addr 172.21.15.49:0/1541911452 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1d80f700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180f88a0 0x7fba1810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1d00e700 1 -- 172.21.15.49:0/1541911452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180f88a0 msgr2=0x7fba1810e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:30.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1d00e700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180f88a0 0x7fba1810e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1d00e700 1 -- 172.21.15.49:0/1541911452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba14005040 con 0x7fba180f9200 2024-02-22T00:57:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.707+0000 7fba1d00e700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 0x7fba1810e570 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fba14005010 tx=0x7fba14009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.708+0000 7fba0af78700 1 -- 172.21.15.49:0/1541911452 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba1400e030 con 0x7fba180f9200 2024-02-22T00:57:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.708+0000 7fba0af78700 1 -- 172.21.15.49:0/1541911452 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba14007e90 con 0x7fba180f9200 2024-02-22T00:57:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.708+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba181082e0 con 0x7fba180f9200 2024-02-22T00:57:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.708+0000 7fba0af78700 1 -- 172.21.15.49:0/1541911452 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba14018070 con 0x7fba180f9200 2024-02-22T00:57:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.708+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba181087c0 con 0x7fba180f9200 2024-02-22T00:57:30.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.709+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1805f590 con 0x7fba180f9200 2024-02-22T00:57:30.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.709+0000 7fba0af78700 1 -- 172.21.15.49:0/1541911452 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fba1401d670 con 0x7fba180f9200 2024-02-22T00:57:30.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.709+0000 7fba0af78700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fba0406caa0 0x7fba0406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:30.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.710+0000 7fba0af78700 1 -- 172.21.15.49:0/1541911452 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fba1408cfd0 con 0x7fba180f9200 2024-02-22T00:57:30.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.710+0000 7fba1d80f700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fba0406caa0 0x7fba0406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:30.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.710+0000 7fba1d80f700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fba0406caa0 0x7fba0406ef60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fba0c004e60 tx=0x7fba0c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:30.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.714+0000 7fba0af78700 1 -- 172.21.15.49:0/1541911452 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fba1405ab30 con 0x7fba180f9200 2024-02-22T00:57:30.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.930+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba18109810 con 0x7fba0406caa0 2024-02-22T00:57:30.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.931+0000 7fba0af78700 1 -- 172.21.15.49:0/1541911452 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fba18109810 con 0x7fba0406caa0 2024-02-22T00:57:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fba0406caa0 msgr2=0x7fba0406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fba0406caa0 0x7fba0406ef60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fba0c004e60 tx=0x7fba0c00b040).stop 2024-02-22T00:57:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 msgr2=0x7fba1810e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 0x7fba1810e570 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fba14005010 tx=0x7fba14009cb0).stop 2024-02-22T00:57:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 shutdown_connections 2024-02-22T00:57:30.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fba0406caa0 0x7fba0406ef60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180f88a0 0x7fba1810e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 --2- 172.21.15.49:0/1541911452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fba180f9200 0x7fba1810e570 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:30.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 >> 172.21.15.49:0/1541911452 conn(0x7fba18070590 msgr2=0x7fba180fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:30.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 shutdown_connections 2024-02-22T00:57:30.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:30.933+0000 7fba1fa73700 1 -- 172.21.15.49:0/1541911452 wait complete. 2024-02-22T00:57:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.034+0000 7f1979c7e700 1 -- 172.21.15.49:0/3689064668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 msgr2=0x7f19740f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.034+0000 7f1979c7e700 1 --2- 172.21.15.49:0/3689064668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 0x7f19740f8c80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f19640047f0 tx=0x7f1964009cb0).stop 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.035+0000 7f1979c7e700 1 -- 172.21.15.49:0/3689064668 shutdown_connections 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.035+0000 7f1979c7e700 1 --2- 172.21.15.49:0/3689064668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19740f9200 0x7f1974101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.035+0000 7f1979c7e700 1 --2- 172.21.15.49:0/3689064668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 0x7f19740f8c80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.035+0000 7f1979c7e700 1 -- 172.21.15.49:0/3689064668 >> 172.21.15.49:0/3689064668 conn(0x7f1974070590 msgr2=0x7f19740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.035+0000 7f1979c7e700 1 -- 172.21.15.49:0/3689064668 shutdown_connections 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.035+0000 7f1979c7e700 1 -- 172.21.15.49:0/3689064668 wait complete. 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.035+0000 7f1979c7e700 1 Processor -- start 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.035+0000 7f1979c7e700 1 -- start start 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f1979c7e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 0x7f197410e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f1979c7e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19740f9200 0x7f197410e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f1979c7e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197410eb10 con 0x7f19740f88a0 2024-02-22T00:57:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f1979c7e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197410ec50 con 0x7f19740f9200 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19737fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 0x7f197410e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19737fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 0x7f197410e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37128/0 (socket says 172.21.15.49:37128) 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19737fe700 1 -- 172.21.15.49:0/3894875351 learned_addr learned my addr 172.21.15.49:0/3894875351 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f196bfff700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19740f9200 0x7f197410e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19737fe700 1 -- 172.21.15.49:0/3894875351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19740f9200 msgr2=0x7f197410e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19737fe700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19740f9200 0x7f197410e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19737fe700 1 -- 172.21.15.49:0/3894875351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964005040 con 0x7f19740f88a0 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19737fe700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 0x7f197410e020 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f196400b120 tx=0x7f1964009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19717fa700 1 -- 172.21.15.49:0/3894875351 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f196400e030 con 0x7f19740f88a0 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1974108280 con 0x7f19740f88a0 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19717fa700 1 -- 172.21.15.49:0/3894875351 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1964007e90 con 0x7f19740f88a0 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f19717fa700 1 -- 172.21.15.49:0/3894875351 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1964018070 con 0x7f19740f88a0 2024-02-22T00:57:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.036+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1974108760 con 0x7f19740f88a0 2024-02-22T00:57:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.037+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1954005150 con 0x7f19740f88a0 2024-02-22T00:57:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.038+0000 7f19717fa700 1 -- 172.21.15.49:0/3894875351 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1964009690 con 0x7f19740f88a0 2024-02-22T00:57:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.038+0000 7f19717fa700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f196006caa0 0x7f196006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.038+0000 7f19717fa700 1 -- 172.21.15.49:0/3894875351 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f196408d100 con 0x7f19740f88a0 2024-02-22T00:57:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.038+0000 7f196bfff700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f196006caa0 0x7f196006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.039+0000 7f196bfff700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f196006caa0 0x7f196006ef60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1974109960 tx=0x7f195c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:31.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.043+0000 7f19717fa700 1 -- 172.21.15.49:0/3894875351 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f196405ac60 con 0x7f19740f88a0 2024-02-22T00:57:31.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.251+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1954000bf0 con 0x7f196006caa0 2024-02-22T00:57:31.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.261+0000 7f19717fa700 1 -- 172.21.15.49:0/3894875351 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f1954000bf0 con 0x7f196006caa0 2024-02-22T00:57:31.257 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:57:31.257 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (20m) 14m ago 31m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (18m) 14m ago 31m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (18m) 14m ago 31m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (20m) 14m ago 31m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (14m) 14m ago 26m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (14m) 14m ago 26m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (14m) 14m ago 26m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (14m) 14m ago 26m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (22m) 14m ago 33m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (21m) 14m ago 31m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (19m) 14m ago 33m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (19m) 14m ago 31m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (21m) 14m ago 31m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (21m) 14m ago 31m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:57:31.258 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (18m) 14m ago 30m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:57:31.259 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (17m) 14m ago 30m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:57:31.259 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (16m) 14m ago 29m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:57:31.259 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (16m) 14m ago 29m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:57:31.259 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (15m) 14m ago 28m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:57:31.259 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (15m) 14m ago 28m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:57:31.259 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (20m) 14m ago 30m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f196006caa0 msgr2=0x7f196006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f196006caa0 0x7f196006ef60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1974109960 tx=0x7f195c009040).stop 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 msgr2=0x7f197410e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 0x7f197410e020 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f196400b120 tx=0x7f1964009cb0).stop 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 shutdown_connections 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f196006caa0 0x7f196006ef60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19740f88a0 0x7f197410e020 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 --2- 172.21.15.49:0/3894875351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19740f9200 0x7f197410e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.263+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 >> 172.21.15.49:0/3894875351 conn(0x7f1974070590 msgr2=0x7f19740fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.264+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 shutdown_connections 2024-02-22T00:57:31.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.264+0000 7f1979c7e700 1 -- 172.21.15.49:0/3894875351 wait complete. 2024-02-22T00:57:31.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.362+0000 7f8a78d40700 1 -- 172.21.15.49:0/501017649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fc7f0 msgr2=0x7f8a740fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.362+0000 7f8a78d40700 1 --2- 172.21.15.49:0/501017649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fc7f0 0x7f8a740fcbd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f8a640047f0 tx=0x7f8a64009cb0).stop 2024-02-22T00:57:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.362+0000 7f8a78d40700 1 -- 172.21.15.49:0/501017649 shutdown_connections 2024-02-22T00:57:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.362+0000 7f8a78d40700 1 --2- 172.21.15.49:0/501017649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a740fd150 0x7f8a740f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.362+0000 7f8a78d40700 1 --2- 172.21.15.49:0/501017649 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fc7f0 0x7f8a740fcbd0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.362+0000 7f8a78d40700 1 -- 172.21.15.49:0/501017649 >> 172.21.15.49:0/501017649 conn(0x7f8a74070590 msgr2=0x7f8a740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.362+0000 7f8a78d40700 1 -- 172.21.15.49:0/501017649 shutdown_connections 2024-02-22T00:57:31.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.362+0000 7f8a78d40700 1 -- 172.21.15.49:0/501017649 wait complete. 2024-02-22T00:57:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.363+0000 7f8a78d40700 1 Processor -- start 2024-02-22T00:57:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.363+0000 7f8a78d40700 1 -- start start 2024-02-22T00:57:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a78d40700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a740fc7f0 0x7f8a7410cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a78d40700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fd150 0x7f8a7410d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a78d40700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7410d9f0 con 0x7f8a740fd150 2024-02-22T00:57:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a78d40700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7410db30 con 0x7f8a740fc7f0 2024-02-22T00:57:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a71d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fd150 0x7f8a7410d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a71d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fd150 0x7f8a7410d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37154/0 (socket says 172.21.15.49:37154) 2024-02-22T00:57:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a71d9b700 1 -- 172.21.15.49:0/3407696689 learned_addr learned my addr 172.21.15.49:0/3407696689 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:57:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a7259c700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a740fc7f0 0x7f8a7410cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a71d9b700 1 -- 172.21.15.49:0/3407696689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a740fc7f0 msgr2=0x7f8a7410cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a71d9b700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a740fc7f0 0x7f8a7410cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a71d9b700 1 -- 172.21.15.49:0/3407696689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64005040 con 0x7f8a740fd150 2024-02-22T00:57:31.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a71d9b700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fd150 0x7f8a7410d3f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f8a5c002780 tx=0x7f8a5c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a6b7fe700 1 -- 172.21.15.49:0/3407696689 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5c007b40 con 0x7f8a740fd150 2024-02-22T00:57:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a741071c0 con 0x7f8a740fd150 2024-02-22T00:57:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a6b7fe700 1 -- 172.21.15.49:0/3407696689 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8a5c00f040 con 0x7f8a740fd150 2024-02-22T00:57:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.364+0000 7f8a6b7fe700 1 -- 172.21.15.49:0/3407696689 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5c014780 con 0x7f8a740fd150 2024-02-22T00:57:31.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.365+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a74107780 con 0x7f8a740fd150 2024-02-22T00:57:31.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.365+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7405f590 con 0x7f8a740fd150 2024-02-22T00:57:31.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.366+0000 7f8a6b7fe700 1 -- 172.21.15.49:0/3407696689 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8a5c007ca0 con 0x7f8a740fd150 2024-02-22T00:57:31.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.366+0000 7f8a6b7fe700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8a6006caa0 0x7f8a6006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.366+0000 7f8a6b7fe700 1 -- 172.21.15.49:0/3407696689 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8a5c08bca0 con 0x7f8a740fd150 2024-02-22T00:57:31.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.366+0000 7f8a7259c700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8a6006caa0 0x7f8a6006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.367+0000 7f8a7259c700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8a6006caa0 0x7f8a6006ef60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f8a64004f10 tx=0x7f8a6400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:31.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.371+0000 7f8a6b7fe700 1 -- 172.21.15.49:0/3407696689 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8a5c090070 con 0x7f8a740fd150 2024-02-22T00:57:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.650+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a74047540 con 0x7f8a740fd150 2024-02-22T00:57:31.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.650+0000 7f8a6b7fe700 1 -- 172.21.15.49:0/3407696689 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f8a5c059800 con 0x7f8a740fd150 2024-02-22T00:57:31.647 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:57:31.648 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:57:31.649 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:57:31.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:57:31.649 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:57:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8a6006caa0 msgr2=0x7f8a6006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8a6006caa0 0x7f8a6006ef60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f8a64004f10 tx=0x7f8a6400b040).stop 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fd150 msgr2=0x7f8a7410d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fd150 0x7f8a7410d3f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f8a5c002780 tx=0x7f8a5c009ee0).stop 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 shutdown_connections 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8a6006caa0 0x7f8a6006ef60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a740fc7f0 0x7f8a7410cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 --2- 172.21.15.49:0/3407696689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a740fd150 0x7f8a7410d3f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 >> 172.21.15.49:0/3407696689 conn(0x7f8a74070590 msgr2=0x7f8a740fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.652+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 shutdown_connections 2024-02-22T00:57:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.653+0000 7f8a78d40700 1 -- 172.21.15.49:0/3407696689 wait complete. 2024-02-22T00:57:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.753+0000 7f248cab9700 1 -- 172.21.15.49:0/4193196199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 msgr2=0x7f24880f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.753+0000 7f248cab9700 1 --2- 172.21.15.49:0/4193196199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 0x7f24880f6930 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f247c0047f0 tx=0x7f247c009cb0).stop 2024-02-22T00:57:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.753+0000 7f248cab9700 1 -- 172.21.15.49:0/4193196199 shutdown_connections 2024-02-22T00:57:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.753+0000 7f248cab9700 1 --2- 172.21.15.49:0/4193196199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 0x7f24880f6930 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.753+0000 7f248cab9700 1 --2- 172.21.15.49:0/4193196199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24880fc7f0 0x7f24880fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:57:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.753+0000 7f248cab9700 1 -- 172.21.15.49:0/4193196199 >> 172.21.15.49:0/4193196199 conn(0x7f2488070590 msgr2=0x7f24880f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.754+0000 7f248cab9700 1 -- 172.21.15.49:0/4193196199 shutdown_connections 2024-02-22T00:57:31.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.754+0000 7f248cab9700 1 -- 172.21.15.49:0/4193196199 wait complete. 2024-02-22T00:57:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.754+0000 7f248cab9700 1 Processor -- start 2024-02-22T00:57:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.754+0000 7f248cab9700 1 -- start start 2024-02-22T00:57:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f248cab9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24880fc7f0 0x7f248810e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f248cab9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 0x7f248810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f248cab9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248810ebc0 con 0x7f24880fd150 2024-02-22T00:57:31.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f248cab9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24881081e0 con 0x7f24880fc7f0 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f2485d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 0x7f248810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f2485d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 0x7f248810e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41210/0 (socket says 172.21.15.49:41210) 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f2485d9b700 1 -- 172.21.15.49:0/3518230691 learned_addr learned my addr 172.21.15.49:0/3518230691 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f248659c700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24880fc7f0 0x7f248810e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f2485d9b700 1 -- 172.21.15.49:0/3518230691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24880fc7f0 msgr2=0x7f248810e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f2485d9b700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24880fc7f0 0x7f248810e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f2485d9b700 1 -- 172.21.15.49:0/3518230691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c005040 con 0x7f24880fd150 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f248659c700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24880fc7f0 0x7f248810e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f2485d9b700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 0x7f248810e530 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f247c0099f0 tx=0x7f247c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f24777fe700 1 -- 172.21.15.49:0/3518230691 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247c00e030 con 0x7f24880fd150 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f24777fe700 1 -- 172.21.15.49:0/3518230691 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f247c007e90 con 0x7f24880fd150 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2488108430 con 0x7f24880fd150 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f24777fe700 1 -- 172.21.15.49:0/3518230691 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f247c018070 con 0x7f24880fd150 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.755+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2488108910 con 0x7f24880fd150 2024-02-22T00:57:31.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.756+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248805f590 con 0x7f24880fd150 2024-02-22T00:57:31.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.757+0000 7f24777fe700 1 -- 172.21.15.49:0/3518230691 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f247c01d420 con 0x7f24880fd150 2024-02-22T00:57:31.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.757+0000 7f24777fe700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f247006caa0 0x7f247006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:31.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.758+0000 7f24777fe700 1 -- 172.21.15.49:0/3518230691 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f247c08d240 con 0x7f24880fd150 2024-02-22T00:57:31.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.758+0000 7f248659c700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f247006caa0 0x7f247006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:31.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.758+0000 7f248659c700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f247006caa0 0x7f247006ef60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f2478009990 tx=0x7f2478008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:31.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:31.762+0000 7f24777fe700 1 -- 172.21.15.49:0/3518230691 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f247c05ada0 con 0x7f24880fd150 2024-02-22T00:57:32.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.005+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2488047540 con 0x7f24880fd150 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.006+0000 7f24777fe700 1 -- 172.21.15.49:0/3518230691 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f247c05a930 con 0x7f24880fd150 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:57:32.003 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:57:32.004 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:57:32.005 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:57:32.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:57:32.006 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:57:32.006 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:57:32.006 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:57:32.006 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:57:32.006 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:57:32.006 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f247006caa0 msgr2=0x7f247006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f247006caa0 0x7f247006ef60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f2478009990 tx=0x7f2478008040).stop 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 msgr2=0x7f248810e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 0x7f248810e530 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f247c0099f0 tx=0x7f247c009cb0).stop 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 shutdown_connections 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f247006caa0 0x7f247006ef60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24880fc7f0 0x7f248810e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 --2- 172.21.15.49:0/3518230691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24880fd150 0x7f248810e530 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 >> 172.21.15.49:0/3518230691 conn(0x7f2488070590 msgr2=0x7f2488060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 shutdown_connections 2024-02-22T00:57:32.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.008+0000 7f248cab9700 1 -- 172.21.15.49:0/3518230691 wait complete. 2024-02-22T00:57:32.008 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:57:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.109+0000 7f0e423e8700 1 -- 172.21.15.49:0/755402263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 msgr2=0x7f0e3c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.109+0000 7f0e423e8700 1 --2- 172.21.15.49:0/755402263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 0x7f0e3c0f6930 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0e300047f0 tx=0x7f0e30009cb0).stop 2024-02-22T00:57:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.110+0000 7f0e423e8700 1 -- 172.21.15.49:0/755402263 shutdown_connections 2024-02-22T00:57:32.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.110+0000 7f0e423e8700 1 --2- 172.21.15.49:0/755402263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 0x7f0e3c0f6930 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.110+0000 7f0e423e8700 1 --2- 172.21.15.49:0/755402263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c0fc7f0 0x7f0e3c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:57:32.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.110+0000 7f0e423e8700 1 -- 172.21.15.49:0/755402263 >> 172.21.15.49:0/755402263 conn(0x7f0e3c070590 msgr2=0x7f0e3c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:32.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.110+0000 7f0e423e8700 1 -- 172.21.15.49:0/755402263 shutdown_connections 2024-02-22T00:57:32.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.110+0000 7f0e423e8700 1 -- 172.21.15.49:0/755402263 wait complete. 2024-02-22T00:57:32.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.110+0000 7f0e423e8700 1 Processor -- start 2024-02-22T00:57:32.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.110+0000 7f0e423e8700 1 -- start start 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e423e8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c0fc7f0 0x7f0e3c10e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e423e8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 0x7f0e3c10e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e423e8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c10ebc0 con 0x7f0e3c0fd150 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e423e8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1081e0 con 0x7f0e3c0fc7f0 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e3b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 0x7f0e3c10e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e3b7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 0x7f0e3c10e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41226/0 (socket says 172.21.15.49:41226) 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e3b7fe700 1 -- 172.21.15.49:0/3429117940 learned_addr learned my addr 172.21.15.49:0/3429117940 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e3bfff700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c0fc7f0 0x7f0e3c10e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e3b7fe700 1 -- 172.21.15.49:0/3429117940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c0fc7f0 msgr2=0x7f0e3c10e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e3b7fe700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c0fc7f0 0x7f0e3c10e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e3b7fe700 1 -- 172.21.15.49:0/3429117940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e30005040 con 0x7f0e3c0fd150 2024-02-22T00:57:32.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e3b7fe700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 0x7f0e3c10e530 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0e30000c00 tx=0x7f0e30009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e397fa700 1 -- 172.21.15.49:0/3429117940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e3000e030 con 0x7f0e3c0fd150 2024-02-22T00:57:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c108430 con 0x7f0e3c0fd150 2024-02-22T00:57:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e397fa700 1 -- 172.21.15.49:0/3429117940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0e30007e90 con 0x7f0e3c0fd150 2024-02-22T00:57:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e397fa700 1 -- 172.21.15.49:0/3429117940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e30018070 con 0x7f0e3c0fd150 2024-02-22T00:57:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.111+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c108910 con 0x7f0e3c0fd150 2024-02-22T00:57:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.112+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c05f590 con 0x7f0e3c0fd150 2024-02-22T00:57:32.111 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.113+0000 7f0e397fa700 1 -- 172.21.15.49:0/3429117940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0e3001d420 con 0x7f0e3c0fd150 2024-02-22T00:57:32.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.113+0000 7f0e397fa700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0e2406cab0 0x7f0e2406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:32.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.113+0000 7f0e3bfff700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0e2406cab0 0x7f0e2406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:32.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.113+0000 7f0e397fa700 1 -- 172.21.15.49:0/3429117940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0e3008d270 con 0x7f0e3c0fd150 2024-02-22T00:57:32.112 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.114+0000 7f0e3bfff700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0e2406cab0 0x7f0e2406ef70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f0e2c00b910 tx=0x7f0e2c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:32.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.118+0000 7f0e397fa700 1 -- 172.21.15.49:0/3429117940 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0e3005ae90 con 0x7f0e3c0fd150 2024-02-22T00:57:32.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.337+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e3c109730 con 0x7f0e2406cab0 2024-02-22T00:57:32.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.338+0000 7f0e397fa700 1 -- 172.21.15.49:0/3429117940 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0e3c109730 con 0x7f0e2406cab0 2024-02-22T00:57:32.335 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:57:32.335 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:57:32.335 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:57:32.335 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:57:32.335 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:57:32.335 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:57:32.335 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:57:32.336 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:57:32.336 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:57:32.336 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:57:32.336 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:57:32.336 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:57:32.336 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:57:32.336 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:57:32.336 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:57:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0e2406cab0 msgr2=0x7f0e2406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0e2406cab0 0x7f0e2406ef70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f0e2c00b910 tx=0x7f0e2c008040).stop 2024-02-22T00:57:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 msgr2=0x7f0e3c10e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 0x7f0e3c10e530 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0e30000c00 tx=0x7f0e30009cb0).stop 2024-02-22T00:57:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 shutdown_connections 2024-02-22T00:57:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f0e2406cab0 0x7f0e2406ef70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e3c0fc7f0 0x7f0e3c10e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 --2- 172.21.15.49:0/3429117940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e3c0fd150 0x7f0e3c10e530 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 >> 172.21.15.49:0/3429117940 conn(0x7f0e3c070590 msgr2=0x7f0e3c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 shutdown_connections 2024-02-22T00:57:32.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.340+0000 7f0e423e8700 1 -- 172.21.15.49:0/3429117940 wait complete. 2024-02-22T00:57:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.441+0000 7f031f3c0700 1 -- 172.21.15.49:0/1069333218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 msgr2=0x7f03180f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.441+0000 7f031f3c0700 1 --2- 172.21.15.49:0/1069333218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 0x7f03180f7a30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f030c0047f0 tx=0x7f030c009cb0).stop 2024-02-22T00:57:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.441+0000 7f031f3c0700 1 -- 172.21.15.49:0/1069333218 shutdown_connections 2024-02-22T00:57:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.441+0000 7f031f3c0700 1 --2- 172.21.15.49:0/1069333218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 0x7f03180f7a30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.441+0000 7f031f3c0700 1 --2- 172.21.15.49:0/1069333218 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180fd8f0 0x7f03180fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:57:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.441+0000 7f031f3c0700 1 -- 172.21.15.49:0/1069333218 >> 172.21.15.49:0/1069333218 conn(0x7f03180f34b0 msgr2=0x7f03180f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.441+0000 7f031f3c0700 1 -- 172.21.15.49:0/1069333218 shutdown_connections 2024-02-22T00:57:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.441+0000 7f031f3c0700 1 -- 172.21.15.49:0/1069333218 wait complete. 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031f3c0700 1 Processor -- start 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031f3c0700 1 -- start start 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031f3c0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180fd8f0 0x7f031810e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031f3c0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 0x7f031810e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031f3c0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031810ebb0 con 0x7f03180fe250 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031f3c0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03181081d0 con 0x7f03180fd8f0 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031c95b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 0x7f031810e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031c95b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 0x7f031810e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41230/0 (socket says 172.21.15.49:41230) 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031c95b700 1 -- 172.21.15.49:0/401815188 learned_addr learned my addr 172.21.15.49:0/401815188 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031d15c700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180fd8f0 0x7f031810e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031c95b700 1 -- 172.21.15.49:0/401815188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180fd8f0 msgr2=0x7f031810e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031c95b700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180fd8f0 0x7f031810e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031c95b700 1 -- 172.21.15.49:0/401815188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c005040 con 0x7f03180fe250 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.442+0000 7f031d15c700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180fd8f0 0x7f031810e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.443+0000 7f031c95b700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 0x7f031810e520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f030c0099f0 tx=0x7f030c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.443+0000 7f030a7fc700 1 -- 172.21.15.49:0/401815188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030c00e030 con 0x7f03180fe250 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.443+0000 7f030a7fc700 1 -- 172.21.15.49:0/401815188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f030c007e90 con 0x7f03180fe250 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.443+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0318108420 con 0x7f03180fe250 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.443+0000 7f030a7fc700 1 -- 172.21.15.49:0/401815188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f030c018070 con 0x7f03180fe250 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.443+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0318108900 con 0x7f03180fe250 2024-02-22T00:57:32.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.444+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031805f590 con 0x7f03180fe250 2024-02-22T00:57:32.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.444+0000 7f030a7fc700 1 -- 172.21.15.49:0/401815188 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f030c01d420 con 0x7f03180fe250 2024-02-22T00:57:32.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.445+0000 7f030a7fc700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f030406caa0 0x7f030406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:57:32.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.445+0000 7f031d15c700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f030406caa0 0x7f030406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:57:32.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.445+0000 7f030a7fc700 1 -- 172.21.15.49:0/401815188 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f030c08d240 con 0x7f03180fe250 2024-02-22T00:57:32.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.445+0000 7f031d15c700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f030406caa0 0x7f030406ef60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f031400a900 tx=0x7f0314008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:57:32.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.449+0000 7f030a7fc700 1 -- 172.21.15.49:0/401815188 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f030c05ada0 con 0x7f03180fe250 2024-02-22T00:57:32.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:32 smithi161 ceph-mon[113442]: pgmap v618: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:32.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:32 smithi161 ceph-mon[113442]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:32.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:32 smithi161 ceph-mon[113442]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:32.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:32 smithi161 ceph-mon[113442]: from='client.35154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:32.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:32 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3407696689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:57:32.539 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:32 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3518230691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:57:32.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:32 smithi049 ceph-mon[132694]: pgmap v618: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:32.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:32 smithi049 ceph-mon[132694]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:32.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:32 smithi049 ceph-mon[132694]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:32.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:32 smithi049 ceph-mon[132694]: from='client.35154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:32.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:32 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3407696689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:57:32.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:32 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3518230691' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:57:32.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.728+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f03181096b0 con 0x7f03180fe250 2024-02-22T00:57:32.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.728+0000 7f030a7fc700 1 -- 172.21.15.49:0/401815188 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f030c05a930 con 0x7f03180fe250 2024-02-22T00:57:32.725 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:57:32.725 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:57:32.726 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:57:32.726 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:57:32.726 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:57:32.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f030406caa0 msgr2=0x7f030406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f030406caa0 0x7f030406ef60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f031400a900 tx=0x7f0314008040).stop 2024-02-22T00:57:32.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 msgr2=0x7f031810e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:57:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 0x7f031810e520 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f030c0099f0 tx=0x7f030c009cb0).stop 2024-02-22T00:57:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 shutdown_connections 2024-02-22T00:57:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f030406caa0 0x7f030406ef60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180fd8f0 0x7f031810e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 --2- 172.21.15.49:0/401815188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f03180fe250 0x7f031810e520 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:57:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.730+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 >> 172.21.15.49:0/401815188 conn(0x7f03180f34b0 msgr2=0x7f03180fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:57:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.731+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 shutdown_connections 2024-02-22T00:57:32.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:57:32.731+0000 7f031f3c0700 1 -- 172.21.15.49:0/401815188 wait complete. 2024-02-22T00:57:33.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:33 smithi161 ceph-mon[113442]: from='client.35166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:33.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:33 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/401815188' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:57:33.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:33 smithi049 ceph-mon[132694]: from='client.35166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:57:33.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:33 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/401815188' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:57:34.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:34 smithi161 ceph-mon[113442]: pgmap v619: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:34.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:34 smithi049 ceph-mon[132694]: pgmap v619: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:36.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:36 smithi161 ceph-mon[113442]: pgmap v620: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:36.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:36 smithi049 ceph-mon[132694]: pgmap v620: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:38.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:38 smithi161 ceph-mon[113442]: pgmap v621: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:38.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:38 smithi049 ceph-mon[132694]: pgmap v621: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:40.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:40 smithi161 ceph-mon[113442]: pgmap v622: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:40.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:40 smithi049 ceph-mon[132694]: pgmap v622: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:42.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:42 smithi161 ceph-mon[113442]: pgmap v623: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:42.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:42 smithi049 ceph-mon[132694]: pgmap v623: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:43.538 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:57:43.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:57:44.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:44 smithi161 ceph-mon[113442]: pgmap v624: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:44.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:44 smithi049 ceph-mon[132694]: pgmap v624: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:46.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:46 smithi161 ceph-mon[113442]: pgmap v625: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:46.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:46 smithi049 ceph-mon[132694]: pgmap v625: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:48.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:48 smithi161 ceph-mon[113442]: pgmap v626: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:48.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:48 smithi049 ceph-mon[132694]: pgmap v626: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:50.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:50 smithi161 ceph-mon[113442]: pgmap v627: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:50.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:50 smithi049 ceph-mon[132694]: pgmap v627: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:52.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:52 smithi161 ceph-mon[113442]: pgmap v628: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:52.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:52 smithi049 ceph-mon[132694]: pgmap v628: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:54.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:54 smithi161 ceph-mon[113442]: pgmap v629: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:54.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:54 smithi049 ceph-mon[132694]: pgmap v629: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:56.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:56 smithi161 ceph-mon[113442]: pgmap v630: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:56.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:56 smithi049 ceph-mon[132694]: pgmap v630: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:58.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:58 smithi161 ceph-mon[113442]: pgmap v631: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:58.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:57:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:57:58.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:58 smithi049 ceph-mon[132694]: pgmap v631: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:57:58.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:57:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:00.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:00 smithi161 ceph-mon[113442]: pgmap v632: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:00.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:00 smithi049 ceph-mon[132694]: pgmap v632: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:02.537 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:02 smithi161 ceph-mon[113442]: pgmap v633: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:02.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:02 smithi049 ceph-mon[132694]: pgmap v633: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:02.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.846+0000 7fceb056d700 1 -- 172.21.15.49:0/1809031735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 msgr2=0x7fcea80f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:02.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.846+0000 7fceb056d700 1 --2- 172.21.15.49:0/1809031735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 0x7fcea80f7a30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fce980047f0 tx=0x7fce98009cb0).stop 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.846+0000 7fceb056d700 1 -- 172.21.15.49:0/1809031735 shutdown_connections 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.846+0000 7fceb056d700 1 --2- 172.21.15.49:0/1809031735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 0x7fcea80f7a30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.846+0000 7fceb056d700 1 --2- 172.21.15.49:0/1809031735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea80fd8f0 0x7fcea80fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.846+0000 7fceb056d700 1 -- 172.21.15.49:0/1809031735 >> 172.21.15.49:0/1809031735 conn(0x7fcea80f34b0 msgr2=0x7fcea80f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.846+0000 7fceb056d700 1 -- 172.21.15.49:0/1809031735 shutdown_connections 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.846+0000 7fceb056d700 1 -- 172.21.15.49:0/1809031735 wait complete. 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.847+0000 7fceb056d700 1 Processor -- start 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.847+0000 7fceb056d700 1 -- start start 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.847+0000 7fceb056d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea80fd8f0 0x7fcea810e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.847+0000 7fceb056d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 0x7fcea810e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.847+0000 7fceb056d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea810eb00 con 0x7fcea80fe250 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.847+0000 7fceb056d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea810ec40 con 0x7fcea80fd8f0 2024-02-22T00:58:02.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.847+0000 7fceadb08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 0x7fcea810e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceadb08700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 0x7fcea810e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52386/0 (socket says 172.21.15.49:52386) 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceadb08700 1 -- 172.21.15.49:0/1447525152 learned_addr learned my addr 172.21.15.49:0/1447525152 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceae309700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea80fd8f0 0x7fcea810e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceadb08700 1 -- 172.21.15.49:0/1447525152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea80fd8f0 msgr2=0x7fcea810e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceadb08700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea80fd8f0 0x7fcea810e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceadb08700 1 -- 172.21.15.49:0/1447525152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98005040 con 0x7fcea80fe250 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceadb08700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 0x7fcea810e500 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fce980099f0 tx=0x7fce98009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fce9f7fe700 1 -- 172.21.15.49:0/1447525152 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9800e030 con 0x7fcea80fe250 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fce9f7fe700 1 -- 172.21.15.49:0/1447525152 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce98007e90 con 0x7fcea80fe250 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea81082e0 con 0x7fcea80fe250 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fce9f7fe700 1 -- 172.21.15.49:0/1447525152 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce98018070 con 0x7fcea80fe250 2024-02-22T00:58:02.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.848+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea81087c0 con 0x7fcea80fe250 2024-02-22T00:58:02.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.850+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea805f590 con 0x7fcea80fe250 2024-02-22T00:58:02.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.850+0000 7fce9f7fe700 1 -- 172.21.15.49:0/1447525152 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fce980094c0 con 0x7fcea80fe250 2024-02-22T00:58:02.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.850+0000 7fce9f7fe700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9406caa0 0x7fce9406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:02.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.850+0000 7fce9f7fe700 1 -- 172.21.15.49:0/1447525152 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fce9808cf60 con 0x7fcea80fe250 2024-02-22T00:58:02.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.850+0000 7fceae309700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9406caa0 0x7fce9406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:02.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.851+0000 7fceae309700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9406caa0 0x7fce9406ef60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fcea4004dc0 tx=0x7fcea400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:02.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:02.855+0000 7fce9f7fe700 1 -- 172.21.15.49:0/1447525152 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fce980c0190 con 0x7fcea80fe250 2024-02-22T00:58:03.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.071+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcea8104710 con 0x7fce9406caa0 2024-02-22T00:58:03.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.072+0000 7fce9f7fe700 1 -- 172.21.15.49:0/1447525152 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fcea400f040 con 0x7fce9406caa0 2024-02-22T00:58:03.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9406caa0 msgr2=0x7fce9406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9406caa0 0x7fce9406ef60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fcea4004dc0 tx=0x7fcea400b040).stop 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 msgr2=0x7fcea810e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 0x7fcea810e500 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fce980099f0 tx=0x7fce98009cb0).stop 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 shutdown_connections 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fce9406caa0 0x7fce9406ef60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcea80fd8f0 0x7fcea810e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 --2- 172.21.15.49:0/1447525152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea80fe250 0x7fcea810e500 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 >> 172.21.15.49:0/1447525152 conn(0x7fcea80f34b0 msgr2=0x7fcea80fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 shutdown_connections 2024-02-22T00:58:03.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.074+0000 7fceb056d700 1 -- 172.21.15.49:0/1447525152 wait complete. 2024-02-22T00:58:03.080 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T00:58:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.177+0000 7f7779570700 1 -- 172.21.15.49:0/3182347262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fd150 msgr2=0x7f77740f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.177+0000 7f7779570700 1 --2- 172.21.15.49:0/3182347262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fd150 0x7f77740f6930 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f775c0047f0 tx=0x7f775c009cb0).stop 2024-02-22T00:58:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.177+0000 7f7779570700 1 -- 172.21.15.49:0/3182347262 shutdown_connections 2024-02-22T00:58:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.177+0000 7f7779570700 1 --2- 172.21.15.49:0/3182347262 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fd150 0x7f77740f6930 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.177+0000 7f7779570700 1 --2- 172.21.15.49:0/3182347262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77740fc7f0 0x7f77740fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.177+0000 7f7779570700 1 -- 172.21.15.49:0/3182347262 >> 172.21.15.49:0/3182347262 conn(0x7f77740f23b0 msgr2=0x7f77740f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.177+0000 7f7779570700 1 -- 172.21.15.49:0/3182347262 shutdown_connections 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.177+0000 7f7779570700 1 -- 172.21.15.49:0/3182347262 wait complete. 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.178+0000 7f7779570700 1 Processor -- start 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.178+0000 7f7779570700 1 -- start start 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.178+0000 7f7779570700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fc7f0 0x7f777410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.178+0000 7f7779570700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77740fd150 0x7f777410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.178+0000 7f7779570700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777410eab0 con 0x7f77740fc7f0 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.178+0000 7f7779570700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777410ebf0 con 0x7f77740fd150 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.178+0000 7f7772ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fc7f0 0x7f777410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f7772ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fc7f0 0x7f777410dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52406/0 (socket says 172.21.15.49:52406) 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f7772ffd700 1 -- 172.21.15.49:0/1993580536 learned_addr learned my addr 172.21.15.49:0/1993580536 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f77727fc700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77740fd150 0x7f777410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f7772ffd700 1 -- 172.21.15.49:0/1993580536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77740fd150 msgr2=0x7f777410e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f7772ffd700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77740fd150 0x7f777410e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f7772ffd700 1 -- 172.21.15.49:0/1993580536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c005040 con 0x7f77740fc7f0 2024-02-22T00:58:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f7772ffd700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fc7f0 0x7f777410dfc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f77640041d0 tx=0x7f7764009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f776bfff700 1 -- 172.21.15.49:0/1993580536 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7764007b40 con 0x7f77740fc7f0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7774108280 con 0x7f77740fc7f0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f776bfff700 1 -- 172.21.15.49:0/1993580536 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f776400f040 con 0x7f77740fc7f0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f776bfff700 1 -- 172.21.15.49:0/1993580536 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77640137d0 con 0x7f77740fc7f0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.179+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7774108840 con 0x7f77740fc7f0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.180+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7774060370 con 0x7f77740fc7f0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.181+0000 7f776bfff700 1 -- 172.21.15.49:0/1993580536 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f7764007ca0 con 0x7f77740fc7f0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.181+0000 7f776bfff700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f776006caa0 0x7f776006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.181+0000 7f776bfff700 1 -- 172.21.15.49:0/1993580536 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f776408b7b0 con 0x7f77740fc7f0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.181+0000 7f77727fc700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f776006caa0 0x7f776006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.181+0000 7f77727fc700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f776006caa0 0x7f776006ef60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f7774109900 tx=0x7f775c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.186+0000 7f776bfff700 1 -- 172.21.15.49:0/1993580536 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7764059310 con 0x7f77740fc7f0 2024-02-22T00:58:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.402+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7774108ee0 con 0x7f776006caa0 2024-02-22T00:58:03.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.403+0000 7f776bfff700 1 -- 172.21.15.49:0/1993580536 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f7774108ee0 con 0x7f776006caa0 2024-02-22T00:58:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f776006caa0 msgr2=0x7f776006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f776006caa0 0x7f776006ef60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f7774109900 tx=0x7f775c00b040).stop 2024-02-22T00:58:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fc7f0 msgr2=0x7f777410dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fc7f0 0x7f777410dfc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f77640041d0 tx=0x7f7764009f60).stop 2024-02-22T00:58:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 shutdown_connections 2024-02-22T00:58:03.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f776006caa0 0x7f776006ef60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77740fc7f0 0x7f777410dfc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 --2- 172.21.15.49:0/1993580536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77740fd150 0x7f777410e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 >> 172.21.15.49:0/1993580536 conn(0x7f77740f23b0 msgr2=0x7f7774061340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:03.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 shutdown_connections 2024-02-22T00:58:03.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.406+0000 7f7779570700 1 -- 172.21.15.49:0/1993580536 wait complete. 2024-02-22T00:58:03.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.506+0000 7eff4e2e8700 1 -- 172.21.15.49:0/346608344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 msgr2=0x7eff480f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.506+0000 7eff4e2e8700 1 --2- 172.21.15.49:0/346608344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 0x7eff480f6930 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7eff3c0047f0 tx=0x7eff3c009cb0).stop 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.506+0000 7eff4e2e8700 1 -- 172.21.15.49:0/346608344 shutdown_connections 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.506+0000 7eff4e2e8700 1 --2- 172.21.15.49:0/346608344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 0x7eff480f6930 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.506+0000 7eff4e2e8700 1 --2- 172.21.15.49:0/346608344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff480fc7f0 0x7eff480fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.506+0000 7eff4e2e8700 1 -- 172.21.15.49:0/346608344 >> 172.21.15.49:0/346608344 conn(0x7eff48070590 msgr2=0x7eff480f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.506+0000 7eff4e2e8700 1 -- 172.21.15.49:0/346608344 shutdown_connections 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.506+0000 7eff4e2e8700 1 -- 172.21.15.49:0/346608344 wait complete. 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff4e2e8700 1 Processor -- start 2024-02-22T00:58:03.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff4e2e8700 1 -- start start 2024-02-22T00:58:03.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff4e2e8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff480fc7f0 0x7eff4810e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff4e2e8700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 0x7eff4810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff4e2e8700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4810ebb0 con 0x7eff480fd150 2024-02-22T00:58:03.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff4e2e8700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4810ecf0 con 0x7eff480fc7f0 2024-02-22T00:58:03.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 0x7eff4810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff477fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 0x7eff4810e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52426/0 (socket says 172.21.15.49:52426) 2024-02-22T00:58:03.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff477fe700 1 -- 172.21.15.49:0/1857857691 learned_addr learned my addr 172.21.15.49:0/1857857691 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:03.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff47fff700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff480fc7f0 0x7eff4810e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff477fe700 1 -- 172.21.15.49:0/1857857691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff480fc7f0 msgr2=0x7eff4810e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff477fe700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff480fc7f0 0x7eff4810e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.507+0000 7eff477fe700 1 -- 172.21.15.49:0/1857857691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c005040 con 0x7eff480fd150 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.508+0000 7eff477fe700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 0x7eff4810e5b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7eff3c000c00 tx=0x7eff3c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.508+0000 7eff457fa700 1 -- 172.21.15.49:0/1857857691 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3c018070 con 0x7eff480fd150 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.508+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff48108360 con 0x7eff480fd150 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.508+0000 7eff457fa700 1 -- 172.21.15.49:0/1857857691 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff3c007e90 con 0x7eff480fd150 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.508+0000 7eff457fa700 1 -- 172.21.15.49:0/1857857691 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3c01de20 con 0x7eff480fd150 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.508+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff481088c0 con 0x7eff480fd150 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.509+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4805f590 con 0x7eff480fd150 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.509+0000 7eff457fa700 1 -- 172.21.15.49:0/1857857691 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7eff3c01d420 con 0x7eff480fd150 2024-02-22T00:58:03.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.510+0000 7eff457fa700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff3006ca30 0x7eff3006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.510+0000 7eff457fa700 1 -- 172.21.15.49:0/1857857691 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7eff3c08c8e0 con 0x7eff480fd150 2024-02-22T00:58:03.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.510+0000 7eff47fff700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff3006ca30 0x7eff3006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.510+0000 7eff47fff700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff3006ca30 0x7eff3006eef0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7eff38004ee0 tx=0x7eff3800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:03.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.515+0000 7eff457fa700 1 -- 172.21.15.49:0/1857857691 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7eff3c0569b0 con 0x7eff480fd150 2024-02-22T00:58:03.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.719+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7eff48108f50 con 0x7eff3006ca30 2024-02-22T00:58:03.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.729+0000 7eff457fa700 1 -- 172.21.15.49:0/1857857691 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7eff48108f50 con 0x7eff3006ca30 2024-02-22T00:58:03.725 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:58:03.725 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (21m) 15m ago 32m 27.9M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:58:03.725 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (18m) 15m ago 32m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (18m) 14m ago 31m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (21m) 15m ago 32m 91.6M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (15m) 15m ago 27m 11.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (15m) 15m ago 27m 14.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (14m) 14m ago 27m 12.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (14m) 14m ago 27m 14.6M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (22m) 15m ago 33m 504M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (22m) 14m ago 31m 449M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (19m) 15m ago 33m 50.9M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (19m) 14m ago 31m 47.2M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (21m) 15m ago 32m 16.7M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (21m) 14m ago 31m 17.7M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (18m) 15m ago 31m 97.7M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:58:03.726 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (18m) 15m ago 30m 100M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:58:03.727 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (17m) 15m ago 30m 86.8M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:58:03.727 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (16m) 14m ago 29m 103M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:58:03.727 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (16m) 14m ago 29m 92.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:58:03.727 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (15m) 14m ago 28m 86.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:58:03.727 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (21m) 14m ago 31m 61.4M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:58:03.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff3006ca30 msgr2=0x7eff3006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff3006ca30 0x7eff3006eef0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7eff38004ee0 tx=0x7eff3800b040).stop 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 msgr2=0x7eff4810e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 0x7eff4810e5b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7eff3c000c00 tx=0x7eff3c009cb0).stop 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 shutdown_connections 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7eff3006ca30 0x7eff3006eef0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff480fc7f0 0x7eff4810e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 --2- 172.21.15.49:0/1857857691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff480fd150 0x7eff4810e5b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 >> 172.21.15.49:0/1857857691 conn(0x7eff48070590 msgr2=0x7eff48060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 shutdown_connections 2024-02-22T00:58:03.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.731+0000 7eff4e2e8700 1 -- 172.21.15.49:0/1857857691 wait complete. 2024-02-22T00:58:03.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 -- 172.21.15.49:0/3363585562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 msgr2=0x7fd0100fde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 --2- 172.21.15.49:0/3363585562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 0x7fd0100fde30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fd00c0047f0 tx=0x7fd00c009cb0).stop 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 -- 172.21.15.49:0/3363585562 shutdown_connections 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 --2- 172.21.15.49:0/3363585562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0100fe3b0 0x7fd0100f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 --2- 172.21.15.49:0/3363585562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 0x7fd0100fde30 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 -- 172.21.15.49:0/3363585562 >> 172.21.15.49:0/3363585562 conn(0x7fd01006ce50 msgr2=0x7fd01006d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 -- 172.21.15.49:0/3363585562 shutdown_connections 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 -- 172.21.15.49:0/3363585562 wait complete. 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 Processor -- start 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.832+0000 7fd018595700 1 -- start start 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd018595700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 0x7fd0100f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd018595700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0100fe3b0 0x7fd0100f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd018595700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0100f7c50 con 0x7fd0100fda50 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd018595700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0100f7d90 con 0x7fd0100fe3b0 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd016331700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 0x7fd0100f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd016331700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 0x7fd0100f7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52434/0 (socket says 172.21.15.49:52434) 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd016331700 1 -- 172.21.15.49:0/2755544993 learned_addr learned my addr 172.21.15.49:0/2755544993 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd015b30700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0100fe3b0 0x7fd0100f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd016331700 1 -- 172.21.15.49:0/2755544993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0100fe3b0 msgr2=0x7fd0100f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd016331700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0100fe3b0 0x7fd0100f7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd016331700 1 -- 172.21.15.49:0/2755544993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c005040 con 0x7fd0100fda50 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd015b30700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0100fe3b0 0x7fd0100f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd016331700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 0x7fd0100f7270 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fd00c00b120 tx=0x7fd00c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd0077fe700 1 -- 172.21.15.49:0/2755544993 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00c00e030 con 0x7fd0100fda50 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd0077fe700 1 -- 172.21.15.49:0/2755544993 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd00c007e90 con 0x7fd0100fda50 2024-02-22T00:58:03.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd0077fe700 1 -- 172.21.15.49:0/2755544993 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd00c018070 con 0x7fd0100fda50 2024-02-22T00:58:03.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0100f7fe0 con 0x7fd0100fda50 2024-02-22T00:58:03.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.833+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd010114740 con 0x7fd0100fda50 2024-02-22T00:58:03.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.834+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd010047540 con 0x7fd0100fda50 2024-02-22T00:58:03.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.835+0000 7fd0077fe700 1 -- 172.21.15.49:0/2755544993 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd00c01d420 con 0x7fd0100fda50 2024-02-22T00:58:03.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.835+0000 7fd0077fe700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcffc06caa0 0x7fcffc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:03.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.836+0000 7fd015b30700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcffc06caa0 0x7fcffc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:03.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.836+0000 7fd0077fe700 1 -- 172.21.15.49:0/2755544993 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd00c08d1b0 con 0x7fd0100fda50 2024-02-22T00:58:03.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.836+0000 7fd015b30700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcffc06caa0 0x7fcffc06ef60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fd0100f8a10 tx=0x7fd000008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:03.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:03.841+0000 7fd0077fe700 1 -- 172.21.15.49:0/2755544993 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd00c057280 con 0x7fd0100fda50 2024-02-22T00:58:04.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.126+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd0100f8750 con 0x7fd0100fda50 2024-02-22T00:58:04.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.127+0000 7fd0077fe700 1 -- 172.21.15.49:0/2755544993 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fd00c05a8a0 con 0x7fd0100fda50 2024-02-22T00:58:04.122 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:58:04.122 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:58:04.122 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:58:04.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:58:04.122 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:58:04.123 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:58:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcffc06caa0 msgr2=0x7fcffc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcffc06caa0 0x7fcffc06ef60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fd0100f8a10 tx=0x7fd000008040).stop 2024-02-22T00:58:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 msgr2=0x7fd0100f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 0x7fd0100f7270 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7fd00c00b120 tx=0x7fd00c009cb0).stop 2024-02-22T00:58:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 shutdown_connections 2024-02-22T00:58:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fcffc06caa0 0x7fcffc06ef60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0100fda50 0x7fd0100f7270 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 --2- 172.21.15.49:0/2755544993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0100fe3b0 0x7fd0100f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 >> 172.21.15.49:0/2755544993 conn(0x7fd01006ce50 msgr2=0x7fd010101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:04.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 shutdown_connections 2024-02-22T00:58:04.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.129+0000 7fd018595700 1 -- 172.21.15.49:0/2755544993 wait complete. 2024-02-22T00:58:04.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.230+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1958506638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 msgr2=0x7f4ed00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.230+0000 7f4ed4e57700 1 --2- 172.21.15.49:0/1958506638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 0x7f4ed00f6930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f4ec00047f0 tx=0x7f4ec0009cb0).stop 2024-02-22T00:58:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.230+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1958506638 shutdown_connections 2024-02-22T00:58:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.230+0000 7f4ed4e57700 1 --2- 172.21.15.49:0/1958506638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 0x7f4ed00f6930 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.230+0000 7f4ed4e57700 1 --2- 172.21.15.49:0/1958506638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed00fc7f0 0x7f4ed00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.230+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1958506638 >> 172.21.15.49:0/1958506638 conn(0x7f4ed0070590 msgr2=0x7f4ed00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.230+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1958506638 shutdown_connections 2024-02-22T00:58:04.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.230+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1958506638 wait complete. 2024-02-22T00:58:04.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.231+0000 7f4ed4e57700 1 Processor -- start 2024-02-22T00:58:04.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.231+0000 7f4ed4e57700 1 -- start start 2024-02-22T00:58:04.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.231+0000 7f4ed4e57700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed00fc7f0 0x7f4ed01101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.231+0000 7f4ed4e57700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 0x7f4ed01106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.231+0000 7f4ed4e57700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0110cc0 con 0x7f4ed00fd150 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.231+0000 7f4ed4e57700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0110e00 con 0x7f4ed00fc7f0 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.231+0000 7f4ecdd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 0x7f4ed01106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ecdd9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 0x7f4ed01106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52454/0 (socket says 172.21.15.49:52454) 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ecdd9b700 1 -- 172.21.15.49:0/1537363503 learned_addr learned my addr 172.21.15.49:0/1537363503 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ece59c700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed00fc7f0 0x7f4ed01101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ecdd9b700 1 -- 172.21.15.49:0/1537363503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed00fc7f0 msgr2=0x7f4ed01101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ecdd9b700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed00fc7f0 0x7f4ed01101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ecdd9b700 1 -- 172.21.15.49:0/1537363503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec0005040 con 0x7f4ed00fd150 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ece59c700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed00fc7f0 0x7f4ed01101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ecdd9b700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 0x7f4ed01106c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f4ec00099f0 tx=0x7f4ec0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:04.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ec77fe700 1 -- 172.21.15.49:0/1537363503 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec000e030 con 0x7f4ed00fd150 2024-02-22T00:58:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ec77fe700 1 -- 172.21.15.49:0/1537363503 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4ec0007e90 con 0x7f4ed00fd150 2024-02-22T00:58:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed010a430 con 0x7f4ed00fd150 2024-02-22T00:58:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ec77fe700 1 -- 172.21.15.49:0/1537363503 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec0018070 con 0x7f4ed00fd150 2024-02-22T00:58:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.232+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed010a990 con 0x7f4ed00fd150 2024-02-22T00:58:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.233+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed005f590 con 0x7f4ed00fd150 2024-02-22T00:58:04.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.234+0000 7f4ec77fe700 1 -- 172.21.15.49:0/1537363503 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4ec001d420 con 0x7f4ed00fd150 2024-02-22T00:58:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.234+0000 7f4ec77fe700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ebc06caa0 0x7f4ebc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.234+0000 7f4ec77fe700 1 -- 172.21.15.49:0/1537363503 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4ec008d240 con 0x7f4ed00fd150 2024-02-22T00:58:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.234+0000 7f4ece59c700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ebc06caa0 0x7f4ebc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:04.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.235+0000 7f4ece59c700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ebc06caa0 0x7f4ebc06ef60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4eb8004ba0 tx=0x7f4eb8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:04.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.239+0000 7f4ec77fe700 1 -- 172.21.15.49:0/1537363503 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4ec005ada0 con 0x7f4ed00fd150 2024-02-22T00:58:04.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.480+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ed0047540 con 0x7f4ed00fd150 2024-02-22T00:58:04.475 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.480+0000 7f4ec77fe700 1 -- 172.21.15.49:0/1537363503 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1841 (secure 0 0 0) 0x7f4ec005a930 con 0x7f4ed00fd150 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:e26 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 17 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T00:58:04.476 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:42:24.207001+0000 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:up {} 2024-02-22T00:58:04.477 INFO:teuthology.orchestra.run.smithi049.stdout:failed 0,1 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:58:04.478 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{-1:34382} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:58:04.479 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:58:04.479 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T00:58:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ebc06caa0 msgr2=0x7f4ebc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ebc06caa0 0x7f4ebc06ef60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4eb8004ba0 tx=0x7f4eb8009040).stop 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 msgr2=0x7f4ed01106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 0x7f4ed01106c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f4ec00099f0 tx=0x7f4ec0009cb0).stop 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 shutdown_connections 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4ebc06caa0 0x7f4ebc06ef60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ed00fc7f0 0x7f4ed01101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 --2- 172.21.15.49:0/1537363503 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ed00fd150 0x7f4ed01106c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 >> 172.21.15.49:0/1537363503 conn(0x7f4ed0070590 msgr2=0x7f4ed0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 shutdown_connections 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.483+0000 7f4ed4e57700 1 -- 172.21.15.49:0/1537363503 wait complete. 2024-02-22T00:58:04.480 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T00:58:04.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.586+0000 7f29a1a47700 1 -- 172.21.15.49:0/2410745489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 msgr2=0x7f299c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.586+0000 7f29a1a47700 1 --2- 172.21.15.49:0/2410745489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 0x7f299c0fdcd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f29900047f0 tx=0x7f2990009cb0).stop 2024-02-22T00:58:04.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.586+0000 7f29a1a47700 1 -- 172.21.15.49:0/2410745489 shutdown_connections 2024-02-22T00:58:04.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.586+0000 7f29a1a47700 1 --2- 172.21.15.49:0/2410745489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f299c0fe250 0x7f299c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.586+0000 7f29a1a47700 1 --2- 172.21.15.49:0/2410745489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 0x7f299c0fdcd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.586+0000 7f29a1a47700 1 -- 172.21.15.49:0/2410745489 >> 172.21.15.49:0/2410745489 conn(0x7f299c0f34b0 msgr2=0x7f299c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:04.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.586+0000 7f29a1a47700 1 -- 172.21.15.49:0/2410745489 shutdown_connections 2024-02-22T00:58:04.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.586+0000 7f29a1a47700 1 -- 172.21.15.49:0/2410745489 wait complete. 2024-02-22T00:58:04.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f29a1a47700 1 Processor -- start 2024-02-22T00:58:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f29a1a47700 1 -- start start 2024-02-22T00:58:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f29a1a47700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 0x7f299c10e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f29a1a47700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f299c0fe250 0x7f299c10e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f29a1a47700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c10eaf0 con 0x7f299c0fd8f0 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f29a1a47700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c10ec30 con 0x7f299c0fe250 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f299affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 0x7f299c10e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f299affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 0x7f299c10e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52470/0 (socket says 172.21.15.49:52470) 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f299affd700 1 -- 172.21.15.49:0/837550223 learned_addr learned my addr 172.21.15.49:0/837550223 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.587+0000 7f299a7fc700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f299c0fe250 0x7f299c10e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f299affd700 1 -- 172.21.15.49:0/837550223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f299c0fe250 msgr2=0x7f299c10e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f299affd700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f299c0fe250 0x7f299c10e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f299affd700 1 -- 172.21.15.49:0/837550223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990005040 con 0x7f299c0fd8f0 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f299affd700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 0x7f299c10e000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f299000b120 tx=0x7f2990009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f2983fff700 1 -- 172.21.15.49:0/837550223 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299000e030 con 0x7f299c0fd8f0 2024-02-22T00:58:04.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f2983fff700 1 -- 172.21.15.49:0/837550223 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2990007e90 con 0x7f299c0fd8f0 2024-02-22T00:58:04.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c108260 con 0x7f299c0fd8f0 2024-02-22T00:58:04.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f2983fff700 1 -- 172.21.15.49:0/837550223 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2990018070 con 0x7f299c0fd8f0 2024-02-22T00:58:04.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.588+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c1087c0 con 0x7f299c0fd8f0 2024-02-22T00:58:04.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.589+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c05f590 con 0x7f299c0fd8f0 2024-02-22T00:58:04.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.590+0000 7f2983fff700 1 -- 172.21.15.49:0/837550223 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f299001d420 con 0x7f299c0fd8f0 2024-02-22T00:58:04.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.590+0000 7f2983fff700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f298406caa0 0x7f298406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.590+0000 7f2983fff700 1 -- 172.21.15.49:0/837550223 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f299008d250 con 0x7f299c0fd8f0 2024-02-22T00:58:04.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.590+0000 7f299a7fc700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f298406caa0 0x7f298406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:04.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.591+0000 7f299a7fc700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f298406caa0 0x7f298406ef60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f299c109940 tx=0x7f298c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:04.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.595+0000 7f2983fff700 1 -- 172.21.15.49:0/837550223 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f299005adb0 con 0x7f299c0fd8f0 2024-02-22T00:58:04.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:04 smithi049 ceph-mon[132694]: pgmap v634: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:04.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:04 smithi049 ceph-mon[132694]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:04.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:04 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2755544993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:04.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:04 smithi161 ceph-mon[113442]: pgmap v634: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:04.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:04 smithi161 ceph-mon[113442]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:04.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:04 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2755544993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:04.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.812+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f299c0ffc40 con 0x7f298406caa0 2024-02-22T00:58:04.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.813+0000 7f2983fff700 1 -- 172.21.15.49:0/837550223 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f299c0ffc40 con 0x7f298406caa0 2024-02-22T00:58:04.808 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:58:04.808 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:75ec18f7067b26b32c6f90cd6827cc96a276ce86be68e998f0bd36838cbd5bd0", 2024-02-22T00:58:04.808 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": true, 2024-02-22T00:58:04.808 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [ 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr", 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mds", 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "mon", 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "osd" 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": "16/21 daemons upgraded", 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "Currently upgrading mds daemons", 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:58:04.809 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:58:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f298406caa0 msgr2=0x7f298406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f298406caa0 0x7f298406ef60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f299c109940 tx=0x7f298c009040).stop 2024-02-22T00:58:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 msgr2=0x7f299c10e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 0x7f299c10e000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f299000b120 tx=0x7f2990009cb0).stop 2024-02-22T00:58:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 shutdown_connections 2024-02-22T00:58:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f298406caa0 0x7f298406ef60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f299c0fd8f0 0x7f299c10e000 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 --2- 172.21.15.49:0/837550223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f299c0fe250 0x7f299c10e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 >> 172.21.15.49:0/837550223 conn(0x7f299c0f34b0 msgr2=0x7f299c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:04.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 shutdown_connections 2024-02-22T00:58:04.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.815+0000 7f29a1a47700 1 -- 172.21.15.49:0/837550223 wait complete. 2024-02-22T00:58:04.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.916+0000 7f9653b09700 1 -- 172.21.15.49:0/2837763402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 msgr2=0x7f964c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.916+0000 7f9653b09700 1 --2- 172.21.15.49:0/2837763402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 0x7f964c0fcbd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f96480047f0 tx=0x7f9648009cb0).stop 2024-02-22T00:58:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.916+0000 7f9653b09700 1 -- 172.21.15.49:0/2837763402 shutdown_connections 2024-02-22T00:58:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.916+0000 7f9653b09700 1 --2- 172.21.15.49:0/2837763402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f964c0fd150 0x7f964c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.916+0000 7f9653b09700 1 --2- 172.21.15.49:0/2837763402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 0x7f964c0fcbd0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.916+0000 7f9653b09700 1 -- 172.21.15.49:0/2837763402 >> 172.21.15.49:0/2837763402 conn(0x7f964c070590 msgr2=0x7f964c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.916+0000 7f9653b09700 1 -- 172.21.15.49:0/2837763402 shutdown_connections 2024-02-22T00:58:04.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.916+0000 7f9653b09700 1 -- 172.21.15.49:0/2837763402 wait complete. 2024-02-22T00:58:04.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.917+0000 7f9653b09700 1 Processor -- start 2024-02-22T00:58:04.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.917+0000 7f9653b09700 1 -- start start 2024-02-22T00:58:04.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f9653b09700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 0x7f964c1090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f9653b09700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f964c0fd150 0x7f964c1095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f9653b09700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c109ad0 con 0x7f964c0fc7f0 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f9653b09700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964c109c10 con 0x7f964c0fd150 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f96518a5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 0x7f964c1090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f96518a5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 0x7f964c1090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52484/0 (socket says 172.21.15.49:52484) 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f96518a5700 1 -- 172.21.15.49:0/1319026843 learned_addr learned my addr 172.21.15.49:0/1319026843 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f96518a5700 1 -- 172.21.15.49:0/1319026843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f964c0fd150 msgr2=0x7f964c1095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f96518a5700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f964c0fd150 0x7f964c1095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f96518a5700 1 -- 172.21.15.49:0/1319026843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648005040 con 0x7f964c0fc7f0 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f96518a5700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 0x7f964c1090f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f964800b120 tx=0x7f9648009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f963effd700 1 -- 172.21.15.49:0/1319026843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f964800e030 con 0x7f964c0fc7f0 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c109e60 con 0x7f964c0fc7f0 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f963effd700 1 -- 172.21.15.49:0/1319026843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9648007e90 con 0x7f964c0fc7f0 2024-02-22T00:58:04.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f963effd700 1 -- 172.21.15.49:0/1319026843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9648018070 con 0x7f964c0fc7f0 2024-02-22T00:58:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.918+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964c112450 con 0x7f964c0fc7f0 2024-02-22T00:58:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.919+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964c05f590 con 0x7f964c0fc7f0 2024-02-22T00:58:04.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.920+0000 7f963effd700 1 -- 172.21.15.49:0/1319026843 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f964801d420 con 0x7f964c0fc7f0 2024-02-22T00:58:04.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.920+0000 7f963effd700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f963806caa0 0x7f963806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:04.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.920+0000 7f963effd700 1 -- 172.21.15.49:0/1319026843 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f964808d350 con 0x7f964c0fc7f0 2024-02-22T00:58:04.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.920+0000 7f96510a4700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f963806caa0 0x7f963806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:04.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.921+0000 7f96510a4700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f963806caa0 0x7f963806ef60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f964c060ee0 tx=0x7f9640007b40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:04.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:04.925+0000 7f963effd700 1 -- 172.21.15.49:0/1319026843 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9648057360 con 0x7f964c0fc7f0 2024-02-22T00:58:05.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.208+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f964c103590 con 0x7f964c0fc7f0 2024-02-22T00:58:05.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.209+0000 7f963effd700 1 -- 172.21.15.49:0/1319026843 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f964805a980 con 0x7f964c0fc7f0 2024-02-22T00:58:05.204 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-02-22T00:58:05.204 INFO:teuthology.orchestra.run.smithi049.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-22T00:58:05.204 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is degraded 2024-02-22T00:58:05.204 INFO:teuthology.orchestra.run.smithi049.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-22T00:58:05.204 INFO:teuthology.orchestra.run.smithi049.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f963806caa0 msgr2=0x7f963806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f963806caa0 0x7f963806ef60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f964c060ee0 tx=0x7f9640007b40).stop 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 msgr2=0x7f964c1090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 0x7f964c1090f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f964800b120 tx=0x7f9648009cb0).stop 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 shutdown_connections 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f963806caa0 0x7f963806ef60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f964c0fc7f0 0x7f964c1090f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 --2- 172.21.15.49:0/1319026843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f964c0fd150 0x7f964c1095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 >> 172.21.15.49:0/1319026843 conn(0x7f964c070590 msgr2=0x7f964c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 shutdown_connections 2024-02-22T00:58:05.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:05.211+0000 7f9653b09700 1 -- 172.21.15.49:0/1319026843 wait complete. 2024-02-22T00:58:05.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:05 smithi049 ceph-mon[132694]: from='client.35178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:05.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:05 smithi049 ceph-mon[132694]: from='client.35182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:05.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:05 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1537363503' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:58:05.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:05 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1319026843' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:58:05.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:05 smithi161 ceph-mon[113442]: from='client.35178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:05.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:05 smithi161 ceph-mon[113442]: from='client.35182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:05.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:05 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1537363503' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T00:58:05.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:05 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1319026843' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:58:06.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:06 smithi049 ceph-mon[132694]: pgmap v635: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:06.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:06 smithi049 ceph-mon[132694]: from='client.35194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:06.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:06 smithi161 ceph-mon[113442]: pgmap v635: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:06.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:06 smithi161 ceph-mon[113442]: from='client.35194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:08.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:08 smithi049 ceph-mon[132694]: pgmap v636: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:08.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:08 smithi161 ceph-mon[113442]: pgmap v636: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:10.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:10 smithi049 ceph-mon[132694]: pgmap v637: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:10.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:10 smithi161 ceph-mon[113442]: pgmap v637: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:12.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:12 smithi049 ceph-mon[132694]: pgmap v638: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:12.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:12 smithi161 ceph-mon[113442]: pgmap v638: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:13.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:13.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:14.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:14 smithi049 ceph-mon[132694]: pgmap v639: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:14.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:14 smithi161 ceph-mon[113442]: pgmap v639: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:16.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:16 smithi049 ceph-mon[132694]: pgmap v640: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:16.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:16 smithi161 ceph-mon[113442]: pgmap v640: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:18.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:18 smithi049 ceph-mon[132694]: pgmap v641: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:18.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:18 smithi161 ceph-mon[113442]: pgmap v641: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:20.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:20 smithi049 ceph-mon[132694]: pgmap v642: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:20.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:20 smithi161 ceph-mon[113442]: pgmap v642: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:22.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:22 smithi049 ceph-mon[132694]: pgmap v643: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:22.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:22 smithi161 ceph-mon[113442]: pgmap v643: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:23.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:23 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:58:23.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:23 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:58:23.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:23 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:23.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:23 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:58:23.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:23 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:58:23.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:23 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:24.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: pgmap v644: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:24.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: pgmap v645: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:24.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-02-22T00:58:24.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:58:24.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all mds 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.rrqshp"}]': finished 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.vwomak"}]': finished 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.plrhpg"}]': finished 2024-02-22T00:58:24.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:58:24.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.wycpud"}]': finished 2024-02-22T00:58:24.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: Upgrade: Setting filesystem cephfs Joinable 2024-02-22T00:58:24.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:24 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-22T00:58:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: pgmap v644: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: pgmap v645: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-02-22T00:58:24.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all mds 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.rrqshp"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.rrqshp"}]': finished 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.vwomak"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi049.vwomak"}]': finished 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.plrhpg"}]: dispatch 2024-02-22T00:58:24.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.plrhpg"}]': finished 2024-02-22T00:58:24.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.wycpud"}]: dispatch 2024-02-22T00:58:24.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi161.wycpud"}]': finished 2024-02-22T00:58:24.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: Upgrade: Setting filesystem cephfs Joinable 2024-02-22T00:58:24.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:24 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-22T00:58:25.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: Standby daemon mds.cephfs.smithi049.vwomak assigned to filesystem cephfs as rank 0 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: Standby daemon mds.cephfs.smithi049.rrqshp assigned to filesystem cephfs as rank 1 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:replay,1=cephfs.smithi049.rrqshp=up:replay} 2 up:standby 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all rgw 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.673 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all rbd-mirror 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.674 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-22T00:58:25.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-22T00:58:25.676 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-22T00:58:25.677 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-22T00:58:25.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T00:58:25.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-22T00:58:25.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:58:25.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.678 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:25 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: Standby daemon mds.cephfs.smithi049.vwomak assigned to filesystem cephfs as rank 0 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: Standby daemon mds.cephfs.smithi049.rrqshp assigned to filesystem cephfs as rank 1 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:replay,1=cephfs.smithi049.rrqshp=up:replay} 2 up:standby 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all rgw 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all rbd-mirror 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.788 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-22T00:58:25.789 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-22T00:58:25.790 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-22T00:58:25.791 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-22T00:58:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T00:58:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-22T00:58:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:58:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:25.792 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:25 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:26.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:26 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all ceph-exporter 2024-02-22T00:58:26.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:26 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all iscsi 2024-02-22T00:58:26.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:26 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all nfs 2024-02-22T00:58:26.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:26 smithi049 ceph-mon[132694]: Upgrade: Setting container_image for all nvmeof 2024-02-22T00:58:26.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:26 smithi049 ceph-mon[132694]: Upgrade: Finalizing container_image settings 2024-02-22T00:58:26.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:26 smithi049 ceph-mon[132694]: Upgrade: Complete! 2024-02-22T00:58:26.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:26 smithi049 ceph-mon[132694]: pgmap v646: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 1 op/s 2024-02-22T00:58:26.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:26 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all ceph-exporter 2024-02-22T00:58:26.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:26 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all iscsi 2024-02-22T00:58:26.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:26 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all nfs 2024-02-22T00:58:26.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:26 smithi161 ceph-mon[113442]: Upgrade: Setting container_image for all nvmeof 2024-02-22T00:58:26.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:26 smithi161 ceph-mon[113442]: Upgrade: Finalizing container_image settings 2024-02-22T00:58:26.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:26 smithi161 ceph-mon[113442]: Upgrade: Complete! 2024-02-22T00:58:26.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:26 smithi161 ceph-mon[113442]: pgmap v646: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 1 op/s 2024-02-22T00:58:28.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:28 smithi049 ceph-mon[132694]: pgmap v647: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7.2 MiB/s rd, 3 op/s 2024-02-22T00:58:28.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:28.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:28.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:28.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:28.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:28.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:28 smithi161 ceph-mon[113442]: pgmap v647: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7.2 MiB/s rd, 3 op/s 2024-02-22T00:58:28.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:28.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:28.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:28.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:28.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:29.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:29 smithi049 ceph-mon[132694]: pgmap v648: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-02-22T00:58:29.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:29 smithi161 ceph-mon[113442]: pgmap v648: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-02-22T00:58:30.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:30.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:30.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:58:30.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:58:30.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: pgmap v649: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 8 op/s 2024-02-22T00:58:30.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:30.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:58:30.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:58:30.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:58:30.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:30 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:30.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:30.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:30.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:58:30.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:58:30.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: pgmap v649: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 8 op/s 2024-02-22T00:58:30.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:30.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:58:30.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:58:30.922 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:58:30.922 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:30 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:31.762 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:31 smithi049 ceph-mon[132694]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-02-22T00:58:31.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:31 smithi161 ceph-mon[113442]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-02-22T00:58:32.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:32 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:resolve 2024-02-22T00:58:32.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:32 smithi161 ceph-mon[113442]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:replay,1=cephfs.smithi049.rrqshp=up:resolve} 2 up:standby 2024-02-22T00:58:32.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:32 smithi161 ceph-mon[113442]: pgmap v650: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 9 op/s 2024-02-22T00:58:32.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:32 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:resolve 2024-02-22T00:58:32.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:32 smithi049 ceph-mon[132694]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:replay,1=cephfs.smithi049.rrqshp=up:resolve} 2 up:standby 2024-02-22T00:58:32.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:32 smithi049 ceph-mon[132694]: pgmap v650: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 9 op/s 2024-02-22T00:58:33.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:33 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:resolve 2024-02-22T00:58:33.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:33 smithi161 ceph-mon[113442]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:resolve,1=cephfs.smithi049.rrqshp=up:resolve} 2 up:standby 2024-02-22T00:58:33.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:33 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:resolve 2024-02-22T00:58:33.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:33 smithi049 ceph-mon[132694]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:resolve,1=cephfs.smithi049.rrqshp=up:resolve} 2 up:standby 2024-02-22T00:58:34.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:34 smithi161 ceph-mon[113442]: reconnect by client.14502 192.168.0.1:0/3038596590 after 0.000999973 2024-02-22T00:58:34.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:34 smithi161 ceph-mon[113442]: reconnect by client.14502 192.168.0.1:0/3038596590 after 0.000999973 2024-02-22T00:58:34.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:34 smithi161 ceph-mon[113442]: reconnect by client.24325 192.168.0.1:0/3479989706 after 0.000999973 2024-02-22T00:58:34.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:34 smithi161 ceph-mon[113442]: reconnect by client.24325 192.168.0.1:0/3479989706 after 0.000999973 2024-02-22T00:58:34.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:34 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:reconnect 2024-02-22T00:58:34.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:34 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:reconnect 2024-02-22T00:58:34.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:34 smithi161 ceph-mon[113442]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:reconnect,1=cephfs.smithi049.rrqshp=up:reconnect} 2 up:standby 2024-02-22T00:58:34.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:34 smithi161 ceph-mon[113442]: pgmap v651: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-22T00:58:34.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:34 smithi049 ceph-mon[132694]: reconnect by client.14502 192.168.0.1:0/3038596590 after 0.000999973 2024-02-22T00:58:34.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:34 smithi049 ceph-mon[132694]: reconnect by client.14502 192.168.0.1:0/3038596590 after 0.000999973 2024-02-22T00:58:34.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:34 smithi049 ceph-mon[132694]: reconnect by client.24325 192.168.0.1:0/3479989706 after 0.000999973 2024-02-22T00:58:34.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:34 smithi049 ceph-mon[132694]: reconnect by client.24325 192.168.0.1:0/3479989706 after 0.000999973 2024-02-22T00:58:34.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:34 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:reconnect 2024-02-22T00:58:34.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:34 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:reconnect 2024-02-22T00:58:34.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:34 smithi049 ceph-mon[132694]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:reconnect,1=cephfs.smithi049.rrqshp=up:reconnect} 2 up:standby 2024-02-22T00:58:34.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:34 smithi049 ceph-mon[132694]: pgmap v651: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-22T00:58:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.327+0000 7ff5ece68700 1 -- 172.21.15.49:0/3301015058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 msgr2=0x7ff5e80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.327+0000 7ff5ece68700 1 --2- 172.21.15.49:0/3301015058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 0x7ff5e80fcbd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7ff5d80047f0 tx=0x7ff5d8009cb0).stop 2024-02-22T00:58:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.327+0000 7ff5ece68700 1 -- 172.21.15.49:0/3301015058 shutdown_connections 2024-02-22T00:58:35.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.327+0000 7ff5ece68700 1 --2- 172.21.15.49:0/3301015058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e80fd150 0x7ff5e80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.327+0000 7ff5ece68700 1 --2- 172.21.15.49:0/3301015058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 0x7ff5e80fcbd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.327+0000 7ff5ece68700 1 -- 172.21.15.49:0/3301015058 >> 172.21.15.49:0/3301015058 conn(0x7ff5e8070590 msgr2=0x7ff5e80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.327+0000 7ff5ece68700 1 -- 172.21.15.49:0/3301015058 shutdown_connections 2024-02-22T00:58:35.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.327+0000 7ff5ece68700 1 -- 172.21.15.49:0/3301015058 wait complete. 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5ece68700 1 Processor -- start 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5ece68700 1 -- start start 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5ece68700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 0x7ff5e810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5ece68700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e80fd150 0x7ff5e810e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5ece68700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e810eab0 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5ece68700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e810ebf0 con 0x7ff5e80fd150 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 0x7ff5e810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 0x7ff5e810dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40032/0 (socket says 172.21.15.49:40032) 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5e659c700 1 -- 172.21.15.49:0/437937056 learned_addr learned my addr 172.21.15.49:0/437937056 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5e5d9b700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e80fd150 0x7ff5e810e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:35.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5e659c700 1 -- 172.21.15.49:0/437937056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e80fd150 msgr2=0x7ff5e810e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5e659c700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e80fd150 0x7ff5e810e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5e659c700 1 -- 172.21.15.49:0/437937056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8005040 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.328+0000 7ff5e5d9b700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e80fd150 0x7ff5e810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.329+0000 7ff5e659c700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 0x7ff5e810dfc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7ff5d8005010 tx=0x7ff5d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.329+0000 7ff5d77fe700 1 -- 172.21.15.49:0/437937056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d800e030 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.329+0000 7ff5d77fe700 1 -- 172.21.15.49:0/437937056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff5d8007e90 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.329+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e8108220 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.329+0000 7ff5d77fe700 1 -- 172.21.15.49:0/437937056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d8018070 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.329+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e8108780 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.330+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e805f590 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.330+0000 7ff5d77fe700 1 -- 172.21.15.49:0/437937056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff5d801d6e0 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.331+0000 7ff5d77fe700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff5d006ca30 0x7ff5d006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.331+0000 7ff5d77fe700 1 -- 172.21.15.49:0/437937056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff5d808d050 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.331+0000 7ff5e5d9b700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff5d006ca30 0x7ff5d006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:35.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.331+0000 7ff5e5d9b700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff5d006ca30 0x7ff5d006eef0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7ff5e8109900 tx=0x7ff5dc009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:35.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.336+0000 7ff5d77fe700 1 -- 172.21.15.49:0/437937056 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff5d805a920 con 0x7ff5e80fc7f0 2024-02-22T00:58:35.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.565+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5e8108e10 con 0x7ff5d006ca30 2024-02-22T00:58:35.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.566+0000 7ff5d77fe700 1 -- 172.21.15.49:0/437937056 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ff5e8108e10 con 0x7ff5d006ca30 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff5d006ca30 msgr2=0x7ff5d006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff5d006ca30 0x7ff5d006eef0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7ff5e8109900 tx=0x7ff5dc009d60).stop 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 msgr2=0x7ff5e810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 0x7ff5e810dfc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7ff5d8005010 tx=0x7ff5d8009cb0).stop 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 shutdown_connections 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff5d006ca30 0x7ff5d006eef0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff5e80fc7f0 0x7ff5e810dfc0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 --2- 172.21.15.49:0/437937056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5e80fd150 0x7ff5e810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:35.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 >> 172.21.15.49:0/437937056 conn(0x7ff5e8070590 msgr2=0x7ff5e8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:35.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 shutdown_connections 2024-02-22T00:58:35.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:35.568+0000 7ff5ece68700 1 -- 172.21.15.49:0/437937056 wait complete. 2024-02-22T00:58:35.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:35 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:rejoin 2024-02-22T00:58:35.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:35 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:rejoin 2024-02-22T00:58:35.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:35 smithi161 ceph-mon[113442]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:rejoin,1=cephfs.smithi049.rrqshp=up:rejoin} 2 up:standby 2024-02-22T00:58:35.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:35 smithi161 ceph-mon[113442]: daemon mds.cephfs.smithi049.rrqshp is now active in filesystem cephfs as rank 1 2024-02-22T00:58:35.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:35 smithi161 ceph-mon[113442]: daemon mds.cephfs.smithi049.vwomak is now active in filesystem cephfs as rank 0 2024-02-22T00:58:35.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:35 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:rejoin 2024-02-22T00:58:35.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:35 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:rejoin 2024-02-22T00:58:35.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:35 smithi049 ceph-mon[132694]: fsmap cephfs:2/2 {0=cephfs.smithi049.vwomak=up:rejoin,1=cephfs.smithi049.rrqshp=up:rejoin} 2 up:standby 2024-02-22T00:58:35.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:35 smithi049 ceph-mon[132694]: daemon mds.cephfs.smithi049.rrqshp is now active in filesystem cephfs as rank 1 2024-02-22T00:58:35.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:35 smithi049 ceph-mon[132694]: daemon mds.cephfs.smithi049.vwomak is now active in filesystem cephfs as rank 0 2024-02-22T00:58:36.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:36 smithi161 ceph-mon[113442]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-22T00:58:36.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:36 smithi161 ceph-mon[113442]: Cluster is now healthy 2024-02-22T00:58:36.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:36 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:active 2024-02-22T00:58:36.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:36 smithi161 ceph-mon[113442]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:active 2024-02-22T00:58:36.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:36 smithi161 ceph-mon[113442]: fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi049.rrqshp=up:active} 2 up:standby 2024-02-22T00:58:36.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:36 smithi161 ceph-mon[113442]: from='client.35202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:36.787 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:36 smithi161 ceph-mon[113442]: pgmap v652: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 94 B/s wr, 7 op/s 2024-02-22T00:58:36.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:36 smithi049 ceph-mon[132694]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-22T00:58:36.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:36 smithi049 ceph-mon[132694]: Cluster is now healthy 2024-02-22T00:58:36.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:36 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] up:active 2024-02-22T00:58:36.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:36 smithi049 ceph-mon[132694]: mds.? [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] up:active 2024-02-22T00:58:36.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:36 smithi049 ceph-mon[132694]: fsmap cephfs:2 {0=cephfs.smithi049.vwomak=up:active,1=cephfs.smithi049.rrqshp=up:active} 2 up:standby 2024-02-22T00:58:36.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:36 smithi049 ceph-mon[132694]: from='client.35202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:36.921 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:36 smithi049 ceph-mon[132694]: pgmap v652: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 94 B/s wr, 7 op/s 2024-02-22T00:58:39.421 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:39 smithi049 ceph-mon[132694]: pgmap v653: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 188 B/s wr, 6 op/s 2024-02-22T00:58:39.536 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:39 smithi161 ceph-mon[113442]: pgmap v653: 65 pgs: 65 active+clean; 256 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 188 B/s wr, 6 op/s 2024-02-22T00:58:40.920 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph orch ps' 2024-02-22T00:58:41.536 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:41 smithi161 ceph-mon[113442]: pgmap v654: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.8 MiB/s rd, 10 KiB/s wr, 13 op/s 2024-02-22T00:58:41.671 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:41 smithi049 ceph-mon[132694]: pgmap v654: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.8 MiB/s rd, 10 KiB/s wr, 13 op/s 2024-02-22T00:58:43.530 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:43 smithi049 ceph-mon[132694]: pgmap v655: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 9.2 KiB/s wr, 11 op/s 2024-02-22T00:58:43.530 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:43.530 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:43.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:43 smithi161 ceph-mon[113442]: pgmap v655: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 9.2 KiB/s wr, 11 op/s 2024-02-22T00:58:43.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:58:43.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:44.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 -- 172.21.15.49:0/3509215144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 msgr2=0x7f9b4c0fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:44.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 --2- 172.21.15.49:0/3509215144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 0x7f9b4c0fdd50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f9b480047f0 tx=0x7f9b48009cb0).stop 2024-02-22T00:58:44.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 -- 172.21.15.49:0/3509215144 shutdown_connections 2024-02-22T00:58:44.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 --2- 172.21.15.49:0/3509215144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c0fe2d0 0x7f9b4c0f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:44.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 --2- 172.21.15.49:0/3509215144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 0x7f9b4c0fdd50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:44.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 -- 172.21.15.49:0/3509215144 >> 172.21.15.49:0/3509215144 conn(0x7f9b4c0f3550 msgr2=0x7f9b4c0f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:44.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 -- 172.21.15.49:0/3509215144 shutdown_connections 2024-02-22T00:58:44.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 -- 172.21.15.49:0/3509215144 wait complete. 2024-02-22T00:58:44.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 Processor -- start 2024-02-22T00:58:44.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.051+0000 7f9b53a31700 1 -- start start 2024-02-22T00:58:44.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b53a31700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 0x7f9b4c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:44.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b53a31700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c0fe2d0 0x7f9b4c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b53a31700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c10eae0 con 0x7f9b4c0fd970 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b53a31700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c10ec20 con 0x7f9b4c0fe2d0 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b517cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 0x7f9b4c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b517cd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 0x7f9b4c10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45042/0 (socket says 172.21.15.49:45042) 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b517cd700 1 -- 172.21.15.49:0/953750681 learned_addr learned my addr 172.21.15.49:0/953750681 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b50fcc700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c0fe2d0 0x7f9b4c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b517cd700 1 -- 172.21.15.49:0/953750681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c0fe2d0 msgr2=0x7f9b4c10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b517cd700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c0fe2d0 0x7f9b4c10e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b517cd700 1 -- 172.21.15.49:0/953750681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b48005040 con 0x7f9b4c0fd970 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b50fcc700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c0fe2d0 0x7f9b4c10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b517cd700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 0x7f9b4c10dff0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f9b48005010 tx=0x7f9b48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.052+0000 7f9b427fc700 1 -- 172.21.15.49:0/953750681 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b4800e030 con 0x7f9b4c0fd970 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.053+0000 7f9b427fc700 1 -- 172.21.15.49:0/953750681 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9b48007e90 con 0x7f9b4c0fd970 2024-02-22T00:58:44.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.053+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c108250 con 0x7f9b4c0fd970 2024-02-22T00:58:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.053+0000 7f9b427fc700 1 -- 172.21.15.49:0/953750681 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b48018070 con 0x7f9b4c0fd970 2024-02-22T00:58:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.053+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c1087b0 con 0x7f9b4c0fd970 2024-02-22T00:58:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.054+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c060370 con 0x7f9b4c0fd970 2024-02-22T00:58:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.054+0000 7f9b427fc700 1 -- 172.21.15.49:0/953750681 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9b4801d6e0 con 0x7f9b4c0fd970 2024-02-22T00:58:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.055+0000 7f9b427fc700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9b3806ca30 0x7f9b3806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:44.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.055+0000 7f9b427fc700 1 -- 172.21.15.49:0/953750681 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9b4808d050 con 0x7f9b4c0fd970 2024-02-22T00:58:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.055+0000 7f9b50fcc700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9b3806ca30 0x7f9b3806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:44.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.055+0000 7f9b50fcc700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9b3806ca30 0x7f9b3806eef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9b4c109930 tx=0x7f9b3c009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:44.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.059+0000 7f9b427fc700 1 -- 172.21.15.49:0/953750681 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9b4805a920 con 0x7f9b4c0fd970 2024-02-22T00:58:44.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.268+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b4c0ffcc0 con 0x7f9b3806ca30 2024-02-22T00:58:44.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.278+0000 7f9b427fc700 1 -- 172.21.15.49:0/953750681 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f9b4c0ffcc0 con 0x7f9b3806ca30 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (21m) 14s ago 33m 28.3M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (19m) 14s ago 33m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (19m) 16s ago 32m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (21m) 14s ago 32m 91.0M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (15m) 14s ago 27m 99.1M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (16m) 14s ago 28m 88.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (15m) 16s ago 27m 19.4M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (15m) 16s ago 27m 20.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (23m) 14s ago 34m 509M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (22m) 16s ago 32m 455M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:58:44.273 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (20m) 14s ago 34m 88.5M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (20m) 16s ago 32m 55.0M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (22m) 14s ago 32m 17.0M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (22m) 16s ago 32m 18.1M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (19m) 14s ago 31m 103M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (18m) 14s ago 31m 109M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (18m) 14s ago 30m 92.2M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (17m) 16s ago 30m 142M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (17m) 16s ago 29m 98.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (16m) 16s ago 29m 95.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:58:44.274 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (22m) 16s ago 32m 74.8M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9b3806ca30 msgr2=0x7f9b3806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9b3806ca30 0x7f9b3806eef0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9b4c109930 tx=0x7f9b3c009d60).stop 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 msgr2=0x7f9b4c10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 0x7f9b4c10dff0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f9b48005010 tx=0x7f9b48009cb0).stop 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 shutdown_connections 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9b3806ca30 0x7f9b3806eef0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b4c0fd970 0x7f9b4c10dff0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 --2- 172.21.15.49:0/953750681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b4c0fe2d0 0x7f9b4c10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 >> 172.21.15.49:0/953750681 conn(0x7f9b4c0f3550 msgr2=0x7f9b4c0fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:44.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 shutdown_connections 2024-02-22T00:58:44.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:44.280+0000 7f9b53a31700 1 -- 172.21.15.49:0/953750681 wait complete. 2024-02-22T00:58:44.596 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:44 smithi049 ceph-mon[132694]: pgmap v656: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 206 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-02-22T00:58:44.596 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:44 smithi049 ceph-mon[132694]: from='client.35206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:44.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:44 smithi161 ceph-mon[113442]: pgmap v656: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 206 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-02-22T00:58:44.786 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:44 smithi161 ceph-mon[113442]: from='client.35206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:44.889 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph orch upgrade status' 2024-02-22T00:58:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.704+0000 7f537cc41700 1 -- 172.21.15.49:0/2082979821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 msgr2=0x7f5378101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.704+0000 7f537cc41700 1 --2- 172.21.15.49:0/2082979821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 0x7f5378101970 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f53600047f0 tx=0x7f5360009cb0).stop 2024-02-22T00:58:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.704+0000 7f537cc41700 1 -- 172.21.15.49:0/2082979821 shutdown_connections 2024-02-22T00:58:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.704+0000 7f537cc41700 1 --2- 172.21.15.49:0/2082979821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 0x7f5378101970 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.704+0000 7f537cc41700 1 --2- 172.21.15.49:0/2082979821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53780f8900 0x7f53780f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.704+0000 7f537cc41700 1 -- 172.21.15.49:0/2082979821 >> 172.21.15.49:0/2082979821 conn(0x7f5378070590 msgr2=0x7f53780f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.704+0000 7f537cc41700 1 -- 172.21.15.49:0/2082979821 shutdown_connections 2024-02-22T00:58:46.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.704+0000 7f537cc41700 1 -- 172.21.15.49:0/2082979821 wait complete. 2024-02-22T00:58:46.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f537cc41700 1 Processor -- start 2024-02-22T00:58:46.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f537cc41700 1 -- start start 2024-02-22T00:58:46.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f537cc41700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53780f8900 0x7f53781102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:46.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f537cc41700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 0x7f53781107a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:46.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f537cc41700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5378110da0 con 0x7f53780f9260 2024-02-22T00:58:46.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f537cc41700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5378110ee0 con 0x7f53780f8900 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f5375d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 0x7f53781107a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f5375d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 0x7f53781107a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45064/0 (socket says 172.21.15.49:45064) 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f5375d9b700 1 -- 172.21.15.49:0/1056116084 learned_addr learned my addr 172.21.15.49:0/1056116084 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f537659c700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53780f8900 0x7f53781102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f5375d9b700 1 -- 172.21.15.49:0/1056116084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53780f8900 msgr2=0x7f53781102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f5375d9b700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53780f8900 0x7f53781102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.705+0000 7f5375d9b700 1 -- 172.21.15.49:0/1056116084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5360005040 con 0x7f53780f9260 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.706+0000 7f5375d9b700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 0x7f53781107a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f5360009380 tx=0x7f5360009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.706+0000 7f536f7fe700 1 -- 172.21.15.49:0/1056116084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f536000e070 con 0x7f53780f9260 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.706+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537810a510 con 0x7f53780f9260 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.706+0000 7f536f7fe700 1 -- 172.21.15.49:0/1056116084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5360007e90 con 0x7f53780f9260 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.706+0000 7f536f7fe700 1 -- 172.21.15.49:0/1056116084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5360018070 con 0x7f53780f9260 2024-02-22T00:58:46.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.706+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537810a9f0 con 0x7f53780f9260 2024-02-22T00:58:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.707+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537805f590 con 0x7f53780f9260 2024-02-22T00:58:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.707+0000 7f536f7fe700 1 -- 172.21.15.49:0/1056116084 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f536001d420 con 0x7f53780f9260 2024-02-22T00:58:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.708+0000 7f536f7fe700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f536406caa0 0x7f536406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:46.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.708+0000 7f536f7fe700 1 -- 172.21.15.49:0/1056116084 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f536008c8e0 con 0x7f53780f9260 2024-02-22T00:58:46.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.708+0000 7f537659c700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f536406caa0 0x7f536406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:46.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.708+0000 7f537659c700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f536406caa0 0x7f536406ef60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f5368004de0 tx=0x7f536800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:46.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.712+0000 7f536f7fe700 1 -- 172.21.15.49:0/1056116084 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f536005a440 con 0x7f53780f9260 2024-02-22T00:58:46.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.927+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f537810b9a0 con 0x7f536406caa0 2024-02-22T00:58:46.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.928+0000 7f536f7fe700 1 -- 172.21.15.49:0/1056116084 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f537810b9a0 con 0x7f536406caa0 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout: "target_image": null, 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout: "in_progress": false, 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout: "which": "", 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout: "services_complete": [], 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout: "progress": null, 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout: "message": "", 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout: "is_paused": false 2024-02-22T00:58:46.923 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f536406caa0 msgr2=0x7f536406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f536406caa0 0x7f536406ef60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f5368004de0 tx=0x7f536800b040).stop 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 msgr2=0x7f53781107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 0x7f53781107a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f5360009380 tx=0x7f5360009cb0).stop 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 shutdown_connections 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f536406caa0 0x7f536406ef60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53780f8900 0x7f53781102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 --2- 172.21.15.49:0/1056116084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53780f9260 0x7f53781107a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 >> 172.21.15.49:0/1056116084 conn(0x7f5378070590 msgr2=0x7f53780f6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 shutdown_connections 2024-02-22T00:58:46.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:46.930+0000 7f537cc41700 1 -- 172.21.15.49:0/1056116084 wait complete. 2024-02-22T00:58:47.262 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:47 smithi049 ceph-mon[132694]: pgmap v657: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 206 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-02-22T00:58:47.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:47 smithi161 ceph-mon[113442]: pgmap v657: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 206 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-02-22T00:58:47.571 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph health detail' 2024-02-22T00:58:48.420 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:48 smithi049 ceph-mon[132694]: from='client.35210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:48.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:48 smithi161 ceph-mon[113442]: from='client.35210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T00:58:49.283 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:49 smithi049 ceph-mon[132694]: pgmap v658: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 9.2 KiB/s wr, 9 op/s 2024-02-22T00:58:49.536 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:49 smithi161 ceph-mon[113442]: pgmap v658: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 9.2 KiB/s wr, 9 op/s 2024-02-22T00:58:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.546+0000 7f9659b51700 1 -- 172.21.15.49:0/484816150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 msgr2=0x7f96540fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.546+0000 7f9659b51700 1 --2- 172.21.15.49:0/484816150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 0x7f96540fcbd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f96440047f0 tx=0x7f9644009cb0).stop 2024-02-22T00:58:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.546+0000 7f9659b51700 1 -- 172.21.15.49:0/484816150 shutdown_connections 2024-02-22T00:58:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.546+0000 7f9659b51700 1 --2- 172.21.15.49:0/484816150 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fd150 0x7f96540f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.546+0000 7f9659b51700 1 --2- 172.21.15.49:0/484816150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fc7f0 0x7f96540fcbd0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.546+0000 7f9659b51700 1 -- 172.21.15.49:0/484816150 >> 172.21.15.49:0/484816150 conn(0x7f9654070590 msgr2=0x7f96540f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.546+0000 7f9659b51700 1 -- 172.21.15.49:0/484816150 shutdown_connections 2024-02-22T00:58:49.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.546+0000 7f9659b51700 1 -- 172.21.15.49:0/484816150 wait complete. 2024-02-22T00:58:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.547+0000 7f9659b51700 1 Processor -- start 2024-02-22T00:58:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.547+0000 7f9659b51700 1 -- start start 2024-02-22T00:58:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.547+0000 7f9659b51700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fc7f0 0x7f965410cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.547+0000 7f9659b51700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 0x7f965410d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.547+0000 7f9659b51700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965410d9f0 con 0x7f96540fd150 2024-02-22T00:58:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.547+0000 7f9659b51700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965410db30 con 0x7f96540fc7f0 2024-02-22T00:58:49.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9652ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 0x7f965410d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9652ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 0x7f965410d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45086/0 (socket says 172.21.15.49:45086) 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9652ffd700 1 -- 172.21.15.49:0/962242217 learned_addr learned my addr 172.21.15.49:0/962242217 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f96537fe700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fc7f0 0x7f965410cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9652ffd700 1 -- 172.21.15.49:0/962242217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fc7f0 msgr2=0x7f965410cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9652ffd700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fc7f0 0x7f965410cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9652ffd700 1 -- 172.21.15.49:0/962242217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644005040 con 0x7f96540fd150 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f96537fe700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fc7f0 0x7f965410cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9652ffd700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 0x7f965410d3f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f963c00ea20 tx=0x7f963c007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9650ff9700 1 -- 172.21.15.49:0/962242217 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f963c00cb90 con 0x7f96540fd150 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9650ff9700 1 -- 172.21.15.49:0/962242217 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f963c00ccf0 con 0x7f96540fd150 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96541071c0 con 0x7f96540fd150 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9650ff9700 1 -- 172.21.15.49:0/962242217 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f963c010630 con 0x7f96540fd150 2024-02-22T00:58:49.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.548+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9654107780 con 0x7f96540fd150 2024-02-22T00:58:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.549+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965405f590 con 0x7f96540fd150 2024-02-22T00:58:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.550+0000 7f9650ff9700 1 -- 172.21.15.49:0/962242217 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f963c011470 con 0x7f96540fd150 2024-02-22T00:58:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.550+0000 7f9650ff9700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964006caa0 0x7f964006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:49.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.551+0000 7f96537fe700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964006caa0 0x7f964006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.551+0000 7f9650ff9700 1 -- 172.21.15.49:0/962242217 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f963c08e5e0 con 0x7f96540fd150 2024-02-22T00:58:49.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.551+0000 7f96537fe700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964006caa0 0x7f964006ef60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f9644007cf0 tx=0x7f964400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:49.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.555+0000 7f9650ff9700 1 -- 172.21.15.49:0/962242217 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f963c05c140 con 0x7f96540fd150 2024-02-22T00:58:49.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.836+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9654047540 con 0x7f96540fd150 2024-02-22T00:58:49.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.836+0000 7f9650ff9700 1 -- 172.21.15.49:0/962242217 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f963c05bcd0 con 0x7f96540fd150 2024-02-22T00:58:49.831 INFO:teuthology.orchestra.run.smithi049.stdout:HEALTH_OK 2024-02-22T00:58:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964006caa0 msgr2=0x7f964006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964006caa0 0x7f964006ef60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f9644007cf0 tx=0x7f964400b040).stop 2024-02-22T00:58:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 msgr2=0x7f965410d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 0x7f965410d3f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f963c00ea20 tx=0x7f963c007f50).stop 2024-02-22T00:58:49.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 shutdown_connections 2024-02-22T00:58:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f964006caa0 0x7f964006ef60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540fc7f0 0x7f965410cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 --2- 172.21.15.49:0/962242217 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96540fd150 0x7f965410d3f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.838+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 >> 172.21.15.49:0/962242217 conn(0x7f9654070590 msgr2=0x7f96540fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.839+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 shutdown_connections 2024-02-22T00:58:49.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:49.839+0000 7f9659b51700 1 -- 172.21.15.49:0/962242217 wait complete. 2024-02-22T00:58:50.420 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:50 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/962242217' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:58:50.479 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph versions' 2024-02-22T00:58:50.536 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:50 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/962242217' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-22T00:58:51.491 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:51 smithi049 ceph-mon[132694]: pgmap v659: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 9.1 KiB/s wr, 8 op/s 2024-02-22T00:58:51.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:51 smithi161 ceph-mon[113442]: pgmap v659: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 9.1 KiB/s wr, 8 op/s 2024-02-22T00:58:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.185+0000 7f81e699b700 1 -- 172.21.15.49:0/3552532822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 msgr2=0x7f81e0101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.185+0000 7f81e699b700 1 --2- 172.21.15.49:0/3552532822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 0x7f81e0101970 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f81d40047f0 tx=0x7f81d4009cb0).stop 2024-02-22T00:58:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.186+0000 7f81e699b700 1 -- 172.21.15.49:0/3552532822 shutdown_connections 2024-02-22T00:58:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.186+0000 7f81e699b700 1 --2- 172.21.15.49:0/3552532822 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 0x7f81e0101970 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.186+0000 7f81e699b700 1 --2- 172.21.15.49:0/3552532822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81e00f8900 0x7f81e00f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T00:58:52.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.186+0000 7f81e699b700 1 -- 172.21.15.49:0/3552532822 >> 172.21.15.49:0/3552532822 conn(0x7f81e0070590 msgr2=0x7f81e00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.186+0000 7f81e699b700 1 -- 172.21.15.49:0/3552532822 shutdown_connections 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.186+0000 7f81e699b700 1 -- 172.21.15.49:0/3552532822 wait complete. 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.186+0000 7f81e699b700 1 Processor -- start 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.186+0000 7f81e699b700 1 -- start start 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81e699b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81e00f8900 0x7f81e00f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81e699b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 0x7f81e00f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81e699b700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00f7290 con 0x7f81e00f9260 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81e699b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00f73d0 con 0x7f81e00f8900 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 0x7f81e00f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81df7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 0x7f81e00f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40392/0 (socket says 172.21.15.49:40392) 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81df7fe700 1 -- 172.21.15.49:0/1143659368 learned_addr learned my addr 172.21.15.49:0/1143659368 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81dffff700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81e00f8900 0x7f81e00f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:52.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81df7fe700 1 -- 172.21.15.49:0/1143659368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81e00f8900 msgr2=0x7f81e00f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81df7fe700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81e00f8900 0x7f81e00f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81df7fe700 1 -- 172.21.15.49:0/1143659368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4005040 con 0x7f81e00f9260 2024-02-22T00:58:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81df7fe700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 0x7f81e00f6da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f81d4009380 tx=0x7f81d4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81dd7fa700 1 -- 172.21.15.49:0/1143659368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d400e030 con 0x7f81e00f9260 2024-02-22T00:58:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81dd7fa700 1 -- 172.21.15.49:0/1143659368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81d4007e90 con 0x7f81e00f9260 2024-02-22T00:58:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e00f7620 con 0x7f81e00f9260 2024-02-22T00:58:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81dd7fa700 1 -- 172.21.15.49:0/1143659368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d4018070 con 0x7f81e00f9260 2024-02-22T00:58:52.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.187+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e0114690 con 0x7f81e00f9260 2024-02-22T00:58:52.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.188+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e005f590 con 0x7f81e00f9260 2024-02-22T00:58:52.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.189+0000 7f81dd7fa700 1 -- 172.21.15.49:0/1143659368 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f81d401d420 con 0x7f81e00f9260 2024-02-22T00:58:52.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.189+0000 7f81dd7fa700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f81c806cab0 0x7f81c806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:58:52.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.189+0000 7f81dd7fa700 1 -- 172.21.15.49:0/1143659368 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f81d408d2e0 con 0x7f81e00f9260 2024-02-22T00:58:52.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.189+0000 7f81dffff700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f81c806cab0 0x7f81c806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:58:52.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.190+0000 7f81dffff700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f81c806cab0 0x7f81c806ef70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f81d0006fd0 tx=0x7f81d0009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:58:52.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.194+0000 7f81dd7fa700 1 -- 172.21.15.49:0/1143659368 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f81d40573b0 con 0x7f81e00f9260 2024-02-22T00:58:52.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.473+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f81e0047540 con 0x7f81e00f9260 2024-02-22T00:58:52.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.474+0000 7f81dd7fa700 1 -- 172.21.15.49:0/1143659368 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f81d405a9d0 con 0x7f81e00f9260 2024-02-22T00:58:52.468 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T00:58:52.468 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T00:58:52.469 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T00:58:52.470 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T00:58:52.470 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T00:58:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f81c806cab0 msgr2=0x7f81c806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f81c806cab0 0x7f81c806ef70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f81d0006fd0 tx=0x7f81d0009060).stop 2024-02-22T00:58:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 msgr2=0x7f81e00f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:58:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 0x7f81e00f6da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f81d4009380 tx=0x7f81d4009cb0).stop 2024-02-22T00:58:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 shutdown_connections 2024-02-22T00:58:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f81c806cab0 0x7f81c806ef70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81e00f8900 0x7f81e00f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:52.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 --2- 172.21.15.49:0/1143659368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f81e00f9260 0x7f81e00f6da0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:58:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 >> 172.21.15.49:0/1143659368 conn(0x7f81e0070590 msgr2=0x7f81e00fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:58:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 shutdown_connections 2024-02-22T00:58:52.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:58:52.476+0000 7f81e699b700 1 -- 172.21.15.49:0/1143659368 wait complete. 2024-02-22T00:58:53.067 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-22T00:58:53.420 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:53 smithi049 ceph-mon[132694]: pgmap v660: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:53.420 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:53 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1143659368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:53.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:53 smithi161 ceph-mon[113442]: pgmap v660: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:53.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:53 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1143659368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T00:58:54.850 INFO:teuthology.orchestra.run.smithi049.stdout:wait for servicemap items w/ changing names to refresh 2024-02-22T00:58:55.340 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:55 smithi049 ceph-mon[132694]: pgmap v661: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:55.342 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'sleep 60' 2024-02-22T00:58:55.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:55 smithi161 ceph-mon[113442]: pgmap v661: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:57.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:57 smithi161 ceph-mon[113442]: pgmap v662: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:57.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:57 smithi049 ceph-mon[132694]: pgmap v662: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:58.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:58.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:58:59.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:58:59 smithi161 ceph-mon[113442]: pgmap v663: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:58:59.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:58:59 smithi049 ceph-mon[132694]: pgmap v663: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:01.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:01 smithi161 ceph-mon[113442]: pgmap v664: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:01.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:01 smithi049 ceph-mon[132694]: pgmap v664: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:03.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:03 smithi161 ceph-mon[113442]: pgmap v665: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:03.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:03 smithi049 ceph-mon[132694]: pgmap v665: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:05.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:05 smithi161 ceph-mon[113442]: pgmap v666: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:05.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:05 smithi049 ceph-mon[132694]: pgmap v666: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:07.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:07 smithi161 ceph-mon[113442]: pgmap v667: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:07.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:07 smithi049 ceph-mon[132694]: pgmap v667: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:09.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:09 smithi161 ceph-mon[113442]: pgmap v668: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:09.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:09 smithi049 ceph-mon[132694]: pgmap v668: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:11.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:11 smithi161 ceph-mon[113442]: pgmap v669: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:11.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:11 smithi049 ceph-mon[132694]: pgmap v669: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:13.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:13 smithi161 ceph-mon[113442]: pgmap v670: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:13.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:59:13.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:13 smithi049 ceph-mon[132694]: pgmap v670: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:13.670 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:59:15.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:15 smithi161 ceph-mon[113442]: pgmap v671: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:15.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:15 smithi049 ceph-mon[132694]: pgmap v671: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:17.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:17 smithi161 ceph-mon[113442]: pgmap v672: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:17.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:17 smithi049 ceph-mon[132694]: pgmap v672: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:19.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:19 smithi161 ceph-mon[113442]: pgmap v673: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:19.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:19 smithi049 ceph-mon[132694]: pgmap v673: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:21.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:21 smithi161 ceph-mon[113442]: pgmap v674: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:21.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:21 smithi049 ceph-mon[132694]: pgmap v674: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:23.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:23 smithi161 ceph-mon[113442]: pgmap v675: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:23.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:23 smithi049 ceph-mon[132694]: pgmap v675: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:25.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:25 smithi161 ceph-mon[113442]: pgmap v676: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:25.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:25 smithi049 ceph-mon[132694]: pgmap v676: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:27.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:27 smithi161 ceph-mon[113442]: pgmap v677: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:27.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:27 smithi049 ceph-mon[132694]: pgmap v677: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:28.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:59:28.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:59:29.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:29 smithi161 ceph-mon[113442]: pgmap v678: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:29.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:29 smithi049 ceph-mon[132694]: pgmap v678: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:31.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:31 smithi161 ceph-mon[113442]: pgmap v679: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:31.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:31 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:59:31.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:31 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:59:31.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:31 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:59:31.535 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:31 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:59:31.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:31 smithi049 ceph-mon[132694]: pgmap v679: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:31.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:31 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T00:59:31.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:31 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T00:59:31.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:31 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T00:59:31.672 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:31 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T00:59:33.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:33 smithi161 ceph-mon[113442]: pgmap v680: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:33.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:33 smithi049 ceph-mon[132694]: pgmap v680: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:35.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:35 smithi161 ceph-mon[113442]: pgmap v681: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:35.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:35 smithi049 ceph-mon[132694]: pgmap v681: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:37.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:37 smithi161 ceph-mon[113442]: pgmap v682: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:37.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:37 smithi049 ceph-mon[132694]: pgmap v682: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:39.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:39 smithi161 ceph-mon[113442]: pgmap v683: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:39.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:39 smithi049 ceph-mon[132694]: pgmap v683: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:41.534 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:41 smithi161 ceph-mon[113442]: pgmap v684: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:41.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:41 smithi049 ceph-mon[132694]: pgmap v684: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:43.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:43 smithi049 ceph-mon[132694]: pgmap v685: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:43.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:59:43.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:43 smithi161 ceph-mon[113442]: pgmap v685: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:43.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:59:45.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:45 smithi049 ceph-mon[132694]: pgmap v686: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:45.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:45 smithi161 ceph-mon[113442]: pgmap v686: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:47.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:47 smithi049 ceph-mon[132694]: pgmap v687: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:47.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:47 smithi161 ceph-mon[113442]: pgmap v687: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:49.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:49 smithi049 ceph-mon[132694]: pgmap v688: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:49.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:49 smithi161 ceph-mon[113442]: pgmap v688: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:51.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:51 smithi049 ceph-mon[132694]: pgmap v689: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:51.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:51 smithi161 ceph-mon[113442]: pgmap v689: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:53.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:53 smithi049 ceph-mon[132694]: pgmap v690: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:53.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:53 smithi161 ceph-mon[113442]: pgmap v690: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:55.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:55 smithi049 ceph-mon[132694]: pgmap v691: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:55.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:55 smithi161 ceph-mon[113442]: pgmap v691: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:57.352 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:57 smithi049 ceph-mon[132694]: pgmap v692: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:57.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph orch ps' 2024-02-22T00:59:57.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:57 smithi161 ceph-mon[113442]: pgmap v692: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:58.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:59:58.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T00:59:59.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.543+0000 7f46edb98700 1 -- 172.21.15.49:0/1951501230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 msgr2=0x7f46e80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.543+0000 7f46edb98700 1 --2- 172.21.15.49:0/1951501230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 0x7f46e80fcbd0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f46d00047f0 tx=0x7f46d0009cb0).stop 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.543+0000 7f46edb98700 1 -- 172.21.15.49:0/1951501230 shutdown_connections 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.543+0000 7f46edb98700 1 --2- 172.21.15.49:0/1951501230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46e80fd150 0x7f46e80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.543+0000 7f46edb98700 1 --2- 172.21.15.49:0/1951501230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 0x7f46e80fcbd0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.543+0000 7f46edb98700 1 -- 172.21.15.49:0/1951501230 >> 172.21.15.49:0/1951501230 conn(0x7f46e8070590 msgr2=0x7f46e80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.543+0000 7f46edb98700 1 -- 172.21.15.49:0/1951501230 shutdown_connections 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.543+0000 7f46edb98700 1 -- 172.21.15.49:0/1951501230 wait complete. 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46edb98700 1 Processor -- start 2024-02-22T00:59:59.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46edb98700 1 -- start start 2024-02-22T00:59:59.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46edb98700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 0x7f46e810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:59:59.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46edb98700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46e80fd150 0x7f46e810e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46edb98700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e810eab0 con 0x7f46e80fc7f0 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46edb98700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e810ebf0 con 0x7f46e80fd150 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46e77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 0x7f46e810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46e77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 0x7f46e810dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35264/0 (socket says 172.21.15.49:35264) 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46e77fe700 1 -- 172.21.15.49:0/2366742637 learned_addr learned my addr 172.21.15.49:0/2366742637 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.544+0000 7f46e6ffd700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46e80fd150 0x7f46e810e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46e77fe700 1 -- 172.21.15.49:0/2366742637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46e80fd150 msgr2=0x7f46e810e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46e77fe700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46e80fd150 0x7f46e810e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46e77fe700 1 -- 172.21.15.49:0/2366742637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d0005040 con 0x7f46e80fc7f0 2024-02-22T00:59:59.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46e77fe700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 0x7f46e810dfc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f46d000b120 tx=0x7f46d0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46e4ff9700 1 -- 172.21.15.49:0/2366742637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d000e030 con 0x7f46e80fc7f0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46e4ff9700 1 -- 172.21.15.49:0/2366742637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f46d0007e90 con 0x7f46e80fc7f0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e8108220 con 0x7f46e80fc7f0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46e4ff9700 1 -- 172.21.15.49:0/2366742637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46d0018070 con 0x7f46e80fc7f0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.545+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e8108780 con 0x7f46e80fc7f0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.546+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e805f590 con 0x7f46e80fc7f0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.546+0000 7f46e4ff9700 1 -- 172.21.15.49:0/2366742637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f46d001d420 con 0x7f46e80fc7f0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.547+0000 7f46e4ff9700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f46d406caa0 0x7f46d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.547+0000 7f46e4ff9700 1 -- 172.21.15.49:0/2366742637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f46d008d1a0 con 0x7f46e80fc7f0 2024-02-22T00:59:59.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.547+0000 7f46e6ffd700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f46d406caa0 0x7f46d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T00:59:59.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.547+0000 7f46e6ffd700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f46d406caa0 0x7f46d406ef60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f46e8109900 tx=0x7f46d8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T00:59:59.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.552+0000 7f46e4ff9700 1 -- 172.21.15.49:0/2366742637 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f46d005ad00 con 0x7f46e80fc7f0 2024-02-22T00:59:59.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 00:59:59 smithi049 ceph-mon[132694]: pgmap v693: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T00:59:59.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.757+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 --> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f46e8108e10 con 0x7f46d406caa0 2024-02-22T00:59:59.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.767+0000 7f46e4ff9700 1 -- 172.21.15.49:0/2366742637 <== mgr.34104 v2:172.21.15.49:6800/982567914 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f46e8108e10 con 0x7f46d406caa0 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:alertmanager.smithi049 smithi049 *:9093,9094 running (23m) 90s ago 34m 28.3M - 0.25.0 c8568f914cd2 fba9b8b8d1d3 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi049 smithi049 running (20m) 90s ago 34m 6647k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 85b75943998b 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:crash.smithi161 smithi161 running (20m) 91s ago 33m 6651k - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c78772858d9 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:grafana.smithi049 smithi049 *:3000 running (22m) 90s ago 34m 91.0M - 9.4.7 954c08fa6188 e399073af3f3 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.rrqshp smithi049 running (17m) 90s ago 29m 99.1M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 fb4b7bb032d5 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi049.vwomak smithi049 running (17m) 90s ago 29m 88.9M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 c5e930d7254d 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.plrhpg smithi161 running (16m) 91s ago 29m 19.4M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 6a0ad666d8db 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:mds.cephfs.smithi161.wycpud smithi161 running (16m) 91s ago 29m 20.2M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 1502efad8675 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi049.rjblpr smithi049 *:8443,9283,8765 running (24m) 90s ago 35m 509M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 93039397d371 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.smithi161.sazlam smithi161 *:8443,9283,8765 running (24m) 91s ago 33m 455M - 18.2.1-638-gc1dc18f4 f643fdc7b9a3 ac52dbd2be89 2024-02-22T00:59:59.760 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi049 smithi049 running (21m) 90s ago 35m 88.5M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 f7281f90682e 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:mon.smithi161 smithi161 running (21m) 91s ago 33m 55.0M 2048M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 e7bd6d48df73 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi049 smithi049 *:9100 running (23m) 90s ago 34m 17.0M - 1.5.0 0da6a335fe13 e3dd6ec8d3bd 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:node-exporter.smithi161 smithi161 *:9100 running (23m) 91s ago 33m 18.1M - 1.5.0 0da6a335fe13 2c9556e08341 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (20m) 90s ago 33m 103M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 d9c71a233046 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi049 running (19m) 90s ago 32m 109M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 b382bd123cdc 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi049 running (19m) 90s ago 32m 92.2M 1910M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 9908da7b4064 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi161 running (18m) 91s ago 31m 142M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 cdd5902896f3 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi161 running (18m) 91s ago 31m 98.2M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 81512caaf4ab 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi161 running (17m) 91s ago 30m 95.9M 2251M 18.2.1-638-gc1dc18f4 f643fdc7b9a3 7c718ce3ecdc 2024-02-22T00:59:59.761 INFO:teuthology.orchestra.run.smithi049.stdout:prometheus.smithi161 smithi161 *:9095 running (23m) 91s ago 33m 74.8M - 2.43.0 a07b618ecd1d 6a09dc6a4eb6 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f46d406caa0 msgr2=0x7f46d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f46d406caa0 0x7f46d406ef60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f46e8109900 tx=0x7f46d8009040).stop 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 msgr2=0x7f46e810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 0x7f46e810dfc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f46d000b120 tx=0x7f46d0009cb0).stop 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 shutdown_connections 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f46d406caa0 0x7f46d406ef60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f46e80fc7f0 0x7f46e810dfc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 --2- 172.21.15.49:0/2366742637 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f46e80fd150 0x7f46e810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T00:59:59.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 >> 172.21.15.49:0/2366742637 conn(0x7f46e8070590 msgr2=0x7f46e8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T00:59:59.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 shutdown_connections 2024-02-22T00:59:59.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T00:59:59.769+0000 7f46edb98700 1 -- 172.21.15.49:0/2366742637 wait complete. 2024-02-22T00:59:59.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 00:59:59 smithi161 ceph-mon[113442]: pgmap v693: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:00.358 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph versions' 2024-02-22T01:00:00.385 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:00 smithi049 ceph-mon[132694]: overall HEALTH_OK 2024-02-22T01:00:00.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:00 smithi161 ceph-mon[113442]: overall HEALTH_OK 2024-02-22T01:00:01.628 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:01 smithi049 ceph-mon[132694]: from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T01:00:01.628 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:01 smithi049 ceph-mon[132694]: pgmap v694: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:01.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:01 smithi161 ceph-mon[113442]: from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T01:00:01.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:01 smithi161 ceph-mon[113442]: pgmap v694: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.155+0000 7f8d8df86700 1 -- 172.21.15.49:0/989362952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f66f0 msgr2=0x7f8d880f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.155+0000 7f8d8df86700 1 --2- 172.21.15.49:0/989362952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f66f0 0x7f8d880f6ad0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f8d78004820 tx=0x7f8d78009cb0).stop 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.155+0000 7f8d8df86700 1 -- 172.21.15.49:0/989362952 shutdown_connections 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.155+0000 7f8d8df86700 1 --2- 172.21.15.49:0/989362952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d880f6fc0 0x7f8d88103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.155+0000 7f8d8df86700 1 --2- 172.21.15.49:0/989362952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f66f0 0x7f8d880f6ad0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.155+0000 7f8d8df86700 1 -- 172.21.15.49:0/989362952 >> 172.21.15.49:0/989362952 conn(0x7f8d88070590 msgr2=0x7f8d880f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.155+0000 7f8d8df86700 1 -- 172.21.15.49:0/989362952 shutdown_connections 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.155+0000 7f8d8df86700 1 -- 172.21.15.49:0/989362952 wait complete. 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.156+0000 7f8d8df86700 1 Processor -- start 2024-02-22T01:00:02.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.156+0000 7f8d8df86700 1 -- start start 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.156+0000 7f8d8df86700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d880f66f0 0x7f8d881102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.156+0000 7f8d8df86700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f6fc0 0x7f8d881107a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.156+0000 7f8d8df86700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88110da0 con 0x7f8d880f6fc0 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.156+0000 7f8d8df86700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88110ee0 con 0x7f8d880f66f0 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.156+0000 7f8d86ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f6fc0 0x7f8d881107a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d86ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f6fc0 0x7f8d881107a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33652/0 (socket says 172.21.15.49:33652) 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d86ffd700 1 -- 172.21.15.49:0/3585125398 learned_addr learned my addr 172.21.15.49:0/3585125398 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d877fe700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d880f66f0 0x7f8d881102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d86ffd700 1 -- 172.21.15.49:0/3585125398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d880f66f0 msgr2=0x7f8d881102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d86ffd700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d880f66f0 0x7f8d881102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d86ffd700 1 -- 172.21.15.49:0/3585125398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d78005040 con 0x7f8d880f6fc0 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d86ffd700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f6fc0 0x7f8d881107a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f8d7c00c740 tx=0x7f8d7c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d84ff9700 1 -- 172.21.15.49:0/3585125398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7c00e680 con 0x7f8d880f6fc0 2024-02-22T01:00:02.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8810a570 con 0x7f8d880f6fc0 2024-02-22T01:00:02.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d84ff9700 1 -- 172.21.15.49:0/3585125398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d7c00ec90 con 0x7f8d880f6fc0 2024-02-22T01:00:02.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d84ff9700 1 -- 172.21.15.49:0/3585125398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7c013d60 con 0x7f8d880f6fc0 2024-02-22T01:00:02.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.157+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8810aab0 con 0x7f8d880f6fc0 2024-02-22T01:00:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.158+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8805f590 con 0x7f8d880f6fc0 2024-02-22T01:00:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.158+0000 7f8d84ff9700 1 -- 172.21.15.49:0/3585125398 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8d7c00e7e0 con 0x7f8d880f6fc0 2024-02-22T01:00:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.159+0000 7f8d84ff9700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d7006caa0 0x7f8d7006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.159+0000 7f8d84ff9700 1 -- 172.21.15.49:0/3585125398 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8d7c08c0a0 con 0x7f8d880f6fc0 2024-02-22T01:00:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.159+0000 7f8d877fe700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d7006caa0 0x7f8d7006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:02.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.159+0000 7f8d877fe700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d7006caa0 0x7f8d7006ef60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8d780043d0 tx=0x7f8d7800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:02.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.164+0000 7f8d84ff9700 1 -- 172.21.15.49:0/3585125398 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8d7c059c00 con 0x7f8d880f6fc0 2024-02-22T01:00:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.445+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d8810b9d0 con 0x7f8d880f6fc0 2024-02-22T01:00:02.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.445+0000 7f8d84ff9700 1 -- 172.21.15.49:0/3585125398 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f8d7c059790 con 0x7f8d880f6fc0 2024-02-22T01:00:02.438 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-02-22T01:00:02.438 INFO:teuthology.orchestra.run.smithi049.stdout: "mon": { 2024-02-22T01:00:02.438 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T01:00:02.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T01:00:02.438 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr": { 2024-02-22T01:00:02.438 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 2 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: "osd": { 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 6 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: "mds": { 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 4 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: "overall": { 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)": 14 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-02-22T01:00:02.439 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-02-22T01:00:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.447+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d7006caa0 msgr2=0x7f8d7006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.447+0000 7f8d8df86700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d7006caa0 0x7f8d7006ef60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8d780043d0 tx=0x7f8d7800b040).stop 2024-02-22T01:00:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.447+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f6fc0 msgr2=0x7f8d881107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.447+0000 7f8d8df86700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f6fc0 0x7f8d881107a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f8d7c00c740 tx=0x7f8d7c007ef0).stop 2024-02-22T01:00:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.448+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 shutdown_connections 2024-02-22T01:00:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.448+0000 7f8d8df86700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d7006caa0 0x7f8d7006ef60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:02.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.448+0000 7f8d8df86700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d880f66f0 0x7f8d881102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:02.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.448+0000 7f8d8df86700 1 --2- 172.21.15.49:0/3585125398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d880f6fc0 0x7f8d881107a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:02.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.448+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 >> 172.21.15.49:0/3585125398 conn(0x7f8d88070590 msgr2=0x7f8d8806d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:02.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.448+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 shutdown_connections 2024-02-22T01:00:02.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:02.448+0000 7f8d8df86700 1 -- 172.21.15.49:0/3585125398 wait complete. 2024-02-22T01:00:03.093 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-22T01:00:03.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:03 smithi049 ceph-mon[132694]: pgmap v695: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:03.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:03 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3585125398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T01:00:03.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:03 smithi161 ceph-mon[113442]: pgmap v695: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:03.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:03 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3585125398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T01:00:04.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.948+0000 7fe91758f700 1 -- 172.21.15.49:0/2686031700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fc7f0 msgr2=0x7fe9100fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:04.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.948+0000 7fe91758f700 1 --2- 172.21.15.49:0/2686031700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fc7f0 0x7fe9100fcbd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fe90c004730 tx=0x7fe90c009cb0).stop 2024-02-22T01:00:04.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.948+0000 7fe91758f700 1 -- 172.21.15.49:0/2686031700 shutdown_connections 2024-02-22T01:00:04.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.948+0000 7fe91758f700 1 --2- 172.21.15.49:0/2686031700 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9100fd150 0x7fe9100f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:04.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.948+0000 7fe91758f700 1 --2- 172.21.15.49:0/2686031700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fc7f0 0x7fe9100fcbd0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:04.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.948+0000 7fe91758f700 1 -- 172.21.15.49:0/2686031700 >> 172.21.15.49:0/2686031700 conn(0x7fe910070590 msgr2=0x7fe9100f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:04.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.948+0000 7fe91758f700 1 -- 172.21.15.49:0/2686031700 shutdown_connections 2024-02-22T01:00:04.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.948+0000 7fe91758f700 1 -- 172.21.15.49:0/2686031700 wait complete. 2024-02-22T01:00:04.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.949+0000 7fe91758f700 1 Processor -- start 2024-02-22T01:00:04.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.949+0000 7fe91758f700 1 -- start start 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.949+0000 7fe91758f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9100fc7f0 0x7fe9100f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.949+0000 7fe91758f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fd150 0x7fe9100f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.949+0000 7fe91758f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100f8f20 con 0x7fe9100fd150 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.949+0000 7fe91758f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100f9060 con 0x7fe9100fc7f0 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.949+0000 7fe914b2a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fd150 0x7fe9100f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.949+0000 7fe914b2a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fd150 0x7fe9100f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33674/0 (socket says 172.21.15.49:33674) 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe914b2a700 1 -- 172.21.15.49:0/1750919816 learned_addr learned my addr 172.21.15.49:0/1750919816 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe91532b700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9100fc7f0 0x7fe9100f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe914b2a700 1 -- 172.21.15.49:0/1750919816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9100fc7f0 msgr2=0x7fe9100f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe914b2a700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9100fc7f0 0x7fe9100f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe914b2a700 1 -- 172.21.15.49:0/1750919816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c005040 con 0x7fe9100fd150 2024-02-22T01:00:04.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe914b2a700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fd150 0x7fe9100f8a30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fe90400e8c0 tx=0x7fe90400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe9027fc700 1 -- 172.21.15.49:0/1750919816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe90400ee60 con 0x7fe9100fd150 2024-02-22T01:00:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe9027fc700 1 -- 172.21.15.49:0/1750919816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe90400f040 con 0x7fe9100fd150 2024-02-22T01:00:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9100f92b0 con 0x7fe9100fd150 2024-02-22T01:00:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe9027fc700 1 -- 172.21.15.49:0/1750919816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe90400c7d0 con 0x7fe9100fd150 2024-02-22T01:00:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.950+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9101147a0 con 0x7fe9100fd150 2024-02-22T01:00:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.951+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91005f590 con 0x7fe9100fd150 2024-02-22T01:00:04.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.952+0000 7fe9027fc700 1 -- 172.21.15.49:0/1750919816 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe904007b40 con 0x7fe9100fd150 2024-02-22T01:00:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.952+0000 7fe9027fc700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe8fc06ca30 0x7fe8fc06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.952+0000 7fe9027fc700 1 -- 172.21.15.49:0/1750919816 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe90408b990 con 0x7fe9100fd150 2024-02-22T01:00:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.952+0000 7fe91532b700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe8fc06ca30 0x7fe8fc06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:04.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.952+0000 7fe91532b700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe8fc06ca30 0x7fe8fc06eef0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fe90c009040 tx=0x7fe90c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:04.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:04.957+0000 7fe9027fc700 1 -- 172.21.15.49:0/1750919816 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe904055a60 con 0x7fe9100fd150 2024-02-22T01:00:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.238+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe9100f9af0 con 0x7fe9100fd150 2024-02-22T01:00:05.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.239+0000 7fe9027fc700 1 -- 172.21.15.49:0/1750919816 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fe904059080 con 0x7fe9100fd150 2024-02-22T01:00:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe8fc06ca30 msgr2=0x7fe8fc06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe8fc06ca30 0x7fe8fc06eef0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fe90c009040 tx=0x7fe90c00b040).stop 2024-02-22T01:00:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fd150 msgr2=0x7fe9100f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fd150 0x7fe9100f8a30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fe90400e8c0 tx=0x7fe90400b040).stop 2024-02-22T01:00:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 shutdown_connections 2024-02-22T01:00:05.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe8fc06ca30 0x7fe8fc06eef0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:05.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe9100fc7f0 0x7fe9100f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:05.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 --2- 172.21.15.49:0/1750919816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe9100fd150 0x7fe9100f8a30 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:05.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 >> 172.21.15.49:0/1750919816 conn(0x7fe910070590 msgr2=0x7fe910060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:05.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 shutdown_connections 2024-02-22T01:00:05.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:05.241+0000 7fe91758f700 1 -- 172.21.15.49:0/1750919816 wait complete. 2024-02-22T01:00:05.243 INFO:teuthology.orchestra.run.smithi049.stdout:true 2024-02-22T01:00:05.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:05 smithi049 ceph-mon[132694]: pgmap v696: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:05.568 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:05 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1750919816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T01:00:05.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:05 smithi161 ceph-mon[113442]: pgmap v696: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:05.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:05 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1750919816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T01:00:05.878 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -e sha1=c1dc18f444603397768fcb7c34a8488b10284df6 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-22T01:00:07.473 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:07 smithi049 ceph-mon[132694]: pgmap v697: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 -- 172.21.15.49:0/90352351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fc7f0 msgr2=0x7f43e40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 --2- 172.21.15.49:0/90352351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fc7f0 0x7f43e40fcbd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f43e00047f0 tx=0x7f43e0009cb0).stop 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 -- 172.21.15.49:0/90352351 shutdown_connections 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 --2- 172.21.15.49:0/90352351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e40fd150 0x7f43e40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 --2- 172.21.15.49:0/90352351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fc7f0 0x7f43e40fcbd0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 -- 172.21.15.49:0/90352351 >> 172.21.15.49:0/90352351 conn(0x7f43e4070590 msgr2=0x7f43e40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 -- 172.21.15.49:0/90352351 shutdown_connections 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 -- 172.21.15.49:0/90352351 wait complete. 2024-02-22T01:00:07.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.706+0000 7f43eb9db700 1 Processor -- start 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43eb9db700 1 -- start start 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43eb9db700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e40fc7f0 0x7f43e40f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43eb9db700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fd150 0x7f43e40f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43eb9db700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40f8f20 con 0x7f43e40fd150 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43eb9db700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40f9060 con 0x7f43e40fc7f0 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e8f76700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fd150 0x7f43e40f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e8f76700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fd150 0x7f43e40f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33688/0 (socket says 172.21.15.49:33688) 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e8f76700 1 -- 172.21.15.49:0/1096090957 learned_addr learned my addr 172.21.15.49:0/1096090957 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e9777700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e40fc7f0 0x7f43e40f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e8f76700 1 -- 172.21.15.49:0/1096090957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e40fc7f0 msgr2=0x7f43e40f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e8f76700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e40fc7f0 0x7f43e40f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e8f76700 1 -- 172.21.15.49:0/1096090957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e0005040 con 0x7f43e40fd150 2024-02-22T01:00:07.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e9777700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e40fc7f0 0x7f43e40f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T01:00:07.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43e8f76700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fd150 0x7f43e40f8a30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f43d40041d0 tx=0x7f43d4009f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:07.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43da7fc700 1 -- 172.21.15.49:0/1096090957 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d4007b40 con 0x7f43e40fd150 2024-02-22T01:00:07.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.707+0000 7f43da7fc700 1 -- 172.21.15.49:0/1096090957 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43d400f040 con 0x7f43e40fd150 2024-02-22T01:00:07.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.708+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e40f9310 con 0x7f43e40fd150 2024-02-22T01:00:07.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.708+0000 7f43da7fc700 1 -- 172.21.15.49:0/1096090957 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43d4013850 con 0x7f43e40fd150 2024-02-22T01:00:07.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.708+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e41146f0 con 0x7f43e40fd150 2024-02-22T01:00:07.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.708+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e405f590 con 0x7f43e40fd150 2024-02-22T01:00:07.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.709+0000 7f43da7fc700 1 -- 172.21.15.49:0/1096090957 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f43d4009110 con 0x7f43e40fd150 2024-02-22T01:00:07.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.710+0000 7f43da7fc700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f43d006cab0 0x7f43d006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:07.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.710+0000 7f43da7fc700 1 -- 172.21.15.49:0/1096090957 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f43d408b650 con 0x7f43e40fd150 2024-02-22T01:00:07.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.710+0000 7f43e9777700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f43d006cab0 0x7f43d006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:07.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.710+0000 7f43e9777700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f43d006cab0 0x7f43d006ef70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f43e0004540 tx=0x7f43e0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:07.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:07.714+0000 7f43da7fc700 1 -- 172.21.15.49:0/1096090957 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f43d40557a0 con 0x7f43e40fd150 2024-02-22T01:00:07.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:07 smithi161 ceph-mon[113442]: pgmap v697: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:07.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.002+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f43e4114db0 con 0x7f43e40fd150 2024-02-22T01:00:07.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.002+0000 7f43da7fc700 1 -- 172.21.15.49:0/1096090957 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f43d4058dc0 con 0x7f43e40fd150 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f43d006cab0 msgr2=0x7f43d006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f43d006cab0 0x7f43d006ef70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f43e0004540 tx=0x7f43e0009cb0).stop 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fd150 msgr2=0x7f43e40f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fd150 0x7f43e40f8a30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f43d40041d0 tx=0x7f43d4009f40).stop 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 shutdown_connections 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f43d006cab0 0x7f43d006ef70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e40fc7f0 0x7f43e40f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 --2- 172.21.15.49:0/1096090957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43e40fd150 0x7f43e40f8a30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 >> 172.21.15.49:0/1096090957 conn(0x7f43e4070590 msgr2=0x7f43e4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.004+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 shutdown_connections 2024-02-22T01:00:07.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:08.005+0000 7f43eb9db700 1 -- 172.21.15.49:0/1096090957 wait complete. 2024-02-22T01:00:08.007 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph version 18.2.1-638-gc1dc18f4 (c1dc18f444603397768fcb7c34a8488b10284df6) reef (stable)" 2024-02-22T01:00:08.629 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:08 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1096090957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T01:00:08.651 DEBUG:teuthology.parallel:result is None 2024-02-22T01:00:08.652 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T01:00:08.667 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T01:00:08.667 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9923b37e-d118-11ee-95bd-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-22T01:00:08.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:08 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1096090957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T01:00:09.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:09 smithi049 ceph-mon[132694]: pgmap v698: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:09.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:09 smithi161 ceph-mon[113442]: pgmap v698: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:10.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.528+0000 7f2f579e1700 1 -- 172.21.15.49:0/865001767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fc7f0 msgr2=0x7f2f500fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:10.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.528+0000 7f2f579e1700 1 --2- 172.21.15.49:0/865001767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fc7f0 0x7f2f500fcbd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f2f4c0047f0 tx=0x7f2f4c009cb0).stop 2024-02-22T01:00:10.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.529+0000 7f2f579e1700 1 -- 172.21.15.49:0/865001767 shutdown_connections 2024-02-22T01:00:10.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.529+0000 7f2f579e1700 1 --2- 172.21.15.49:0/865001767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f500fd150 0x7f2f500f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:10.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.529+0000 7f2f579e1700 1 --2- 172.21.15.49:0/865001767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fc7f0 0x7f2f500fcbd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:10.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.529+0000 7f2f579e1700 1 -- 172.21.15.49:0/865001767 >> 172.21.15.49:0/865001767 conn(0x7f2f50070590 msgr2=0x7f2f500f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:10.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.529+0000 7f2f579e1700 1 -- 172.21.15.49:0/865001767 shutdown_connections 2024-02-22T01:00:10.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.529+0000 7f2f579e1700 1 -- 172.21.15.49:0/865001767 wait complete. 2024-02-22T01:00:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.529+0000 7f2f579e1700 1 Processor -- start 2024-02-22T01:00:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f579e1700 1 -- start start 2024-02-22T01:00:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f579e1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f500fc7f0 0x7f2f5010cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f579e1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fd150 0x7f2f5010d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f579e1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5010daf0 con 0x7f2f500fd150 2024-02-22T01:00:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f579e1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50107110 con 0x7f2f500fc7f0 2024-02-22T01:00:10.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f54f7c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fd150 0x7f2f5010d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f54f7c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fd150 0x7f2f5010d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33708/0 (socket says 172.21.15.49:33708) 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f54f7c700 1 -- 172.21.15.49:0/1807920505 learned_addr learned my addr 172.21.15.49:0/1807920505 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f5577d700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f500fc7f0 0x7f2f5010cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f54f7c700 1 -- 172.21.15.49:0/1807920505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f500fc7f0 msgr2=0x7f2f5010cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f54f7c700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f500fc7f0 0x7f2f5010cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f54f7c700 1 -- 172.21.15.49:0/1807920505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c005040 con 0x7f2f500fd150 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f5577d700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f500fc7f0 0x7f2f5010cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.530+0000 7f2f54f7c700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fd150 0x7f2f5010d460 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f2f4000b480 tx=0x7f2f400090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.531+0000 7f2f467fc700 1 -- 172.21.15.49:0/1807920505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f40002500 con 0x7f2f500fd150 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.531+0000 7f2f467fc700 1 -- 172.21.15.49:0/1807920505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f40002b10 con 0x7f2f500fd150 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.531+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f501073c0 con 0x7f2f500fd150 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.531+0000 7f2f467fc700 1 -- 172.21.15.49:0/1807920505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f40012c90 con 0x7f2f500fd150 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.531+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f50107900 con 0x7f2f500fd150 2024-02-22T01:00:10.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.532+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5005f590 con 0x7f2f500fd150 2024-02-22T01:00:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.532+0000 7f2f467fc700 1 -- 172.21.15.49:0/1807920505 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2f40002660 con 0x7f2f500fd150 2024-02-22T01:00:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.533+0000 7f2f467fc700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f3c06caa0 0x7f2f3c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.533+0000 7f2f467fc700 1 -- 172.21.15.49:0/1807920505 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2f4008bf00 con 0x7f2f500fd150 2024-02-22T01:00:10.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.533+0000 7f2f5577d700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f3c06caa0 0x7f2f3c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:10.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.533+0000 7f2f5577d700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f3c06caa0 0x7f2f3c06ef60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f2f4c0043d0 tx=0x7f2f4c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:10.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.537+0000 7f2f467fc700 1 -- 172.21.15.49:0/1807920505 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2f400599a0 con 0x7f2f500fd150 2024-02-22T01:00:10.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.780+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2f501085f0 con 0x7f2f500fd150 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.780+0000 7f2f467fc700 1 -- 172.21.15.49:0/1807920505 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1862 (secure 0 0 0) 0x7f2f40059530 con 0x7f2f500fd150 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:e33 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 33 2024-02-22T01:00:10.773 INFO:teuthology.orchestra.run.smithi049.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-02-22T00:30:38.229820+0000 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-02-22T00:58:35.474586+0000 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 60 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 80 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 2 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=34378,1=34382} 2024-02-22T01:00:10.774 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 1 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.vwomak{0:34378} state up:active seq 244 join_fscid=1 addr [v2:172.21.15.49:6826/2292918873,v1:172.21.15.49:6827/2292918873] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi049.rrqshp{1:34382} state up:active seq 240 join_fscid=1 addr [v2:172.21.15.49:6828/1528771222,v1:172.21.15.49:6829/1528771222] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:10.775 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.wycpud{-1:44331} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6824/1420583505,v1:172.21.15.161:6825/1420583505] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T01:00:10.776 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.cephfs.smithi161.plrhpg{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.161:6826/1231559763,v1:172.21.15.161:6827/1231559763] compat {c=[1],r=[1],i=[7ff]}] 2024-02-22T01:00:10.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f3c06caa0 msgr2=0x7f2f3c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:10.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f3c06caa0 0x7f2f3c06ef60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f2f4c0043d0 tx=0x7f2f4c00b040).stop 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fd150 msgr2=0x7f2f5010d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fd150 0x7f2f5010d460 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f2f4000b480 tx=0x7f2f400090f0).stop 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 shutdown_connections 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2f3c06caa0 0x7f2f3c06ef60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f500fc7f0 0x7f2f5010cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 --2- 172.21.15.49:0/1807920505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2f500fd150 0x7f2f5010d460 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 >> 172.21.15.49:0/1807920505 conn(0x7f2f50070590 msgr2=0x7f2f500fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 shutdown_connections 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:10.782+0000 7f2f579e1700 1 -- 172.21.15.49:0/1807920505 wait complete. 2024-02-22T01:00:10.777 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 33 2024-02-22T01:00:11.394 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:11 smithi049 ceph-mon[132694]: pgmap v699: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:11.394 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:11 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1807920505' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T01:00:11.415 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-22T01:00:11.427 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-22T01:00:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.559+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/2038952086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fd090 msgr2=0x7f2a680f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.559+0000 7f2a6f7c1700 1 --2- 172.21.15.49:0/2038952086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fd090 0x7f2a680f6870 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f2a640047f0 tx=0x7f2a64009cb0).stop 2024-02-22T01:00:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.559+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/2038952086 shutdown_connections 2024-02-22T01:00:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.559+0000 7f2a6f7c1700 1 --2- 172.21.15.49:0/2038952086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fd090 0x7f2a680f6870 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.559+0000 7f2a6f7c1700 1 --2- 172.21.15.49:0/2038952086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a680fc730 0x7f2a680fcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.559+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/2038952086 >> 172.21.15.49:0/2038952086 conn(0x7f2a6806c760 msgr2=0x7f2a6806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.559+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/2038952086 shutdown_connections 2024-02-22T01:00:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.559+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/2038952086 wait complete. 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.560+0000 7f2a6f7c1700 1 Processor -- start 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.560+0000 7f2a6f7c1700 1 -- start start 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.560+0000 7f2a6f7c1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fc730 0x7f2a6810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.560+0000 7f2a6f7c1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a680fd090 0x7f2a6810e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.560+0000 7f2a6f7c1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6810ea60 con 0x7f2a680fc730 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.560+0000 7f2a6f7c1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6810eba0 con 0x7f2a680fd090 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.560+0000 7f2a6d55d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fc730 0x7f2a6810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.560+0000 7f2a6d55d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fc730 0x7f2a6810df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53248/0 (socket says 172.21.15.49:53248) 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a6d55d700 1 -- 172.21.15.49:0/748684024 learned_addr learned my addr 172.21.15.49:0/748684024 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a6cd5c700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a680fd090 0x7f2a6810e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a6d55d700 1 -- 172.21.15.49:0/748684024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a680fd090 msgr2=0x7f2a6810e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a6d55d700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a680fd090 0x7f2a6810e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a6d55d700 1 -- 172.21.15.49:0/748684024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64005040 con 0x7f2a680fc730 2024-02-22T01:00:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a6d55d700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fc730 0x7f2a6810df70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f2a5800c790 tx=0x7f2a58004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a5e7fc700 1 -- 172.21.15.49:0/748684024 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a580106f0 con 0x7f2a680fc730 2024-02-22T01:00:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a5e7fc700 1 -- 172.21.15.49:0/748684024 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a58010d00 con 0x7f2a680fc730 2024-02-22T01:00:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a68108230 con 0x7f2a680fc730 2024-02-22T01:00:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a5e7fc700 1 -- 172.21.15.49:0/748684024 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a58012da0 con 0x7f2a680fc730 2024-02-22T01:00:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.561+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a68108770 con 0x7f2a680fc730 2024-02-22T01:00:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.562+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6805f380 con 0x7f2a680fc730 2024-02-22T01:00:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.562+0000 7f2a5e7fc700 1 -- 172.21.15.49:0/748684024 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2a58012400 con 0x7f2a680fc730 2024-02-22T01:00:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.563+0000 7f2a5e7fc700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2a5406caa0 0x7f2a5406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.563+0000 7f2a5e7fc700 1 -- 172.21.15.49:0/748684024 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2a5808b6a0 con 0x7f2a680fc730 2024-02-22T01:00:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.563+0000 7f2a6cd5c700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2a5406caa0 0x7f2a5406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.563+0000 7f2a6cd5c700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2a5406caa0 0x7f2a5406ef60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f2a64004f10 tx=0x7f2a6400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.567+0000 7f2a5e7fc700 1 -- 172.21.15.49:0/748684024 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2a58059200 con 0x7f2a680fc730 2024-02-22T01:00:11.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.769+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a6805eec0 con 0x7f2a680fc730 2024-02-22T01:00:11.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.770+0000 7f2a5e7fc700 1 -- 172.21.15.49:0/748684024 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16137 (secure 0 0 0) 0x7f2a58058d90 con 0x7f2a680fc730 2024-02-22T01:00:11.763 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:11.763 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","created":"2024-02-22T00:24:07.498307+0000","modified":"2024-02-22T00:43:17.221392+0000","last_up_change":"2024-02-22T00:42:21.961319+0000","last_in_change":"2024-02-22T00:29:00.339229+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-22T00:28:03.647916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-22T00:30:37.161023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-22T00:30:37.647309+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14701491-880b-4aa8-b29c-2f93fad67550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6803","nonce":2349267451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6805","nonce":2349267451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6809","nonce":2349267451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6807","nonce":2349267451}]},"public_addr":"172.21.15.49:6803/2349267451","cluster_addr":"172.21.15.49:6805/2349267451","heartbeat_back_addr":"172.21.15.49:6809/2349267451","heartbeat_front_addr":"172.21.15.49:6807/2349267451","state":["exists","up"]},{"osd":1,"uuid":"6a984f0c-ab4d-4881-baf7-7821af596292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6811","nonce":3701332011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6813","nonce":3701332011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6817","nonce":3701332011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6815","nonce":3701332011}]},"public_addr":"172.21.15.49:6811/3701332011","cluster_addr":"172.21.15.49:6813/3701332011","heartbeat_back_addr":"172.21.15.49:6817/3701332011","heartbeat_front_addr":"172.21.15.49:6815/3701332011","state":["exists","up"]},{"osd":2,"uuid":"fdbc04fa-88df-4bd8-9272-38e17a0ddc99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6819","nonce":4257132266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6821","nonce":4257132266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6825","nonce":4257132266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6823","nonce":4257132266}]},"public_addr":"172.21.15.49:6819/4257132266","cluster_addr":"172.21.15.49:6821/4257132266","heartbeat_back_addr":"172.21.15.49:6825/4257132266","heartbeat_front_addr":"172.21.15.49:6823/4257132266","state":["exists","up"]},{"osd":3,"uuid":"b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6801","nonce":4220305275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6803","nonce":4220305275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6807","nonce":4220305275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6805","nonce":4220305275}]},"public_addr":"172.21.15.161:6801/4220305275","cluster_addr":"172.21.15.161:6803/4220305275","heartbeat_back_addr":"172.21.15.161:6807/4220305275","heartbeat_front_addr":"172.21.15.161:6805/4220305275","state":["exists","up"]},{"osd":4,"uuid":"a017d7c9-0283-4fe1-8839-1ccbdbd95972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6809","nonce":520056397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6811","nonce":520056397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6815","nonce":520056397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6813","nonce":520056397}]},"public_addr":"172.21.15.161:6809/520056397","cluster_addr":"172.21.15.161:6811/520056397","heartbeat_back_addr":"172.21.15.161:6815/520056397","heartbeat_front_addr":"172.21.15.161:6813/520056397","state":["exists","up"]},{"osd":5,"uuid":"3f97d2c3-52e0-490a-a7ec-d989884f03a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6817","nonce":3112518053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6819","nonce":3112518053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6823","nonce":3112518053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6821","nonce":3112518053}]},"public_addr":"172.21.15.161:6817/3112518053","cluster_addr":"172.21.15.161:6819/3112518053","heartbeat_back_addr":"172.21.15.161:6823/3112518053","heartbeat_front_addr":"172.21.15.161:6821/3112518053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:26:57.942621+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:27:33.707227+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:01.399431+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:25.246971+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:51.257793+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:29:17.568705+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6825/1178849707":"2024-02-23T00:42:24.206575+0000","172.21.15.161:6824/1178849707":"2024-02-23T00:42:24.206575+0000","172.21.15.49:6826/502304157":"2024-02-23T00:42:24.206557+0000","172.21.15.49:6801/825337018":"2024-02-23T00:38:12.296162+0000","172.21.15.49:0/1275556630":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6801/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/825337018":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6800/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/4010391313":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6801/3085400794":"2024-02-23T00:32:49.737110+0000","172.21.15.49:0/3181714365":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6801/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/3235067899":"2024-02-23T00:38:12.296162+0000","172.21.15.49:0/1848258748":"2024-02-23T00:32:49.737110+0000","172.21.15.161:0/579221873":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6800/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.161:6829/2756597363":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6801/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6800/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/1567499828":"2024-02-23T00:26:01.748034+0000","172.21.15.161:0/1226666066":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/11441843":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6800/3085400794":"2024-02-23T00:32:49.737110+0000","172.21.15.49:0/3432989727":"2024-02-23T00:32:49.737110+0000","172.21.15.161:0/1507012470":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/1752326277":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/2319195782":"2024-02-23T00:25:10.135002+0000","172.21.15.161:0/401498250":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6827/502304157":"2024-02-23T00:42:24.206557+0000","172.21.15.49:0/4194533393":"2024-02-23T00:24:40.044887+0000","172.21.15.161:6828/2756597363":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/755765908":"2024-02-23T00:25:10.135002+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-22T01:00:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.772+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2a5406caa0 msgr2=0x7f2a5406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.772+0000 7f2a6f7c1700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2a5406caa0 0x7f2a5406ef60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f2a64004f10 tx=0x7f2a6400b040).stop 2024-02-22T01:00:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fc730 msgr2=0x7f2a6810df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fc730 0x7f2a6810df70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f2a5800c790 tx=0x7f2a58004330).stop 2024-02-22T01:00:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 shutdown_connections 2024-02-22T01:00:11.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f2a5406caa0 0x7f2a5406ef60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a680fc730 0x7f2a6810df70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 --2- 172.21.15.49:0/748684024 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a680fd090 0x7f2a6810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 >> 172.21.15.49:0/748684024 conn(0x7f2a6806c760 msgr2=0x7f2a68060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 shutdown_connections 2024-02-22T01:00:11.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.773+0000 7f2a6f7c1700 1 -- 172.21.15.49:0/748684024 wait complete. 2024-02-22T01:00:11.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-22T00:28:03.647916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-22T00:30:37.161023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-22T00:30:37.647309+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-22T01:00:11.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-22T01:00:11.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:11 smithi161 ceph-mon[113442]: pgmap v699: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:11.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:11 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1807920505' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-22T01:00:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.910+0000 7f5fdfa69700 1 -- 172.21.15.49:0/2269574134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f89f0 msgr2=0x7f5fd80f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.910+0000 7f5fdfa69700 1 --2- 172.21.15.49:0/2269574134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f89f0 0x7f5fd80f8dd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f5fd40047f0 tx=0x7f5fd4009cb0).stop 2024-02-22T01:00:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.911+0000 7f5fdfa69700 1 -- 172.21.15.49:0/2269574134 shutdown_connections 2024-02-22T01:00:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.911+0000 7f5fdfa69700 1 --2- 172.21.15.49:0/2269574134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd80f92c0 0x7f5fd8101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.911+0000 7f5fdfa69700 1 --2- 172.21.15.49:0/2269574134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f89f0 0x7f5fd80f8dd0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.911+0000 7f5fdfa69700 1 -- 172.21.15.49:0/2269574134 >> 172.21.15.49:0/2269574134 conn(0x7f5fd806c760 msgr2=0x7f5fd806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.911+0000 7f5fdfa69700 1 -- 172.21.15.49:0/2269574134 shutdown_connections 2024-02-22T01:00:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.911+0000 7f5fdfa69700 1 -- 172.21.15.49:0/2269574134 wait complete. 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.911+0000 7f5fdfa69700 1 Processor -- start 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdfa69700 1 -- start start 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdfa69700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd80f89f0 0x7f5fd810e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdfa69700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f92c0 0x7f5fd810e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdfa69700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd810ebf0 con 0x7f5fd80f92c0 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdfa69700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd810ed30 con 0x7f5fd80f89f0 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd004700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f92c0 0x7f5fd810e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd004700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f92c0 0x7f5fd810e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53278/0 (socket says 172.21.15.49:53278) 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd004700 1 -- 172.21.15.49:0/452110372 learned_addr learned my addr 172.21.15.49:0/452110372 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd805700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd80f89f0 0x7f5fd810e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd004700 1 -- 172.21.15.49:0/452110372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd80f89f0 msgr2=0x7f5fd810e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd004700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd80f89f0 0x7f5fd810e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd004700 1 -- 172.21.15.49:0/452110372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd4005040 con 0x7f5fd80f92c0 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd805700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd80f89f0 0x7f5fd810e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.912+0000 7f5fdd004700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f92c0 0x7f5fd810e5f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f5fcc00e910 tx=0x7f5fcc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.913+0000 7f5fcaf78700 1 -- 172.21.15.49:0/452110372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fcc00eeb0 con 0x7f5fd80f92c0 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.913+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd8108360 con 0x7f5fd80f92c0 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.913+0000 7f5fcaf78700 1 -- 172.21.15.49:0/452110372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5fcc00f040 con 0x7f5fd80f92c0 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.913+0000 7f5fcaf78700 1 -- 172.21.15.49:0/452110372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fcc00c8a0 con 0x7f5fd80f92c0 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.913+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd81088a0 con 0x7f5fd80f92c0 2024-02-22T01:00:11.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.914+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd805f380 con 0x7f5fd80f92c0 2024-02-22T01:00:11.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.914+0000 7f5fcaf78700 1 -- 172.21.15.49:0/452110372 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5fcc0090d0 con 0x7f5fd80f92c0 2024-02-22T01:00:11.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.915+0000 7f5fcaf78700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5fc406caf0 0x7f5fc406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:11.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.915+0000 7f5fcaf78700 1 -- 172.21.15.49:0/452110372 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5fcc08b930 con 0x7f5fd80f92c0 2024-02-22T01:00:11.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.915+0000 7f5fdd805700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5fc406caf0 0x7f5fc406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:11.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.915+0000 7f5fdd805700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5fc406caf0 0x7f5fc406efb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f5fd4004e60 tx=0x7f5fd400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:11.919+0000 7f5fcaf78700 1 -- 172.21.15.49:0/452110372 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5fcc0593d0 con 0x7f5fd80f92c0 2024-02-22T01:00:12.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.118+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fd81097b0 con 0x7f5fd80f92c0 2024-02-22T01:00:12.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.118+0000 7f5fcaf78700 1 -- 172.21.15.49:0/452110372 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fcc058f60 con 0x7f5fd80f92c0 2024-02-22T01:00:12.111 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5fc406caf0 msgr2=0x7f5fc406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5fc406caf0 0x7f5fc406efb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f5fd4004e60 tx=0x7f5fd400b040).stop 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f92c0 msgr2=0x7f5fd810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f92c0 0x7f5fd810e5f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f5fcc00e910 tx=0x7f5fcc00b040).stop 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 shutdown_connections 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f5fc406caf0 0x7f5fc406efb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5fd80f89f0 0x7f5fd810e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 --2- 172.21.15.49:0/452110372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5fd80f92c0 0x7f5fd810e5f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 >> 172.21.15.49:0/452110372 conn(0x7f5fd806c760 msgr2=0x7f5fd8100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 shutdown_connections 2024-02-22T01:00:12.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.120+0000 7f5fdfa69700 1 -- 172.21.15.49:0/452110372 wait complete. 2024-02-22T01:00:12.125 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-22T01:00:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.256+0000 7fab28394700 1 -- 172.21.15.49:0/2548452665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 msgr2=0x7fab200f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.256+0000 7fab28394700 1 --2- 172.21.15.49:0/2548452665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 0x7fab200f6b20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fab140047f0 tx=0x7fab14009cb0).stop 2024-02-22T01:00:12.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.256+0000 7fab28394700 1 -- 172.21.15.49:0/2548452665 shutdown_connections 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.256+0000 7fab28394700 1 --2- 172.21.15.49:0/2548452665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 0x7fab200f6b20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.256+0000 7fab28394700 1 --2- 172.21.15.49:0/2548452665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab200fca00 0x7fab200fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.256+0000 7fab28394700 1 -- 172.21.15.49:0/2548452665 >> 172.21.15.49:0/2548452665 conn(0x7fab200f2580 msgr2=0x7fab200f49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.256+0000 7fab28394700 1 -- 172.21.15.49:0/2548452665 shutdown_connections 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.256+0000 7fab28394700 1 -- 172.21.15.49:0/2548452665 wait complete. 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab28394700 1 Processor -- start 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab28394700 1 -- start start 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab28394700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab200fca00 0x7fab20110480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab28394700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 0x7fab20110970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab28394700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20111000 con 0x7fab200fd360 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab28394700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2010a620 con 0x7fab200fca00 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab2592f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 0x7fab20110970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab2592f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 0x7fab20110970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53284/0 (socket says 172.21.15.49:53284) 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab2592f700 1 -- 172.21.15.49:0/3889365471 learned_addr learned my addr 172.21.15.49:0/3889365471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:12.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab26130700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab200fca00 0x7fab20110480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab2592f700 1 -- 172.21.15.49:0/3889365471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab200fca00 msgr2=0x7fab20110480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab2592f700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab200fca00 0x7fab20110480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab2592f700 1 -- 172.21.15.49:0/3889365471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14005040 con 0x7fab200fd360 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab26130700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab200fca00 0x7fab20110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.257+0000 7fab2592f700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 0x7fab20110970 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fab1400b120 tx=0x7fab14009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.258+0000 7fab137fe700 1 -- 172.21.15.49:0/3889365471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab1400e030 con 0x7fab200fd360 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.258+0000 7fab137fe700 1 -- 172.21.15.49:0/3889365471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab14007e90 con 0x7fab200fd360 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.258+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2010a8a0 con 0x7fab200fd360 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.258+0000 7fab137fe700 1 -- 172.21.15.49:0/3889365471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab14018070 con 0x7fab200fd360 2024-02-22T01:00:12.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.258+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2010ad80 con 0x7fab200fd360 2024-02-22T01:00:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.259+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab20060410 con 0x7fab200fd360 2024-02-22T01:00:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.259+0000 7fab137fe700 1 -- 172.21.15.49:0/3889365471 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fab14009640 con 0x7fab200fd360 2024-02-22T01:00:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.259+0000 7fab137fe700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fab0c06caa0 0x7fab0c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.260+0000 7fab137fe700 1 -- 172.21.15.49:0/3889365471 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fab1408d1c0 con 0x7fab200fd360 2024-02-22T01:00:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.260+0000 7fab26130700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fab0c06caa0 0x7fab0c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:12.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.260+0000 7fab26130700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fab0c06caa0 0x7fab0c06ef60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fab1c00a900 tx=0x7fab1c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:12.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.264+0000 7fab137fe700 1 -- 172.21.15.49:0/3889365471 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fab1405ad20 con 0x7fab200fd360 2024-02-22T01:00:12.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:12 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/748684024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T01:00:12.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:12 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/452110372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-22T01:00:12.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.465+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fab2005f0f0 con 0x7fab200fd360 2024-02-22T01:00:12.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.465+0000 7fab137fe700 1 -- 172.21.15.49:0/3889365471 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fab1405a8b0 con 0x7fab200fd360 2024-02-22T01:00:12.458 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-02-22T01:00:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fab0c06caa0 msgr2=0x7fab0c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fab0c06caa0 0x7fab0c06ef60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fab1c00a900 tx=0x7fab1c008040).stop 2024-02-22T01:00:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 msgr2=0x7fab20110970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 0x7fab20110970 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fab1400b120 tx=0x7fab14009cb0).stop 2024-02-22T01:00:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 shutdown_connections 2024-02-22T01:00:12.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fab0c06caa0 0x7fab0c06ef60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab200fca00 0x7fab20110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 --2- 172.21.15.49:0/3889365471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fab200fd360 0x7fab20110970 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 >> 172.21.15.49:0/3889365471 conn(0x7fab200f2580 msgr2=0x7fab20061440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 shutdown_connections 2024-02-22T01:00:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.468+0000 7fab28394700 1 -- 172.21.15.49:0/3889365471 wait complete. 2024-02-22T01:00:12.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-22T01:00:12.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.604+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3097179500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f89f0 msgr2=0x7f22b40f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.604+0000 7f22bc0ec700 1 --2- 172.21.15.49:0/3097179500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f89f0 0x7f22b40f8dd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f22a80047f0 tx=0x7f22a8009cb0).stop 2024-02-22T01:00:12.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.604+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3097179500 shutdown_connections 2024-02-22T01:00:12.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.604+0000 7f22bc0ec700 1 --2- 172.21.15.49:0/3097179500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b40f92c0 0x7f22b4101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.604+0000 7f22bc0ec700 1 --2- 172.21.15.49:0/3097179500 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f89f0 0x7f22b40f8dd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.604+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3097179500 >> 172.21.15.49:0/3097179500 conn(0x7f22b406c760 msgr2=0x7f22b406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.604+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3097179500 shutdown_connections 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.604+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3097179500 wait complete. 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22bc0ec700 1 Processor -- start 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22bc0ec700 1 -- start start 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22bc0ec700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b40f89f0 0x7f22b410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22bc0ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f92c0 0x7f22b410e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22bc0ec700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b410eac0 con 0x7f22b40f92c0 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22bc0ec700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b410ec00 con 0x7f22b40f89f0 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22b9687700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f92c0 0x7f22b410e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22b9687700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f92c0 0x7f22b410e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53298/0 (socket says 172.21.15.49:53298) 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22b9687700 1 -- 172.21.15.49:0/3182874148 learned_addr learned my addr 172.21.15.49:0/3182874148 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22b9687700 1 -- 172.21.15.49:0/3182874148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b40f89f0 msgr2=0x7f22b410dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22b9687700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b40f89f0 0x7f22b410dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:12.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22b9687700 1 -- 172.21.15.49:0/3182874148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8005040 con 0x7f22b40f92c0 2024-02-22T01:00:12.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.605+0000 7f22b9687700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f92c0 0x7f22b410e4c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f22b00041d0 tx=0x7f22b0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:12.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.606+0000 7f22a6ffd700 1 -- 172.21.15.49:0/3182874148 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22b0002d90 con 0x7f22b40f92c0 2024-02-22T01:00:12.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.606+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b4108290 con 0x7f22b40f92c0 2024-02-22T01:00:12.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.606+0000 7f22a6ffd700 1 -- 172.21.15.49:0/3182874148 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f22b000f040 con 0x7f22b40f92c0 2024-02-22T01:00:12.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.606+0000 7f22a6ffd700 1 -- 172.21.15.49:0/3182874148 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22b000d800 con 0x7f22b40f92c0 2024-02-22T01:00:12.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.606+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b41087d0 con 0x7f22b40f92c0 2024-02-22T01:00:12.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.607+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b405f380 con 0x7f22b40f92c0 2024-02-22T01:00:12.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.607+0000 7f22a6ffd700 1 -- 172.21.15.49:0/3182874148 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f22b000dac0 con 0x7f22b40f92c0 2024-02-22T01:00:12.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.608+0000 7f22a6ffd700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f22a006caa0 0x7f22a006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.608+0000 7f22a6ffd700 1 -- 172.21.15.49:0/3182874148 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f22b008beb0 con 0x7f22b40f92c0 2024-02-22T01:00:12.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.608+0000 7f22b9e88700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f22a006caa0 0x7f22a006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:12.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.608+0000 7f22b9e88700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f22a006caa0 0x7f22a006ef60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f22a80047f0 tx=0x7f22a8009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:12.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.612+0000 7f22a6ffd700 1 -- 172.21.15.49:0/3182874148 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f22b0059950 con 0x7f22b40f92c0 2024-02-22T01:00:12.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:12 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/748684024' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T01:00:12.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:12 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/452110372' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-22T01:00:12.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.810+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f22b405eec0 con 0x7f22b40f92c0 2024-02-22T01:00:12.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.811+0000 7f22a6ffd700 1 -- 172.21.15.49:0/3182874148 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f22b405eec0 con 0x7f22b40f92c0 2024-02-22T01:00:12.803 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-02-22T01:00:12.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f22a006caa0 msgr2=0x7f22a006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f22a006caa0 0x7f22a006ef60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f22a80047f0 tx=0x7f22a8009cb0).stop 2024-02-22T01:00:12.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f92c0 msgr2=0x7f22b410e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f92c0 0x7f22b410e4c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f22b00041d0 tx=0x7f22b0009f60).stop 2024-02-22T01:00:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 shutdown_connections 2024-02-22T01:00:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f22a006caa0 0x7f22a006ef60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b40f89f0 0x7f22b410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 --2- 172.21.15.49:0/3182874148 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f22b40f92c0 0x7f22b410e4c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 >> 172.21.15.49:0/3182874148 conn(0x7f22b406c760 msgr2=0x7f22b40fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 shutdown_connections 2024-02-22T01:00:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.813+0000 7f22bc0ec700 1 -- 172.21.15.49:0/3182874148 wait complete. 2024-02-22T01:00:12.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-22T01:00:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 -- 172.21.15.49:0/1694448218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fd090 msgr2=0x7fed4c0f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 --2- 172.21.15.49:0/1694448218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fd090 0x7fed4c0f6870 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fed400047f0 tx=0x7fed40009cb0).stop 2024-02-22T01:00:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 -- 172.21.15.49:0/1694448218 shutdown_connections 2024-02-22T01:00:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 --2- 172.21.15.49:0/1694448218 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fd090 0x7fed4c0f6870 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 --2- 172.21.15.49:0/1694448218 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4c0fc730 0x7fed4c0fcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 -- 172.21.15.49:0/1694448218 >> 172.21.15.49:0/1694448218 conn(0x7fed4c06c760 msgr2=0x7fed4c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 -- 172.21.15.49:0/1694448218 shutdown_connections 2024-02-22T01:00:12.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 -- 172.21.15.49:0/1694448218 wait complete. 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 Processor -- start 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.946+0000 7fed54475700 1 -- start start 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed54475700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fc730 0x7fed4c109080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed54475700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4c0fd090 0x7fed4c109570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed54475700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c109a60 con 0x7fed4c0fc730 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed54475700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c109ba0 con 0x7fed4c0fd090 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed52211700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fc730 0x7fed4c109080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed52211700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fc730 0x7fed4c109080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53310/0 (socket says 172.21.15.49:53310) 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed52211700 1 -- 172.21.15.49:0/108071060 learned_addr learned my addr 172.21.15.49:0/108071060 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed52211700 1 -- 172.21.15.49:0/108071060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4c0fd090 msgr2=0x7fed4c109570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed51a10700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4c0fd090 0x7fed4c109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed52211700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4c0fd090 0x7fed4c109570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed52211700 1 -- 172.21.15.49:0/108071060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40005040 con 0x7fed4c0fc730 2024-02-22T01:00:12.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed52211700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fc730 0x7fed4c109080 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fed48002770 tx=0x7fed48002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:12.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed3f7fe700 1 -- 172.21.15.49:0/108071060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed48002d80 con 0x7fed4c0fc730 2024-02-22T01:00:12.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed3f7fe700 1 -- 172.21.15.49:0/108071060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fed4800f040 con 0x7fed4c0fc730 2024-02-22T01:00:12.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c109e50 con 0x7fed4c0fc730 2024-02-22T01:00:12.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed3f7fe700 1 -- 172.21.15.49:0/108071060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed4800d800 con 0x7fed4c0fc730 2024-02-22T01:00:12.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.947+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c1123c0 con 0x7fed4c0fc730 2024-02-22T01:00:12.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.948+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c05f380 con 0x7fed4c0fc730 2024-02-22T01:00:12.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.949+0000 7fed3f7fe700 1 -- 172.21.15.49:0/108071060 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fed48009110 con 0x7fed4c0fc730 2024-02-22T01:00:12.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.949+0000 7fed3f7fe700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed3806caa0 0x7fed3806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:12.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.949+0000 7fed3f7fe700 1 -- 172.21.15.49:0/108071060 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fed4808b8e0 con 0x7fed4c0fc730 2024-02-22T01:00:12.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.949+0000 7fed51a10700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed3806caa0 0x7fed3806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:12.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.950+0000 7fed51a10700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed3806caa0 0x7fed3806ef60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fed400043d0 tx=0x7fed4000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:12.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:12.954+0000 7fed3f7fe700 1 -- 172.21.15.49:0/108071060 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fed480559b0 con 0x7fed4c0fc730 2024-02-22T01:00:13.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.199+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed4c05eec0 con 0x7fed4c0fc730 2024-02-22T01:00:13.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.200+0000 7fed3f7fe700 1 -- 172.21.15.49:0/108071060 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4851 (secure 0 0 0) 0x7fed48058fd0 con 0x7fed4c0fc730 2024-02-22T01:00:13.192 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:13.192 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44335,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/1231559763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1231559763},{"type":"v1","addr":"172.21.15.161:6827","nonce":1231559763}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:58:35.474586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":28,"state":"up:active","state_seq":244,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34382":{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":1,"incarnation":28,"state":"up:active","state_seq":240,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:13.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed3806caa0 msgr2=0x7fed3806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed3806caa0 0x7fed3806ef60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fed400043d0 tx=0x7fed4000b040).stop 2024-02-22T01:00:13.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fc730 msgr2=0x7fed4c109080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fc730 0x7fed4c109080 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fed48002770 tx=0x7fed48002b30).stop 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 shutdown_connections 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fed3806caa0 0x7fed3806ef60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed4c0fc730 0x7fed4c109080 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 --2- 172.21.15.49:0/108071060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed4c0fd090 0x7fed4c109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 >> 172.21.15.49:0/108071060 conn(0x7fed4c06c760 msgr2=0x7fed4c0faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 shutdown_connections 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.202+0000 7fed54475700 1 -- 172.21.15.49:0/108071060 wait complete. 2024-02-22T01:00:13.195 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 33 2024-02-22T01:00:13.206 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 2, 'flags': 18} 2024-02-22T01:00:13.206 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2024-02-22T01:00:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.336+0000 7fded1fe5700 1 -- 172.21.15.49:0/242293452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fe230 msgr2=0x7fdecc0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.336+0000 7fded1fe5700 1 --2- 172.21.15.49:0/242293452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fe230 0x7fdecc0f7a10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fdeb40047f0 tx=0x7fdeb4009cb0).stop 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.336+0000 7fded1fe5700 1 -- 172.21.15.49:0/242293452 shutdown_connections 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.336+0000 7fded1fe5700 1 --2- 172.21.15.49:0/242293452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fe230 0x7fdecc0f7a10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.336+0000 7fded1fe5700 1 --2- 172.21.15.49:0/242293452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdecc0fd8d0 0x7fdecc0fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.336+0000 7fded1fe5700 1 -- 172.21.15.49:0/242293452 >> 172.21.15.49:0/242293452 conn(0x7fdecc0f3490 msgr2=0x7fdecc0f58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.336+0000 7fded1fe5700 1 -- 172.21.15.49:0/242293452 shutdown_connections 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.336+0000 7fded1fe5700 1 -- 172.21.15.49:0/242293452 wait complete. 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fded1fe5700 1 Processor -- start 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fded1fe5700 1 -- start start 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fded1fe5700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fd8d0 0x7fdecc10e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fded1fe5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdecc0fe230 0x7fdecc10e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fded1fe5700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc10eb00 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fded1fe5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc10ec40 con 0x7fdecc0fe230 2024-02-22T01:00:13.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fdecb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fd8d0 0x7fdecc10e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fdecb7fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fd8d0 0x7fdecc10e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53326/0 (socket says 172.21.15.49:53326) 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fdecb7fe700 1 -- 172.21.15.49:0/787125311 learned_addr learned my addr 172.21.15.49:0/787125311 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.337+0000 7fdecaffd700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdecc0fe230 0x7fdecc10e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fdecb7fe700 1 -- 172.21.15.49:0/787125311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdecc0fe230 msgr2=0x7fdecc10e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fdecb7fe700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdecc0fe230 0x7fdecc10e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fdecb7fe700 1 -- 172.21.15.49:0/787125311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4005040 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fdecb7fe700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fd8d0 0x7fdecc10e010 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fdebc00c740 tx=0x7fdebc007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fdec8ff9700 1 -- 172.21.15.49:0/787125311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdebc00e680 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc1082d0 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fdec8ff9700 1 -- 172.21.15.49:0/787125311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdebc00ec90 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fdec8ff9700 1 -- 172.21.15.49:0/787125311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdebc013d60 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.338+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc108810 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.339+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc0606d0 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.339+0000 7fdec8ff9700 1 -- 172.21.15.49:0/787125311 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fdebc00e7e0 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.340+0000 7fdec8ff9700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdeb806caa0 0x7fdeb806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:13.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.340+0000 7fdec8ff9700 1 -- 172.21.15.49:0/787125311 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdebc08c0a0 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.340+0000 7fdecaffd700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdeb806caa0 0x7fdeb806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:13.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.340+0000 7fdecaffd700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdeb806caa0 0x7fdeb806ef60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fdeb4004f10 tx=0x7fdeb400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:13.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.344+0000 7fdec8ff9700 1 -- 172.21.15.49:0/787125311 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdebc059c00 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.587+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7fdecc05eec0 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.588+0000 7fdec8ff9700 1 -- 172.21.15.49:0/787125311 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v33) v1 ==== 107+0+4835 (secure 0 0 0) 0x7fdebc059790 con 0x7fdecc0fd8d0 2024-02-22T01:00:13.580 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:13.580 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:32:27.890695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14438,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.49:6827/502304157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":502304157},{"type":"v1","addr":"172.21.15.49:6827","nonce":502304157}]},"join_fscid":1,"export_targets":[1],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi161.wycpud","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.161:6825/1178849707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1178849707},{"type":"v1","addr":"172.21.15.161:6825","nonce":1178849707}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:13.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdeb806caa0 msgr2=0x7fdeb806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdeb806caa0 0x7fdeb806ef60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fdeb4004f10 tx=0x7fdeb400b040).stop 2024-02-22T01:00:13.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fd8d0 msgr2=0x7fdecc10e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fd8d0 0x7fdecc10e010 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fdebc00c740 tx=0x7fdebc007ef0).stop 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 shutdown_connections 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fdeb806caa0 0x7fdeb806ef60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdecc0fd8d0 0x7fdecc10e010 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 --2- 172.21.15.49:0/787125311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdecc0fe230 0x7fdecc10e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 >> 172.21.15.49:0/787125311 conn(0x7fdecc0f3490 msgr2=0x7fdecc0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 shutdown_connections 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.590+0000 7fded1fe5700 1 -- 172.21.15.49:0/787125311 wait complete. 2024-02-22T01:00:13.583 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 13 2024-02-22T01:00:13.593 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:13 smithi049 ceph-mon[132694]: pgmap v700: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:13.593 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:00:13.593 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:13 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3889365471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-22T01:00:13.594 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:13 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3182874148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-22T01:00:13.594 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:13 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/108071060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-22T01:00:13.595 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-02-22T01:00:13.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 -- 172.21.15.49:0/3342968592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 msgr2=0x7ffac00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 --2- 172.21.15.49:0/3342968592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 0x7ffac00fcc10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7ffab00047f0 tx=0x7ffab0009cb0).stop 2024-02-22T01:00:13.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 -- 172.21.15.49:0/3342968592 shutdown_connections 2024-02-22T01:00:13.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 --2- 172.21.15.49:0/3342968592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffac00fd100 0x7ffac00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 --2- 172.21.15.49:0/3342968592 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 0x7ffac00fcc10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 -- 172.21.15.49:0/3342968592 >> 172.21.15.49:0/3342968592 conn(0x7ffac006c760 msgr2=0x7ffac006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 -- 172.21.15.49:0/3342968592 shutdown_connections 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 -- 172.21.15.49:0/3342968592 wait complete. 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.724+0000 7ffac75b0700 1 Processor -- start 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac75b0700 1 -- start start 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac75b0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 0x7ffac010ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac75b0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffac00fd100 0x7ffac010d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac75b0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac010d970 con 0x7ffac00fc830 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac75b0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac010dab0 con 0x7ffac00fd100 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac534c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 0x7ffac010ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:13.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac534c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 0x7ffac010ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53340/0 (socket says 172.21.15.49:53340) 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac534c700 1 -- 172.21.15.49:0/2150047751 learned_addr learned my addr 172.21.15.49:0/2150047751 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac534c700 1 -- 172.21.15.49:0/2150047751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffac00fd100 msgr2=0x7ffac010d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac534c700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffac00fd100 0x7ffac010d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac534c700 1 -- 172.21.15.49:0/2150047751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0005040 con 0x7ffac00fc830 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac534c700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 0x7ffac010ce80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7ffab0009920 tx=0x7ffab0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffab67fc700 1 -- 172.21.15.49:0/2150047751 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab000e030 con 0x7ffac00fc830 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac01070e0 con 0x7ffac00fc830 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffab67fc700 1 -- 172.21.15.49:0/2150047751 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffab0007e90 con 0x7ffac00fc830 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffab67fc700 1 -- 172.21.15.49:0/2150047751 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab001a070 con 0x7ffac00fc830 2024-02-22T01:00:13.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.725+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac0107640 con 0x7ffac00fc830 2024-02-22T01:00:13.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.726+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac005f380 con 0x7ffac00fc830 2024-02-22T01:00:13.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.728+0000 7ffab67fc700 1 -- 172.21.15.49:0/2150047751 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffab001fbc0 con 0x7ffac00fc830 2024-02-22T01:00:13.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.728+0000 7ffab67fc700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffaac06caa0 0x7ffaac06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:13.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.728+0000 7ffab67fc700 1 -- 172.21.15.49:0/2150047751 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ffab008f9c0 con 0x7ffac00fc830 2024-02-22T01:00:13.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.728+0000 7ffac4b4b700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffaac06caa0 0x7ffaac06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:13.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.728+0000 7ffac4b4b700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffaac06caa0 0x7ffaac06ef60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7ffac01087c0 tx=0x7ffabc007bc0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:13.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.732+0000 7ffab67fc700 1 -- 172.21.15.49:0/2150047751 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffab005d520 con 0x7ffac00fc830 2024-02-22T01:00:13.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:13 smithi161 ceph-mon[113442]: pgmap v700: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:13.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:00:13.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:13 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3889365471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-22T01:00:13.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:13 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3182874148' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-22T01:00:13.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:13 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/108071060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-22T01:00:13.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.982+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7ffac01085e0 con 0x7ffac00fc830 2024-02-22T01:00:13.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.983+0000 7ffab67fc700 1 -- 172.21.15.49:0/2150047751 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v33) v1 ==== 107+0+4836 (secure 0 0 0) 0x7ffac01085e0 con 0x7ffac00fc830 2024-02-22T01:00:13.975 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:13.975 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:33:59.986935+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14438,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.49:6827/502304157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":502304157},{"type":"v1","addr":"172.21.15.49:6827","nonce":502304157}]},"join_fscid":1,"export_targets":[1],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi161.wycpud","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.161:6825/1178849707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1178849707},{"type":"v1","addr":"172.21.15.161:6825","nonce":1178849707}]},"join_fscid":1,"export_targets":[0],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffaac06caa0 msgr2=0x7ffaac06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffaac06caa0 0x7ffaac06ef60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7ffac01087c0 tx=0x7ffabc007bc0).stop 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 msgr2=0x7ffac010ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 0x7ffac010ce80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7ffab0009920 tx=0x7ffab0009cb0).stop 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 shutdown_connections 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ffaac06caa0 0x7ffaac06ef60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffac00fc830 0x7ffac010ce80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 --2- 172.21.15.49:0/2150047751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffac00fd100 0x7ffac010d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 >> 172.21.15.49:0/2150047751 conn(0x7ffac006c760 msgr2=0x7ffac00ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.985+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 shutdown_connections 2024-02-22T01:00:13.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:13.986+0000 7ffac75b0700 1 -- 172.21.15.49:0/2150047751 wait complete. 2024-02-22T01:00:13.979 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 14 2024-02-22T01:00:13.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-02-22T01:00:14.113 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.119+0000 7f14aa851700 1 -- 172.21.15.49:0/3631582728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fd100 msgr2=0x7f14a40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.119+0000 7f14aa851700 1 --2- 172.21.15.49:0/3631582728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fd100 0x7f14a40f6930 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f14980047f0 tx=0x7f1498009cb0).stop 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.119+0000 7f14aa851700 1 -- 172.21.15.49:0/3631582728 shutdown_connections 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.119+0000 7f14aa851700 1 --2- 172.21.15.49:0/3631582728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fd100 0x7f14a40f6930 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.119+0000 7f14aa851700 1 --2- 172.21.15.49:0/3631582728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14a40fc830 0x7f14a40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.119+0000 7f14aa851700 1 -- 172.21.15.49:0/3631582728 >> 172.21.15.49:0/3631582728 conn(0x7f14a406c760 msgr2=0x7f14a406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.119+0000 7f14aa851700 1 -- 172.21.15.49:0/3631582728 shutdown_connections 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.119+0000 7f14aa851700 1 -- 172.21.15.49:0/3631582728 wait complete. 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14aa851700 1 Processor -- start 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14aa851700 1 -- start start 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14aa851700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fc830 0x7f14a40fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14aa851700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14a40fd100 0x7f14a40fdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14aa851700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40fe160 con 0x7f14a40fc830 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14aa851700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40fe2a0 con 0x7f14a40fd100 2024-02-22T01:00:14.114 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14a3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fc830 0x7f14a40fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14a3fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fc830 0x7f14a40fd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53356/0 (socket says 172.21.15.49:53356) 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14a3fff700 1 -- 172.21.15.49:0/2150794529 learned_addr learned my addr 172.21.15.49:0/2150794529 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14a37fe700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14a40fd100 0x7f14a40fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14a3fff700 1 -- 172.21.15.49:0/2150794529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14a40fd100 msgr2=0x7f14a40fdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14a3fff700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14a40fd100 0x7f14a40fdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14a3fff700 1 -- 172.21.15.49:0/2150794529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1498005040 con 0x7f14a40fc830 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.120+0000 7f14a37fe700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14a40fd100 0x7f14a40fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.121+0000 7f14a3fff700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fc830 0x7f14a40fd780 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f149400b4b0 tx=0x7f14940090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.121+0000 7f14a17fa700 1 -- 172.21.15.49:0/2150794529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1494002500 con 0x7f14a40fc830 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.121+0000 7f14a17fa700 1 -- 172.21.15.49:0/2150794529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1494002b10 con 0x7f14a40fc830 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.121+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a40fe550 con 0x7f14a40fc830 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.121+0000 7f14a17fa700 1 -- 172.21.15.49:0/2150794529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1494012cf0 con 0x7f14a40fc830 2024-02-22T01:00:14.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.121+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a4114760 con 0x7f14a40fc830 2024-02-22T01:00:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.122+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a405f380 con 0x7f14a40fc830 2024-02-22T01:00:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.123+0000 7f14a17fa700 1 -- 172.21.15.49:0/2150794529 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1494002660 con 0x7f14a40fc830 2024-02-22T01:00:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.123+0000 7f14a17fa700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f148c06caa0 0x7f148c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.123+0000 7f14a37fe700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f148c06caa0 0x7f148c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.123+0000 7f14a17fa700 1 -- 172.21.15.49:0/2150794529 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f149408c1d0 con 0x7f14a40fc830 2024-02-22T01:00:14.117 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.124+0000 7f14a37fe700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f148c06caa0 0x7f148c06ef60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f14a40fef20 tx=0x7f149800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.127+0000 7f14a17fa700 1 -- 172.21.15.49:0/2150794529 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f14940562a0 con 0x7f14a40fc830 2024-02-22T01:00:14.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.374+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f14a405eec0 con 0x7f14a40fc830 2024-02-22T01:00:14.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.375+0000 7f14a17fa700 1 -- 172.21.15.49:0/2150794529 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v33) v1 ==== 107+0+4835 (secure 0 0 0) 0x7f14940598c0 con 0x7f14a40fc830 2024-02-22T01:00:14.367 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:14.367 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:37:22.642562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14438,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.49:6827/502304157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":502304157},{"type":"v1","addr":"172.21.15.49:6827","nonce":502304157}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi161.wycpud","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.161:6825/1178849707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1178849707},{"type":"v1","addr":"172.21.15.161:6825","nonce":1178849707}]},"join_fscid":1,"export_targets":[0],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:14.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f148c06caa0 msgr2=0x7f148c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f148c06caa0 0x7f148c06ef60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f14a40fef20 tx=0x7f149800b040).stop 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fc830 msgr2=0x7f14a40fd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fc830 0x7f14a40fd780 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f149400b4b0 tx=0x7f14940090f0).stop 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 shutdown_connections 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f148c06caa0 0x7f148c06ef60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14a40fc830 0x7f14a40fd780 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 --2- 172.21.15.49:0/2150794529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14a40fd100 0x7f14a40fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 >> 172.21.15.49:0/2150794529 conn(0x7f14a406c760 msgr2=0x7f14a4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 shutdown_connections 2024-02-22T01:00:14.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.377+0000 7f14aa851700 1 -- 172.21.15.49:0/2150794529 wait complete. 2024-02-22T01:00:14.371 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 15 2024-02-22T01:00:14.382 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-02-22T01:00:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.511+0000 7f14b4dcf700 1 -- 172.21.15.49:0/1888181834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fc830 msgr2=0x7f14b00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.511+0000 7f14b4dcf700 1 --2- 172.21.15.49:0/1888181834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fc830 0x7f14b00fcc10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f14a40047f0 tx=0x7f14a4009cb0).stop 2024-02-22T01:00:14.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.511+0000 7f14b4dcf700 1 -- 172.21.15.49:0/1888181834 shutdown_connections 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.511+0000 7f14b4dcf700 1 --2- 172.21.15.49:0/1888181834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b00fd100 0x7f14b00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.511+0000 7f14b4dcf700 1 --2- 172.21.15.49:0/1888181834 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fc830 0x7f14b00fcc10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.511+0000 7f14b4dcf700 1 -- 172.21.15.49:0/1888181834 >> 172.21.15.49:0/1888181834 conn(0x7f14b006c760 msgr2=0x7f14b006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.511+0000 7f14b4dcf700 1 -- 172.21.15.49:0/1888181834 shutdown_connections 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.511+0000 7f14b4dcf700 1 -- 172.21.15.49:0/1888181834 wait complete. 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.512+0000 7f14b4dcf700 1 Processor -- start 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.512+0000 7f14b4dcf700 1 -- start start 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.512+0000 7f14b4dcf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b00fc830 0x7f14b010df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.512+0000 7f14b4dcf700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fd100 0x7f14b010e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.512+0000 7f14b4dcf700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b010ea80 con 0x7f14b00fd100 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.512+0000 7f14b4dcf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b010ebc0 con 0x7f14b00fc830 2024-02-22T01:00:14.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14add9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fd100 0x7f14b010e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14add9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fd100 0x7f14b010e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53384/0 (socket says 172.21.15.49:53384) 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14add9b700 1 -- 172.21.15.49:0/996226762 learned_addr learned my addr 172.21.15.49:0/996226762 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14ae59c700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b00fc830 0x7f14b010df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14add9b700 1 -- 172.21.15.49:0/996226762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b00fc830 msgr2=0x7f14b010df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14add9b700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b00fc830 0x7f14b010df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14add9b700 1 -- 172.21.15.49:0/996226762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4005040 con 0x7f14b00fd100 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14add9b700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fd100 0x7f14b010e480 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f14a000c790 tx=0x7f14a000caa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f149f7fe700 1 -- 172.21.15.49:0/996226762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a000e680 con 0x7f14b00fd100 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b0108250 con 0x7f14b00fd100 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f149f7fe700 1 -- 172.21.15.49:0/996226762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14a000ec90 con 0x7f14b00fd100 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f149f7fe700 1 -- 172.21.15.49:0/996226762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a0012de0 con 0x7f14b00fd100 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.513+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b0108810 con 0x7f14b00fd100 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.514+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b005f380 con 0x7f14b00fd100 2024-02-22T01:00:14.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.515+0000 7f149f7fe700 1 -- 172.21.15.49:0/996226762 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f14a000e7e0 con 0x7f14b00fd100 2024-02-22T01:00:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.515+0000 7f149f7fe700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f149806caa0 0x7f149806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.515+0000 7f149f7fe700 1 -- 172.21.15.49:0/996226762 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f14a008b670 con 0x7f14b00fd100 2024-02-22T01:00:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.515+0000 7f14ae59c700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f149806caa0 0x7f149806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.516+0000 7f14ae59c700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f149806caa0 0x7f149806ef60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f14a4004f10 tx=0x7f14a400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:14.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.520+0000 7f149f7fe700 1 -- 172.21.15.49:0/996226762 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f14a00591d0 con 0x7f14b00fd100 2024-02-22T01:00:14.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:14 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/787125311' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-02-22T01:00:14.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:14 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2150047751' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-02-22T01:00:14.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.762+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f14b005eec0 con 0x7f14b00fd100 2024-02-22T01:00:14.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.763+0000 7f149f7fe700 1 -- 172.21.15.49:0/996226762 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v33) v1 ==== 107+0+4834 (secure 0 0 0) 0x7f14a0058d60 con 0x7f14b00fd100 2024-02-22T01:00:14.755 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:14.755 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:37:34.675539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14438,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14438":{"gid":14438,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.49:6827/502304157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":502304157},{"type":"v1","addr":"172.21.15.49:6827","nonce":502304157}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi161.wycpud","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.161:6825/1178849707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1178849707},{"type":"v1","addr":"172.21.15.161:6825","nonce":1178849707}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:14.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f149806caa0 msgr2=0x7f149806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f149806caa0 0x7f149806ef60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f14a4004f10 tx=0x7f14a400b040).stop 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fd100 msgr2=0x7f14b010e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fd100 0x7f14b010e480 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f14a000c790 tx=0x7f14a000caa0).stop 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 shutdown_connections 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f149806caa0 0x7f149806ef60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b00fc830 0x7f14b010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 --2- 172.21.15.49:0/996226762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14b00fd100 0x7f14b010e480 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 >> 172.21.15.49:0/996226762 conn(0x7f14b006c760 msgr2=0x7f14b0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 shutdown_connections 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.765+0000 7f14b4dcf700 1 -- 172.21.15.49:0/996226762 wait complete. 2024-02-22T01:00:14.758 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 16 2024-02-22T01:00:14.770 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-02-22T01:00:14.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:14 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/787125311' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-02-22T01:00:14.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:14 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2150047751' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-02-22T01:00:14.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.899+0000 7f9d8851a700 1 -- 172.21.15.49:0/1216937121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fd100 msgr2=0x7f9d800f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.899+0000 7f9d8851a700 1 --2- 172.21.15.49:0/1216937121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fd100 0x7f9d800f6930 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f9d700047f0 tx=0x7f9d70009cb0).stop 2024-02-22T01:00:14.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.899+0000 7f9d8851a700 1 -- 172.21.15.49:0/1216937121 shutdown_connections 2024-02-22T01:00:14.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.899+0000 7f9d8851a700 1 --2- 172.21.15.49:0/1216937121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fd100 0x7f9d800f6930 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.899+0000 7f9d8851a700 1 --2- 172.21.15.49:0/1216937121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d800fc830 0x7f9d800fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.899+0000 7f9d8851a700 1 -- 172.21.15.49:0/1216937121 >> 172.21.15.49:0/1216937121 conn(0x7f9d8006c760 msgr2=0x7f9d8006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:14.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.899+0000 7f9d8851a700 1 -- 172.21.15.49:0/1216937121 shutdown_connections 2024-02-22T01:00:14.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.899+0000 7f9d8851a700 1 -- 172.21.15.49:0/1216937121 wait complete. 2024-02-22T01:00:14.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d8851a700 1 Processor -- start 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d8851a700 1 -- start start 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d8851a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fc830 0x7f9d80109090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d8851a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d800fd100 0x7f9d80109580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d8851a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80109a70 con 0x7f9d800fc830 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d8851a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80109bb0 con 0x7f9d800fd100 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d862b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fc830 0x7f9d80109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d862b6700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fc830 0x7f9d80109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53390/0 (socket says 172.21.15.49:53390) 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d862b6700 1 -- 172.21.15.49:0/4065380888 learned_addr learned my addr 172.21.15.49:0/4065380888 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.900+0000 7f9d85ab5700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d800fd100 0x7f9d80109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d862b6700 1 -- 172.21.15.49:0/4065380888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d800fd100 msgr2=0x7f9d80109580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d862b6700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d800fd100 0x7f9d80109580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d862b6700 1 -- 172.21.15.49:0/4065380888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d70005040 con 0x7f9d800fc830 2024-02-22T01:00:14.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d85ab5700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d800fd100 0x7f9d80109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d862b6700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fc830 0x7f9d80109090 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f9d7c0041d0 tx=0x7f9d7c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d777fe700 1 -- 172.21.15.49:0/4065380888 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d7c002d90 con 0x7f9d800fc830 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d777fe700 1 -- 172.21.15.49:0/4065380888 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9d7c00f040 con 0x7f9d800fc830 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d777fe700 1 -- 172.21.15.49:0/4065380888 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d7c00d800 con 0x7f9d800fc830 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d80109e60 con 0x7f9d800fc830 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.901+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d80112450 con 0x7f9d800fc830 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.902+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8005f380 con 0x7f9d800fc830 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.902+0000 7f9d777fe700 1 -- 172.21.15.49:0/4065380888 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9d7c00dac0 con 0x7f9d800fc830 2024-02-22T01:00:14.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.903+0000 7f9d777fe700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d6c06caa0 0x7f9d6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:14.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.903+0000 7f9d777fe700 1 -- 172.21.15.49:0/4065380888 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9d7c08bdf0 con 0x7f9d800fc830 2024-02-22T01:00:14.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.903+0000 7f9d85ab5700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d6c06caa0 0x7f9d6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:14.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.903+0000 7f9d85ab5700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d6c06caa0 0x7f9d6c06ef60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f9d70007cf0 tx=0x7f9d7000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:14.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:14.907+0000 7f9d777fe700 1 -- 172.21.15.49:0/4065380888 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9d7c055ec0 con 0x7f9d800fc830 2024-02-22T01:00:15.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.152+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f9d8005eec0 con 0x7f9d800fc830 2024-02-22T01:00:15.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.153+0000 7f9d777fe700 1 -- 172.21.15.49:0/4065380888 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v33) v1 ==== 107+0+3257 (secure 0 0 0) 0x7f9d7c0594e0 con 0x7f9d800fc830 2024-02-22T01:00:15.145 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:15.145 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d6c06caa0 msgr2=0x7f9d6c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d6c06caa0 0x7f9d6c06ef60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f9d70007cf0 tx=0x7f9d7000b040).stop 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fc830 msgr2=0x7f9d80109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fc830 0x7f9d80109090 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f9d7c0041d0 tx=0x7f9d7c009f60).stop 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 shutdown_connections 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9d6c06caa0 0x7f9d6c06ef60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9d800fc830 0x7f9d80109090 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 --2- 172.21.15.49:0/4065380888 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d800fd100 0x7f9d80109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 >> 172.21.15.49:0/4065380888 conn(0x7f9d8006c760 msgr2=0x7f9d800fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 shutdown_connections 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.155+0000 7f9d8851a700 1 -- 172.21.15.49:0/4065380888 wait complete. 2024-02-22T01:00:15.148 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 17 2024-02-22T01:00:15.160 DEBUG:tasks.fs:max_mds not reduced in epoch 17 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:15.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-22T01:00:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.289+0000 7f8f163f0700 1 -- 172.21.15.49:0/159628654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fd100 msgr2=0x7f8f100f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.289+0000 7f8f163f0700 1 --2- 172.21.15.49:0/159628654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fd100 0x7f8f100f6930 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f8f040047f0 tx=0x7f8f04009cb0).stop 2024-02-22T01:00:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.289+0000 7f8f163f0700 1 -- 172.21.15.49:0/159628654 shutdown_connections 2024-02-22T01:00:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.289+0000 7f8f163f0700 1 --2- 172.21.15.49:0/159628654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fd100 0x7f8f100f6930 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.289+0000 7f8f163f0700 1 --2- 172.21.15.49:0/159628654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f100fc830 0x7f8f100fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.289+0000 7f8f163f0700 1 -- 172.21.15.49:0/159628654 >> 172.21.15.49:0/159628654 conn(0x7f8f1006c760 msgr2=0x7f8f1006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.290+0000 7f8f163f0700 1 -- 172.21.15.49:0/159628654 shutdown_connections 2024-02-22T01:00:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.290+0000 7f8f163f0700 1 -- 172.21.15.49:0/159628654 wait complete. 2024-02-22T01:00:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.290+0000 7f8f163f0700 1 Processor -- start 2024-02-22T01:00:15.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.290+0000 7f8f163f0700 1 -- start start 2024-02-22T01:00:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.290+0000 7f8f163f0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fc830 0x7f8f10109030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.290+0000 7f8f163f0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f100fd100 0x7f8f10109520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.290+0000 7f8f163f0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10109a60 con 0x7f8f100fc830 2024-02-22T01:00:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.290+0000 7f8f163f0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10109ba0 con 0x7f8f100fd100 2024-02-22T01:00:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fc830 0x7f8f10109030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0ffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fc830 0x7f8f10109030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53414/0 (socket says 172.21.15.49:53414) 2024-02-22T01:00:15.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0ffff700 1 -- 172.21.15.49:0/4254543622 learned_addr learned my addr 172.21.15.49:0/4254543622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0f7fe700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f100fd100 0x7f8f10109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0ffff700 1 -- 172.21.15.49:0/4254543622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f100fd100 msgr2=0x7f8f10109520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0ffff700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f100fd100 0x7f8f10109520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0ffff700 1 -- 172.21.15.49:0/4254543622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f04005040 con 0x7f8f100fc830 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0f7fe700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f100fd100 0x7f8f10109520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0ffff700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fc830 0x7f8f10109030 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f8f000041d0 tx=0x7f8f00009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0d7fa700 1 -- 172.21.15.49:0/4254543622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f00002d90 con 0x7f8f100fc830 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0d7fa700 1 -- 172.21.15.49:0/4254543622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f0000f040 con 0x7f8f100fc830 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f0d7fa700 1 -- 172.21.15.49:0/4254543622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f0000d800 con 0x7f8f100fc830 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f10109e50 con 0x7f8f100fc830 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.291+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f10112440 con 0x7f8f100fc830 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.292+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1005f380 con 0x7f8f100fc830 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.293+0000 7f8f0d7fa700 1 -- 172.21.15.49:0/4254543622 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8f0000da70 con 0x7f8f100fc830 2024-02-22T01:00:15.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.293+0000 7f8f0d7fa700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ef806caa0 0x7f8ef806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:15.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.293+0000 7f8f0f7fe700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ef806caa0 0x7f8ef806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:15.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.293+0000 7f8f0d7fa700 1 -- 172.21.15.49:0/4254543622 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8f0008bd20 con 0x7f8f100fc830 2024-02-22T01:00:15.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.294+0000 7f8f0f7fe700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ef806caa0 0x7f8ef806ef60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f8f04007cf0 tx=0x7f8f0400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:15.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.298+0000 7f8f0d7fa700 1 -- 172.21.15.49:0/4254543622 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8f00055df0 con 0x7f8f100fc830 2024-02-22T01:00:15.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:15 smithi049 ceph-mon[132694]: pgmap v701: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:15.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:15 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2150794529' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-22T01:00:15.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:15 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/996226762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-22T01:00:15.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:15 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4065380888' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-22T01:00:15.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.542+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f8f1005eec0 con 0x7f8f100fc830 2024-02-22T01:00:15.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.542+0000 7f8f0d7fa700 1 -- 172.21.15.49:0/4254543622 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v33) v1 ==== 107+0+4818 (secure 0 0 0) 0x7f8f00059410 con 0x7f8f100fc830 2024-02-22T01:00:15.535 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:15.535 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34374,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/3996496243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3996496243},{"type":"v1","addr":"172.21.15.49:6827","nonce":3996496243}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":44303,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/2117166336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2117166336},{"type":"v1","addr":"172.21.15.161:6825","nonce":2117166336}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.544+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ef806caa0 msgr2=0x7f8ef806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.544+0000 7f8f163f0700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ef806caa0 0x7f8ef806ef60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f8f04007cf0 tx=0x7f8f0400b040).stop 2024-02-22T01:00:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.544+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fc830 msgr2=0x7f8f10109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.544+0000 7f8f163f0700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fc830 0x7f8f10109030 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f8f000041d0 tx=0x7f8f00009f60).stop 2024-02-22T01:00:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.545+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 shutdown_connections 2024-02-22T01:00:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.545+0000 7f8f163f0700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8ef806caa0 0x7f8ef806ef60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.545+0000 7f8f163f0700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f100fc830 0x7f8f10109030 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.545+0000 7f8f163f0700 1 --2- 172.21.15.49:0/4254543622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f100fd100 0x7f8f10109520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.545+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 >> 172.21.15.49:0/4254543622 conn(0x7f8f1006c760 msgr2=0x7f8f100fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.545+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 shutdown_connections 2024-02-22T01:00:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.545+0000 7f8f163f0700 1 -- 172.21.15.49:0/4254543622 wait complete. 2024-02-22T01:00:15.538 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 18 2024-02-22T01:00:15.549 DEBUG:tasks.fs:max_mds not reduced in epoch 18 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:15.550 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-22T01:00:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 -- 172.21.15.49:0/122361536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fd8f0 msgr2=0x7fa6b80fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 --2- 172.21.15.49:0/122361536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fd8f0 0x7fa6b80fdcd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fa6ac0047f0 tx=0x7fa6ac009cb0).stop 2024-02-22T01:00:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 -- 172.21.15.49:0/122361536 shutdown_connections 2024-02-22T01:00:15.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 --2- 172.21.15.49:0/122361536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b80fe250 0x7fa6b80f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 --2- 172.21.15.49:0/122361536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fd8f0 0x7fa6b80fdcd0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 -- 172.21.15.49:0/122361536 >> 172.21.15.49:0/122361536 conn(0x7fa6b80f34d0 msgr2=0x7fa6b80f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 -- 172.21.15.49:0/122361536 shutdown_connections 2024-02-22T01:00:15.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 -- 172.21.15.49:0/122361536 wait complete. 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.679+0000 7fa6bc8be700 1 Processor -- start 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6bc8be700 1 -- start start 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6bc8be700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b80fd8f0 0x7fa6b806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6bc8be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fe250 0x7fa6b806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6bc8be700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b806bab0 con 0x7fa6b80fe250 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6bc8be700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b806bbf0 con 0x7fa6b80fd8f0 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6b5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fe250 0x7fa6b806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6b5d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fe250 0x7fa6b806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53432/0 (socket says 172.21.15.49:53432) 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6b5d9b700 1 -- 172.21.15.49:0/2695273766 learned_addr learned my addr 172.21.15.49:0/2695273766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6b5d9b700 1 -- 172.21.15.49:0/2695273766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b80fd8f0 msgr2=0x7fa6b806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6b5d9b700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b80fd8f0 0x7fa6b806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6b5d9b700 1 -- 172.21.15.49:0/2695273766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac005040 con 0x7fa6b80fe250 2024-02-22T01:00:15.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6b5d9b700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fe250 0x7fa6b806b5c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fa6a800c710 tx=0x7fa6a8007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6a77fe700 1 -- 172.21.15.49:0/2695273766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6a800e680 con 0x7fa6b80fe250 2024-02-22T01:00:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b806bea0 con 0x7fa6b80fe250 2024-02-22T01:00:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6a77fe700 1 -- 172.21.15.49:0/2695273766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa6a800ec90 con 0x7fa6b80fe250 2024-02-22T01:00:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6a77fe700 1 -- 172.21.15.49:0/2695273766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6a8013cd0 con 0x7fa6b80fe250 2024-02-22T01:00:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.680+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b81146b0 con 0x7fa6b80fe250 2024-02-22T01:00:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.681+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b805f360 con 0x7fa6b80fe250 2024-02-22T01:00:15.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.682+0000 7fa6a77fe700 1 -- 172.21.15.49:0/2695273766 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa6a8013410 con 0x7fa6b80fe250 2024-02-22T01:00:15.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.682+0000 7fa6a77fe700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6a006caa0 0x7fa6a006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:15.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.682+0000 7fa6a77fe700 1 -- 172.21.15.49:0/2695273766 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa6a808c080 con 0x7fa6b80fe250 2024-02-22T01:00:15.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.682+0000 7fa6b659c700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6a006caa0 0x7fa6a006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:15.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.683+0000 7fa6b659c700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6a006caa0 0x7fa6a006ef60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fa6ac0047f0 tx=0x7fa6ac009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:15.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.687+0000 7fa6a77fe700 1 -- 172.21.15.49:0/2695273766 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa6a8056150 con 0x7fa6b80fe250 2024-02-22T01:00:15.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:15 smithi161 ceph-mon[113442]: pgmap v701: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:15.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:15 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2150794529' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-22T01:00:15.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:15 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/996226762' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-22T01:00:15.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:15 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4065380888' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-22T01:00:15.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.931+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7fa6b806c650 con 0x7fa6b80fe250 2024-02-22T01:00:15.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.932+0000 7fa6a77fe700 1 -- 172.21.15.49:0/2695273766 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v33) v1 ==== 107+0+4039 (secure 0 0 0) 0x7fa6a8059770 con 0x7fa6b80fe250 2024-02-22T01:00:15.924 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:15.924 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":44303,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/2117166336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2117166336},{"type":"v1","addr":"172.21.15.161:6825","nonce":2117166336}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:15.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6a006caa0 msgr2=0x7fa6a006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6a006caa0 0x7fa6a006ef60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fa6ac0047f0 tx=0x7fa6ac009cb0).stop 2024-02-22T01:00:15.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fe250 msgr2=0x7fa6b806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:15.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fe250 0x7fa6b806b5c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fa6a800c710 tx=0x7fa6a8007ec0).stop 2024-02-22T01:00:15.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 shutdown_connections 2024-02-22T01:00:15.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa6a006caa0 0x7fa6a006ef60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b80fd8f0 0x7fa6b806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:15.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 --2- 172.21.15.49:0/2695273766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6b80fe250 0x7fa6b806b5c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:15.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 >> 172.21.15.49:0/2695273766 conn(0x7fa6b80f34d0 msgr2=0x7fa6b80fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:15.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 shutdown_connections 2024-02-22T01:00:15.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:15.934+0000 7fa6bc8be700 1 -- 172.21.15.49:0/2695273766 wait complete. 2024-02-22T01:00:15.927 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 19 2024-02-22T01:00:15.938 DEBUG:tasks.fs:max_mds not reduced in epoch 19 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:15.938 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-22T01:00:16.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.068+0000 7f6243dba700 1 -- 172.21.15.49:0/3709569512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fc830 msgr2=0x7f623c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.068+0000 7f6243dba700 1 --2- 172.21.15.49:0/3709569512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fc830 0x7f623c0fcc10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f62380047f0 tx=0x7f6238009cb0).stop 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.068+0000 7f6243dba700 1 -- 172.21.15.49:0/3709569512 shutdown_connections 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.068+0000 7f6243dba700 1 --2- 172.21.15.49:0/3709569512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f623c0fd100 0x7f623c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.068+0000 7f6243dba700 1 --2- 172.21.15.49:0/3709569512 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fc830 0x7f623c0fcc10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.068+0000 7f6243dba700 1 -- 172.21.15.49:0/3709569512 >> 172.21.15.49:0/3709569512 conn(0x7f623c06c760 msgr2=0x7f623c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6243dba700 1 -- 172.21.15.49:0/3709569512 shutdown_connections 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6243dba700 1 -- 172.21.15.49:0/3709569512 wait complete. 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6243dba700 1 Processor -- start 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6243dba700 1 -- start start 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6243dba700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f623c0fc830 0x7f623c10ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6243dba700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fd100 0x7f623c10d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6243dba700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c10d970 con 0x7f623c0fd100 2024-02-22T01:00:16.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6243dba700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623c10dab0 con 0x7f623c0fc830 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.069+0000 7f6241355700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fd100 0x7f623c10d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6241355700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fd100 0x7f623c10d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53456/0 (socket says 172.21.15.49:53456) 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6241355700 1 -- 172.21.15.49:0/2212756256 learned_addr learned my addr 172.21.15.49:0/2212756256 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6241b56700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f623c0fc830 0x7f623c10ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6241355700 1 -- 172.21.15.49:0/2212756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f623c0fc830 msgr2=0x7f623c10ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6241355700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f623c0fc830 0x7f623c10ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6241355700 1 -- 172.21.15.49:0/2212756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238005040 con 0x7f623c0fd100 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6241b56700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f623c0fc830 0x7f623c10ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6241355700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fd100 0x7f623c10d370 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f622c0041d0 tx=0x7f622c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:16.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6232ffd700 1 -- 172.21.15.49:0/2212756256 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f622c002d90 con 0x7f623c0fd100 2024-02-22T01:00:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623c107140 con 0x7f623c0fd100 2024-02-22T01:00:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6232ffd700 1 -- 172.21.15.49:0/2212756256 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f622c00f040 con 0x7f623c0fd100 2024-02-22T01:00:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6232ffd700 1 -- 172.21.15.49:0/2212756256 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f622c00d800 con 0x7f623c0fd100 2024-02-22T01:00:16.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.070+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623c107700 con 0x7f623c0fd100 2024-02-22T01:00:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.071+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623c05f380 con 0x7f623c0fd100 2024-02-22T01:00:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.072+0000 7f6232ffd700 1 -- 172.21.15.49:0/2212756256 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f622c00dac0 con 0x7f623c0fd100 2024-02-22T01:00:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.072+0000 7f6232ffd700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f622806caa0 0x7f622806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.072+0000 7f6232ffd700 1 -- 172.21.15.49:0/2212756256 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f622c08bdf0 con 0x7f623c0fd100 2024-02-22T01:00:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.072+0000 7f6241b56700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f622806caa0 0x7f622806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:16.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.072+0000 7f6241b56700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f622806caa0 0x7f622806ef60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f6238004540 tx=0x7f623800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:16.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.076+0000 7f6232ffd700 1 -- 172.21.15.49:0/2212756256 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f622c059950 con 0x7f623c0fd100 2024-02-22T01:00:16.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.322+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f623c05eec0 con 0x7f623c0fd100 2024-02-22T01:00:16.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.323+0000 7f6232ffd700 1 -- 172.21.15.49:0/2212756256 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v33) v1 ==== 107+0+4818 (secure 0 0 0) 0x7f623c05eec0 con 0x7f623c0fd100 2024-02-22T01:00:16.315 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:16.315 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14450,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/657022316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":657022316},{"type":"v1","addr":"172.21.15.49:6829","nonce":657022316}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44303,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/2117166336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2117166336},{"type":"v1","addr":"172.21.15.161:6825","nonce":2117166336}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f622806caa0 msgr2=0x7f622806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f622806caa0 0x7f622806ef60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f6238004540 tx=0x7f623800b040).stop 2024-02-22T01:00:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fd100 msgr2=0x7f623c10d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fd100 0x7f623c10d370 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f622c0041d0 tx=0x7f622c009f60).stop 2024-02-22T01:00:16.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 shutdown_connections 2024-02-22T01:00:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f622806caa0 0x7f622806ef60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f623c0fc830 0x7f623c10ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 --2- 172.21.15.49:0/2212756256 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f623c0fd100 0x7f623c10d370 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 >> 172.21.15.49:0/2212756256 conn(0x7f623c06c760 msgr2=0x7f623c0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 shutdown_connections 2024-02-22T01:00:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.325+0000 7f6243dba700 1 -- 172.21.15.49:0/2212756256 wait complete. 2024-02-22T01:00:16.319 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 20 2024-02-22T01:00:16.330 DEBUG:tasks.fs:max_mds not reduced in epoch 20 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:16.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-22T01:00:16.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.459+0000 7f907e97f700 1 -- 172.21.15.49:0/3097351457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fd100 msgr2=0x7f90780f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.459+0000 7f907e97f700 1 --2- 172.21.15.49:0/3097351457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fd100 0x7f90780f6930 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f906c0047f0 tx=0x7f906c009cb0).stop 2024-02-22T01:00:16.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.459+0000 7f907e97f700 1 -- 172.21.15.49:0/3097351457 shutdown_connections 2024-02-22T01:00:16.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.459+0000 7f907e97f700 1 --2- 172.21.15.49:0/3097351457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fd100 0x7f90780f6930 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.459+0000 7f907e97f700 1 --2- 172.21.15.49:0/3097351457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90780fc830 0x7f90780fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.459+0000 7f907e97f700 1 -- 172.21.15.49:0/3097351457 >> 172.21.15.49:0/3097351457 conn(0x7f907806c760 msgr2=0x7f907806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:16.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.459+0000 7f907e97f700 1 -- 172.21.15.49:0/3097351457 shutdown_connections 2024-02-22T01:00:16.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.459+0000 7f907e97f700 1 -- 172.21.15.49:0/3097351457 wait complete. 2024-02-22T01:00:16.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.460+0000 7f907e97f700 1 Processor -- start 2024-02-22T01:00:16.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.460+0000 7f907e97f700 1 -- start start 2024-02-22T01:00:16.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f907e97f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fc830 0x7f9078109090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f907e97f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90780fd100 0x7f9078109580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f907e97f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078109a70 con 0x7f90780fc830 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f907e97f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9078109bb0 con 0x7f90780fd100 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f9077fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fc830 0x7f9078109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f9077fff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fc830 0x7f9078109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53478/0 (socket says 172.21.15.49:53478) 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f9077fff700 1 -- 172.21.15.49:0/1278438497 learned_addr learned my addr 172.21.15.49:0/1278438497 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f9077fff700 1 -- 172.21.15.49:0/1278438497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90780fd100 msgr2=0x7f9078109580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f9077fff700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90780fd100 0x7f9078109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f9077fff700 1 -- 172.21.15.49:0/1278438497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c005040 con 0x7f90780fc830 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f9077fff700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fc830 0x7f9078109090 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f906800c790 tx=0x7f906800cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f90757fa700 1 -- 172.21.15.49:0/1278438497 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90680106f0 con 0x7f90780fc830 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f90757fa700 1 -- 172.21.15.49:0/1278438497 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9068010d00 con 0x7f90780fc830 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f90757fa700 1 -- 172.21.15.49:0/1278438497 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9068012e50 con 0x7f90780fc830 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.461+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9078109e60 con 0x7f90780fc830 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.462+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9078112480 con 0x7f90780fc830 2024-02-22T01:00:16.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.462+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907805f380 con 0x7f90780fc830 2024-02-22T01:00:16.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.463+0000 7f90757fa700 1 -- 172.21.15.49:0/1278438497 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9068010850 con 0x7f90780fc830 2024-02-22T01:00:16.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.463+0000 7f90757fa700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f906006caa0 0x7f906006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.463+0000 7f90757fa700 1 -- 172.21.15.49:0/1278438497 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f906808b6e0 con 0x7f90780fc830 2024-02-22T01:00:16.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.463+0000 7f90777fe700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f906006caa0 0x7f906006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:16.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.464+0000 7f90777fe700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f906006caa0 0x7f906006ef60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f906c0043d0 tx=0x7f906c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:16.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.468+0000 7f90757fa700 1 -- 172.21.15.49:0/1278438497 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f90680557b0 con 0x7f90780fc830 2024-02-22T01:00:16.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:16 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4254543622' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-22T01:00:16.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:16 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2695273766' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-22T01:00:16.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:16 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2212756256' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-22T01:00:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.712+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f90780feb80 con 0x7f90780fc830 2024-02-22T01:00:16.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.713+0000 7f90757fa700 1 -- 172.21.15.49:0/1278438497 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v33) v1 ==== 107+0+4043 (secure 0 0 0) 0x7f9068058dd0 con 0x7f90780fc830 2024-02-22T01:00:16.705 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:16.705 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44303,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/2117166336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2117166336},{"type":"v1","addr":"172.21.15.161:6825","nonce":2117166336}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f906006caa0 msgr2=0x7f906006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f906006caa0 0x7f906006ef60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f906c0043d0 tx=0x7f906c009cb0).stop 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fc830 msgr2=0x7f9078109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fc830 0x7f9078109090 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f906800c790 tx=0x7f906800cb50).stop 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 shutdown_connections 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f906006caa0 0x7f906006ef60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90780fc830 0x7f9078109090 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 --2- 172.21.15.49:0/1278438497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90780fd100 0x7f9078109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 >> 172.21.15.49:0/1278438497 conn(0x7f907806c760 msgr2=0x7f90780fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.715+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 shutdown_connections 2024-02-22T01:00:16.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.716+0000 7f907e97f700 1 -- 172.21.15.49:0/1278438497 wait complete. 2024-02-22T01:00:16.709 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 21 2024-02-22T01:00:16.720 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:16.720 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-22T01:00:16.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:16 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4254543622' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-22T01:00:16.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:16 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2695273766' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-22T01:00:16.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:16 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2212756256' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-22T01:00:16.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.850+0000 7f3a85115700 1 -- 172.21.15.49:0/987397236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fd100 msgr2=0x7f3a800f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.850+0000 7f3a85115700 1 --2- 172.21.15.49:0/987397236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fd100 0x7f3a800f6930 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f3a680047f0 tx=0x7f3a68009cb0).stop 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.850+0000 7f3a85115700 1 -- 172.21.15.49:0/987397236 shutdown_connections 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.850+0000 7f3a85115700 1 --2- 172.21.15.49:0/987397236 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fd100 0x7f3a800f6930 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.850+0000 7f3a85115700 1 --2- 172.21.15.49:0/987397236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a800fc830 0x7f3a800fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.850+0000 7f3a85115700 1 -- 172.21.15.49:0/987397236 >> 172.21.15.49:0/987397236 conn(0x7f3a8006c760 msgr2=0x7f3a8006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.850+0000 7f3a85115700 1 -- 172.21.15.49:0/987397236 shutdown_connections 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.850+0000 7f3a85115700 1 -- 172.21.15.49:0/987397236 wait complete. 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.851+0000 7f3a85115700 1 Processor -- start 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.851+0000 7f3a85115700 1 -- start start 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.851+0000 7f3a85115700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fc830 0x7f3a8010cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.851+0000 7f3a85115700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a800fd100 0x7f3a8010d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.851+0000 7f3a85115700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8010d990 con 0x7f3a800fc830 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.851+0000 7f3a85115700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8010dad0 con 0x7f3a800fd100 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a7ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fc830 0x7f3a8010cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a7ed9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fc830 0x7f3a8010cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53488/0 (socket says 172.21.15.49:53488) 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a7ed9d700 1 -- 172.21.15.49:0/1028052566 learned_addr learned my addr 172.21.15.49:0/1028052566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a7e59c700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a800fd100 0x7f3a8010d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a7ed9d700 1 -- 172.21.15.49:0/1028052566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a800fd100 msgr2=0x7f3a8010d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a7ed9d700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a800fd100 0x7f3a8010d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a7ed9d700 1 -- 172.21.15.49:0/1028052566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68005040 con 0x7f3a800fc830 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a7ed9d700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fc830 0x7f3a8010cea0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f3a700041d0 tx=0x7f3a70009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a77fff700 1 -- 172.21.15.49:0/1028052566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a70007b40 con 0x7f3a800fc830 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a80107160 con 0x7f3a800fc830 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a77fff700 1 -- 172.21.15.49:0/1028052566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3a7000f040 con 0x7f3a800fc830 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a77fff700 1 -- 172.21.15.49:0/1028052566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a700147b0 con 0x7f3a800fc830 2024-02-22T01:00:16.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.852+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a80107720 con 0x7f3a800fc830 2024-02-22T01:00:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.853+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8005f380 con 0x7f3a800fc830 2024-02-22T01:00:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.854+0000 7f3a77fff700 1 -- 172.21.15.49:0/1028052566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3a70009110 con 0x7f3a800fc830 2024-02-22T01:00:16.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.854+0000 7f3a77fff700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a6c06caa0 0x7f3a6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.854+0000 7f3a77fff700 1 -- 172.21.15.49:0/1028052566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f3a7008bda0 con 0x7f3a800fc830 2024-02-22T01:00:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.854+0000 7f3a7e59c700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a6c06caa0 0x7f3a6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:16.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.855+0000 7f3a7e59c700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a6c06caa0 0x7f3a6c06ef60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f3a801087e0 tx=0x7f3a6800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:16.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:16.859+0000 7f3a77fff700 1 -- 172.21.15.49:0/1028052566 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3a70059900 con 0x7f3a800fc830 2024-02-22T01:00:17.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.102+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f3a8005eec0 con 0x7f3a800fc830 2024-02-22T01:00:17.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.103+0000 7f3a77fff700 1 -- 172.21.15.49:0/1028052566 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v33) v1 ==== 107+0+4822 (secure 0 0 0) 0x7f3a70059490 con 0x7f3a800fc830 2024-02-22T01:00:17.096 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:17.096 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44303,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/2117166336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2117166336},{"type":"v1","addr":"172.21.15.161:6825","nonce":2117166336}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:17.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a6c06caa0 msgr2=0x7f3a6c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a6c06caa0 0x7f3a6c06ef60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f3a801087e0 tx=0x7f3a6800b040).stop 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fc830 msgr2=0x7f3a8010cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fc830 0x7f3a8010cea0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f3a700041d0 tx=0x7f3a70009f60).stop 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 shutdown_connections 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f3a6c06caa0 0x7f3a6c06ef60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a800fc830 0x7f3a8010cea0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 --2- 172.21.15.49:0/1028052566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a800fd100 0x7f3a8010d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 >> 172.21.15.49:0/1028052566 conn(0x7f3a8006c760 msgr2=0x7f3a800fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 shutdown_connections 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.106+0000 7f3a85115700 1 -- 172.21.15.49:0/1028052566 wait complete. 2024-02-22T01:00:17.099 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 22 2024-02-22T01:00:17.111 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:17.111 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-22T01:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.240+0000 7f49bd0a7700 1 -- 172.21.15.49:0/565726625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 msgr2=0x7f49b80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.240+0000 7f49bd0a7700 1 --2- 172.21.15.49:0/565726625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 0x7f49b80fcc10 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f49a00047f0 tx=0x7f49a0009cb0).stop 2024-02-22T01:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.240+0000 7f49bd0a7700 1 -- 172.21.15.49:0/565726625 shutdown_connections 2024-02-22T01:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.240+0000 7f49bd0a7700 1 --2- 172.21.15.49:0/565726625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49b80fd100 0x7f49b80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.240+0000 7f49bd0a7700 1 --2- 172.21.15.49:0/565726625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 0x7f49b80fcc10 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.240+0000 7f49bd0a7700 1 -- 172.21.15.49:0/565726625 >> 172.21.15.49:0/565726625 conn(0x7f49b806c760 msgr2=0x7f49b806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.240+0000 7f49bd0a7700 1 -- 172.21.15.49:0/565726625 shutdown_connections 2024-02-22T01:00:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.240+0000 7f49bd0a7700 1 -- 172.21.15.49:0/565726625 wait complete. 2024-02-22T01:00:17.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.241+0000 7f49bd0a7700 1 Processor -- start 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.241+0000 7f49bd0a7700 1 -- start start 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49bd0a7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 0x7f49b810cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49bd0a7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49b80fd100 0x7f49b810d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49bd0a7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b810d990 con 0x7f49b80fc830 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49bd0a7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b810dad0 con 0x7f49b80fd100 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49b6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 0x7f49b810cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49b6d9d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 0x7f49b810cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53506/0 (socket says 172.21.15.49:53506) 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49b6d9d700 1 -- 172.21.15.49:0/3926498 learned_addr learned my addr 172.21.15.49:0/3926498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49b659c700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49b80fd100 0x7f49b810d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49b6d9d700 1 -- 172.21.15.49:0/3926498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49b80fd100 msgr2=0x7f49b810d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49b6d9d700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49b80fd100 0x7f49b810d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49b6d9d700 1 -- 172.21.15.49:0/3926498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a0005040 con 0x7f49b80fc830 2024-02-22T01:00:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49b6d9d700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 0x7f49b810cea0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f49a00043a0 tx=0x7f49a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49affff700 1 -- 172.21.15.49:0/3926498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a000e030 con 0x7f49b80fc830 2024-02-22T01:00:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49affff700 1 -- 172.21.15.49:0/3926498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49a0007e90 con 0x7f49b80fc830 2024-02-22T01:00:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b8107100 con 0x7f49b80fc830 2024-02-22T01:00:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.242+0000 7f49affff700 1 -- 172.21.15.49:0/3926498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a0018070 con 0x7f49b80fc830 2024-02-22T01:00:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.243+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b8107660 con 0x7f49b80fc830 2024-02-22T01:00:17.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.244+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b805f380 con 0x7f49b80fc830 2024-02-22T01:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.244+0000 7f49affff700 1 -- 172.21.15.49:0/3926498 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f49a00094c0 con 0x7f49b80fc830 2024-02-22T01:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.245+0000 7f49affff700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49a406cab0 0x7f49a406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.245+0000 7f49affff700 1 -- 172.21.15.49:0/3926498 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f49a008d6e0 con 0x7f49b80fc830 2024-02-22T01:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.245+0000 7f49b659c700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49a406cab0 0x7f49a406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.245+0000 7f49b659c700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49a406cab0 0x7f49a406ef70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f49b81087e0 tx=0x7f49a800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:17.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.249+0000 7f49affff700 1 -- 172.21.15.49:0/3926498 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f49a005b240 con 0x7f49b80fc830 2024-02-22T01:00:17.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:17 smithi049 ceph-mon[132694]: pgmap v702: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:17.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:17 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1278438497' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-22T01:00:17.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:17 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1028052566' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-22T01:00:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.493+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f49b805eec0 con 0x7f49b80fc830 2024-02-22T01:00:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.493+0000 7f49affff700 1 -- 172.21.15.49:0/3926498 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v33) v1 ==== 107+0+4040 (secure 0 0 0) 0x7f49a005add0 con 0x7f49b80fc830 2024-02-22T01:00:17.486 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:17.486 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49a406cab0 msgr2=0x7f49a406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49a406cab0 0x7f49a406ef70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f49b81087e0 tx=0x7f49a800b040).stop 2024-02-22T01:00:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 msgr2=0x7f49b810cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 0x7f49b810cea0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f49a00043a0 tx=0x7f49a0009cb0).stop 2024-02-22T01:00:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 shutdown_connections 2024-02-22T01:00:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f49a406cab0 0x7f49a406ef70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49b80fc830 0x7f49b810cea0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 --2- 172.21.15.49:0/3926498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49b80fd100 0x7f49b810d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 >> 172.21.15.49:0/3926498 conn(0x7f49b806c760 msgr2=0x7f49b80ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 shutdown_connections 2024-02-22T01:00:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.496+0000 7f49bd0a7700 1 -- 172.21.15.49:0/3926498 wait complete. 2024-02-22T01:00:17.489 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 23 2024-02-22T01:00:17.500 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:17.500 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 -- 172.21.15.49:0/3568327984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 msgr2=0x7fb44c0f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 --2- 172.21.15.49:0/3568327984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 0x7fb44c0f8dd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fb4480047f0 tx=0x7fb448009cb0).stop 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 -- 172.21.15.49:0/3568327984 shutdown_connections 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 --2- 172.21.15.49:0/3568327984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb44c0f92c0 0x7fb44c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 --2- 172.21.15.49:0/3568327984 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 0x7fb44c0f8dd0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 -- 172.21.15.49:0/3568327984 >> 172.21.15.49:0/3568327984 conn(0x7fb44c06c760 msgr2=0x7fb44c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 -- 172.21.15.49:0/3568327984 shutdown_connections 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 -- 172.21.15.49:0/3568327984 wait complete. 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 Processor -- start 2024-02-22T01:00:17.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.630+0000 7fb4542f9700 1 -- start start 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4542f9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 0x7fb44c0f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4542f9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb44c0f92c0 0x7fb44c0f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4542f9700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0f7380 con 0x7fb44c0f89f0 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4542f9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0f74c0 con 0x7fb44c0f92c0 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb452095700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 0x7fb44c0f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb452095700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 0x7fb44c0f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53520/0 (socket says 172.21.15.49:53520) 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb452095700 1 -- 172.21.15.49:0/3824791659 learned_addr learned my addr 172.21.15.49:0/3824791659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb451894700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb44c0f92c0 0x7fb44c0f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb452095700 1 -- 172.21.15.49:0/3824791659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb44c0f92c0 msgr2=0x7fb44c0f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb452095700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb44c0f92c0 0x7fb44c0f6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb452095700 1 -- 172.21.15.49:0/3824791659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb448005040 con 0x7fb44c0f89f0 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb452095700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 0x7fb44c0f69a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fb448009380 tx=0x7fb448009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:17.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4437fe700 1 -- 172.21.15.49:0/3824791659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44800e070 con 0x7fb44c0f89f0 2024-02-22T01:00:17.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4437fe700 1 -- 172.21.15.49:0/3824791659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb448007e90 con 0x7fb44c0f89f0 2024-02-22T01:00:17.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c0f7770 con 0x7fb44c0f89f0 2024-02-22T01:00:17.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4437fe700 1 -- 172.21.15.49:0/3824791659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb448018070 con 0x7fb44c0f89f0 2024-02-22T01:00:17.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.631+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c1145a0 con 0x7fb44c0f89f0 2024-02-22T01:00:17.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.632+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c05f380 con 0x7fb44c0f89f0 2024-02-22T01:00:17.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.633+0000 7fb4437fe700 1 -- 172.21.15.49:0/3824791659 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb44801d420 con 0x7fb44c0f89f0 2024-02-22T01:00:17.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.633+0000 7fb4437fe700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb43806caa0 0x7fb43806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:17.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.633+0000 7fb4437fe700 1 -- 172.21.15.49:0/3824791659 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb44808c870 con 0x7fb44c0f89f0 2024-02-22T01:00:17.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.633+0000 7fb451894700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb43806caa0 0x7fb43806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:17.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.634+0000 7fb451894700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb43806caa0 0x7fb43806ef60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fb43c009a00 tx=0x7fb43c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:17.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.638+0000 7fb4437fe700 1 -- 172.21.15.49:0/3824791659 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb448056a00 con 0x7fb44c0f89f0 2024-02-22T01:00:17.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:17 smithi161 ceph-mon[113442]: pgmap v702: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:17.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:17 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1278438497' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-22T01:00:17.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:17 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1028052566' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-22T01:00:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.878+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fb44c0f7f20 con 0x7fb44c0f89f0 2024-02-22T01:00:17.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.878+0000 7fb4437fe700 1 -- 172.21.15.49:0/3824791659 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v33) v1 ==== 107+0+4822 (secure 0 0 0) 0x7fb44805a020 con 0x7fb44c0f89f0 2024-02-22T01:00:17.871 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:17.871 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/338849788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":338849788},{"type":"v1","addr":"172.21.15.161:6827","nonce":338849788}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb43806caa0 msgr2=0x7fb43806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb43806caa0 0x7fb43806ef60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fb43c009a00 tx=0x7fb43c00b040).stop 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 msgr2=0x7fb44c0f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 0x7fb44c0f69a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fb448009380 tx=0x7fb448009cb0).stop 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 shutdown_connections 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fb43806caa0 0x7fb43806ef60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb44c0f89f0 0x7fb44c0f69a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 --2- 172.21.15.49:0/3824791659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb44c0f92c0 0x7fb44c0f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.880+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 >> 172.21.15.49:0/3824791659 conn(0x7fb44c06c760 msgr2=0x7fb44c0fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.881+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 shutdown_connections 2024-02-22T01:00:17.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:17.881+0000 7fb4542f9700 1 -- 172.21.15.49:0/3824791659 wait complete. 2024-02-22T01:00:17.874 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-02-22T01:00:17.885 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:17.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.013+0000 7fc2ff60e700 1 -- 172.21.15.49:0/13931351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fb720 msgr2=0x7fc2f80fbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.013+0000 7fc2ff60e700 1 --2- 172.21.15.49:0/13931351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fb720 0x7fc2f80fbb00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fc2f40047f0 tx=0x7fc2f4009cb0).stop 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.013+0000 7fc2ff60e700 1 -- 172.21.15.49:0/13931351 shutdown_connections 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.013+0000 7fc2ff60e700 1 --2- 172.21.15.49:0/13931351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80fc080 0x7fc2f80f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.013+0000 7fc2ff60e700 1 --2- 172.21.15.49:0/13931351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fb720 0x7fc2f80fbb00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.013+0000 7fc2ff60e700 1 -- 172.21.15.49:0/13931351 >> 172.21.15.49:0/13931351 conn(0x7fc2f806cb60 msgr2=0x7fc2f80f3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.013+0000 7fc2ff60e700 1 -- 172.21.15.49:0/13931351 shutdown_connections 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.013+0000 7fc2ff60e700 1 -- 172.21.15.49:0/13931351 wait complete. 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2ff60e700 1 Processor -- start 2024-02-22T01:00:18.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2ff60e700 1 -- start start 2024-02-22T01:00:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2ff60e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80fb720 0x7fc2f810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2ff60e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fc080 0x7fc2f810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2ff60e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f810ec00 con 0x7fc2f80fc080 2024-02-22T01:00:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2ff60e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8108220 con 0x7fc2f80fb720 2024-02-22T01:00:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2fcba9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fc080 0x7fc2f810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2fcba9700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fc080 0x7fc2f810e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53538/0 (socket says 172.21.15.49:53538) 2024-02-22T01:00:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2fcba9700 1 -- 172.21.15.49:0/3017029579 learned_addr learned my addr 172.21.15.49:0/3017029579 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:18.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2fcba9700 1 -- 172.21.15.49:0/3017029579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80fb720 msgr2=0x7fc2f810e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2fcba9700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80fb720 0x7fc2f810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.014+0000 7fc2fcba9700 1 -- 172.21.15.49:0/3017029579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4005040 con 0x7fc2f80fc080 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.015+0000 7fc2fcba9700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fc080 0x7fc2f810e570 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fc2ec00b440 tx=0x7fc2ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.015+0000 7fc2ea7fc700 1 -- 172.21.15.49:0/3017029579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2ec002500 con 0x7fc2f80fc080 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.015+0000 7fc2ea7fc700 1 -- 172.21.15.49:0/3017029579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2ec002b10 con 0x7fc2f80fc080 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.015+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f81084d0 con 0x7fc2f80fc080 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.015+0000 7fc2ea7fc700 1 -- 172.21.15.49:0/3017029579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2ec012c90 con 0x7fc2f80fc080 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.015+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f8108a10 con 0x7fc2f80fc080 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.016+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f80606f0 con 0x7fc2f80fc080 2024-02-22T01:00:18.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.016+0000 7fc2ea7fc700 1 -- 172.21.15.49:0/3017029579 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc2ec002660 con 0x7fc2f80fc080 2024-02-22T01:00:18.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.017+0000 7fc2ea7fc700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc2e406caa0 0x7fc2e406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.017+0000 7fc2fd3aa700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc2e406caa0 0x7fc2e406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:18.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.017+0000 7fc2ea7fc700 1 -- 172.21.15.49:0/3017029579 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc2ec08bee0 con 0x7fc2f80fc080 2024-02-22T01:00:18.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.017+0000 7fc2fd3aa700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc2e406caa0 0x7fc2e406ef60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fc2f40047f0 tx=0x7fc2f4009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:18.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.021+0000 7fc2ea7fc700 1 -- 172.21.15.49:0/3017029579 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc2ec059980 con 0x7fc2f80fc080 2024-02-22T01:00:18.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.262+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fc2f8109700 con 0x7fc2f80fc080 2024-02-22T01:00:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.263+0000 7fc2ea7fc700 1 -- 172.21.15.49:0/3017029579 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v33) v1 ==== 107+0+4043 (secure 0 0 0) 0x7fc2ec059510 con 0x7fc2f80fc080 2024-02-22T01:00:18.255 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:18.255 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc2e406caa0 msgr2=0x7fc2e406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc2e406caa0 0x7fc2e406ef60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fc2f40047f0 tx=0x7fc2f4009cb0).stop 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fc080 msgr2=0x7fc2f810e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fc080 0x7fc2f810e570 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fc2ec00b440 tx=0x7fc2ec009060).stop 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 shutdown_connections 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fc2e406caa0 0x7fc2e406ef60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f80fb720 0x7fc2f810e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 --2- 172.21.15.49:0/3017029579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc2f80fc080 0x7fc2f810e570 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 >> 172.21.15.49:0/3017029579 conn(0x7fc2f806cb60 msgr2=0x7fc2f80f5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 shutdown_connections 2024-02-22T01:00:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.265+0000 7fc2ff60e700 1 -- 172.21.15.49:0/3017029579 wait complete. 2024-02-22T01:00:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-02-22T01:00:18.269 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:18.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-22T01:00:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 -- 172.21.15.49:0/2456713085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 msgr2=0x7f29f4101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 --2- 172.21.15.49:0/2456713085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 0x7f29f4101a60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f29e40047f0 tx=0x7f29e4009cb0).stop 2024-02-22T01:00:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 -- 172.21.15.49:0/2456713085 shutdown_connections 2024-02-22T01:00:18.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 --2- 172.21.15.49:0/2456713085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 0x7f29f4101a60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 --2- 172.21.15.49:0/2456713085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f40f89f0 0x7f29f40f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 -- 172.21.15.49:0/2456713085 >> 172.21.15.49:0/2456713085 conn(0x7f29f406c760 msgr2=0x7f29f406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 -- 172.21.15.49:0/2456713085 shutdown_connections 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 -- 172.21.15.49:0/2456713085 wait complete. 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 Processor -- start 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.399+0000 7f29fa53f700 1 -- start start 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29fa53f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f40f89f0 0x7f29f410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29fa53f700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 0x7f29f410e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29fa53f700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f410eac0 con 0x7f29f40f92c0 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29fa53f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f410ec00 con 0x7f29f40f89f0 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 0x7f29f410e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f37fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 0x7f29f410e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53570/0 (socket says 172.21.15.49:53570) 2024-02-22T01:00:18.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f37fe700 1 -- 172.21.15.49:0/1189071451 learned_addr learned my addr 172.21.15.49:0/1189071451 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f3fff700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f40f89f0 0x7f29f410dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f37fe700 1 -- 172.21.15.49:0/1189071451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f40f89f0 msgr2=0x7f29f410dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f37fe700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f40f89f0 0x7f29f410dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f37fe700 1 -- 172.21.15.49:0/1189071451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4005040 con 0x7f29f40f92c0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f3fff700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f40f89f0 0x7f29f410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f37fe700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 0x7f29f410e4c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f29e4009380 tx=0x7f29e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29f17fa700 1 -- 172.21.15.49:0/1189071451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e400e070 con 0x7f29f40f92c0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.400+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f4108290 con 0x7f29f40f92c0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.401+0000 7f29f17fa700 1 -- 172.21.15.49:0/1189071451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29e4007e90 con 0x7f29f40f92c0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.401+0000 7f29f17fa700 1 -- 172.21.15.49:0/1189071451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e4018070 con 0x7f29f40f92c0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.401+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f41087d0 con 0x7f29f40f92c0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.401+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f405f380 con 0x7f29f40f92c0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.402+0000 7f29f17fa700 1 -- 172.21.15.49:0/1189071451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f29e401d420 con 0x7f29f40f92c0 2024-02-22T01:00:18.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.402+0000 7f29f17fa700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29e006caa0 0x7f29e006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.402+0000 7f29f17fa700 1 -- 172.21.15.49:0/1189071451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f29e408c8f0 con 0x7f29f40f92c0 2024-02-22T01:00:18.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.403+0000 7f29f3fff700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29e006caa0 0x7f29e006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:18.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.403+0000 7f29f3fff700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29e006caa0 0x7f29e006ef60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f29dc009250 tx=0x7f29dc009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:18.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.407+0000 7f29f17fa700 1 -- 172.21.15.49:0/1189071451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f29e405a450 con 0x7f29f40f92c0 2024-02-22T01:00:18.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.651+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f29f405eec0 con 0x7f29f40f92c0 2024-02-22T01:00:18.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.651+0000 7f29f17fa700 1 -- 172.21.15.49:0/1189071451 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v33) v1 ==== 107+0+4825 (secure 0 0 0) 0x7f29e4059fe0 con 0x7f29f40f92c0 2024-02-22T01:00:18.643 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:18.644 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44335,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/1231559763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1231559763},{"type":"v1","addr":"172.21.15.161:6827","nonce":1231559763}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:42:24.207001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29e006caa0 msgr2=0x7f29e006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29e006caa0 0x7f29e006ef60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f29dc009250 tx=0x7f29dc009d60).stop 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 msgr2=0x7f29f410e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 0x7f29f410e4c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f29e4009380 tx=0x7f29e4009cb0).stop 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 shutdown_connections 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f29e006caa0 0x7f29e006ef60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29f40f89f0 0x7f29f410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 --2- 172.21.15.49:0/1189071451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29f40f92c0 0x7f29f410e4c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 >> 172.21.15.49:0/1189071451 conn(0x7f29f406c760 msgr2=0x7f29f40fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:18.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 shutdown_connections 2024-02-22T01:00:18.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.654+0000 7f29fa53f700 1 -- 172.21.15.49:0/1189071451 wait complete. 2024-02-22T01:00:18.647 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-02-22T01:00:18.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:18 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3926498' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-22T01:00:18.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:18 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3824791659' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-22T01:00:18.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:18 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3017029579' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-22T01:00:18.658 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-02-22T01:00:18.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-22T01:00:18.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.787+0000 7f27b1313700 1 -- 172.21.15.49:0/2565449245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 msgr2=0x7f27ac101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.787+0000 7f27b1313700 1 --2- 172.21.15.49:0/2565449245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 0x7f27ac101a60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f27940047f0 tx=0x7f2794009cb0).stop 2024-02-22T01:00:18.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.787+0000 7f27b1313700 1 -- 172.21.15.49:0/2565449245 shutdown_connections 2024-02-22T01:00:18.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.787+0000 7f27b1313700 1 --2- 172.21.15.49:0/2565449245 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 0x7f27ac101a60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.787+0000 7f27b1313700 1 --2- 172.21.15.49:0/2565449245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27ac0f89f0 0x7f27ac0f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.787+0000 7f27b1313700 1 -- 172.21.15.49:0/2565449245 >> 172.21.15.49:0/2565449245 conn(0x7f27ac06c760 msgr2=0x7f27ac06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.787+0000 7f27b1313700 1 -- 172.21.15.49:0/2565449245 shutdown_connections 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.787+0000 7f27b1313700 1 -- 172.21.15.49:0/2565449245 wait complete. 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27b1313700 1 Processor -- start 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27b1313700 1 -- start start 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27b1313700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27ac0f89f0 0x7f27ac10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27b1313700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 0x7f27ac10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27b1313700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac10eb70 con 0x7f27ac0f92c0 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27b1313700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac108190 con 0x7f27ac0f89f0 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27aa7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 0x7f27ac10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27aa7fc700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 0x7f27ac10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53586/0 (socket says 172.21.15.49:53586) 2024-02-22T01:00:18.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27aa7fc700 1 -- 172.21.15.49:0/688930903 learned_addr learned my addr 172.21.15.49:0/688930903 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27aaffd700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27ac0f89f0 0x7f27ac10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27aa7fc700 1 -- 172.21.15.49:0/688930903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27ac0f89f0 msgr2=0x7f27ac10dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27aa7fc700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27ac0f89f0 0x7f27ac10dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27aa7fc700 1 -- 172.21.15.49:0/688930903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2794005040 con 0x7f27ac0f92c0 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.788+0000 7f27aaffd700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27ac0f89f0 0x7f27ac10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.789+0000 7f27aa7fc700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 0x7f27ac10e4e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f2794009380 tx=0x7f2794009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.789+0000 7f27a3fff700 1 -- 172.21.15.49:0/688930903 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f279400e030 con 0x7f27ac0f92c0 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.789+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ac108440 con 0x7f27ac0f92c0 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.789+0000 7f27a3fff700 1 -- 172.21.15.49:0/688930903 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2794007e90 con 0x7f27ac0f92c0 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.789+0000 7f27a3fff700 1 -- 172.21.15.49:0/688930903 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2794018070 con 0x7f27ac0f92c0 2024-02-22T01:00:18.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.789+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ac108980 con 0x7f27ac0f92c0 2024-02-22T01:00:18.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:18 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3926498' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-22T01:00:18.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:18 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3824791659' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-22T01:00:18.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:18 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3017029579' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-22T01:00:18.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.790+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ac05f380 con 0x7f27ac0f92c0 2024-02-22T01:00:18.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.790+0000 7f27a3fff700 1 -- 172.21.15.49:0/688930903 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f279401d420 con 0x7f27ac0f92c0 2024-02-22T01:00:18.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.791+0000 7f27a3fff700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f279806cab0 0x7f279806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:18.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.791+0000 7f27a3fff700 1 -- 172.21.15.49:0/688930903 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f279408d2e0 con 0x7f27ac0f92c0 2024-02-22T01:00:18.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.791+0000 7f27aaffd700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f279806cab0 0x7f279806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:18.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.791+0000 7f27aaffd700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f279806cab0 0x7f279806ef70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f279c00a900 tx=0x7f279c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:18.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:18.795+0000 7f27a3fff700 1 -- 172.21.15.49:0/688930903 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f279405ae40 con 0x7f27ac0f92c0 2024-02-22T01:00:19.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.037+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f27ac05eec0 con 0x7f27ac0f92c0 2024-02-22T01:00:19.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.038+0000 7f27a3fff700 1 -- 172.21.15.49:0/688930903 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v33) v1 ==== 107+0+4824 (secure 0 0 0) 0x7f279405a9d0 con 0x7f27ac0f92c0 2024-02-22T01:00:19.030 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:19.030 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44335,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/1231559763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1231559763},{"type":"v1","addr":"172.21.15.161:6827","nonce":1231559763}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:58:24.372518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:19.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f279806cab0 msgr2=0x7f279806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f279806cab0 0x7f279806ef70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f279c00a900 tx=0x7f279c008040).stop 2024-02-22T01:00:19.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 msgr2=0x7f27ac10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 0x7f27ac10e4e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f2794009380 tx=0x7f2794009cb0).stop 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 shutdown_connections 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f279806cab0 0x7f279806ef70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27ac0f89f0 0x7f27ac10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 --2- 172.21.15.49:0/688930903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27ac0f92c0 0x7f27ac10e4e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 >> 172.21.15.49:0/688930903 conn(0x7f27ac06c760 msgr2=0x7f27ac0fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 shutdown_connections 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.040+0000 7f27b1313700 1 -- 172.21.15.49:0/688930903 wait complete. 2024-02-22T01:00:19.033 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-02-22T01:00:19.045 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-22T01:00:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.173+0000 7f02be09e700 1 -- 172.21.15.49:0/868333703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f92c0 msgr2=0x7f02b8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.173+0000 7f02be09e700 1 --2- 172.21.15.49:0/868333703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f92c0 0x7f02b8101a60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f02ac0047f0 tx=0x7f02ac009cb0).stop 2024-02-22T01:00:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.173+0000 7f02be09e700 1 -- 172.21.15.49:0/868333703 shutdown_connections 2024-02-22T01:00:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.173+0000 7f02be09e700 1 --2- 172.21.15.49:0/868333703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f92c0 0x7f02b8101a60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.173+0000 7f02be09e700 1 --2- 172.21.15.49:0/868333703 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b80f89f0 0x7f02b80f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.173+0000 7f02be09e700 1 -- 172.21.15.49:0/868333703 >> 172.21.15.49:0/868333703 conn(0x7f02b806c760 msgr2=0x7f02b806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:19.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.173+0000 7f02be09e700 1 -- 172.21.15.49:0/868333703 shutdown_connections 2024-02-22T01:00:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.173+0000 7f02be09e700 1 -- 172.21.15.49:0/868333703 wait complete. 2024-02-22T01:00:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.174+0000 7f02be09e700 1 Processor -- start 2024-02-22T01:00:19.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.174+0000 7f02be09e700 1 -- start start 2024-02-22T01:00:19.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.174+0000 7f02be09e700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f89f0 0x7f02b810dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.174+0000 7f02be09e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b80f92c0 0x7f02b810e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.174+0000 7f02be09e700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b810eac0 con 0x7f02b80f89f0 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.174+0000 7f02be09e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b810ec00 con 0x7f02b80f92c0 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f89f0 0x7f02b810dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f89f0 0x7f02b810dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53600/0 (socket says 172.21.15.49:53600) 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b77fe700 1 -- 172.21.15.49:0/2349436146 learned_addr learned my addr 172.21.15.49:0/2349436146 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b6ffd700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b80f92c0 0x7f02b810e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b77fe700 1 -- 172.21.15.49:0/2349436146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b80f92c0 msgr2=0x7f02b810e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b77fe700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b80f92c0 0x7f02b810e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b77fe700 1 -- 172.21.15.49:0/2349436146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac005040 con 0x7f02b80f89f0 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b77fe700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f89f0 0x7f02b810dfd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f02a800c740 tx=0x7f02a8007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b4ff9700 1 -- 172.21.15.49:0/2349436146 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a800e680 con 0x7f02b80f89f0 2024-02-22T01:00:19.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b4ff9700 1 -- 172.21.15.49:0/2349436146 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02a800ec90 con 0x7f02b80f89f0 2024-02-22T01:00:19.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b8108290 con 0x7f02b80f89f0 2024-02-22T01:00:19.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02b4ff9700 1 -- 172.21.15.49:0/2349436146 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02a8013d30 con 0x7f02b80f89f0 2024-02-22T01:00:19.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.175+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b81087d0 con 0x7f02b80f89f0 2024-02-22T01:00:19.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.176+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b805f380 con 0x7f02b80f89f0 2024-02-22T01:00:19.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.177+0000 7f02b4ff9700 1 -- 172.21.15.49:0/2349436146 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f02a8013410 con 0x7f02b80f89f0 2024-02-22T01:00:19.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.177+0000 7f02b4ff9700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02a006cab0 0x7f02a006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.177+0000 7f02b4ff9700 1 -- 172.21.15.49:0/2349436146 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f02a808bfa0 con 0x7f02b80f89f0 2024-02-22T01:00:19.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.177+0000 7f02b6ffd700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02a006cab0 0x7f02a006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:19.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.178+0000 7f02b6ffd700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02a006cab0 0x7f02a006ef70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f02ac0135d0 tx=0x7f02ac009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:19.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.182+0000 7f02b4ff9700 1 -- 172.21.15.49:0/2349436146 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f02a8059b00 con 0x7f02b80f89f0 2024-02-22T01:00:19.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.424+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f02b81096f0 con 0x7f02b80f89f0 2024-02-22T01:00:19.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.424+0000 7f02b4ff9700 1 -- 172.21.15.49:0/2349436146 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v33) v1 ==== 107+0+4847 (secure 0 0 0) 0x7f02a8059690 con 0x7f02b80f89f0 2024-02-22T01:00:19.417 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:19.417 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44335,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/1231559763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1231559763},{"type":"v1","addr":"172.21.15.161:6827","nonce":1231559763}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:58:24.376154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34382":{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":1,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:19.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02a006cab0 msgr2=0x7f02a006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02a006cab0 0x7f02a006ef70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f02ac0135d0 tx=0x7f02ac009cb0).stop 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f89f0 msgr2=0x7f02b810dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f89f0 0x7f02b810dfd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f02a800c740 tx=0x7f02a8007ef0).stop 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 shutdown_connections 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f02a006cab0 0x7f02a006ef70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02b80f89f0 0x7f02b810dfd0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 --2- 172.21.15.49:0/2349436146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b80f92c0 0x7f02b810e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.426+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 >> 172.21.15.49:0/2349436146 conn(0x7f02b806c760 msgr2=0x7f02b80fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.427+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 shutdown_connections 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.427+0000 7f02be09e700 1 -- 172.21.15.49:0/2349436146 wait complete. 2024-02-22T01:00:19.419 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 28 2024-02-22T01:00:19.431 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-22T01:00:19.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.560+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/1528486209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f92c0 msgr2=0x7f4ab0101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.560+0000 7f4ab7a8c700 1 --2- 172.21.15.49:0/1528486209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f92c0 0x7f4ab0101a60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f4aac0047f0 tx=0x7f4aac009cb0).stop 2024-02-22T01:00:19.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.560+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/1528486209 shutdown_connections 2024-02-22T01:00:19.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.560+0000 7f4ab7a8c700 1 --2- 172.21.15.49:0/1528486209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f92c0 0x7f4ab0101a60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.560+0000 7f4ab7a8c700 1 --2- 172.21.15.49:0/1528486209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ab00f89f0 0x7f4ab00f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.560+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/1528486209 >> 172.21.15.49:0/1528486209 conn(0x7f4ab006c760 msgr2=0x7f4ab006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:19.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.560+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/1528486209 shutdown_connections 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.560+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/1528486209 wait complete. 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab7a8c700 1 Processor -- start 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab7a8c700 1 -- start start 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab7a8c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f89f0 0x7f4ab0110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab7a8c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ab00f92c0 0x7f4ab0110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab7a8c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0110c60 con 0x7f4ab00f89f0 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab7a8c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0110da0 con 0x7f4ab00f92c0 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5828700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f89f0 0x7f4ab0110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5828700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f89f0 0x7f4ab0110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53614/0 (socket says 172.21.15.49:53614) 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5828700 1 -- 172.21.15.49:0/4007326195 learned_addr learned my addr 172.21.15.49:0/4007326195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5027700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ab00f92c0 0x7f4ab0110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5828700 1 -- 172.21.15.49:0/4007326195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ab00f92c0 msgr2=0x7f4ab0110660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5828700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ab00f92c0 0x7f4ab0110660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5828700 1 -- 172.21.15.49:0/4007326195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac005040 con 0x7f4ab00f89f0 2024-02-22T01:00:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5027700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ab00f92c0 0x7f4ab0110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T01:00:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.561+0000 7f4ab5828700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f89f0 0x7f4ab0110170 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f4aa000c790 tx=0x7f4aa0004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.562+0000 7f4aa6f78700 1 -- 172.21.15.49:0/4007326195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aa00106f0 con 0x7f4ab00f89f0 2024-02-22T01:00:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.562+0000 7f4aa6f78700 1 -- 172.21.15.49:0/4007326195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4aa0010d00 con 0x7f4ab00f89f0 2024-02-22T01:00:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.562+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab010a470 con 0x7f4ab00f89f0 2024-02-22T01:00:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.562+0000 7f4aa6f78700 1 -- 172.21.15.49:0/4007326195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4aa0012da0 con 0x7f4ab00f89f0 2024-02-22T01:00:19.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.562+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab010a9b0 con 0x7f4ab00f89f0 2024-02-22T01:00:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.563+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab005f380 con 0x7f4ab00f89f0 2024-02-22T01:00:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.563+0000 7f4aa6f78700 1 -- 172.21.15.49:0/4007326195 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4aa0012400 con 0x7f4ab00f89f0 2024-02-22T01:00:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.563+0000 7f4aa6f78700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a9c06caa0 0x7f4a9c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.564+0000 7f4aa6f78700 1 -- 172.21.15.49:0/4007326195 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4aa008b6a0 con 0x7f4ab00f89f0 2024-02-22T01:00:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.564+0000 7f4ab5027700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a9c06caa0 0x7f4a9c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:19.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.564+0000 7f4ab5027700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a9c06caa0 0x7f4a9c06ef60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f4aac000c00 tx=0x7f4aac00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:19.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.568+0000 7f4aa6f78700 1 -- 172.21.15.49:0/4007326195 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4aa0055770 con 0x7f4ab00f89f0 2024-02-22T01:00:19.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:19 smithi049 ceph-mon[132694]: pgmap v703: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:19.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:19 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1189071451' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-22T01:00:19.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:19 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/688930903' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-22T01:00:19.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:19 smithi161 ceph-mon[113442]: pgmap v703: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:19.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:19 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1189071451' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-22T01:00:19.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:19 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/688930903' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-22T01:00:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.809+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f4ab01013d0 con 0x7f4ab00f89f0 2024-02-22T01:00:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.810+0000 7f4aa6f78700 1 -- 172.21.15.49:0/4007326195 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v33) v1 ==== 107+0+4850 (secure 0 0 0) 0x7f4aa0058d90 con 0x7f4ab00f89f0 2024-02-22T01:00:19.802 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:19.802 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44335,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/1231559763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1231559763},{"type":"v1","addr":"172.21.15.161:6827","nonce":1231559763}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:58:31.458266+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34382":{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":1,"incarnation":28,"state":"up:resolve","state_seq":237,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a9c06caa0 msgr2=0x7f4a9c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a9c06caa0 0x7f4a9c06ef60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f4aac000c00 tx=0x7f4aac00b040).stop 2024-02-22T01:00:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f89f0 msgr2=0x7f4ab0110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f89f0 0x7f4ab0110170 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f4aa000c790 tx=0x7f4aa0004330).stop 2024-02-22T01:00:19.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 shutdown_connections 2024-02-22T01:00:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4a9c06caa0 0x7f4a9c06ef60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ab00f89f0 0x7f4ab0110170 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 --2- 172.21.15.49:0/4007326195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ab00f92c0 0x7f4ab0110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 >> 172.21.15.49:0/4007326195 conn(0x7f4ab006c760 msgr2=0x7f4ab00f67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 shutdown_connections 2024-02-22T01:00:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.812+0000 7f4ab7a8c700 1 -- 172.21.15.49:0/4007326195 wait complete. 2024-02-22T01:00:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 29 2024-02-22T01:00:19.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-22T01:00:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.945+0000 7f4d224ec700 1 -- 172.21.15.49:0/3568053975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fe250 msgr2=0x7f4d1c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.945+0000 7f4d224ec700 1 --2- 172.21.15.49:0/3568053975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fe250 0x7f4d1c0f7a30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f4d040047f0 tx=0x7f4d04009cb0).stop 2024-02-22T01:00:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.945+0000 7f4d224ec700 1 -- 172.21.15.49:0/3568053975 shutdown_connections 2024-02-22T01:00:19.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.945+0000 7f4d224ec700 1 --2- 172.21.15.49:0/3568053975 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fe250 0x7f4d1c0f7a30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.945+0000 7f4d224ec700 1 --2- 172.21.15.49:0/3568053975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d1c0fd8f0 0x7f4d1c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.945+0000 7f4d224ec700 1 -- 172.21.15.49:0/3568053975 >> 172.21.15.49:0/3568053975 conn(0x7f4d1c0f34d0 msgr2=0x7f4d1c0f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.945+0000 7f4d224ec700 1 -- 172.21.15.49:0/3568053975 shutdown_connections 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.945+0000 7f4d224ec700 1 -- 172.21.15.49:0/3568053975 wait complete. 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d224ec700 1 Processor -- start 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d224ec700 1 -- start start 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d224ec700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fd8f0 0x7f4d1c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d224ec700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d1c0fe250 0x7f4d1c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d224ec700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c06bab0 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d224ec700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c06bbf0 con 0x7f4d1c0fe250 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d1bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fd8f0 0x7f4d1c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d1bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fd8f0 0x7f4d1c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53634/0 (socket says 172.21.15.49:53634) 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.946+0000 7f4d1bfff700 1 -- 172.21.15.49:0/2790566698 learned_addr learned my addr 172.21.15.49:0/2790566698 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:19.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d1bfff700 1 -- 172.21.15.49:0/2790566698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d1c0fe250 msgr2=0x7f4d1c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d1bfff700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d1c0fe250 0x7f4d1c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d1bfff700 1 -- 172.21.15.49:0/2790566698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04005040 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d1bfff700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fd8f0 0x7f4d1c06b0d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f4d0c00b4b0 tx=0x7f4d0c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d19ffb700 1 -- 172.21.15.49:0/2790566698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d0c002500 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d19ffb700 1 -- 172.21.15.49:0/2790566698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d0c002b10 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c06bea0 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d19ffb700 1 -- 172.21.15.49:0/2790566698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d0c012cf0 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.947+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c114730 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.948+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c05f360 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.948+0000 7f4d19ffb700 1 -- 172.21.15.49:0/2790566698 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4d0c002660 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.949+0000 7f4d19ffb700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4d0806cab0 0x7f4d0806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:19.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.949+0000 7f4d19ffb700 1 -- 172.21.15.49:0/2790566698 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4d0c08be80 con 0x7f4d1c0fd8f0 2024-02-22T01:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.949+0000 7f4d13fff700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4d0806cab0 0x7f4d0806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:19.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.949+0000 7f4d13fff700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4d0806cab0 0x7f4d0806ef70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f4d04004710 tx=0x7f4d04009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:19.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:19.953+0000 7f4d19ffb700 1 -- 172.21.15.49:0/2790566698 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4d0c055f50 con 0x7f4d1c0fd8f0 2024-02-22T01:00:20.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.197+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f4d1c05eec0 con 0x7f4d1c0fd8f0 2024-02-22T01:00:20.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.198+0000 7f4d19ffb700 1 -- 172.21.15.49:0/2790566698 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v33) v1 ==== 107+0+4853 (secure 0 0 0) 0x7f4d0c059570 con 0x7f4d1c0fd8f0 2024-02-22T01:00:20.190 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:20.190 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44335,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/1231559763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1231559763},{"type":"v1","addr":"172.21.15.161:6827","nonce":1231559763}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:58:32.459478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":28,"state":"up:resolve","state_seq":241,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34382":{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":1,"incarnation":28,"state":"up:resolve","state_seq":237,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:20.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4d0806cab0 msgr2=0x7f4d0806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4d0806cab0 0x7f4d0806ef70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f4d04004710 tx=0x7f4d04009cb0).stop 2024-02-22T01:00:20.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fd8f0 msgr2=0x7f4d1c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fd8f0 0x7f4d1c06b0d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f4d0c00b4b0 tx=0x7f4d0c0090f0).stop 2024-02-22T01:00:20.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 shutdown_connections 2024-02-22T01:00:20.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f4d0806cab0 0x7f4d0806ef70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d1c0fd8f0 0x7f4d1c06b0d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 --2- 172.21.15.49:0/2790566698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d1c0fe250 0x7f4d1c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 >> 172.21.15.49:0/2790566698 conn(0x7f4d1c0f34d0 msgr2=0x7f4d1c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 shutdown_connections 2024-02-22T01:00:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.200+0000 7f4d224ec700 1 -- 172.21.15.49:0/2790566698 wait complete. 2024-02-22T01:00:20.193 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 30 2024-02-22T01:00:20.204 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-22T01:00:20.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.333+0000 7fd4ecc50700 1 -- 172.21.15.49:0/221247910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 msgr2=0x7fd4e80fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.333+0000 7fd4ecc50700 1 --2- 172.21.15.49:0/221247910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 0x7fd4e80fccc0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fd4dc0047f0 tx=0x7fd4dc009cb0).stop 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.333+0000 7fd4ecc50700 1 -- 172.21.15.49:0/221247910 shutdown_connections 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.333+0000 7fd4ecc50700 1 --2- 172.21.15.49:0/221247910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4e80fd240 0x7fd4e80f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.333+0000 7fd4ecc50700 1 --2- 172.21.15.49:0/221247910 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 0x7fd4e80fccc0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.333+0000 7fd4ecc50700 1 -- 172.21.15.49:0/221247910 >> 172.21.15.49:0/221247910 conn(0x7fd4e80f24e0 msgr2=0x7fd4e80f4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.333+0000 7fd4ecc50700 1 -- 172.21.15.49:0/221247910 shutdown_connections 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.333+0000 7fd4ecc50700 1 -- 172.21.15.49:0/221247910 wait complete. 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4ecc50700 1 Processor -- start 2024-02-22T01:00:20.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4ecc50700 1 -- start start 2024-02-22T01:00:20.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4ecc50700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 0x7fd4e8109130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4ecc50700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4e80fd240 0x7fd4e8109620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4ecc50700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8109b10 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4ecc50700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8109c50 con 0x7fd4e80fd240 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 0x7fd4e8109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e659c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 0x7fd4e8109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53648/0 (socket says 172.21.15.49:53648) 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e659c700 1 -- 172.21.15.49:0/3789180133 learned_addr learned my addr 172.21.15.49:0/3789180133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e5d9b700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4e80fd240 0x7fd4e8109620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e659c700 1 -- 172.21.15.49:0/3789180133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4e80fd240 msgr2=0x7fd4e8109620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e659c700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4e80fd240 0x7fd4e8109620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e659c700 1 -- 172.21.15.49:0/3789180133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc005040 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e5d9b700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4e80fd240 0x7fd4e8109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T01:00:20.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.334+0000 7fd4e659c700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 0x7fd4e8109130 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fd4dc005010 tx=0x7fd4dc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.335+0000 7fd4d77fe700 1 -- 172.21.15.49:0/3789180133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4dc00e030 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.335+0000 7fd4d77fe700 1 -- 172.21.15.49:0/3789180133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd4dc007e90 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.335+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e8109ea0 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.335+0000 7fd4d77fe700 1 -- 172.21.15.49:0/3789180133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4dc018070 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.335+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e8112410 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.336+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e805f2e0 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.336+0000 7fd4d77fe700 1 -- 172.21.15.49:0/3789180133 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd4dc01d6e0 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.336+0000 7fd4d77fe700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd4d006ca30 0x7fd4d006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.337+0000 7fd4d77fe700 1 -- 172.21.15.49:0/3789180133 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd4dc08d050 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.337+0000 7fd4e5d9b700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd4d006ca30 0x7fd4d006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:20.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.337+0000 7fd4e5d9b700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd4d006ca30 0x7fd4d006eef0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fd4d8009a00 tx=0x7fd4d800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:20.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.341+0000 7fd4d77fe700 1 -- 172.21.15.49:0/3789180133 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd4dc05abb0 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.583+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fd4e80fec70 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.583+0000 7fd4d77fe700 1 -- 172.21.15.49:0/3789180133 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v33) v1 ==== 107+0+4857 (secure 0 0 0) 0x7fd4dc05a740 con 0x7fd4e80fc8e0 2024-02-22T01:00:20.575 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:20.576 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44335,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/1231559763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1231559763},{"type":"v1","addr":"172.21.15.161:6827","nonce":1231559763}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:58:33.464073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":242,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34382":{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":1,"incarnation":28,"state":"up:reconnect","state_seq":238,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.585+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd4d006ca30 msgr2=0x7fd4d006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.585+0000 7fd4ecc50700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd4d006ca30 0x7fd4d006eef0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fd4d8009a00 tx=0x7fd4d800b040).stop 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.585+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 msgr2=0x7fd4e8109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.585+0000 7fd4ecc50700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 0x7fd4e8109130 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fd4dc005010 tx=0x7fd4dc009cb0).stop 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.586+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 shutdown_connections 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.586+0000 7fd4ecc50700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fd4d006ca30 0x7fd4d006eef0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.586+0000 7fd4ecc50700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4e80fc8e0 0x7fd4e8109130 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.586+0000 7fd4ecc50700 1 --2- 172.21.15.49:0/3789180133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4e80fd240 0x7fd4e8109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.586+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 >> 172.21.15.49:0/3789180133 conn(0x7fd4e80f24e0 msgr2=0x7fd4e80faca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.586+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 shutdown_connections 2024-02-22T01:00:20.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.586+0000 7fd4ecc50700 1 -- 172.21.15.49:0/3789180133 wait complete. 2024-02-22T01:00:20.579 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 31 2024-02-22T01:00:20.588 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:20 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2349436146' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-22T01:00:20.589 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:20 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4007326195' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-22T01:00:20.589 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:20 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2790566698' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-22T01:00:20.590 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-22T01:00:20.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.718+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1001475666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 msgr2=0x7fa1580f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.718+0000 7fa15ca6c700 1 --2- 172.21.15.49:0/1001475666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 0x7fa1580f7a30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fa1400047f0 tx=0x7fa140009cb0).stop 2024-02-22T01:00:20.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.718+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1001475666 shutdown_connections 2024-02-22T01:00:20.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.718+0000 7fa15ca6c700 1 --2- 172.21.15.49:0/1001475666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 0x7fa1580f7a30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.718+0000 7fa15ca6c700 1 --2- 172.21.15.49:0/1001475666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1580fd8f0 0x7fa1580fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.718+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1001475666 >> 172.21.15.49:0/1001475666 conn(0x7fa1580f34d0 msgr2=0x7fa1580f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:20.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.718+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1001475666 shutdown_connections 2024-02-22T01:00:20.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.718+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1001475666 wait complete. 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa15ca6c700 1 Processor -- start 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa15ca6c700 1 -- start start 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa15ca6c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1580fd8f0 0x7fa158110220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa15ca6c700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 0x7fa158110710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa15ca6c700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158110d10 con 0x7fa1580fe250 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa15ca6c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158110e50 con 0x7fa1580fd8f0 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa155d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 0x7fa158110710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa155d9b700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 0x7fa158110710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53668/0 (socket says 172.21.15.49:53668) 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.719+0000 7fa155d9b700 1 -- 172.21.15.49:0/1551261158 learned_addr learned my addr 172.21.15.49:0/1551261158 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:20.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa15659c700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1580fd8f0 0x7fa158110220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa155d9b700 1 -- 172.21.15.49:0/1551261158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1580fd8f0 msgr2=0x7fa158110220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa155d9b700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1580fd8f0 0x7fa158110220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa155d9b700 1 -- 172.21.15.49:0/1551261158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140005040 con 0x7fa1580fe250 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa155d9b700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 0x7fa158110710 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fa140000c00 tx=0x7fa140009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa14f7fe700 1 -- 172.21.15.49:0/1551261158 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa14000e030 con 0x7fa1580fe250 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa14f7fe700 1 -- 172.21.15.49:0/1551261158 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa140007e90 con 0x7fa1580fe250 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa14f7fe700 1 -- 172.21.15.49:0/1551261158 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa140018070 con 0x7fa1580fe250 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15810a480 con 0x7fa1580fe250 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.720+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15810a960 con 0x7fa1580fe250 2024-02-22T01:00:20.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.721+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15805f360 con 0x7fa1580fe250 2024-02-22T01:00:20.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.722+0000 7fa14f7fe700 1 -- 172.21.15.49:0/1551261158 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa14001d420 con 0x7fa1580fe250 2024-02-22T01:00:20.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.722+0000 7fa14f7fe700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa14406cab0 0x7fa14406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:20.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.722+0000 7fa14f7fe700 1 -- 172.21.15.49:0/1551261158 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa14008cf30 con 0x7fa1580fe250 2024-02-22T01:00:20.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.722+0000 7fa15659c700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa14406cab0 0x7fa14406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:20.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.722+0000 7fa15659c700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa14406cab0 0x7fa14406ef70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fa148004dc0 tx=0x7fa14800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:20.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.726+0000 7fa14f7fe700 1 -- 172.21.15.49:0/1551261158 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa1400c0190 con 0x7fa1580fe250 2024-02-22T01:00:20.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:20 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2349436146' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-22T01:00:20.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:20 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4007326195' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-22T01:00:20.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:20 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2790566698' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-22T01:00:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.970+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7fa15810b8d0 con 0x7fa1580fe250 2024-02-22T01:00:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.970+0000 7fa14f7fe700 1 -- 172.21.15.49:0/1551261158 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v33) v1 ==== 107+0+4851 (secure 0 0 0) 0x7fa14005aa90 con 0x7fa1580fe250 2024-02-22T01:00:20.963 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:20.963 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44331,"name":"cephfs.smithi161.wycpud","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6825/1420583505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":1420583505},{"type":"v1","addr":"172.21.15.161:6825","nonce":1420583505}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44335,"name":"cephfs.smithi161.plrhpg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6827/1231559763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":1231559763},{"type":"v1","addr":"172.21.15.161:6827","nonce":1231559763}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-22T00:30:38.229820+0000","modified":"2024-02-22T00:58:34.465718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi049.vwomak","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":243,"addr":"172.21.15.49:6827/2292918873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":2292918873},{"type":"v1","addr":"172.21.15.49:6827","nonce":2292918873}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34382":{"gid":34382,"name":"cephfs.smithi049.rrqshp","rank":1,"incarnation":28,"state":"up:rejoin","state_seq":239,"addr":"172.21.15.49:6829/1528771222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":1528771222},{"type":"v1","addr":"172.21.15.49:6829","nonce":1528771222}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-22T01:00:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa14406cab0 msgr2=0x7fa14406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa14406cab0 0x7fa14406ef70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fa148004dc0 tx=0x7fa14800b040).stop 2024-02-22T01:00:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 msgr2=0x7fa158110710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 0x7fa158110710 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fa140000c00 tx=0x7fa140009cb0).stop 2024-02-22T01:00:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 shutdown_connections 2024-02-22T01:00:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa14406cab0 0x7fa14406ef70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1580fd8f0 0x7fa158110220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 --2- 172.21.15.49:0/1551261158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa1580fe250 0x7fa158110710 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 >> 172.21.15.49:0/1551261158 conn(0x7fa1580f34d0 msgr2=0x7fa15806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 shutdown_connections 2024-02-22T01:00:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:20.973+0000 7fa15ca6c700 1 -- 172.21.15.49:0/1551261158 wait complete. 2024-02-22T01:00:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 32 2024-02-22T01:00:20.977 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-22T01:00:20.989 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-22T01:00:20.989 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T01:00:20.990 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-22T01:00:21.012 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T01:00:21.012 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-22T01:00:21.074 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-22T01:00:21.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.241+0000 7f8c9189d700 1 -- 172.21.15.49:0/131794869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 msgr2=0x7f8c8c0fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.241+0000 7f8c9189d700 1 --2- 172.21.15.49:0/131794869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 0x7f8c8c0fcb10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f8c7c0047f0 tx=0x7f8c7c009cb0).stop 2024-02-22T01:00:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.241+0000 7f8c9189d700 1 -- 172.21.15.49:0/131794869 shutdown_connections 2024-02-22T01:00:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.241+0000 7f8c9189d700 1 --2- 172.21.15.49:0/131794869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c8c0fd090 0x7f8c8c0f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.241+0000 7f8c9189d700 1 --2- 172.21.15.49:0/131794869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 0x7f8c8c0fcb10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.241+0000 7f8c9189d700 1 -- 172.21.15.49:0/131794869 >> 172.21.15.49:0/131794869 conn(0x7f8c8c06c760 msgr2=0x7f8c8c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.241+0000 7f8c9189d700 1 -- 172.21.15.49:0/131794869 shutdown_connections 2024-02-22T01:00:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.241+0000 7f8c9189d700 1 -- 172.21.15.49:0/131794869 wait complete. 2024-02-22T01:00:21.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.242+0000 7f8c9189d700 1 Processor -- start 2024-02-22T01:00:21.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.242+0000 7f8c9189d700 1 -- start start 2024-02-22T01:00:21.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.242+0000 7f8c9189d700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 0x7f8c8c10cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.242+0000 7f8c9189d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c8c0fd090 0x7f8c8c10d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.242+0000 7f8c9189d700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c10d8e0 con 0x7f8c8c0fc730 2024-02-22T01:00:21.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.242+0000 7f8c9189d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c10da20 con 0x7f8c8c0fd090 2024-02-22T01:00:21.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c8affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 0x7f8c8c10cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c8affd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 0x7f8c8c10cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53678/0 (socket says 172.21.15.49:53678) 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c8affd700 1 -- 172.21.15.49:0/4028513295 learned_addr learned my addr 172.21.15.49:0/4028513295 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c8a7fc700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c8c0fd090 0x7f8c8c10d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c8affd700 1 -- 172.21.15.49:0/4028513295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c8c0fd090 msgr2=0x7f8c8c10d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c8affd700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c8c0fd090 0x7f8c8c10d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c8affd700 1 -- 172.21.15.49:0/4028513295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c005040 con 0x7f8c8c0fc730 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c8affd700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 0x7f8c8c10cdf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f8c7c0043a0 tx=0x7f8c7c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c83fff700 1 -- 172.21.15.49:0/4028513295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7c00e030 con 0x7f8c8c0fc730 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c83fff700 1 -- 172.21.15.49:0/4028513295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c7c007e90 con 0x7f8c8c0fc730 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8c107050 con 0x7f8c8c0fc730 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c83fff700 1 -- 172.21.15.49:0/4028513295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7c018070 con 0x7f8c8c0fc730 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.243+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8c1075b0 con 0x7f8c8c0fc730 2024-02-22T01:00:21.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.244+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8c05f380 con 0x7f8c8c0fc730 2024-02-22T01:00:21.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.245+0000 7f8c83fff700 1 -- 172.21.15.49:0/4028513295 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8c7c0094c0 con 0x7f8c8c0fc730 2024-02-22T01:00:21.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.245+0000 7f8c83fff700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8c7806cab0 0x7f8c7806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.245+0000 7f8c83fff700 1 -- 172.21.15.49:0/4028513295 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8c7c08cf20 con 0x7f8c8c0fc730 2024-02-22T01:00:21.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.245+0000 7f8c8a7fc700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8c7806cab0 0x7f8c7806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.245+0000 7f8c8a7fc700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8c7806cab0 0x7f8c7806ef70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f8c8c108730 tx=0x7f8c7400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:21.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.250+0000 7f8c83fff700 1 -- 172.21.15.49:0/4028513295 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8c7c0c0190 con 0x7f8c8c0fc730 2024-02-22T01:00:21.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.450+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c8c05eec0 con 0x7f8c8c0fc730 2024-02-22T01:00:21.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.451+0000 7f8c83fff700 1 -- 172.21.15.49:0/4028513295 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16137 (secure 0 0 0) 0x7f8c7c05aa80 con 0x7f8c8c0fc730 2024-02-22T01:00:21.444 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:21.444 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","created":"2024-02-22T00:24:07.498307+0000","modified":"2024-02-22T00:43:17.221392+0000","last_up_change":"2024-02-22T00:42:21.961319+0000","last_in_change":"2024-02-22T00:29:00.339229+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-22T00:28:03.647916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-22T00:30:37.161023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-22T00:30:37.647309+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14701491-880b-4aa8-b29c-2f93fad67550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6803","nonce":2349267451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6805","nonce":2349267451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6809","nonce":2349267451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6807","nonce":2349267451}]},"public_addr":"172.21.15.49:6803/2349267451","cluster_addr":"172.21.15.49:6805/2349267451","heartbeat_back_addr":"172.21.15.49:6809/2349267451","heartbeat_front_addr":"172.21.15.49:6807/2349267451","state":["exists","up"]},{"osd":1,"uuid":"6a984f0c-ab4d-4881-baf7-7821af596292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6811","nonce":3701332011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6813","nonce":3701332011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6817","nonce":3701332011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6815","nonce":3701332011}]},"public_addr":"172.21.15.49:6811/3701332011","cluster_addr":"172.21.15.49:6813/3701332011","heartbeat_back_addr":"172.21.15.49:6817/3701332011","heartbeat_front_addr":"172.21.15.49:6815/3701332011","state":["exists","up"]},{"osd":2,"uuid":"fdbc04fa-88df-4bd8-9272-38e17a0ddc99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6819","nonce":4257132266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6821","nonce":4257132266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6825","nonce":4257132266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6823","nonce":4257132266}]},"public_addr":"172.21.15.49:6819/4257132266","cluster_addr":"172.21.15.49:6821/4257132266","heartbeat_back_addr":"172.21.15.49:6825/4257132266","heartbeat_front_addr":"172.21.15.49:6823/4257132266","state":["exists","up"]},{"osd":3,"uuid":"b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6801","nonce":4220305275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6803","nonce":4220305275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6807","nonce":4220305275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6805","nonce":4220305275}]},"public_addr":"172.21.15.161:6801/4220305275","cluster_addr":"172.21.15.161:6803/4220305275","heartbeat_back_addr":"172.21.15.161:6807/4220305275","heartbeat_front_addr":"172.21.15.161:6805/4220305275","state":["exists","up"]},{"osd":4,"uuid":"a017d7c9-0283-4fe1-8839-1ccbdbd95972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6809","nonce":520056397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6811","nonce":520056397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6815","nonce":520056397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6813","nonce":520056397}]},"public_addr":"172.21.15.161:6809/520056397","cluster_addr":"172.21.15.161:6811/520056397","heartbeat_back_addr":"172.21.15.161:6815/520056397","heartbeat_front_addr":"172.21.15.161:6813/520056397","state":["exists","up"]},{"osd":5,"uuid":"3f97d2c3-52e0-490a-a7ec-d989884f03a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6817","nonce":3112518053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6819","nonce":3112518053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6823","nonce":3112518053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6821","nonce":3112518053}]},"public_addr":"172.21.15.161:6817/3112518053","cluster_addr":"172.21.15.161:6819/3112518053","heartbeat_back_addr":"172.21.15.161:6823/3112518053","heartbeat_front_addr":"172.21.15.161:6821/3112518053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:26:57.942621+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:27:33.707227+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:01.399431+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:25.246971+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:51.257793+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:29:17.568705+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6825/1178849707":"2024-02-23T00:42:24.206575+0000","172.21.15.161:6824/1178849707":"2024-02-23T00:42:24.206575+0000","172.21.15.49:6826/502304157":"2024-02-23T00:42:24.206557+0000","172.21.15.49:6801/825337018":"2024-02-23T00:38:12.296162+0000","172.21.15.49:0/1275556630":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6801/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/825337018":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6800/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/4010391313":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6801/3085400794":"2024-02-23T00:32:49.737110+0000","172.21.15.49:0/3181714365":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6801/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/3235067899":"2024-02-23T00:38:12.296162+0000","172.21.15.49:0/1848258748":"2024-02-23T00:32:49.737110+0000","172.21.15.161:0/579221873":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6800/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.161:6829/2756597363":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6801/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6800/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/1567499828":"2024-02-23T00:26:01.748034+0000","172.21.15.161:0/1226666066":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/11441843":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6800/3085400794":"2024-02-23T00:32:49.737110+0000","172.21.15.49:0/3432989727":"2024-02-23T00:32:49.737110+0000","172.21.15.161:0/1507012470":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/1752326277":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/2319195782":"2024-02-23T00:25:10.135002+0000","172.21.15.161:0/401498250":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6827/502304157":"2024-02-23T00:42:24.206557+0000","172.21.15.49:0/4194533393":"2024-02-23T00:24:40.044887+0000","172.21.15.161:6828/2756597363":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/755765908":"2024-02-23T00:25:10.135002+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.453+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8c7806cab0 msgr2=0x7f8c7806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.453+0000 7f8c9189d700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8c7806cab0 0x7f8c7806ef70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f8c8c108730 tx=0x7f8c7400b040).stop 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.453+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 msgr2=0x7f8c8c10cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.453+0000 7f8c9189d700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 0x7f8c8c10cdf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f8c7c0043a0 tx=0x7f8c7c009cb0).stop 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.454+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 shutdown_connections 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.454+0000 7f8c9189d700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8c7806cab0 0x7f8c7806ef70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.454+0000 7f8c9189d700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8c8c0fc730 0x7f8c8c10cdf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.454+0000 7f8c9189d700 1 --2- 172.21.15.49:0/4028513295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c8c0fd090 0x7f8c8c10d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.454+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 >> 172.21.15.49:0/4028513295 conn(0x7f8c8c06c760 msgr2=0x7f8c8c0faaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.454+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 shutdown_connections 2024-02-22T01:00:21.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.454+0000 7f8c9189d700 1 -- 172.21.15.49:0/4028513295 wait complete. 2024-02-22T01:00:21.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-22T00:28:03.647916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-22T00:30:37.161023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-22T00:30:37.647309+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-22T01:00:21.466 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-22T01:00:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.598+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/3871812455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fd8f0 msgr2=0x7ff7dc0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.598+0000 7ff7e2ad4700 1 --2- 172.21.15.49:0/3871812455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fd8f0 0x7ff7dc0fdcd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7ff7d00047f0 tx=0x7ff7d0009cb0).stop 2024-02-22T01:00:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.598+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/3871812455 shutdown_connections 2024-02-22T01:00:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.598+0000 7ff7e2ad4700 1 --2- 172.21.15.49:0/3871812455 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7dc0fe250 0x7ff7dc0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.598+0000 7ff7e2ad4700 1 --2- 172.21.15.49:0/3871812455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fd8f0 0x7ff7dc0fdcd0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.598+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/3871812455 >> 172.21.15.49:0/3871812455 conn(0x7ff7dc0f34d0 msgr2=0x7ff7dc0f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:21.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.598+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/3871812455 shutdown_connections 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.598+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/3871812455 wait complete. 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7e2ad4700 1 Processor -- start 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7e2ad4700 1 -- start start 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7e2ad4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7dc0fd8f0 0x7ff7dc10e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7e2ad4700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fe250 0x7ff7dc10e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7e2ad4700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc10ebd0 con 0x7ff7dc0fe250 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7e2ad4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc1081f0 con 0x7ff7dc0fd8f0 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fe250 0x7ff7dc10e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7dbfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fe250 0x7ff7dc10e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56972/0 (socket says 172.21.15.49:56972) 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7dbfff700 1 -- 172.21.15.49:0/2683882843 learned_addr learned my addr 172.21.15.49:0/2683882843 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7e0870700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7dc0fd8f0 0x7ff7dc10e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7dbfff700 1 -- 172.21.15.49:0/2683882843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7dc0fd8f0 msgr2=0x7ff7dc10e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7dbfff700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7dc0fd8f0 0x7ff7dc10e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.599+0000 7ff7dbfff700 1 -- 172.21.15.49:0/2683882843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d0005040 con 0x7ff7dc0fe250 2024-02-22T01:00:21.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.600+0000 7ff7dbfff700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fe250 0x7ff7dc10e540 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7ff7c800b480 tx=0x7ff7c80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:21.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.600+0000 7ff7d9f76700 1 -- 172.21.15.49:0/2683882843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7c8002500 con 0x7ff7dc0fe250 2024-02-22T01:00:21.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.600+0000 7ff7d9f76700 1 -- 172.21.15.49:0/2683882843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff7c8002b10 con 0x7ff7dc0fe250 2024-02-22T01:00:21.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.600+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc1084a0 con 0x7ff7dc0fe250 2024-02-22T01:00:21.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.600+0000 7ff7d9f76700 1 -- 172.21.15.49:0/2683882843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7c8012c90 con 0x7ff7dc0fe250 2024-02-22T01:00:21.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.600+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc1089e0 con 0x7ff7dc0fe250 2024-02-22T01:00:21.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.601+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc05f360 con 0x7ff7dc0fe250 2024-02-22T01:00:21.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.601+0000 7ff7d9f76700 1 -- 172.21.15.49:0/2683882843 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff7c8002660 con 0x7ff7dc0fe250 2024-02-22T01:00:21.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.602+0000 7ff7d9f76700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff7cc06caa0 0x7ff7cc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.602+0000 7ff7d9f76700 1 -- 172.21.15.49:0/2683882843 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff7c808be70 con 0x7ff7dc0fe250 2024-02-22T01:00:21.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.602+0000 7ff7e0870700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff7cc06caa0 0x7ff7cc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.602+0000 7ff7e0870700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff7cc06caa0 0x7ff7cc06ef60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ff7d0004f10 tx=0x7ff7d000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:21.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.606+0000 7ff7d9f76700 1 -- 172.21.15.49:0/2683882843 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff7c80599d0 con 0x7ff7dc0fe250 2024-02-22T01:00:21.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:21 smithi049 ceph-mon[132694]: pgmap v704: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:21.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:21 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3789180133' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-22T01:00:21.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:21 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1551261158' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-22T01:00:21.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:21 smithi161 ceph-mon[113442]: pgmap v704: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:21.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:21 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3789180133' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-22T01:00:21.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:21 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1551261158' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-22T01:00:21.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.806+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7dc1096d0 con 0x7ff7dc0fe250 2024-02-22T01:00:21.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.806+0000 7ff7d9f76700 1 -- 172.21.15.49:0/2683882843 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7c8059560 con 0x7ff7dc0fe250 2024-02-22T01:00:21.799 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-02-22T01:00:21.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff7cc06caa0 msgr2=0x7ff7cc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff7cc06caa0 0x7ff7cc06ef60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ff7d0004f10 tx=0x7ff7d000b040).stop 2024-02-22T01:00:21.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fe250 msgr2=0x7ff7dc10e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fe250 0x7ff7dc10e540 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7ff7c800b480 tx=0x7ff7c80090f0).stop 2024-02-22T01:00:21.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 shutdown_connections 2024-02-22T01:00:21.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7ff7cc06caa0 0x7ff7cc06ef60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7dc0fd8f0 0x7ff7dc10e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 --2- 172.21.15.49:0/2683882843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7dc0fe250 0x7ff7dc10e540 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 >> 172.21.15.49:0/2683882843 conn(0x7ff7dc0f34d0 msgr2=0x7ff7dc0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:21.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 shutdown_connections 2024-02-22T01:00:21.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.808+0000 7ff7e2ad4700 1 -- 172.21.15.49:0/2683882843 wait complete. 2024-02-22T01:00:21.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-22T01:00:21.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.944+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/3901304498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fd8f0 msgr2=0x7fbd280fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.944+0000 7fbd2ddd7700 1 --2- 172.21.15.49:0/3901304498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fd8f0 0x7fbd280fdcd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fbd180047f0 tx=0x7fbd18009cb0).stop 2024-02-22T01:00:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.944+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/3901304498 shutdown_connections 2024-02-22T01:00:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.944+0000 7fbd2ddd7700 1 --2- 172.21.15.49:0/3901304498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd280fe250 0x7fbd280f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.944+0000 7fbd2ddd7700 1 --2- 172.21.15.49:0/3901304498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fd8f0 0x7fbd280fdcd0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.944+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/3901304498 >> 172.21.15.49:0/3901304498 conn(0x7fbd280f34d0 msgr2=0x7fbd280f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:21.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.944+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/3901304498 shutdown_connections 2024-02-22T01:00:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.944+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/3901304498 wait complete. 2024-02-22T01:00:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd2ddd7700 1 Processor -- start 2024-02-22T01:00:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd2ddd7700 1 -- start start 2024-02-22T01:00:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd2ddd7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd280fd8f0 0x7fbd2810dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd2ddd7700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fe250 0x7fbd2810e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd2ddd7700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2810eac0 con 0x7fbd280fe250 2024-02-22T01:00:21.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd2ddd7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2810ec00 con 0x7fbd280fd8f0 2024-02-22T01:00:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd26ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fe250 0x7fbd2810e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd26ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fe250 0x7fbd2810e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56982/0 (socket says 172.21.15.49:56982) 2024-02-22T01:00:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd26ffd700 1 -- 172.21.15.49:0/1842847052 learned_addr learned my addr 172.21.15.49:0/1842847052 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd277fe700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd280fd8f0 0x7fbd2810dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd26ffd700 1 -- 172.21.15.49:0/1842847052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd280fd8f0 msgr2=0x7fbd2810dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd26ffd700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd280fd8f0 0x7fbd2810dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:21.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.945+0000 7fbd26ffd700 1 -- 172.21.15.49:0/1842847052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18005040 con 0x7fbd280fe250 2024-02-22T01:00:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.946+0000 7fbd26ffd700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fe250 0x7fbd2810e4c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fbd1000c790 tx=0x7fbd10007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.946+0000 7fbd24ff9700 1 -- 172.21.15.49:0/1842847052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd1000e680 con 0x7fbd280fe250 2024-02-22T01:00:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.946+0000 7fbd24ff9700 1 -- 172.21.15.49:0/1842847052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbd1000ec90 con 0x7fbd280fe250 2024-02-22T01:00:21.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.946+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd28108290 con 0x7fbd280fe250 2024-02-22T01:00:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.946+0000 7fbd24ff9700 1 -- 172.21.15.49:0/1842847052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd10012c70 con 0x7fbd280fe250 2024-02-22T01:00:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.946+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd28108850 con 0x7fbd280fe250 2024-02-22T01:00:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.947+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2805f360 con 0x7fbd280fe250 2024-02-22T01:00:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.947+0000 7fbd24ff9700 1 -- 172.21.15.49:0/1842847052 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbd1000e7e0 con 0x7fbd280fe250 2024-02-22T01:00:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.947+0000 7fbd24ff9700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbd1406caa0 0x7fbd1406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.948+0000 7fbd24ff9700 1 -- 172.21.15.49:0/1842847052 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbd1008b600 con 0x7fbd280fe250 2024-02-22T01:00:21.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.948+0000 7fbd277fe700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbd1406caa0 0x7fbd1406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:21.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.948+0000 7fbd277fe700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbd1406caa0 0x7fbd1406ef60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fbd18007cf0 tx=0x7fbd1800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:21.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:21.952+0000 7fbd24ff9700 1 -- 172.21.15.49:0/1842847052 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbd10059160 con 0x7fbd280fe250 2024-02-22T01:00:22.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.150+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fbd2805eec0 con 0x7fbd280fe250 2024-02-22T01:00:22.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.151+0000 7fbd24ff9700 1 -- 172.21.15.49:0/1842847052 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbd10058cf0 con 0x7fbd280fe250 2024-02-22T01:00:22.143 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-02-22T01:00:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbd1406caa0 msgr2=0x7fbd1406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbd1406caa0 0x7fbd1406ef60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fbd18007cf0 tx=0x7fbd1800b040).stop 2024-02-22T01:00:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fe250 msgr2=0x7fbd2810e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fe250 0x7fbd2810e4c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fbd1000c790 tx=0x7fbd10007f70).stop 2024-02-22T01:00:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 shutdown_connections 2024-02-22T01:00:22.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fbd1406caa0 0x7fbd1406ef60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd280fd8f0 0x7fbd2810dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 --2- 172.21.15.49:0/1842847052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbd280fe250 0x7fbd2810e4c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 >> 172.21.15.49:0/1842847052 conn(0x7fbd280f34d0 msgr2=0x7fbd280fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 shutdown_connections 2024-02-22T01:00:22.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.153+0000 7fbd2ddd7700 1 -- 172.21.15.49:0/1842847052 wait complete. 2024-02-22T01:00:22.157 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-22T01:00:22.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 -- 172.21.15.49:0/3576142451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 msgr2=0x7fa6140f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 --2- 172.21.15.49:0/3576142451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 0x7fa6140f6930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fa6080047f0 tx=0x7fa608009cb0).stop 2024-02-22T01:00:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 -- 172.21.15.49:0/3576142451 shutdown_connections 2024-02-22T01:00:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 --2- 172.21.15.49:0/3576142451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 0x7fa6140f6930 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 --2- 172.21.15.49:0/3576142451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6140fc830 0x7fa6140fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 -- 172.21.15.49:0/3576142451 >> 172.21.15.49:0/3576142451 conn(0x7fa61406c760 msgr2=0x7fa61406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 -- 172.21.15.49:0/3576142451 shutdown_connections 2024-02-22T01:00:22.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 -- 172.21.15.49:0/3576142451 wait complete. 2024-02-22T01:00:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.288+0000 7fa619ec0700 1 Processor -- start 2024-02-22T01:00:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa619ec0700 1 -- start start 2024-02-22T01:00:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa619ec0700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6140fc830 0x7fa61410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa619ec0700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 0x7fa61410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:22.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa619ec0700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61410eab0 con 0x7fa6140fd100 2024-02-22T01:00:22.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa619ec0700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61410ebf0 con 0x7fa6140fc830 2024-02-22T01:00:22.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa612ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 0x7fa61410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:22.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa612ffd700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 0x7fa61410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57010/0 (socket says 172.21.15.49:57010) 2024-02-22T01:00:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa612ffd700 1 -- 172.21.15.49:0/1795139477 learned_addr learned my addr 172.21.15.49:0/1795139477 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa6137fe700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6140fc830 0x7fa61410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa612ffd700 1 -- 172.21.15.49:0/1795139477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6140fc830 msgr2=0x7fa61410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa612ffd700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6140fc830 0x7fa61410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa612ffd700 1 -- 172.21.15.49:0/1795139477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608005040 con 0x7fa6140fd100 2024-02-22T01:00:22.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa612ffd700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 0x7fa61410e4b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fa60800b120 tx=0x7fa608009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:22.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.289+0000 7fa610ff9700 1 -- 172.21.15.49:0/1795139477 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa60800e030 con 0x7fa6140fd100 2024-02-22T01:00:22.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.290+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa614108220 con 0x7fa6140fd100 2024-02-22T01:00:22.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.290+0000 7fa610ff9700 1 -- 172.21.15.49:0/1795139477 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa608007e90 con 0x7fa6140fd100 2024-02-22T01:00:22.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.290+0000 7fa610ff9700 1 -- 172.21.15.49:0/1795139477 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa608018070 con 0x7fa6140fd100 2024-02-22T01:00:22.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.290+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa614108780 con 0x7fa6140fd100 2024-02-22T01:00:22.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.291+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61405f380 con 0x7fa6140fd100 2024-02-22T01:00:22.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.292+0000 7fa610ff9700 1 -- 172.21.15.49:0/1795139477 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa608009710 con 0x7fa6140fd100 2024-02-22T01:00:22.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.292+0000 7fa610ff9700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa5fc06caa0 0x7fa5fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:22.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.292+0000 7fa610ff9700 1 -- 172.21.15.49:0/1795139477 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa60808d5e0 con 0x7fa6140fd100 2024-02-22T01:00:22.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.292+0000 7fa6137fe700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa5fc06caa0 0x7fa5fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:22.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.293+0000 7fa6137fe700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa5fc06caa0 0x7fa5fc06ef60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fa60c004b60 tx=0x7fa60c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:22.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.296+0000 7fa610ff9700 1 -- 172.21.15.49:0/1795139477 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa60805b140 con 0x7fa6140fd100 2024-02-22T01:00:22.417 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:22 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4028513295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T01:00:22.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:22 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2683882843' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-22T01:00:22.418 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:22 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1842847052' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-22T01:00:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.493+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fa61405eec0 con 0x7fa6140fd100 2024-02-22T01:00:22.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.494+0000 7fa610ff9700 1 -- 172.21.15.49:0/1795139477 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa60805acd0 con 0x7fa6140fd100 2024-02-22T01:00:22.486 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-02-22T01:00:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa5fc06caa0 msgr2=0x7fa5fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa5fc06caa0 0x7fa5fc06ef60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fa60c004b60 tx=0x7fa60c009040).stop 2024-02-22T01:00:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 msgr2=0x7fa61410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 0x7fa61410e4b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fa60800b120 tx=0x7fa608009cb0).stop 2024-02-22T01:00:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 shutdown_connections 2024-02-22T01:00:22.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fa5fc06caa0 0x7fa5fc06ef60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6140fc830 0x7fa61410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 --2- 172.21.15.49:0/1795139477 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa6140fd100 0x7fa61410e4b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 >> 172.21.15.49:0/1795139477 conn(0x7fa61406c760 msgr2=0x7fa614060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:22.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 shutdown_connections 2024-02-22T01:00:22.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.496+0000 7fa619ec0700 1 -- 172.21.15.49:0/1795139477 wait complete. 2024-02-22T01:00:22.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-22T01:00:22.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.630+0000 7f1a4c369700 1 -- 172.21.15.49:0/2041350690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 msgr2=0x7f1a44101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.630+0000 7f1a4c369700 1 --2- 172.21.15.49:0/2041350690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 0x7f1a44101a60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f1a380047f0 tx=0x7f1a38009cb0).stop 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.630+0000 7f1a4c369700 1 -- 172.21.15.49:0/2041350690 shutdown_connections 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.630+0000 7f1a4c369700 1 --2- 172.21.15.49:0/2041350690 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 0x7f1a44101a60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.630+0000 7f1a4c369700 1 --2- 172.21.15.49:0/2041350690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a440f89f0 0x7f1a440f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.630+0000 7f1a4c369700 1 -- 172.21.15.49:0/2041350690 >> 172.21.15.49:0/2041350690 conn(0x7f1a4406c760 msgr2=0x7f1a4406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.630+0000 7f1a4c369700 1 -- 172.21.15.49:0/2041350690 shutdown_connections 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.630+0000 7f1a4c369700 1 -- 172.21.15.49:0/2041350690 wait complete. 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a4c369700 1 Processor -- start 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a4c369700 1 -- start start 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a4c369700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a440f89f0 0x7f1a4410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a4c369700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 0x7f1a4410e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a4c369700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4410eac0 con 0x7f1a440f92c0 2024-02-22T01:00:22.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a4c369700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4410ec00 con 0x7f1a440f89f0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a49904700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 0x7f1a4410e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a49904700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 0x7f1a4410e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57024/0 (socket says 172.21.15.49:57024) 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.631+0000 7f1a49904700 1 -- 172.21.15.49:0/1066061490 learned_addr learned my addr 172.21.15.49:0/1066061490 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a4a105700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a440f89f0 0x7f1a4410dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a49904700 1 -- 172.21.15.49:0/1066061490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a440f89f0 msgr2=0x7f1a4410dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a49904700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a440f89f0 0x7f1a4410dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a49904700 1 -- 172.21.15.49:0/1066061490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a38005040 con 0x7f1a440f92c0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a4a105700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a440f89f0 0x7f1a4410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a49904700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 0x7f1a4410e4c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f1a38009380 tx=0x7f1a38009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a377fe700 1 -- 172.21.15.49:0/1066061490 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a3800e030 con 0x7f1a440f92c0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a44108290 con 0x7f1a440f92c0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a377fe700 1 -- 172.21.15.49:0/1066061490 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a38007e90 con 0x7f1a440f92c0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a377fe700 1 -- 172.21.15.49:0/1066061490 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a38018070 con 0x7f1a440f92c0 2024-02-22T01:00:22.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.632+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a441087d0 con 0x7f1a440f92c0 2024-02-22T01:00:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.633+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4405f380 con 0x7f1a440f92c0 2024-02-22T01:00:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.633+0000 7f1a377fe700 1 -- 172.21.15.49:0/1066061490 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1a3801d420 con 0x7f1a440f92c0 2024-02-22T01:00:22.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.634+0000 7f1a377fe700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3006cab0 0x7f1a3006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.634+0000 7f1a377fe700 1 -- 172.21.15.49:0/1066061490 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1a3808d300 con 0x7f1a440f92c0 2024-02-22T01:00:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.634+0000 7f1a4a105700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3006cab0 0x7f1a3006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:22.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.634+0000 7f1a4a105700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3006cab0 0x7f1a3006ef70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f1a400041d0 tx=0x7f1a40009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:22.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.638+0000 7f1a377fe700 1 -- 172.21.15.49:0/1066061490 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1a3805ae60 con 0x7f1a440f92c0 2024-02-22T01:00:22.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:22 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4028513295' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T01:00:22.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:22 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2683882843' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-22T01:00:22.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:22 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1842847052' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-22T01:00:22.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.851+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1a4405eec0 con 0x7f1a440f92c0 2024-02-22T01:00:22.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.851+0000 7f1a377fe700 1 -- 172.21.15.49:0/1066061490 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 32 entries v84) v1 ==== 81+0+1899 (secure 0 0 0) 0x7f1a3805a9f0 con 0x7f1a440f92c0 2024-02-22T01:00:22.844 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:6825/1178849707 2024-02-23T00:42:24.206575+0000 2024-02-22T01:00:22.844 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:6824/1178849707 2024-02-23T00:42:24.206575+0000 2024-02-22T01:00:22.844 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6826/502304157 2024-02-23T00:42:24.206557+0000 2024-02-22T01:00:22.845 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/825337018 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:22.845 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1275556630 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:22.845 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/3269480929 2024-02-23T00:26:01.748034+0000 2024-02-22T01:00:22.845 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/825337018 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:22.845 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/3269480929 2024-02-23T00:26:01.748034+0000 2024-02-22T01:00:22.845 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4010391313 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:22.846 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/3085400794 2024-02-23T00:32:49.737110+0000 2024-02-22T01:00:22.846 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3181714365 2024-02-23T00:24:40.044887+0000 2024-02-22T01:00:22.846 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2503465771 2024-02-23T00:25:10.135002+0000 2024-02-22T01:00:22.846 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3235067899 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:22.846 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1848258748 2024-02-23T00:32:49.737110+0000 2024-02-22T01:00:22.846 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:0/579221873 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:22.847 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2503465771 2024-02-23T00:25:10.135002+0000 2024-02-22T01:00:22.847 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:6829/2756597363 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:22.847 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/48931101 2024-02-23T00:24:40.044887+0000 2024-02-22T01:00:22.847 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/48931101 2024-02-23T00:24:40.044887+0000 2024-02-22T01:00:22.847 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1567499828 2024-02-23T00:26:01.748034+0000 2024-02-22T01:00:22.847 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:0/1226666066 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:22.848 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/11441843 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:22.848 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/3085400794 2024-02-23T00:32:49.737110+0000 2024-02-22T01:00:22.848 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3432989727 2024-02-23T00:32:49.737110+0000 2024-02-22T01:00:22.849 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:0/1507012470 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:22.849 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1752326277 2024-02-23T00:26:01.748034+0000 2024-02-22T01:00:22.849 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2319195782 2024-02-23T00:25:10.135002+0000 2024-02-22T01:00:22.849 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:0/401498250 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:22.849 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6827/502304157 2024-02-23T00:42:24.206557+0000 2024-02-22T01:00:22.849 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4194533393 2024-02-23T00:24:40.044887+0000 2024-02-22T01:00:22.850 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:6828/2756597363 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:22.850 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/755765908 2024-02-23T00:25:10.135002+0000 2024-02-22T01:00:22.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.853+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3006cab0 msgr2=0x7f1a3006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.853+0000 7f1a4c369700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3006cab0 0x7f1a3006ef70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f1a400041d0 tx=0x7f1a40009040).stop 2024-02-22T01:00:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.853+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 msgr2=0x7f1a4410e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.853+0000 7f1a4c369700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 0x7f1a4410e4c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f1a38009380 tx=0x7f1a38009cb0).stop 2024-02-22T01:00:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.854+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 shutdown_connections 2024-02-22T01:00:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.854+0000 7f1a4c369700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f1a3006cab0 0x7f1a3006ef70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.854+0000 7f1a4c369700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a440f89f0 0x7f1a4410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.854+0000 7f1a4c369700 1 --2- 172.21.15.49:0/1066061490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a440f92c0 0x7f1a4410e4c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.854+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 >> 172.21.15.49:0/1066061490 conn(0x7f1a4406c760 msgr2=0x7f1a440fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.854+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 shutdown_connections 2024-02-22T01:00:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:22.854+0000 7f1a4c369700 1 -- 172.21.15.49:0/1066061490 wait complete. 2024-02-22T01:00:22.853 INFO:teuthology.orchestra.run.smithi049.stderr:listed 32 entries 2024-02-22T01:00:22.858 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-02-22T01:00:22.858 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-22T01:00:22.879 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/94202434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f9220 msgr2=0x7f9ec81019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 --2- 172.21.15.49:0/94202434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f9220 0x7f9ec81019c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f9ebc0047f0 tx=0x7f9ebc009cb0).stop 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/94202434 shutdown_connections 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 --2- 172.21.15.49:0/94202434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f9220 0x7f9ec81019c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 --2- 172.21.15.49:0/94202434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80f8950 0x7f9ec80f8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/94202434 >> 172.21.15.49:0/94202434 conn(0x7f9ec806c760 msgr2=0x7f9ec806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/94202434 shutdown_connections 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/94202434 wait complete. 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 Processor -- start 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.049+0000 7f9ecdb2a700 1 -- start start 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ecdb2a700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f8950 0x7f9ec810e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ecdb2a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80f9220 0x7f9ec810e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ecdb2a700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec810eb60 con 0x7f9ec80f8950 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ecdb2a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec810eca0 con 0x7f9ec80f9220 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f8950 0x7f9ec810e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec77fe700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f8950 0x7f9ec810e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57046/0 (socket says 172.21.15.49:57046) 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec77fe700 1 -- 172.21.15.49:0/4210129709 learned_addr learned my addr 172.21.15.49:0/4210129709 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec6ffd700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80f9220 0x7f9ec810e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec77fe700 1 -- 172.21.15.49:0/4210129709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80f9220 msgr2=0x7f9ec810e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec77fe700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80f9220 0x7f9ec810e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec77fe700 1 -- 172.21.15.49:0/4210129709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc005040 con 0x7f9ec80f8950 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec77fe700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f8950 0x7f9ec810e070 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f9eb800e910 tx=0x7f9eb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec4ff9700 1 -- 172.21.15.49:0/4210129709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb800eeb0 con 0x7f9ec80f8950 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec81082d0 con 0x7f9ec80f8950 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec4ff9700 1 -- 172.21.15.49:0/4210129709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9eb800f040 con 0x7f9ec80f8950 2024-02-22T01:00:23.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ec4ff9700 1 -- 172.21.15.49:0/4210129709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb800c8a0 con 0x7f9ec80f8950 2024-02-22T01:00:23.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.050+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec8108810 con 0x7f9ec80f8950 2024-02-22T01:00:23.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.051+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec805f380 con 0x7f9ec80f8950 2024-02-22T01:00:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.052+0000 7f9ec4ff9700 1 -- 172.21.15.49:0/4210129709 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9eb80090d0 con 0x7f9ec80f8950 2024-02-22T01:00:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.052+0000 7f9ec4ff9700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9eb006caa0 0x7f9eb006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.052+0000 7f9ec4ff9700 1 -- 172.21.15.49:0/4210129709 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9eb808b870 con 0x7f9ec80f8950 2024-02-22T01:00:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.052+0000 7f9ec6ffd700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9eb006caa0 0x7f9eb006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.053+0000 7f9ec6ffd700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9eb006caa0 0x7f9eb006ef60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f9ebc004e60 tx=0x7f9ebc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:23.048 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.056+0000 7f9ec4ff9700 1 -- 172.21.15.49:0/4210129709 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9eb80593d0 con 0x7f9ec80f8950 2024-02-22T01:00:23.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.254+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec805eec0 con 0x7f9ec80f8950 2024-02-22T01:00:23.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.255+0000 7f9ec4ff9700 1 -- 172.21.15.49:0/4210129709 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16137 (secure 0 0 0) 0x7f9eb8058f60 con 0x7f9ec80f8950 2024-02-22T01:00:23.247 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-02-22T01:00:23.248 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":84,"fsid":"9923b37e-d118-11ee-95bd-87774f69a715","created":"2024-02-22T00:24:07.498307+0000","modified":"2024-02-22T00:43:17.221392+0000","last_up_change":"2024-02-22T00:42:21.961319+0000","last_in_change":"2024-02-22T00:29:00.339229+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-22T00:28:03.647916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-22T00:30:37.161023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-22T00:30:37.647309+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14701491-880b-4aa8-b29c-2f93fad67550","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":48,"up_from":52,"up_thru":77,"down_at":49,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6803","nonce":2349267451}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6805","nonce":2349267451}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6809","nonce":2349267451}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":2349267451},{"type":"v1","addr":"172.21.15.49:6807","nonce":2349267451}]},"public_addr":"172.21.15.49:6803/2349267451","cluster_addr":"172.21.15.49:6805/2349267451","heartbeat_back_addr":"172.21.15.49:6809/2349267451","heartbeat_front_addr":"172.21.15.49:6807/2349267451","state":["exists","up"]},{"osd":1,"uuid":"6a984f0c-ab4d-4881-baf7-7821af596292","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":53,"up_from":57,"up_thru":77,"down_at":54,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6811","nonce":3701332011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6813","nonce":3701332011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6817","nonce":3701332011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":3701332011},{"type":"v1","addr":"172.21.15.49:6815","nonce":3701332011}]},"public_addr":"172.21.15.49:6811/3701332011","cluster_addr":"172.21.15.49:6813/3701332011","heartbeat_back_addr":"172.21.15.49:6817/3701332011","heartbeat_front_addr":"172.21.15.49:6815/3701332011","state":["exists","up"]},{"osd":2,"uuid":"fdbc04fa-88df-4bd8-9272-38e17a0ddc99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":58,"up_from":62,"up_thru":77,"down_at":59,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6819","nonce":4257132266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6821","nonce":4257132266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6825","nonce":4257132266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":4257132266},{"type":"v1","addr":"172.21.15.49:6823","nonce":4257132266}]},"public_addr":"172.21.15.49:6819/4257132266","cluster_addr":"172.21.15.49:6821/4257132266","heartbeat_back_addr":"172.21.15.49:6825/4257132266","heartbeat_front_addr":"172.21.15.49:6823/4257132266","state":["exists","up"]},{"osd":3,"uuid":"b390fc5b-11b9-4c6f-9eaa-ed0e812d9d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":63,"up_from":67,"up_thru":77,"down_at":64,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6801","nonce":4220305275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6803","nonce":4220305275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6807","nonce":4220305275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":4220305275},{"type":"v1","addr":"172.21.15.161:6805","nonce":4220305275}]},"public_addr":"172.21.15.161:6801/4220305275","cluster_addr":"172.21.15.161:6803/4220305275","heartbeat_back_addr":"172.21.15.161:6807/4220305275","heartbeat_front_addr":"172.21.15.161:6805/4220305275","state":["exists","up"]},{"osd":4,"uuid":"a017d7c9-0283-4fe1-8839-1ccbdbd95972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":68,"up_from":72,"up_thru":77,"down_at":69,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6809","nonce":520056397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6811","nonce":520056397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6815","nonce":520056397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":520056397},{"type":"v1","addr":"172.21.15.161:6813","nonce":520056397}]},"public_addr":"172.21.15.161:6809/520056397","cluster_addr":"172.21.15.161:6811/520056397","heartbeat_back_addr":"172.21.15.161:6815/520056397","heartbeat_front_addr":"172.21.15.161:6813/520056397","state":["exists","up"]},{"osd":5,"uuid":"3f97d2c3-52e0-490a-a7ec-d989884f03a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":73,"up_from":77,"up_thru":77,"down_at":74,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6817","nonce":3112518053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6819","nonce":3112518053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6823","nonce":3112518053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":3112518053},{"type":"v1","addr":"172.21.15.161:6821","nonce":3112518053}]},"public_addr":"172.21.15.161:6817/3112518053","cluster_addr":"172.21.15.161:6819/3112518053","heartbeat_back_addr":"172.21.15.161:6823/3112518053","heartbeat_front_addr":"172.21.15.161:6821/3112518053","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:26:57.942621+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:27:33.707227+0000","dead_epoch":53},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:01.399431+0000","dead_epoch":58},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:25.246971+0000","dead_epoch":63},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:28:51.257793+0000","dead_epoch":68},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T00:29:17.568705+0000","dead_epoch":73}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6825/1178849707":"2024-02-23T00:42:24.206575+0000","172.21.15.161:6824/1178849707":"2024-02-23T00:42:24.206575+0000","172.21.15.49:6826/502304157":"2024-02-23T00:42:24.206557+0000","172.21.15.49:6801/825337018":"2024-02-23T00:38:12.296162+0000","172.21.15.49:0/1275556630":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6801/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:6800/825337018":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6800/3269480929":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/4010391313":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6801/3085400794":"2024-02-23T00:32:49.737110+0000","172.21.15.49:0/3181714365":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6801/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.49:0/3235067899":"2024-02-23T00:38:12.296162+0000","172.21.15.49:0/1848258748":"2024-02-23T00:32:49.737110+0000","172.21.15.161:0/579221873":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6800/2503465771":"2024-02-23T00:25:10.135002+0000","172.21.15.161:6829/2756597363":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6801/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:6800/48931101":"2024-02-23T00:24:40.044887+0000","172.21.15.49:0/1567499828":"2024-02-23T00:26:01.748034+0000","172.21.15.161:0/1226666066":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/11441843":"2024-02-23T00:38:12.296162+0000","172.21.15.49:6800/3085400794":"2024-02-23T00:32:49.737110+0000","172.21.15.49:0/3432989727":"2024-02-23T00:32:49.737110+0000","172.21.15.161:0/1507012470":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/1752326277":"2024-02-23T00:26:01.748034+0000","172.21.15.49:0/2319195782":"2024-02-23T00:25:10.135002+0000","172.21.15.161:0/401498250":"2024-02-23T00:35:21.542730+0000","172.21.15.49:6827/502304157":"2024-02-23T00:42:24.206557+0000","172.21.15.49:0/4194533393":"2024-02-23T00:24:40.044887+0000","172.21.15.161:6828/2756597363":"2024-02-23T00:35:21.542730+0000","172.21.15.49:0/755765908":"2024-02-23T00:25:10.135002+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9eb006caa0 msgr2=0x7f9eb006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9eb006caa0 0x7f9eb006ef60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f9ebc004e60 tx=0x7f9ebc00b040).stop 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f8950 msgr2=0x7f9ec810e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f8950 0x7f9ec810e070 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f9eb800e910 tx=0x7f9eb800b040).stop 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 shutdown_connections 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9eb006caa0 0x7f9eb006ef60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9ec80f8950 0x7f9ec810e070 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 --2- 172.21.15.49:0/4210129709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80f9220 0x7f9ec810e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.257+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 >> 172.21.15.49:0/4210129709 conn(0x7f9ec806c760 msgr2=0x7f9ec8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.258+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 shutdown_connections 2024-02-22T01:00:23.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.258+0000 7f9ecdb2a700 1 -- 172.21.15.49:0/4210129709 wait complete. 2024-02-22T01:00:23.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-22T00:28:03.647916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-22T00:30:37.161023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-22T00:30:37.647309+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-22T01:00:23.263 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-22T01:00:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.394+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/1449695038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 msgr2=0x7fe2e00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.394+0000 7fe2e6bfb700 1 --2- 172.21.15.49:0/1449695038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 0x7fe2e00f6930 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fe2cc0047f0 tx=0x7fe2cc009cb0).stop 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.394+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/1449695038 shutdown_connections 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.394+0000 7fe2e6bfb700 1 --2- 172.21.15.49:0/1449695038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 0x7fe2e00f6930 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.394+0000 7fe2e6bfb700 1 --2- 172.21.15.49:0/1449695038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e00fc830 0x7fe2e00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.394+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/1449695038 >> 172.21.15.49:0/1449695038 conn(0x7fe2e006c760 msgr2=0x7fe2e006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.394+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/1449695038 shutdown_connections 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.394+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/1449695038 wait complete. 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2e6bfb700 1 Processor -- start 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2e6bfb700 1 -- start start 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2e6bfb700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e00fc830 0x7fe2e0109090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2e6bfb700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 0x7fe2e0109580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2e6bfb700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0109a70 con 0x7fe2e00fd100 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2e6bfb700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e0109bb0 con 0x7fe2e00fc830 2024-02-22T01:00:23.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 0x7fe2e0109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2dffff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 0x7fe2e0109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57076/0 (socket says 172.21.15.49:57076) 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2dffff700 1 -- 172.21.15.49:0/3257572959 learned_addr learned my addr 172.21.15.49:0/3257572959 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2dffff700 1 -- 172.21.15.49:0/3257572959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e00fc830 msgr2=0x7fe2e0109090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2e4997700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e00fc830 0x7fe2e0109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2dffff700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e00fc830 0x7fe2e0109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.395+0000 7fe2dffff700 1 -- 172.21.15.49:0/3257572959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc005040 con 0x7fe2e00fd100 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.396+0000 7fe2dffff700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 0x7fe2e0109580 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fe2cc00b120 tx=0x7fe2cc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.396+0000 7fe2ddffb700 1 -- 172.21.15.49:0/3257572959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2cc00e030 con 0x7fe2e00fd100 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.396+0000 7fe2ddffb700 1 -- 172.21.15.49:0/3257572959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe2cc007e90 con 0x7fe2e00fd100 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.396+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e0109e00 con 0x7fe2e00fd100 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.396+0000 7fe2ddffb700 1 -- 172.21.15.49:0/3257572959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2cc018070 con 0x7fe2e00fd100 2024-02-22T01:00:23.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.396+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e01123f0 con 0x7fe2e00fd100 2024-02-22T01:00:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.397+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e005f380 con 0x7fe2e00fd100 2024-02-22T01:00:23.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.398+0000 7fe2ddffb700 1 -- 172.21.15.49:0/3257572959 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe2cc009710 con 0x7fe2e00fd100 2024-02-22T01:00:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.398+0000 7fe2ddffb700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe2d006caa0 0x7fe2d006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.398+0000 7fe2ddffb700 1 -- 172.21.15.49:0/3257572959 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe2cc08d2e0 con 0x7fe2e00fd100 2024-02-22T01:00:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.398+0000 7fe2e4997700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe2d006caa0 0x7fe2d006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.399+0000 7fe2e4997700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe2d006caa0 0x7fe2d006ef60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fe2d40041d0 tx=0x7fe2d4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:23.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.402+0000 7fe2ddffb700 1 -- 172.21.15.49:0/3257572959 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe2cc0573b0 con 0x7fe2e00fd100 2024-02-22T01:00:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.600+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2e005eec0 con 0x7fe2e00fd100 2024-02-22T01:00:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.601+0000 7fe2ddffb700 1 -- 172.21.15.49:0/3257572959 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2e005eec0 con 0x7fe2e00fd100 2024-02-22T01:00:23.593 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-02-22T01:00:23.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe2d006caa0 msgr2=0x7fe2d006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe2d006caa0 0x7fe2d006ef60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fe2d40041d0 tx=0x7fe2d4009040).stop 2024-02-22T01:00:23.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 msgr2=0x7fe2e0109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 0x7fe2e0109580 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fe2cc00b120 tx=0x7fe2cc009cb0).stop 2024-02-22T01:00:23.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 shutdown_connections 2024-02-22T01:00:23.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7fe2d006caa0 0x7fe2d006ef60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2e00fc830 0x7fe2e0109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 --2- 172.21.15.49:0/3257572959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe2e00fd100 0x7fe2e0109580 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 >> 172.21.15.49:0/3257572959 conn(0x7fe2e006c760 msgr2=0x7fe2e00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:23.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 shutdown_connections 2024-02-22T01:00:23.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.603+0000 7fe2e6bfb700 1 -- 172.21.15.49:0/3257572959 wait complete. 2024-02-22T01:00:23.605 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:23 smithi049 ceph-mon[132694]: pgmap v705: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:23.606 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:23 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1795139477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-22T01:00:23.606 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:23 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1066061490' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-22T01:00:23.606 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:23 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4210129709' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T01:00:23.607 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-22T01:00:23.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.737+0000 7f8d6c427700 1 -- 172.21.15.49:0/4260924955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fc830 msgr2=0x7f8d640fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.737+0000 7f8d6c427700 1 --2- 172.21.15.49:0/4260924955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fc830 0x7f8d640fcc10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f8d600047f0 tx=0x7f8d60009cb0).stop 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 -- 172.21.15.49:0/4260924955 shutdown_connections 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 --2- 172.21.15.49:0/4260924955 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d640fd100 0x7f8d640f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 --2- 172.21.15.49:0/4260924955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fc830 0x7f8d640fcc10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 -- 172.21.15.49:0/4260924955 >> 172.21.15.49:0/4260924955 conn(0x7f8d6406c760 msgr2=0x7f8d6406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 -- 172.21.15.49:0/4260924955 shutdown_connections 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 -- 172.21.15.49:0/4260924955 wait complete. 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 Processor -- start 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 -- start start 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d640fc830 0x7f8d640fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fd100 0x7f8d640fdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640fe160 con 0x7f8d640fd100 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.738+0000 7f8d6c427700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d640fe2a0 con 0x7f8d640fc830 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d699c2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fd100 0x7f8d640fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d699c2700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fd100 0x7f8d640fdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57106/0 (socket says 172.21.15.49:57106) 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d699c2700 1 -- 172.21.15.49:0/2539174362 learned_addr learned my addr 172.21.15.49:0/2539174362 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d6a1c3700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d640fc830 0x7f8d640fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d699c2700 1 -- 172.21.15.49:0/2539174362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d640fc830 msgr2=0x7f8d640fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d699c2700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d640fc830 0x7f8d640fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d699c2700 1 -- 172.21.15.49:0/2539174362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d60005040 con 0x7f8d640fd100 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d699c2700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fd100 0x7f8d640fdc70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f8d5400c790 tx=0x7f8d5400caa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d5b7fe700 1 -- 172.21.15.49:0/2539174362 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d5400e680 con 0x7f8d640fd100 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d5b7fe700 1 -- 172.21.15.49:0/2539174362 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8d5400ec90 con 0x7f8d640fd100 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d5b7fe700 1 -- 172.21.15.49:0/2539174362 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d54012de0 con 0x7f8d640fd100 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d640fe550 con 0x7f8d640fd100 2024-02-22T01:00:23.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.739+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d64114670 con 0x7f8d640fd100 2024-02-22T01:00:23.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.740+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6405f380 con 0x7f8d640fd100 2024-02-22T01:00:23.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.741+0000 7f8d5b7fe700 1 -- 172.21.15.49:0/2539174362 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8d5400e7e0 con 0x7f8d640fd100 2024-02-22T01:00:23.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.741+0000 7f8d5b7fe700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d5006caa0 0x7f8d5006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:23.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.741+0000 7f8d5b7fe700 1 -- 172.21.15.49:0/2539174362 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8d5408b580 con 0x7f8d640fd100 2024-02-22T01:00:23.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.741+0000 7f8d6a1c3700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d5006caa0 0x7f8d5006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:23.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.742+0000 7f8d6a1c3700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d5006caa0 0x7f8d5006ef60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f8d60004f10 tx=0x7f8d6000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:23.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.746+0000 7f8d5b7fe700 1 -- 172.21.15.49:0/2539174362 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8d54055650 con 0x7f8d640fd100 2024-02-22T01:00:23.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:23 smithi161 ceph-mon[113442]: pgmap v705: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:23.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:23 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1795139477' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-22T01:00:23.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:23 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1066061490' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-22T01:00:23.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:23 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4210129709' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T01:00:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.943+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f8d64103590 con 0x7f8d640fd100 2024-02-22T01:00:23.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.943+0000 7f8d5b7fe700 1 -- 172.21.15.49:0/2539174362 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8d54058c70 con 0x7f8d640fd100 2024-02-22T01:00:23.935 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d5006caa0 msgr2=0x7f8d5006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d5006caa0 0x7f8d5006ef60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f8d60004f10 tx=0x7f8d6000b040).stop 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fd100 msgr2=0x7f8d640fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fd100 0x7f8d640fdc70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f8d5400c790 tx=0x7f8d5400caa0).stop 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 shutdown_connections 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f8d5006caa0 0x7f8d5006ef60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d640fc830 0x7f8d640fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 --2- 172.21.15.49:0/2539174362 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8d640fd100 0x7f8d640fdc70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 >> 172.21.15.49:0/2539174362 conn(0x7f8d6406c760 msgr2=0x7f8d64060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 shutdown_connections 2024-02-22T01:00:23.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:23.945+0000 7f8d6c427700 1 -- 172.21.15.49:0/2539174362 wait complete. 2024-02-22T01:00:23.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 -- 172.21.15.49:0/1805704009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fd170 msgr2=0x7f9e940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 --2- 172.21.15.49:0/1805704009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fd170 0x7f9e940f6950 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f9e840047f0 tx=0x7f9e84009cb0).stop 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 -- 172.21.15.49:0/1805704009 shutdown_connections 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 --2- 172.21.15.49:0/1805704009 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fd170 0x7f9e940f6950 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 --2- 172.21.15.49:0/1805704009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e940fc810 0x7f9e940fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 -- 172.21.15.49:0/1805704009 >> 172.21.15.49:0/1805704009 conn(0x7f9e940f23f0 msgr2=0x7f9e940f4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 -- 172.21.15.49:0/1805704009 shutdown_connections 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 -- 172.21.15.49:0/1805704009 wait complete. 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 Processor -- start 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 -- start start 2024-02-22T01:00:24.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.081+0000 7f9e9c522700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fc810 0x7f9e9410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9c522700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e940fd170 0x7f9e9410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9c522700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9410ebe0 con 0x7f9e940fc810 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9c522700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e94108200 con 0x7f9e940fd170 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9a2be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fc810 0x7f9e9410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9a2be700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fc810 0x7f9e9410e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57134/0 (socket says 172.21.15.49:57134) 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9a2be700 1 -- 172.21.15.49:0/4242732440 learned_addr learned my addr 172.21.15.49:0/4242732440 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e99abd700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e940fd170 0x7f9e9410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9a2be700 1 -- 172.21.15.49:0/4242732440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e940fd170 msgr2=0x7f9e9410e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9a2be700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e940fd170 0x7f9e9410e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9a2be700 1 -- 172.21.15.49:0/4242732440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e84005040 con 0x7f9e940fc810 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e99abd700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e940fd170 0x7f9e9410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9a2be700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fc810 0x7f9e9410e060 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f9e9000b4b0 tx=0x7f9e900090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:24.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e8b7fe700 1 -- 172.21.15.49:0/4242732440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e90002500 con 0x7f9e940fc810 2024-02-22T01:00:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e8b7fe700 1 -- 172.21.15.49:0/4242732440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e90002b10 con 0x7f9e940fc810 2024-02-22T01:00:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e941084b0 con 0x7f9e940fc810 2024-02-22T01:00:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e8b7fe700 1 -- 172.21.15.49:0/4242732440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e90012cf0 con 0x7f9e940fc810 2024-02-22T01:00:24.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.082+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e941089f0 con 0x7f9e940fc810 2024-02-22T01:00:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.083+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9405f2e0 con 0x7f9e940fc810 2024-02-22T01:00:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.084+0000 7f9e8b7fe700 1 -- 172.21.15.49:0/4242732440 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9e90002660 con 0x7f9e940fc810 2024-02-22T01:00:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.084+0000 7f9e8b7fe700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e8006cab0 0x7f9e8006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.084+0000 7f9e8b7fe700 1 -- 172.21.15.49:0/4242732440 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9e9008bdb0 con 0x7f9e940fc810 2024-02-22T01:00:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.084+0000 7f9e99abd700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e8006cab0 0x7f9e8006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:24.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.085+0000 7f9e99abd700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e8006cab0 0x7f9e8006ef70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f9e941099a0 tx=0x7f9e84009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:24.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.089+0000 7f9e8b7fe700 1 -- 172.21.15.49:0/4242732440 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9e90059910 con 0x7f9e940fc810 2024-02-22T01:00:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.290+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f9e941096e0 con 0x7f9e940fc810 2024-02-22T01:00:24.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.290+0000 7f9e8b7fe700 1 -- 172.21.15.49:0/4242732440 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f9e900594a0 con 0x7f9e940fc810 2024-02-22T01:00:24.283 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-02-22T01:00:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e8006cab0 msgr2=0x7f9e8006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e8006cab0 0x7f9e8006ef70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f9e941099a0 tx=0x7f9e84009cb0).stop 2024-02-22T01:00:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fc810 msgr2=0x7f9e9410e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fc810 0x7f9e9410e060 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f9e9000b4b0 tx=0x7f9e900090f0).stop 2024-02-22T01:00:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 shutdown_connections 2024-02-22T01:00:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f9e8006cab0 0x7f9e8006ef70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e940fc810 0x7f9e9410e060 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 --2- 172.21.15.49:0/4242732440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e940fd170 0x7f9e9410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 >> 172.21.15.49:0/4242732440 conn(0x7f9e940f23f0 msgr2=0x7f9e94060e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 shutdown_connections 2024-02-22T01:00:24.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.293+0000 7f9e9c522700 1 -- 172.21.15.49:0/4242732440 wait complete. 2024-02-22T01:00:24.297 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-22T01:00:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 -- 172.21.15.49:0/3574715005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fc830 msgr2=0x7f13740fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:24.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 --2- 172.21.15.49:0/3574715005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fc830 0x7f13740fcc10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f13640047f0 tx=0x7f1364009cb0).stop 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 -- 172.21.15.49:0/3574715005 shutdown_connections 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 --2- 172.21.15.49:0/3574715005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13740fd100 0x7f13740f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 --2- 172.21.15.49:0/3574715005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fc830 0x7f13740fcc10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 -- 172.21.15.49:0/3574715005 >> 172.21.15.49:0/3574715005 conn(0x7f137406c760 msgr2=0x7f137406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 -- 172.21.15.49:0/3574715005 shutdown_connections 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 -- 172.21.15.49:0/3574715005 wait complete. 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.427+0000 7f137a9f1700 1 Processor -- start 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f137a9f1700 1 -- start start 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f137a9f1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13740fc830 0x7f137410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f137a9f1700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fd100 0x7f137410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f137a9f1700 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137410ebb0 con 0x7f13740fd100 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f137a9f1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13741081d0 con 0x7f13740fc830 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f136bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fd100 0x7f137410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:24.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f136bfff700 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fd100 0x7f137410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57154/0 (socket says 172.21.15.49:57154) 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f136bfff700 1 -- 172.21.15.49:0/1628157950 learned_addr learned my addr 172.21.15.49:0/1628157950 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f1373fff700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13740fc830 0x7f137410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f136bfff700 1 -- 172.21.15.49:0/1628157950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13740fc830 msgr2=0x7f137410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f136bfff700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13740fc830 0x7f137410e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f136bfff700 1 -- 172.21.15.49:0/1628157950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364005040 con 0x7f13740fd100 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f136bfff700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fd100 0x7f137410e520 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f135c00b4b0 tx=0x7f135c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f1371ffb700 1 -- 172.21.15.49:0/1628157950 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f135c002500 con 0x7f13740fd100 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f1371ffb700 1 -- 172.21.15.49:0/1628157950 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f135c002b10 con 0x7f13740fd100 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374108480 con 0x7f13740fd100 2024-02-22T01:00:24.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.428+0000 7f1371ffb700 1 -- 172.21.15.49:0/1628157950 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f135c012cf0 con 0x7f13740fd100 2024-02-22T01:00:24.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.429+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13741089c0 con 0x7f13740fd100 2024-02-22T01:00:24.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.430+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137405f380 con 0x7f13740fd100 2024-02-22T01:00:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.430+0000 7f1371ffb700 1 -- 172.21.15.49:0/1628157950 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 38) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f135c002660 con 0x7f13740fd100 2024-02-22T01:00:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.430+0000 7f1371ffb700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f136006cab0 0x7f136006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-02-22T01:00:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.430+0000 7f1371ffb700 1 -- 172.21.15.49:0/1628157950 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f135c08bda0 con 0x7f13740fd100 2024-02-22T01:00:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.430+0000 7f1373fff700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f136006cab0 0x7f136006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-22T01:00:24.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.431+0000 7f1373fff700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f136006cab0 0x7f136006ef70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f1364000c00 tx=0x7f1364009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-22T01:00:24.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.435+0000 7f1371ffb700 1 -- 172.21.15.49:0/1628157950 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f135c059900 con 0x7f13740fd100 2024-02-22T01:00:24.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.651+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f137405eec0 con 0x7f13740fd100 2024-02-22T01:00:24.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.651+0000 7f1371ffb700 1 -- 172.21.15.49:0/1628157950 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 32 entries v84) v1 ==== 81+0+1899 (secure 0 0 0) 0x7f135c059490 con 0x7f13740fd100 2024-02-22T01:00:24.643 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:6825/1178849707 2024-02-23T00:42:24.206575+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:6824/1178849707 2024-02-23T00:42:24.206575+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6826/502304157 2024-02-23T00:42:24.206557+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/825337018 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1275556630 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/3269480929 2024-02-23T00:26:01.748034+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/825337018 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/3269480929 2024-02-23T00:26:01.748034+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4010391313 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/3085400794 2024-02-23T00:32:49.737110+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3181714365 2024-02-23T00:24:40.044887+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/2503465771 2024-02-23T00:25:10.135002+0000 2024-02-22T01:00:24.644 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3235067899 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1848258748 2024-02-23T00:32:49.737110+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:0/579221873 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/2503465771 2024-02-23T00:25:10.135002+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:6829/2756597363 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/48931101 2024-02-23T00:24:40.044887+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/48931101 2024-02-23T00:24:40.044887+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1567499828 2024-02-23T00:26:01.748034+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:0/1226666066 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/11441843 2024-02-23T00:38:12.296162+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/3085400794 2024-02-23T00:32:49.737110+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3432989727 2024-02-23T00:32:49.737110+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:0/1507012470 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1752326277 2024-02-23T00:26:01.748034+0000 2024-02-22T01:00:24.645 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2319195782 2024-02-23T00:25:10.135002+0000 2024-02-22T01:00:24.646 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:0/401498250 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:24.646 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6827/502304157 2024-02-23T00:42:24.206557+0000 2024-02-22T01:00:24.646 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4194533393 2024-02-23T00:24:40.044887+0000 2024-02-22T01:00:24.646 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.161:6828/2756597363 2024-02-23T00:35:21.542730+0000 2024-02-22T01:00:24.646 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/755765908 2024-02-23T00:25:10.135002+0000 2024-02-22T01:00:24.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f136006cab0 msgr2=0x7f136006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:24.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f136006cab0 0x7f136006ef70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f1364000c00 tx=0x7f1364009cb0).stop 2024-02-22T01:00:24.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fd100 msgr2=0x7f137410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T01:00:24.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fd100 0x7f137410e520 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f135c00b4b0 tx=0x7f135c0090f0).stop 2024-02-22T01:00:24.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 shutdown_connections 2024-02-22T01:00:24.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:6800/982567914,v1:172.21.15.49:6801/982567914] conn(0x7f136006cab0 0x7f136006ef70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13740fc830 0x7f137410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 --2- 172.21.15.49:0/1628157950 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f13740fd100 0x7f137410e520 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-02-22T01:00:24.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 >> 172.21.15.49:0/1628157950 conn(0x7f137406c760 msgr2=0x7f13740605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-22T01:00:24.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 shutdown_connections 2024-02-22T01:00:24.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-02-22T01:00:24.654+0000 7f137a9f1700 1 -- 172.21.15.49:0/1628157950 wait complete. 2024-02-22T01:00:24.648 INFO:teuthology.orchestra.run.smithi049.stderr:listed 32 entries 2024-02-22T01:00:24.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:24 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/3257572959' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-22T01:00:24.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:24 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/2539174362' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-22T01:00:24.657 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:24 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/4242732440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-22T01:00:24.658 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi049.front.sepia.ceph.com... 2024-02-22T01:00:24.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-22T01:00:24.658 DEBUG:teuthology.orchestra.run.smithi049:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-22T01:00:24.695 INFO:teuthology.orchestra.run:waiting for 300 2024-02-22T01:00:24.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:24 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/3257572959' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-22T01:00:24.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:24 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/2539174362' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-22T01:00:24.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:24 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/4242732440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-22T01:00:25.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:25 smithi049 ceph-mon[132694]: pgmap v706: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:25.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:25 smithi049 ceph-mon[132694]: from='client.? 172.21.15.49:0/1628157950' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-22T01:00:25.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:25 smithi161 ceph-mon[113442]: pgmap v706: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:25.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:25 smithi161 ceph-mon[113442]: from='client.? 172.21.15.49:0/1628157950' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-22T01:00:27.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:27 smithi049 ceph-mon[132694]: pgmap v707: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:27.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:27 smithi161 ceph-mon[113442]: pgmap v707: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:28.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:00:28.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:00:29.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:29 smithi049 ceph-mon[132694]: pgmap v708: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:29.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:29 smithi161 ceph-mon[113442]: pgmap v708: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:31.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:31 smithi049 ceph-mon[132694]: pgmap v709: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:31.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:31 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:00:31.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:31 smithi161 ceph-mon[113442]: pgmap v709: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:31.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:31 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:00:32.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:00:32.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:00:32.668 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:00:32.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:00:32.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:00:32.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:00:33.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:33 smithi049 ceph-mon[132694]: pgmap v710: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:33.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:33 smithi161 ceph-mon[113442]: pgmap v710: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:35.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:35 smithi049 ceph-mon[132694]: pgmap v711: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:35.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:35 smithi161 ceph-mon[113442]: pgmap v711: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:37.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:37 smithi049 ceph-mon[132694]: pgmap v712: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:37.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:37 smithi161 ceph-mon[113442]: pgmap v712: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:39.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:39 smithi049 ceph-mon[132694]: pgmap v713: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:39.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:39 smithi161 ceph-mon[113442]: pgmap v713: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:41.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:41 smithi049 ceph-mon[132694]: pgmap v714: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:41.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:41 smithi161 ceph-mon[113442]: pgmap v714: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:42.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:00:42.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:00:43.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:43 smithi049 ceph-mon[132694]: pgmap v715: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:43.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:43 smithi161 ceph-mon[113442]: pgmap v715: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:45.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:45 smithi049 ceph-mon[132694]: pgmap v716: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:45.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:45 smithi161 ceph-mon[113442]: pgmap v716: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:47.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:47 smithi049 ceph-mon[132694]: pgmap v717: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:47.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:47 smithi161 ceph-mon[113442]: pgmap v717: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:48.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:48 smithi049 ceph-mon[132694]: pgmap v718: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:48.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:48 smithi161 ceph-mon[113442]: pgmap v718: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:51.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:51 smithi161 ceph-mon[113442]: pgmap v719: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:51.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:51 smithi049 ceph-mon[132694]: pgmap v719: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:53.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:53 smithi161 ceph-mon[113442]: pgmap v720: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:53.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:53 smithi049 ceph-mon[132694]: pgmap v720: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:55.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:55 smithi161 ceph-mon[113442]: pgmap v721: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:55.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:55 smithi049 ceph-mon[132694]: pgmap v721: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:57.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:57 smithi161 ceph-mon[113442]: pgmap v722: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:57.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:57 smithi049 ceph-mon[132694]: pgmap v722: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:58.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:00:58.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:00:59.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:00:59 smithi161 ceph-mon[113442]: pgmap v723: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:00:59.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:00:59 smithi049 ceph-mon[132694]: pgmap v723: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:01.531 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:01 smithi049 ceph-mon[132694]: pgmap v724: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:01.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:01 smithi161 ceph-mon[113442]: pgmap v724: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:03.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:03 smithi161 ceph-mon[113442]: pgmap v725: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:03.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:03 smithi049 ceph-mon[132694]: pgmap v725: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:05.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:05 smithi161 ceph-mon[113442]: pgmap v726: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:05.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:05 smithi049 ceph-mon[132694]: pgmap v726: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:07.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:07 smithi161 ceph-mon[113442]: pgmap v727: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:07.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:07 smithi049 ceph-mon[132694]: pgmap v727: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:09.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:09 smithi161 ceph-mon[113442]: pgmap v728: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:09.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:09 smithi049 ceph-mon[132694]: pgmap v728: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:11.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:11 smithi161 ceph-mon[113442]: pgmap v729: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:11.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:11 smithi049 ceph-mon[132694]: pgmap v729: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:13.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:13 smithi161 ceph-mon[113442]: pgmap v730: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:13.540 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:01:13.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:13 smithi049 ceph-mon[132694]: pgmap v730: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:13.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:01:15.531 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:15 smithi161 ceph-mon[113442]: pgmap v731: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:15.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:15 smithi049 ceph-mon[132694]: pgmap v731: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:17.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:17 smithi161 ceph-mon[113442]: pgmap v732: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:17.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:17 smithi049 ceph-mon[132694]: pgmap v732: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:19.531 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:19 smithi161 ceph-mon[113442]: pgmap v733: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:19.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:19 smithi049 ceph-mon[132694]: pgmap v733: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:21.532 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:21 smithi161 ceph-mon[113442]: pgmap v734: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:21.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:21 smithi049 ceph-mon[132694]: pgmap v734: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:23.531 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:23 smithi161 ceph-mon[113442]: pgmap v735: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:23.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:23 smithi049 ceph-mon[132694]: pgmap v735: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:25.531 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:25 smithi161 ceph-mon[113442]: pgmap v736: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:25.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:25 smithi049 ceph-mon[132694]: pgmap v736: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:27.531 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:27 smithi161 ceph-mon[113442]: pgmap v737: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:27.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:27 smithi049 ceph-mon[132694]: pgmap v737: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:28.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:01:28.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:01:29.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:29 smithi049 ceph-mon[132694]: pgmap v738: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:29.783 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:29 smithi161 ceph-mon[113442]: pgmap v738: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:31.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:31 smithi049 ceph-mon[132694]: pgmap v739: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:31.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:31 smithi161 ceph-mon[113442]: pgmap v739: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:32.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:01:32.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:01:32.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:01:32.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:01:32.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:01:32.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:01:32.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:01:32.782 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:01:33.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:33 smithi049 ceph-mon[132694]: pgmap v740: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:33.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:33 smithi161 ceph-mon[113442]: pgmap v740: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:35.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:35 smithi049 ceph-mon[132694]: pgmap v741: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:35.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:35 smithi161 ceph-mon[113442]: pgmap v741: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:37.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:37 smithi049 ceph-mon[132694]: pgmap v742: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:37.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:37 smithi161 ceph-mon[113442]: pgmap v742: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:39.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:39 smithi049 ceph-mon[132694]: pgmap v743: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:39.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:39 smithi161 ceph-mon[113442]: pgmap v743: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:41.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:41 smithi049 ceph-mon[132694]: pgmap v744: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:41.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:41 smithi161 ceph-mon[113442]: pgmap v744: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:43.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:43 smithi049 ceph-mon[132694]: pgmap v745: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:43.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:01:43.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:43 smithi161 ceph-mon[113442]: pgmap v745: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:43.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:01:45.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:45 smithi049 ceph-mon[132694]: pgmap v746: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:45.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:45 smithi161 ceph-mon[113442]: pgmap v746: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:47.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:47 smithi049 ceph-mon[132694]: pgmap v747: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:47.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:47 smithi161 ceph-mon[113442]: pgmap v747: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:49.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:49 smithi049 ceph-mon[132694]: pgmap v748: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:49.874 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:49 smithi161 ceph-mon[113442]: pgmap v748: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:51.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:51 smithi049 ceph-mon[132694]: pgmap v749: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:51.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:51 smithi161 ceph-mon[113442]: pgmap v749: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:53.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:53 smithi049 ceph-mon[132694]: pgmap v750: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:53.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:53 smithi161 ceph-mon[113442]: pgmap v750: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:55.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:55 smithi049 ceph-mon[132694]: pgmap v751: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:55.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:55 smithi161 ceph-mon[113442]: pgmap v751: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:57.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:57 smithi049 ceph-mon[132694]: pgmap v752: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:57.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:57 smithi161 ceph-mon[113442]: pgmap v752: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:58.667 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:01:58.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:01:59.666 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:01:59 smithi049 ceph-mon[132694]: pgmap v753: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:01:59.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:01:59 smithi161 ceph-mon[113442]: pgmap v753: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:01.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:01 smithi049 ceph-mon[132694]: pgmap v754: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:01.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:01 smithi161 ceph-mon[113442]: pgmap v754: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:03.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:03 smithi049 ceph-mon[132694]: pgmap v755: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:03.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:03 smithi161 ceph-mon[113442]: pgmap v755: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:05.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:05 smithi049 ceph-mon[132694]: pgmap v756: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:05.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:05 smithi161 ceph-mon[113442]: pgmap v756: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:07.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:07 smithi049 ceph-mon[132694]: pgmap v757: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:07.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:07 smithi161 ceph-mon[113442]: pgmap v757: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:09.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:09 smithi049 ceph-mon[132694]: pgmap v758: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:09.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:09 smithi161 ceph-mon[113442]: pgmap v758: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:11.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:11 smithi049 ceph-mon[132694]: pgmap v759: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:11.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:11 smithi161 ceph-mon[113442]: pgmap v759: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:13.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:13 smithi049 ceph-mon[132694]: pgmap v760: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:13.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:02:13.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:13 smithi161 ceph-mon[113442]: pgmap v760: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:13.781 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:02:15.669 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:15 smithi049 ceph-mon[132694]: pgmap v761: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:15.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:15 smithi161 ceph-mon[113442]: pgmap v761: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:17.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:17 smithi049 ceph-mon[132694]: pgmap v762: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:17.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:17 smithi161 ceph-mon[113442]: pgmap v762: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:19.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:19 smithi049 ceph-mon[132694]: pgmap v763: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:19.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:19 smithi161 ceph-mon[113442]: pgmap v763: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:21.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:21 smithi049 ceph-mon[132694]: pgmap v764: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:21.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:21 smithi161 ceph-mon[113442]: pgmap v764: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:23.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:23 smithi049 ceph-mon[132694]: pgmap v765: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:23.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:23 smithi161 ceph-mon[113442]: pgmap v765: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:25.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:25 smithi049 ceph-mon[132694]: pgmap v766: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:25.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:25 smithi161 ceph-mon[113442]: pgmap v766: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:27.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:27 smithi049 ceph-mon[132694]: pgmap v767: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:27.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:27 smithi161 ceph-mon[113442]: pgmap v767: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:28.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:02:28.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:02:29.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:29 smithi049 ceph-mon[132694]: pgmap v768: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:29.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:29 smithi161 ceph-mon[113442]: pgmap v768: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:31.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:31 smithi049 ceph-mon[132694]: pgmap v769: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:31.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:31 smithi161 ceph-mon[113442]: pgmap v769: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:32.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:32 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:02:32.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:32 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:02:33.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:33 smithi049 ceph-mon[132694]: pgmap v770: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:33.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:02:33.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:02:33.665 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:02:33.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:33 smithi161 ceph-mon[113442]: pgmap v770: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:33.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:02:33.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:02:33.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:02:35.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:35 smithi049 ceph-mon[132694]: pgmap v771: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:35.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:35 smithi161 ceph-mon[113442]: pgmap v771: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:37.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:37 smithi049 ceph-mon[132694]: pgmap v772: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:37.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:37 smithi161 ceph-mon[113442]: pgmap v772: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:39.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:39 smithi049 ceph-mon[132694]: pgmap v773: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:39.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:39 smithi161 ceph-mon[113442]: pgmap v773: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:41.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:41 smithi049 ceph-mon[132694]: pgmap v774: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:41.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:41 smithi161 ceph-mon[113442]: pgmap v774: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:42.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:02:42.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:02:43.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:43 smithi049 ceph-mon[132694]: pgmap v775: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:43.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:43 smithi161 ceph-mon[113442]: pgmap v775: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:45.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:45 smithi049 ceph-mon[132694]: pgmap v776: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:45.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:45 smithi161 ceph-mon[113442]: pgmap v776: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:47.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:47 smithi161 ceph-mon[113442]: pgmap v777: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:47.914 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:47 smithi049 ceph-mon[132694]: pgmap v777: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:49.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:49 smithi161 ceph-mon[113442]: pgmap v778: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:49.914 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:49 smithi049 ceph-mon[132694]: pgmap v778: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:51.755 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:51 smithi049 ceph-mon[132694]: pgmap v779: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:51.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:51 smithi161 ceph-mon[113442]: pgmap v779: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:53.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:53 smithi161 ceph-mon[113442]: pgmap v780: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:53.914 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:53 smithi049 ceph-mon[132694]: pgmap v780: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:55.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:55 smithi161 ceph-mon[113442]: pgmap v781: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:55.914 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:55 smithi049 ceph-mon[132694]: pgmap v781: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:57.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:57 smithi161 ceph-mon[113442]: pgmap v782: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:57.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:02:57.914 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:57 smithi049 ceph-mon[132694]: pgmap v782: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:57.914 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:02:58.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:02:58 smithi161 ceph-mon[113442]: pgmap v783: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:02:58.914 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:02:58 smithi049 ceph-mon[132694]: pgmap v783: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:01.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:01 smithi161 ceph-mon[113442]: pgmap v784: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:01.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:01 smithi049 ceph-mon[132694]: pgmap v784: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:03.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:03 smithi161 ceph-mon[113442]: pgmap v785: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:03.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:03 smithi049 ceph-mon[132694]: pgmap v785: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:05.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:05 smithi161 ceph-mon[113442]: pgmap v786: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:05.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:05 smithi049 ceph-mon[132694]: pgmap v786: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:07.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:07 smithi161 ceph-mon[113442]: pgmap v787: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:07.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:07 smithi049 ceph-mon[132694]: pgmap v787: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:09.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:09 smithi161 ceph-mon[113442]: pgmap v788: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:09.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:09 smithi049 ceph-mon[132694]: pgmap v788: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:11.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:11 smithi161 ceph-mon[113442]: pgmap v789: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:11.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:11 smithi049 ceph-mon[132694]: pgmap v789: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:13.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:13 smithi161 ceph-mon[113442]: pgmap v790: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:13.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:03:13.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:13 smithi049 ceph-mon[132694]: pgmap v790: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:13.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:03:15.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:15 smithi161 ceph-mon[113442]: pgmap v791: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:15.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:15 smithi049 ceph-mon[132694]: pgmap v791: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:17.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:17 smithi161 ceph-mon[113442]: pgmap v792: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:17.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:17 smithi049 ceph-mon[132694]: pgmap v792: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:19.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:19 smithi161 ceph-mon[113442]: pgmap v793: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:19.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:19 smithi049 ceph-mon[132694]: pgmap v793: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:21.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:21 smithi161 ceph-mon[113442]: pgmap v794: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:21.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:21 smithi049 ceph-mon[132694]: pgmap v794: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:23.529 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:23 smithi161 ceph-mon[113442]: pgmap v795: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:23.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:23 smithi049 ceph-mon[132694]: pgmap v795: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:25.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:25 smithi049 ceph-mon[132694]: pgmap v796: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:25.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:25 smithi161 ceph-mon[113442]: pgmap v796: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:27.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:27 smithi049 ceph-mon[132694]: pgmap v797: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:27.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:27 smithi161 ceph-mon[113442]: pgmap v797: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:28.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:03:28.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:03:29.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:29 smithi049 ceph-mon[132694]: pgmap v798: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:29.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:29 smithi161 ceph-mon[113442]: pgmap v798: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:31.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:31 smithi049 ceph-mon[132694]: pgmap v799: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:31.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:31 smithi161 ceph-mon[113442]: pgmap v799: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:33.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:33 smithi049 ceph-mon[132694]: pgmap v800: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:33.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:03:33.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:03:33.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:03:33.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:33 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:03:33.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:33 smithi161 ceph-mon[113442]: pgmap v800: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:33.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:03:33.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:03:33.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:03:33.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:33 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:03:35.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:35 smithi049 ceph-mon[132694]: pgmap v801: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:35.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:35 smithi161 ceph-mon[113442]: pgmap v801: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:37.664 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:37 smithi049 ceph-mon[132694]: pgmap v802: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:37.779 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:37 smithi161 ceph-mon[113442]: pgmap v802: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:39.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:39 smithi049 ceph-mon[132694]: pgmap v803: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:39.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:39 smithi161 ceph-mon[113442]: pgmap v803: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:41.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:41 smithi049 ceph-mon[132694]: pgmap v804: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:41.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:41 smithi161 ceph-mon[113442]: pgmap v804: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:43.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:43 smithi049 ceph-mon[132694]: pgmap v805: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:43.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:43 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:03:43.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:43 smithi161 ceph-mon[113442]: pgmap v805: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:43.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:43 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:03:45.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:45 smithi049 ceph-mon[132694]: pgmap v806: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:45.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:45 smithi161 ceph-mon[113442]: pgmap v806: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:47.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:47 smithi049 ceph-mon[132694]: pgmap v807: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:47.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:47 smithi161 ceph-mon[113442]: pgmap v807: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:49.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:49 smithi049 ceph-mon[132694]: pgmap v808: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:49.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:49 smithi161 ceph-mon[113442]: pgmap v808: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:51.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:51 smithi049 ceph-mon[132694]: pgmap v809: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:51.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:51 smithi161 ceph-mon[113442]: pgmap v809: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:53.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:53 smithi049 ceph-mon[132694]: pgmap v810: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:53.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:53 smithi161 ceph-mon[113442]: pgmap v810: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:55.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:55 smithi049 ceph-mon[132694]: pgmap v811: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:55.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:55 smithi161 ceph-mon[113442]: pgmap v811: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:57.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:57 smithi049 ceph-mon[132694]: pgmap v812: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:57.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:57 smithi161 ceph-mon[113442]: pgmap v812: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:58.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:58 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:03:58.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:58 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:03:59.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:03:59 smithi049 ceph-mon[132694]: pgmap v813: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:03:59.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:03:59 smithi161 ceph-mon[113442]: pgmap v813: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:01.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:01 smithi049 ceph-mon[132694]: pgmap v814: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:01.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:01 smithi161 ceph-mon[113442]: pgmap v814: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:03.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:03 smithi049 ceph-mon[132694]: pgmap v815: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:03.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:03 smithi161 ceph-mon[113442]: pgmap v815: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:05.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:05 smithi049 ceph-mon[132694]: pgmap v816: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:05.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:05 smithi161 ceph-mon[113442]: pgmap v816: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:07.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:07 smithi049 ceph-mon[132694]: pgmap v817: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:07.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:07 smithi161 ceph-mon[113442]: pgmap v817: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:09.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:09 smithi049 ceph-mon[132694]: pgmap v818: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:09.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:09 smithi161 ceph-mon[113442]: pgmap v818: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:11.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:11 smithi049 ceph-mon[132694]: pgmap v819: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:11.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:11 smithi161 ceph-mon[113442]: pgmap v819: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:13.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:13 smithi049 ceph-mon[132694]: pgmap v820: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:13.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:04:13.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:13 smithi161 ceph-mon[113442]: pgmap v820: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:13.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:04:15.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:15 smithi049 ceph-mon[132694]: pgmap v821: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:15.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:15 smithi161 ceph-mon[113442]: pgmap v821: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:17.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:17 smithi049 ceph-mon[132694]: pgmap v822: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:17.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:17 smithi161 ceph-mon[113442]: pgmap v822: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:19.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:19 smithi049 ceph-mon[132694]: pgmap v823: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:19.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:19 smithi161 ceph-mon[113442]: pgmap v823: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:21.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:21 smithi049 ceph-mon[132694]: pgmap v824: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:21.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:21 smithi161 ceph-mon[113442]: pgmap v824: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:23.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:23 smithi049 ceph-mon[132694]: pgmap v825: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:23.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:23 smithi161 ceph-mon[113442]: pgmap v825: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:25.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:25 smithi049 ceph-mon[132694]: pgmap v826: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:25.780 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:25 smithi161 ceph-mon[113442]: pgmap v826: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:27.663 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:27 smithi049 ceph-mon[132694]: pgmap v827: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:27.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:27 smithi161 ceph-mon[113442]: pgmap v827: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:28.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:28 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:04:28.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:28 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:04:29.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:29 smithi049 ceph-mon[132694]: pgmap v828: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:29.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:29 smithi161 ceph-mon[113442]: pgmap v828: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:31.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:31 smithi049 ceph-mon[132694]: pgmap v829: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:31.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:31 smithi161 ceph-mon[113442]: pgmap v829: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:33.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:33 smithi049 ceph-mon[132694]: pgmap v830: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:33.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:33 smithi161 ceph-mon[113442]: pgmap v830: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:34.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:04:34.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:04:34.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:04:34.675 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:34 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:04:34.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T01:04:34.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T01:04:34.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-22T01:04:34.778 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:34 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' 2024-02-22T01:04:35.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:35 smithi049 ceph-mon[132694]: pgmap v831: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:35.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:35 smithi161 ceph-mon[113442]: pgmap v831: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:37.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:37 smithi049 ceph-mon[132694]: pgmap v832: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:37.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:37 smithi161 ceph-mon[113442]: pgmap v832: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:39.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:39 smithi049 ceph-mon[132694]: pgmap v833: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:39.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:39 smithi161 ceph-mon[113442]: pgmap v833: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:41.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:41 smithi049 ceph-mon[132694]: pgmap v834: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:41.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:41 smithi161 ceph-mon[113442]: pgmap v834: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:42.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:42 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:04:42.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:42 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:04:43.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:43 smithi049 ceph-mon[132694]: pgmap v835: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:43.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:43 smithi161 ceph-mon[113442]: pgmap v835: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:45.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:45 smithi049 ceph-mon[132694]: pgmap v836: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:45.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:45 smithi161 ceph-mon[113442]: pgmap v836: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:47.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:47 smithi161 ceph-mon[113442]: pgmap v837: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:47.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:47 smithi049 ceph-mon[132694]: pgmap v837: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:49.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:49 smithi161 ceph-mon[113442]: pgmap v838: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:49.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:49 smithi049 ceph-mon[132694]: pgmap v838: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:51.753 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:51 smithi049 ceph-mon[132694]: pgmap v839: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:51.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:51 smithi161 ceph-mon[113442]: pgmap v839: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:53.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:53 smithi161 ceph-mon[113442]: pgmap v840: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:53.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:53 smithi049 ceph-mon[132694]: pgmap v840: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:55.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:55 smithi161 ceph-mon[113442]: pgmap v841: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:55.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:55 smithi049 ceph-mon[132694]: pgmap v841: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:57.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:57 smithi161 ceph-mon[113442]: pgmap v842: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:57.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:57 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:04:57.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:57 smithi049 ceph-mon[132694]: pgmap v842: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:57.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:57 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:04:59.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:04:59 smithi161 ceph-mon[113442]: pgmap v843: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:04:59.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:04:59 smithi049 ceph-mon[132694]: pgmap v843: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:01.753 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:01 smithi049 ceph-mon[132694]: pgmap v844: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:01.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:01 smithi161 ceph-mon[113442]: pgmap v844: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:03.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:03 smithi161 ceph-mon[113442]: pgmap v845: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:03.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:03 smithi049 ceph-mon[132694]: pgmap v845: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:05.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:05 smithi161 ceph-mon[113442]: pgmap v846: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:05.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:05 smithi049 ceph-mon[132694]: pgmap v846: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:07.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:07 smithi161 ceph-mon[113442]: pgmap v847: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:07.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:07 smithi049 ceph-mon[132694]: pgmap v847: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:09.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:09 smithi161 ceph-mon[113442]: pgmap v848: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:09.912 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:09 smithi049 ceph-mon[132694]: pgmap v848: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:11.527 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:11 smithi161 ceph-mon[113442]: pgmap v849: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:11.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:11 smithi049 ceph-mon[132694]: pgmap v849: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:13.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:13 smithi049 ceph-mon[132694]: pgmap v850: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:13.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:13 smithi049 ceph-mon[132694]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:05:13.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:13 smithi161 ceph-mon[113442]: pgmap v850: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:13.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:13 smithi161 ceph-mon[113442]: from='mgr.34104 172.21.15.49:0/2623123846' entity='mgr.smithi049.rjblpr' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-22T01:05:15.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:15 smithi049 ceph-mon[132694]: pgmap v851: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:15.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:15 smithi161 ceph-mon[113442]: pgmap v851: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:17.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:17 smithi049 ceph-mon[132694]: pgmap v852: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:17.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:17 smithi161 ceph-mon[113442]: pgmap v852: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:19.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:19 smithi049 ceph-mon[132694]: pgmap v853: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:19.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:19 smithi161 ceph-mon[113442]: pgmap v853: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:21.662 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:21 smithi049 ceph-mon[132694]: pgmap v854: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:21.777 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:21 smithi161 ceph-mon[113442]: pgmap v854: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:23.661 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:23 smithi049 ceph-mon[132694]: pgmap v855: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:23.768 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-02-22T01:05:23.768 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-22T01:05:23.770 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-22T01:05:23.782 INFO:tasks.cephadm:Teardown begin 2024-02-22T01:05:23.782 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/cephadm.py", line 1750, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-22T01:05:23.783 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T01:05:23.784 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:23 smithi161 ceph-mon[113442]: pgmap v855: 65 pgs: 65 active+clean; 257 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-02-22T01:05:23.821 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T01:05:23.860 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-22T01:05:23.860 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-22T01:05:23.883 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-22T01:05:23.921 INFO:tasks.cephadm:Stopping all daemons... 2024-02-22T01:05:23.921 INFO:tasks.cephadm.mon.smithi049:Stopping mon.smithi049... 2024-02-22T01:05:23.921 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi049 2024-02-22T01:05:24.162 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:23 smithi049 systemd[1]: Stopping Ceph mon.smithi049 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T01:05:24.588 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[132671]: 2024-02-22T01:05:24.240+0000 7f8aee612700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi049 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-22T01:05:24.588 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:24 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049[132671]: 2024-02-22T01:05:24.240+0000 7f8aee612700 -1 mon.smithi049@0(leader) e3 *** Got Signal Terminated *** 2024-02-22T01:05:24.911 INFO:journalctl@ceph.mon.smithi049.smithi049.stdout:Feb 22 01:05:24 smithi049 bash[188981]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi049 2024-02-22T01:05:25.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi049.service' 2024-02-22T01:05:25.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T01:05:25.207 INFO:tasks.cephadm.mon.smithi049:Stopped mon.smithi049 2024-02-22T01:05:25.207 INFO:tasks.cephadm.mon.smithi161:Stopping mon.smithi161... 2024-02-22T01:05:25.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi161 2024-02-22T01:05:25.527 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:25 smithi161 systemd[1]: Stopping Ceph mon.smithi161 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T01:05:25.834 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[113419]: 2024-02-22T01:05:25.541+0000 7fe6706ab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi161 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-22T01:05:25.834 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:25 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161[113419]: 2024-02-22T01:05:25.541+0000 7fe6706ab700 -1 mon.smithi161@1(peon) e3 *** Got Signal Terminated *** 2024-02-22T01:05:26.276 INFO:journalctl@ceph.mon.smithi161.smithi161.stdout:Feb 22 01:05:26 smithi161 bash[157391]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-mon-smithi161 2024-02-22T01:05:26.438 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@mon.smithi161.service' 2024-02-22T01:05:26.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T01:05:26.485 INFO:tasks.cephadm.mon.smithi161:Stopped mon.smithi161 2024-02-22T01:05:26.485 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-22T01:05:26.485 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.0 2024-02-22T01:05:26.789 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 01:05:26 smithi049 systemd[1]: Stopping Ceph osd.0 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T01:05:27.161 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 01:05:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[147442]: 2024-02-22T01:05:26.803+0000 7f4e88e2d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-22T01:05:27.162 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 01:05:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[147442]: 2024-02-22T01:05:26.803+0000 7f4e88e2d700 -1 osd.0 84 *** Got signal Terminated *** 2024-02-22T01:05:27.162 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 01:05:26 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0[147442]: 2024-02-22T01:05:26.803+0000 7f4e88e2d700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T01:05:32.911 INFO:journalctl@ceph.osd.0.smithi049.stdout:Feb 22 01:05:32 smithi049 bash[189141]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-0 2024-02-22T01:05:34.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.0.service' 2024-02-22T01:05:34.771 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T01:05:34.771 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-22T01:05:34.771 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-22T01:05:34.771 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.1 2024-02-22T01:05:35.048 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 01:05:34 smithi049 systemd[1]: Stopping Ceph osd.1 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T01:05:35.411 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 01:05:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[154636]: 2024-02-22T01:05:35.061+0000 7f4b468d3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-22T01:05:35.411 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 01:05:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[154636]: 2024-02-22T01:05:35.061+0000 7f4b468d3700 -1 osd.1 84 *** Got signal Terminated *** 2024-02-22T01:05:35.412 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 01:05:35 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1[154636]: 2024-02-22T01:05:35.061+0000 7f4b468d3700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T01:05:41.161 INFO:journalctl@ceph.osd.1.smithi049.stdout:Feb 22 01:05:40 smithi049 bash[189412]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-1 2024-02-22T01:05:42.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.1.service' 2024-02-22T01:05:42.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T01:05:42.473 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-22T01:05:42.473 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-22T01:05:42.473 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.2 2024-02-22T01:05:42.766 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 01:05:42 smithi049 systemd[1]: Stopping Ceph osd.2 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T01:05:43.161 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 01:05:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[161812]: 2024-02-22T01:05:42.780+0000 7f202a4c4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-22T01:05:43.161 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 01:05:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[161812]: 2024-02-22T01:05:42.780+0000 7f202a4c4700 -1 osd.2 84 *** Got signal Terminated *** 2024-02-22T01:05:43.162 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 01:05:42 smithi049 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2[161812]: 2024-02-22T01:05:42.780+0000 7f202a4c4700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T01:05:48.911 INFO:journalctl@ceph.osd.2.smithi049.stdout:Feb 22 01:05:48 smithi049 bash[189677]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-2 2024-02-22T01:05:50.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.2.service' 2024-02-22T01:05:50.304 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T01:05:50.304 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-22T01:05:50.304 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-22T01:05:50.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.3 2024-02-22T01:05:50.776 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 01:05:50 smithi161 systemd[1]: Stopping Ceph osd.3 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T01:05:50.776 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 01:05:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[126212]: 2024-02-22T01:05:50.596+0000 7f94c2021700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-22T01:05:50.776 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 01:05:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[126212]: 2024-02-22T01:05:50.596+0000 7f94c2021700 -1 osd.3 84 *** Got signal Terminated *** 2024-02-22T01:05:50.777 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 01:05:50 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3[126212]: 2024-02-22T01:05:50.596+0000 7f94c2021700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T01:05:53.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:53 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:53.422+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:05:54.526 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:54.410+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:05:54.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:05:54 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:05:54.162+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:05:55.526 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:55.380+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:05:55.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:05:55 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:05:55.184+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:05:56.395 INFO:journalctl@ceph.osd.3.smithi161.stdout:Feb 22 01:05:56 smithi161 bash[157549]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-3 2024-02-22T01:05:56.395 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:05:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:05:56.159+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:05:56.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:56 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:56.409+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:05:57.434 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:05:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:05:57.199+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:05:57.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:57 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:57.448+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:05:58.077 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.3.service' 2024-02-22T01:05:58.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T01:05:58.120 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-22T01:05:58.120 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-22T01:05:58.120 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.4 2024-02-22T01:05:58.430 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:58 smithi161 systemd[1]: Stopping Ceph osd.4 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T01:05:58.430 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:05:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:05:58.227+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:05:58.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:58.445+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:05:58.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:58.465+0000 7f8c6e3b2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-22T01:05:58.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:58.465+0000 7f8c6e3b2700 -1 osd.4 84 *** Got signal Terminated *** 2024-02-22T01:05:58.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:58 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:58.465+0000 7f8c6e3b2700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T01:05:59.526 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:05:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:05:59.469+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:05:59.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:05:59 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:05:59.274+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:00.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:00.283+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:00.527 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:06:00 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:06:00.494+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:06:01.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:01.281+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:01.526 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:06:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:06:01.512+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:06:01.526 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:06:01 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:06:01.512+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-02-22T01:05:34.739991+0000 front 2024-02-22T01:05:34.740080+0000 (oldest deadline 2024-02-22T01:06:00.639842+0000) 2024-02-22T01:06:02.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:06:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:06:02.532+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:28.939567+0000 front 2024-02-22T01:05:28.939415+0000 (oldest deadline 2024-02-22T01:05:53.039225+0000) 2024-02-22T01:06:02.776 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:06:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4[133098]: 2024-02-22T01:06:02.532+0000 7f8c699a6700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-02-22T01:05:34.739991+0000 front 2024-02-22T01:05:34.740080+0000 (oldest deadline 2024-02-22T01:06:00.639842+0000) 2024-02-22T01:06:02.777 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:02 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:02.325+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:03.776 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:03 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:03.313+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:04.526 INFO:journalctl@ceph.osd.4.smithi161.stdout:Feb 22 01:06:04 smithi161 bash[157815]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-4 2024-02-22T01:06:04.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:04 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:04.346+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:05.719 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:05 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:05.314+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:06.045 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.4.service' 2024-02-22T01:06:06.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T01:06:06.087 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-22T01:06:06.087 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-22T01:06:06.087 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.5 2024-02-22T01:06:06.299 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:06 smithi161 systemd[1]: Stopping Ceph osd.5 for 9923b37e-d118-11ee-95bd-87774f69a715... 2024-02-22T01:06:06.776 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:06.313+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:06.776 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:06.313+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-02-22T01:05:40.061766+0000 front 2024-02-22T01:05:40.061849+0000 (oldest deadline 2024-02-22T01:06:05.961620+0000) 2024-02-22T01:06:06.776 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:06.406+0000 7f003379c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-22T01:06:06.776 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:06.406+0000 7f003379c700 -1 osd.5 84 *** Got signal Terminated *** 2024-02-22T01:06:06.776 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:06 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:06.406+0000 7f003379c700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T01:06:07.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:07.280+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:07.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:07 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:07.280+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-02-22T01:05:40.061766+0000 front 2024-02-22T01:05:40.061849+0000 (oldest deadline 2024-02-22T01:06:05.961620+0000) 2024-02-22T01:06:08.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:08.274+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:08.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:08 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:08.274+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-02-22T01:05:40.061766+0000 front 2024-02-22T01:05:40.061849+0000 (oldest deadline 2024-02-22T01:06:05.961620+0000) 2024-02-22T01:06:09.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:09.286+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:09.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:09 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:09.286+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-02-22T01:05:40.061766+0000 front 2024-02-22T01:05:40.061849+0000 (oldest deadline 2024-02-22T01:06:05.961620+0000) 2024-02-22T01:06:10.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:10.263+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:10.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:10 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:10.263+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-02-22T01:05:40.061766+0000 front 2024-02-22T01:05:40.061849+0000 (oldest deadline 2024-02-22T01:06:05.961620+0000) 2024-02-22T01:06:11.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:11.235+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-02-22T01:05:30.260204+0000 front 2024-02-22T01:05:30.260179+0000 (oldest deadline 2024-02-22T01:05:53.760077+0000) 2024-02-22T01:06:11.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:11 smithi161 ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5[139325]: 2024-02-22T01:06:11.235+0000 7f002e58f700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.49:6814 osd.1 since back 2024-02-22T01:05:40.061766+0000 front 2024-02-22T01:05:40.061849+0000 (oldest deadline 2024-02-22T01:06:05.961620+0000) 2024-02-22T01:06:12.526 INFO:journalctl@ceph.osd.5.smithi161.stdout:Feb 22 01:06:12 smithi161 bash[158081]: ceph-9923b37e-d118-11ee-95bd-87774f69a715-osd-5 2024-02-22T01:06:14.039 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9923b37e-d118-11ee-95bd-87774f69a715@osd.5.service' 2024-02-22T01:06:14.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T01:06:14.081 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-22T01:06:14.081 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9923b37e-d118-11ee-95bd-87774f69a715 --force --keep-logs 2024-02-22T01:06:19.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi049.stderr:ceph-fuse[106471]: fuse finished with error 0 and tester_r 0 2024-02-22T01:06:32.581 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9923b37e-d118-11ee-95bd-87774f69a715 --force --keep-logs 2024-02-22T01:06:47.977 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T01:06:48.015 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T01:06:48.046 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-22T01:06:48.047 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191/remote/smithi049/crash 2024-02-22T01:06:48.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/crash -- . 2024-02-22T01:06:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:tar: /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/crash: Cannot open: No such file or directory 2024-02-22T01:06:48.088 INFO:teuthology.orchestra.run.smithi049.stderr:tar: Error is not recoverable: exiting now 2024-02-22T01:06:48.090 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191/remote/smithi161/crash 2024-02-22T01:06:48.091 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/crash -- . 2024-02-22T01:06:48.116 INFO:teuthology.orchestra.run.smithi161.stderr:tar: /var/lib/ceph/9923b37e-d118-11ee-95bd-87774f69a715/crash: Cannot open: No such file or directory 2024-02-22T01:06:48.116 INFO:teuthology.orchestra.run.smithi161.stderr:tar: Error is not recoverable: exiting now 2024-02-22T01:06:48.117 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-22T01:06:48.117 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9923b37e-d118-11ee-95bd-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-22T01:06:48.163 INFO:teuthology.orchestra.run.smithi049.stderr:grep: /var/log/ceph/9923b37e-d118-11ee-95bd-87774f69a715/ceph.log: No such file or directory 2024-02-22T01:06:48.165 INFO:tasks.cephadm:Compressing logs... 2024-02-22T01:06:48.165 DEBUG:teuthology.orchestra.run.smithi049:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-22T01:06:48.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-22T01:06:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-22T01:06:48.235 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-22T01:07:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-02-22T01:07:06.952 INFO:teuthology.orchestra.run.smithi049.stderr:gzip: /var/log/ceph/ceph-client.0.log: file size changed while zipping 2024-02-22T01:08:36.504 INFO:tasks.cephadm:Archiving logs... 2024-02-22T01:08:36.506 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191/remote/smithi049/log 2024-02-22T01:08:36.507 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-22T01:08:48.652 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191/remote/smithi161/log 2024-02-22T01:08:48.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-22T01:08:58.033 INFO:tasks.cephadm:Removing cluster... 2024-02-22T01:08:58.033 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9923b37e-d118-11ee-95bd-87774f69a715 --force 2024-02-22T01:08:58.588 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9923b37e-d118-11ee-95bd-87774f69a715 --force 2024-02-22T01:08:59.085 INFO:tasks.cephadm:Removing cephadm ... 2024-02-22T01:08:59.085 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-22T01:08:59.104 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-22T01:08:59.122 INFO:tasks.cephadm:Teardown complete 2024-02-22T01:08:59.122 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-22T01:08:59.133 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-22T01:08:59.134 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-22T01:08:59.134 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-22T01:08:59.147 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-22T01:08:59.237 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-22T01:08:59.248 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-22T01:08:59.249 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T01:08:59.251 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T01:08:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:bash: ntpq: command not found 2024-02-22T01:08:59.267 INFO:teuthology.orchestra.run.smithi161.stderr:bash: ntpq: command not found 2024-02-22T01:08:59.270 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-22T01:08:59.271 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-02-22T01:08:59.271 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 +11us[ +11us] +/- 104ms 2024-02-22T01:08:59.271 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv02.front.sepia.ceph.com 3 7 377 38 +73us[ +68us] +/- 56ms 2024-02-22T01:08:59.271 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 111 -135us[ -140us] +/- 86ms 2024-02-22T01:08:59.271 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T01:08:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-22T01:08:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-02-22T01:08:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 39 +17us[ +17us] +/- 103ms 2024-02-22T01:08:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 +61us[ +56us] +/- 56ms 2024-02-22T01:08:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -138us[ -143us] +/- 87ms 2024-02-22T01:08:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T01:08:59.273 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-22T01:08:59.284 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-22T01:08:59.284 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-22T01:08:59.295 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-22T01:08:59.386 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-22T01:08:59.453 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-22T01:08:59.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T01:08:59.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-22T01:08:59.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T01:08:59.515 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-22T01:08:59.526 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-22T01:08:59.537 INFO:teuthology.task.internal:Duration was 4284.842449 seconds 2024-02-22T01:08:59.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-22T01:08:59.548 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-22T01:08:59.548 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-22T01:08:59.551 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-22T01:08:59.597 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-22T01:08:59.601 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-22T01:08:59.921 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-22T01:08:59.921 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-02-22T01:08:59.921 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-22T01:08:59.946 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-02-22T01:08:59.946 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-22T01:08:59.969 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-22T01:08:59.969 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-22T01:08:59.988 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-22T01:09:00.070 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-22T01:09:00.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-22T01:09:00.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-22T01:09:00.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-22T01:09:00.234 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-22T01:09:00.234 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-22T01:09:00.262 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-22T01:09:00.290 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-22T01:09:00.302 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-22T01:09:00.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-22T01:09:00.329 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-02-22T01:09:00.356 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-02-22T01:09:00.387 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-22T01:09:00.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T01:09:00.410 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-22T01:09:00.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T01:09:00.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-22T01:09:00.459 INFO:teuthology.task.internal:Transferring archived files... 2024-02-22T01:09:00.460 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191/remote/smithi049 2024-02-22T01:09:00.460 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-22T01:09:00.507 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191/remote/smithi161 2024-02-22T01:09:00.507 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-22T01:09:00.550 INFO:teuthology.task.internal:Removing archive directory... 2024-02-22T01:09:00.550 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-22T01:09:00.552 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-22T01:09:00.600 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-22T01:09:00.613 INFO:teuthology.task.internal:Not uploading archives. 2024-02-22T01:09:00.614 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-22T01:09:00.626 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-22T01:09:00.626 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-22T01:09:00.628 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-22T01:09:00.644 INFO:teuthology.orchestra.run.smithi049.stdout: 525364 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 22 01:09 /home/ubuntu/cephtest 2024-02-22T01:09:00.644 INFO:teuthology.orchestra.run.smithi049.stdout: 526838 4 d--------- 2 ubuntu ubuntu 4096 Feb 22 00:31 /home/ubuntu/cephtest/mnt.0 2024-02-22T01:09:00.644 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-02-22T01:09:00.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T01:09:00.645 INFO:teuthology.orchestra.run.smithi049.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-22T01:09:00.645 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_c1dc18f444603397768fcb7c34a8488b10284df6/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi049 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-22T01:09:00.646 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-22T01:09:00.659 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-22T01:09:00.672 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-22T01:09:00.672 INFO:teuthology.nuke:Checking targets against current locks 2024-02-22T01:09:00.700 DEBUG:teuthology.nuke:shortname: smithi049 2024-02-22T01:09:00.701 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-22T01:09:00.726 DEBUG:teuthology.nuke:shortname: smithi161 2024-02-22T01:09:00.726 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-22T01:09:00.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 23:24:57.977013', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHwlVrfVY0BiEVsdD9CfI+t0GU1XLPzOdSEmbhV6StIwczciyhpJv4W25CfFjSCjjiSUjcBcdPhNsnhmn3rbKLo='} 2024-02-22T01:09:00.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-21_23:06:32-fs-wip-yuri10-testing-2024-02-21-1249-reef-distro-default-smithi/7570191', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 23:24:57.975270', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5kR6KISUPHuUFM9/bYxOFY67OipMkuKQLuOJpm70mJDkLbVP0YT/++hnFGfLi41YpixpwzyfM6jfZ3mK9Ww5I='} 2024-02-22T01:09:00.778 INFO:teuthology.orchestra.console.smithi049:Power off 2024-02-22T01:09:00.778 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T01:09:00.804 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-02-22T01:09:00.805 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T01:09:00.821 INFO:teuthology.orchestra.console.smithi161:Power off 2024-02-22T01:09:00.822 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T01:09:00.834 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-02-22T01:09:00.845 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-02-22T01:09:00.845 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T01:09:00.874 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-22T01:09:04.835 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T01:09:04.875 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T01:09:04.945 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-02-22T01:09:04.984 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-22T01:09:08.950 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T01:09:08.985 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T01:09:09.061 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-02-22T01:09:09.095 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-02-22T01:09:09.163 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-02-22T01:09:13.097 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T01:09:13.210 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-02-22T01:09:13.311 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-02-22T01:09:13.415 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 4284.842449188232 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-02-22T01:09:13.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T01:09:13.502 INFO:teuthology.run:FAIL